Analysis of inter-expert agreement when working with the AOSpine classification (TLCS, 2013): our experience, questions and contradictions
https://doi.org/10.14531/ss2019.4.13-20
Abstract
Objective. To assess inter-expert agreement among spine surgeons having different levels of clinical experience when working with the AOSpine classification (TLCS, 2013).
Materials and Methods. The study involved nine surgeons divided into three equal groups depending on work experience. All respondents were asked to classify the MSCT data of 50 patients with acute injuries to the thoracic and lumbar spine pursuant to TLCS (2013) classification. To evaluate inter-expert agreement, a Kappa coefficient interpreted according to Landis – Koch criteria was used.
Results. The overall coefficient of inter-expert agreement for all observations among all groups of respondents was 0.43, which reflects a moderate level of agreement. Moderate inter-expert agreement was revealed for injury types A (0.45) and C (0.56), and satisfactory – for type B (0.34). The highest levels of agreement were obtained for subtypes A1 (0.67) and A4 (0.80) in the group of advanced specialists and for type C (0.70) in the group of specialists with a basic level of experience.
Conclusion. The study demonstrated predominantly moderate level of inter-expert agreement when working with the AOSpine classification (TLCS, 2013). The accuracy of its use increases with a gain in practical experience of a surgeon.
Materials and Methods. The study involved nine surgeons divided into three equal groups depending on work experience. All respondents were asked to classify the MSCT data of 50 patients with acute injuries to the thoracic and lumbar spine pursuant to TLCS (2013) classification. To evaluate inter-expert agreement, a Kappa coefficient interpreted according to Landis – Koch criteria was used.
Results. The overall coefficient of inter-expert agreement for all observations among all groups of respondents was 0.43, which reflects a moderate level of agreement. Moderate inter-expert agreement was revealed for injury types A (0.45) and C (0.56), and satisfactory – for type B (0.34). The highest levels of agreement were obtained for subtypes A1 (0.67) and A4 (0.80) in the group of advanced specialists and for type C (0.70) in the group of specialists with a basic level of experience.
Conclusion. The study demonstrated predominantly moderate level of inter-expert agreement when working with the AOSpine classification (TLCS, 2013). The accuracy of its use increases with a gain in practical experience of a surgeon.
About the Authors
A. V. Dydykin
Privolzhsky Research Medical University
Russian Federation
Russian Federation
MD, PhD, neurosurgeon, junior researcher in the Group of Spine and Spinal Cord Pathology
10/1, Minina I Pozharskogo sq., Nizhny Novgorod, 603950, Russia
K. S. Yashin
Privolzhsky Research Medical University
Russian Federation
Russian Federation
MD, PhD, neurosurgeon, Department of Oncology and Neurosurgery (Cerebral Unit)
10/1, Minina I Pozharskogo sq., Nizhny Novgorod, 603950, Russia
A. E. Bokov
Privolzhsky Research Medical University
Russian Federation
Russian Federation
MD, PhD, neurosurgeon, Head of Neurosurgery Department, Trauma and Orthopedic Institute, University Clinic
10/1, Minina I Pozharskogo sq., Nizhny Novgorod, 603950, Russia
S. G. Mlyavykh
Privolzhsky Research Medical University
Russian Federation
Russian Federation
MD, PhD, neurosurgeon, Head of the Trauma and Orthopedic Institute, University Clinic
10/1, Minina I Pozharskogo sq., Nizhny Novgorod, 603950, Russia
References
1. Morozov IN, Mlyavykh SG. The epidemiology of vertebral-cerebrospinal trauma: review. Meditsinskyi Almanakh. 2011;(4):157–159. In Russian.
2. Alpantaki K, Bano A, Pasku D, Mavrogenis AF, Papagelopoulos PJ, Sapkas GS, Korres DS, Katonis P. Thoracolumbar burst fractures: a systematic review of management. Orthopedics. 2010;33:422–429. DOI: 10.3928/01477447-20100429-24.
3. DeWald RL. Burst fractures of the thoracic and lumbar spine. Clin Orthop Relat Res. 1984;(189):150–161.
4. Furlan, JC, Sakakibara BM, Miller WC, Krassioukov AV. Global incidence and prevalence of traumatic spinal cord injury. Can J Neurol Sci. 2013;40:456–464. DOI: 10.1017/s0317167100014530.
5. Singh A, Tetreault L, Kalsi-Ryan S, Nouri A, Fehlings MG. Global prevalence and incidence of traumatic spinal cord injury. Clin Epidemiol. 2014;6:309–331. DOI: 10.2147/CLEP.S68889.
6. Kolesov SV, Ptashnikov DA, Shvets VV. Injuries to the Spinal Cord and Spine, ed. by S.P. Mironov. Moscow, 2018. In Russian.
7. Cassar-Pullicino VN, Imhof H. Spinal Trauma – An Imaging Approach. Transl. under the general edition of Prof. Sh. Sh. Shotemor. Moscow, 2009. In Russian.
8. Schroeder GD, Harrop JS, Vaccaro AR. Thoracolumbar trauma classification. Neurosurg Clin N Am. 2017;28:23–29. DOI: 10.1016/j.nec.2016.07.007.
9. Patel AA, Vaccaro AR. Thoracolumbar spine trauma classification. J Am Acad Orthop Surg. 2010;18:63–71.
10. Sethi MK, Schoenfeld AJ, Bono CM, Harris MB. The evolution of thoracolumbar injury classification systems. Spine J. 2009;9:780–788. DOI: 10.1016/j.spinee.2009.04.003.
11. Vaccaro AR, Oner C, Kepler CK, Dvorak M, Schnake K, Bellabarba C, Reinhold M, Aarabi B, Kandziora F, Chapman J, Shanmuganathan R, Fehlings M, Vialle L. AOSpine thoracolumbar spine injury classification system: fracture description, neurological status and key modifiers. Spine. 2013;38:2028–2037. DOI: 10.1097/BRS.0b013e3182a8a381.
12. Kaul R, Chhabra HS, Vaccaro AR, Abel R, Tuli S, Shetty AP, Das KD, Mohapatra B, Nanda A, Sangondimath GM, Bansal ML, Patel N. Reliability assessment of AOSpine thoracolumbar spine injury classification system and Thoracolumbar Injury Classification and Severity Score (TLICS) for thoracolumbar spine injuries: results of a multicentre study. Eur Spine J. 2017;26:1470–1476. DOI: 10.1007/s00586-016-4663-5.
13. Cheng J, Liu P, Sun D, Qin T, Ma Z, Liu J. Reliability and reproducibility analysis of the AOSpine thoracolumbar spine injury classification system by Chinese spinal surgeons. Eur Spine J. 2017;26:1477–1482. DOI: 10.1007/s00586-016-4842-4.
14. Kepler CK, Vaccaro AR, Koerner JD, Dvorak MF, Kandziora F, Rajasekaran S, Aarabi B, Vialle LR, Fehlings MG, Schroeder GD, Reinhold M, Schnake KJ, Bellabarba C, Cumhur Oner F. Reliability analysis of the AOSpine thoracolumbar spine injury classification system by a worldwide group of naive spinal surgeons. Eur Spine J. 2016;25:1082–1086. DOI: 10.1007/s00586-015-3765-9.
15. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. DOI: 10.2307/2529310.
Review
For citations:
Dydykin A.V., Yashin K.S., Bokov A.E., Mlyavykh S.G. Analysis of inter-expert agreement when working with the AOSpine classification (TLCS, 2013): our experience, questions and contradictions. Russian Journal of Spine Surgery (Khirurgiya Pozvonochnika). 2019;16(4):13-20. https://doi.org/10.14531/ss2019.4.13-20
Email this article 