AO Spine upper cervical injury classification system: a description and reliability study

BACKGROUND CONTEXT: Prior upper cervical spine injury classification systems have focused on injuries to the craniocervical junction (CCJ), atlas, and dens independently. However, no previous system has classified upper cervical spine injuries using a comprehensive system incorporating all injuries from the occiput to the C2-3 joint. PURPOSE: To (1) determine the accuracy of experts at correctly classifying upper cervical spine injuries based on the recently proposed AO Spine Upper Cervical Injury Classification System (2) to determine their interobserver reliability and (3) identify the intraobserver reproducibility of the experts. STUDY DESIGN/SETTING: International Multi-Center Survey. PATIENT SAMPLE: A survey of international spine surgeons on 29 unique upper cervical spine injuries. OUTCOME MEASURES: Classification accuracy, interobserver reliability, intraobserver reproducibility. METHODS: Thirteen international AO Spine Knowledge Forum Trauma members participated in two live webinar-based classifications of 29 upper cervical spine injuries presented in random order, four weeks apart. Percent agreement with the gold-standard and kappa coefficients (kappa) were calculated to determine the interobserver reliability and intraobserver reproducibility. RESULTS: Raters demonstrated 80.8% and 82.7% accuracy with identification of the injury classification (combined location and type) on the first and second assessment, respectively. Injury classification intraobserver reproducibility was excellent (mean, [range] kappa=0.82 [0.58-1.00]). Excellent interobserver reliability was found for injury location (kappa = 0.922 and kappa=0.912) on both assessments, while injury type was substantial (kappa=0.689 and 0.699) on both assessments. This correlated to a substantial overall interobserver reliability (kappa=0.729 and 0.732). CONCLUSIONS: Early phase validation demonstrated classification of upper cervical spine injuries using the AO Spine Upper Cervical Injury Classification System to be accurate, reliable, and reproducible. Greater than 80% accuracy was detected for injury classification. The intraobserver reproducibility was excellent, while the interobserver reliability was substantial. (c) 2022 AO Foundation, AO Spine, AO Network Clinical Research. Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)

Automated summary

This study validates the accuracy, reliability, and reproducibility of the AO Spine Upper Cervical Injury Classification System for classifying upper cervical spine injuries. The classification showed over 80% accuracy, excellent intraobserver reproducibility, and substantial interobserver reliability.