Development of an Artificial Intelligence System for the Automatic Evaluation of Cervical Vertebral Maturation Status

Background: Cervical vertebral maturation (CVM) is widely used to evaluate growth potential in the field of orthodontics. This study is aimed to develop an artificial intelligence (AI) system to automatically determine the CVM status and evaluate the AI performance. Methods: A total of 1080 cephalometric radiographs, with the age of patients ranging from 6 to 22 years old, were included in the dataset (980 in training dataset and 100 in testing dataset). Two reference points and thirteen anatomical points were labelled and the cervical vertebral maturation staging (CS) was assessed by human examiners as gold standard. A convolutional neural network (CNN) model was built to train on 980 images and to test on 100 images. Statistical analysis was conducted to detect labelling differences between AI and human examiners, AI performance was also evaluated. Results: The mean labelling error between human examiners was 0.48 +/- 0.12 mm. The mean labelling error between AI and human examiners was 0.36 +/- 0.09 mm. In general, the agreement between AI results and the gold standard was good, with the intraclass correlation coefficient (ICC) value being up to 98%. Moreover, the accuracy of CVM staging was 71%. In terms of F1 score, CS6 stage (85%) ranked the highest accuracy. Conclusions: In this study, AI showed a good agreement with human examiners, being a useful and reliable tool in assessing the cervical vertebral maturation.

Automated summary

The study aimed to develop an AI system for automatically determining CVM status, and found that the AI system showed good agreement with human examiners in terms of labelling error. Additionally, the AI system demonstrated good accuracy in CVM staging and achieved high F1 scores, indicating its reliability and usefulness in evaluating cervical vertebral maturation.