Expert-augmented automated machine learning optimizes hemodynamic predictors of spinal cord injury outcome

Artificial intelligence and machine learning (AI/ML) is becoming increasingly more accessible to biomedical researchers with significant potential to transform biomedicine through optimization of highly-accurate predictive models and enabling better understanding of disease biology. Automated machine learning (AutoML) in particular is positioned to democratize artificial intelligence (AI) by reducing the amount of human input and ML expertise needed. However, successful translation of AI/ML in biomedicine requires moving beyond optimizing only for prediction accuracy and towards establishing reproducible clinical and biological inferences. This is especially challenging for clinical studies on rare disorders where the smaller patient cohorts and corresponding sample size is an obstacle for reproducible modeling results. Here, we present a model-agnostic framework to reinforce AutoML using strategies and tools of explainable and reproducible AI, including novel metrics to assess model reproducibility. The framework enables clinicians to interpret AutoML-generated models for clinical and biological verifiability and consequently integrate domain expertise during model development. We applied the framework towards spinal cord injury prognostication to optimize the intraoperative hemodynamic range during injury-related surgery and additionally identified a strong detrimental relationship between intraoperative hypertension and patient outcome. Furthermore, our analysis captured how evolving clinical practices such as faster time-to-surgery and blood pressure management affect clinical model development. Altogether, we illustrate how expert-augmented AutoML improves inferential reproducibility for biomedical discovery and can ultimately build trust in AI processes towards effective clinical integration.

Automated summary

Artificial intelligence and machine learning have the potential to transform biomedicine by optimizing predictive models and enhancing understanding of disease biology. Automated machine learning, in particular, can democratize AI by reducing the need for human input and expertise. However, successful application of AI and machine learning in biomedicine requires reproducible clinical and biological inferences, which is challenging for rare disorders with small patient cohorts. A model-agnostic framework that incorporates explainable and reproducible AI strategies is proposed to enhance AutoML and facilitate clinical interpretation and integration of expert knowledge.