Advancing COVID-19 diagnosis with privacy-preserving collaboration in artificial intelligence

Artificial intelligence provides a promising solution for streamlining COVID-19 diagnoses; however, concerns surrounding security and trustworthiness impede the collection of large-scale representative medical data, posing a considerable challenge for training a well-generalized model in clinical practices. To address this, we launch the Unified CT-COVID AI Diagnostic Initiative (UCADI), where the artificial intelligence (AI) model can be distributedly trained and independently executed at each host institution under a federated learning framework without data sharing. Here we show that our federated learning framework model considerably outperformed all of the local models (with a test sensitivity/specificity of 0.973/0.951 in China and 0.730/0.942 in the United Kingdom), achieving comparable performance with a panel of professional radiologists. We further evaluated the model on the hold-out (collected from another two hospitals without the federated learning framework) and heterogeneous (acquired with contrast materials) data, provided visual explanations for decisions made by the model, and analysed the trade-offs between the model performance and the communication costs in the federated training process. Our study is based on 9,573 chest computed tomography scans from 3,336 patients collected from 23 hospitals located in China and the United Kingdom. Collectively, our work advanced the prospects of utilizing federated learning for privacy-preserving AI in digital health. The COVID-19 pandemic sparked the need for international collaboration in using clinical data for rapid development of diagnosis and treatment methods. But the sensitive nature of medical data requires special care and ideally potentially sensitive data would not leave the organization which collected it. Xiang Bai and colleagues present a privacy-preserving AI framework for CT-based COVID-19 diagnosis and demonstrate it on data from 23 hospitals in China and the United Kingdom.

Automated summary

Artificial intelligence shows promise in streamlining COVID-19 diagnoses, but concerns around security and trustworthiness hinder the collection of large-scale medical data. The Unified CT-COVID AI Diagnostic Initiative (UCADI) introduces a federated learning framework for training AI models without data sharing, achieving comparable performance with professional radiologists. This study, based on data from 23 hospitals in China and the UK, advances the use of federated learning for privacy-preserving AI in digital health.