Meaningless Applications and Misguided Methodologies in Artificial Intelligence-Related Orthopaedic Research Propagates Hype Over Hope

There exists great hope and hype in the literature surrounding applications of artificial intelligence (AI) to orthopaedic surgery. Between 2018 and 2021, a total of 178 AI-related articles were published in orthopaedics. However, for every 2 original research papers that apply AI to orthopaedics, a commentary or review is published (30.3%). AI-related research in orthopaedics frequently fails to provide use cases that offer the uninitiated an opportunity to appraise the importance of AI by studying meaningful questions, evaluating unknown hypotheses, or analyzing quality data. The hype perpetuates a feed-forward cycle that relegates AI to a meaningless buzzword by rewarding those with nascent understanding and rudimentary technical knowhow into committing several basic errors: (1) inappropriately conflating vernacular (AI/machine learning), (2) repackaging registry data, (3) prematurely releasing internally validated algorithms, (4) overstating the black box phenomenon by failing to provide weighted analysis, (5) claiming to evaluate AI rather than the data itself, and (6) withholding full model architecture code. Relevant AI-specific guidelines are forthcoming, but forced application of the original Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis guidelines designed for regression analyses is irrelevant and misleading. To safeguard meaningful use, AI-related research efforts in orthopaedics should be (1) directed toward administrative support over clinical evaluation and management, (2) require the use of the advanced model, and (3) answer a question that was previously unknown, unanswered, or unquantifiable.

Automated summary

There is great hope and hype surrounding artificial intelligence (AI) applications in orthopaedic surgery. However, the existing AI-related research in orthopaedics often fails to provide meaningful use cases and leaves the uninitiated unable to evaluate the importance of AI. The hype perpetuates a cycle that rewards those with limited understanding and basic technical knowhow, resulting in several errors. Relevant AI-specific guidelines are forthcoming, but applying existing guidelines designed for regression analyses is irrelevant and misleading for AI research in orthopaedics.