4.0 Review

Human-centered design and evaluation of AI-empowered clinical decision support systems: a systematic review

Related references

Note: Only part of the references are listed.
Article Psychiatry

Evaluating the perceived utility of an artificial intelligence-powered clinical decision support system for depression treatment using a simulation center

Myriam Tanguay-Sela et al.

Summary: The study evaluated the perceived utility of the Aifred CDSS in aiding treatment decisions for major depressive disorder, with 60% of physicians finding it useful, especially family physicians. Half of the physicians would use the tool for all depression patients, while an additional 35% would reserve it for more severe or treatment-resistant cases. The CDSS was also found to be helpful in discussing treatment options with patients.

PSYCHIATRY RESEARCH (2022)

Review Computer Science, Information Systems

Design, effectiveness, and economic outcomes of contemporary chronic disease clinical decision support systems: a systematic review and meta-analysis

Winnie Chen et al.

Summary: This systematic review investigates the design, effectiveness, and economic outcomes of electronic health record-based clinical decision support (CDS) targeting chronic diseases. The results show heterogeneity in the effectiveness and cost-effectiveness of CDS interventions, likely due to differences in implementation context and evaluation methodology.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2022)

Article Health Care Sciences & Services

Designing and implementing smart glass technology for emergency medical services: a sociotechnical perspective

Zhan Zhang et al.

Summary: This study investigates the implementation and adoption of smart glasses in fast-paced medical settings such as emergency medical services (EMS) through a sociotechnical perspective. The results highlight key requirements for the successful implementation of smart glasses in EMS, including durable devices, easy-to-use interface design, seamless integration with existing systems and workflow, and secure data management. The findings inform the design implications for smart glass applications in fulfilling EMS providers' needs.

JAMIA OPEN (2022)

Review Health Care Sciences & Services

Human Factors and Technological Characteristics Influencing the Interaction of Medical Professionals With Artificial Intelligence-Enabled Clinical Decision Support Systems: Literature Review

Michael Knop et al.

Summary: This study summarizes the factors influencing effective collaboration between medical professionals and AI-enabled CDSSs, providing essential insights for medical professionals, management, and technology designers. However, the study highlights the limited theoretical foundations related to AI-CDSSs.

JMIR HUMAN FACTORS (2022)

Article Health Care Sciences & Services

Utilization of Self-Diagnosis Health Chatbots in Real-World Settings: Case Study

Xiangmin Fan et al.

Summary: This study analyzed the usage of a widely deployed self-diagnosis chatbot in China, finding that users of different age groups consulted on various medical conditions, but issues such as users dropping out mid-consultation and misuse of chatbots were identified, along with user concerns about insufficient information and accuracy of diagnostic suggestions.

JOURNAL OF MEDICAL INTERNET RESEARCH (2021)

Article Computer Science, Cybernetics

Human-centered XAI: Developing design patterns for explanations of clinical decision support systems

Tjeerd A. J. Schoonderwoerd et al.

Summary: Research focus on transparency of machine learning models and human-centered approaches to XAI. The paper presents a case study applying a human-centered design approach for AI-generated explanations, aiming to integrate human factors into the development processes.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2021)

Article Psychiatry

Using a simulation centre to evaluate preliminary acceptability and impact of an artificial intelligence-powered clinical decision support system for depression treatment on the physician-patient interaction

David Benrimoh et al.

Summary: The study found that the Aifred tool was acceptable and feasible for clinicians to use in clinical encounters. Clinicians expressed willingness to use the tool in real clinical practice and had trust in the system's predictions for treatment selection. The tool also helped increase patient understanding of and trust in treatment.

BJPSYCH OPEN (2021)

Article Computer Science, Information Systems

Status of AI-Enabled Clinical Decision Support Systems Implementations in China

Mengting Ji et al.

Summary: The study found that 23.75% of Chinese hospitals have implemented AI+CDSSs systems, with statistically significant differences in grade, scale, and medical volume between implemented and not-implemented hospitals. Overall satisfaction with these systems ranged from neutral to satisfied, with common concerns including system function improvement and integration, data quality and availability, and methodological bias.

METHODS OF INFORMATION IN MEDICINE (2021)

Article Health Care Sciences & Services

Technology Acceptance of a Machine Learning Algorithm Predicting Delirium in a Clinical Setting: a Mixed-Methods Study

Stefanie Jauk et al.

Summary: This study evaluated the user acceptance of a machine learning-based application supporting delirium management in hospitals. Results showed that healthcare professionals found the application useful, easy to understand, and appreciated the additional information provided. However, actual system use was still low during the pilot study.

JOURNAL OF MEDICAL SYSTEMS (2021)

Article Health Care Sciences & Services

Effect of AI Explanations on Human Perceptions of Patient-Facing AI-Powered Healthcare Systems

Zhan Zhang et al.

Summary: This study evaluates the effects of different AI explanations on people's perceptions of AI-powered healthcare system. The results show that revealing model performance information can promote trust and perceived usefulness of system outputs, while providing local explanations can promote understandability but not necessarily trust.

JOURNAL OF MEDICAL SYSTEMS (2021)

Review Chemistry, Multidisciplinary

Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review

Anna Markella Antoniadi et al.

Summary: Machine Learning and Artificial Intelligence have great potential in transforming medicine, but the lack of transparency in AI applications, especially in Clinical Decision Support Systems, can lead to issues of reliance. Explainable AI (XAI) provides rationale for users to understand AI outputs, but there is a distinct lack of XAI application and user studies in the context of CDSS. Further research is needed to explore the opportunities and challenges of implementing XAI in CDSS.

APPLIED SCIENCES-BASEL (2021)

Article Computer Science, Artificial Intelligence

Integrating Al Algorithms into the Clinical Workflow

Krishna Juluru et al.

Summary: The study describes generalizable components for integrating AI systems into clinical workflows, including deployment, usage assessment, and real-time performance monitoring. Results showed that the AI system successfully processed a large number of examinations and allowed radiologists to make real-time corrections to the results. Surveys indicated that the majority of users were satisfied with the integration of the AI system into the clinical workflow.

RADIOLOGY-ARTIFICIAL INTELLIGENCE (2021)

Article Health Care Sciences & Services

Clinical Utility and Functionality of an Artificial Intelligence-Based App to Predict Mortality in COVID-19: Mixed Methods Analysis

Ahmed Abdulaal et al.

Summary: This study demonstrates the usability of a web-based app utilizing an artificial neural network to predict COVID-19 patient outcomes in a clinical setting. Most of the 31 National Health Service physicians involved found the app easy to use and believed it could be a useful tool in clinical practice, although concerns were raised about using the app in isolation.

JMIR FORMATIVE RESEARCH (2021)

Article Health Policy & Services

Addressing power dynamics in interprofessional health care teams

Paulchris Okpala

Summary: The balance of power within healthcare teams influences their effectiveness, with factors such as team, role allocation, and communication playing a role. Strategies such as collaboration, direct communication, and education can be used to address power imbalance.

INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT (2021)

Article Computer Science, Information Systems

A lesson in implementation: A pre-post study of providers' experience with artificial intelligence-based clinical decision support

Santiago Romero-Brufau et al.

INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS (2020)

Article Health Care Sciences & Services

Economic impact of clinical decision support interventions based on electronic health records

Daniel Lewkowicz et al.

BMC HEALTH SERVICES RESEARCH (2020)

Article Computer Science, Information Systems

OrderRex clinical user testing: a randomized trial of recommender system decision support on simulated cases

Andre Kumar et al.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2020)

Article Engineering, Electrical & Electronic

IBM Watson, Heal Thyself

Eliza Strickland

IEEE SPECTRUM (2019)

Editorial Material Medicine, General & Internal

Clinical Decision Support in the Era of Artificial Intelligence

Edward H. Shortliffe et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2018)

Article Multidisciplinary Sciences

Deep neural network improves fracture detection by clinicians

Robert Lindsey et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2018)

Article Computer Science, Information Systems

A web-based clinical decision support system for gestational diabetes: Automatic diet prescription and detection of insulin needs

Estefania Caballero-Ruiz et al.

INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS (2017)

Article Radiology, Nuclear Medicine & Medical Imaging

Machine Learning for Medical Imaging1

Bradley J. Erickson et al.

RADIOGRAPHICS (2017)

Review Clinical Neurology

Artificial intelligence in healthcare: past, present and future

Fei Jiang et al.

STROKE AND VASCULAR NEUROLOGY (2017)

Article Computer Science, Artificial Intelligence

European Union Regulations on Algorithmic Decision Making and a Right to Explanation

Bryce Goodman et al.

AI MAGAZINE (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Investigating the Heart Pump Implant Decision Process: Opportunities for Decision Support Tools to Help

Qian Yang et al.

34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016 (2016)

Article Education, Scientific Disciplines

Performing Systematic Literature Reviews With Novices: An Iterative Approach

Mathieu Lavallee et al.

IEEE TRANSACTIONS ON EDUCATION (2014)

Review Medical Informatics

Systematic review of clinical decision support interventions with potential for inpatient cost reduction

Christopher L. Fillmore et al.

BMC MEDICAL INFORMATICS AND DECISION MAKING (2013)

Review Medicine, General & Internal

Effect of Clinical Decision-Support Systems A Systematic Review

Tiffani J. Bright et al.

ANNALS OF INTERNAL MEDICINE (2012)

Article Health Policy & Services

Safety Issues Related to the Electronic Medical Record (EMR): Synthesis of the Literature from the Last Decade, 2000-2009

Linda Harrington et al.

JOURNAL OF HEALTHCARE MANAGEMENT (2011)

Article Medicine, General & Internal

Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement

David Moher et al.

ANNALS OF INTERNAL MEDICINE (2009)

Article Computer Science, Artificial Intelligence

The coming of age of artificial intelligence in medicine

Vimla L. Patel et al.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2009)

Article Computer Science, Cybernetics

An empirical evaluation of the System Usability Scale

Aaron Bangor et al.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2008)

Article Computer Science, Information Systems

Technology implementation and workarounds in the nursing home

Amy A. Vogelsmeier et al.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2008)