4.7 Article

The impact of inconsistent human annotations on AI driven clinical decision making

Related references

Note: Only part of the references are listed.
Article Computer Science, Information Systems

A Survey on Classifying Big Data with Label Noise

Justin M. Johnson et al.

Summary: This survey reviews the literature extensively on treating label noise within big data, addressing the challenges associated with big data and presenting 30 methods for treating class label noise in different big data contexts. The surveyed works include distributed solutions, deep learning techniques, and streaming techniques. The paper identifies common trends and best practices, reviews implementation details, compares empirical results, and provides references to open-source projects. The emphasis on label noise challenges, solutions, and empirical results as they relate to big data distinguishes this work as a unique contribution that will inspire future research and guide machine learning practitioners.

ACM JOURNAL OF DATA AND INFORMATION QUALITY (2022)

Article Emergency Medicine

MONitoring Knockbacks in EmergencY (MONKEY) - An Audit of Disposition Outcomes in Emergency Patients with Rejected Admission Requests

Wendell Zhang et al.

Summary: Emergency Department clinicians often face difficulties in referring patients to inpatient teams for hospital admission. This study found that most emergency referrals for admission were warranted and accurate, but knockbacks increased the length of stay in the ED and may adversely affect patient care. Further discussion and clearer referral guidelines are needed between ED clinicians and their inpatient colleagues.

OPEN ACCESS EMERGENCY MEDICINE (2022)

Review Medicine, General & Internal

Early Prediction of Sepsis in the ICU Using Machine Learning: A Systematic Review

Michael Moor et al.

Summary: The study demonstrates that machine learning can be used to optimize the early prediction of sepsis, but current approaches have low comparability and reproducibility.

FRONTIERS IN MEDICINE (2021)

Article Computer Science, Artificial Intelligence

Deep learning with noisy labels: Exploring techniques and remedies in medical image analysis

Davood Karimi et al.

MEDICAL IMAGE ANALYSIS (2020)

Article Biochemistry & Molecular Biology

Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension

Samantha Cruz Rivera et al.

NATURE MEDICINE (2020)

Proceedings Paper Engineering, Biomedical

Resolving Differences of Opinion between Medical Experts: A Case Study with the IS-DELPHI System

Derek Sleeman et al.

PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES, VOL 5: HEALTHINF (2020)

Proceedings Paper Computer Science, Information Systems

A Method to Detect Inconsistent Annotations in a Medical Document using UMLS

Devasish Mahato et al.

PROCEEDINGS OF THE 11TH ANNUAL MEETING OF THE FORUM FOR INFORMATION RETRIEVAL EVALUATION (FIRE 2019) (2019)

Editorial Material Medicine, General & Internal

Unintended Consequences of Machine Learning in Medicine

Federico Cabitza et al.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2017)

Article Health Care Sciences & Services

Measuring inter-rater reliability for nominal data - which coefficients and confidence intervals are appropriate?

Antonia Zapf et al.

BMC MEDICAL RESEARCH METHODOLOGY (2016)

Editorial Material Health Care Sciences & Services

Prediction models need appropriate internal, internal-external, and external validation

Ewout W. Steyerberg et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2016)

Article Health Care Sciences & Services

Guidelines for Developing and Reporting Machine Learning Predictive Models in Biomedical Research: A Multidisciplinary View

Wei Luo et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2016)

Article Health Care Sciences & Services

External validation of new risk prediction models is infrequent and reveals worse prognostic discrimination

George C. M. Siontis et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2015)

Article Computer Science, Artificial Intelligence

Effect of label noise in the complexity of classification problems

Luis P. F. Garcia et al.

NEUROCOMPUTING (2015)

Review Cardiac & Cardiovascular Systems

Towards better clinical prediction models: seven steps for development and an ABCD for validation

Ewout W. Steyerberg et al.

EUROPEAN HEART JOURNAL (2014)

Article Computer Science, Artificial Intelligence

Classification in the Presence of Label Noise: a Survey

Benoit Frenay et al.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2014)

Article Computer Science, Information Systems

Investigating the Disagreement Between Clinicians' Ratings of Patients in ICUs

Simon Rogers et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2013)

Article Computer Science, Artificial Intelligence

Detecting and resolving inconsistencies between domain experts' different perspectives on (classification) tasks

Derek Sleeman et al.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2012)

Article Medical Laboratory Technology

Interrater reliability: the kappa statistic

Mary L. McHugh

BIOCHEMIA MEDICA (2012)

Article Pathology

Atypical ductal hyperplasia: interobserver and intraobserver variability

Rohit K. Jain et al.

MODERN PATHOLOGY (2011)

Article Computer Science, Artificial Intelligence

Building Watson: An Overview of the DeepQA Project

David Ferrucci et al.

AI MAGAZINE (2010)

Article Computer Science, Artificial Intelligence

A study of the effect of different types of noise on the precision of supervised learning techniques

David F. Nettleton et al.

ARTIFICIAL INTELLIGENCE REVIEW (2010)

Article Computer Science, Artificial Intelligence

Class noise vs. attribute noise: A quantitative study of their impacts

XQ Zhu et al.

ARTIFICIAL INTELLIGENCE REVIEW (2004)

Article Health Care Sciences & Services

External validation is necessary in, prediction research: A clinical example

SE Bleeker et al.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2003)

Article Computer Science, Artificial Intelligence

Random forests

L Breiman

MACHINE LEARNING (2001)

Article Computer Science, Information Systems

Processing and representation of meta-data for sleep apnea diagnosis with an artificial intelligence approach

D Nettleton et al.

INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS (2001)