3.8 Review

Assessing the Quality and Impact of eHealth Tools: Systematic Literature Review and Narrative Synthesis

Related references

Note: Only part of the references are listed.
Review Health Care Sciences & Services

Digital Behavior Change Interventions for the Prevention and Management of Type 2 Diabetes: Systematic Market Analysis

Roman Keller et al.

Summary: This study aims to identify the top-funded companies offering digital behavior change interventions (DBCIs) for type 2 diabetes management and prevention. The level of scientific evidence supporting these interventions and the use of novel automated approaches are examined. The results indicate that the funding received by these companies does not align with the evidence of intervention effectiveness. There is limited evidence supporting the different DBCIs, and there is a need for more rigorous trials and transparent reporting. The use of automated approaches such as conversational agents and just-in-time adaptive interventions is currently limited.

JOURNAL OF MEDICAL INTERNET RESEARCH (2022)

Review Computer Science, Information Systems

Review, Assess, Classify, and Evaluate (RACE): a framework for studying m-health apps and its application for opioid apps

Upkar Varshney et al.

Summary: The 3-step RACE framework was developed for systematic analysis of m-health apps, and when applied to opioid apps, it provided insights for practice and research, which can also be utilized for studying m-health apps related to other health conditions.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2022)

Review Health Care Sciences & Services

Sociotechnical Factors Affecting Patients' Adoption of Mobile Health Tools: Systematic Literature Review and Narrative Synthesis

Christine Jacob et al.

Summary: This review investigates the factors affecting patients' adoption of mHealth tools, including technical factors, health-related factors, and social and personal factors. The results indicate that considering these factors and developing appropriate strategies is essential to promote mHealth adoption.

JMIR MHEALTH AND UHEALTH (2022)

Article Health Care Sciences & Services

Assessing the Clinical Robustness of Digital Health Startups: Cross-sectional Observational Analysis

Sean Day et al.

Summary: This analysis examines the clinical robustness and public claims of digital health companies. The results show that many of these companies have a low level of clinical robustness and do not make many claims. This suggests that both companies and customers may benefit from investing in greater clinical validation efforts.

JOURNAL OF MEDICAL INTERNET RESEARCH (2022)

Article Health Policy & Services

The regulatory gap in digital health and alternative pathways to bridge it

Jeffrey David Iqbal et al.

Summary: Regulatory gaps in the market of digital health technologies pose a threat to patient-consumers, with alternatives to regulatory agency-based assessments evaluated as potential solutions.

HEALTH POLICY AND TECHNOLOGY (2022)

Article Health Care Sciences & Services

From Testers to Cocreators-the Value of and Approaches to Successful Patient Engagement in the Development of eHealth Solutions: Qualitative Expert Interview Study

Christine Jacob et al.

Summary: This study aims to understand the challenges and opportunities in engaging patients in eHealth development and proposes solutions to overcome the identified gaps. The study found that patient engagement is crucial for providing different types of value, but patients are often engaged too late in the development process and only serve as testers. Barriers to patient engagement include compliance risks, patient-related factors, power dynamics, and mistrust. However, engaging through partners, involving professional patient experts, and embedding patients in development teams are facilitators for better patient engagement.

JMIR HUMAN FACTORS (2022)

Article Health Care Sciences & Services

Patients' Experiences of Using an eHealth Pain Management Intervention Combined With Psychomotor Physiotherapy: Qualitative Study

Anne-Grethe Eiken et al.

Summary: This study explores the application of blended care approach, combining psychomotor physiotherapy (PMP) and eHealth self-management, in patients with chronic pain. Through individual interviews, it is found that patients with chronic pain experience changes in bodily signals, pain and stress relationship, self-acceptance, and adoption of active coping strategies when using the combination of EPIO and PMP.

JMIR FORMATIVE RESEARCH (2022)

Article Health Care Sciences & Services

Mobile app validation: a digital health scorecard approach

Ramy Sedhom et al.

Summary: The development of digital health solutions is growing rapidly, but the lack of standardized quality assessment lags behind; Low barriers to development of mobile health apps has led to a crowded and confusing market with low user satisfaction; Research found technical limitations and limited clinical value in mobile health apps, highlighting the need for transparent and standardized evaluation to improve mobile health quality.

NPJ DIGITAL MEDICINE (2021)

Review Health Care Sciences & Services

Application of a health technology assessment framework to digital health technologies that manage chronic disease: a systematic review

Amy von Huben et al.

Summary: The increasing research in DHTs managing chronic diseases at home is not covering all the content recommended for a DHT-specific and comprehensive HTA. Measures are needed to improve the quality of trial design and reporting in DHT primary research to address this issue.

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2021)

Article Health Care Sciences & Services

Physicians' Attitudes Toward Prescribable mHealth Apps and Implications for Adoption in Germany: Mixed Methods Study

Florian Dahlhausen et al.

Summary: The study investigated the current attitudes of physicians and psychotherapists in Germany towards mHealth apps, finding that while the majority supported the prescription opportunity for DiGA, only 30.3% planned to actually prescribe. Barriers include lack of information, reimbursement issues, insufficient medical evidence, legal and technological uncertainties.

JMIR MHEALTH AND UHEALTH (2021)

Review Health Care Sciences & Services

Identification and Evaluation of Methodologies to Assess the Quality of Mobile Health Apps in High-, Low-, and Middle-Income Countries: Rapid Review

Fionn Woulfe et al.

Summary: The rapid growth of mHealth apps worldwide has led to challenges in assessing their quality due to variations in quality interpretation and limited consensus on standards. While there is engagement with authors from LMICs, there is a lack of consideration for applying current methodologies in LMIC settings.

JMIR MHEALTH AND UHEALTH (2021)

Review Health Care Sciences & Services

Tools for Evaluating the Content, Efficacy, and Usability of Mobile Health Apps According to the Consensus-Based Standards for the Selection of Health Measurement Instruments: Systematic Review

Antonio Muro-Culebras et al.

Summary: The study analyzed the quality of tools used to measure the quality of mHealth apps according to the COSMIN guideline, identifying suitable tools for evaluating mHealth app quality by screening validation studies including psychometric properties.

JMIR MHEALTH AND UHEALTH (2021)

Review Health Care Sciences & Services

Information Quality Frameworks for Digital Health Technologies: Systematic Review

Kayode Philip Fadahunsi et al.

Summary: This study presents the CLIQ framework for digital health through a systematic review, which includes 13 unique dimensions covering various aspects of digital health information, aiding in the evaluation of information quality issues related to digital health.

JOURNAL OF MEDICAL INTERNET RESEARCH (2021)

Review Medicine, General & Internal

Evaluating evaluation frameworks: a scoping review of frameworks for assessing health apps

Sarah Lagan et al.

Summary: With the increasing number of app evaluation frameworks, users are finding it challenging to select appropriate evaluation tools and health apps. This review compares what different app evaluation frameworks offer, identifies converging trends in the field, and highlights new priorities for enhancing clinical guidance.

BMJ OPEN (2021)

Article Psychology, Clinical

Evaluating the quality and safety of health-related apps and e-tools: Adapting the Mobile App Rating Scale and developing a quality assurance protocol

Anna E. Roberts et al.

Summary: Apps and e-tools have great potential as mental health intervention tools, but it's important to have a way to evaluate their quality and safety. This study adapted the MARS to evaluate these tools, tested its reliability, and developed a quality assurance protocol. The A-MARS was shown to be reliable, but the training and skill required to use it effectively may be a barrier.

INTERNET INTERVENTIONS-THE APPLICATION OF INFORMATION TECHNOLOGY IN MENTAL AND BEHAVIOURAL HEALTH (2021)

Review Health Care Sciences & Services

Domains and Methods Used to Assess Home Telemonitoring Scalability: Systematic Review

Salome Azevedo et al.

Summary: This systematic review aims to identify the domains and methods used in peer-reviewed research studies that assess the scalability of home telemonitoring-based interventions under real-world conditions. The review evaluated 13 articles focusing on the potential of scaling up a home telemonitoring intervention, with most studies considering domains such as problem, intervention, effectiveness, and costs and benefits.

JMIR MHEALTH AND UHEALTH (2021)

Article Health Care Sciences & Services

The NICE Evidence Standards Framework for digital health and care technologies - Developing and maintaining an innovative evidence framework with global impact

Harriet Unsworth et al.

Summary: The ESF is a standardized framework developed in 2018 by NICE in partnership with various UK health organizations to guide developers and commissioners on the evidence levels required for evaluating DHTs. The framework has been well-received and has had a significant impact globally, with ongoing efforts to maintain and improve it in a rapidly evolving field.

DIGITAL HEALTH (2021)

Review Public, Environmental & Occupational Health

Approaches to assess e-health programs: A scoping review

Nitin Kumar Joshi et al.

Summary: The assessment of e-Health technologies is crucial for further investment and adoption. The available literature on this topic is heterogeneous in terms of methodology. Context and objectives should be considered when assessing e-Health programs.

INDIAN JOURNAL OF COMMUNITY MEDICINE (2021)

Review Health Care Sciences & Services

Systematic review of cost-effectiveness analysis of behavior change communication apps: Assessment of key methods

Cynthia Afedi Hazel et al.

Summary: There is insufficient evidence to support the cost-effectiveness of behavior change communication apps, with significant study challenges reported for estimating program costs and outcomes. Main challenges include limited or lack of cost data, inappropriate cost measures, difficulty identifying and quantifying app effectiveness, representing app effects as Quality-adjusted Life Years, and aggregating cost and effects into a single quantitative measure like Incremental Cost Effectiveness Ratio.

DIGITAL HEALTH (2021)

Article Health Care Sciences & Services

Insights from user reviews to improve mental health apps

Felwah Alqahtani et al.

HEALTH INFORMATICS JOURNAL (2020)

Article Health Care Sciences & Services

The new definition of health technology assessment: A milestone in international collaboration

Brian O'Rourke et al.

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2020)

Review Health Care Sciences & Services

Health technology assessment frameworks for eHealth: A systematic review

Christiaan Vis et al.

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2020)

Review Health Care Sciences & Services

Understanding Clinicians' Adoption of Mobile Health Tools: A Qualitative Review of the Most Used Frameworks

Christine Jacob et al.

JMIR MHEALTH AND UHEALTH (2020)

Article Health Care Sciences & Services

A Questionnaire for Assessing User Satisfaction With Mobile Health Apps: Development Using Rasch Measurement Theory

Jeanette Melin et al.

JMIR MHEALTH AND UHEALTH (2020)

Article Health Care Sciences & Services

Evaluation Criteria for Weight Management Apps: Validation Using a Modified Delphi Process

Noemi Robles et al.

JMIR MHEALTH AND UHEALTH (2020)

Article Health Care Sciences & Services

Technology Evaluation and Assessment Criteria for Health Apps (TEACH-Apps): Pilot Study

Erica Camacho et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2020)

Review Psychology, Clinical

A systematic review of providers' attitudes toward telemental health via videoconferencing

Samantha L. Connolly et al.

CLINICAL PSYCHOLOGY-SCIENCE AND PRACTICE (2020)

Article Health Policy & Services

Intervention Scalability Assessment Tool: A decision support tool for health policy makers and implementers

Andrew Milat et al.

HEALTH RESEARCH POLICY AND SYSTEMS (2020)

Article Health Care Sciences & Services

Measuring the Implementation of Behavioral Intervention Technologies: Recharacterization of Established Outcomes

Eric D. A. Hermes et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2019)

Article Computer Science, Interdisciplinary Applications

Beyond TAM and UTAUT: Future directions for HIT implementation research

Aviv Shachak et al.

JOURNAL OF BIOMEDICAL INFORMATICS (2019)

Article Health Care Sciences & Services

By the numbers: ratings and utilization of behavioral health mobile applications

Andrew D. Carlo et al.

NPJ DIGITAL MEDICINE (2019)

Review Health Care Sciences & Services

Digital health: a path to validation

Simon C. Mathews et al.

NPJ DIGITAL MEDICINE (2019)

Article Computer Science, Information Systems

A design and evaluation framework for digital health interventions

Tobias Kowatsch et al.

IT-INFORMATION TECHNOLOGY (2019)

Article Health Care Sciences & Services

Assessing the Privacy of mHealth Apps for Self-Tracking: Heuristic Evaluation Approach

Luke Hutton et al.

JMIR MHEALTH AND UHEALTH (2018)

Article Education, Scientific Disciplines

Mobile Apps for the Dietary Approaches to Stop Hypertension (DASH): App Quality Evaluation

Kristen Nicole DiFilippo et al.

JOURNAL OF NUTRITION EDUCATION AND BEHAVIOR (2018)

Review Computer Science, Information Systems

Criteria for assessing the quality of mHealth apps: a systematic review

Rasool Nouri et al.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2018)

Article Health Care Sciences & Services

COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study

C. B. Terwee et al.

QUALITY OF LIFE RESEARCH (2018)

Review Health Care Sciences & Services

COSMIN guideline for systematic reviews of patient-reported outcome measures

C. A. C. Prinsen et al.

QUALITY OF LIFE RESEARCH (2018)

Article Health Care Sciences & Services

An Assessment Framework for e-Mental Health Apps in Canada: Results of a Modified Delphi Process

Jennifer Zelmer et al.

JMIR MHEALTH AND UHEALTH (2018)

Article Health Care Sciences & Services

A Path to Better-Quality mHealth Apps

Richard S. Larson

JMIR MHEALTH AND UHEALTH (2018)

Article Public, Environmental & Occupational Health

MedAd-AppQ: A quality assessment tool for medication adherence apps on iOS and android platforms

Eskinder Eshetu Ali et al.

RESEARCH IN SOCIAL & ADMINISTRATIVE PHARMACY (2018)

Review Health Care Sciences & Services

Prescribable mHealth apps identified from an overview of systematic reviews

Oyungerel Byambasuren et al.

NPJ DIGITAL MEDICINE (2018)

Article Health Care Sciences & Services

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions

Amit Baumel et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2017)

Review Health Care Sciences & Services

A Systematic Review and Taxonomy of Published Quality Criteria Related to the Evaluation of User-Facing eHealth Programs

Amit Baumel et al.

JOURNAL OF MEDICAL SYSTEMS (2017)

Article Health Care Sciences & Services

mHealth Assessment: Conceptualization of a Global Framework

Meghan Bradway et al.

JMIR MHEALTH AND UHEALTH (2017)

Article Health Care Sciences & Services

A New Tool for Nutrition App Quality Evaluation (AQEL): Development, Validation, and Reliability Testing

Kristen Nicole DiFilippo et al.

JMIR MHEALTH AND UHEALTH (2017)

Review Psychology, Clinical

Anxiety: There is an app for that. A systematic review of anxiety apps

Madalina Sucala et al.

DEPRESSION AND ANXIETY (2017)

Review Public, Environmental & Occupational Health

Challenges in Assessing Mobile Health App Quality A Systematic Review of Prevalent and Innovative Methods

Quinn H. Grundy et al.

AMERICAN JOURNAL OF PREVENTIVE MEDICINE (2016)

News Item Multidisciplinary Sciences

POCKET PSYCHIATRY

Emily Anthes

NATURE (2016)

Review Medicine, General & Internal

Rayyan-a web and mobile app for systematic reviews

Mourad Ouzzani et al.

SYSTEMATIC REVIEWS (2016)

Article Medical Informatics

A Legal Framework to Support Development and Assessment of Digital Health Services

Cecilia Garell et al.

JMIR MEDICAL INFORMATICS (2016)

Article Medicine, General & Internal

The evolution of mobile apps for asthma: an updated systematic assessment of content and tools

Kit Huckvale et al.

BMC MEDICINE (2015)

Article Health Care Sciences & Services

A New Method for Assessing Content Validity in Model-Based Creation and Iteration of eHealth Interventions

Nancy Kassam-Adams et al.

JOURNAL OF MEDICAL INTERNET RESEARCH (2015)

Review Cell Biology

The emerging field of mobile health

Steven R. Steinhubl et al.

SCIENCE TRANSLATIONAL MEDICINE (2015)

Review Health Care Sciences & Services

A Systematic Review of Quality Assessment Methods for Smartphone Health Apps

Nasser F. BinDhim et al.

TELEMEDICINE AND E-HEALTH (2015)

Review Health Care Sciences & Services

A Systematic Review of Quality Assessment Methods for Smartphone Health Apps

Nasser F. BinDhim et al.

TELEMEDICINE AND E-HEALTH (2015)

Article Health Care Sciences & Services

Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps

Stoyan R. Stoyanov et al.

JMIR MHEALTH AND UHEALTH (2015)

Letter Health Care Sciences & Services

A Systematic Self-Certification Model for Mobile Medical Apps

Thomas Lorchan Lewis

JOURNAL OF MEDICAL INTERNET RESEARCH (2013)

Article Health Care Sciences & Services

Development and Evaluation of Tools for Measuring the Quality of Experience (QoE) in mHealth Applications

Borja Martinez-Perez et al.

JOURNAL OF MEDICAL SYSTEMS (2013)

Article Medicine, General & Internal

Apps for asthma self-management: a systematic assessment of content and tools

Kit Huckvale et al.

BMC MEDICINE (2012)

Review Medicine, General & Internal

Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement

David Moher et al.

PLOS MEDICINE (2009)

Article Health Care Sciences & Services

Implementing evidence-based interventions in health care: application of the replicating effective programs framework

Amy M. Kilbourne et al.

IMPLEMENTATION SCIENCE (2007)