4.6 Article

Reinforcement Learning Models and Algorithms for Diabetes Management

Related references

Note: Only part of the references are listed.
Article Computer Science, Theory & Methods

Reinforcement Learning in Healthcare: A Survey

Chao Yu et al.

Summary: As a subfield of machine learning, reinforcement learning aims to optimize decision making by using interaction samples of an agent with its environment and the potentially delayed feedbacks. It tackles sequential decision-making problems with sampled, evaluative, and delayed feedbacks simultaneously. In healthcare domains, it is a suitable candidate for developing powerful solutions in various areas such as treatment regimes, medical diagnosis, and control or scheduling problems. Challenges, open issues, potential solutions, and future research directions are also discussed.

ACM COMPUTING SURVEYS (2023)

Article Computer Science, Information Systems

Electronic health records based reinforcement learning for treatment optimizing

Tianhao Li et al.

Summary: The study proposed an EHRs-based reinforcement learning algorithm to optimize sequential treatment strategies for diseases, achieving good results in experiments. The research includes modeling process and reinforcement learning process, utilizing deep Q network to explore optimal insulin dose for patients and extending the algorithm to cooperative learning environment.

INFORMATION SYSTEMS (2022)

Review Nutrition & Dietetics

Could Polyphenolic Food Intake Help in the Control of Type 2 Diabetes? A Narrative Review of the Last Evidence

Luigi Ferrara et al.

Summary: This article summarizes human clinical trials conducted within the last 5 years linking dietary polyphenols to T2D, with a focus on polyphenolic foods found in the Mediterranean diet. The intake of polyphenols and their food sources have demonstrated beneficial effects on insulin resistance and other cardiometabolic risk factors. The Mediterranean diet and its key components, such as olive oil, nuts, and red wine, have been inversely associated with insulin resistance and T2D.

CURRENT NUTRITION & FOOD SCIENCE (2022)

Article Biology

Subcutaneous insulin administration by deep reinforcement learning for blood glucose level control of type-2 diabetic patients

Mohammad Ali Raheb et al.

Summary: This study applied a reinforcement learning algorithm called normalized advantage function (NAF) to regulate blood glucose levels in type-2 diabetic patients. The results demonstrate the promising potential of this method in controlling blood glucose fluctuations.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Computer Science, Artificial Intelligence

Reinforcement learning-based expanded personalized diabetes treatment recommendation using South Korean electronic health records

Sang Ho Oh et al.

Summary: In this study, the researchers aim to develop a reinforcement learning-based treatment recommendation model using electronic health records of South Korean patients. By considering various details, the proposed contextual bandits model offers a practical solution to address clinical challenges in prescribing diabetes medication.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Proceedings Paper Automation & Control Systems

Artificial Pancreas Control for Diabetes using TD3 Deep Reinforcement Learning

Alan Mackey et al.

Summary: This study investigates whether deep reinforcement learning (DRL) can be used as a potential solution for devising patient-specific control policies for diabetes. A Twin Delayed Deep Deterministic Policy Gradient (TD3) model is implemented and tested in a simulated environment. The results show promise in controlling blood glucose profiles for patients, although further research is needed before it can be considered for human use.

2022 33RD IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC) (2022)

Proceedings Paper Automation & Control Systems

Long-Term Adaptation of Closed-Loop Glucose Regulation Via Reinforcement Learning Tools

Maria Cecilia Serafini et al.

Summary: Closed-loop controllers for glucose regulation, known as Artificial Pancreas (AP) systems, have become a significant problem in automatic control. This study evaluates the potential of Reinforcement Learning (RL) tools for long-term adaptation of the ARG controller and demonstrates its success in avoiding hypoglycemia and outperforming rule-based decision making schemes.

IFAC PAPERSONLINE (2022)

Article Telecommunications

OIDPR: Optimized insulin dosage via privacy-preserving reinforcement learning

Zuobin Ying et al.

Summary: The article introduces a framework for optimized insulin dosage with privacy-preserving reinforcement learning (OIDPR), utilizing additive secret sharing and edge computing for data confidentiality and performance optimization. Comprehensive theoretical analyses and experimental results demonstrate the supervisor functionality and high performance of the framework.

TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES (2021)

Article Computer Science, Interdisciplinary Applications

Long-term use of the hybrid artificial pancreas by adjusting carbohydrate ratios and programmed basal rate: A reinforcement learning approach

Adnan Jafar et al.

Summary: The study introduces a reinforcement learning algorithm to adaptively optimize carbohydrate ratios and programmed basal rate in a hybrid artificial pancreas for better glucose control in individuals with type 1 diabetes. The algorithm improved time spent in target glucose range and decreased time spent below 4.0 mmol/L in simulator testing, showing potential for improving real-life glucose management for type 1 diabetes patients.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2021)

Article Pharmacology & Pharmacy

Personalized Multimorbidity Management for Patients with Type 2 Diabetes Using Reinforcement Learning of Electronic Health Records

Hua Zheng et al.

Summary: A personalized artificial intelligence algorithm based on reinforcement learning was developed for personalized diabetes and multimorbidity management, showing significant improvements in health outcomes for patients with type 2 diabetes.

DRUGS (2021)

Article Computer Science, Information Systems

Toward a Fully Automated Artificial Pancreas System Using a Bioinspired Reinforcement Learning Design: In Silico Validation

Seunghyun Lee et al.

Summary: The article introduces a novel reinforcement learning based artificial intelligence algorithm for automated insulin infusion control. Through training on virtual patients in the FDA approved UVA/Padova simulator, the algorithm achieves fully automated blood glucose control.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2021)

Article Computer Science, Information Systems

Basal Glucose Control in Type 1 Diabetes Using Deep Reinforcement Learning: An In Silico Validation

Taiyu Zhu et al.

Summary: This study proposes using deep reinforcement learning to improve blood glucose control in Type 1 diabetes patients, achieving significant progress in single-hormone and dual-hormone delivery strategies. The results demonstrate that this approach can effectively reduce hypoglycemia and increase the percentage of time patients spend in the target blood glucose range.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Reinforcement Learning-Based Insulin Injection Time And Dosages Optimization

Zihao Wang et al.

Summary: This study investigates optimizing insulin injection time and dosage for type 1 diabetes patients using a reinforcement learning framework. Through heuristic search and double-score strategy, the proposed method outperforms other existing methods in experiments conducted on an FDA-approved simulator for 30 virtual patients over 10 days.

2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) (2021)

Article Computer Science, Information Systems

A Blood Glucose Control Framework Based on Reinforcement Learning With Safety and Interpretability: In Silico Validation

Min Hyuk Lim et al.

Summary: Controlling blood glucose levels in diabetic patients is crucial for health management. This study introduces a fast online learning method using random forest regressor and dual attention network for glucose prediction and state variables extension. The system was validated using an FDA-approved type 1 diabetes simulator, showing comparable outcomes with traditional PID control. The extended state variables are correlated with basic states and can be fundamental elements for mathematical modeling of physiological responses.

IEEE ACCESS (2021)

Review Computer Science, Artificial Intelligence

Reinforcement learning application in diabetes blood glucose control: A systematic review

Miguel Tejedor et al.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2020)

Article Computer Science, Information Systems

GluNet: A Deep Learning Framework for Accurate Glucose Forecasting

Kezhi Li et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2020)

Article Computer Science, Information Systems

Convolutional Recurrent Neural Networks for Glucose Prediction

Kezhi Li et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2020)

Article Computer Science, Artificial Intelligence

Near-optimal insulin treatment for diabetes patients: A machine learning approach

Mark Shifrin et al.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2020)

Article Computer Science, Artificial Intelligence

Reinforcement learning for intelligent healthcare applications: A survey

Antonio Coronato et al.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2020)

Letter Endocrinology & Metabolism

Letter to the editor: Unexpected high mortality in COVID-19 and diabetic ketoacidosis

Natalia Chamorro-Pareja et al.

METABOLISM-CLINICAL AND EXPERIMENTAL (2020)

Proceedings Paper Automation & Control Systems

Sampled-Data Static Output Feedback Control of the Glucose-Insulin System

M. Di Ferdinando et al.

IFAC PAPERSONLINE (2020)

Review Endocrinology & Metabolism

Clinical profile and outcomes in COVID-19 patients with diabetic ketoacidosis: A systematic review of literature

Rimesh Pal et al.

DIABETES & METABOLIC SYNDROME-CLINICAL RESEARCH & REVIEWS (2020)

Article Biology

Optimal adaptive control of drug dosing using integral reinforcement learning

Regina Padmanabhan et al.

MATHEMATICAL BIOSCIENCES (2019)

Review Endocrinology & Metabolism

A Century of Diabetes Technology: Signals, Models, and Artificial Pancreas Control

Boris Kovatchev

TRENDS IN ENDOCRINOLOGY AND METABOLISM (2019)

Article Engineering, Biomedical

A Markov decision process for modeling adverse drug reactions in medication treatment of type 2 diabetes

Maryam Eghbali-Zarch et al.

PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART H-JOURNAL OF ENGINEERING IN MEDICINE (2019)

Article Computer Science, Information Systems

A Dual Mode Adaptive Basal-Bolus Advisor Based on Reinforcement Learning

Qingnan Sun et al.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2019)

Article Endocrinology & Metabolism

Validation of Time in Range as an Outcome Measure for Diabetes Clinical Trials

Roy W. Beck et al.

DIABETES CARE (2019)

Article Endocrinology & Metabolism

IDF Diabetes Atlas: Global estimates of diabetes prevalence for 2017 and projections for 2045

N. H. Cho et al.

DIABETES RESEARCH AND CLINICAL PRACTICE (2018)

Article Computer Science, Interdisciplinary Applications

Simulation-based optimization of radiotherapy: Agent-based modeling and reinforcement learning

Ammar Jalalimanesh et al.

MATHEMATICS AND COMPUTERS IN SIMULATION (2017)

Article Multidisciplinary Sciences

Mastering the game of Go without human knowledge

David Silver et al.

NATURE (2017)

Article Biology

Development of a Reinforcement Learning-based Evolutionary Fuzzy Rule-Based System for diabetes diagnosis

Fatemeh Mansourypoor et al.

COMPUTERS IN BIOLOGY AND MEDICINE (2017)

Article Computer Science, Artificial Intelligence

An active inference approach to on-line agent monitoring in safety-critical systems

Luis Avila et al.

ADVANCED ENGINEERING INFORMATICS (2015)

Article Computer Science, Artificial Intelligence

Controlling blood glucose variability under uncertainty using reinforcement learning and Gaussian processes

Mariano De Paula et al.

APPLIED SOFT COMPUTING (2015)

Article Biochemistry & Molecular Biology

Personalized Nutrition by Prediction of Glycemic Responses

David Zeevi et al.

Article Computer Science, Artificial Intelligence

On-line policy learning and adaptation for real-time personalization of an artificial pancreas

Mariano De Paula et al.

EXPERT SYSTEMS WITH APPLICATIONS (2015)

Article Computer Science, Interdisciplinary Applications

Analysis of three T1DM simulation models for evaluating robust closed-loop controllers

P. Colmegna et al.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2014)

Article Endocrinology & Metabolism

The Oral Minimal Model Method

Claudio Cobelli et al.

DIABETES (2014)

Article Endocrinology & Metabolism

First Use of Model Predictive Control in Outpatient Wearable Artificial Pancreas

Simone Del Favero et al.

DIABETES CARE (2014)

Article Computer Science, Artificial Intelligence

Behavior monitoring under uncertainty using Bayesian surprise and optimal action selection

Luis Avila et al.

EXPERT SYSTEMS WITH APPLICATIONS (2014)

Article Biology

Model-based control of plasma glycemia: Tests on populations of virtual patients

P. Palumbo et al.

MATHEMATICAL BIOSCIENCES (2014)

Article Computer Science, Interdisciplinary Applications

An Actor-Critic based controller for glucose regulation in type 1 diabetes

Elena Daskalaki et al.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2013)

Article Endocrinology & Metabolism

Carbohydrate counting accuracy and blood glucose variability in adults with type 1 diabetes

A. S. Brazeau et al.

DIABETES RESEARCH AND CLINICAL PRACTICE (2013)

Article Endocrinology & Metabolism

Hypoglycemia, Diabetes, and Cardiovascular Disease

Janet K. Snell-Bergeon et al.

DIABETES TECHNOLOGY & THERAPEUTICS (2012)

Article Computer Science, Information Systems

Development of AIDA v4.3b Diabetes Simulator: Technical Upgrade to Support Incorporation of Lispro, Aspart, and Glargine Insulin Analogues

Eldon D. Lehmann et al.

JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING (2011)

Article Endocrinology & Metabolism

Cellular modeling: insight into oral minimal models of insulin secretion

Morten Gram Pedersen et al.

AMERICAN JOURNAL OF PHYSIOLOGY-ENDOCRINOLOGY AND METABOLISM (2010)

Article Automation & Control Systems

A feedforward-feedback glucose control strategy for type 1 diabetes mellitus

Gianni Marchetti et al.

JOURNAL OF PROCESS CONTROL (2008)

Article Endocrinology & Metabolism

Relationship between glycated haemoglobin levels and mean glucose levels over time

D. M. Nathan et al.

DIABETOLOGIA (2007)

Article Engineering, Chemical

Type 1 diabetic patient insulin delivery using asymmetric PI control

Justin A. Gantt et al.

CHEMICAL ENGINEERING COMMUNICATIONS (2007)

Article Endocrinology & Metabolism

Reduced sampling schedule for the glucose minimal model: importance of Bayesian estimation

P Magni et al.

AMERICAN JOURNAL OF PHYSIOLOGY-ENDOCRINOLOGY AND METABOLISM (2006)

Review Genetics & Heredity

Gene-environment interactions in human diseases

DJ Hunter

NATURE REVIEWS GENETICS (2005)

Review Endocrinology & Metabolism

Glucagon and regulation of glucose metabolism

GQ Jiang et al.

AMERICAN JOURNAL OF PHYSIOLOGY-ENDOCRINOLOGY AND METABOLISM (2003)

Article Clinical Neurology

The spectrum of neuropathy in diabetes and impaired glucose tolerance

CJ Sumner et al.

NEUROLOGY (2003)

Article Endocrinology & Metabolism

Partitioning glucose distribution/transport, disposal, and endogenous production during IVGTT

R Hovorka et al.

AMERICAN JOURNAL OF PHYSIOLOGY-ENDOCRINOLOGY AND METABOLISM (2002)