4.6 Article

The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation

Related references

Note: Only part of the references are listed.
Article Physics, Multidisciplinary

Count regression models for COVID-19

Stephen Chan et al.

Summary: The novel coronavirus outbreak in late 2019 has become a global pandemic, leading to a statistical study on the daily incidence of COVID-19 in eighteen countries worldwide. The best fitting count regression model for new daily COVID-19 cases of all countries analysed was found to be a negative binomial distribution with log link function, providing preliminary results and an overall picture of the global pandemic trends.

PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS (2021)

Article Mathematical & Computational Biology

The Matthews correlation coefficient (MCC) is more reliable than balanced accuracy, bookmaker informedness, and markedness in two-class confusion matrix evaluation

Davide Chicco et al.

Summary: In this manuscript, the authors reaffirm the robustness of the Matthews correlation coefficient (MCC) as a metric for summarizing classifier performance. They compare MCC to other metrics such as balanced accuracy, bookmaker informedness, and markedness, and demonstrate situations where MCC provides a more informative response. The authors also identify three exceptions where bookmaker informedness may be more appropriate, but overall suggest MCC as a standard measure for evaluating binary classifications in various fields.

BIODATA MINING (2021)

Article Computer Science, Artificial Intelligence

Classifier uncertainty: evidence, potential impact, and probabilistic treatment

Niklas Toetsch et al.

Summary: This study introduces a method to quantify the uncertainty of classification performance metrics based on a probability model of the confusion matrix. Results show that uncertainties can be surprisingly large limiting performance evaluation, while the method can also be used for sample size estimation.

PEERJ COMPUTER SCIENCE (2021)

Article Computer Science, Information Systems

The Matthews Correlation Coefficient (MCC) is More Informative Than Cohen's Kappa and Brier Score in Binary Classification Assessment

Davide Chicco et al.

Summary: Measuring the outcome of binary classifications is crucial in machine learning and statistics, but there is no consensus on which statistical rate to use. The Matthews correlation coefficient (MCC) has advantages over other scores in terms of reliability on imbalanced datasets. Comparing MCC with Cohen's Kappa and Brier score, MCC provides more truthful and informative results in certain use cases. It is therefore recommended to use MCC for evaluating binary classifications.

IEEE ACCESS (2021)

Article Computer Science, Information Systems

An Ensemble Learning Approach for Enhanced Classification of Patients With Hepatitis and Cirrhosis

Davide Chicco et al.

Summary: This study analyzed electronic health records (EHRs) of 540 healthy controls and 75 patients diagnosed with hepatitis C, using machine learning classifiers to predict their diagnosis. The study found that the enzyme levels of AST and ALT were the most diagnostic variables for hepatitis C. The results of the machine learning model outperformed the traditional AST/ALT ratio in predicting hepatitis C and cirrhosis diagnosis.

IEEE ACCESS (2021)

Article Multidisciplinary Sciences

Benign overfitting in linear regression

Peter L. Bartlett et al.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2020)

Article Engineering, Electrical & Electronic

Optimum design of chamfer masks using symmetric mean absolute percentage error

Baraka Jacob Maiseli

EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING (2019)

Article Statistics & Probability

A Coefficient of Determination for Generalized Linear Models

Dabao Zhang

AMERICAN STATISTICIAN (2017)

Article Multidisciplinary Sciences

A new accuracy measure based on bounded relative error for time series forecasting

Chao Chen et al.

PLOS ONE (2017)

Article Computer Science, Artificial Intelligence

Mean Absolute Percentage Error for regression models

Arnaud de Myttenaere et al.

NEUROCOMPUTING (2016)

Editorial Material Biochemical Research Methods

POINTS OF SIGNIFICANCE Simple linear regression

Naomi Altman et al.

NATURE METHODS (2015)

Editorial Material Biochemical Research Methods

Multiple linear regression

Martin Krzywinski et al.

NATURE METHODS (2015)

Article Geosciences, Multidisciplinary

Root mean square error (RMSE) or mean absolute error (MAE)? - Arguments against avoiding RMSE in the literature

T. Chai et al.

GEOSCIENTIFIC MODEL DEVELOPMENT (2014)

Editorial Material Engineering, Electrical & Electronic

Simple Formulas for Bias and Mean Square Error Computation

H. C. So et al.

IEEE SIGNAL PROCESSING MAGAZINE (2013)

Article Gastroenterology & Hepatology

The Enhanced Liver Fibrosis (ELF) score: Normal values, influence factors and proposed cut-off values

Ralf Lichtinghagen et al.

JOURNAL OF HEPATOLOGY (2013)

Article Education & Educational Research

Using the coefficient of determination R2 to test the significance of multiple linear regression

Roberto C. Quinino et al.

TEACHING STATISTICS (2013)

Article Genetics & Heredity

A Better Coefficient of Determination for Genetic Profile Analysis

Sang Hong Lee et al.

GENETIC EPIDEMIOLOGY (2012)

Letter Ophthalmology

The Coefficient of Determination: What Determines a Useful R2 Statistic?

Luke Saunders et al.

INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE (2012)

Article Computer Science, Interdisciplinary Applications

Bayesian inference for additive mixed quantile regression models

Yu Ryan Yue et al.

COMPUTATIONAL STATISTICS & DATA ANALYSIS (2011)

Article Mathematics, Interdisciplinary Applications

Accuracy in Parameter Estimation for the Root Mean Square Error of Approximation: Sample Size Planning for Narrow Confidence Intervals

Ken Kelley et al.

MULTIVARIATE BEHAVIORAL RESEARCH (2011)

Article Statistics & Probability

A robust coefficient of determination for regression

Olivier Renaud et al.

JOURNAL OF STATISTICAL PLANNING AND INFERENCE (2010)

Review Cell Biology

Linking data to models: data regression

Khuloud Jaqaman et al.

NATURE REVIEWS MOLECULAR CELL BIOLOGY (2006)

Article Mathematics, Applied

Multiresponse robust design:: Mean square error (MSE) criterion

O Köksoy

APPLIED MATHEMATICS AND COMPUTATION (2006)

Article Economics

Another look at measures of forecast accuracy

Rob J. Hyndman et al.

INTERNATIONAL JOURNAL OF FORECASTING (2006)

Article Ophthalmology

Visual acuity as a function of Zernike mode and level of root mean square error

RA Applegate et al.

OPTOMETRY AND VISION SCIENCE (2003)

Article Computer Science, Artificial Intelligence

Random forests

L Breiman

MACHINE LEARNING (2001)

Article Psychology, Educational

Power and sample size for the root mean square error of approximation test of not close fit in structural equation modeling

GR Hancock et al.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2001)

Article Economics

The M3-Competition: results, conclusions and implications

S Makridakis et al.

INTERNATIONAL JOURNAL OF FORECASTING (2000)

Article Engineering, Electrical & Electronic

Coefficient of determination in nonlinear signal processing

ER Dougherty et al.

SIGNAL PROCESSING (2000)