4.6 Article

Assessing the accuracy of predictive models for numerical data: Not r nor r2, why not? Then what?

期刊

PLOS ONE
卷 12, 期 8, 页码 -

出版社

PUBLIC LIBRARY SCIENCE
DOI: 10.1371/journal.pone.0183250

关键词

-

资金

  1. Geoscience Australia

向作者/读者索取更多资源

Assessing the accuracy of predictive models is critical because predictive models have been increasingly used across various disciplines and predictive accuracy determines the quality of resultant predictions. Pearson product-moment correlation coefficient (r) and the coefficient of determination (r(2)) are among the most widely used measures for assessing predictive models for numerical data, although they are argued to be biased, insufficient and misleading. In this study, geometrical graphs were used to illustrate what were used in the calculation of r and r(2) and simulations were used to demonstrate the behaviour of r and r(2) and to compare three accuracy measures under various scenarios. Relevant confusions about r and r(2), has been clarified. The calculation of r and r(2) is not based on the differences between the predicted and observed values. The existing error measures suffer various limitations and are unable to tell the accuracy. Variance explained by predictive models based on cross-validation (VEcv) is free of these limitations and is a reliable accuracy measure. Legates and McCabe's efficiency (E-1) is also an alternative accuracy measure. The r and r(2) do not measure the accuracy and are incorrect accuracy measures. The existing error measures suffer limitations. VEcv and E-1 are recommended for assessing the accuracy. The applications of these accuracy measures would encourage accuracy-improved predictive models to be developed to generate predictions for evidence-informed decision-making.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据