4.6 Article

Uncertainty Prediction for Machine Learning Models of Material Properties

期刊

ACS OMEGA
卷 6, 期 48, 页码 32431-32440

出版社

AMER CHEMICAL SOC
DOI: 10.1021/acsomega.1c03752

关键词

-

资金

  1. National Institute of Standards and Technology and the Materials Genome Initiative (MGI)

向作者/读者索取更多资源

Uncertainty quantification is crucial in AI-based material properties predictions, and in this study, three different approaches were compared for evaluating individual uncertainties. Directly modeling individual uncertainties was found to be the most convenient and accurate method among the three approaches.
Uncertainty quantification in artificial intelligence (AI)-based predictions of material properties is of immense importance for the success and reliability of AI applications in materials science. While confidence intervals are commonly reported for machine learning (ML) models, prediction intervals, i.e., the evaluation of the uncertainty on each prediction, are not as frequently available. In this work, we compare three different approaches to obtain such individual uncertainty, testing them on 12 ML-physical properties. Specifically, we investigated using the quantile loss function, machine learning the prediction intervals directly, and using Gaussian processes. We identify each approach's advantages and disadvantages and end up slightly favoring the modeling of the individual uncertainties directly, as it is the easiest to fit and, in most of the cases, minimizes over- and underestimation of the predicted errors. All data for training and testing were taken from the publicly available JARVIS-DFT database, and the codes developed for computing the prediction intervals are available through the JARVIS-tools package.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据