期刊
BEHAVIOURAL PROCESSES
卷 148, 期 -, 页码 56-62出版社
ELSEVIER
DOI: 10.1016/j.beproc.2018.01.004
关键词
Validation; Confusion matrix; Linear regression; Error indices; Confusion probabilities; Feeding behaviour
资金
- Regional Council of Pohjois-Savo (European Regional Development Fund) [A31185]
- Centre for Economic Development, Transport
- Environment of Pohjois-Savo (European Social Fund) [S11334]
- Olvi foundation
- Niemi foundation
The aim of the present study was to evaluate empirically confusion matrices in device validation. We compared the confusion matrix method to linear regression and error indices in the validation of a device measuring feeding behaviour of dairy cattle. In addition, we studied how to extract additional information on classification errors with confusion probabilities. The data consisted of 12 h behaviour measurements from five dairy cows; feeding and other behaviour were detected simultaneously with a device and from video recordings. The resulting 216 000 pairs of classifications were used to construct confusion matrices and calculate performance measures. In addition, hourly durations of each behaviour were calculated and the accuracy of measurements was evaluated with linear regression and error indices. All three validation methods agreed when the behaviour was detected very accurately or inaccurately. Otherwise, in the intermediate cases, the confusion matrix method and error indices produced relatively concordant results, but the linear regression method often disagreed with them. Our study supports the use of confusion matrix analysis in validation since it is robust to any data distribution and type of relationship, it makes a stringent evaluation of validity, and it offers extra information on the type and sources of errors.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据