期刊
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE
卷 25, 期 8, 页码 1173-1195出版社
WORLD SCIENTIFIC PUBL CO PTE LTD
DOI: 10.1142/S0218001411009093
关键词
Classification; ordinal data; evaluation measures; performance; classification accuracy
资金
- Fundacao para a Ciencia e a Tecnologia (FCT) - Portugal [PTDC/EIA/64914/2006]
- Fundação para a Ciência e a Tecnologia [PTDC/EIA/64914/2006] Funding Source: FCT
Ordinal classification is a form of multiclass classification for which there is an inherent order between the classes, but not a meaningful numeric differerence between them. The performance of such classifiers is usually assessed by measures appropriate for nominal classes or for regression. Unfortunately, these do not account for the true dimension of the error. The goal of this work is to show that existing measures for evaluating ordinal classification models surffer from a number of important shortcomings. For this reason, we propose an alternative measure defined directly in the confusion matrix. An error coefficient appropriate for ordinal data should capture how much the result diverges from the ideal prediction and how inconsistent the classifier is in regard to the relative order of the classes. The proposed coefficient results from the observation that the performance yielded by the Misclassification Error Rate coefficient is the benefit of the path along the diagonal of the confusion matrix. We carry out an experimental study which confirms the usefulness of the novel metric.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据