Journal
PATTERNS
Volume 1, Issue 2, Pages -Publisher
CELL PRESS
DOI: 10.1016/j.patter.2020.100025
Keywords
-
Categories
Funding
- Singapore Ministry of Education Academic Research Fund Tier 2 grant [MOE2019-T2-1-042]
- NRF-NSFC [NRF2018NRFNSFC003SB-006]
- Accelerating Creativity in Excellence grant from NTU
- National Research Foundation Singapore under its AI Singapore Program [AISG-100E-2019-027, AISG-100E2019-028]
- Kwan Im Thong Hood Cho Temple Chair Professorship
Ask authors/readers for more resources
Class-prediction accuracy provides a quick but superficial way of determining classifier performance. It does not inform on the reproducibility of the findings or whether the selected or constructed features used are meaningful and specific. Furthermore, the class-prediction accuracy oversummarizes and does not inform on how training and learning have been accomplished: two classifiers providing the same performance in one validation can disagree on many future validations. It does not provide explainability in its decision-making process and is not objective, as its value is also affected by class proportions in the validation set. Despite these issues, this does not mean we should omit the class-prediction accuracy. Instead, it needs to be enriched with accompanying evidence and tests that supplement and contextualize the reported accuracy. This additional evidence serves as augmentations and can help us perform machine learning better while avoiding naive reliance on oversimplified metrics.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available