Journal
INFORMATION SCIENCES
Volume 546, Issue -, Pages 803-814Publisher
ELSEVIER SCIENCE INC
DOI: 10.1016/j.ins.2020.08.117
Keywords
Crowdsourcing; Label noise correction; Entropy; Cross-entropy
Categories
Funding
- National Natural Science Foundation of China [U1711267]
- Fundamental Research Funds for the Central Universities [CUGGC03]
Ask authors/readers for more resources
Crowdsourcing services offer a fast and cost-effective way to obtain labeled data, but label noise is commonly present. This study introduces a Cross-Entropy-based Noise Correction method that outperforms existing techniques in mitigating label noise in crowdsourced data.
Crowdsourcing services provide a fast, efficient, and cost-effective approach to obtaining labeled data, particularly for human-like tasks. In a crowdsourcing scenario, after ground truth inference methods have been employed to obtain integrated instance labels, label noise remains present in the integrated labels. Label noise handling techniques can then be implemented to mitigate the effects of this noise. In this study, we propose a Cross-Entropy-based Noise Correction (CENC) method for crowdsourcing. CENC uses the entropies of the label distributions generated from multiple noisy label sets to filter noisy instances. It then exploits the cross-entropies between each possible true class probability distribution and each predicted class probability distribution to rectify the noisy instances. Using both simulated benchmark data and real-world crowdsourced data, we show that CENC outperforms all other existing state-of-the-art noise correction methods. (C) 2020 Elsevier Inc. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available