期刊
KNOWLEDGE-BASED SYSTEMS
卷 149, 期 -, 页码 47-60出版社
ELSEVIER
DOI: 10.1016/j.knosys.2018.02.005
关键词
Judgment analysis; Opinion ensemble; Rank aggregation
资金
- MeitY, Government of India
In crowd opinion aggregation models, the expertise of annotators plays an important role to derive the appropriate judgment. It is seen that in most of the aggregation methods annotators' accuracy and bias are considered as two important features and based on it the priority of annotators is assigned. But instead of relying upon these limited features, the quality of annotators can be suitably exploited using rank-based features to further improve the prediction. Basically, the annotators are ranked according to various features and therefrom multiple separate rankings are produced. These rankings, if properly weighted, can lead to obtain the final aggregated ranking in a better way. In this paper, we have developed a novel weighted rank aggregation approach and applied the same on three artificially generated ranking datasets with varying noise. Moreover, the comparative effectiveness of the proposed method is demonstrated by applying it on three Amazon Mechanical Turk datasets. (C) 2018 Elsevier B.V. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据