3.8 Proceedings Paper

Improving Query and Assessment Quality in Text-Based Interactive Video Retrieval Evaluation

出版社

ASSOC COMPUTING MACHINERY
DOI: 10.1145/3591106.3592281

关键词

video retrieval; evaluation; benchmarking; quality assurance

向作者/读者索取更多资源

This paper proposes a process for refining known-item and open-set type queries in interactive video retrieval evaluations. It emphasizes the importance of proper task interpretations.
Different task interpretations are a highly undesired element in interactive video retrieval evaluations. When a participating team focuses partially on a wrong goal, the evaluation results might become partially misleading. In this paper, we propose a process for refining known-item and open-set type queries, and preparing the assessors that judge the correctness of submissions to openset queries. Our findings from recent years reveal that a proper methodology can lead to objective query quality improvements and subjective participant satisfaction with query clarity.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

3.8
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据