期刊
出版社
ASSOC COMPUTING MACHINERY
DOI: 10.1145/3591106.3592281
关键词
video retrieval; evaluation; benchmarking; quality assurance
This paper proposes a process for refining known-item and open-set type queries in interactive video retrieval evaluations. It emphasizes the importance of proper task interpretations.
Different task interpretations are a highly undesired element in interactive video retrieval evaluations. When a participating team focuses partially on a wrong goal, the evaluation results might become partially misleading. In this paper, we propose a process for refining known-item and open-set type queries, and preparing the assessors that judge the correctness of submissions to openset queries. Our findings from recent years reveal that a proper methodology can lead to objective query quality improvements and subjective participant satisfaction with query clarity.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据