期刊
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
卷 112, 期 12, 页码 3618-3623出版社
NATL ACAD SCIENCES
DOI: 10.1073/pnas.1422953112
关键词
scene interpretation; computer vision; Turing test; binary questions; unpredictable answers
资金
- Office of Naval Research [ONR N000141010933]
- Defense Advanced Research Projects Agency [FA8650-11-1-7151]
- National Science Foundation [0964416]
- Direct For Computer & Info Scie & Enginr
- Div Of Information & Intelligent Systems [0964416] Funding Source: National Science Foundation
Today, computer vision systems are tested by their accuracy in detecting and localizing instances of objects. As an alternative, and motivated by the ability of humans to provide far richer descriptions and even tell a story about an image, we construct a visual Turing test: an operator-assisted device that produces a stochastic sequence of binary questions from a given test image. The query engine proposes a question; the operator either provides the correct answer or rejects the question as ambiguous; the engine proposes the next question (just-in-time truthing). The test is then administered to the computer-vision system, one question at a time. After the system's answer is recorded, the system is provided the correct answer and the next question. Parsing is trivial and deterministic; the system being tested requires no natural language processing. The query engine employs statistical constraints, learned from a training set, to produce questions with essentially unpredictable answers-the answer to a question, given the history of questions and their correct answers, is nearly equally likely to be positive or negative. In this sense, the test is only about vision. The system is designed to produce streams of questions that follow natural story lines, from the instantiation of a unique object, through an exploration of its properties, and on to its relationships with other uniquely instantiated objects.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据