期刊
INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY
卷 19, 期 2, 页码 373-383出版社
SPRINGER
DOI: 10.1007/s10772-015-9330-4
关键词
Chatbot; Usefulness; Localizability; Humanness; Naturalness; Language benefit
Human-computer dialogue systems interact with human users using natural language. We used the ALICE/AIML chatbot architecture as a platform to develop a range of chatbots covering different languages, genres, text-types, and user-groups, to illustrate qualitative aspects of natural language dialogue system evaluation. We present some of the different evaluation techniques used in natural language dialogue systems, including black box and glass box, comparative, quantitative, and qualitative evaluation. Four aspects of NLP dialogue system evaluation are often overlooked: usefulness'' in terms of a user's qualitative needs, localizability'' to new genres and languages, humanness'' or naturalness'' compared to human-human dialogues, and language benefit'' compared to alternative interfaces. We illustrated these aspects with respect to our work on machine-learnt chatbot dialogue systems; we believe these aspects are worthwhile in impressing potential new users and customers.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据