4.2 Review

Inside pandora's box: a systematic review of the assessment of the perceived quality of chatbots for people with disabilities or special needs

Journal

Publisher

TAYLOR & FRANCIS INC
DOI: 10.1080/17483107.2020.1775313

Keywords

Chatbots; conversational agents; assistive technology; people with disability; people with special needs; quality of interaction; usability; user experience

Categories

Funding

  1. DGTCSI-ISCTI - Directorate General for Management and Information and Communications Technology, Superior Institute of Communication and Information Technologies, Ministry of Economic Development, Rome, Italy

Ask authors/readers for more resources

Introduction:People with disabilities or special needs can benefit from AI-based conversational agents (i.e., chatbots) that are used for competence training and well-being management. Assessing the quality of interactions with these chatbots is key to being able to reduce dissatisfaction with them and to understanding their potential long-term benefit. This in turn will help to increase adherence to their use, thereby improving the quality of life of the large population of end-users that they are able to serve. Methods:Following Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) methodology, we systematically reviewed the literature on methods of assessing the perceived quality of interactions with chatbots using the from Scopus and the Web of Science electronic databases. Using the Boolean operators (AND/OR) the keywords chatbot*, conversational agent*, special needs, disability were combined. Results:Revealed that only 15 of 192 papers on this topic included people with disabilities or special needs in their assessments. The results also highlighted the lack of a shared theoretical framework for assessing the perceived quality of interactions with chatbots. Conclusion:Systematic procedures based on reliable and valid methodologies continue to be needed in this field. The current lack of reliable tools and systematic methods to assess chatbots for people with disabilities and special needs is concerning, and ultimately, it may also lead to unreliable systems entering the market with disruptive consequences for people.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available