Journal
PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17)
Volume -, Issue -, Pages 5839-5849Publisher
ASSOC COMPUTING MACHINERY
DOI: 10.1145/3025453.3025899
Keywords
blind; accessibility; photographs; object recognition; computer vision
Funding
- Shimizu Corporation
- JST CREST
- Direct For Computer & Info Scie & Enginr
- Division Of Computer and Network Systems [1205539] Funding Source: National Science Foundation
Ask authors/readers for more resources
Blind people often need to identify objects around them, from packages of food to items of clothing. Automatic object recognition continues to provide limited assistance in such tasks because models tend to be trained on images taken by sighted people with different background clutter, scale, viewpoints, occlusion, and image quality than in photos taken by blind users. We explore personal object recognizers, where visually impaired people train a mobile application with a few snapshots of objects of interest and provide custom labels. We adopt transfer learning with a deep learning system for user-defined multi-label k-instance classification. Experiments with blind participants demonstrate the feasibility of our approach, which reaches accuracies over 90% for some participants. We analyze user data and feedback to explore effects of sample size, photo-quality variance, and object shape; and contrast models trained on photos by blind participants to those by sighted participants and generic recognizers.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available