Journal
2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS)
Volume -, Issue -, Pages 1756-1763Publisher
IEEE
DOI: 10.1109/IROS47612.2022.9981461
Keywords
-
Categories
Funding
- ONR [N0014-19-1-2266]
- ARL DCIST CRA award [W911NF17-2-0181]
Ask authors/readers for more resources
This research proposes a human-interactive framework for detecting human-informed interesting objects through few-shot online learning. An unsupervised learning algorithm is applied on the unmanned vehicle to recognize interesting scenes, and annotations provided by a human operator are used to learn and detect similar objects.
Interestingness recognition is crucial for decision making in autonomous exploration for mobile robots. Previous methods proposed an unsupervised online learning approach that can adapt to environments and detect interesting scenes quickly, but lack the ability to adapt to human-informed interesting objects. To solve this problem, we introduce a human-interactive framework, AirInteraction, that can detect human-informed objects via few-shot online learning. To reduce the communication bandwidth, we first apply an online unsupervised learning algorithm on the unmanned vehicle for interestingness recognition and then only send the potential interesting scenes to a base-station for human inspection. The human operator is able to draw and provide bounding box annotations for particular interesting objects, which are sent back to the robot to detect similar objects via few-shot learning. Only using few human-labeled examples, the robot can learn novel interesting object categories during the mission and detect interesting scenes that contain the objects. We evaluate our method on various interesting scene recognition datasets. To the best of our knowledge, it is the first human-informed fewshot object detection framework for autonomous exploration.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available