期刊
IEEE TRANSACTIONS ON MULTIMEDIA
卷 24, 期 -, 页码 2392-2406出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2021.3080076
关键词
Cameras; Robot vision systems; Image recognition; Robots; Service robots; Training; Cloud computing; Scene recognition; convolutional neural networks (CNNs); service robot; fish-eye camera; feature fusion
资金
- National Key R&D Program of China [2018YFB1307101]
- NationalNatural Science Foundation of China [U1813215]
This paper proposes a family scene recognition mechanism for service robots, which addresses the challenges of view shortage and poor adaptation. By using a combination of different cameras, the mechanism ensures sufficient view for the robot. A feature fusion method is designed to improve training efficiency and recognition accuracy, and the mechanism is deployed in a hybrid cloud with human guidance to enhance recognition skills and adaptation.
The key challenges of scene recognition for service robots in various family environments are the view shortage of holistic scenes and poor adaptation. To address these problems, a family scene recognition mechanism for the service robot is proposed in this paper. A comprehensive application of fish-eye, pinhole, and depth cameras is provided to guarantee the sufficient view of robot. A selective CNN features fusion for the recognition of fish-eye scene images is designed to improve the training efficiency and the recognition accuracy. The mechanism is deployed in a designed hybrid cloud including public and private clouds. The proposed family scene recognition model is trained by large-scale datasets in the public cloud and runs in the private cloud. Besides, the recognition skill can be reinforced and increased by matching human guidance and CNN features to help the robot learn new scenes and improve the adaptation in different family environments. Extensive experiments are implemented to evaluate the proposed method using real scene images from six families. The experiment results show the validity and good performance of our method for the service robot scene recognition in various family environments.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据