Journal
ADVANCED INTELLIGENT SYSTEMS
Volume 4, Issue 12, Pages -Publisher
WILEY
DOI: 10.1002/aisy.202200213
Keywords
electronic skin; machine learning; multimodal; robotics; tactile sensors
Funding
- Postgraduate Research&Practice Innovation Program of Jiangsu Province [KYCX22_0230]
- National Natural Science Foundation of China [62075040]
- National Key R&D Program of China [2021YFF0701100, 2021YFB3600502]
Ask authors/readers for more resources
This article reviews recent advances in multimodal sensing and processing systems for advanced robotics, presenting various types of multimodal sensors and data fusion algorithms. The challenges and future development of multimodal sensors and data fusion algorithms are discussed, and the potential applications of these advancements in different fields are highlighted.
Nature has proved that multiple sense and processing capabilities are critical for target recognition and race survival. As such, advanced robots that perform missions in an unstructured environment highly need organism-similar multimodal sensing and processing systems for sophisticated unstructured environmental stimuli. Herein, recent progress in multimodal sensing and processing systems for advanced robotics is reviewed. Multimodal sensors including tactile sensors that capture surface properties of objects (i.e., thermal conductivity, temperature, softness, and electron affinity), visual sensors that capture the color and size of objects, and gas sensors that capture object smell are summarized. The multimodal data fusion algorithms that process multimodal signals from multimodal sensors to achieve object recognition and decision making are also presented. The challenges and future development of multimodal sensors and data fusion algorithms are further discussed. Advances in these areas open new avenues for advanced robotics applications in human-robot collaboration, rescue missions, garbage sorting, and intelligent prosthetics.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available