4.7 Article

Collaborative Semantic Understanding and Mapping Framework for Autonomous Systems

Journal

IEEE-ASME TRANSACTIONS ON MECHATRONICS
Volume 26, Issue 2, Pages 978-989

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMECH.2020.3015054

Keywords

Semantics; Robot sensing systems; Collaboration; Geometry; Three-dimensional displays; Robot kinematics; Collaborative information fusion; mobile robots; semantic mapping; semantic segmentation

Funding

  1. National Research Foundation Singapore, ST Engineering-NTU Corporate Lab under its NRF Corporate Lab@UniversityScheme

Ask authors/readers for more resources

The article proposes a novel hierarchical collaborative probabilistic semantic mapping framework that combines single robot level semantic point cloud with collaborative robot level global semantic map fusion. An expectation-maximization approach is used to estimate hidden data association, followed by Bayesian rule for semantic and occupancy probability update. Experimental results demonstrate high quality of global semantic maps on unmanned aerial vehicle and unmanned ground vehicle platforms, showcasing accuracy and utility in practical missions.
Performing collaborative semantic mapping is a critical challenge for cooperative robots to enhance their comprehensive contextual understanding of the surroundings. This article bridges the gap between the advances in collaborative geometry mapping that relies on pure geometry information fusion, and single robot semantic mapping that focuses on integrating continuous raw sensor data. In this article, a novel hierarchical collaborative probabilistic semantic mapping framework is proposed, where the problem is formulated in a distributed setting. The key novelty of this work is the modeling of the hierarchical semantic map fusion framework and its mathematical derivation of its probability decomposition. At the single robot level, the semantic point cloud is obtained by combining information from heterogeneous sensors and used to generate local semantic maps. At the collaborative robots level, local maps are shared among robots for global semantic map fusion. Since the voxel correspondence is unknown between local maps, an expectation-maximization approach is proposed to estimate the hidden data association. Then, Bayesian rule is applied to perform semantic and occupancy probability update. Experimental results on the unmanned aerial vehicle and the unmanned ground vehicle platforms show the high quality of global semantic maps, demonstrating the accuracy and utility in practical missions.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available