4.6 Review

External Extrinsic Calibration of Multi-Modal Imaging Sensors: A Review

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Artificial Intelligence

Automatic targetless LiDAR-camera calibration: a survey

Xingchen Li et al.

Summary: This paper presents a thorough review of automatic targetless LiDAR-camera calibration methods. The methods are divided into four categories based on how potential cues in the environment are utilized, and an in-depth overview is provided for each category, serving as a potential guidance for researchers in the related fields.

ARTIFICIAL INTELLIGENCE REVIEW (2023)

Review Computer Science, Artificial Intelligence

External multi-modal imaging sensor calibration for sensor fusion: A review

Zhouyan Qiu et al.

Summary: With the increasing demand for external sensor calibration in multi-modal data fusion, this review examines recent research on multi-modal imaging sensor calibration and proposes future research directions. The review comprehensively explains different calibration methods and highlights the emerging research direction of systematic calibration.

INFORMATION FUSION (2023)

Article Engineering, Mechanical

Calibration of multi-sensor fusion for autonomous vehicle system

Yongkang Lu et al.

Summary: This paper proposes an effective multi-sensor calibration method for autonomous vehicle systems, which includes single-sensor intrinsic calibration, multi-sensor extrinsic calibration, and multi-sensor time synchronization. The experiment results demonstrate the practical validity of the proposed algorithm.

INTERNATIONAL JOURNAL OF VEHICLE DESIGN (2023)

Proceedings Paper Automation & Control Systems

Joint Camera Intrinsic and LiDAR-Camera Extrinsic Calibration

Guohang Yan et al.

Summary: Sensor-based environmental perception is crucial for autonomous driving systems, and accurately calibrating multiple sensors is essential. This paper proposes a novel target-based joint calibration method for camera intrinsic and LiDAR-camera extrinsic parameters. The method utilizes a unique calibration board pattern and a cost function to solve for the camera's parameters and the LiDAR-camera extrinsic parameters. Experimental results demonstrate the accuracy and robust performance of the proposed method.

2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023) (2023)

Article Computer Science, Information Systems

Particle Swarm Optimization: A Comprehensive Survey

Tareq M. Shami et al.

Summary: This paper provides a comprehensive review of particle swarm optimization (PSO), including its basic concepts, variants, applications, and drawbacks. It also reviews research on utilizing PSO to solve feature selection problems and presents potential research directions.

IEEE ACCESS (2022)

Article Optics

Improvement to LiDAR-camera extrinsic calibration by using 3D-3D correspondences

An Duy Nguyen et al.

Summary: This study proposes a calibration method using a planar board to improve the accuracy of calibration between 3D LiDAR systems and cameras. By utilizing 3D-3D vertices and plane correspondences, a rigid transformation is performed, and the accuracy of vertex estimation is improved by compensating for missing parts. The proposed method is evaluated through experiments on simulated data and real datasets.
Article Chemistry, Analytical

Automatic Extrinsic Calibration of 3D LIDAR and Multi-Cameras Based on Graph Optimization

Jinshun Ou et al.

Summary: This paper presents a 3D LIDAR-to-camera automatic calibration framework based on graph optimization, which can achieve automatic calibration between LIDAR and multiple cameras and achieve more accurate calibration results than existing methods.

SENSORS (2022)

Article Engineering, Civil

Automotive LiDAR Technology: A Survey

Ricardo Roriz et al.

Summary: This article presents the recent advances and technologies behind LiDAR sensors for the automotive industry, while highlighting the current and future challenges, providing insights on how to step towards better LiDAR solutions.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

ATOP: An Attention-to-Optimization Approach for Automatic LiDAR-Camera Calibration via Cross-Modal Object Matching

Yi Sun et al.

IEEE Transactions on Intelligent Vehicles (2022)

Article Engineering, Civil

Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups

Jorge Beltran et al.

Summary: Most sensor setups for onboard autonomous perception consist of LiDARs and vision systems, and an accurate calibration between the sensors is required. We propose a method to calibrate the extrinsic parameters of any pair of sensors, which can handle devices with different resolutions and poses, and outperforms existing methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Proceedings Paper Automation & Control Systems

An Efficient and Accurate Solution to Camera Pose Estimation Problem from Point and Line Correspondences Based on Null Space Analysis

Yi Zhang et al.

Summary: In this paper, a solution named EOPnPL is proposed for the perspective n-point and line problem. Through null space analysis, EOPnPL integrates linear-expressed line constraints with original point constraints to achieve both accuracy and efficiency. Experimental results show that EOPnPL performs well in simulations and real-data experiments, with high accuracy compared to other methods under ordinary conditions.

2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Rope3D: The Roadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Task

Xiaoqing Ye et al.

Summary: To accelerate the progress of roadside perception for autonomous driving, we present Rope3D, the first high-diversity challenging 3D dataset specifically designed for roadside perception tasks. The dataset consists of a large number of images and 3D objects captured under various settings, and we also establish a new roadside perception benchmark and propose an improved object detection approach.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) (2022)

Proceedings Paper Computer Science, Software Engineering

A cooperative LiDAR-camera scheme for extrinsic calibration

Georgios Zamanakos et al.

Summary: This paper proposes a method for LiDAR-camera extrinsic calibration from multiple static scenes, using a simple design for calibration target with an ArUco marker. A novel LiDAR-camera cooperative scheme is employed, where the camera-based detection of the marker guides the processing of the LiDAR point cloud to detect the 3D marker in it. Accuracy in marker localization is improved through further correction of the pose estimation once the marker has been accurately localized. Experimental results demonstrate the improved accuracy in the computation of the extrinsic calibration parameters.

2022 IEEE 14TH IMAGE, VIDEO, AND MULTIDIMENSIONAL SIGNAL PROCESSING WORKSHOP (IVMSP) (2022)

Article Robotics

Online multi-sensor calibration based on moving object tracking

J. Persic et al.

Summary: A proposed online calibration method based on detection and tracking of moving objects aims to enhance the long-term reliability of perception sensors in autonomous systems. The method includes track-to-track association, lightweight decalibration detection, and graph-based rotation calibration, providing a resource inexpensive solution by utilizing existing information in the system.

ADVANCED ROBOTICS (2021)

Article Robotics

Event-Based Stereo Visual Odometry

Yi Zhou et al.

Summary: Event-based cameras, with their independently working pixels and asynchronous response to brightness changes, are able to tackle challenging scenarios in robotics, such as high-speed and high dynamic range scenes. The system leverages the advantages of event-based cameras to perform visual odometry in challenging illumination conditions and runs in real-time on a standard CPU, demonstrating versatility in natural scenes with general 6-DoF motion.

IEEE TRANSACTIONS ON ROBOTICS (2021)

Article Optics

Simple and efficient registration of 3D point cloud and image data for an indoor mobile mapping system

Hao Ma et al.

Summary: A simple and efficient registration method for 3D lidar point clouds with optical images is proposed, featuring point feature extraction, cost map construction, and consideration of loss function to improve robustness. Experiments demonstrate positive results.

JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION (2021)

Review Chemistry, Analytical

Sensor and Sensor Fusion Technology in Autonomous Vehicles: A Review

De Jong Yeong et al.

Summary: Automated driving is becoming a pivotal technology in transforming the future of transportation with advancements in sensor and communication technology. Sensor calibration is crucial for ensuring the safety and feasibility of automated driving vehicles, while sensor fusion and obstacle detection techniques play a critical role in the successful implementation of autonomous driving systems.

SENSORS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

SemCal: Semantic LiDAR-Camera Calibration using Neural Mutual Information Estimator

Peng Jiang et al.

Summary: This paper presents an automatic calibration algorithm for a LiDAR and camera system using semantic information, with a novel differentiable objective function supporting gradient-based optimization methods. The method demonstrates improved robustness and accuracy on synthetic datasets and urban, off-road benchmark datasets.

2021 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI) (2021)

Proceedings Paper Automation & Control Systems

Line-based Automatic Extrinsic Calibration of LiDAR and Camera

Xinyu Zhang et al.

Summary: A line-based method is proposed for automatic online extrinsic calibration of LiDAR and camera, demonstrating its robustness in extracting geometric features and improving calibration accuracy. Experiments on the KITTI benchmark verify the method's effectiveness in achieving accurate calibration. Additionally, the method shows applicability in various scenarios by automatically correcting miscalibration errors and achieving high accuracy in online experiments.

2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021) (2021)

Proceedings Paper Automation & Control Systems

Multi-sensor Fusion Incorporating Adaptive Transformation for Reconfigurable Pavement Sweeping Robot

A. P. Povendhan et al.

Summary: Efficient sensor fusion framework is necessary for autonomous robots. Our research proposes an adaptive sensor fusion framework that can be implemented on any reconfigurable robot and has been tested on a real robot.

2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2021)

Proceedings Paper Computer Science, Artificial Intelligence

DeepI2P: Image-to-Point Cloud Registration via Deep Classification

Jiaxin Li et al.

Summary: This paper introduces a novel approach for cross-modality registration between an image and a point cloud, converting the registration problem into a classification and inverse camera projection optimization problem. Experimental results demonstrate the feasibility of this method.

2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 (2021)

Article Computer Science, Artificial Intelligence

A Joint Extrinsic Calibration Tool for Radar, Camera and Lidar

Joris Domhof et al.

Summary: Our study addresses joint extrinsic calibration of lidar, camera and radar sensors, proposing a single calibration target design for all three modalities. The results show that using terms for all sensor pairs is the most robust method, especially for lidar to radar calibration.

IEEE TRANSACTIONS ON INTELLIGENT VEHICLES (2021)

Article Computer Science, Artificial Intelligence

The ApolloScape Open Dataset for Autonomous Driving and Its Application

Xinyu Huang et al.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2020)

Proceedings Paper Automation & Control Systems

CalibRCNN: Calibrating Camera and LiDAR by Recurrent Convolutional Neural Network and Geometric Constraints

Jieying Shi et al.

2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2020)

Proceedings Paper Automation & Control Systems

Automatic LiDAR-Camera Calibration of Extrinsic Parameters Using a Spherical Target

Tekla Toth et al.

2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2020)

Proceedings Paper Automation & Control Systems

Unified Intrinsic and Extrinsic Camera and LiDAR Calibration under Uncertainties

Julius Kuemmerle et al.

2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2020)

Proceedings Paper Computer Science, Software Engineering

An Improved Harris Corner Detection Algorithm

Qingfeng Sun

COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL II: SIGNAL PROCESSING (2020)

Article Chemistry, Analytical

LiDAR-Camera Calibration Using Line Correspondences

Zixuan Bai et al.

SENSORS (2020)

Article Robotics

Spatiotemporal Camera-LiDAR Calibration: A Targetless and Structureless Approach

Chanoh Park et al.

IEEE ROBOTICS AND AUTOMATION LETTERS (2020)

Article Computer Science, Information Systems

Multi-Sensor Fusion in Automated Driving: A Survey

Zhangjing Wang et al.

IEEE ACCESS (2020)

Article Computer Science, Artificial Intelligence

Recent progress in semantic image segmentation

Xiaolong Liu et al.

ARTIFICIAL INTELLIGENCE REVIEW (2019)

Article Engineering, Biomedical

A Brain-Robot Interaction System by Fusing Human and Machine Intelligence

Xiaoqian Mao et al.

IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING (2019)

Article Engineering, Multidisciplinary

Bearing fault diagnosis based on Cluster-contraction Stage-wise Orthogonal-Matching-Pursuit

Liu Song et al.

MEASUREMENT (2019)

Review Forestry

Structure from Motion Photogrammetry in Forestry: a Review

Jakob Iglhaut et al.

CURRENT FORESTRY REPORTS (2019)

Article Robotics

Robust improvement solution to perspective-n-point problem

Feng Youyang et al.

INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS (2019)

Article Automation & Control Systems

Extrinsic 6DoF calibration of a radar-LiDAR-camera system enhanced by radar cross section estimates evaluation

Juraj Persic et al.

ROBOTICS AND AUTONOMOUS SYSTEMS (2019)

Article Engineering, Multidisciplinary

Improved FAST corner-detection method

Wenyi Xiong et al.

JOURNAL OF ENGINEERING-JOE (2019)

Proceedings Paper Computer Science, Artificial Intelligence

WoodScape: A multi-task, multi-camera fisheye dataset for autonomous driving

Senthil Yogamani et al.

2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) (2019)

Proceedings Paper Imaging Science & Photographic Technology

SFM AND SEMANTIC INFORMATION BASED ONLINE TARGETLESS CAMERA-LIDAR SELF-CALIBRATION

Balazs Nagy et al.

2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) (2019)

Article Computer Science, Information Systems

Extrinsic Calibration and Odometry for Camera-LiDAR Systems

Chenghao Shi et al.

IEEE ACCESS (2019)

Proceedings Paper Automation & Control Systems

2D3D-MatchNet: Learning to Match Keypoints Across 2D Image and 3D Point Cloud

Mengdan Feng et al.

2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA) (2019)

Article Geography, Physical

Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features

Jianping Li et al.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2018)

Article Computer Science, Information Systems

Multi-sensor data fusion using NIHS transform and decomposition algorithms

V. Ankarao et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2018)

Editorial Material Chemistry, Analytical

Sensing and Connection Systems for Assisted and Autonomous Driving and Unmanned Vehicles

Sergio Saponara

SENSORS (2018)

Article Computer Science, Information Systems

Charuco Board-Based Omnidirectional Camera Calibration Method

Gwon Hwan An et al.

ELECTRONICS (2018)

Proceedings Paper Computer Science, Cybernetics

Online Recalibration of a Camera and Lidar System

Hao-Ting Wang et al.

2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC) (2018)

Article Computer Science, Artificial Intelligence

Fine scale image registration in large-scale urban LIDAR point sets

Maximilien Guislain et al.

COMPUTER VISION AND IMAGE UNDERSTANDING (2017)

Article Engineering, Civil

High-Precision Vehicle Navigation in Urban Environments Using an MEM's IMU and Single-Frequency GPS Receiver

Sheng Zhao et al.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2016)

Article Robotics

Motion-Based Calibration of Multimodal Sensor Extrinsics and Timing Offset Estimation

Zachary Taylor et al.

IEEE TRANSACTIONS ON ROBOTICS (2016)

Article Optics

Cross-ratio-based line scan camera calibration using a planar pattern

Dongdong Li et al.

OPTICAL ENGINEERING (2016)

Article Computer Science, Information Systems

Fast Power and Performance Evaluation of FPGA-Based Wireless Communication Systems

Jordane Lorandel et al.

IEEE ACCESS (2016)

Article Engineering, Electrical & Electronic

Automatic Fusion of Hyperspectral Images and Laser Scans Using Feature Points

Xiao Zhang et al.

JOURNAL OF SENSORS (2015)

Article Robotics

Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information

Gaurav Pandey et al.

JOURNAL OF FIELD ROBOTICS (2015)

Proceedings Paper Computer Science, Artificial Intelligence

Direct Visual Localisation and Calibration for Road Vehicles in Changing City Environments

Geoffrey Pascoe et al.

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW) (2015)

Proceedings Paper Computer Science, Artificial Intelligence

FlowNet: Learning Optical Flow with Convolutional Networks

Alexey Dosovitskiy et al.

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) (2015)

Article Computer Science, Interdisciplinary Applications

MVSec: multi-perspective and deductive visual analytics on heterogeneous network security data

Ying Zhao et al.

JOURNAL OF VISUALIZATION (2014)

Article Robotics

Vision meets robotics: The KITTI dataset

A. Geiger et al.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2013)

Article Automation & Control Systems

Extrinsic Calibration of a Camera and Laser Range Finder Using a New Calibration Structure of a Plane with a Triangular Hole

Jong-Eun Ha

INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS (2012)

Article Computer Science, Artificial Intelligence

EPnP: An Accurate O(n) Solution to the PnP Problem

Vincent Lepetit et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2009)

Article Optics

Flexible and accurate implementation of a binocular structured light system

Rongqian Yang et al.

OPTICS AND LASERS IN ENGINEERING (2008)

Article Computer Science, Information Systems

The similarity metric

M Li et al.

IEEE TRANSACTIONS ON INFORMATION THEORY (2004)