Accurate Calibration of Multi-LiDAR-Multi-Camera Systems

As autonomous driving attracts more and more attention these days, the algorithms and sensors used for machine perception become popular in research, as well. This paper investigates the extrinsic calibration of two frequently-applied sensors: the camera and Light Detection and Ranging (LiDAR). The...

Full description

Bibliographic Details
Main Authors: Zoltán Pusztai, Iván Eichhardt, Levente Hajder
Format: Article
Language:English
Published: MDPI AG 2018-07-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/18/7/2139
id doaj-ee10726841ff4f3abc706e74ddf59f4b
record_format Article
spelling doaj-ee10726841ff4f3abc706e74ddf59f4b2020-11-25T00:56:22ZengMDPI AGSensors1424-82202018-07-01187213910.3390/s18072139s18072139Accurate Calibration of Multi-LiDAR-Multi-Camera SystemsZoltán Pusztai0Iván Eichhardt1Levente Hajder2Geometric Computer Vision Group, Machine Perception Laboratory, MTA SZTAKI, Kende st. 17, 1111 Budapest, HungaryGeometric Computer Vision Group, Machine Perception Laboratory, MTA SZTAKI, Kende st. 17, 1111 Budapest, HungaryGeometric Computer Vision Group, Machine Perception Laboratory, MTA SZTAKI, Kende st. 17, 1111 Budapest, HungaryAs autonomous driving attracts more and more attention these days, the algorithms and sensors used for machine perception become popular in research, as well. This paper investigates the extrinsic calibration of two frequently-applied sensors: the camera and Light Detection and Ranging (LiDAR). The calibration can be done with the help of ordinary boxes. It contains an iterative refinement step, which is proven to converge to the box in the LiDAR point cloud, and can be used for system calibration containing multiple LiDARs and cameras. For that purpose, a bundle adjustment-like minimization is also presented. The accuracy of the method is evaluated on both synthetic and real-world data, outperforming the state-of-the-art techniques. The method is general in the sense that it is both LiDAR and camera-type independent, and only the intrinsic camera parameters have to be known. Finally, a method for determining the 2D bounding box of the car chassis from LiDAR point clouds is also presented in order to determine the car body border with respect to the calibrated sensors.http://www.mdpi.com/1424-8220/18/7/2139LiDARcameraLiDAR camera systemmachine perceptionextrinsic calibrationautonomous driving
collection DOAJ
language English
format Article
sources DOAJ
author Zoltán Pusztai
Iván Eichhardt
Levente Hajder
spellingShingle Zoltán Pusztai
Iván Eichhardt
Levente Hajder
Accurate Calibration of Multi-LiDAR-Multi-Camera Systems
Sensors
LiDAR
camera
LiDAR camera system
machine perception
extrinsic calibration
autonomous driving
author_facet Zoltán Pusztai
Iván Eichhardt
Levente Hajder
author_sort Zoltán Pusztai
title Accurate Calibration of Multi-LiDAR-Multi-Camera Systems
title_short Accurate Calibration of Multi-LiDAR-Multi-Camera Systems
title_full Accurate Calibration of Multi-LiDAR-Multi-Camera Systems
title_fullStr Accurate Calibration of Multi-LiDAR-Multi-Camera Systems
title_full_unstemmed Accurate Calibration of Multi-LiDAR-Multi-Camera Systems
title_sort accurate calibration of multi-lidar-multi-camera systems
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2018-07-01
description As autonomous driving attracts more and more attention these days, the algorithms and sensors used for machine perception become popular in research, as well. This paper investigates the extrinsic calibration of two frequently-applied sensors: the camera and Light Detection and Ranging (LiDAR). The calibration can be done with the help of ordinary boxes. It contains an iterative refinement step, which is proven to converge to the box in the LiDAR point cloud, and can be used for system calibration containing multiple LiDARs and cameras. For that purpose, a bundle adjustment-like minimization is also presented. The accuracy of the method is evaluated on both synthetic and real-world data, outperforming the state-of-the-art techniques. The method is general in the sense that it is both LiDAR and camera-type independent, and only the intrinsic camera parameters have to be known. Finally, a method for determining the 2D bounding box of the car chassis from LiDAR point clouds is also presented in order to determine the car body border with respect to the calibrated sensors.
topic LiDAR
camera
LiDAR camera system
machine perception
extrinsic calibration
autonomous driving
url http://www.mdpi.com/1424-8220/18/7/2139
work_keys_str_mv AT zoltanpusztai accuratecalibrationofmultilidarmulticamerasystems
AT ivaneichhardt accuratecalibrationofmultilidarmulticamerasystems
AT leventehajder accuratecalibrationofmultilidarmulticamerasystems
_version_ 1725227597982334976