Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations

In contrast to previous works on data augmentation using LIDAR (Light Detection and Ranging), which mostly consider point clouds under good weather conditions, this paper uses point clouds which are affected by spray. Spray water can be a cause of phantom braking and understanding how to handle the...

Full description

Bibliographic Details
Main Authors: Jose Roberto Vargas Rivero, Thiemo Gerbich, Boris Buschardt, Jia Chen
Format: Article
Language:English
Published: MDPI AG 2021-06-01
Series:Sensors
Subjects:
AV
Online Access:https://www.mdpi.com/1424-8220/21/13/4503
id doaj-a763cbc7b98a4f819cfaf2225cbcc814
record_format Article
spelling doaj-a763cbc7b98a4f819cfaf2225cbcc8142021-07-15T15:45:42ZengMDPI AGSensors1424-82202021-06-01214503450310.3390/s21134503Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather SituationsJose Roberto Vargas Rivero0Thiemo Gerbich1Boris Buschardt2Jia Chen3Audi AG, Auto-Union-Str., D-85057 Ingolstadt, GermanyAudi AG, Auto-Union-Str., D-85057 Ingolstadt, GermanyAudi AG, Auto-Union-Str., D-85057 Ingolstadt, GermanyElectrical and Computer Engineering, Technical University of Munich, Theresienstr. 90, D-80333 München, GermanyIn contrast to previous works on data augmentation using LIDAR (Light Detection and Ranging), which mostly consider point clouds under good weather conditions, this paper uses point clouds which are affected by spray. Spray water can be a cause of phantom braking and understanding how to handle the extra detections caused by it is an important step in the development of ADAS (Advanced Driver Assistance Systems)/AV (Autonomous Vehicles) functions. The extra detections caused by spray cannot be safely removed without considering cases in which real solid objects may be present in the same region in which the detections caused by spray take place. As collecting real examples would be extremely difficult, the use of synthetic data is proposed. Real scenes are reconstructed virtually with an added extra object in the spray region, in a way that the detections caused by this obstacle match the characteristics a real object in the same position would have regarding intensity, echo number and occlusion. The detections generated by the obstacle are then used to augment the real data, obtaining, after occlusion effects are added, a good approximation of the desired training data. This data is used to train a classifier achieving an average F-Score of 92. The performance of the classifier is analyzed in detail based on the characteristics of the synthetic object: size, position, reflection, duration. The proposed method can be easily expanded to different kinds of obstacles and classifier types.https://www.mdpi.com/1424-8220/21/13/4503LIDARpoint cloudspray waterADASAVdata augmentation
collection DOAJ
language English
format Article
sources DOAJ
author Jose Roberto Vargas Rivero
Thiemo Gerbich
Boris Buschardt
Jia Chen
spellingShingle Jose Roberto Vargas Rivero
Thiemo Gerbich
Boris Buschardt
Jia Chen
Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations
Sensors
LIDAR
point cloud
spray water
ADAS
AV
data augmentation
author_facet Jose Roberto Vargas Rivero
Thiemo Gerbich
Boris Buschardt
Jia Chen
author_sort Jose Roberto Vargas Rivero
title Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations
title_short Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations
title_full Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations
title_fullStr Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations
title_full_unstemmed Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations
title_sort data augmentation of automotive lidar point clouds under adverse weather situations
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-06-01
description In contrast to previous works on data augmentation using LIDAR (Light Detection and Ranging), which mostly consider point clouds under good weather conditions, this paper uses point clouds which are affected by spray. Spray water can be a cause of phantom braking and understanding how to handle the extra detections caused by it is an important step in the development of ADAS (Advanced Driver Assistance Systems)/AV (Autonomous Vehicles) functions. The extra detections caused by spray cannot be safely removed without considering cases in which real solid objects may be present in the same region in which the detections caused by spray take place. As collecting real examples would be extremely difficult, the use of synthetic data is proposed. Real scenes are reconstructed virtually with an added extra object in the spray region, in a way that the detections caused by this obstacle match the characteristics a real object in the same position would have regarding intensity, echo number and occlusion. The detections generated by the obstacle are then used to augment the real data, obtaining, after occlusion effects are added, a good approximation of the desired training data. This data is used to train a classifier achieving an average F-Score of 92. The performance of the classifier is analyzed in detail based on the characteristics of the synthetic object: size, position, reflection, duration. The proposed method can be easily expanded to different kinds of obstacles and classifier types.
topic LIDAR
point cloud
spray water
ADAS
AV
data augmentation
url https://www.mdpi.com/1424-8220/21/13/4503
work_keys_str_mv AT joserobertovargasrivero dataaugmentationofautomotivelidarpointcloudsunderadverseweathersituations
AT thiemogerbich dataaugmentationofautomotivelidarpointcloudsunderadverseweathersituations
AT borisbuschardt dataaugmentationofautomotivelidarpointcloudsunderadverseweathersituations
AT jiachen dataaugmentationofautomotivelidarpointcloudsunderadverseweathersituations
_version_ 1721298548829454336