Integrity Monitoring of Multimodal Perception System for Vehicle Localization

Autonomous driving systems tightly rely on the quality of the data from sensors for tasks such as localization and navigation. In this work, we present an integrity monitoring framework that can assess the quality of multimodal data from exteroceptive sensors. The proposed multisource coherence-base...

Full description

Bibliographic Details
Main Authors: Arjun Balakrishnan, Sergio Rodriguez Florez, Roger Reynaud
Format: Article
Language:English
Published: MDPI AG 2020-08-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/16/4654
id doaj-c620d0ba93c5408aa18d99783fca906a
record_format Article
spelling doaj-c620d0ba93c5408aa18d99783fca906a2020-11-25T03:46:29ZengMDPI AGSensors1424-82202020-08-01204654465410.3390/s20164654Integrity Monitoring of Multimodal Perception System for Vehicle LocalizationArjun Balakrishnan0Sergio Rodriguez Florez1Roger Reynaud2CNRS, ENS Paris-Saclay, Université Paris-Saclay, 91190 Gif-sur-Yvette, FranceCNRS, ENS Paris-Saclay, Université Paris-Saclay, 91190 Gif-sur-Yvette, FranceCNRS, ENS Paris-Saclay, Université Paris-Saclay, 91190 Gif-sur-Yvette, FranceAutonomous driving systems tightly rely on the quality of the data from sensors for tasks such as localization and navigation. In this work, we present an integrity monitoring framework that can assess the quality of multimodal data from exteroceptive sensors. The proposed multisource coherence-based integrity assessment framework is capable of handling highway as well as complex semi-urban and urban scenarios. To achieve such generalization and scalability, we employ a semantic-grid data representation, which can efficiently represent the surroundings of the vehicle. The proposed method is used to evaluate the integrity of sources in several scenarios, and the integrity markers generated are used for identifying and quantifying unreliable data. A particular focus is given to real-world complex scenarios obtained from publicly available datasets where integrity localization requirements are of high importance. Those scenarios are examined to evaluate the performance of the framework and to provide proof-of-concept. We also establish the importance of the proposed integrity assessment framework in context-based localization applications for autonomous vehicles. The proposed method applies the integrity assessment concepts in the field of aviation to ground vehicles and provides the Protection Level markers (Horizontal, Lateral, Longitudinal) for perception systems used for vehicle localization.https://www.mdpi.com/1424-8220/20/16/4654multimodal data sourceintegrity assessmentintelligent vehicleslocalizationProtection Level markers
collection DOAJ
language English
format Article
sources DOAJ
author Arjun Balakrishnan
Sergio Rodriguez Florez
Roger Reynaud
spellingShingle Arjun Balakrishnan
Sergio Rodriguez Florez
Roger Reynaud
Integrity Monitoring of Multimodal Perception System for Vehicle Localization
Sensors
multimodal data source
integrity assessment
intelligent vehicles
localization
Protection Level markers
author_facet Arjun Balakrishnan
Sergio Rodriguez Florez
Roger Reynaud
author_sort Arjun Balakrishnan
title Integrity Monitoring of Multimodal Perception System for Vehicle Localization
title_short Integrity Monitoring of Multimodal Perception System for Vehicle Localization
title_full Integrity Monitoring of Multimodal Perception System for Vehicle Localization
title_fullStr Integrity Monitoring of Multimodal Perception System for Vehicle Localization
title_full_unstemmed Integrity Monitoring of Multimodal Perception System for Vehicle Localization
title_sort integrity monitoring of multimodal perception system for vehicle localization
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-08-01
description Autonomous driving systems tightly rely on the quality of the data from sensors for tasks such as localization and navigation. In this work, we present an integrity monitoring framework that can assess the quality of multimodal data from exteroceptive sensors. The proposed multisource coherence-based integrity assessment framework is capable of handling highway as well as complex semi-urban and urban scenarios. To achieve such generalization and scalability, we employ a semantic-grid data representation, which can efficiently represent the surroundings of the vehicle. The proposed method is used to evaluate the integrity of sources in several scenarios, and the integrity markers generated are used for identifying and quantifying unreliable data. A particular focus is given to real-world complex scenarios obtained from publicly available datasets where integrity localization requirements are of high importance. Those scenarios are examined to evaluate the performance of the framework and to provide proof-of-concept. We also establish the importance of the proposed integrity assessment framework in context-based localization applications for autonomous vehicles. The proposed method applies the integrity assessment concepts in the field of aviation to ground vehicles and provides the Protection Level markers (Horizontal, Lateral, Longitudinal) for perception systems used for vehicle localization.
topic multimodal data source
integrity assessment
intelligent vehicles
localization
Protection Level markers
url https://www.mdpi.com/1424-8220/20/16/4654
work_keys_str_mv AT arjunbalakrishnan integritymonitoringofmultimodalperceptionsystemforvehiclelocalization
AT sergiorodriguezflorez integritymonitoringofmultimodalperceptionsystemforvehiclelocalization
AT rogerreynaud integritymonitoringofmultimodalperceptionsystemforvehiclelocalization
_version_ 1724506234366722048