A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME

GPRs (Ground Penetrating Radar) are widely adopted in underground space survey and mapping, because of their advantages of fast data acquisition, convenience, high imaging resolution and NDT (Non Destructive Testing) inspection. However, at present, the automation of the GPR data post-processing is...

Full description

Bibliographic Details
Main Authors: Z. Zong, C. Chen, X. Mi, W. Sun, Y. Song, J. Li, Z. Dong, R. Huang, B. Yang
Format: Article
Language:English
Published: Copernicus Publications 2019-09-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W16/293/2019/isprs-archives-XLII-2-W16-293-2019.pdf
id doaj-8b1e8ac7fe8d4cc599589eb5f7414325
record_format Article
spelling doaj-8b1e8ac7fe8d4cc599589eb5f74143252020-11-24T20:44:18ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342019-09-01XLII-2-W1629329910.5194/isprs-archives-XLII-2-W16-293-2019A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIMEZ. Zong0C. Chen1X. Mi2W. Sun3Y. Song4J. Li5Z. Dong6R. Huang7B. Yang8State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaState Key Laboratory of Geodesy and Earth’s Dynamics, Institute of Geodesy and Geophysics of CAS, Wuhan 430077, Hubei Province, PR ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, Hubei Province, PR ChinaGPRs (Ground Penetrating Radar) are widely adopted in underground space survey and mapping, because of their advantages of fast data acquisition, convenience, high imaging resolution and NDT (Non Destructive Testing) inspection. However, at present, the automation of the GPR data post-processing is low and the identification of underground objects needs expert interpretation. The heavy manual interpretation labor limits the GPR applications in large-scale urban scenarios. According to the latest research, it is still an unsolved problem to detect targets or defects in GPR data automatically and needs further exploration. In this paper, we propose a deep learning method for real-time detection of underground targets from GPR data. Seven typical targets in urban underground space are identified and labelled to construct the training dataset. The constructed dataset is consist of 489 labelled samples including rainwater wells, cables, metal/nonmetal pipes, sparse/dense steel reinforcement, voids. The training dataset is further augmented to produce more samples. DarkNet53 convolutional neural network (CNN) is trained using the constructed training dataset including realistic data and augmented data to extract features of the buried objects. And then the end-to-end YOLO detection framework is used to classify and locate the seven specific categories buried targets in the GPR data in real time. Experiments show that the automatic real-time detection method proposed in this paper can effectively detect the buried objects in the ground penetrating radar image in real time at Shenzhen test site (typical urban road scene).https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W16/293/2019/isprs-archives-XLII-2-W16-293-2019.pdf
collection DOAJ
language English
format Article
sources DOAJ
author Z. Zong
C. Chen
X. Mi
W. Sun
Y. Song
J. Li
Z. Dong
R. Huang
B. Yang
spellingShingle Z. Zong
C. Chen
X. Mi
W. Sun
Y. Song
J. Li
Z. Dong
R. Huang
B. Yang
A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet Z. Zong
C. Chen
X. Mi
W. Sun
Y. Song
J. Li
Z. Dong
R. Huang
B. Yang
author_sort Z. Zong
title A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME
title_short A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME
title_full A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME
title_fullStr A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME
title_full_unstemmed A DEEP LEARNING APPROACH FOR URBAN UNDERGROUND OBJECTS DETECTION FROM VEHICLE-BORNE GROUND PENETRATING RADAR DATA IN REAL-TIME
title_sort deep learning approach for urban underground objects detection from vehicle-borne ground penetrating radar data in real-time
publisher Copernicus Publications
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 1682-1750
2194-9034
publishDate 2019-09-01
description GPRs (Ground Penetrating Radar) are widely adopted in underground space survey and mapping, because of their advantages of fast data acquisition, convenience, high imaging resolution and NDT (Non Destructive Testing) inspection. However, at present, the automation of the GPR data post-processing is low and the identification of underground objects needs expert interpretation. The heavy manual interpretation labor limits the GPR applications in large-scale urban scenarios. According to the latest research, it is still an unsolved problem to detect targets or defects in GPR data automatically and needs further exploration. In this paper, we propose a deep learning method for real-time detection of underground targets from GPR data. Seven typical targets in urban underground space are identified and labelled to construct the training dataset. The constructed dataset is consist of 489 labelled samples including rainwater wells, cables, metal/nonmetal pipes, sparse/dense steel reinforcement, voids. The training dataset is further augmented to produce more samples. DarkNet53 convolutional neural network (CNN) is trained using the constructed training dataset including realistic data and augmented data to extract features of the buried objects. And then the end-to-end YOLO detection framework is used to classify and locate the seven specific categories buried targets in the GPR data in real time. Experiments show that the automatic real-time detection method proposed in this paper can effectively detect the buried objects in the ground penetrating radar image in real time at Shenzhen test site (typical urban road scene).
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-2-W16/293/2019/isprs-archives-XLII-2-W16-293-2019.pdf
work_keys_str_mv AT zzong adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT cchen adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT xmi adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT wsun adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT ysong adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT jli adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT zdong adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT rhuang adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT byang adeeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT zzong deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT cchen deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT xmi deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT wsun deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT ysong deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT jli deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT zdong deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT rhuang deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
AT byang deeplearningapproachforurbanundergroundobjectsdetectionfromvehiclebornegroundpenetratingradardatainrealtime
_version_ 1716817730421653504