Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique

Regular crack inspection of tunnels is essential to guarantee their safe operation. At present, the manual detection method is time-consuming, subjective and even dangerous, while the automatic detection method is relatively inaccurate. Detecting tunnel cracks is a challenging task since cracks are...

Full description

Bibliographic Details
Main Authors: Gang Li, Biao Ma, Shuanhai He, Xueli Ren, Qiangwei Liu
Format: Article
Language:English
Published: MDPI AG 2020-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/3/717
id doaj-4447831e4b87440a8b469eb42a34fe75
record_format Article
spelling doaj-4447831e4b87440a8b469eb42a34fe752020-11-25T03:00:54ZengMDPI AGSensors1424-82202020-01-0120371710.3390/s20030717s20030717Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated CliqueGang Li0Biao Ma1Shuanhai He2Xueli Ren3Qiangwei Liu4School of Electronic and Control Engineering, Chang’an University, Xi’an 710064, Shaanxi, ChinaSchool of Electronic and Control Engineering, Chang’an University, Xi’an 710064, Shaanxi, ChinaKey Laboratory for Old Bridge Detection and Reinforcement Technology of Ministry of Transportation, Chang’an University, Xi’an 710064, Shaanxi, ChinaSchool of Electronic and Control Engineering, Chang’an University, Xi’an 710064, Shaanxi, ChinaSchool of Electronic and Control Engineering, Chang’an University, Xi’an 710064, Shaanxi, ChinaRegular crack inspection of tunnels is essential to guarantee their safe operation. At present, the manual detection method is time-consuming, subjective and even dangerous, while the automatic detection method is relatively inaccurate. Detecting tunnel cracks is a challenging task since cracks are tiny, and there are many noise patterns in the tunnel images. This study proposes a deep learning algorithm based on U-Net and a convolutional neural network with alternately updated clique (CliqueNet), called U-CliqueNet, to separate cracks from background in the tunnel images. A consumer-grade DSC-WX700 camera (SONY, Wuxi, China) was used to collect 200 original images, then cracks are manually marked and divided into sub-images with a resolution of <inline-formula> <math display="inline"> <semantics> <mrow> <mrow> <mn>496</mn> <mtext>&nbsp;</mtext> <mo>&#215;</mo> <mtext>&nbsp;</mtext> <mn>496</mn> </mrow> </mrow> </semantics> </math> </inline-formula> pixels. A total of 60,000 sub-images were obtained in the dataset of tunnel cracks, among which 50,000 were used for training and 10,000 were used for testing. The proposed framework conducted training and testing on this dataset, the mean pixel accuracy (MPA), mean intersection over union (MIoU), precision and F1-score are 92.25%, 86.96%, 86.32% and 83.40%, respectively. We compared the U-CliqueNet with fully convolutional networks (FCN), U-net, Encoder&#8722;decoder network (SegNet) and the multi-scale fusion crack detection (MFCD) algorithm using hypothesis testing, and it&#8217;s proved that the MIoU predicted by U-CliqueNet was significantly higher than that of the other four algorithms. The area, length and mean width of cracks can be calculated, and the relative error between the detected mean crack width and the actual mean crack width ranges from &#8722;11.20% to 18.57%. The results show that this framework can be used for fast and accurate crack semantic segmentation of tunnel images.https://www.mdpi.com/1424-8220/20/3/717tunnel cracku-netcliquenetcrack measurement
collection DOAJ
language English
format Article
sources DOAJ
author Gang Li
Biao Ma
Shuanhai He
Xueli Ren
Qiangwei Liu
spellingShingle Gang Li
Biao Ma
Shuanhai He
Xueli Ren
Qiangwei Liu
Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique
Sensors
tunnel crack
u-net
cliquenet
crack measurement
author_facet Gang Li
Biao Ma
Shuanhai He
Xueli Ren
Qiangwei Liu
author_sort Gang Li
title Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique
title_short Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique
title_full Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique
title_fullStr Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique
title_full_unstemmed Automatic Tunnel Crack Detection Based on U-Net and a Convolutional Neural Network with Alternately Updated Clique
title_sort automatic tunnel crack detection based on u-net and a convolutional neural network with alternately updated clique
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-01-01
description Regular crack inspection of tunnels is essential to guarantee their safe operation. At present, the manual detection method is time-consuming, subjective and even dangerous, while the automatic detection method is relatively inaccurate. Detecting tunnel cracks is a challenging task since cracks are tiny, and there are many noise patterns in the tunnel images. This study proposes a deep learning algorithm based on U-Net and a convolutional neural network with alternately updated clique (CliqueNet), called U-CliqueNet, to separate cracks from background in the tunnel images. A consumer-grade DSC-WX700 camera (SONY, Wuxi, China) was used to collect 200 original images, then cracks are manually marked and divided into sub-images with a resolution of <inline-formula> <math display="inline"> <semantics> <mrow> <mrow> <mn>496</mn> <mtext>&nbsp;</mtext> <mo>&#215;</mo> <mtext>&nbsp;</mtext> <mn>496</mn> </mrow> </mrow> </semantics> </math> </inline-formula> pixels. A total of 60,000 sub-images were obtained in the dataset of tunnel cracks, among which 50,000 were used for training and 10,000 were used for testing. The proposed framework conducted training and testing on this dataset, the mean pixel accuracy (MPA), mean intersection over union (MIoU), precision and F1-score are 92.25%, 86.96%, 86.32% and 83.40%, respectively. We compared the U-CliqueNet with fully convolutional networks (FCN), U-net, Encoder&#8722;decoder network (SegNet) and the multi-scale fusion crack detection (MFCD) algorithm using hypothesis testing, and it&#8217;s proved that the MIoU predicted by U-CliqueNet was significantly higher than that of the other four algorithms. The area, length and mean width of cracks can be calculated, and the relative error between the detected mean crack width and the actual mean crack width ranges from &#8722;11.20% to 18.57%. The results show that this framework can be used for fast and accurate crack semantic segmentation of tunnel images.
topic tunnel crack
u-net
cliquenet
crack measurement
url https://www.mdpi.com/1424-8220/20/3/717
work_keys_str_mv AT gangli automatictunnelcrackdetectionbasedonunetandaconvolutionalneuralnetworkwithalternatelyupdatedclique
AT biaoma automatictunnelcrackdetectionbasedonunetandaconvolutionalneuralnetworkwithalternatelyupdatedclique
AT shuanhaihe automatictunnelcrackdetectionbasedonunetandaconvolutionalneuralnetworkwithalternatelyupdatedclique
AT xueliren automatictunnelcrackdetectionbasedonunetandaconvolutionalneuralnetworkwithalternatelyupdatedclique
AT qiangweiliu automatictunnelcrackdetectionbasedonunetandaconvolutionalneuralnetworkwithalternatelyupdatedclique
_version_ 1724696117606612992