A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface

To create an intelligent surface region of interests (ROI) 3D quantitative inspection strategy a reality in the continuous casting (CC) production line, an improved 3D laser image scanning system (3D-LDS) was established based on binocular imaging and deep-learning techniques. In 3D-LDS, firstly, to...

Full description

Bibliographic Details
Main Authors: Liming Zhao, Fangfang Li, Yi Zhang, Xiaodong Xu, Hong Xiao, Yang Feng
Format: Article
Language:English
Published: MDPI AG 2020-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/4/980
id doaj-58ae7064a01e4390b2d9abc3c33b06be
record_format Article
spelling doaj-58ae7064a01e4390b2d9abc3c33b06be2020-11-25T01:42:27ZengMDPI AGSensors1424-82202020-02-0120498010.3390/s20040980s20040980A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products SurfaceLiming Zhao0Fangfang Li1Yi Zhang2Xiaodong Xu3Hong Xiao4Yang Feng5Research Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaResearch Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaResearch Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaResearch Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaResearch Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaResearch Center of Intelligent System and Robotics, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaTo create an intelligent surface region of interests (ROI) 3D quantitative inspection strategy a reality in the continuous casting (CC) production line, an improved 3D laser image scanning system (3D-LDS) was established based on binocular imaging and deep-learning techniques. In 3D-LDS, firstly, to meet the requirements of the industrial application, the CCD laser image scanning method was optimized in high-temperature experiments and secondly, we proposed a novel region proposal method based on 3D ROI initial depth location for effectively suppressing redundant candidate bounding boxes generated by pseudo-defects in a real-time inspection process. Thirdly, a novel two-step defects inspection strategy was presented by devising a fusion deep CNN model which combined fully connected networks (for defects classification/recognition) and fully convolutional networks (for defects delineation). The 3D-LDS’ dichotomous inspection method of defects classification and delineation processes are helpful in understanding and addressing challenges for defects inspection in CC product surfaces. The applicability of the presented methods is mainly tied to the surface quality inspection for slab, strip and billet products.https://www.mdpi.com/1424-8220/20/4/980continuous castingsurface defects3d imagingneural networkdeep learningdefect detection
collection DOAJ
language English
format Article
sources DOAJ
author Liming Zhao
Fangfang Li
Yi Zhang
Xiaodong Xu
Hong Xiao
Yang Feng
spellingShingle Liming Zhao
Fangfang Li
Yi Zhang
Xiaodong Xu
Hong Xiao
Yang Feng
A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface
Sensors
continuous casting
surface defects
3d imaging
neural network
deep learning
defect detection
author_facet Liming Zhao
Fangfang Li
Yi Zhang
Xiaodong Xu
Hong Xiao
Yang Feng
author_sort Liming Zhao
title A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface
title_short A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface
title_full A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface
title_fullStr A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface
title_full_unstemmed A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface
title_sort deep-learning-based 3d defect quantitative inspection system in cc products surface
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-02-01
description To create an intelligent surface region of interests (ROI) 3D quantitative inspection strategy a reality in the continuous casting (CC) production line, an improved 3D laser image scanning system (3D-LDS) was established based on binocular imaging and deep-learning techniques. In 3D-LDS, firstly, to meet the requirements of the industrial application, the CCD laser image scanning method was optimized in high-temperature experiments and secondly, we proposed a novel region proposal method based on 3D ROI initial depth location for effectively suppressing redundant candidate bounding boxes generated by pseudo-defects in a real-time inspection process. Thirdly, a novel two-step defects inspection strategy was presented by devising a fusion deep CNN model which combined fully connected networks (for defects classification/recognition) and fully convolutional networks (for defects delineation). The 3D-LDS’ dichotomous inspection method of defects classification and delineation processes are helpful in understanding and addressing challenges for defects inspection in CC product surfaces. The applicability of the presented methods is mainly tied to the surface quality inspection for slab, strip and billet products.
topic continuous casting
surface defects
3d imaging
neural network
deep learning
defect detection
url https://www.mdpi.com/1424-8220/20/4/980
work_keys_str_mv AT limingzhao adeeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT fangfangli adeeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT yizhang adeeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT xiaodongxu adeeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT hongxiao adeeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT yangfeng adeeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT limingzhao deeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT fangfangli deeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT yizhang deeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT xiaodongxu deeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT hongxiao deeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
AT yangfeng deeplearningbased3ddefectquantitativeinspectionsysteminccproductssurface
_version_ 1725036233212559360