Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning

Weld bead geometry features (WBGFs) such as the bead width, height, area, and center of gravity are the common factors for weighing welding quality control. The effective modeling of these WBGFs contributes to implementing timely decision making of welding process parameters to improve welding quali...

Full description

Bibliographic Details
Main Authors: Yinshui He, Daize Li, Zengxi Pan, Guohong Ma, Lesheng Yu, Haitao Yuan, Jian Le
Format: Article
Language:English
Published: MDPI AG 2020-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/24/7104
id doaj-bb026a992db24199b47ad1760089c792
record_format Article
spelling doaj-bb026a992db24199b47ad1760089c7922020-12-12T00:02:58ZengMDPI AGSensors1424-82202020-12-01207104710410.3390/s20247104Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and LearningYinshui He0Daize Li1Zengxi Pan2Guohong Ma3Lesheng Yu4Haitao Yuan5Jian Le6School of Resources Environmental & Chemical Engineering, Nanchang University, Nanchang 330031, ChinaSchool of Resources Environmental & Chemical Engineering, Nanchang University, Nanchang 330031, ChinaSchool of Mechanical, Materials, Mechatronic and Biomedical Engineering University of Wollongong, Wollongong, NSW 2500, AustraliaKey Laboratory of Lightweight and High Strength Structural Materials of Jiangxi Province, Nanchang 330031, ChinaKey Laboratory of Lightweight and High Strength Structural Materials of Jiangxi Province, Nanchang 330031, ChinaKey Laboratory of Lightweight and High Strength Structural Materials of Jiangxi Province, Nanchang 330031, ChinaInformation Engineering School of Nanchang University, Nanchang 330031, ChinaWeld bead geometry features (WBGFs) such as the bead width, height, area, and center of gravity are the common factors for weighing welding quality control. The effective modeling of these WBGFs contributes to implementing timely decision making of welding process parameters to improve welding quality and enhance automatic levels. In this work, a dynamic modeling method of WBGFs is presented based on machine vision and learning in multipass gas metal arc welding (GMAW) with typical joints. A laser vision sensing system is used to detect weld seam profiles (WSPs) during the GMAW process. A novel WSP extraction method is proposed using scale-invariant feature transform and machine learning. The feature points of the extracted WSP, namely the boundary points of the weld beads, are identified with slope mutation detection and number supervision. In order to stabilize the modeling process, a fault detection and diagnosis method is implemented with cubic exponential smoothing, and the diagnostic accuracy is within 1.50 pixels. A linear interpolation method is presented to implement sub pixel discrimination of the weld bead before modeling WBGFs. With the effective feature points and the extracted WSP, a scheme of modeling the area, center of gravity, and all-position width and height of the weld bead is presented. Experimental results show that the proposed method in this work adapts to the variable features of the weld beads in thick plate GMAW with T-joints and butt/lap joints. This work can provide more evidence to control the weld formation in a thick plate GMAW in real time.https://www.mdpi.com/1424-8220/20/24/7104weld bead geometry featuresvisual all-position measurementthick plate gas metal arc weldingmachine vision and learningfault detection and diagnosis
collection DOAJ
language English
format Article
sources DOAJ
author Yinshui He
Daize Li
Zengxi Pan
Guohong Ma
Lesheng Yu
Haitao Yuan
Jian Le
spellingShingle Yinshui He
Daize Li
Zengxi Pan
Guohong Ma
Lesheng Yu
Haitao Yuan
Jian Le
Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning
Sensors
weld bead geometry features
visual all-position measurement
thick plate gas metal arc welding
machine vision and learning
fault detection and diagnosis
author_facet Yinshui He
Daize Li
Zengxi Pan
Guohong Ma
Lesheng Yu
Haitao Yuan
Jian Le
author_sort Yinshui He
title Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning
title_short Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning
title_full Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning
title_fullStr Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning
title_full_unstemmed Dynamic Modeling of Weld Bead Geometry Features in Thick Plate GMAW Based on Machine Vision and Learning
title_sort dynamic modeling of weld bead geometry features in thick plate gmaw based on machine vision and learning
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-12-01
description Weld bead geometry features (WBGFs) such as the bead width, height, area, and center of gravity are the common factors for weighing welding quality control. The effective modeling of these WBGFs contributes to implementing timely decision making of welding process parameters to improve welding quality and enhance automatic levels. In this work, a dynamic modeling method of WBGFs is presented based on machine vision and learning in multipass gas metal arc welding (GMAW) with typical joints. A laser vision sensing system is used to detect weld seam profiles (WSPs) during the GMAW process. A novel WSP extraction method is proposed using scale-invariant feature transform and machine learning. The feature points of the extracted WSP, namely the boundary points of the weld beads, are identified with slope mutation detection and number supervision. In order to stabilize the modeling process, a fault detection and diagnosis method is implemented with cubic exponential smoothing, and the diagnostic accuracy is within 1.50 pixels. A linear interpolation method is presented to implement sub pixel discrimination of the weld bead before modeling WBGFs. With the effective feature points and the extracted WSP, a scheme of modeling the area, center of gravity, and all-position width and height of the weld bead is presented. Experimental results show that the proposed method in this work adapts to the variable features of the weld beads in thick plate GMAW with T-joints and butt/lap joints. This work can provide more evidence to control the weld formation in a thick plate GMAW in real time.
topic weld bead geometry features
visual all-position measurement
thick plate gas metal arc welding
machine vision and learning
fault detection and diagnosis
url https://www.mdpi.com/1424-8220/20/24/7104
work_keys_str_mv AT yinshuihe dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
AT daizeli dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
AT zengxipan dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
AT guohongma dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
AT leshengyu dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
AT haitaoyuan dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
AT jianle dynamicmodelingofweldbeadgeometryfeaturesinthickplategmawbasedonmachinevisionandlearning
_version_ 1724386045928144896