Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images

Ferrography analysis(FA) is an important approach to detect the wear state of mechanical equipment. Ferrographic image recognition based on deep learning needs a large number of image samples. However, the ferrographic images of mechanical equipment are difficult to obtain enough high-quality sample...

Full description

Bibliographic Details
Main Authors: Hongwei Fan, Shuoqi Gao, Xuhui Zhang, Xiangang Cao, Hongwei Ma, Qi Liu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9146873/
id doaj-daad8ed1502d4321a8fb0e578c2b122c
record_format Article
spelling doaj-daad8ed1502d4321a8fb0e578c2b122c2021-03-30T03:23:50ZengIEEEIEEE Access2169-35362020-01-01813707413709310.1109/ACCESS.2020.30117289146873Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual ImagesHongwei Fan0https://orcid.org/0000-0002-9891-0568Shuoqi Gao1https://orcid.org/0000-0002-9466-4363Xuhui Zhang2https://orcid.org/0000-0002-5216-1362Xiangang Cao3Hongwei Ma4Qi Liu5School of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, ChinaSchool of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, ChinaSchool of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, ChinaSchool of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, ChinaSchool of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, ChinaSchool of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an, ChinaFerrography analysis(FA) is an important approach to detect the wear state of mechanical equipment. Ferrographic image recognition based on deep learning needs a large number of image samples. However, the ferrographic images of mechanical equipment are difficult to obtain enough high-quality samples in a short time due to the complexity and low efficiency of the ferrogram making. Therefore, the recognition method for small sample ferrographic images based on the convolutional neural network(CNN) and transfer learning(TL) is proposed. Based on the similarity of samples, the virtual ferrographic image set is designed as the source data of the pretraining model, the tested CNN model is constructed by using the TL. Based on the AlexNet frame, this paper studies the influence of the CNN internal factors including network structure, convolution parameters, activation function, optimization mode, learning rate and the external factors on the classification effect of test samples, and the L2 regularizer is added to solve the overfitting. According to the classification result of test samples, an optimal parameter combination is obtained to establish an intelligent recognition model of ferrographic images based on CNN and TL with the recognition accuracy of 93.75%. Moreover, the t-SNE is used to realize the wear particle recognition process visualization, which proves the effectiveness of the proposed algorithm. This work provides an effective way for the ferrographic image recognition of wear particles under small samples.https://ieeexplore.ieee.org/document/9146873/Ferrographic imageconvolutional neural networktransfer learningwear condition recognition
collection DOAJ
language English
format Article
sources DOAJ
author Hongwei Fan
Shuoqi Gao
Xuhui Zhang
Xiangang Cao
Hongwei Ma
Qi Liu
spellingShingle Hongwei Fan
Shuoqi Gao
Xuhui Zhang
Xiangang Cao
Hongwei Ma
Qi Liu
Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images
IEEE Access
Ferrographic image
convolutional neural network
transfer learning
wear condition recognition
author_facet Hongwei Fan
Shuoqi Gao
Xuhui Zhang
Xiangang Cao
Hongwei Ma
Qi Liu
author_sort Hongwei Fan
title Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images
title_short Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images
title_full Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images
title_fullStr Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images
title_full_unstemmed Intelligent Recognition of Ferrographic Images Combining Optimal CNN With Transfer Learning Introducing Virtual Images
title_sort intelligent recognition of ferrographic images combining optimal cnn with transfer learning introducing virtual images
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Ferrography analysis(FA) is an important approach to detect the wear state of mechanical equipment. Ferrographic image recognition based on deep learning needs a large number of image samples. However, the ferrographic images of mechanical equipment are difficult to obtain enough high-quality samples in a short time due to the complexity and low efficiency of the ferrogram making. Therefore, the recognition method for small sample ferrographic images based on the convolutional neural network(CNN) and transfer learning(TL) is proposed. Based on the similarity of samples, the virtual ferrographic image set is designed as the source data of the pretraining model, the tested CNN model is constructed by using the TL. Based on the AlexNet frame, this paper studies the influence of the CNN internal factors including network structure, convolution parameters, activation function, optimization mode, learning rate and the external factors on the classification effect of test samples, and the L2 regularizer is added to solve the overfitting. According to the classification result of test samples, an optimal parameter combination is obtained to establish an intelligent recognition model of ferrographic images based on CNN and TL with the recognition accuracy of 93.75%. Moreover, the t-SNE is used to realize the wear particle recognition process visualization, which proves the effectiveness of the proposed algorithm. This work provides an effective way for the ferrographic image recognition of wear particles under small samples.
topic Ferrographic image
convolutional neural network
transfer learning
wear condition recognition
url https://ieeexplore.ieee.org/document/9146873/
work_keys_str_mv AT hongweifan intelligentrecognitionofferrographicimagescombiningoptimalcnnwithtransferlearningintroducingvirtualimages
AT shuoqigao intelligentrecognitionofferrographicimagescombiningoptimalcnnwithtransferlearningintroducingvirtualimages
AT xuhuizhang intelligentrecognitionofferrographicimagescombiningoptimalcnnwithtransferlearningintroducingvirtualimages
AT xiangangcao intelligentrecognitionofferrographicimagescombiningoptimalcnnwithtransferlearningintroducingvirtualimages
AT hongweima intelligentrecognitionofferrographicimagescombiningoptimalcnnwithtransferlearningintroducingvirtualimages
AT qiliu intelligentrecognitionofferrographicimagescombiningoptimalcnnwithtransferlearningintroducingvirtualimages
_version_ 1724183576536154112