Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning

Deep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model t...

Full description

Bibliographic Details
Main Authors: Hao Zhang, Qiang Zhang, Siyu Shao, Tianlin Niu, Xinyu Yang, Haibin Ding
Format: Article
Language:English
Published: Hindawi Limited 2020-01-01
Series:Shock and Vibration
Online Access:http://dx.doi.org/10.1155/2020/8888627
id doaj-fd94a161dff64b36ae4939dde205e06e
record_format Article
spelling doaj-fd94a161dff64b36ae4939dde205e06e2020-11-25T02:32:50ZengHindawi LimitedShock and Vibration1070-96221875-92032020-01-01202010.1155/2020/88886278888627Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer LearningHao Zhang0Qiang Zhang1Siyu Shao2Tianlin Niu3Xinyu Yang4Haibin Ding5The Graduate School of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaTraining Base of Army Engineering University, Xuzhou 221004, ChinaDeep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model training process, it is difficult for the deep model to converge when the parameter initialization is inappropriate, which results in poor prediction performance. In this paper, a novel deep learning framework is proposed to predict the remaining useful life of rotatory machine with high accuracy. Firstly, model parameters and feature learning ability of the pretrained model are transferred to the new network by means of transfer learning to achieve reasonable initialization. Then, the specific sensor signals are converted to RGB image as the specific task data to fine-tune the parameters of the high-level network structure. The features extracted from the pretrained network are the input into the Bidirectional Long Short-Term Memory to obtain the RUL prediction results. The ability of LSTM to model sequence signals and the dynamic learning ability of bidirectional propagation to time information contribute to accurate RUL prediction. Finally, the deep model proposed in this paper is tested on the sensor signal dataset of bearing and gearbox. The high accuracy prediction results show the superiority of the transfer learning-based sequential network in RUL prediction.http://dx.doi.org/10.1155/2020/8888627
collection DOAJ
language English
format Article
sources DOAJ
author Hao Zhang
Qiang Zhang
Siyu Shao
Tianlin Niu
Xinyu Yang
Haibin Ding
spellingShingle Hao Zhang
Qiang Zhang
Siyu Shao
Tianlin Niu
Xinyu Yang
Haibin Ding
Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
Shock and Vibration
author_facet Hao Zhang
Qiang Zhang
Siyu Shao
Tianlin Niu
Xinyu Yang
Haibin Ding
author_sort Hao Zhang
title Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
title_short Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
title_full Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
title_fullStr Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
title_full_unstemmed Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
title_sort sequential network with residual neural network for rotatory machine remaining useful life prediction using deep transfer learning
publisher Hindawi Limited
series Shock and Vibration
issn 1070-9622
1875-9203
publishDate 2020-01-01
description Deep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model training process, it is difficult for the deep model to converge when the parameter initialization is inappropriate, which results in poor prediction performance. In this paper, a novel deep learning framework is proposed to predict the remaining useful life of rotatory machine with high accuracy. Firstly, model parameters and feature learning ability of the pretrained model are transferred to the new network by means of transfer learning to achieve reasonable initialization. Then, the specific sensor signals are converted to RGB image as the specific task data to fine-tune the parameters of the high-level network structure. The features extracted from the pretrained network are the input into the Bidirectional Long Short-Term Memory to obtain the RUL prediction results. The ability of LSTM to model sequence signals and the dynamic learning ability of bidirectional propagation to time information contribute to accurate RUL prediction. Finally, the deep model proposed in this paper is tested on the sensor signal dataset of bearing and gearbox. The high accuracy prediction results show the superiority of the transfer learning-based sequential network in RUL prediction.
url http://dx.doi.org/10.1155/2020/8888627
work_keys_str_mv AT haozhang sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning
AT qiangzhang sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning
AT siyushao sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning
AT tianlinniu sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning
AT xinyuyang sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning
AT haibinding sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning
_version_ 1715455576055480320