Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning
Deep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model t...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2020-01-01
|
Series: | Shock and Vibration |
Online Access: | http://dx.doi.org/10.1155/2020/8888627 |
id |
doaj-fd94a161dff64b36ae4939dde205e06e |
---|---|
record_format |
Article |
spelling |
doaj-fd94a161dff64b36ae4939dde205e06e2020-11-25T02:32:50ZengHindawi LimitedShock and Vibration1070-96221875-92032020-01-01202010.1155/2020/88886278888627Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer LearningHao Zhang0Qiang Zhang1Siyu Shao2Tianlin Niu3Xinyu Yang4Haibin Ding5The Graduate School of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaAir and Missile Defense College of Air Force Engineering University, Xi’an 710051, ChinaTraining Base of Army Engineering University, Xuzhou 221004, ChinaDeep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model training process, it is difficult for the deep model to converge when the parameter initialization is inappropriate, which results in poor prediction performance. In this paper, a novel deep learning framework is proposed to predict the remaining useful life of rotatory machine with high accuracy. Firstly, model parameters and feature learning ability of the pretrained model are transferred to the new network by means of transfer learning to achieve reasonable initialization. Then, the specific sensor signals are converted to RGB image as the specific task data to fine-tune the parameters of the high-level network structure. The features extracted from the pretrained network are the input into the Bidirectional Long Short-Term Memory to obtain the RUL prediction results. The ability of LSTM to model sequence signals and the dynamic learning ability of bidirectional propagation to time information contribute to accurate RUL prediction. Finally, the deep model proposed in this paper is tested on the sensor signal dataset of bearing and gearbox. The high accuracy prediction results show the superiority of the transfer learning-based sequential network in RUL prediction.http://dx.doi.org/10.1155/2020/8888627 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hao Zhang Qiang Zhang Siyu Shao Tianlin Niu Xinyu Yang Haibin Ding |
spellingShingle |
Hao Zhang Qiang Zhang Siyu Shao Tianlin Niu Xinyu Yang Haibin Ding Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning Shock and Vibration |
author_facet |
Hao Zhang Qiang Zhang Siyu Shao Tianlin Niu Xinyu Yang Haibin Ding |
author_sort |
Hao Zhang |
title |
Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning |
title_short |
Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning |
title_full |
Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning |
title_fullStr |
Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning |
title_full_unstemmed |
Sequential Network with Residual Neural Network for Rotatory Machine Remaining Useful Life Prediction Using Deep Transfer Learning |
title_sort |
sequential network with residual neural network for rotatory machine remaining useful life prediction using deep transfer learning |
publisher |
Hindawi Limited |
series |
Shock and Vibration |
issn |
1070-9622 1875-9203 |
publishDate |
2020-01-01 |
description |
Deep learning has a strong feature learning ability, which has proved its effectiveness in fault prediction and remaining useful life prediction of rotatory machine. However, training a deep network from scratch requires a large amount of training data and is time-consuming. In the practical model training process, it is difficult for the deep model to converge when the parameter initialization is inappropriate, which results in poor prediction performance. In this paper, a novel deep learning framework is proposed to predict the remaining useful life of rotatory machine with high accuracy. Firstly, model parameters and feature learning ability of the pretrained model are transferred to the new network by means of transfer learning to achieve reasonable initialization. Then, the specific sensor signals are converted to RGB image as the specific task data to fine-tune the parameters of the high-level network structure. The features extracted from the pretrained network are the input into the Bidirectional Long Short-Term Memory to obtain the RUL prediction results. The ability of LSTM to model sequence signals and the dynamic learning ability of bidirectional propagation to time information contribute to accurate RUL prediction. Finally, the deep model proposed in this paper is tested on the sensor signal dataset of bearing and gearbox. The high accuracy prediction results show the superiority of the transfer learning-based sequential network in RUL prediction. |
url |
http://dx.doi.org/10.1155/2020/8888627 |
work_keys_str_mv |
AT haozhang sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning AT qiangzhang sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning AT siyushao sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning AT tianlinniu sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning AT xinyuyang sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning AT haibinding sequentialnetworkwithresidualneuralnetworkforrotatorymachineremainingusefullifepredictionusingdeeptransferlearning |
_version_ |
1715455576055480320 |