Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation

Prognostics, such as remaining useful life (RUL) prediction, is a crucial task in condition-based maintenance. A major challenge in data-driven prognostics is the difficulty of obtaining a sufficient number of samples of failure progression. However, for traditional machine learning methods and deep...

Full description

Bibliographic Details
Main Authors: Ansi Zhang, Honglei Wang, Shaobo Li, Yuxin Cui, Zhonghao Liu, Guanci Yang, Jianjun Hu
Format: Article
Language:English
Published: MDPI AG 2018-11-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/8/12/2416
id doaj-ad7c9cbe3328442d8a0715d94ba1b1a2
record_format Article
spelling doaj-ad7c9cbe3328442d8a0715d94ba1b1a22020-11-25T00:58:50ZengMDPI AGApplied Sciences2076-34172018-11-01812241610.3390/app8122416app8122416Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life EstimationAnsi Zhang0Honglei Wang1Shaobo Li2Yuxin Cui3Zhonghao Liu4Guanci Yang5Jianjun Hu6Key Laboratory of Advanced Manufacturing Technology of Ministry of Education, Guizhou University, Guiyang 550025, ChinaGuizhou Provincial Key Laboratory of Internet Collaborative intelligent manufacturing, Guizhou University, Guiyang 550025, ChinaKey Laboratory of Advanced Manufacturing Technology of Ministry of Education, Guizhou University, Guiyang 550025, ChinaDepartment of Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, USADepartment of Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, USAKey Laboratory of Advanced Manufacturing Technology of Ministry of Education, Guizhou University, Guiyang 550025, ChinaDepartment of Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, USAPrognostics, such as remaining useful life (RUL) prediction, is a crucial task in condition-based maintenance. A major challenge in data-driven prognostics is the difficulty of obtaining a sufficient number of samples of failure progression. However, for traditional machine learning methods and deep neural networks, enough training data is a prerequisite to train good prediction models. In this work, we proposed a transfer learning algorithm based on Bi-directional Long Short-Term Memory (BLSTM) recurrent neural networks for RUL estimation, in which the models can be first trained on different but related datasets and then fine-tuned by the target dataset. Extensive experimental results show that transfer learning can in general improve the prediction models on the dataset with a small number of samples. There is one exception that when transferring from multi-type operating conditions to single operating conditions, transfer learning led to a worse result.https://www.mdpi.com/2076-3417/8/12/2416remaining useful lifefault diagnosisLSTMdeep learningtransfer learningturbofan engine
collection DOAJ
language English
format Article
sources DOAJ
author Ansi Zhang
Honglei Wang
Shaobo Li
Yuxin Cui
Zhonghao Liu
Guanci Yang
Jianjun Hu
spellingShingle Ansi Zhang
Honglei Wang
Shaobo Li
Yuxin Cui
Zhonghao Liu
Guanci Yang
Jianjun Hu
Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
Applied Sciences
remaining useful life
fault diagnosis
LSTM
deep learning
transfer learning
turbofan engine
author_facet Ansi Zhang
Honglei Wang
Shaobo Li
Yuxin Cui
Zhonghao Liu
Guanci Yang
Jianjun Hu
author_sort Ansi Zhang
title Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
title_short Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
title_full Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
title_fullStr Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
title_full_unstemmed Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation
title_sort transfer learning with deep recurrent neural networks for remaining useful life estimation
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2018-11-01
description Prognostics, such as remaining useful life (RUL) prediction, is a crucial task in condition-based maintenance. A major challenge in data-driven prognostics is the difficulty of obtaining a sufficient number of samples of failure progression. However, for traditional machine learning methods and deep neural networks, enough training data is a prerequisite to train good prediction models. In this work, we proposed a transfer learning algorithm based on Bi-directional Long Short-Term Memory (BLSTM) recurrent neural networks for RUL estimation, in which the models can be first trained on different but related datasets and then fine-tuned by the target dataset. Extensive experimental results show that transfer learning can in general improve the prediction models on the dataset with a small number of samples. There is one exception that when transferring from multi-type operating conditions to single operating conditions, transfer learning led to a worse result.
topic remaining useful life
fault diagnosis
LSTM
deep learning
transfer learning
turbofan engine
url https://www.mdpi.com/2076-3417/8/12/2416
work_keys_str_mv AT ansizhang transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
AT hongleiwang transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
AT shaoboli transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
AT yuxincui transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
AT zhonghaoliu transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
AT guanciyang transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
AT jianjunhu transferlearningwithdeeprecurrentneuralnetworksforremainingusefullifeestimation
_version_ 1725220304905568256