Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model

The stripe fixed pattern noise (FPN) of infrared images significantly corrupts image quality, so that most infrared imaging systems suffer from the degradation of visibility and detectability during operation. Therefore, the FPN de-striping method, which eliminates stripe patterns without substantia...

Full description

Bibliographic Details
Main Authors: Jongho Lee, Yong Man Ro
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9174992/
id doaj-2221a95534434ec5a6dab447e19792b3
record_format Article
spelling doaj-2221a95534434ec5a6dab447e19792b32021-03-30T04:19:43ZengIEEEIEEE Access2169-35362020-01-01815551915552810.1109/ACCESS.2020.30190579174992Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise ModelJongho Lee0https://orcid.org/0000-0001-8088-873XYong Man Ro1https://orcid.org/0000-0001-5306-6853Image and Video Systems Laboratory, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South KoreaImage and Video Systems Laboratory, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South KoreaThe stripe fixed pattern noise (FPN) of infrared images significantly corrupts image quality, so that most infrared imaging systems suffer from the degradation of visibility and detectability during operation. Therefore, the FPN de-striping method, which eliminates stripe patterns without substantial loss of image information, remains a core technology in the field of infrared image processing. In this article, we propose the dual-branch structure based FPN de-striping deep convolutional neural network (DBS-DCN) to effectively extract structural features of FPN and preserve the image details in a single infrared image. In addition, we have established the parametric FPN model through the diagnostic experiments of infrared images based on the physical principle of an infrared detector and its signal response. We have optimized each parameter of the FPN model using measured data, which acquired on a wide range of detector temperatures. Further, we generate the training data using our FPN model to ensure stable learning performance against various stripe patterns. We performed comparative experiments with state-of-the-art methods using artificially corrupted infrared images and real corrupted infrared data, and our proposed method achieved outstanding de-striping results in both qualitative and quantitative evaluation compared to existing methods.https://ieeexplore.ieee.org/document/9174992/Infrared imagefixed pattern noisede-striping methodconvolution network
collection DOAJ
language English
format Article
sources DOAJ
author Jongho Lee
Yong Man Ro
spellingShingle Jongho Lee
Yong Man Ro
Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model
IEEE Access
Infrared image
fixed pattern noise
de-striping method
convolution network
author_facet Jongho Lee
Yong Man Ro
author_sort Jongho Lee
title Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model
title_short Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model
title_full Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model
title_fullStr Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model
title_full_unstemmed Dual-Branch Structured De-Striping Convolution Network Using Parametric Noise Model
title_sort dual-branch structured de-striping convolution network using parametric noise model
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description The stripe fixed pattern noise (FPN) of infrared images significantly corrupts image quality, so that most infrared imaging systems suffer from the degradation of visibility and detectability during operation. Therefore, the FPN de-striping method, which eliminates stripe patterns without substantial loss of image information, remains a core technology in the field of infrared image processing. In this article, we propose the dual-branch structure based FPN de-striping deep convolutional neural network (DBS-DCN) to effectively extract structural features of FPN and preserve the image details in a single infrared image. In addition, we have established the parametric FPN model through the diagnostic experiments of infrared images based on the physical principle of an infrared detector and its signal response. We have optimized each parameter of the FPN model using measured data, which acquired on a wide range of detector temperatures. Further, we generate the training data using our FPN model to ensure stable learning performance against various stripe patterns. We performed comparative experiments with state-of-the-art methods using artificially corrupted infrared images and real corrupted infrared data, and our proposed method achieved outstanding de-striping results in both qualitative and quantitative evaluation compared to existing methods.
topic Infrared image
fixed pattern noise
de-striping method
convolution network
url https://ieeexplore.ieee.org/document/9174992/
work_keys_str_mv AT jongholee dualbranchstructureddestripingconvolutionnetworkusingparametricnoisemodel
AT yongmanro dualbranchstructureddestripingconvolutionnetworkusingparametricnoisemodel
_version_ 1724181952443973632