Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network

Wide field-of-view (FOV) and high-resolution (HR) imaging are essential to many applications where high-content image acquisition is necessary. However, due to the insufficient spatial sampling of the image detector and the trade-off between pixel size and photosensitivity, the ability of current im...

Full description

Bibliographic Details
Main Authors: Bowen Wang, Yan Zou, Linfei Zhang, Yan Hu, Hao Yan, Chao Zuo, Qian Chen
Format: Article
Language:English
Published: MDPI AG 2021-08-01
Series:Photonics
Subjects:
Online Access:https://www.mdpi.com/2304-6732/8/8/321
id doaj-be1e7d7a3b994e208ecf2693816add8a
record_format Article
spelling doaj-be1e7d7a3b994e208ecf2693816add8a2021-08-26T14:13:39ZengMDPI AGPhotonics2304-67322021-08-01832132110.3390/photonics8080321Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction NetworkBowen Wang0Yan Zou1Linfei Zhang2Yan Hu3Hao Yan4Chao Zuo5Qian Chen6Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, ChinaJiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, ChinaJiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, ChinaJiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, ChinaMilitary Representative Office of Army Equipment Department in Taian, Taian 271000, ChinaJiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, ChinaJiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, ChinaWide field-of-view (FOV) and high-resolution (HR) imaging are essential to many applications where high-content image acquisition is necessary. However, due to the insufficient spatial sampling of the image detector and the trade-off between pixel size and photosensitivity, the ability of current imaging sensors to obtain high spatial resolution is limited, especially under low-light-level (LLL) imaging conditions. To solve these problems, we propose a multi-scale feature extraction (MSFE) network to realize pixel-super-resolved LLL imaging. In order to perform data fusion and information extraction for low resolution (LR) images, the network extracts high-frequency detail information from different dimensions by combining the channel attention mechanism module and skip connection module. In this way, the calculation of the high-frequency components can receive greater attention. Compared with other networks, the peak signal-to-noise ratio of the reconstructed image was increased by 1.67 dB. Extensions of the MSFE network are investigated for scene-based color mapping of the gray image. Most of the color information could be recovered, and the similarity with the real image reached 0.728. The qualitative and quantitative experimental results show that the proposed method achieved superior performance in image fidelity and detail enhancement over the state-of-the-art.https://www.mdpi.com/2304-6732/8/8/321super resolutionlow-light-leveldeep learning networkmulti-scale feature extraction
collection DOAJ
language English
format Article
sources DOAJ
author Bowen Wang
Yan Zou
Linfei Zhang
Yan Hu
Hao Yan
Chao Zuo
Qian Chen
spellingShingle Bowen Wang
Yan Zou
Linfei Zhang
Yan Hu
Hao Yan
Chao Zuo
Qian Chen
Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network
Photonics
super resolution
low-light-level
deep learning network
multi-scale feature extraction
author_facet Bowen Wang
Yan Zou
Linfei Zhang
Yan Hu
Hao Yan
Chao Zuo
Qian Chen
author_sort Bowen Wang
title Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network
title_short Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network
title_full Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network
title_fullStr Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network
title_full_unstemmed Low-Light-Level Image Super-Resolution Reconstruction Based on a Multi-Scale Features Extraction Network
title_sort low-light-level image super-resolution reconstruction based on a multi-scale features extraction network
publisher MDPI AG
series Photonics
issn 2304-6732
publishDate 2021-08-01
description Wide field-of-view (FOV) and high-resolution (HR) imaging are essential to many applications where high-content image acquisition is necessary. However, due to the insufficient spatial sampling of the image detector and the trade-off between pixel size and photosensitivity, the ability of current imaging sensors to obtain high spatial resolution is limited, especially under low-light-level (LLL) imaging conditions. To solve these problems, we propose a multi-scale feature extraction (MSFE) network to realize pixel-super-resolved LLL imaging. In order to perform data fusion and information extraction for low resolution (LR) images, the network extracts high-frequency detail information from different dimensions by combining the channel attention mechanism module and skip connection module. In this way, the calculation of the high-frequency components can receive greater attention. Compared with other networks, the peak signal-to-noise ratio of the reconstructed image was increased by 1.67 dB. Extensions of the MSFE network are investigated for scene-based color mapping of the gray image. Most of the color information could be recovered, and the similarity with the real image reached 0.728. The qualitative and quantitative experimental results show that the proposed method achieved superior performance in image fidelity and detail enhancement over the state-of-the-art.
topic super resolution
low-light-level
deep learning network
multi-scale feature extraction
url https://www.mdpi.com/2304-6732/8/8/321
work_keys_str_mv AT bowenwang lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
AT yanzou lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
AT linfeizhang lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
AT yanhu lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
AT haoyan lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
AT chaozuo lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
AT qianchen lowlightlevelimagesuperresolutionreconstructionbasedonamultiscalefeaturesextractionnetwork
_version_ 1721190649901875200