Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks

For the image super-resolution method from a single channel, it is difficult to achieve both fast convergence and high-quality texture restoration. By mitigating the weaknesses of existing methods, the present paper proposes an image super-resolution algorithm based on dual-channel convolutional neu...

Full description

Bibliographic Details
Main Authors: Yuantao Chen, Jin Wang, Xi Chen, Arun Kumar Sangaiah, Kai Yang, Zhouhong Cao
Format: Article
Language:English
Published: MDPI AG 2019-06-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/9/11/2316
id doaj-2aa4c9656bcc4ab2825e6b09b9275d3a
record_format Article
spelling doaj-2aa4c9656bcc4ab2825e6b09b9275d3a2020-11-25T01:11:16ZengMDPI AGApplied Sciences2076-34172019-06-01911231610.3390/app9112316app9112316Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural NetworksYuantao Chen0Jin Wang1Xi Chen2Arun Kumar Sangaiah3Kai Yang4Zhouhong Cao5School of Computer and Communication Engineering & Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, Changsha University of Science and Technology, Changsha 410114, ChinaSchool of Computer and Communication Engineering & Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, Changsha University of Science and Technology, Changsha 410114, ChinaSchool of Computer and Communication Engineering & Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, Changsha University of Science and Technology, Changsha 410114, ChinaSchool of Computing Science and Engineering, Vellore Institute of Technology University, Vellore 632014, IndiaTechnical Quality Department, Hunan ZOOMLION Heavy Industry Intelligent Technology Corporation Limited, Changsha 410005, ChinaSchool of Hydraulic Engineering & Hunan Provincial Science and Technology Innovation Platform of Key Laboratory of Dongting Lake Aquatic Eco-Environmental Control and Restoration, Changsha University of Science and Technology, Changsha 410114, ChinaFor the image super-resolution method from a single channel, it is difficult to achieve both fast convergence and high-quality texture restoration. By mitigating the weaknesses of existing methods, the present paper proposes an image super-resolution algorithm based on dual-channel convolutional neural networks (DCCNN). The novel structure of the network model was divided into a deep channel and a shallow channel. The deep channel was used to extract the detailed texture information from the original image, while the shallow channel was mainly used to recover the overall outline of the original image. Firstly, the residual block was adjusted in the feature extraction stage, and the nonlinear mapping ability of the network was enhanced. The feature mapping dimension was reduced, and the effective features of the image were obtained. In the up-sampling stage, the parameters of the deconvolutional kernel were adjusted, and high-frequency signal loss was decreased. The high-resolution feature space could be rebuilt recursively using long-term and short-term memory blocks during the reconstruction stage, further enhancing the recovery of texture information. Secondly, the convolutional kernel was adjusted in the shallow channel to reduce the parameters, ensuring that the overall outline of the image was restored and that the network converged rapidly. Finally, the dual-channel loss function was jointly optimized to enhance the feature-fitting ability in order to obtain the final high-resolution image output. Using the improved algorithm, the network converged more rapidly, the image edge and texture reconstruction effect were obviously improved, and the Peak Signal-to-Noise Ratio (PSNR) and structural similarity were also superior to those of other solutions.https://www.mdpi.com/2076-3417/9/11/2316super-resolutiondual-channelresidual blockconvolutional kernel parameterlong-term and short-term memory blocks
collection DOAJ
language English
format Article
sources DOAJ
author Yuantao Chen
Jin Wang
Xi Chen
Arun Kumar Sangaiah
Kai Yang
Zhouhong Cao
spellingShingle Yuantao Chen
Jin Wang
Xi Chen
Arun Kumar Sangaiah
Kai Yang
Zhouhong Cao
Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
Applied Sciences
super-resolution
dual-channel
residual block
convolutional kernel parameter
long-term and short-term memory blocks
author_facet Yuantao Chen
Jin Wang
Xi Chen
Arun Kumar Sangaiah
Kai Yang
Zhouhong Cao
author_sort Yuantao Chen
title Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
title_short Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
title_full Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
title_fullStr Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
title_full_unstemmed Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
title_sort image super-resolution algorithm based on dual-channel convolutional neural networks
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2019-06-01
description For the image super-resolution method from a single channel, it is difficult to achieve both fast convergence and high-quality texture restoration. By mitigating the weaknesses of existing methods, the present paper proposes an image super-resolution algorithm based on dual-channel convolutional neural networks (DCCNN). The novel structure of the network model was divided into a deep channel and a shallow channel. The deep channel was used to extract the detailed texture information from the original image, while the shallow channel was mainly used to recover the overall outline of the original image. Firstly, the residual block was adjusted in the feature extraction stage, and the nonlinear mapping ability of the network was enhanced. The feature mapping dimension was reduced, and the effective features of the image were obtained. In the up-sampling stage, the parameters of the deconvolutional kernel were adjusted, and high-frequency signal loss was decreased. The high-resolution feature space could be rebuilt recursively using long-term and short-term memory blocks during the reconstruction stage, further enhancing the recovery of texture information. Secondly, the convolutional kernel was adjusted in the shallow channel to reduce the parameters, ensuring that the overall outline of the image was restored and that the network converged rapidly. Finally, the dual-channel loss function was jointly optimized to enhance the feature-fitting ability in order to obtain the final high-resolution image output. Using the improved algorithm, the network converged more rapidly, the image edge and texture reconstruction effect were obviously improved, and the Peak Signal-to-Noise Ratio (PSNR) and structural similarity were also superior to those of other solutions.
topic super-resolution
dual-channel
residual block
convolutional kernel parameter
long-term and short-term memory blocks
url https://www.mdpi.com/2076-3417/9/11/2316
work_keys_str_mv AT yuantaochen imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks
AT jinwang imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks
AT xichen imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks
AT arunkumarsangaiah imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks
AT kaiyang imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks
AT zhouhongcao imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks
_version_ 1725171975011172352