Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks
For the image super-resolution method from a single channel, it is difficult to achieve both fast convergence and high-quality texture restoration. By mitigating the weaknesses of existing methods, the present paper proposes an image super-resolution algorithm based on dual-channel convolutional neu...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-06-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/9/11/2316 |
id |
doaj-2aa4c9656bcc4ab2825e6b09b9275d3a |
---|---|
record_format |
Article |
spelling |
doaj-2aa4c9656bcc4ab2825e6b09b9275d3a2020-11-25T01:11:16ZengMDPI AGApplied Sciences2076-34172019-06-01911231610.3390/app9112316app9112316Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural NetworksYuantao Chen0Jin Wang1Xi Chen2Arun Kumar Sangaiah3Kai Yang4Zhouhong Cao5School of Computer and Communication Engineering & Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, Changsha University of Science and Technology, Changsha 410114, ChinaSchool of Computer and Communication Engineering & Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, Changsha University of Science and Technology, Changsha 410114, ChinaSchool of Computer and Communication Engineering & Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, Changsha University of Science and Technology, Changsha 410114, ChinaSchool of Computing Science and Engineering, Vellore Institute of Technology University, Vellore 632014, IndiaTechnical Quality Department, Hunan ZOOMLION Heavy Industry Intelligent Technology Corporation Limited, Changsha 410005, ChinaSchool of Hydraulic Engineering & Hunan Provincial Science and Technology Innovation Platform of Key Laboratory of Dongting Lake Aquatic Eco-Environmental Control and Restoration, Changsha University of Science and Technology, Changsha 410114, ChinaFor the image super-resolution method from a single channel, it is difficult to achieve both fast convergence and high-quality texture restoration. By mitigating the weaknesses of existing methods, the present paper proposes an image super-resolution algorithm based on dual-channel convolutional neural networks (DCCNN). The novel structure of the network model was divided into a deep channel and a shallow channel. The deep channel was used to extract the detailed texture information from the original image, while the shallow channel was mainly used to recover the overall outline of the original image. Firstly, the residual block was adjusted in the feature extraction stage, and the nonlinear mapping ability of the network was enhanced. The feature mapping dimension was reduced, and the effective features of the image were obtained. In the up-sampling stage, the parameters of the deconvolutional kernel were adjusted, and high-frequency signal loss was decreased. The high-resolution feature space could be rebuilt recursively using long-term and short-term memory blocks during the reconstruction stage, further enhancing the recovery of texture information. Secondly, the convolutional kernel was adjusted in the shallow channel to reduce the parameters, ensuring that the overall outline of the image was restored and that the network converged rapidly. Finally, the dual-channel loss function was jointly optimized to enhance the feature-fitting ability in order to obtain the final high-resolution image output. Using the improved algorithm, the network converged more rapidly, the image edge and texture reconstruction effect were obviously improved, and the Peak Signal-to-Noise Ratio (PSNR) and structural similarity were also superior to those of other solutions.https://www.mdpi.com/2076-3417/9/11/2316super-resolutiondual-channelresidual blockconvolutional kernel parameterlong-term and short-term memory blocks |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yuantao Chen Jin Wang Xi Chen Arun Kumar Sangaiah Kai Yang Zhouhong Cao |
spellingShingle |
Yuantao Chen Jin Wang Xi Chen Arun Kumar Sangaiah Kai Yang Zhouhong Cao Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks Applied Sciences super-resolution dual-channel residual block convolutional kernel parameter long-term and short-term memory blocks |
author_facet |
Yuantao Chen Jin Wang Xi Chen Arun Kumar Sangaiah Kai Yang Zhouhong Cao |
author_sort |
Yuantao Chen |
title |
Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks |
title_short |
Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks |
title_full |
Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks |
title_fullStr |
Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks |
title_full_unstemmed |
Image Super-Resolution Algorithm Based on Dual-Channel Convolutional Neural Networks |
title_sort |
image super-resolution algorithm based on dual-channel convolutional neural networks |
publisher |
MDPI AG |
series |
Applied Sciences |
issn |
2076-3417 |
publishDate |
2019-06-01 |
description |
For the image super-resolution method from a single channel, it is difficult to achieve both fast convergence and high-quality texture restoration. By mitigating the weaknesses of existing methods, the present paper proposes an image super-resolution algorithm based on dual-channel convolutional neural networks (DCCNN). The novel structure of the network model was divided into a deep channel and a shallow channel. The deep channel was used to extract the detailed texture information from the original image, while the shallow channel was mainly used to recover the overall outline of the original image. Firstly, the residual block was adjusted in the feature extraction stage, and the nonlinear mapping ability of the network was enhanced. The feature mapping dimension was reduced, and the effective features of the image were obtained. In the up-sampling stage, the parameters of the deconvolutional kernel were adjusted, and high-frequency signal loss was decreased. The high-resolution feature space could be rebuilt recursively using long-term and short-term memory blocks during the reconstruction stage, further enhancing the recovery of texture information. Secondly, the convolutional kernel was adjusted in the shallow channel to reduce the parameters, ensuring that the overall outline of the image was restored and that the network converged rapidly. Finally, the dual-channel loss function was jointly optimized to enhance the feature-fitting ability in order to obtain the final high-resolution image output. Using the improved algorithm, the network converged more rapidly, the image edge and texture reconstruction effect were obviously improved, and the Peak Signal-to-Noise Ratio (PSNR) and structural similarity were also superior to those of other solutions. |
topic |
super-resolution dual-channel residual block convolutional kernel parameter long-term and short-term memory blocks |
url |
https://www.mdpi.com/2076-3417/9/11/2316 |
work_keys_str_mv |
AT yuantaochen imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks AT jinwang imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks AT xichen imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks AT arunkumarsangaiah imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks AT kaiyang imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks AT zhouhongcao imagesuperresolutionalgorithmbasedondualchannelconvolutionalneuralnetworks |
_version_ |
1725171975011172352 |