Guided Dual Networks for Single Image Super-Resolution

The PSNR-oriented super-resolution (SR) methods pursue high reconstruction accuracy, but tend to produce over-smoothed results and lose plenty of high-frequency details. The GAN-based SR methods aim to generate more photo-realistic images, but the hallucinatory details are often accompanied with uns...

Full description

Bibliographic Details
Main Authors: Wenhui Chen, Chuangchuang Liu, Yitong Yan, Longcun Jin, Xianfang Sun, Xinyi Peng
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9097227/
id doaj-c263d7417a5148b09af1cb847ab2a590
record_format Article
spelling doaj-c263d7417a5148b09af1cb847ab2a5902021-03-30T03:01:29ZengIEEEIEEE Access2169-35362020-01-018936089362010.1109/ACCESS.2020.29951759097227Guided Dual Networks for Single Image Super-ResolutionWenhui Chen0https://orcid.org/0000-0002-4404-1790Chuangchuang Liu1https://orcid.org/0000-0002-7120-3601Yitong Yan2https://orcid.org/0000-0002-2823-8139Longcun Jin3https://orcid.org/0000-0002-1300-345XXianfang Sun4https://orcid.org/0000-0002-6114-0766Xinyi Peng5https://orcid.org/0000-0002-8060-5899School of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Computer Science and Informatics, Cardiff University, Cardiff, U.K.School of Software Engineering, South China University of Technology, Guangzhou, ChinaThe PSNR-oriented super-resolution (SR) methods pursue high reconstruction accuracy, but tend to produce over-smoothed results and lose plenty of high-frequency details. The GAN-based SR methods aim to generate more photo-realistic images, but the hallucinatory details are often accompanied with unsatisfying artifacts and noise. To address these problems, we propose a guided dual super-resolution network (GDSR), which exploits the advantages of both the PSNR-oriented and the GAN-based methods to achieve a good trade-off between reconstruction accuracy and perceptual quality. Specifically, our network contains two branches, where one is trained to extract global information and the other to focus on detail information. In this way, our network simultaneously generates SR images with high accuracy and satisfactory visual quality. To obtain more high-frequency features, we use the global features extracted from the low-frequency branch to guide the training of the high-frequency branch. Besides, our method utilizes a mask network to adaptively recover the final super-resolved image. Extensive experiments on several standard benchmarks show that our proposed method achieves better performance compared with state-of-the-art methods. The source code and the results of our GDSR are available at https://github.com/wenchen4321/GDSR.https://ieeexplore.ieee.org/document/9097227/Convolutional neural networkdual networkgenerative adversarial networksingle image super-resolution
collection DOAJ
language English
format Article
sources DOAJ
author Wenhui Chen
Chuangchuang Liu
Yitong Yan
Longcun Jin
Xianfang Sun
Xinyi Peng
spellingShingle Wenhui Chen
Chuangchuang Liu
Yitong Yan
Longcun Jin
Xianfang Sun
Xinyi Peng
Guided Dual Networks for Single Image Super-Resolution
IEEE Access
Convolutional neural network
dual network
generative adversarial network
single image super-resolution
author_facet Wenhui Chen
Chuangchuang Liu
Yitong Yan
Longcun Jin
Xianfang Sun
Xinyi Peng
author_sort Wenhui Chen
title Guided Dual Networks for Single Image Super-Resolution
title_short Guided Dual Networks for Single Image Super-Resolution
title_full Guided Dual Networks for Single Image Super-Resolution
title_fullStr Guided Dual Networks for Single Image Super-Resolution
title_full_unstemmed Guided Dual Networks for Single Image Super-Resolution
title_sort guided dual networks for single image super-resolution
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description The PSNR-oriented super-resolution (SR) methods pursue high reconstruction accuracy, but tend to produce over-smoothed results and lose plenty of high-frequency details. The GAN-based SR methods aim to generate more photo-realistic images, but the hallucinatory details are often accompanied with unsatisfying artifacts and noise. To address these problems, we propose a guided dual super-resolution network (GDSR), which exploits the advantages of both the PSNR-oriented and the GAN-based methods to achieve a good trade-off between reconstruction accuracy and perceptual quality. Specifically, our network contains two branches, where one is trained to extract global information and the other to focus on detail information. In this way, our network simultaneously generates SR images with high accuracy and satisfactory visual quality. To obtain more high-frequency features, we use the global features extracted from the low-frequency branch to guide the training of the high-frequency branch. Besides, our method utilizes a mask network to adaptively recover the final super-resolved image. Extensive experiments on several standard benchmarks show that our proposed method achieves better performance compared with state-of-the-art methods. The source code and the results of our GDSR are available at https://github.com/wenchen4321/GDSR.
topic Convolutional neural network
dual network
generative adversarial network
single image super-resolution
url https://ieeexplore.ieee.org/document/9097227/
work_keys_str_mv AT wenhuichen guideddualnetworksforsingleimagesuperresolution
AT chuangchuangliu guideddualnetworksforsingleimagesuperresolution
AT yitongyan guideddualnetworksforsingleimagesuperresolution
AT longcunjin guideddualnetworksforsingleimagesuperresolution
AT xianfangsun guideddualnetworksforsingleimagesuperresolution
AT xinyipeng guideddualnetworksforsingleimagesuperresolution
_version_ 1724184237423198208