Guided Dual Networks for Single Image Super-Resolution
The PSNR-oriented super-resolution (SR) methods pursue high reconstruction accuracy, but tend to produce over-smoothed results and lose plenty of high-frequency details. The GAN-based SR methods aim to generate more photo-realistic images, but the hallucinatory details are often accompanied with uns...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9097227/ |
id |
doaj-c263d7417a5148b09af1cb847ab2a590 |
---|---|
record_format |
Article |
spelling |
doaj-c263d7417a5148b09af1cb847ab2a5902021-03-30T03:01:29ZengIEEEIEEE Access2169-35362020-01-018936089362010.1109/ACCESS.2020.29951759097227Guided Dual Networks for Single Image Super-ResolutionWenhui Chen0https://orcid.org/0000-0002-4404-1790Chuangchuang Liu1https://orcid.org/0000-0002-7120-3601Yitong Yan2https://orcid.org/0000-0002-2823-8139Longcun Jin3https://orcid.org/0000-0002-1300-345XXianfang Sun4https://orcid.org/0000-0002-6114-0766Xinyi Peng5https://orcid.org/0000-0002-8060-5899School of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Software Engineering, South China University of Technology, Guangzhou, ChinaSchool of Computer Science and Informatics, Cardiff University, Cardiff, U.K.School of Software Engineering, South China University of Technology, Guangzhou, ChinaThe PSNR-oriented super-resolution (SR) methods pursue high reconstruction accuracy, but tend to produce over-smoothed results and lose plenty of high-frequency details. The GAN-based SR methods aim to generate more photo-realistic images, but the hallucinatory details are often accompanied with unsatisfying artifacts and noise. To address these problems, we propose a guided dual super-resolution network (GDSR), which exploits the advantages of both the PSNR-oriented and the GAN-based methods to achieve a good trade-off between reconstruction accuracy and perceptual quality. Specifically, our network contains two branches, where one is trained to extract global information and the other to focus on detail information. In this way, our network simultaneously generates SR images with high accuracy and satisfactory visual quality. To obtain more high-frequency features, we use the global features extracted from the low-frequency branch to guide the training of the high-frequency branch. Besides, our method utilizes a mask network to adaptively recover the final super-resolved image. Extensive experiments on several standard benchmarks show that our proposed method achieves better performance compared with state-of-the-art methods. The source code and the results of our GDSR are available at https://github.com/wenchen4321/GDSR.https://ieeexplore.ieee.org/document/9097227/Convolutional neural networkdual networkgenerative adversarial networksingle image super-resolution |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Wenhui Chen Chuangchuang Liu Yitong Yan Longcun Jin Xianfang Sun Xinyi Peng |
spellingShingle |
Wenhui Chen Chuangchuang Liu Yitong Yan Longcun Jin Xianfang Sun Xinyi Peng Guided Dual Networks for Single Image Super-Resolution IEEE Access Convolutional neural network dual network generative adversarial network single image super-resolution |
author_facet |
Wenhui Chen Chuangchuang Liu Yitong Yan Longcun Jin Xianfang Sun Xinyi Peng |
author_sort |
Wenhui Chen |
title |
Guided Dual Networks for Single Image Super-Resolution |
title_short |
Guided Dual Networks for Single Image Super-Resolution |
title_full |
Guided Dual Networks for Single Image Super-Resolution |
title_fullStr |
Guided Dual Networks for Single Image Super-Resolution |
title_full_unstemmed |
Guided Dual Networks for Single Image Super-Resolution |
title_sort |
guided dual networks for single image super-resolution |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
The PSNR-oriented super-resolution (SR) methods pursue high reconstruction accuracy, but tend to produce over-smoothed results and lose plenty of high-frequency details. The GAN-based SR methods aim to generate more photo-realistic images, but the hallucinatory details are often accompanied with unsatisfying artifacts and noise. To address these problems, we propose a guided dual super-resolution network (GDSR), which exploits the advantages of both the PSNR-oriented and the GAN-based methods to achieve a good trade-off between reconstruction accuracy and perceptual quality. Specifically, our network contains two branches, where one is trained to extract global information and the other to focus on detail information. In this way, our network simultaneously generates SR images with high accuracy and satisfactory visual quality. To obtain more high-frequency features, we use the global features extracted from the low-frequency branch to guide the training of the high-frequency branch. Besides, our method utilizes a mask network to adaptively recover the final super-resolved image. Extensive experiments on several standard benchmarks show that our proposed method achieves better performance compared with state-of-the-art methods. The source code and the results of our GDSR are available at https://github.com/wenchen4321/GDSR. |
topic |
Convolutional neural network dual network generative adversarial network single image super-resolution |
url |
https://ieeexplore.ieee.org/document/9097227/ |
work_keys_str_mv |
AT wenhuichen guideddualnetworksforsingleimagesuperresolution AT chuangchuangliu guideddualnetworksforsingleimagesuperresolution AT yitongyan guideddualnetworksforsingleimagesuperresolution AT longcunjin guideddualnetworksforsingleimagesuperresolution AT xianfangsun guideddualnetworksforsingleimagesuperresolution AT xinyipeng guideddualnetworksforsingleimagesuperresolution |
_version_ |
1724184237423198208 |