SMGAN: A self-modulated generative adversarial network for single image dehazing

Single image dehazing has become a key prerequisite for most high-level computer vision tasks since haze severely degrades the input images. Traditional prior-based methods dehaze images by some assumptions concluded from haze-free images, which recover high-quality results but always cause some hal...

Full description

Bibliographic Details
Main Authors: Nian Wang, Zhigao Cui, Yanzhao Su, Chuan He, Yunwei Lan, Aihua Li
Format: Article
Language:English
Published: AIP Publishing LLC 2021-08-01
Series:AIP Advances
Online Access:http://dx.doi.org/10.1063/5.0059424
id doaj-8d4f398c199d4afb842e97b5ae1073d2
record_format Article
spelling doaj-8d4f398c199d4afb842e97b5ae1073d22021-09-03T11:18:12ZengAIP Publishing LLCAIP Advances2158-32262021-08-01118085227085227-1010.1063/5.0059424SMGAN: A self-modulated generative adversarial network for single image dehazingNian Wang0Zhigao Cui1Yanzhao Su2Chuan He3Yunwei Lan4Aihua Li5Xi’an Research Institute of High-Tech, Xi’an 710025, ChinaXi’an Research Institute of High-Tech, Xi’an 710025, ChinaXi’an Research Institute of High-Tech, Xi’an 710025, ChinaXi’an Research Institute of High-Tech, Xi’an 710025, ChinaXi’an Research Institute of High-Tech, Xi’an 710025, ChinaXi’an Research Institute of High-Tech, Xi’an 710025, ChinaSingle image dehazing has become a key prerequisite for most high-level computer vision tasks since haze severely degrades the input images. Traditional prior-based methods dehaze images by some assumptions concluded from haze-free images, which recover high-quality results but always cause some halos or color distortion. Recently, many methods have been using convolutional neural networks to learn the haze-relevant features and then retrieve the original images. These learning-based methods achieve better performance in synthetic scenes but can hardly restore a clear image with discriminative texture when applied to real-world images, mainly because these networks are trained on synthetic datasets. To solve these problems, a self-modulated generative adversarial network for single image dehazing named SMGAN is proposed. The SMGAN inputs prior-dehazed images into a parameter-shared encoder to produce some latent information of these dehazed images. During the hazy image decoding process, the latent information is sent to self-modulated batch normalization layers, which makes the network fit in real haze removal. Moreover, consider that there are some over-enhanced regions in the guidance images, and a refine module is proposed to alleviate the negative information. The proposed SMGAN combines the advantages of prior-based methods and learning-based methods, which provides superior performance compared with the state-of-the-art methods on both synthetic and real-word datasets.http://dx.doi.org/10.1063/5.0059424
collection DOAJ
language English
format Article
sources DOAJ
author Nian Wang
Zhigao Cui
Yanzhao Su
Chuan He
Yunwei Lan
Aihua Li
spellingShingle Nian Wang
Zhigao Cui
Yanzhao Su
Chuan He
Yunwei Lan
Aihua Li
SMGAN: A self-modulated generative adversarial network for single image dehazing
AIP Advances
author_facet Nian Wang
Zhigao Cui
Yanzhao Su
Chuan He
Yunwei Lan
Aihua Li
author_sort Nian Wang
title SMGAN: A self-modulated generative adversarial network for single image dehazing
title_short SMGAN: A self-modulated generative adversarial network for single image dehazing
title_full SMGAN: A self-modulated generative adversarial network for single image dehazing
title_fullStr SMGAN: A self-modulated generative adversarial network for single image dehazing
title_full_unstemmed SMGAN: A self-modulated generative adversarial network for single image dehazing
title_sort smgan: a self-modulated generative adversarial network for single image dehazing
publisher AIP Publishing LLC
series AIP Advances
issn 2158-3226
publishDate 2021-08-01
description Single image dehazing has become a key prerequisite for most high-level computer vision tasks since haze severely degrades the input images. Traditional prior-based methods dehaze images by some assumptions concluded from haze-free images, which recover high-quality results but always cause some halos or color distortion. Recently, many methods have been using convolutional neural networks to learn the haze-relevant features and then retrieve the original images. These learning-based methods achieve better performance in synthetic scenes but can hardly restore a clear image with discriminative texture when applied to real-world images, mainly because these networks are trained on synthetic datasets. To solve these problems, a self-modulated generative adversarial network for single image dehazing named SMGAN is proposed. The SMGAN inputs prior-dehazed images into a parameter-shared encoder to produce some latent information of these dehazed images. During the hazy image decoding process, the latent information is sent to self-modulated batch normalization layers, which makes the network fit in real haze removal. Moreover, consider that there are some over-enhanced regions in the guidance images, and a refine module is proposed to alleviate the negative information. The proposed SMGAN combines the advantages of prior-based methods and learning-based methods, which provides superior performance compared with the state-of-the-art methods on both synthetic and real-word datasets.
url http://dx.doi.org/10.1063/5.0059424
work_keys_str_mv AT nianwang smganaselfmodulatedgenerativeadversarialnetworkforsingleimagedehazing
AT zhigaocui smganaselfmodulatedgenerativeadversarialnetworkforsingleimagedehazing
AT yanzhaosu smganaselfmodulatedgenerativeadversarialnetworkforsingleimagedehazing
AT chuanhe smganaselfmodulatedgenerativeadversarialnetworkforsingleimagedehazing
AT yunweilan smganaselfmodulatedgenerativeadversarialnetworkforsingleimagedehazing
AT aihuali smganaselfmodulatedgenerativeadversarialnetworkforsingleimagedehazing
_version_ 1717817345301282816