Single Image Rain Removal Based on Deep Learning and Symmetry Transform

Rainy, as an inevitable weather condition, will affect the acquired image. To solve this problem, a single image rain removal algorithm based on deep learning and symmetric transformation is proposed. Because of the important characteristics of wavelet transform, such as symmetry, orthogonality, fle...

Full description

Bibliographic Details
Main Authors: Qing Yang, Ming Yu, Yan Xu, Shixin Cen
Format: Article
Language:English
Published: MDPI AG 2020-02-01
Series:Symmetry
Subjects:
snr
Online Access:https://www.mdpi.com/2073-8994/12/2/224
id doaj-f92401e8c8644c2e9ed2ba1cc7fc0b02
record_format Article
spelling doaj-f92401e8c8644c2e9ed2ba1cc7fc0b022020-11-25T01:27:38ZengMDPI AGSymmetry2073-89942020-02-0112222410.3390/sym12020224sym12020224Single Image Rain Removal Based on Deep Learning and Symmetry TransformQing Yang0Ming Yu1Yan Xu2Shixin Cen3School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, ChinaSchool of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, ChinaDepartment of Electronic and Optical Engineering, Army Engineering University Shijiazhuang Campus, Shijiazhuang 050003, ChinaSchool of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, ChinaRainy, as an inevitable weather condition, will affect the acquired image. To solve this problem, a single image rain removal algorithm based on deep learning and symmetric transformation is proposed. Because of the important characteristics of wavelet transform, such as symmetry, orthogonality, flexibility and limited support, wavelet transform is used to remove rain from a single image. The image is denoised by using wavelet decomposition, threshold value and wavelet reconstruction in wavelet transform, and the rain drop image is transformed from RGB space to YUV (luma chroma) space by using deep learning to obtain the brightness component and color component of the image. the brightness component and residual component of the raindrop source image and the ideal recovered image without raindrop are extracted. The residual image and brightness component are overlapped again, the reconstructed image is restored to RGB space by YUV inverse transformation, and the final color raindrop free image is obtained. After training the network, the optimal parameters of the network are obtained, and finally the convolution neural network which can effectively remove the rain line is obtained. Experimental results show that compared with other algorithms, the proposed algorithm achieves the highest value in both peak signal-to-noise ratio (PSNR) and structural similarity, which shows that the image effect of the algorithm is better after rain removal.https://www.mdpi.com/2073-8994/12/2/224deep learningwavelet transformimagerain removal algorithmvery deep networksnr
collection DOAJ
language English
format Article
sources DOAJ
author Qing Yang
Ming Yu
Yan Xu
Shixin Cen
spellingShingle Qing Yang
Ming Yu
Yan Xu
Shixin Cen
Single Image Rain Removal Based on Deep Learning and Symmetry Transform
Symmetry
deep learning
wavelet transform
image
rain removal algorithm
very deep network
snr
author_facet Qing Yang
Ming Yu
Yan Xu
Shixin Cen
author_sort Qing Yang
title Single Image Rain Removal Based on Deep Learning and Symmetry Transform
title_short Single Image Rain Removal Based on Deep Learning and Symmetry Transform
title_full Single Image Rain Removal Based on Deep Learning and Symmetry Transform
title_fullStr Single Image Rain Removal Based on Deep Learning and Symmetry Transform
title_full_unstemmed Single Image Rain Removal Based on Deep Learning and Symmetry Transform
title_sort single image rain removal based on deep learning and symmetry transform
publisher MDPI AG
series Symmetry
issn 2073-8994
publishDate 2020-02-01
description Rainy, as an inevitable weather condition, will affect the acquired image. To solve this problem, a single image rain removal algorithm based on deep learning and symmetric transformation is proposed. Because of the important characteristics of wavelet transform, such as symmetry, orthogonality, flexibility and limited support, wavelet transform is used to remove rain from a single image. The image is denoised by using wavelet decomposition, threshold value and wavelet reconstruction in wavelet transform, and the rain drop image is transformed from RGB space to YUV (luma chroma) space by using deep learning to obtain the brightness component and color component of the image. the brightness component and residual component of the raindrop source image and the ideal recovered image without raindrop are extracted. The residual image and brightness component are overlapped again, the reconstructed image is restored to RGB space by YUV inverse transformation, and the final color raindrop free image is obtained. After training the network, the optimal parameters of the network are obtained, and finally the convolution neural network which can effectively remove the rain line is obtained. Experimental results show that compared with other algorithms, the proposed algorithm achieves the highest value in both peak signal-to-noise ratio (PSNR) and structural similarity, which shows that the image effect of the algorithm is better after rain removal.
topic deep learning
wavelet transform
image
rain removal algorithm
very deep network
snr
url https://www.mdpi.com/2073-8994/12/2/224
work_keys_str_mv AT qingyang singleimagerainremovalbasedondeeplearningandsymmetrytransform
AT mingyu singleimagerainremovalbasedondeeplearningandsymmetrytransform
AT yanxu singleimagerainremovalbasedondeeplearningandsymmetrytransform
AT shixincen singleimagerainremovalbasedondeeplearningandsymmetrytransform
_version_ 1725104087013261312