Single Image Rain Removal Based on Deep Learning and Symmetry Transform
Rainy, as an inevitable weather condition, will affect the acquired image. To solve this problem, a single image rain removal algorithm based on deep learning and symmetric transformation is proposed. Because of the important characteristics of wavelet transform, such as symmetry, orthogonality, fle...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-02-01
|
Series: | Symmetry |
Subjects: | |
Online Access: | https://www.mdpi.com/2073-8994/12/2/224 |
id |
doaj-f92401e8c8644c2e9ed2ba1cc7fc0b02 |
---|---|
record_format |
Article |
spelling |
doaj-f92401e8c8644c2e9ed2ba1cc7fc0b022020-11-25T01:27:38ZengMDPI AGSymmetry2073-89942020-02-0112222410.3390/sym12020224sym12020224Single Image Rain Removal Based on Deep Learning and Symmetry TransformQing Yang0Ming Yu1Yan Xu2Shixin Cen3School of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, ChinaSchool of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, ChinaDepartment of Electronic and Optical Engineering, Army Engineering University Shijiazhuang Campus, Shijiazhuang 050003, ChinaSchool of Electronic and Information Engineering, Hebei University of Technology, Tianjin 300401, ChinaRainy, as an inevitable weather condition, will affect the acquired image. To solve this problem, a single image rain removal algorithm based on deep learning and symmetric transformation is proposed. Because of the important characteristics of wavelet transform, such as symmetry, orthogonality, flexibility and limited support, wavelet transform is used to remove rain from a single image. The image is denoised by using wavelet decomposition, threshold value and wavelet reconstruction in wavelet transform, and the rain drop image is transformed from RGB space to YUV (luma chroma) space by using deep learning to obtain the brightness component and color component of the image. the brightness component and residual component of the raindrop source image and the ideal recovered image without raindrop are extracted. The residual image and brightness component are overlapped again, the reconstructed image is restored to RGB space by YUV inverse transformation, and the final color raindrop free image is obtained. After training the network, the optimal parameters of the network are obtained, and finally the convolution neural network which can effectively remove the rain line is obtained. Experimental results show that compared with other algorithms, the proposed algorithm achieves the highest value in both peak signal-to-noise ratio (PSNR) and structural similarity, which shows that the image effect of the algorithm is better after rain removal.https://www.mdpi.com/2073-8994/12/2/224deep learningwavelet transformimagerain removal algorithmvery deep networksnr |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Qing Yang Ming Yu Yan Xu Shixin Cen |
spellingShingle |
Qing Yang Ming Yu Yan Xu Shixin Cen Single Image Rain Removal Based on Deep Learning and Symmetry Transform Symmetry deep learning wavelet transform image rain removal algorithm very deep network snr |
author_facet |
Qing Yang Ming Yu Yan Xu Shixin Cen |
author_sort |
Qing Yang |
title |
Single Image Rain Removal Based on Deep Learning and Symmetry Transform |
title_short |
Single Image Rain Removal Based on Deep Learning and Symmetry Transform |
title_full |
Single Image Rain Removal Based on Deep Learning and Symmetry Transform |
title_fullStr |
Single Image Rain Removal Based on Deep Learning and Symmetry Transform |
title_full_unstemmed |
Single Image Rain Removal Based on Deep Learning and Symmetry Transform |
title_sort |
single image rain removal based on deep learning and symmetry transform |
publisher |
MDPI AG |
series |
Symmetry |
issn |
2073-8994 |
publishDate |
2020-02-01 |
description |
Rainy, as an inevitable weather condition, will affect the acquired image. To solve this problem, a single image rain removal algorithm based on deep learning and symmetric transformation is proposed. Because of the important characteristics of wavelet transform, such as symmetry, orthogonality, flexibility and limited support, wavelet transform is used to remove rain from a single image. The image is denoised by using wavelet decomposition, threshold value and wavelet reconstruction in wavelet transform, and the rain drop image is transformed from RGB space to YUV (luma chroma) space by using deep learning to obtain the brightness component and color component of the image. the brightness component and residual component of the raindrop source image and the ideal recovered image without raindrop are extracted. The residual image and brightness component are overlapped again, the reconstructed image is restored to RGB space by YUV inverse transformation, and the final color raindrop free image is obtained. After training the network, the optimal parameters of the network are obtained, and finally the convolution neural network which can effectively remove the rain line is obtained. Experimental results show that compared with other algorithms, the proposed algorithm achieves the highest value in both peak signal-to-noise ratio (PSNR) and structural similarity, which shows that the image effect of the algorithm is better after rain removal. |
topic |
deep learning wavelet transform image rain removal algorithm very deep network snr |
url |
https://www.mdpi.com/2073-8994/12/2/224 |
work_keys_str_mv |
AT qingyang singleimagerainremovalbasedondeeplearningandsymmetrytransform AT mingyu singleimagerainremovalbasedondeeplearningandsymmetrytransform AT yanxu singleimagerainremovalbasedondeeplearningandsymmetrytransform AT shixincen singleimagerainremovalbasedondeeplearningandsymmetrytransform |
_version_ |
1725104087013261312 |