MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
Reducing the impact of hazy images on subsequent visual information processing is a challenging problem. In this paper, combining with atmospheric scattering model, we propose an end-to-end multi-scale feature multiple parallel fusion network called MMP-Net for single image haze removal. The MMP-Net...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8978695/ |
id |
doaj-d5d77cca69b3447e8a7f3983c5cab76e |
---|---|
record_format |
Article |
spelling |
doaj-d5d77cca69b3447e8a7f3983c5cab76e2021-03-30T02:35:04ZengIEEEIEEE Access2169-35362020-01-018254312544110.1109/ACCESS.2020.29710928978695MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze RemovalJiajia Yan0https://orcid.org/0000-0002-6702-4221Chaofeng Li1https://orcid.org/0000-0002-3236-3143Yuhui Zheng2https://orcid.org/0000-0002-4408-3800Shoukun Xu3https://orcid.org/0000-0001-5996-0266Xiaoyong Yan4https://orcid.org/0000-0002-8097-9268Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, ChinaInstitute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, ChinaCollege of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, ChinaSchool of Information Science and Engineering, Changzhou University, Changzhou, ChinaSchool of Modern Posts and Institute of Modern Posts, Nanjing University of Posts and Telecommunications, Nanjing, ChinaReducing the impact of hazy images on subsequent visual information processing is a challenging problem. In this paper, combining with atmospheric scattering model, we propose an end-to-end multi-scale feature multiple parallel fusion network called MMP-Net for single image haze removal. The MMP-Net includes three components: multi-scale CNN module, residual learning module and deep parallel fusion module. 1) In multi-scale CNN module, a multi-scale convolutional neural network (CNNs) is adopted to extract different scales features from whole to local, and these features are fused multiple times in parallel. 2) In residual learning module, residual blocks are introduced to deeply learn detailed features, which can recover more image details. 3) In deep parallel fusion module, those features from residual learning module are deeply merged with the fused features from CNNs, and finally used to recover a clean haze-free image via the atmospheric scattering model. The experimental results show that on the average of three datasets (SOTS, HSTS, and D-Hazy), proposed MMP-Net improves PSNR from 20.91db to 22.21db and SSIM from 0.8720 to 0.9023 over the best state-of-the-art DehazeNet method. What's more, MMP-Net gains the best subjective visual quality on real-world hazy images.https://ieeexplore.ieee.org/document/8978695/Image dehazingconvolutional neural networkresidual learningparallel fusion |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jiajia Yan Chaofeng Li Yuhui Zheng Shoukun Xu Xiaoyong Yan |
spellingShingle |
Jiajia Yan Chaofeng Li Yuhui Zheng Shoukun Xu Xiaoyong Yan MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal IEEE Access Image dehazing convolutional neural network residual learning parallel fusion |
author_facet |
Jiajia Yan Chaofeng Li Yuhui Zheng Shoukun Xu Xiaoyong Yan |
author_sort |
Jiajia Yan |
title |
MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal |
title_short |
MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal |
title_full |
MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal |
title_fullStr |
MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal |
title_full_unstemmed |
MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal |
title_sort |
mmp-net: a multi-scale feature multiple parallel fusion network for single image haze removal |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
Reducing the impact of hazy images on subsequent visual information processing is a challenging problem. In this paper, combining with atmospheric scattering model, we propose an end-to-end multi-scale feature multiple parallel fusion network called MMP-Net for single image haze removal. The MMP-Net includes three components: multi-scale CNN module, residual learning module and deep parallel fusion module. 1) In multi-scale CNN module, a multi-scale convolutional neural network (CNNs) is adopted to extract different scales features from whole to local, and these features are fused multiple times in parallel. 2) In residual learning module, residual blocks are introduced to deeply learn detailed features, which can recover more image details. 3) In deep parallel fusion module, those features from residual learning module are deeply merged with the fused features from CNNs, and finally used to recover a clean haze-free image via the atmospheric scattering model. The experimental results show that on the average of three datasets (SOTS, HSTS, and D-Hazy), proposed MMP-Net improves PSNR from 20.91db to 22.21db and SSIM from 0.8720 to 0.9023 over the best state-of-the-art DehazeNet method. What's more, MMP-Net gains the best subjective visual quality on real-world hazy images. |
topic |
Image dehazing convolutional neural network residual learning parallel fusion |
url |
https://ieeexplore.ieee.org/document/8978695/ |
work_keys_str_mv |
AT jiajiayan mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval AT chaofengli mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval AT yuhuizheng mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval AT shoukunxu mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval AT xiaoyongyan mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval |
_version_ |
1724184900364402688 |