MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal

Reducing the impact of hazy images on subsequent visual information processing is a challenging problem. In this paper, combining with atmospheric scattering model, we propose an end-to-end multi-scale feature multiple parallel fusion network called MMP-Net for single image haze removal. The MMP-Net...

Full description

Bibliographic Details
Main Authors: Jiajia Yan, Chaofeng Li, Yuhui Zheng, Shoukun Xu, Xiaoyong Yan
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8978695/
id doaj-d5d77cca69b3447e8a7f3983c5cab76e
record_format Article
spelling doaj-d5d77cca69b3447e8a7f3983c5cab76e2021-03-30T02:35:04ZengIEEEIEEE Access2169-35362020-01-018254312544110.1109/ACCESS.2020.29710928978695MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze RemovalJiajia Yan0https://orcid.org/0000-0002-6702-4221Chaofeng Li1https://orcid.org/0000-0002-3236-3143Yuhui Zheng2https://orcid.org/0000-0002-4408-3800Shoukun Xu3https://orcid.org/0000-0001-5996-0266Xiaoyong Yan4https://orcid.org/0000-0002-8097-9268Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, ChinaInstitute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, ChinaCollege of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, ChinaSchool of Information Science and Engineering, Changzhou University, Changzhou, ChinaSchool of Modern Posts and Institute of Modern Posts, Nanjing University of Posts and Telecommunications, Nanjing, ChinaReducing the impact of hazy images on subsequent visual information processing is a challenging problem. In this paper, combining with atmospheric scattering model, we propose an end-to-end multi-scale feature multiple parallel fusion network called MMP-Net for single image haze removal. The MMP-Net includes three components: multi-scale CNN module, residual learning module and deep parallel fusion module. 1) In multi-scale CNN module, a multi-scale convolutional neural network (CNNs) is adopted to extract different scales features from whole to local, and these features are fused multiple times in parallel. 2) In residual learning module, residual blocks are introduced to deeply learn detailed features, which can recover more image details. 3) In deep parallel fusion module, those features from residual learning module are deeply merged with the fused features from CNNs, and finally used to recover a clean haze-free image via the atmospheric scattering model. The experimental results show that on the average of three datasets (SOTS, HSTS, and D-Hazy), proposed MMP-Net improves PSNR from 20.91db to 22.21db and SSIM from 0.8720 to 0.9023 over the best state-of-the-art DehazeNet method. What's more, MMP-Net gains the best subjective visual quality on real-world hazy images.https://ieeexplore.ieee.org/document/8978695/Image dehazingconvolutional neural networkresidual learningparallel fusion
collection DOAJ
language English
format Article
sources DOAJ
author Jiajia Yan
Chaofeng Li
Yuhui Zheng
Shoukun Xu
Xiaoyong Yan
spellingShingle Jiajia Yan
Chaofeng Li
Yuhui Zheng
Shoukun Xu
Xiaoyong Yan
MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
IEEE Access
Image dehazing
convolutional neural network
residual learning
parallel fusion
author_facet Jiajia Yan
Chaofeng Li
Yuhui Zheng
Shoukun Xu
Xiaoyong Yan
author_sort Jiajia Yan
title MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
title_short MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
title_full MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
title_fullStr MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
title_full_unstemmed MMP-Net: A Multi-Scale Feature Multiple Parallel Fusion Network for Single Image Haze Removal
title_sort mmp-net: a multi-scale feature multiple parallel fusion network for single image haze removal
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Reducing the impact of hazy images on subsequent visual information processing is a challenging problem. In this paper, combining with atmospheric scattering model, we propose an end-to-end multi-scale feature multiple parallel fusion network called MMP-Net for single image haze removal. The MMP-Net includes three components: multi-scale CNN module, residual learning module and deep parallel fusion module. 1) In multi-scale CNN module, a multi-scale convolutional neural network (CNNs) is adopted to extract different scales features from whole to local, and these features are fused multiple times in parallel. 2) In residual learning module, residual blocks are introduced to deeply learn detailed features, which can recover more image details. 3) In deep parallel fusion module, those features from residual learning module are deeply merged with the fused features from CNNs, and finally used to recover a clean haze-free image via the atmospheric scattering model. The experimental results show that on the average of three datasets (SOTS, HSTS, and D-Hazy), proposed MMP-Net improves PSNR from 20.91db to 22.21db and SSIM from 0.8720 to 0.9023 over the best state-of-the-art DehazeNet method. What's more, MMP-Net gains the best subjective visual quality on real-world hazy images.
topic Image dehazing
convolutional neural network
residual learning
parallel fusion
url https://ieeexplore.ieee.org/document/8978695/
work_keys_str_mv AT jiajiayan mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval
AT chaofengli mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval
AT yuhuizheng mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval
AT shoukunxu mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval
AT xiaoyongyan mmpnetamultiscalefeaturemultipleparallelfusionnetworkforsingleimagehazeremoval
_version_ 1724184900364402688