Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light

Since the method to remove fog from images is complicated and detail loss and color distortion could occur to the defogged images, a defogging method based on near-infrared and visible image fusion is put forward in this paper. The algorithm in this paper uses the near-infrared image with rich detai...

Full description

Bibliographic Details
Main Authors: Yubin Yuan, Yu Shen, Jing Peng, Lin Wang, Hongguo Zhang
Format: Article
Language:English
Published: Hindawi Limited 2020-01-01
Series:Journal of Sensors
Online Access:http://dx.doi.org/10.1155/2020/8818650
id doaj-c225b3b9c67b47aa9992ee0e9a358287
record_format Article
spelling doaj-c225b3b9c67b47aa9992ee0e9a3582872020-11-30T09:11:28ZengHindawi LimitedJournal of Sensors1687-725X1687-72682020-01-01202010.1155/2020/88186508818650Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible LightYubin Yuan0Yu Shen1Jing Peng2Lin Wang3Hongguo Zhang4School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, ChinaSchool of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, ChinaSchool of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, ChinaSchool of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, ChinaSchool of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, ChinaSince the method to remove fog from images is complicated and detail loss and color distortion could occur to the defogged images, a defogging method based on near-infrared and visible image fusion is put forward in this paper. The algorithm in this paper uses the near-infrared image with rich details as a new data source and adopts the image fusion method to obtain a defog image with rich details and high color recovery. First, the colorful visible image is converted into HSI color space to obtain an intensity channel image, color channel image, and saturation channel image. The intensity channel image is fused with a near-infrared image and defogged, and then it is decomposed by Nonsubsampled Shearlet Transform. The obtained high-frequency coefficient is filtered by preserving the edge with a double exponential edge smoothing filter, while low-frequency antisharpening masking treatment is conducted on the low-frequency coefficient. The new intensity channel image could be obtained based on the fusion rule and by reciprocal transformation. Then, in color treatment of the visible image, the degradation model of the saturation image is established, which estimates the parameters based on the principle of dark primary color to obtain the estimated saturation image. Finally, the new intensity channel image, the estimated saturation image, and the primary color image are reflected to RGB space to obtain the fusion image, which is enhanced by color and sharpness correction. In order to prove the effectiveness of the algorithm, the dense fog image and the thin fog image are compared with the popular single image defogging and multiple image defogging algorithms and the visible light-near infrared fusion defogging algorithm based on deep learning. The experimental results show that the proposed algorithm is better in improving the edge contrast and the visual sharpness of the image than the existing high-efficiency defogging method.http://dx.doi.org/10.1155/2020/8818650
collection DOAJ
language English
format Article
sources DOAJ
author Yubin Yuan
Yu Shen
Jing Peng
Lin Wang
Hongguo Zhang
spellingShingle Yubin Yuan
Yu Shen
Jing Peng
Lin Wang
Hongguo Zhang
Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
Journal of Sensors
author_facet Yubin Yuan
Yu Shen
Jing Peng
Lin Wang
Hongguo Zhang
author_sort Yubin Yuan
title Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
title_short Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
title_full Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
title_fullStr Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
title_full_unstemmed Defogging Technology Based on Dual-Channel Sensor Information Fusion of Near-Infrared and Visible Light
title_sort defogging technology based on dual-channel sensor information fusion of near-infrared and visible light
publisher Hindawi Limited
series Journal of Sensors
issn 1687-725X
1687-7268
publishDate 2020-01-01
description Since the method to remove fog from images is complicated and detail loss and color distortion could occur to the defogged images, a defogging method based on near-infrared and visible image fusion is put forward in this paper. The algorithm in this paper uses the near-infrared image with rich details as a new data source and adopts the image fusion method to obtain a defog image with rich details and high color recovery. First, the colorful visible image is converted into HSI color space to obtain an intensity channel image, color channel image, and saturation channel image. The intensity channel image is fused with a near-infrared image and defogged, and then it is decomposed by Nonsubsampled Shearlet Transform. The obtained high-frequency coefficient is filtered by preserving the edge with a double exponential edge smoothing filter, while low-frequency antisharpening masking treatment is conducted on the low-frequency coefficient. The new intensity channel image could be obtained based on the fusion rule and by reciprocal transformation. Then, in color treatment of the visible image, the degradation model of the saturation image is established, which estimates the parameters based on the principle of dark primary color to obtain the estimated saturation image. Finally, the new intensity channel image, the estimated saturation image, and the primary color image are reflected to RGB space to obtain the fusion image, which is enhanced by color and sharpness correction. In order to prove the effectiveness of the algorithm, the dense fog image and the thin fog image are compared with the popular single image defogging and multiple image defogging algorithms and the visible light-near infrared fusion defogging algorithm based on deep learning. The experimental results show that the proposed algorithm is better in improving the edge contrast and the visual sharpness of the image than the existing high-efficiency defogging method.
url http://dx.doi.org/10.1155/2020/8818650
work_keys_str_mv AT yubinyuan defoggingtechnologybasedondualchannelsensorinformationfusionofnearinfraredandvisiblelight
AT yushen defoggingtechnologybasedondualchannelsensorinformationfusionofnearinfraredandvisiblelight
AT jingpeng defoggingtechnologybasedondualchannelsensorinformationfusionofnearinfraredandvisiblelight
AT linwang defoggingtechnologybasedondualchannelsensorinformationfusionofnearinfraredandvisiblelight
AT hongguozhang defoggingtechnologybasedondualchannelsensorinformationfusionofnearinfraredandvisiblelight
_version_ 1715027843648323584