Dual Image Deblurring Using Deep Image Prior
Blind image deblurring, one of the main problems in image restoration, is a challenging, ill-posed problem. Hence, it is important to design a prior to solve it. Recently, deep image prior (DIP) has shown that convolutional neural networks (CNNs) can be a powerful prior for a single natural image. P...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-08-01
|
Series: | Electronics |
Subjects: | |
Online Access: | https://www.mdpi.com/2079-9292/10/17/2045 |
id |
doaj-78c9bd45e00844109d714d64362a0da8 |
---|---|
record_format |
Article |
spelling |
doaj-78c9bd45e00844109d714d64362a0da82021-09-09T13:41:50ZengMDPI AGElectronics2079-92922021-08-01102045204510.3390/electronics10172045Dual Image Deblurring Using Deep Image PriorChang Jong Shin0Tae Bok Lee1Yong Seok Heo2Department of Artificial Intelligence, Ajou University, Suwon 16499, KoreaDepartment of Artificial Intelligence, Ajou University, Suwon 16499, KoreaDepartment of Artificial Intelligence, Ajou University, Suwon 16499, KoreaBlind image deblurring, one of the main problems in image restoration, is a challenging, ill-posed problem. Hence, it is important to design a prior to solve it. Recently, deep image prior (DIP) has shown that convolutional neural networks (CNNs) can be a powerful prior for a single natural image. Previous DIP-based deblurring methods exploited CNNs as a prior when solving the blind deburring problem and performed remarkably well. However, these methods do not completely utilize the given multiple blurry images, and have limitations of performance for severely blurred images. This is because their architectures are strictly designed to utilize a single image. In this paper, we propose a method called DualDeblur, which uses dual blurry images to generate a single sharp image. DualDeblur jointly utilizes the complementary information of multiple blurry images to capture image statistics for a single sharp image. Additionally, we propose an adaptive <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mi>L</mi><mn>2</mn></msub><mo>_</mo></mrow></semantics></math></inline-formula>SSIM loss that enhances both pixel accuracy and structural properties. Extensive experiments show the superior performance of our method to previous methods in both qualitative and quantitative evaluations.https://www.mdpi.com/2079-9292/10/17/2045deep learningdeep image priordeblurringblur kernel estimation |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Chang Jong Shin Tae Bok Lee Yong Seok Heo |
spellingShingle |
Chang Jong Shin Tae Bok Lee Yong Seok Heo Dual Image Deblurring Using Deep Image Prior Electronics deep learning deep image prior deblurring blur kernel estimation |
author_facet |
Chang Jong Shin Tae Bok Lee Yong Seok Heo |
author_sort |
Chang Jong Shin |
title |
Dual Image Deblurring Using Deep Image Prior |
title_short |
Dual Image Deblurring Using Deep Image Prior |
title_full |
Dual Image Deblurring Using Deep Image Prior |
title_fullStr |
Dual Image Deblurring Using Deep Image Prior |
title_full_unstemmed |
Dual Image Deblurring Using Deep Image Prior |
title_sort |
dual image deblurring using deep image prior |
publisher |
MDPI AG |
series |
Electronics |
issn |
2079-9292 |
publishDate |
2021-08-01 |
description |
Blind image deblurring, one of the main problems in image restoration, is a challenging, ill-posed problem. Hence, it is important to design a prior to solve it. Recently, deep image prior (DIP) has shown that convolutional neural networks (CNNs) can be a powerful prior for a single natural image. Previous DIP-based deblurring methods exploited CNNs as a prior when solving the blind deburring problem and performed remarkably well. However, these methods do not completely utilize the given multiple blurry images, and have limitations of performance for severely blurred images. This is because their architectures are strictly designed to utilize a single image. In this paper, we propose a method called DualDeblur, which uses dual blurry images to generate a single sharp image. DualDeblur jointly utilizes the complementary information of multiple blurry images to capture image statistics for a single sharp image. Additionally, we propose an adaptive <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mi>L</mi><mn>2</mn></msub><mo>_</mo></mrow></semantics></math></inline-formula>SSIM loss that enhances both pixel accuracy and structural properties. Extensive experiments show the superior performance of our method to previous methods in both qualitative and quantitative evaluations. |
topic |
deep learning deep image prior deblurring blur kernel estimation |
url |
https://www.mdpi.com/2079-9292/10/17/2045 |
work_keys_str_mv |
AT changjongshin dualimagedeblurringusingdeepimageprior AT taeboklee dualimagedeblurringusingdeepimageprior AT yongseokheo dualimagedeblurringusingdeepimageprior |
_version_ |
1717760632896356352 |