Dual Image Deblurring Using Deep Image Prior

Blind image deblurring, one of the main problems in image restoration, is a challenging, ill-posed problem. Hence, it is important to design a prior to solve it. Recently, deep image prior (DIP) has shown that convolutional neural networks (CNNs) can be a powerful prior for a single natural image. P...

Full description

Bibliographic Details
Main Authors: Chang Jong Shin, Tae Bok Lee, Yong Seok Heo
Format: Article
Language:English
Published: MDPI AG 2021-08-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/10/17/2045
id doaj-78c9bd45e00844109d714d64362a0da8
record_format Article
spelling doaj-78c9bd45e00844109d714d64362a0da82021-09-09T13:41:50ZengMDPI AGElectronics2079-92922021-08-01102045204510.3390/electronics10172045Dual Image Deblurring Using Deep Image PriorChang Jong Shin0Tae Bok Lee1Yong Seok Heo2Department of Artificial Intelligence, Ajou University, Suwon 16499, KoreaDepartment of Artificial Intelligence, Ajou University, Suwon 16499, KoreaDepartment of Artificial Intelligence, Ajou University, Suwon 16499, KoreaBlind image deblurring, one of the main problems in image restoration, is a challenging, ill-posed problem. Hence, it is important to design a prior to solve it. Recently, deep image prior (DIP) has shown that convolutional neural networks (CNNs) can be a powerful prior for a single natural image. Previous DIP-based deblurring methods exploited CNNs as a prior when solving the blind deburring problem and performed remarkably well. However, these methods do not completely utilize the given multiple blurry images, and have limitations of performance for severely blurred images. This is because their architectures are strictly designed to utilize a single image. In this paper, we propose a method called DualDeblur, which uses dual blurry images to generate a single sharp image. DualDeblur jointly utilizes the complementary information of multiple blurry images to capture image statistics for a single sharp image. Additionally, we propose an adaptive <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mi>L</mi><mn>2</mn></msub><mo>_</mo></mrow></semantics></math></inline-formula>SSIM loss that enhances both pixel accuracy and structural properties. Extensive experiments show the superior performance of our method to previous methods in both qualitative and quantitative evaluations.https://www.mdpi.com/2079-9292/10/17/2045deep learningdeep image priordeblurringblur kernel estimation
collection DOAJ
language English
format Article
sources DOAJ
author Chang Jong Shin
Tae Bok Lee
Yong Seok Heo
spellingShingle Chang Jong Shin
Tae Bok Lee
Yong Seok Heo
Dual Image Deblurring Using Deep Image Prior
Electronics
deep learning
deep image prior
deblurring
blur kernel estimation
author_facet Chang Jong Shin
Tae Bok Lee
Yong Seok Heo
author_sort Chang Jong Shin
title Dual Image Deblurring Using Deep Image Prior
title_short Dual Image Deblurring Using Deep Image Prior
title_full Dual Image Deblurring Using Deep Image Prior
title_fullStr Dual Image Deblurring Using Deep Image Prior
title_full_unstemmed Dual Image Deblurring Using Deep Image Prior
title_sort dual image deblurring using deep image prior
publisher MDPI AG
series Electronics
issn 2079-9292
publishDate 2021-08-01
description Blind image deblurring, one of the main problems in image restoration, is a challenging, ill-posed problem. Hence, it is important to design a prior to solve it. Recently, deep image prior (DIP) has shown that convolutional neural networks (CNNs) can be a powerful prior for a single natural image. Previous DIP-based deblurring methods exploited CNNs as a prior when solving the blind deburring problem and performed remarkably well. However, these methods do not completely utilize the given multiple blurry images, and have limitations of performance for severely blurred images. This is because their architectures are strictly designed to utilize a single image. In this paper, we propose a method called DualDeblur, which uses dual blurry images to generate a single sharp image. DualDeblur jointly utilizes the complementary information of multiple blurry images to capture image statistics for a single sharp image. Additionally, we propose an adaptive <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mrow><msub><mi>L</mi><mn>2</mn></msub><mo>_</mo></mrow></semantics></math></inline-formula>SSIM loss that enhances both pixel accuracy and structural properties. Extensive experiments show the superior performance of our method to previous methods in both qualitative and quantitative evaluations.
topic deep learning
deep image prior
deblurring
blur kernel estimation
url https://www.mdpi.com/2079-9292/10/17/2045
work_keys_str_mv AT changjongshin dualimagedeblurringusingdeepimageprior
AT taeboklee dualimagedeblurringusingdeepimageprior
AT yongseokheo dualimagedeblurringusingdeepimageprior
_version_ 1717760632896356352