Screen Window Propagating for Image Inpainting

Image repair often has errors in filling. An exemplar-based technique has the advantage of filling texture and structure simultaneously, but there exist some problems with this, such as not considering the overall situation of inpainting, the unreasonable calculation of priority, and random selectio...

Full description

Bibliographic Details
Main Authors: Huaming Liu, Xuehui Bi, Guanming Lu, Weilan Wang, Jingjie Yan, Zhengyan Zhang
Format: Article
Language:English
Published: IEEE 2018-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8492403/
id doaj-2cb992baf3464adca20c4dc6e4798e7f
record_format Article
spelling doaj-2cb992baf3464adca20c4dc6e4798e7f2021-03-29T21:21:19ZengIEEEIEEE Access2169-35362018-01-016617616177210.1109/ACCESS.2018.28761618492403Screen Window Propagating for Image InpaintingHuaming Liu0https://orcid.org/0000-0002-0268-7745Xuehui Bi1Guanming Lu2Weilan Wang3Jingjie Yan4Zhengyan Zhang5College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing, ChinaSchool of Computer and Information Engineering, Fuyang Normal University, Fuyang, ChinaCollege of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing, ChinaKey Laboratory of China’s Ethnic Languages and Information Technology, Ministry of Education, Northwest Minzu University, Lanzhou, ChinaCollege of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing, ChinaSchool of Electronics and Information, Jiangsu University of Science and Technology, Zhenjiang, ChinaImage repair often has errors in filling. An exemplar-based technique has the advantage of filling texture and structure simultaneously, but there exist some problems with this, such as not considering the overall situation of inpainting, the unreasonable calculation of priority, and random selection when there are multiple candidate patches. In view of these situations, this paper proposes a method of screen window propagating where the upper layer guides the lower layer inpainting from the top layer by means of multiple resolution decomposition. Screen window propagating aims to constrain the inpainting of the lower layer and maintain the overall profile. Improving the priority calculation using the upper repair result can lead to getting a better repair order. When there is more than one candidate patch, the structural similarity index measure (SSIM) is used to obtain the best candidate patch. We consider four cases of rotation and inversion when looking for the best exemplar. The experiments show that our method can obtain more satisfactory results than other methods based on subjective and objective indicators, such as peak signal-tonoise ratio (PSNR), SSIM, and feature similarity index measurement. Screen window propagating for image inpainting aims toward image restoration. Whole contours are preserved and the lower layer can utilize more upper layer information. Our method considers information from the whole and its parts.https://ieeexplore.ieee.org/document/8492403/Exemplar-based techniquepyramid decompositionguidance strategy of screen window propagatingexemplar matching
collection DOAJ
language English
format Article
sources DOAJ
author Huaming Liu
Xuehui Bi
Guanming Lu
Weilan Wang
Jingjie Yan
Zhengyan Zhang
spellingShingle Huaming Liu
Xuehui Bi
Guanming Lu
Weilan Wang
Jingjie Yan
Zhengyan Zhang
Screen Window Propagating for Image Inpainting
IEEE Access
Exemplar-based technique
pyramid decomposition
guidance strategy of screen window propagating
exemplar matching
author_facet Huaming Liu
Xuehui Bi
Guanming Lu
Weilan Wang
Jingjie Yan
Zhengyan Zhang
author_sort Huaming Liu
title Screen Window Propagating for Image Inpainting
title_short Screen Window Propagating for Image Inpainting
title_full Screen Window Propagating for Image Inpainting
title_fullStr Screen Window Propagating for Image Inpainting
title_full_unstemmed Screen Window Propagating for Image Inpainting
title_sort screen window propagating for image inpainting
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2018-01-01
description Image repair often has errors in filling. An exemplar-based technique has the advantage of filling texture and structure simultaneously, but there exist some problems with this, such as not considering the overall situation of inpainting, the unreasonable calculation of priority, and random selection when there are multiple candidate patches. In view of these situations, this paper proposes a method of screen window propagating where the upper layer guides the lower layer inpainting from the top layer by means of multiple resolution decomposition. Screen window propagating aims to constrain the inpainting of the lower layer and maintain the overall profile. Improving the priority calculation using the upper repair result can lead to getting a better repair order. When there is more than one candidate patch, the structural similarity index measure (SSIM) is used to obtain the best candidate patch. We consider four cases of rotation and inversion when looking for the best exemplar. The experiments show that our method can obtain more satisfactory results than other methods based on subjective and objective indicators, such as peak signal-tonoise ratio (PSNR), SSIM, and feature similarity index measurement. Screen window propagating for image inpainting aims toward image restoration. Whole contours are preserved and the lower layer can utilize more upper layer information. Our method considers information from the whole and its parts.
topic Exemplar-based technique
pyramid decomposition
guidance strategy of screen window propagating
exemplar matching
url https://ieeexplore.ieee.org/document/8492403/
work_keys_str_mv AT huamingliu screenwindowpropagatingforimageinpainting
AT xuehuibi screenwindowpropagatingforimageinpainting
AT guanminglu screenwindowpropagatingforimageinpainting
AT weilanwang screenwindowpropagatingforimageinpainting
AT jingjieyan screenwindowpropagatingforimageinpainting
AT zhengyanzhang screenwindowpropagatingforimageinpainting
_version_ 1724193074368741376