Colorization in Gabor space and realistic surface rendering on GPUs.

Based on the construction of Gabor feature space, which is important in applying pixel similarity computations, we formalize the space using rotation-invariant Gabor filter banks and apply optimizations in texture feature space. In image colorizations, the pixels that have similar Gabor features app...

Full description

Bibliographic Details
Other Authors: Sheng, Bin
Format: Others
Language:English
Chinese
Published: 2011
Subjects:
Online Access:http://library.cuhk.edu.hk/record=b6075109
http://repository.lib.cuhk.edu.hk/en/item/cuhk-344742
id ndltd-cuhk.edu.hk-oai-cuhk-dr-cuhk_344742
record_format oai_dc
collection NDLTD
language English
Chinese
format Others
sources NDLTD
topic Color
Gabor transforms
Graphics processing units
Image processing--Digital techniques
Rendering (Computer graphics)
spellingShingle Color
Gabor transforms
Graphics processing units
Image processing--Digital techniques
Rendering (Computer graphics)
Colorization in Gabor space and realistic surface rendering on GPUs.
description Based on the construction of Gabor feature space, which is important in applying pixel similarity computations, we formalize the space using rotation-invariant Gabor filter banks and apply optimizations in texture feature space. In image colorizations, the pixels that have similar Gabor features appear similar colors, our approach can colorize natural images globally, without the restriction of the disjoint regions with similar texture-like appearances. Our approach supports the two-pass colorization processes: coloring optimization in Gabor space and color detailing for progressive effects. We further work on the video colorization using the optimized Gabor flow computing, including coloring keyframes, color propagation by Gabor filtering, and optimized parallel computing over the video. Our video colorization is designed in a spatiotemporal manner to keep temporal coherence, and provides simple closed-form solutions in energy optimization that yield fast colonizations. Moreover, we develop parallel surface texturing of geometric models on GPU, generating spatially-varying visual appearances. We incorporate the Gabor feature space for the searching of 2D exemplars, to determine the k-coherence candidate pixels. The multi-pass correction in synthesis is applied to the local neighborhood for parallel processes. The iso/aniso-scale texture synthesis leverages the strengths of GPU computing, so to synthesize the iso/aniso-scale texturing appearance in parallel over arbitrary surfaces. Our experimental results showed that our approach produces simply controllable texturing effects of surface synthesis, generating texture-similar and spatially-varying visual appearances with GPU accelerated performance. === Texture feature similarity has long been crucial and important topic in VR/graphics applications, such as image and video colorizations, surface texture synthesis and geometry image applications. Generally, the image feature is highly subjective, depending on not only the image pixels but also interactive users. Existing colorization and surface texture synthesis pay little attention to the generation of conforming color/textures that accurately reflect exemplar structures or user's intension. Realistic surface synthesis remains a challenging task in VR/graphics researches. In this dissertation, we focus on the encoding of the Gabor filter banks into texture feature similarity computations and GPU-parallel surface rendering faithfully, including image/vodeo colorizations, parallel texturing of geometric surfaces, and multiresolution rendering on sole-cube maps (SCMs). === We further explore the GPU-based multiresolution rendering on solecube maps (SCMs). Our SCMs on GPU generate adaptive mesh surfaces dynamically, and are fully developed in parallelization for large-scale and complex VR environments. We also encapsulate the differential coordinates in SCMs, reflecting the local geometric characteristics for geometric modeling and interactive animation applications. For the future work, we will work on improving the image/ video feature analysis framework in VR/graphics applications. The further work lying in the surface texture synthesis includes the interactive control of texture orientations by surface vector fields using sketch editing, so to widen the gamut of interactive tools available for texturing artists and end users. === Sheng, Bin. === Adviser: Hanqin Sun. === Source: Dissertation Abstracts International, Volume: 73-04, Section: B, page: . === Thesis (Ph.D.)--Chinese University of Hong Kong, 2011. === Includes bibliographical references (leaves 128-142). === Electronic reproduction. Hong Kong : Chinese University of Hong Kong, [2012] System requirements: Adobe Acrobat Reader. Available via World Wide Web. === Electronic reproduction. [Ann Arbor, MI] : ProQuest Information and Learning, [201-] System requirements: Adobe Acrobat Reader. Available via World Wide Web. === Abstract also in Chinese.
author2 Sheng, Bin
author_facet Sheng, Bin
title Colorization in Gabor space and realistic surface rendering on GPUs.
title_short Colorization in Gabor space and realistic surface rendering on GPUs.
title_full Colorization in Gabor space and realistic surface rendering on GPUs.
title_fullStr Colorization in Gabor space and realistic surface rendering on GPUs.
title_full_unstemmed Colorization in Gabor space and realistic surface rendering on GPUs.
title_sort colorization in gabor space and realistic surface rendering on gpus.
publishDate 2011
url http://library.cuhk.edu.hk/record=b6075109
http://repository.lib.cuhk.edu.hk/en/item/cuhk-344742
_version_ 1718977979793539072
spelling ndltd-cuhk.edu.hk-oai-cuhk-dr-cuhk_3447422019-02-19T03:42:35Z Colorization in Gabor space and realistic surface rendering on GPUs. 基於Gabor特徵空間的染色技術與真實感表面GPU繪製 CUHK electronic theses & dissertations collection Ji yu Gabor te zheng kong jian de ran se ji shu yu zhen shi gan biao mian GPU hui zhi Color Gabor transforms Graphics processing units Image processing--Digital techniques Rendering (Computer graphics) Based on the construction of Gabor feature space, which is important in applying pixel similarity computations, we formalize the space using rotation-invariant Gabor filter banks and apply optimizations in texture feature space. In image colorizations, the pixels that have similar Gabor features appear similar colors, our approach can colorize natural images globally, without the restriction of the disjoint regions with similar texture-like appearances. Our approach supports the two-pass colorization processes: coloring optimization in Gabor space and color detailing for progressive effects. We further work on the video colorization using the optimized Gabor flow computing, including coloring keyframes, color propagation by Gabor filtering, and optimized parallel computing over the video. Our video colorization is designed in a spatiotemporal manner to keep temporal coherence, and provides simple closed-form solutions in energy optimization that yield fast colonizations. Moreover, we develop parallel surface texturing of geometric models on GPU, generating spatially-varying visual appearances. We incorporate the Gabor feature space for the searching of 2D exemplars, to determine the k-coherence candidate pixels. The multi-pass correction in synthesis is applied to the local neighborhood for parallel processes. The iso/aniso-scale texture synthesis leverages the strengths of GPU computing, so to synthesize the iso/aniso-scale texturing appearance in parallel over arbitrary surfaces. Our experimental results showed that our approach produces simply controllable texturing effects of surface synthesis, generating texture-similar and spatially-varying visual appearances with GPU accelerated performance. Texture feature similarity has long been crucial and important topic in VR/graphics applications, such as image and video colorizations, surface texture synthesis and geometry image applications. Generally, the image feature is highly subjective, depending on not only the image pixels but also interactive users. Existing colorization and surface texture synthesis pay little attention to the generation of conforming color/textures that accurately reflect exemplar structures or user's intension. Realistic surface synthesis remains a challenging task in VR/graphics researches. In this dissertation, we focus on the encoding of the Gabor filter banks into texture feature similarity computations and GPU-parallel surface rendering faithfully, including image/vodeo colorizations, parallel texturing of geometric surfaces, and multiresolution rendering on sole-cube maps (SCMs). We further explore the GPU-based multiresolution rendering on solecube maps (SCMs). Our SCMs on GPU generate adaptive mesh surfaces dynamically, and are fully developed in parallelization for large-scale and complex VR environments. We also encapsulate the differential coordinates in SCMs, reflecting the local geometric characteristics for geometric modeling and interactive animation applications. For the future work, we will work on improving the image/ video feature analysis framework in VR/graphics applications. The further work lying in the surface texture synthesis includes the interactive control of texture orientations by surface vector fields using sketch editing, so to widen the gamut of interactive tools available for texturing artists and end users. Sheng, Bin. Adviser: Hanqin Sun. Source: Dissertation Abstracts International, Volume: 73-04, Section: B, page: . Thesis (Ph.D.)--Chinese University of Hong Kong, 2011. Includes bibliographical references (leaves 128-142). Electronic reproduction. Hong Kong : Chinese University of Hong Kong, [2012] System requirements: Adobe Acrobat Reader. Available via World Wide Web. Electronic reproduction. [Ann Arbor, MI] : ProQuest Information and Learning, [201-] System requirements: Adobe Acrobat Reader. Available via World Wide Web. Abstract also in Chinese. Sheng, Bin Chinese University of Hong Kong Graduate School. Division of Computer Science and Engineering. 2011 Text theses electronic resource microform microfiche 1 online resource (xii, 142 leaves : ill.) cuhk:344742 isbn: 9781267099402 http://library.cuhk.edu.hk/record=b6075109 eng chi Use of this resource is governed by the terms and conditions of the Creative Commons “Attribution-NonCommercial-NoDerivatives 4.0 International” License (http://creativecommons.org/licenses/by-nc-nd/4.0/) http://repository.lib.cuhk.edu.hk/en/islandora/object/cuhk%3A344742/datastream/TN/view/Colorization%20in%20Gabor%20space%20and%20realistic%20surface%20rendering%20on%20GPUs.jpghttp://repository.lib.cuhk.edu.hk/en/item/cuhk-344742