| Summary: | 博士 === 國立臺灣大學 === 資訊工程學研究所 === 105 === Multi-view images give more useful informations than single image if we can find the correspondence between each view.
It''s means that we can use these additional informations to improve the computational photography applications.
This thesis presents three application on multi-view images.
The first application introduce a warping-based novel view synthesis framework for both binocular stereoscopic images and videos.
Large-size autostereoscopic displays require multiple views while most stereoscopic cameras and digital video recorder can only capture two.
Obtain accurate depth maps from two-view image or video is still difficult and time consuming, but popular novel view synthesis methods, such as depth image based rendering (DIBR), often heavily rely on it.
The proposed framework requires neither depth maps nor user intervention.
Dense and reliable features is extracted and find the correspondences of two-view.
Image warped basis on these correspondences to synthesize novel views while simultaneously maintaining stereoscopic properties ,preserving image structures and keeping temporal coherence on video.
Our method produces higher-quality multi-view images and video more efficiently without tedious parameter tuning.
This is useful to convert stereoscopic images and videos taken by binocular cameras into multi-view images and videos ready to be displayed on autostereoscopic displays.
3D printing has become an important and prevalent tool.
Image-based modeling is a popular way to acquire 3D models for further editing and printing.
However, exiting tools are often not robust enough for users to obtain the 3D models they want.
The constructed models are often incomplete, disjoint and noisy.
Here we proposed a shape from silhouette system to reconstruct 3D models more robustly.
In second part of this thesis introduce a robust automatic method for segmenting an object out of the background using a set of multi-view images.
The segmentation is performed by minimizing an energy function which incorporates color statistics, spatial coherency, appearance proximity, epipolar constraints and back projection consistency of 3D feature points.
It can be efficiently optimized using the min-cut algorithm.
With the segmentation, the visual hull method is applied to reconstruct the 3D model of the object.
However, the primary weakness of this approach is the inability to reproduce the concave region.
To fix this problem, we use the photo-consistency principle of multi-view introduced at the third part of this thesis.
Those voxel belong to the object surface will be found and give a refined result model with more details.
Experiments show that the proposed method can generate better models than some popular systems.
|
|---|
