A Virtual View Synthesis Algorithm and Hardware Implementation for Multi-view Source Input

碩士 === 國立清華大學 === 電機工程學系 === 100 === Along with the development of 3D rendering technology, the view number of multi-view autostereoscopic TV has become much more than before. This means that the requirement of video compression is more serious than ever, and at the same time, the storage and re...

Full description

Bibliographic Details
Main Authors: Zhang, Zhi-Wei, 張智維
Other Authors: Chen, Yung-Chang
Format: Others
Language:en_US
Published: 2012
Online Access:http://ndltd.ncl.edu.tw/handle/14678037429239626898
Description
Summary:碩士 === 國立清華大學 === 電機工程學系 === 100 === Along with the development of 3D rendering technology, the view number of multi-view autostereoscopic TV has become much more than before. This means that the requirement of video compression is more serious than ever, and at the same time, the storage and rendering problems of multi-views are also getting harder. In traditional DIBR (Depth Image Based Rendering), multi-view TV can use a source that contains one image and one depth map to synthesize the other virtual views, so that the source need not store all views. However, it causes holes or depth distortion in virtual views, the former of which makes strange area on rendered image and the latter makes the depth perceived distorted. As the newest video coding standard is to be established, multi-view video and its corresponding depth maps source becomes possibly available, thus benefits the utility of multi-view TV. But in reality, the multi-view source may not involve all views for multi-view TV. Because the number of views for multi-view TV is still increasing, and the complexity of creating a multi-view source for content producer is proportional to the view number. That means how to create the virtual views not contained in the original source will become a new problem. This thesis creates a model to depict the relationships between multi-view TV, camera, and virtual views, and illustrates how to use the model to synthesize virtual views. The virtual view synthesis algorithm here by using multi images and depth maps as inputs, which are different from traditional DIBR. In this way, problems of traditional DIBR can be circumvented. In the meantime, our algorithm also proposes a stereo matching technique in low complexity which can be used when the multi-view source does not contain its own depth maps.