Novel View Synthesis from Multiple Cameras by Using Dense Correspondence Technique

• Main Authors: Yi-Huan Liu, 劉宜桓
• Other Authors: Cheng-Yuan Tang
• Format: Others
• Language: zh-TW
• Published: 2008
• Online Access: http://ndltd.ncl.edu.tw/handle/37133211767382101518

碩士 === 華梵大學 === 資訊管理學系碩士班 === 96 === The purpose of the thesis is to synthesize a novel view based on multiple images with different view angles. There are two main steps to accomplish the purpose: several images are used for finding dense stereo correspondences, and then the novel views are synthesized using these correspondences. Refer to stereo correspondences. In our experimental setup, eight cameras which have been well calibrated are used. In the beginning, SIFT (Scale Invariant Feature Transform) is used to obtain good stereo corresponding point pairs which are regarded as seeds. ZNCC (Zero-mean Normalized Cross Correlation) is to filter the bad seeds obtained from using SIFT. The 3D coordinates are then computed using these filtered stereo correspondences in different combinations. In order to improve the correctness of depths generated from stereo correspondences, the 3D points transformed from the world coordinate system into the corresponding camera coordinate systems are projected into other images. Two measurements, such as ZNCC and color histogram, are used to verify the correctness of the corresponding point pairs. Once some sparse 3D points obtained from some corresponding point pairs have been verified, these sparse 3D points are then projected into several images for further processing: a region in an image pair for generating denser stereo correspondences will be selected by using ZNCC. Refer to novel view synthesis. For synthesizing an image from a novel view, the CCV(Color Consistence Verification) will be used to determine the best color value from multiple images. And then, the triangular meshes are generated using Delaunay Triangulation. The interpolation methods are used to synthesize image regions for the regions having no stereo correspondences.