Active Object Movie using Temporal Consistency and Occlusion Recovery

• Main Authors: Shih-Yu Huang, 黃士育
• Other Authors: Mau-Tsuen Yang
• Format: Others
• Language: zh-TW
• Published: 2004
• Online Access: http://ndltd.ncl.edu.tw/handle/52672842765499166169

碩士 === 國立東華大學 === 資訊工程學系 === 92 === Active object movie is an object movie with movable objects. The technique of active object movie allows users to change their view-point freely when they are watching a object video sequence. The feasibility of an active object movie is measured by the throughput of virtual view-point image synthesizing and the quality of the synthesized image. In video sequences with real-time frame rate, the visual contents are usually similar between consecutive frames. This kind of correlation is referred as temporal consistency. By analyzing the difference between consecutive frames, we can segment the image into four regions : moving, uncorresponding, invalidated ,and heritable. Exploiting temporal consistency between consecutive frames can reduce matching costs, and then virtual view-point images can be synthesized more efficiently. The quality of the synthesize image is depending on the accuracy of the disparity estimation. We estimate dense disparity by stereo matching. Due to occlusion, those pixels that cannot find corresponding points are referred as holes in the disparity map. We analyze the disparity distributions nearby every holds and categorize then into three cases. We propose interpolation strategies for each case to recover the holes in the disparity map. The experiment shows that stereo matching using temporal consistency is twice faster than traditional methods, and occlusion recovery can decrease the SSD error in the virtual view-point image.