3D Image Composition using Kinect System

• Main Authors: Chen, Kuan-Yi, 陳冠諭
• Other Authors: Hang, Hsueh-Ming
• Format: Others
• Language: zh-TW
• Published: 2016
• Online Access: http://ndltd.ncl.edu.tw/handle/36236013864470282300

碩士 === 國立交通大學 === 電機學院電信學程 === 104 === Chroma keying (scene composition) is a popular technique in TV and movie production. Typically, it merges the foreground from one scene with the background from another scene. The foreground is often taken in a virtual studio whose floor, wall and ceiling are painted with a specific green color, so that the background can be easily replaced by another scene. Now, we like to do the same scene composition job on two arbitrary images. In this process, we need to extract objects from the foreground scene. Then, place the object (foreground) on the background scene. In this thesis, we use Microsoft Kinect 2 device to capture the foreground scene. The depth image produced by Kinect 2 facilitates the object extraction process. However, the captured depth map contains occlusion region and noises (missing depth pixels). We use an iterative median filter to remove the holes (missing pixels). In the foreground extraction, we adopt the popular Otsu’s method in the histogram domain. In addition, we adopt a “trimap” description of the object. A depth map is partitioned into 3 areas: background, foreground and unknown (between foreground and background). The unknown area is identified by the Sobel operator, which detects the object boundaries. We replace the background using the alpha channel technique. Because we derive a trimap for the foreground object, the “unknown” area on the final composition is the blended pixels of the foreground and background images. We found the visual results are more vivid and appearing.