| Summary: | 碩士 === 國立交通大學 === 多媒體工程研究所 === 100 === In this study, an augmented-reality based tour guidance system for use in park areas using a video surveillance vehicle and computer vision techniques has been proposed. When a user drives the vehicle in a park, he/she can get from the system tour guidance information about the names of the nearby buildings appearing along the way on the two roadsides. The building names are displayed on the iPad, which then are projected onto the windshield for the user to observe on the driver’s seat, in a sense of augmenting the scene seen through the car windshield by the projected building names.
To implement a system of this augmented reality function, at first, a PTZ camera and a two-camera omni-imaging device equipped on the vehicle roof are used for acquiring PTZ-images and omni-images, respectively, for the purposes of guidance map construction and vehicle localization. Guidance map construction is carried out by use of the PTZ camera to measure feature points on nearby buildings. Vehicle localization during vehicle driving is accomplished through 3D image analysis using omni-images acquired of a series of red circular-shaped landmarks attached beforehand on along-way flat roadside objects (sidewalks, pedestrian chairs, etc.).
To detect red circular-shaped landmarks around the video surveillance vehicle during park navigation, image analysis techniques, including YCbCr color modeling, region growing, approximation of a circle in an omni-image by an ellipse, elliptical shape fitting, etc., are applied to segment out the corresponding elliptical-shaped landmark in the omni-image. Also proposed is a method for obtaining the center point of the ellipse in the omni-image to compute the 3D data of the detected landmark for vehicle localization.
Furthermore, methods for calculating the accurate position of the iPad image projected on the windshield, computing the accurate position of the vehicle in the guidance map, and showing the names of the nearby buildings are proposed. Finally, also proposed are methods for analyzing the vehicle turning direction by motion vectors produced by optical flow analysis, and for generating a guidance map graph for use in path planning for each tour in the park.
Good experimental results are also shown, which prove the feasibility of the proposed methods for augmented reality based tour guidance in park areas.
|
|---|
