An Augmented Reality-based System for Art-exhibition Guidance by Computer Vision Techniques Using Smart Glasses

• Main Authors: Lin, Yu-Hua, 林育樺
• Other Authors: Tsai, Wen-Hsiang
• Format: Others
• Language: en_US
• Published: 2016
• Online Access: http://ndltd.ncl.edu.tw/handle/01670963607930273882

碩士 === 國立交通大學 === 多媒體工程研究所 === 104 === When people visit a new indoor art exhibition, they usually need a guidance system to tell them how to arrive artworks desired to see. In this study, a real-time augmented reality (AR)-based guidance system built on a pair of smart-glasses for use in indoor art-exhibition spaces has been proposed. The system is based on computer vision and AR techniques to achieve automatic guidance functions. At first, the system is designed to be based on image matching for user localization in the exhibition space, and so an environment map, which includes a plan drawing of the exhibition space, a database of artwork images in the environment, and all artwork information, is established. The artwork images are taken according to a grid-like arrangement of space nodes with eight images taken around 360o at each node. All the learned data are saved into a database for use in the guidance phase. Next, a method for user localization is proposed for use by the system. Specifically, the server-side of the system receives the image taken by the client-side camera and matches the image against the image database using speeded up robust features (SURFs) extracted from the images. Then, the system derives the user’s orientation and position parameters according to the corresponding relationship between the image taken by the user and the matching result. Finally, the client-side receives the result of user localization from the sever-side for use in drawing an AR guidance arrow on the smart-glasses screen. To realize real-time guidance, methods for speeding up image transmission and processing are also proposed for uses both in the learning phase and in the guidance phase. Consequently, user localization can be updated, and the AR guidance arrow and the information of the artwork can be displayed on the screen of the smart-glasses, all in real-time. Finally, a method for path planning and AR-based guidance and is proposed. Based on the derived user’s position, the system plans a shortest path from the user’s location to a pre-selected destination artwork by use of the Dijkstra algorithm. Furthermore, the AR guidance arrow is rendered in a 3D fashion and augmented on the smart-glasses screen to guide the user where to go and which direction to turn to. When the user arrives at the desired artwork, the detailed information of the artwork is augmented on the screen for appreciation. Good experimental results are also presented, which show the feasibility of the proposed methods and the system for real-time art-exhibition guidance applications.