| Summary: | 碩士 === 大同大學 === 媒體設計學系(所) === 106 === In recent years, augmented reality (AR) technology has rapidly developed and been applied to many different fields and daily life. Improvements in today equipment technology and accessibility to mobile devices has increased the public’s contact with AR. To give users a better experience during use, “interaction” has become the most important part of AR. One common way of achieving interaction with virtual objects is to use hand signals with 2D interface. Users can also interact with objects via mobile devices or voice operation. Gesture identification and operation has also been used in the last few years, but mostly in tandem with AR glasses. This method has not been applied to mobile devices and there is not yet a set of floating gesture operation that suitable for object interaction. This study applies gesture identification on mobile devices and interaction with virtual objects, as well as made breakthroughs in many developments and applications. We designed a set of gestures that is suitable for object interaction to improve the users’ intuitiveness and ease of use during use.
This study surveyed interactions related AR applications for mobile devices and virtual object interactions, as well as existing single-hand gesture matched to AR glasses. Four function commands commonly used for object interactions were selected and 12 function commands used for product interactions were listed. The objective is to understand operation methods used by subjects to interact with different products. The subjects were allowed to freely design gestures that correspond to the commands. Three operating methods commonly used for screen interfaces were selected and the mobile devices’ cameras were used to identify the gestures. The questionnaire result shows that when choosing between having button reminders on the screen interface and directly operating the object, the intuitive operating method the subjects preferred was to directly operate the object on the interface and use gesture.
The aforementioned result screened out two operating methods and 10 function commands as the main test items. The items were divided into A and B operating modes for the experiment and comparison. Questionnaire result shows that there is no difference between the intuitiveness and difficulty of these two operating methods. However, subjects perceived the hand gesture operation as more interesting and flexible. Gesture learning is also easier out of the two methods. Of the main function commands, most people preferred screen interface operation for select and move. For the rest of the commands, the subjects preferred using gesture operation to interact with the object. The more interaction feedback the object gave the more fun the floating hand gesture operation becomes. Gesture and AR interaction application with mobile devices in the future not only can make the interaction more intuitive, but can also improve the user experience.
|
|---|
