Design and Development of Hand-free and 3-D Pointing Gesture Recognition System

• Main Authors: Chih-han Ko, 柯志函
• Other Authors: Yung-Hui Lee
• Format: Others
• Language: zh-TW
• Published: 2009
• Online Access: http://ndltd.ncl.edu.tw/handle/92207115965771180412

碩士 === 國立臺灣科技大學 === 工業管理系 === 97 === Pointing gesture is a very intuitive human communication. Basically, the pointing orientation has a fully spatial compatibility, and the meaning of gesture is in the pointing trajectory. The objective of this study is to design and development a "free-hand, 3 dimensional, real time, pointing gesture recognition system” using 2 cameras. When pointing an object, the eye, the finger, and the object should be collinear. Base upon this principle, sub-system of 3-D camera calibration, hand/head area detection, and/head tracking were developed to continuously tracking the hand/head 3-D positions. The 3-D pointing positions were reconstructed in a large screen with a refresh speed of 20 Hz. It was then the velocity and the accelerations of the pointing trajectories were calculated. To verify the advantage of the system, we built a remote controlled music player with free-hand comments of play, pause, volume control, move to a previous, and move to the next control. Experiment result showed that the average time-spending for gesture command is less than 4 seconds, and the recognition rate of all comments is more than 90%.