A Real-Time User Interest Meter Based on Human Cognitive Model and its Applications

• Main Authors: Chia-Han Chang, 張家翰
• Other Authors: 李明穗
• Format: Others
• Language: en_US
• Published: 2009
• Online Access: http://ndltd.ncl.edu.tw/handle/33611820606953482639

碩士 === 國立臺灣大學 === 資訊網路與多媒體研究所 === 97 === In users’ interaction process of the 3D Magic Crystal Ball, an interactive visual display system which allows users to see a 3D virtual artifact appearing inside a transparent glass ball and to manipulate it with bared hands, we find that there are many interesting reactions of users. We want to collect each user’s interesting reactions and combine them into personal memory. Therefore, we propose the Interest Meter, a system making computer understand user’s reactions, based on multimodal interfaces for measuring user’s interest in real time. The Interest Meter takes account of users’ spontaneous reactions when users interact with computers. In this work, we analyze the variations of user’s eye movement, blinking, head motion, and facial expression when the user interacts with computers. Furthermore, we propose the method of combining those signals into interest level and verify that it works in our experiment. There are two integrated application in our thesis. First, produces the personal memory of each user according to the user’s reactions to the Magic Crystal Ball. Second, edits the MV-style home video auto-matically by the user’s reactions during watching home videos. According to our experiments and applications, it shows that the Interest Meter can measure user’s interest and make a great improvement of the interac-tion.