A-gaze directed music composition system for text browsing

• Main Authors: Mei-Xing Chen, 陳美杏
• Other Authors: Chuan-Kai Yang
• Format: Others
• Language: zh-TW
• Published: 2011
• Online Access: http://ndltd.ncl.edu.tw/handle/9w9wb4

碩士 === 國立臺灣科技大學 === 資訊管理系 === 99 === Music can change our lives. Many media such as movies and advertising convey their ideas through the help of music. Instead of adopting the traditional schemes for matching images with music, we opt for a new paradigm by composing music that can fit the “mood” of the text that a user is reading, thus enhancing the reading efficiency, as well as offering drastically difference experience. By taking gazing direction into consideration, readers can read text as usual, while our system, based on a pre-built emotion and adverb word database, can generate music with particular attributes to align with the emotions presented in the text. Compared with the much expensive devices (up to a few hundred thousand dollars) involved in others’ research, such as an eye-tracker, our system rely only on a common web-cam, which may costs less than thousand. It is interesting to note that, the three core techniques developed in this work: eye-control-mouse, text emotion, and music emotion, can be very useful, for being used individually, in a combined fashion, or even in many different possible combinations. For example, eye-driven mouse, audio book, interactive billboards, etc. are some possible interesting directions which are worth of further research.