Video Content Highlights Extraction Based on Facial Expression of Viewers

• Main Authors: Yi-Yin Hsieh, 謝宜吟
• Other Authors: Damon Shing-Min Liu
• Format: Others
• Language: en_US
• Published: 2016
• Online Access: http://ndltd.ncl.edu.tw/handle/3q2n9f

碩士 === 國立中正大學 === 資訊工程研究所 === 104 === Video highlights are sequences of frames that impressed us most. We memorized the exciting, entertaining or interesting parts of video. For example, in football games, we consider the scene of a shot as a highlight. In previous works, most highlight frames in video were extracted using the content. However, the highlight extraction results did not completely match the emotion feedbacks of viewers due to the lack of consideration in the viewer reaction. In order to solve this problem, we present a highlight extraction system based on viewer’s affections. This work consists of several stages: video collecting, preprocessing, and highlight extraction. In our thesis, we focus on video highlight extraction. We calculate viewers’ expression intensity and normalize the distribution curve of their emotion feedbacks to extract video highlights. Our approach can couple with two modes. We can extract video highlights according to everybody’s preferences parts of videos in single viewer mode. We extended our method to multi viewer evaluation in order to decrease personal preferences toward different kinds of video.