Statistical Skimming of Feature Films
We present a statistical framework based on Hidden Markov Models (HMMs) for skimming feature films. A chain of HMMs is used to model subsequent story units: HMM states represent different visual-concepts, transitions model the temporal dependencies in each story unit, and stochastic observations are...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Hindawi Limited
2010-01-01
|
| Series: | International Journal of Digital Multimedia Broadcasting |
| Online Access: | http://dx.doi.org/10.1155/2010/709161 |
| Summary: | We present a statistical framework based on Hidden Markov Models (HMMs)
for skimming feature films. A chain of HMMs is used to model subsequent story units: HMM states represent different visual-concepts, transitions model the temporal dependencies in each story unit, and stochastic observations are given by single shots. The skim is generated as an observation sequence, where, in order to privilege more informative segments for entering the skim, shots are assigned higher probability of observation if endowed with salient features related to specific film genres. The effectiveness of the method is demonstrated by skimming the first thirty minutes of a wide set of action and dramatic movies, in order to create previews for users useful for assessing whether they would like to see that movie or not, but without revealing the
movie central part and plot details. Results are evaluated and compared through extensive user
tests in terms of metrics that estimate the content representational value of the obtained video
skims and their utility for assessing the user's interest in the observed movie. |
|---|---|
| ISSN: | 1687-7578 1687-7586 |