Memorability of image regions

While long term human visual memory can store a remarkable amount of visual information, it tends to degrade over time. Recent works have shown that image memorability is an intrinsic property of an image that can be reliably estimated using state-of-the-art image features and machine learning algor...

Full description

Bibliographic Details
Main Authors: Khosla, Aditya (Author), Xiao, Jianxiong (Author), Torralba, Antonio (Author), Oliva, Aude (Author)
Format: Article
Language:English
Published: 2020-04-30T20:24:24Z.
Subjects:
Online Access:Get fulltext
Description
Summary:While long term human visual memory can store a remarkable amount of visual information, it tends to degrade over time. Recent works have shown that image memorability is an intrinsic property of an image that can be reliably estimated using state-of-the-art image features and machine learning algorithms. However, the class of features and image information that is forgotten has not been explored yet. In this work, we propose a probabilistic framework that models how and which local regions from an image may be forgotten using a data-driven approach that combines local and global images features. The model automatically discovers memorability maps of individual images without any human annotation. We incorporate multiple image region attributes in our algorithm, leading to improved memorability prediction of images as compared to previous works. ©2012 Paper presented at the 26th Conference on Neural Information Processing Systems (NeurIPS 2012), Dec. 3-8, 2012, Lake Tahoe, Calif.
NSF (grant no. 1016862)
ONR MURI (grant no. N000141010933)
NSF Career Award (no. 0747120)