Computational Model for Human 3D Shape Perception From a Single Specular Image

• Main Authors: Takeaki Shimokawa, Akiko Nishio, Masa-aki Sato, Mitsuo Kawato, Hidehiko Komatsu
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2019-03-01
• Series: Frontiers in Computational Neuroscience
• Subjects: 3D shape perception; specularity; gloss; orientation field; illumination prior
• Online Access: https://www.frontiersin.org/article/10.3389/fncom.2019.00010/full

In natural conditions the human visual system can estimate the 3D shape of specular objects even from a single image. Although previous studies suggested that the orientation field plays a key role for 3D shape perception from specular reflections, its computational plausibility, and possible mechanisms have not been investigated. In this study, to complement the orientation field information, we first add prior knowledge that objects are illuminated from above and utilize the vertical polarity of the intensity gradient. Then we construct an algorithm that incorporates these two image cues to estimate 3D shapes from a single specular image. We evaluated the algorithm with glossy and mirrored surfaces and found that 3D shapes can be recovered with a high correlation coefficient of around 0.8 with true surface shapes. Moreover, under a specific condition, the algorithm's errors resembled those made by human observers. These findings show that the combination of the orientation field and the vertical polarity of the intensity gradient is computationally sufficient and probably reproduces essential representations used in human shape perception from specular reflections.