Super-Identity Convolutional Neural Network for Face Hallucination

• Main Authors: Kaipeng Zhang, 張凱鵬
• Other Authors: 徐宏民
• Format: Others
• Language: zh-TW
• Published: 2018
• Online Access: http://ndltd.ncl.edu.tw/handle/65mcyg

碩士 === 國立臺灣大學 === 資訊網路與多媒體研究所 === 106 === Face hallucination is a generative task to super-resolve the facial image with low resolution while human perception of face heavily relies on identity information. However, previous face hallucination approaches largely ignore facial identity recovery. This paper proposes Super-Identity Convolutional Neural Network (SICNN) to recover identity information for generating faces closed to the real identity. Specifically, we define a super-identity loss to measure the identity difference between a hallucinated face and its corresponding high-resolution face within the hypersphere identity metric space. However, directly using this loss will lead to a Dynamic Domain Divergence problem, which is caused by the large margin between the high-resolution domain and the hallucination domain. To overcome this challenge, we present a domain-integrated training approach by constructing a robust identity metric for faces from these two domains. Extensive experimental evaluations demonstrate that the proposed SICNN achieves superior hallucination visual quality over the state-of-the-art methods on a challenging task to super-resolve 12x14 faces with an 8x upscaling factor. In addition, SICNN significantly improves the recognizability of ultra-low-resolution faces.