An Information Theoretic Interpretation to Deep Neural Networks

With the unprecedented performance achieved by deep learning, it is commonly believed that deep neural networks (DNNs) attempt to extract informative features for learning tasks. To formalize this intuition, we apply the local information geometric analysis and establish an information-theoretic fra...

Full description

Bibliographic Details
Main Authors: Xu, Xiangxiang (Author), Huang, Shao-Lun (Author), Zheng, Lizhong (Author), Wornell, Gregory W. (Author)
Format: Article
Language:English
Published: Multidisciplinary Digital Publishing Institute, 2022-01-20T19:32:08Z.
Subjects:
Online Access:Get fulltext