Fisher-rao metric, geometry, and complexity of neural networks

© 2019 by the author(s). We study the relationship between geometry and capacity measures for deep neural networks from an invariance viewpoint. We introduce a new notion of capacity - the Fisher-Rao norm - that possesses desirable invariance properties and is motivated by Information Geometry. We d...

Full description

Bibliographic Details
Main Authors: Liang, T (Author), Poggio, T (Author), Rakhlin, A (Author), Stokes, J (Author)
Format: Article
Language:English
Published: 2021-12-02T20:14:53Z.
Subjects:
Online Access:Get fulltext