Efficiently testing local optimality and escaping saddles for RELu networks

© 7th International Conference on Learning Representations, ICLR 2019. All Rights Reserved. We provide a theoretical algorithm for checking local optimality and escaping saddles at nondifferentiable points of empirical risks of two-layer ReLU networks. Our algorithm receives any parameter value and...

Full description

Bibliographic Details
Main Authors: Jadbabaie, Ali (Author), Yun, Chulhee (Author), Sra, Suvrit (Author)
Format: Article
Language:English
Published: 2021-11-03T12:57:28Z.
Subjects:
Online Access:Get fulltext