Multilevel minimization for deep residual networks

We present a new multilevel minimization framework for the training of deep residual networks (ResNets), which has the potential to significantly reduce training time and effort. Our framework is based on the dynamical system’s viewpoint, which formulates a ResNet as the discretization of an initial...

Full description

Bibliographic Details
Main Authors: Gaedke-Merzhäuser Lisa, Kopaničáková Alena, Krause Rolf
Format: Article
Language:English
Published: EDP Sciences 2021-08-01
Series:ESAIM: Proceedings and Surveys
Online Access:https://www.esaim-proc.org/articles/proc/pdf/2021/02/proc2107112.pdf