Integration Methods and Accelerated Optimization Algorithms
From MaRDI portal
Publication:6283485
arXiv1702.06751MaRDI QIDQ6283485FDOQ6283485
Authors: Damien Scieur, Vincent Roulet, Francis Bach, Alexandre d'Aspremont 
Publication date: 22 February 2017
Abstract: We show that accelerated optimization methods can be seen as particular instances of multi-step integration schemes from numerical analysis, applied to the gradient flow equation. In comparison with recent advances in this vein, the differential equation considered here is the basic gradient flow and we show that multi-step schemes allow integration of this differential equation using larger step sizes, thus intuitively explaining acceleration results.
This page was built for publication: Integration Methods and Accelerated Optimization Algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6283485)
