scientific article; zbMATH DE number 7049759
From MaRDI portal
Publication:4633052
zbMath1484.62106arXiv1811.01558MaRDI QIDQ4633052
Cheng Tai, Qianxiao Li, E. Weinan
Publication date: 2 May 2019
Full work available at URL: https://arxiv.org/abs/1811.01558
Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.
stochastic differential equationsmomentumstochastic gradient algorithmsmodified equationsNesterov's accelerated gradient
Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Stochastic programming (90C15) Stochastic approximation (62L20)
Related Items (23)
Approximation to stochastic variance reduced gradient Langevin dynamics by stochastic delay differential equations ⋮ Analytic continuation of noisy data using Adams Bashforth residual neural network ⋮ A probability approximation framework: Markov process approach ⋮ Analysis of kinetic models for label switching and stochastic gradient descent ⋮ A Systematic Approach to Lyapunov Analyses of Continuous-Time Models in Convex Optimization ⋮ Unnamed Item ⋮ Improving the Convergence Rates for the Kinetic Fokker–Planck Equation by Optimal Control ⋮ Improving sampling accuracy of stochastic gradient MCMC methods via non-uniform subsampling of gradients ⋮ Convergence of gradient algorithms for nonconvex \(C^{1+ \alpha}\) cost functions ⋮ Subsampling in ensemble Kalman inversion ⋮ High‐dimensional limit theorems for SGD: Effective dynamics and critical scaling ⋮ GANs training: A game and stochastic control approach ⋮ Affine-invariant ensemble transform methods for logistic regression ⋮ A Continuous-Time Analysis of Distributed Stochastic Gradient ⋮ An efficient numerical algorithm for solving data driven feedback control problems ⋮ Analysis of stochastic gradient descent in continuous time ⋮ Optimal approximation rate of ReLU networks in terms of width and depth ⋮ On stochastic mirror descent with interacting particles: convergence properties and variance reduction ⋮ Neural ODEs as the deep limit of ResNets with constant weights ⋮ Approximating the magnetization in the Curie-Weiss model ⋮ Unnamed Item ⋮ Structure-preserving deep learning ⋮ Stochastic gradient descent and fast relaxation to thermodynamic equilibrium: A stochastic control approach
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- The Pricing of Options and Corporate Liabilities
- The modified equation approach to the stability and accuracy analysis of finite-difference methods
- Stochastic approximation methods for constrained and unconstrained systems
- Introductory lectures on convex optimization. A basic course.
- On the diffusion approximation of nonconvex stochastic gradient descent
- Semigroups of stochastic gradient descent and online principal component analysis: properties and diffusion approximations
- Heuristic stability theory for finite-difference equations
- A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
- An Invariant Measure Approach to the Convergence of Stochastic Approximations with State Dependent Noise
- Weak Approximation of Solutions of Systems of Stochastic Differential Equations
- Approximate Integration of Stochastic Differential Equations
- Rates of Convergence for Sequential Monte Carlo Optimization Methods
- A variational perspective on accelerated methods in optimization
- Stochastic modified equations for the asynchronous stochastic gradient descent
- The Stability Properties of a Coupled Pair of Non-Linear Partial Difference Equations
- Book Reviews
- Probability
- Accelerated proximal stochastic dual coordinate ascent for regularized loss minimization
- Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm
This page was built for publication:
