Generalized gradients in dynamic optimization, optimal control, and machine learning problems

DOI10.1007/s10559-020-00240-xzbMath1464.49016OpenAlexW3014423178MaRDI QIDQ2215292

Vladimir I. Norkin

Publication date: 11 December 2020

Published in: Cybernetics and Systems Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10559-020-00240-x

zbMATH Keywords

optimal controlstochastic optimizationdynamic optimizationmachine learningdeep learningmultilayer neural networksstochastic generalized gradientnonsmooth noncovex optimizationstochastic smoothing

Mathematics Subject Classification ID

Nonconvex programming, global optimization (90C26) Learning and adaptive systems in artificial intelligence (68T05) Nonsmooth analysis (49J52) Discrete-time control/observation systems (93C55) Optimality conditions for problems involving relations other than differential equations (49K21)

Related Items (1)

Stochastic generalized gradient methods for training nonconvex nonsmooth neural networks

Uses Software

• GradSamp

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Solution of nonconvex nonsmooth stochastic optimization problems
• Theory and software implementations of Shor's \(r\)-algorithms
• Tame functions are semismooth
• Stochastic generalized gradient method for nonconvex nonsmooth stochastic optimization
• Optimal strategies for an inventory system with cost functions of general form
• Stochastic subgradient method converges on tame functions
• A nonsmooth version of Newton's method
• Iterative learning control. Robustness and monotonic convergence for interval systems.
• Stochastic generalized-differentiable functions in the problem of nonconvex nonsmooth stochastic optimization
• Evaluating Derivatives
• Lectures on Stochastic Programming
• Robust Stochastic Approximation Approach to Stochastic Programming
• Optimization and nonsmooth analysis
• A note on the generalized differentiability of mappings
• A modification and an extension of Lemarechal’s algorithm for nonsmooth minimization
• Semismooth and Semiconvex Functions in Constrained Optimization
• An Algorithm for Constrained Optimization with Semismooth Functions
• Neural Networks and Qualitative Physics
• Variational Analysis
• Optimization Methods for Large-Scale Machine Learning
• Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations
• A Robust Gradient Sampling Algorithm for Nonsmooth, Nonconvex Optimization
• Learning representations by back-propagating errors
• A Stochastic Approximation Method

This page was built for publication: Generalized gradients in dynamic optimization, optimal control, and machine learning problems