Large Sample Mean-Field Stochastic Optimization
From MaRDI portal
Publication:5097396
Abstract: We study a class of sampled stochastic optimization problems, where the underlying state process has diffusive dynamics of the mean-field type. We establish the existence of optimal relaxed controls when the sample set has finite size. The core of our paper is to prove, via -convergence, that the minimizer of the finite sample relaxed problem converges to that of the limiting optimization problem. We connect the limit of the sampled objective functional to the unique solution, in the trajectory sense, of a nonlinear Fokker-Planck-Kolmogorov (FPK) equation in a random environment. We highlight the connection between the minimizers of our optimization problems and the optimal training weights of a deep residual neural network.
Recommendations
- Stochastic optimization for large-scale machine learning
- Variable-sample methods for stochastic optimization
- Stochastic semidefinite optimization using sampling methods
- Approximation, Randomization and Combinatorial Optimization. Algorithms and Techniques
- A stochastic quasi-Newton method for large-scale optimization
- Sampling-based approximation algorithms for multistage stochastic optimization
- scientific article; zbMATH DE number 1959636
- Adaptive sampling strategies for stochastic optimization
- Large deviations for the method of empirical means in stochastic optimization problems with continuous time observations
- Sample average approximation method for compound stochastic optimization problems
Cites work
- scientific article; zbMATH DE number 6378127 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- scientific article; zbMATH DE number 5681750 (Why is no real title available?)
- A general characterization of the mean field limit for stochastic differential games
- A mean field view of the landscape of two-layer neural networks
- A mean-field optimal control formulation of deep learning
- A proposal on machine learning via dynamical systems
- An introduction to -convergence
- Compact sets in the space \(L^ p(0,T;B)\)
- Compactification methods in the control of degenerate diffusions: existence of an optimal control
- Deep neural networks, generic universal interpolation, and controlled ODEs
- Infinite dimensional analysis. A hitchhiker's guide.
- Mean Field Analysis of Deep Neural Networks
- Mean field analysis of neural networks: a law of large numbers
- Mean field games via controlled martingale problems: existence of Markovian equilibria
- Mean field games with common noise
- Mean field limit for disordered diffusions with singular interactions
- Mean-field Markov decision processes with common noise and open-loop controls
- OPTIMAL CONTROL OF PROBABILITY DENSITY FUNCTIONS OF STOCHASTIC PROCESSES
- On the Existence of Optimal Controls
- On uniqueness of solutions to nonlinear Fokker-Planck-Kolmogorov equations
- Optimal Transport
- Optimal bilinear control of Gross-Pitaevskii equations
- Optimal bilinear control of nonlinear stochastic Schrödinger equations driven by linear multiplicative noise
- Probabilistic theory of mean field games with applications I. Mean field FBSDEs, control, and games
- Probabilistic theory of mean field games with applications II. Mean field games with common noise and master equations
- Stable architectures for deep neural networks
- Stochastic minimum principle for partially observed systems subject to continuous and jump diffusion processes and driven by relaxed controls
- The Relaxed Stochastic Maximum Principle in Singular Optimal Control of Diffusions
- Weak and strong error analysis for mean-field rank-based particle approximations of one-dimensional viscous scalar conservation laws
This page was built for publication: Large Sample Mean-Field Stochastic Optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5097396)
