Adaptive Sampling Strategies for Stochastic Optimization
From MaRDI portal
Publication:4562248
DOI10.1137/17M1154679zbMath1461.65131arXiv1710.11258MaRDI QIDQ4562248
Raghu Bollapragada, Nocedal, Jorge, Byrd, Richard H.
Publication date: 19 December 2018
Published in: SIAM Journal on Optimization (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1710.11258
Numerical mathematical programming methods (65K05) Large-scale problems in mathematical programming (90C06) Learning and adaptive systems in artificial intelligence (68T05) Stochastic programming (90C15) Methods of successive quadratic programming type (90C55)
Related Items
Ritz-like values in steplength selections for stochastic gradient methods, A Variable Sample-Size Stochastic Quasi-Newton Method for Smooth and Nonsmooth Stochastic Convex Optimization, Parameter calibration in wake effect simulation model with stochastic gradient descent and stratified sampling, Subsampled nonmonotone spectral gradient methods, An adaptive stochastic sequential quadratic programming with differentiable exact augmented Lagrangians, A stochastic gradient method for a class of nonlinear PDE-constrained optimal control problems under uncertainty, Inequality constrained stochastic nonlinear optimization via active-set sequential quadratic programming, A trust region method for noisy unconstrained optimization, An adaptive sampling augmented Lagrangian method for stochastic optimization with deterministic constraints, Statistically equivalent surrogate material models: impact of random imperfections on the elasto-plastic response, Risk-averse design of tall buildings for uncertain wind conditions, Gradient-based optimisation of the conditional-value-at-risk using the multi-level Monte Carlo method, An overview of stochastic quasi-Newton methods for large-scale machine learning, Globally Convergent Multilevel Training of Deep Residual Networks, Adaptive sampling stochastic multigradient algorithm for stochastic multiobjective optimization, A limited-memory BFGS-based differential evolution algorithm for optimal control of nonlinear systems with mixed control variables and probability constraints, A line search based proximal stochastic gradient algorithm with dynamical variance reduction, Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization, A single timescale stochastic quasi-Newton method for stochastic optimization, Discriminative Bayesian filtering lends momentum to the stochastic Newton method for minimizing log-convex functions, Randomized Approach to Nonlinear Inversion Combining Random and Optimized Simultaneous Sources and Detectors, Online surrogate multiobjective optimization algorithm for contaminated groundwater remediation designs, Resolving learning rates adaptively by locating stochastic non-negative associated gradient projection points using line searches, A Stochastic Line Search Method with Expected Complexity Analysis, A robust multi-batch L-BFGS method for machine learning, Adaptive Sequential Sample Average Approximation for Solving Two-Stage Stochastic Linear Programs
Uses Software
Cites Work
- Unnamed Item
- Unnamed Item
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- Minimizing finite sums with the stochastic average gradient
- Sample size selection in optimization methods for machine learning
- Exploration-exploitation tradeoff using variance estimates in multi-armed bandits
- Introductory lectures on convex optimization. A basic course.
- Global convergence rate analysis of unconstrained optimization methods based on probabilistic models
- Optimal Budget Allocation for Sample Average Approximation
- Hybrid Deterministic-Stochastic Methods for Data Fitting
- Variable-sample methods for stochastic optimization
- On Sampling Rates in Simulation-Based Recursions
- Optimization Methods for Large-Scale Machine Learning
- On the Global Convergence of Trust Region Algorithms Using Inexact Gradient Information
- Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming
