Stochastic Estimation of the Maximum of a Regression Function

From MaRDI portal
Publication:5816980

DOI10.1214/aoms/1177729392zbMath0049.36601OpenAlexW2009797711WikidataQ30051328 ScholiaQ30051328MaRDI QIDQ5816980

J. Kiefer, Jacob Wolfowitz

Publication date: 1952

Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aoms/1177729392



Related Items

Full-low evaluation methods for derivative-free optimization, Actor-Critic–Like Stochastic Adaptive Search for Continuous Simulation Optimization, Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling, Convergence of a Distributed Kiefer-Wolfowitz Algorithm, A stochastic variable metric algorithm for system modelling and identification, Dynamic Inventory Control with Fixed Setup Costs and Unknown Discrete Demand Distribution, Adaptive Finite-Difference Interval Estimation for Noisy Derivative-Free Optimization, Estimation of the parameters of sampled-data systems by means of stochastic approximation†, The Stochastic Auxiliary Problem Principle in Banach Spaces: Measurability and Convergence, Zeroth-order optimization with orthogonal random directions, Risk-Sensitive Reinforcement Learning via Policy Gradient Search, Technical note: <scp>Finite‐time</scp> regret analysis of <scp>Kiefer‐Wolfowitz</scp> stochastic approximation algorithm and nonparametric <scp>multi‐product</scp> dynamic pricing with unknown demand, Simultaneous perturbation stochastic approximation: towards one-measurement per iteration, Rotorcraft low-noise trajectories design: black-box optimization using surrogates, Encounters with Martingales in Statistics and Stochastic Optimization, Online Covariance Matrix Estimation in Stochastic Gradient Descent, A sampling criterion for constrained Bayesian optimization with uncertainties, Convergence of the Kiefer–Wolfowitz algorithm in the presence of discontinuities, Convergence of gradient algorithms for nonconvex \(C^{1+ \alpha}\) cost functions, Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization, Stochastic Fixed-Point Iterations for Nonexpansive Maps: Convergence and Error Bounds, Estimation and inference for minimizer and minimum of convex functions: optimality, adaptivity and uncertainty principles, Estimation and inference by stochastic optimization, Uncertainty Quantification for Stochastic Approximation Limits Using Chaos Expansion, Unnamed Item, Process noise covariance estimation via stochastic approximation, Coordinating Pricing and Inventory Replenishment with Nonparametric Demand Learning, Unnamed Item, Gradient-Based Adaptive Stochastic Search for Simulation Optimization Over Continuous Space, A Stochastic Gradient Method With Mesh Refinement for PDE-Constrained Optimization Under Uncertainty, Surrogate-Based Promising Area Search for Lipschitz Continuous Simulation Optimization, Maximum Likelihood Estimation of Regularization Parameters in High-Dimensional Inverse Problems: An Empirical Bayesian Approach. Part II: Theoretical Analysis, Dynamic Inventory and Price Controls Involving Unknown Demand on Discrete Nonperishable Items, Unnamed Item, Online surrogate problem methodology for stochastic discrete resource allocation problem., Estimation problems associated with stochastic modeling of proliferation and differentiation of O-2A progenitor cells in vitro, Stochastic approximation, Simulation-based parameter estimation for complex models: a breast cancer natural history modelling illustration, Multidimensional stochastic approximation, Unnamed Item, Unnamed Item, Some ideas to minimize an empirically given fuzzy function, Learning automata algorithms for pattern classification., Stochastic approximation algorithms: overview and recent trends., Minimization algorithms based on supervisor and searcher cooperation, Ensemble Kalman inversion: a derivative-free technique for machine learning tasks, Simulation optimization: a review of algorithms and applications, Parallel Simultaneous Perturbation Optimization, Derivative-free optimization methods, Projected Stochastic Gradients for Convex Constrained Problems in Hilbert Spaces, Distributed Subgradient-Free Stochastic Optimization Algorithm for Nonsmooth Convex Functions over Time-Varying Networks, An Optimizing Up-and-Down Design, Importance Sampling of Test Cases in Markovian Software Usage Models, Optimal adaptive sampling for a symmetric two-state continuous time Markov chain, Efficient Bayesian Experimentation Using an Expected Information Gain Lower Bound, Smoothed Functional Algorithms for Stochastic Optimization Using q -Gaussian Distributions, Proximal Gradient Methods for Machine Learning and Imaging, Approximating quasi-stationary distributions with interacting reinforced random walks, Workshop on statistical approaches for the evaluation of complex computer models, Solving deterministic problems via stochastic approximation. - A simple yet powerful numerical method, Inventory models under uncertainty: An adaptive approach, Applicable stochastic control: From theory to practice, Stochastic approximation revisited, Stopping rules for optimization algorithms based on stochastic approximation, On stochastic extremum seeking via adaptive perturbation-demodulation loop, Stochastic approximation of global minimum points, Computational aspects in applied stochastic control, A stochastic successive minimization method for nonsmooth nonconvex optimization with applications to transceiver design in wireless communication networks, Stochastic derivative-free optimization using a trust region framework, Interval estimation of the critical value in a general linear model, A stochastic steepest-descent algorithm, A combined direction stochastic approximation algorithm, A stochastic optimization approach for robot scheduling, A direct search method for unconstrained quantile-based simulation optimization, Online estimation of hazard rate under random censoring, Continuous action set learning automata for stochastic optimization, Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming, Stochastic optimization using a trust-region method and random models, A stochastic algorithm using one sample point per iteration and diminishing step-sizes, Minimizing noisy functionals in Hilbert space: An extension of the Kiefer-Wolfowitz procedure, A two-step gradient estimation approach for setting supply chain operating parameters, Scheduling policies using marked/phantom slot algorithms, Stochastic optimization algorithms of a Bayesian design criterion for Bayesian parameter estimation of nonlinear regression models: Application in pharmacokinetics, Stochastic approximation - A powerful method for solving deterministic numerical problems, Pseudo-likelihood estimation for discretely observed multitype Bellman--Harris branching proc\-esses, Continuum modeling and control of large nonuniform wireless networks via nonlinear partial differential equations, Approximate maximum likelihood estimation for population genetic inference, Solving deterministic problems by stochastic approximation, Simultaneous perturbation stochastic approximation of nonsmooth functions, Exploring or reducing noise? A global optimization algorithm in the presence of noise, Stochastic Nelder-Mead simplex method -- a new globally convergent direct search method for simulation optimization, Convergence guarantees for generalized adaptive stochastic search methods for continuous global optimization, Importance accelerated Robbins-Monro recursion with applications to parametric confidence limits, Adaptive-treed bandits, A smoothing stochastic algorithm for quantile estimation, Extremum seeking of dynamical systems via gradient descent and stochastic approximation methods, Adaptive finite element methods for the identification of elastic constants, Continuous optimization via simulation using golden region search, Heterogeneous beliefs and local information in stochastic fictitious play, A new hybrid stochastic approximation algorithm, A stopping rule for stochastic approximation, Optimization of stochastic simulation models, Stochastic heavy ball, Trends in identification, Stochastic approximation and modern model-based designs for dose-finding clinical trials, Simple and cumulative regret for continuous noisy optimization, Iterated filtering, On stochastic gradient and subgradient methods with adaptive steplength sequences, Design issues for generalized linear models: a review, Online learning for quantile regression and support vector regression, A sparsity preserving stochastic gradient methods for sparse regression, Recurrent algorithms of structural classification analysis for complex organized information, Stochastic design optimization of asynchronous flexible assembly systems, Parallel deterministic and stochastic global minimization of functions with very many minima, Gradient estimation using Lagrange interpolation polynomials, Convergence in models with bounded expected relative hazard rates, Newton-based stochastic optimization using \(q\)-Gaussian smoothed functional algorithms, Accelerated randomized stochastic optimization., A variational inequality based stochastic approximation for inverse problems in stochastic partial differential equations, Stochastic compositional gradient descent: algorithms for minimizing compositions of expected-value functions, Stochastic optimization algorithms for barrier dividend strategies, Stochastic approximation, cooperative dynamics and supermodular games, Stochastic quasigradient methods for optimization of discrete event systems, Estimation of an optimal solution of a LP problem with unknown objective function, On the convergence of a stochastic approximation procedure for estimating the quantile criterion in the case of a discontinuous distribution function, Computational advances for and from Bayesian analysis, Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space, State estimation scheme for nonlinear dynamical systems based on the stochastic approximation, Convergence of stochastic proximal gradient algorithm, On random observation processes for stochastic approximation, Approximation methods for the unconstrained optimization, A random observation process for stochastic approximation, Reservoir uncertainty tolerant, proactive control of intelligent wells, Upper bounds for the 0-1 stochastic knapsack problem and a B\&B algorithm, General convergence results for stochastic approximations via weak convergence theory, Variational Bayesian strategies for high-dimensional, stochastic design problems, Cyclic stochastic approximation with disturbance on input in the parameter tracking problem based on a multiagent algorithm, Asymptotically valid single-stage multiple-comparison procedures, Sensitivity analysis and optimization of stochastic Petri nets, Robustized recursive estimation with applications, Optimal two-stage procedures for estimating location and size of the maximum of a multivariate regression function, Optimization via simulation: A review, Stochastic approximation search algorithms with randomization at the input, A stopping rule for the Robbins-Monro method, Stochastic algorithms with Armijo stepsizes for minimization of functions, The stochastic approximation method for the estimation of a multivariate probability density, A statistical foundation for machine learning, with application to Go- Moku, A Kalman-tracking filter approach to nonlinear programming, A stochastic approximation view of boosting, Optimal estimator for distributed anonymous observers, Convergence analysis of dynamic stochastic approximation, Performance analysis of the simultaneous perturbation stochastic approximation algorithm on the noisy sphere model, Almost surely convergent global optimziation algorithm using noise-corrupted observations, Weak convergence rates for stochastic approximation with application to multiple targets and simulated annealing, Locating the minimum of a function when the errors of observation have unknown density, On the optimality and efficiency of common random numbers, Optimization algorithm with probabilistic estimation, Experimental design for estimating the optimum point in a response surface, Recursive regression estimation based on the two-time-scale stochastic approximation method and Bernstein polynomials, Wear convergence of stochastic approximation processes with random indices, Prediction of hereditary cancers using neural networks, Stochastic zeroth-order discretizations of Langevin diffusions for Bayesian inference, The price of reverse factoring: financing rates vs. payment delays, On the almost sure convergence of a general stochastic approximation procedure, Unnamed Item, A theoretical and empirical comparison of gradient approximations in derivative-free optimization, A gradient method for unconstrained optimization in noisy environment, Parameter estimation in a highly non-linear model using simultaneous perturbation stochastic approximation, Optimal Learning for Nonlinear Parametric Belief Models Over Multidimensional Continuous Spaces, ASTRO-DF: A Class of Adaptive Sampling Trust-Region Algorithms for Derivative-Free Stochastic Optimization, Unnamed Item, The multivariate Révész's online estimator of a regression function and its averaging, Unnamed Item, SIMULATION-BASED OPTIMIZATION BY NEW STOCHASTIC APPROXIMATION ALGORITHM, \textsc{OCam}: out-of-core coordinate descent algorithm for matrix completion, Signal recovery by stochastic optimization, Sequences with low discrepancy generalisation and application to bobbins-monbo algorithm, Stochastic quasi-Newton with line-search regularisation, Neural networks synthesis based on stochastic approximation algorithm, Discrete variable stochastic approximation procedures and recursive autoregressive model identification, Kernel-based online gradient descent using distributed approach, Swarming for Faster Convergence in Stochastic Optimization, Online optimization of replacement policies using learning automata, Some multivariate risk indicators: Minimization by using a Kiefer–Wolfowitz approach to the mirror stochastic algorithm, Bayesian mode and maximum estimation and accelerated rates of contraction, Optimising portfolio diversification and dimensionality, Convergence of online pairwise regression learning with quadratic loss, Finding optimal vaccination strategies for pandemic influenza using genetic algorithms, Mini-batch learning of exponential family finite mixture models, On Sampling Rates in Simulation-Based Recursions, Correctness of automatic differentiation via diffeologies and categorical gluing, SENSITIVITY ANALYSIS OF NONLINEAR BEHAVIOR WITH DISTORTED PROBABILITY, EXPLICIT HESTON SOLUTIONS AND STOCHASTIC APPROXIMATION FOR PATH-DEPENDENT OPTION PRICING, The existence of maximum likelihood estimate in high-dimensional binary response generalized linear models, Optimal experimental design and some related control problems, Sequential Designs for Binary Data with the Purpose to Maximize the Probability of Response, Kiefer–Wolfowitz algorithm under quasi-associated random errors, Designing inharmonic strings, Online estimation of integrated squared density derivatives, Stochastic optimisation with inequality constraints using simultaneous perturbations and penalty functions, A companion for the Kiefer-Wolfowitz-Blum stochastic approximation algorithm, A randomized stochastic optimization algorithm: its estimation accuracy, Asymptotic Statistical Results: Theory and Practice, A composite likelihood approach to the analysis of longitudinal clonal data on multitype cellular systems under an age-dependent branching process, ERGODIC PROPERTIES OF WEAK ASYMPTOTIC PSEUDOTRAJECTORIES FOR SET-VALUED DYNAMICAL SYSTEMS, A compact law of the iterated logarithm for online estimator of hazard rate under random censoring, A Resampling-Based Stochastic Approximation Method for Analysis of Large Geostatistical Data, Simultaneous perturbation Newton algorithms for simulation optimization, The stochastic approximation method for estimation of a distribution function, Optimization based on information containing uncertainties, Optimization of functions whose values are subject to small errors, Global optimization of stochastic black-box systems via sequential kriging meta-models, Distributed stochastic gradient tracking methods, Global optimization of functions by the random optimization method, Stochastic mesh adaptive direct search for blackbox optimization using probabilistic estimates, Stochastic proximal gradient methods for nonconvex problems in Hilbert spaces, Stability bounds and almost sure convergence of improved particle swarm optimization methods, Non-Stationary Stochastic Optimization, Extremum Seeking Control with Two-Sided Stochastic Perturbations, Applied stochastic approximation algorithms in Hilbert space, A selective overview of deep learning, Stochastic approximation: from statistical origin to big-data, multidisciplinary applications, Recursive estimators of integrated squared density derivatives, Stochastic approximation algorithm with randomization at the input for unsupervised parameters estimation of Gaussian mixture model with sparse parameters, Estimation of local degree distributions via local weighted averaging and Monte Carlo cross-validation, A novel technique for stochastic root-finding: enhancing the search with adaptive \(d\)-ary search, Empirical Dynamic Programming, Efficient recursive estimation. Application to estimating the parameters of a covariance function, A stochastic primal-dual method for optimization with conditional value at risk constraints, An adaptive algorithm for optimal non-linear estimation in stochastic systems, A descent algorithm for constrained stochastic extrema, A Flocking-Based Approach for Distributed Stochastic Optimization, On Incomplete Learning and Certainty-Equivalence Control, System identification from noise-corrupted measurements, Revisiting the ODE method for recursive algorithms: fast convergence using quasi stochastic approximation, Finding best approximation pairs for two intersections of closed convex sets, Simulation methods for robust risk assessment and the distorted mix approach, Versuchspläne zur stochastischen Optimierung, On sequential search for the maximum of an unknown function, Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection, The Pricing Problem, Spatial sampling design using generalized Neyman-Scott process, A Note on Stochastic Approximation, Stopping criteria for, and strong convergence of, stochastic gradient descent on Bottou-Curtis-Nocedal functions, A sequential design for maximizing the probability of a favourable response, The variational quantum eigensolver: a review of methods and best practices, A SYSTEMIC MODEL OF BIOFEEDBACK LEARNING, Fundamental design principles for reinforcement learning algorithms, Unnamed Item, Nonparametrics: Retrospectives and perspectives*, Matrices -- compensating the loss of anschauung, Gradient estimation schemes for noisy functions, A stochastic gradient algorithm with momentum terms for optimal control problems governed by a convection-diffusion equation with random diffusivity, New combinatorial direction stochastic approximation algorithms, Convergence of Recursive Stochastic Algorithms Using Wasserstein Divergence, Iterative learning control for a class of uncertain nonlinear systems with current state feedback, Stochastic optimization on social networks with application to service pricing, Unnamed Item