Randomized urn models revisited using stochastic approximation
From MaRDI portal
Abstract: This paper presents the link between stochastic approximation and clinical trials based on randomized urn models investigated in Bai and Hu (1999,2005) and Bai, Hu and Shen (2002). We reformulate the dynamics of both the urn composition and the assigned treatments as standard stochastic approximation (SA) algorithms with remainder. Then, we derive the a.s. convergence and the asymptotic normality (CLT) of the normalized procedure under less stringent assumptions by calling upon the ODE and SDE methods. As a second step, we investigate a more involved family of models, known as multi-arm clinical trials, where the urn updating depends on the past performances of the treatments. By increasing the dimension of the state vector, our SA approach provides this time a new asymptotic normality result.
Recommendations
- Nonlinear randomized urn models: a stochastic approximation viewpoint
- Central limit theorems of a recursive stochastic algorithm with applications to adaptive designs
- Asymptotics in randomized urn models
- Stochastic approximation with random step sizes and urn models with random replacement matrices having finite mean
- A randomly reinforced urn
Cites work
- scientific article; zbMATH DE number 48727 (Why is no real title available?)
- scientific article; zbMATH DE number 3548141 (Why is no real title available?)
- scientific article; zbMATH DE number 1329864 (Why is no real title available?)
- scientific article; zbMATH DE number 734901 (Why is no real title available?)
- scientific article; zbMATH DE number 976356 (Why is no real title available?)
- scientific article; zbMATH DE number 1972910 (Why is no real title available?)
- scientific article; zbMATH DE number 1405930 (Why is no real title available?)
- scientific article; zbMATH DE number 3272753 (Why is no real title available?)
- A randomized play-the-winner design for multi-arm clinical trials
- An adaptive design for multi-arm clinical trials
- An algebraic approach to Pólya processes
- Approximation gaussienne d'algorithmes stochastiques à dynamique markovienne. (Gaussian approximation of stochastic algorithms)
- Asymptotic Normality in the Generalized Polya–Eggenberger Urn Model, with an Application to Computer Data Structures
- Asymptotic theorems for urn models with nonhomogeneous generating matrices
- Asymptotics in randomized urn models
- Bernard Friedman's Urn
- Central limit theorems for urn models
- Convergence of stochastic algorithms: from the Kushner–Clark theorem to the Lyapounov functional method
- Embedding of Urn Schemes into Continuous Time Markov Branching Processes and Related Limit Theorems
- Functional limit theorems for multitype branching processes and generalized Pólya urns.
- Martingale functional central limit theorems for a generalized Pólya urn
- Stochastic algorithms
- Stochastic approximation and modern model-based designs for dose-finding clinical trials
- Stochastic approximation methods for constrained and unconstrained systems
- The generalized Polya's urn design for sequential medical trials
- When can the two-armed bandit algorithm be trusted?
Cited in
(46)- Nonconvergence to unstable points in urn models and stochastic approximations
- Convergence in models with bounded expected relative hazard rates
- Networks of reinforced stochastic processes: asymptotics for the empirical means
- Random-allocation and urn models
- Hierarchical reinforced urn processes
- Azuma-Hoeffding bounds for a class of urn models
- Beta-stacy processes and a generalization of the Pólya-Urn scheme
- A self-equilibrium Friedman-like urn via stochastic approximation
- Nonparametric covariate-adjusted response-adaptive design based on a functional urn model
- A finite memory interacting Pólya contagion network and its approximating dynamical systems
- Multiple drawing multi-colour urns by stochastic approximation
- The rescaled Pólya urn: local reinforcement and chi-squared goodness-of-fit test
- Generalized rescaled Pólya urn and its statistical application
- Interacting generalized Friedman's urn systems
- Interacting nonlinear reinforced stochastic processes: Synchronization or non-synchronization
- Stochastic approximation on noncompact measure spaces and application to measure-valued Pólya processes
- Approximating the operating characteristics of Bayesian uncertainty directed trial designs
- An urn model to construct an efficient test procedure for response adaptive designs
- On a notion of partially conditionally identically distributed sequences
- Unbalanced multi-drawing urn with random addition matrix
- Interacting urns on a finite directed graph
- Nonlinear unbalanced urn models via stochastic approximation
- Urn schemes and reinforced random walks.
- Probabilistic Transforms for Combinatorial Urn Models
- Nonlinear randomized urn models: a stochastic approximation viewpoint
- A generalized urn with multiple drawing and random addition
- Stochastic approximation with random step sizes and urn models with random replacement matrices having finite mean
- Synchronization and fluctuations for interacting stochastic systems with individual and collective reinforcement
- Barabási-Albert random graph with multiple type edges and perturbation
- Asymptotic theorems of sequential estimation-adjusted urn models
- Moment solution to an urn model
- Pólya urns with immigration at random times
- A new approach to Pólya urn schemes and its infinite color generalization
- Interacting reinforced stochastic processes: statistical inference based on the weighted empirical means
- Urn models, approximations, and splines
- The Gaussian approximation for generalized Friedman's urn model with heterogeneous and unbalanced updating
- Negatively reinforced balanced urn schemes
- Central limit theorems of a recursive stochastic algorithm with applications to adaptive designs
- Positive reinforced generalized time-dependent Pólya urns via stochastic approximation
- Addendum and corrigendum to: ``Randomized urn models revisited using stochastic approximation.
- Strong convergence of infinite color balanced urns under uniform ergodicity
- scientific article; zbMATH DE number 3947298 (Why is no real title available?)
- Synchronization of reinforced stochastic processes with a network-based interaction
- Almost sure convergence of randomized urn models with application to elephant random walk
- Occupancy urn models in the analysis of algorithms
- Linear de-preferential urn models
This page was built for publication: Randomized urn models revisited using stochastic approximation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q363849)
