Randomized urn models revisited using stochastic approximation
From MaRDI portal
Abstract: This paper presents the link between stochastic approximation and clinical trials based on randomized urn models investigated in Bai and Hu (1999,2005) and Bai, Hu and Shen (2002). We reformulate the dynamics of both the urn composition and the assigned treatments as standard stochastic approximation (SA) algorithms with remainder. Then, we derive the a.s. convergence and the asymptotic normality (CLT) of the normalized procedure under less stringent assumptions by calling upon the ODE and SDE methods. As a second step, we investigate a more involved family of models, known as multi-arm clinical trials, where the urn updating depends on the past performances of the treatments. By increasing the dimension of the state vector, our SA approach provides this time a new asymptotic normality result.
Recommendations
- Nonlinear randomized urn models: a stochastic approximation viewpoint
- Central limit theorems of a recursive stochastic algorithm with applications to adaptive designs
- Asymptotics in randomized urn models
- Stochastic approximation with random step sizes and urn models with random replacement matrices having finite mean
- A randomly reinforced urn
Cites work
- A randomized play-the-winner design for multi-arm clinical trials
- An adaptive design for multi-arm clinical trials
- An algebraic approach to Pólya processes
- Approximation gaussienne d'algorithmes stochastiques à dynamique markovienne. (Gaussian approximation of stochastic algorithms)
- Asymptotic Normality in the Generalized Polya–Eggenberger Urn Model, with an Application to Computer Data Structures
- Asymptotic theorems for urn models with nonhomogeneous generating matrices
- Asymptotics in randomized urn models
- Bernard Friedman's Urn
- Central limit theorems for urn models
- Convergence of stochastic algorithms: from the Kushner–Clark theorem to the Lyapounov functional method
- Embedding of Urn Schemes into Continuous Time Markov Branching Processes and Related Limit Theorems
- Functional limit theorems for multitype branching processes and generalized Pólya urns.
- scientific article; zbMATH DE number 48727 (Why is no real title available?)
- scientific article; zbMATH DE number 3548141 (Why is no real title available?)
- scientific article; zbMATH DE number 1329864 (Why is no real title available?)
- scientific article; zbMATH DE number 734901 (Why is no real title available?)
- scientific article; zbMATH DE number 976356 (Why is no real title available?)
- scientific article; zbMATH DE number 1972910 (Why is no real title available?)
- scientific article; zbMATH DE number 1405930 (Why is no real title available?)
- scientific article; zbMATH DE number 3272753 (Why is no real title available?)
- Martingale functional central limit theorems for a generalized Pólya urn
- Stochastic algorithms
- Stochastic approximation and modern model-based designs for dose-finding clinical trials
- Stochastic approximation methods for constrained and unconstrained systems
- The generalized Polya's urn design for sequential medical trials
- When can the two-armed bandit algorithm be trusted?
Cited in
(49)- Urn models, approximations, and splines
- Occupancy urn models in the analysis of algorithms
- Beta-stacy processes and a generalization of the Pólya-Urn scheme
- Synchronization of reinforced stochastic processes with a network-based interaction
- Pólya urns with immigration at random times
- A self-equilibrium Friedman-like urn via stochastic approximation
- Negatively reinforced balanced urn schemes
- Moment solution to an urn model
- Urn schemes and reinforced random walks.
- The Gaussian approximation for generalized Friedman's urn model with heterogeneous and unbalanced updating
- Nonparametric covariate-adjusted response-adaptive design based on a functional urn model
- Addendum and corrigendum to: ``Randomized urn models revisited using stochastic approximation.
- An urn model to construct an efficient test procedure for response adaptive designs
- Almost sure convergence of randomized urn models with application to elephant random walk
- A new approach to Pólya urn schemes and its infinite color generalization
- Generalized rescaled Pólya urn and its statistical application
- Approximating the operating characteristics of Bayesian uncertainty directed trial designs
- Barabási-Albert random graph with multiple type edges and perturbation
- Nonlinear randomized urn models: a stochastic approximation viewpoint
- Interacting reinforced stochastic processes: statistical inference based on the weighted empirical means
- Networks of reinforced stochastic processes: asymptotics for the empirical means
- Stochastic approximation with random step sizes and urn models with random replacement matrices having finite mean
- Interacting generalized Friedman's urn systems
- A generalized urn with multiple drawing and random addition
- Asymptotic theorems of sequential estimation-adjusted urn models
- Stochastic approximation on noncompact measure spaces and application to measure-valued Pólya processes
- Nonlinear unbalanced urn models via stochastic approximation
- scientific article; zbMATH DE number 3947298 (Why is no real title available?)
- Hierarchical reinforced urn processes
- Probabilistic Transforms for Combinatorial Urn Models
- Multiple drawing multi-colour urns by stochastic approximation
- Convergence in models with bounded expected relative hazard rates
- Random-allocation and urn models
- Unbalanced multi-drawing urn with random addition matrix
- The rescaled Pólya urn: local reinforcement and chi-squared goodness-of-fit test
- A finite memory interacting Pólya contagion network and its approximating dynamical systems
- Central limit theorems of a recursive stochastic algorithm with applications to adaptive designs
- Strong convergence of infinite color balanced urns under uniform ergodicity
- Linear de-preferential urn models
- Interacting urns on a finite directed graph
- Azuma-Hoeffding bounds for a class of urn models
- Interacting nonlinear reinforced stochastic processes: Synchronization or non-synchronization
- Synchronization and fluctuations for interacting stochastic systems with individual and collective reinforcement
- Positive reinforced generalized time-dependent Pólya urns via stochastic approximation
- On a notion of partially conditionally identically distributed sequences
- An urn model for social dynamics on networks
- Nonlinear and unbalanced urn models with two types of strategies: a stochastic approximation point of view
- Central limit theorems for interacting innovation processes, related statistical tools and general results
- Nonconvergence to unstable points in urn models and stochastic approximations
This page was built for publication: Randomized urn models revisited using stochastic approximation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q363849)
