On extended admissible procedures and their nonstandard Bayes risk

DOI10.1214/20-AOS2026MaRDI QIDQ2054475zbMATH OpenOpenAlexFDO

Authors Haosui Duanmu, Daniel M. Roy

Publication date 3 December 2021

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1612.09305, https://projecteuclid.org/journals/annals-of-statistics/volume-49/issue-4/On-extended-admissible-procedures-and-their-nonstandard-Bayes-risk/10.1214/20-AOS2026.full

zbMATH Keywords

decision theorynonstandard analysiscomplete class theorems

Mathematics Subject Classification ID

Bayesian problems; characterization of Bayes procedures (62C10) Nonstandard measure theory (28E05) Complete class results in statistical decision theory (62C07) Admissibility in statistical decision theory (62C15)

Abstract: For finite parameter spaces under finite loss, every Bayes procedure derived from a prior with full support is admissible, and every admissible procedure is Bayes. This relationship already breaks down once we move to finite-dimensional Euclidean parameter spaces. Compactness and strong regularity conditions suffice to repair the relationship, but without these conditions, admissible procedures need not be Bayes. Under strong regularity conditions, admissible procedures can be shown to be the limits of Bayes procedures. Under even stricter conditions, they are generalized Bayes, i.e., they minimize the Bayes risk with respect to an improper prior. In both these cases, one must venture beyond the strict confines of Bayesian analysis. Using methods from mathematical logic and nonstandard analysis, we introduce the class of nonstandard Bayes decision procedures---namely, those whose Bayes risk with respect to some prior is within an infinitesimal of the optimal Bayes risk. Among procedures with finite risk functions, we show that a decision procedure is extended admissible if and only if its nonstandard extension is nonstandard Bayes. For problems with continuous risk functions defined on metric parameter spaces, we derive a nonstandard analogue of Blyth's method that can be used to establish the admissibility of a procedure. We also apply the nonstandard theory to derive a purely standard theorem: when risk functions are continuous on a compact Hausdorff parameter space, a procedure is extended admissible if and only if it is Bayes.

Recommendations

• Note on a Fundamental Relationship Between Admissible and Bayesian Decision Rules
• scientific article; zbMATH DE number 4056771
• scientific article; zbMATH DE number 3923848
• scientific article; zbMATH DE number 53492
• Admissibility: Survey of a Concept in Progress

Cites work

• scientific article; zbMATH DE number 3113204 (Why is no real title available?)
• scientific article; zbMATH DE number 3122730 (Why is no real title available?)
• scientific article; zbMATH DE number 3816010 (Why is no real title available?)
• scientific article; zbMATH DE number 4005319 (Why is no real title available?)
• scientific article; zbMATH DE number 44577 (Why is no real title available?)
• scientific article; zbMATH DE number 1220667 (Why is no real title available?)
• scientific article; zbMATH DE number 1163398 (Why is no real title available?)
• scientific article; zbMATH DE number 841144 (Why is no real title available?)
• scientific article; zbMATH DE number 3246773 (Why is no real title available?)
• scientific article; zbMATH DE number 3061365 (Why is no real title available?)
• scientific article; zbMATH DE number 3090557 (Why is no real title available?)
• A Necessary and Sufficient Condition for Admissibility
• A stepwise Bayesian procedure
• Admissible Estimators, Recurrent Diffusions, and Insoluble Boundary Value Problems
• An Essentially Complete Class of Admissible Decision Functions
• An Extension of Wald's Theory of Statistical Decision Functions
• Contributions to the Theory of Statistical Estimation and Testing Hypotheses
• Estimation with quadratic loss.
• Finitely-additive, countably-additive and internal probability measures.
• Foundations of a General Theory of Sequential Decision Functions
• Generalized Bayes Decision Functions, Admissibility and the Exponential Family
• Generalized Bayes Solutions in Estimation Problems
• Generalized Bayes estimators in multivariate problems
• Invariance, Minimax Sequential Estimation, and Continuous Time Processes
• Lexicographic probability, conditional probability, and nonstandard probability
• On finitely additive priors, coherence, and extended admissibility
• Star-Finite Representations of Measure Spaces
• Statistical Decision Functions
• Statistical decision theory and Bayesian analysis. 2nd ed
• The admissibility of the empirical distribution function

Cited in

(7)

• A Bayesian nonatomic game and its applicability to finite-player situations
• Integration with filters
• Loeb extension and Loeb equivalence II
• On existence of Berk-Nash equilibria in misspecified Markov decision processes with infinite spaces
• Mixing and hitting times for Gibbs samplers and other non-Feller processes
• On abstract economies with an arbitrary set of players and action sets in locally-convex topological vector spaces
• Walrasian equilibrium theory with and without free-disposal: theorems and counterexamples in an infinite-agent context

This page was built for publication: On extended admissible procedures and their nonstandard Bayes risk

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2054475)