Coverage of credible intervals in Bayesian multivariate isotonic regression

DOI10.1214/23-AOS2298arXiv2211.12566OpenAlexW4386035730MaRDI QIDQ6136595FDOQ6136595

Authors: Kang Wang, Subhashis Ghosal 

Publication date: 31 August 2023

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We consider the nonparametric multivariate isotonic regression problem, where the regression function is assumed to be nondecreasing with respect to each predictor. Our goal is to construct a Bayesian credible interval for the function value at a given interior point with assured limiting frequentist coverage. We put a prior on unrestricted step-functions, but make inference using the induced posterior measure by an "immersion map" from the space of unrestricted functions to that of multivariate monotone functions. This allows maintaining the natural conjugacy for posterior sampling. A natural immersion map to use is a projection via a distance, but in the present context, a block isotonization map is found to be more useful. The approach of using the induced "immersion posterior" measure instead of the original posterior to make inference provides a useful extension of the Bayesian paradigm, particularly helpful when the model space is restricted by some complex relations. We establish a key weak convergence result for the posterior distribution of the function at a point in terms of some functional of a multi-indexed Gaussian process that leads to an expression for the limiting coverage of the Bayesian credible interval. Analogous to a recent result for univariate monotone functions, we find that the limiting coverage is slightly higher than the credibility, the opposite of a phenomenon observed in smoothing problems. Interestingly, the relation between credibility and limiting coverage does not involve any unknown parameter. Hence by a recalibration procedure, we can get a predetermined asymptotic coverage by choosing a suitable credibility level smaller than the targeted coverage, and thus also shorten the credible intervals.

Full work available at URL: https://arxiv.org/abs/2211.12566

Recommendations

• Coverage of credible intervals in nonparametric monotone regression
• A nonparametric Bayes method for isotonic regression
• On frequentist coverage errors of Bayesian credible sets in moderately high dimensions
• Bayesian Isotonic Regression and Trend Analysis
• Confidence intervals for multiple isotonic regression and other monotone models

zbMATH Keywords

credible intervalGaussian processisotonic regressionblock isotonizationimmersion posteriorlimiting coverage

Mathematics Subject Classification ID

Bayesian inference (62F15) Nonparametric estimation (62G05) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20)

Cites Work

• Asymptotic Statistics
• Multiscale testing of qualitative hypotheses
• Title not available (Why is that?)
• A method for Bayesian monotonic multiple regression
• Bayesian monotone regression using Gaussian process projection
• An Empirical Distribution Function for Sampling with Incomplete Information
• Bayesian Isotonic Regression and Trend Analysis
• The asymptotic behavior of monotone regression estimates
• Testing for monotonicity of a regression mean by calibrating for linear functions.
• Testing monotonicity of regression.
• Likelihood ratio tests for monotone functions.
• Maximum Likelihood Estimates of Monotone Parameters
• Title not available (Why is that?)
• A Bayesian approach to non-parametric monotone function estimation
• An analysis of Bayesian inference for nonparametric regression
• Inconsistency of bootstrap: the Grenander estimator
• Nonparametric estimation under shape constraints. Estimators, algorithms and asymptotics
• Tests for monotonicity of a regression mean with guaranteed level
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Estimating a monotone density from censored observations
• Risk bounds in isotonic regression
• On risk bounds in isotonic and other shape restricted regression problems
• Likelihood based inference for monotone response models
• Sharp oracle inequalities for least squares estimators in shape restricted regression
• Optimal confidence bands for shape-restricted curves
• Adaptive confidence intervals for regression functions under shape constraints
• Multiscale methods for shape constraints in deconvolution: confidence statements for qualitative features
• Bayesian Multivariate Isotonic Regression Splines
• Concentration rate and consistency of the posterior distribution for selected priors under monotonicity constraints
• The limit distribution of the \(L_{\infty}\)-error of Grenander-type estimators
• Asymptotic normality of the \(L_k\)-error of the Grenander estimator
• Beyond Parametrics in Interdisciplinary Research: Festschrift in Honor of Professor Pranab K. Sen
• On the \(\mathbb L_p\)-error of monotonicity constrained estimators
• Title not available (Why is that?)
• Efficient Bayesian estimation and uncertainty quantification in ordinary differential equation models
• Isotonic regression in multi-dimensional spaces and graphs
• Isotonic regression in general dimensions
• Nonparametric confidence intervals for monotone functions
• Bayesian two-step estimation in differential equation models
• Bayesian inference for higher-order ordinary differential equation models
• On matrix estimation under monotonicity constraints
• Limit distribution theory for block estimators in multiple isotonic regression
• On Integrated L¹ Convergence Rate of an Isotonic Regression Estimator for Multivariate Observations
• Coverage of credible intervals in nonparametric monotone regression
• Convergence rates for Bayesian estimation and testing in monotone regression
• Confidence intervals for multiple isotonic regression and other monotone models
• Set structured global empirical risk minimizers are rate optimal in general dimensions
• Rates and coverage for monotone densities using projection-posterior
• Two-step Bayesian methods for generalized regression driven by partial differential equations
• Coverage of credible intervals in Bayesian multivariate isotonic regression

Cited In (1)

• Coverage of credible intervals in Bayesian multivariate isotonic regression

This page was built for publication: Coverage of credible intervals in Bayesian multivariate isotonic regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6136595)