Confidence intervals for multiple isotonic regression and other monotone models

DOI10.1214/20-AOS2025MaRDI QIDQ2054474zbMATH OpenOpenAlexFDO

Authors Yanyan Li

Publication date 3 December 2021

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2001.07064, https://projecteuclid.org/journals/annals-of-statistics/volume-49/issue-4/Confidence-intervals-for-multiple-isotonic-regression-and-other-monotone-models/10.1214/20-AOS2025.full

zbMATH Keywords

confidence intervalGaussian processshape constraintslimit distribution theorymultiple isotonic regression

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Nonparametric regression and quantile regression (62G08) Asymptotic distribution theory in statistics (62E20) Nonparametric tolerance and confidence regions (62G15)

Abstract: We consider the problem of constructing pointwise confidence intervals in the multiple isotonic regression model. Recently, [HZ19] obtained a pointwise limit distribution theory for the so-called block max-min and min-max estimators [FLN17] in this model, but inference remains a difficult problem due to the nuisance parameter in the limit distribution that involves multiple unknown partial derivatives of the true regression function. In this paper, we show that this difficult nuisance parameter can be effectively eliminated by taking advantage of information beyond point estimates in the block max-min and min-max estimators. Formally, let $hatu(x_0)$ (resp. $hatv(x_0)$) be the maximizing lower-left (resp. minimizing upper-right) vertex in the block max-min (resp. min-max) estimator, and $hat{f}_n$ be the average of the block max-min and min-max estimators. If all (first-order) partial derivatives of $f_0$ are non-vanishing at $x_0$, then the following pivotal limit distribution theory holds: ${\displaystyle }$ sqrt{n_{hat{u},hat{v}}(x_0)}�ig(hat{f}_n(x_0)-f_0(x_0)�ig) ightsquigarrow sigmacdot mathbb{L}_{1_d}. ${\displaystyle }$ Here $n_{hatu,hatv}(x_0)$ is the number of design points in the block $[hatu(x_0),hatv(x_0)]$, $sigma$ is the standard deviation of the errors, and $mathbb{L}_{1_d}$ is a universal limit distribution free of nuisance parameters. This immediately yields confidence intervals for $f_0(x_0)$ with asymptotically exact confidence level and oracle length. Notably, the construction of the confidence intervals, even new in the univariate setting, requires no more efforts than performing an isotonic regression for once using the block max-min and min-max estimators, and can be easily adapted to other common monotone models. Extensive simulations are carried out to support our theory.

Recommendations

• Nonparametric confidence intervals for monotone functions
• Limit distribution theory for block estimators in multiple isotonic regression
• scientific article; zbMATH DE number 1267279
• Adaptive confidence sets in shape restricted regression
• Monotone nonparametric regression and confidence intervals

Cites work

• scientific article; zbMATH DE number 3126936 (Why is no real title available?)
• scientific article; zbMATH DE number 5278587 (Why is no real title available?)
• scientific article; zbMATH DE number 107551 (Why is no real title available?)
• scientific article; zbMATH DE number 193111 (Why is no real title available?)
• scientific article; zbMATH DE number 788246 (Why is no real title available?)
• scientific article; zbMATH DE number 6791300 (Why is no real title available?)
• scientific article; zbMATH DE number 3288992 (Why is no real title available?)
• scientific article; zbMATH DE number 3390139 (Why is no real title available?)
• A canonical process for estimation of convex functions: the ``invelope of integrated Brownian motion \(+t^ 4\).
• A general projection framework for constrained smoothing.
• A pseudolikelihood method for analyzing interval censored data
• Adaptation in log-concave density estimation
• Adaptation in multivariate log-concave density estimation
• Adaptive risk bounds in unimodal regression
• Approximation and estimation of \(s\)-concave densities via Rényi divergences
• Approximation by log-concave distributions, with applications to regression
• Bandwidth choice for nonparametric regression
• Beyond Parametrics in Interdisciplinary Research: Festschrift in Honor of Professor Pranab K. Sen
• Change-point in stochastic design regression and the bootstrap
• Concave regression: value-constrained estimation and likelihood ratio-based inference
• Confidence sets for split points in decision trees
• Consistency in concave regression
• Consistency of multidimensional convex regression
• Estimation for Distributions with Monotone Failure Rate
• Estimation of a \(k\)-monotone density: limit distribution theory and the spline connection
• Estimation of a convex function: Characterizations and asymptotic theory.
• Generalized additive and index models with shape constraints
• Global rates of convergence in log-concave density estimation
• Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
• Global risk bounds and adaptation in univariate convex regression
• High-dimensional nonparametric density estimation via symmetry and shape constraints
• Inconsistency of bootstrap: the Grenander estimator
• Inference for the mode of a log-concave density
• Isotonic estimation and rates of convergence in Wicksell's problem
• Isotonic regression in general dimensions
• Isotonic regression in multi-dimensional spaces and graphs
• Likelihood based inference for monotone response models
• Likelihood ratio tests for monotone functions.
• Limit distribution theory for block estimators in multiple isotonic regression
• Limit distribution theory for maximum likelihood estimation of a log-concave density
• Maximum likelihood estimation of a log-concave density and its distribution function: basic properties and uniform consistency
• Multivariate extensions of isotonic regression and total variation denoising via entire monotonicity and Hardy-Krause variation
• Nonparametric confidence intervals for monotone functions
• Nonparametric estimation of a convex bathtub-shaped hazard function
• Nonparametric estimation of multivariate convex-transformed densities
• Nonparametric estimation under shape constraints. Estimators, algorithms and asymptotics
• Nonparametric least squares estimation of a multivariate convex regression function
• Nonparametric regression under qualitative smoothness assumptions
• On Difference-Based Variance Estimation in Nonparametric Regression When the Covariate is High Dimensional
• On Integrated L¹ Convergence Rate of an Isotonic Regression Estimator for Multivariate Observations
• On estimation of noise variance in two-dimensional signal processing
• On matrix estimation under monotonicity constraints
• On risk bounds in isotonic and other shape restricted regression problems
• On univariate convex regression
• Point Estimates of Ordinates of Concave Functions
• Quasi-concave density estimation
• Representation theorem for convex nonparametric least squares
• Risk bounds in isotonic regression
• Sharp oracle inequalities for least squares estimators in shape restricted regression
• The asymptotic behavior of monotone regression estimates
• Two estimators of the mean of a counting process with panel count data.
• Weak convergence and empirical processes. With applications to statistics

Cited in

(7)

• Stepwise Confidence Intervals for Monotone Dose–Response Studies
• Coverage of credible intervals in nonparametric monotone regression
• Inference for Local Parameters in Convexity Constrained Models
• Nonparametric confidence intervals for monotone functions
• Nonparametric inference under a monotone hazard ratio order
• Coverage of credible intervals in Bayesian multivariate isotonic regression
• Limit distribution theory for block estimators in multiple isotonic regression

Describes a project that uses

Uses Software

• scar
• GitHub

This page was built for publication: Confidence intervals for multiple isotonic regression and other monotone models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2054474)