Concave regression: value-constrained estimation and likelihood ratio-based inference
From MaRDI portal
Abstract: We propose a likelihood ratio statistic for forming hypothesis tests and confidence intervals for a nonparametrically estimated univariate regression function, based on the shape restriction of concavity (alternatively, convexity). Dealing with the likelihood ratio statistic requires studying an estimator satisfying a null hypothesis, that is, studying a concave least-squares estimator satisfying a further equality constraint. We study this null hypothesis least-squares estimator (NLSE) here, and use it to study our likelihood ratio statistic. The NLSE is the solution to a convex program, and we find a set of inequality and equality constraints that characterize the solution. We also study a corresponding limiting version of the convex program based on observing a Brownian motion with drift. The solution to the limit problem is a stochastic process. We study the optimality conditions for the solution to the limit problem and find that they match those we derived for the solution to the finite sample problem. This allows us to show the limit stochastic process yields the limit distribution of the (finite sample) NLSE. We conjecture that the likelihood ratio statistic is asymptotically pivotal, meaning that it has a limit distribution with no nuisance parameters to be estimated, which makes it a very effective tool for this difficult inference problem. We provide a partial proof of this conjecture, and we also provide simulation evidence strongly supporting this conjecture.
Recommendations
- Testing for and against a concavity restriction with normal errors
- Consistency of concave regression with an application to current-status data
- Refinements of the Kiefer-Wolfowitz theorem and a test of concavity
- Likelihood ratio test for and against nonlinear inequality constraints
- Nonparametric shape-restricted regression
Cites work
- A canonical process for estimation of convex functions: the ``invelope of integrated Brownian motion \(+t^ 4\).
- Adaptive confidence intervals for regression functions under shape constraints
- All of Nonparametric Statistics
- An algorithm for approximating piecewise linear concave functions from sample gradients
- An Algorithm for Restricted Least Squares Regression
- Bootstrap methods: another look at the jackknife
- Consistency in concave regression
- Consistency of multidimensional convex regression
- Constrained penalized splines
- Convex Analysis
- Decomposing inventory routing problems with approximate value functions
- Effect of bias estimation on coverage accuracy of bootstrap confidence intervals for a probability density
- Estimating a Convex Function in Nonparametric Regression
- Estimation of a convex function: Characterizations and asymptotic theory.
- Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
- scientific article; zbMATH DE number 991498 (Why is no real title available?)
- scientific article; zbMATH DE number 3850449 (Why is no real title available?)
- scientific article; zbMATH DE number 4100438 (Why is no real title available?)
- scientific article; zbMATH DE number 3608725 (Why is no real title available?)
- scientific article; zbMATH DE number 1324223 (Why is no real title available?)
- scientific article; zbMATH DE number 3283207 (Why is no real title available?)
- Inference for the mode of a log-concave density
- Inference using shape-restricted regression splines
- Likelihood based inference for monotone response models
- Likelihood ratio tests for monotone functions.
- Limit distribution theory for maximum likelihood estimation of a log-concave density
- Maximum likelihood estimation of a log-concave density and its distribution function: basic properties and uniform consistency
- Multivariate convex regression with adaptive partitioning
- Nonparametric confidence intervals for monotone functions
- Nonparametric least squares estimation of a multivariate convex regression function
- Nonparametric option pricing under shape restrictions
- Nonparametric regression under qualitative smoothness assumptions
- Note—A Note on Least Squares Fitting of Functions Constrained to be Either Nonnegative, Nondecreasing or Convex
- On the estimation of a probability density function by the maximum penalized likelihood method
- Optimal confidence bands for shape-restricted curves
- Point Estimates of Ordinates of Concave Functions
- Representation theorem for convex nonparametric least squares
- Shape-restricted nonparametric regression with overall noisy measurements
- Statistics of shocks in solutions of inviscid Burgers equation
- Testing the monotonicity or convexity of a function using regression splines
- The Extremal Convex Functions.
- Univariate log-concave density estimation with symmetry or modal constraints
Cited in
(8)- Likelihood ratio tests for positivity in polynomial regressions
- Confidence intervals for multiple isotonic regression and other monotone models
- Inference for the mode of a log-concave density
- Concave extended linear modeling: A theoretical synthesis
- An improved global risk bound in concave regression
- Testing for and against a concavity restriction with normal errors
- Concave Likelihood-Based Regression with Finite-Support Response Variables
- Likelihood-based inference under nonconvex boundary constraints
This page was built for publication: Concave regression: value-constrained estimation and likelihood ratio-based inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1739026)
