Approximation by log-concave distributions, with applications to regression

DOI10.1214/10-AOS853MaRDI QIDQ548533zbMATH OpenOpenAlexFDO

Authors Lutz Dümbgen, Richard Samworth, Dominic Schuhmacher

Publication date 29 June 2011

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1002.3448

zbMATH Keywords

isotonic regressionprojectionconvex supportMallows distanceweak semicontinuity

Mathematics Subject Classification ID

Density estimation (62G07) Nonparametric regression and quantile regression (62G08) Linear regression; mixed models (62J05) Estimation in multivariate analysis (62H12) Approximations to statistical distributions (nonasymptotic) (62E17)

Abstract: We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if and only if $P$ has finite first moments and is not supported by some hyperplane. Furthermore we show that this approximation depends continuously on $P$ with respect to Mallows distance $D_1(cdot,cdot)$. This result implies consistency of the maximum likelihood estimator of a log-concave density under fairly general conditions. It also allows us to prove existence and consistency of estimators in regression models with a response $Y=mu(X)+epsilon$, where $X$ and $epsilon$ are independent, $mu(cdot)$ belongs to a certain class of regression functions while $epsilon$ is a random error with log-concave density and mean zero.

Recommendations

• Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
• Maximum likelihood estimation of a log-concave density and its distribution function: basic properties and uniform consistency
• Multivariate log-concave distributions as a nearly parametric model
• Adaptation in log-concave density estimation
• Estimating a discrete log-concave distribution in higher dimensions

Cites work

• scientific article; zbMATH DE number 3126936 (Why is no real title available?)
• scientific article; zbMATH DE number 3134565 (Why is no real title available?)
• scientific article; zbMATH DE number 51427 (Why is no real title available?)
• scientific article; zbMATH DE number 1909499 (Why is no real title available?)
• scientific article; zbMATH DE number 3390139 (Why is no real title available?)
• A Note on Asymptotic Joint Normality
• Approximation by log-concave distributions, with applications to regression
• Breakdown properties of location estimates based on halfspace depth and projected outlyingness
• Consistency of multivariate log-concave density estimators
• Convex models, MLE and misspecification
• Differential evolution. A practical approach to global optimization. With CD-ROM.
• Inference and modeling with log-concave distributions
• Large deviation probabilities for certain nonparametric maximum likelihood estimators
• Limit distribution theory for maximum likelihood estimation of a log-concave density
• Log-concave probability and its applications
• Maximum likelihood estimation of a log-concave density and its distribution function: basic properties and uniform consistency
• Multivariate log-concave distributions as a nearly parametric model
• Nonparametric estimation of multivariate convex-transformed densities
• Quasi-concave density estimation
• Some asymptotic theory for the bootstrap
• The Integral of a Symmetric Unimodal Function over a Symmetric Convex Set and Some Probability Inequalities
• Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
• Thinking outside the box: Statistical inference based on Kullback-Leibler empirical projections
• Weak convergence and empirical processes. With applications to statistics

Cited in

(45)

• Local continuity of log-concave projection, with applications to estimation under model misspecification
• High-dimensional nonparametric density estimation via symmetry and shape constraints
• Exact solutions in log-concave maximum likelihood estimation
• Improved inference for vaccine-induced immune responses via shape-constrained methods
• Convergence of linear functionals of the Grenander estimator under misspecification
• Inference for the mode of a log-concave density
• On the Bartlett correction of empirical likelihood for Gaussian long-memory time series
• Editorial: Special issue on ``Nonparametric inference under shape constraints
• Semiparametric time series models with log-concave innovations: maximum likelihood estimation and its consistency
• Adaptation in log-concave density estimation
• Independent component analysis via nonparametric maximum likelihood estimation
• Some approximations of the logistic distribution with application to the covariance matrix of logistic regression
• A Unifying Tutorial on Approximate Message Passing
• An EM algorithm for fitting a mixture model with symmetric log-concave densities
• Adaptation in multivariate log-concave density estimation
• Inference for empirical Wasserstein distances on finite spaces
• The robust EM-type algorithms for log-concave mixtures of regression models
• Maximum likelihood estimation of the mixture of log-concave densities
• A Bayesian nonparametric approach to log-concave density estimation
• A new computational framework for log-concave density estimation
• Recent progress in log-concave density estimation
• Modal linear regression using log-concave distributions
• Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
• Univariate log-concave density estimation with symmetry or modal constraints
• Multivariate log-concave distributions as a nearly parametric model
• Learning Theory
• Global convergence of the log-concave MLE when the true distribution is geometric
• Variational analysis of constrained M-estimators
• Fusion of hard and soft information in nonparametric density estimation
• Adaptive estimation in symmetric location model under log-concavity constraint
• Approximation and estimation of s-concave densities via Rényi divergences
• Maximum-likelihood estimation of a log-concave density based on censored data
• On convex least squares estimation when the truth is linear
• Concave Likelihood-Based Regression with Finite-Support Response Variables
• Confidence intervals for multiple isotonic regression and other monotone models
• Log-concavity and strong log-concavity: a review
• On convergence rates of convex regression in multiple dimensions
• Approximation by log-concave distributions, with applications to regression
• R-estimation in semiparametric dynamic location-scale models
• The limiting behavior of isotonic and convex regression estimators when the model is misspecified
• Inference for Local Parameters in Convexity Constrained Models
• Bi-log-concave distribution functions
• Optimal combination of linear and spectral estimators for generalized linear models
• Monotony of Lloyd's method II for log-concave density and convex error weighting function (Corresp.)
• On computation of semiparametric maximum likelihood estimators with shape constraints

Describes a project that uses

Uses Software

• logcondens
• LogConcDEAD

This page was built for publication: Approximation by log-concave distributions, with applications to regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q548533)