Nonparametric estimation of multivariate convex-transformed densities

DOI10.1214/10-AOS840MaRDI QIDQ620567zbMATH OpenOpenAlexWikidataFDO

Authors Arseni Seregin, Jon A. Wellner

Publication date 19 January 2011

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/0911.4151

zbMATH Keywords

consistencymaximum likelihoodnonparametric estimationlower boundsunimodalmode estimationshape constraintsstrongly unimodallog-concave density estimationqualitative assumptions

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Density estimation (62G07) Asymptotic properties of nonparametric inference (62G20) Estimation in multivariate analysis (62H12)

Abstract: We study estimation of multivariate densities $p$ of the form $p(x)=h(g(x))$ for $xinmathbb{R}^d$ and for a fixed monotone function $h$ and an unknown convex function $g$. The canonical example is $h(y)=e^{-y}$ for $yinmathbbR$; in this case, the resulting class of densities [mathcal {P}(e^{-y})={p=exp(-g):g is convex}] is well known as the class of log-concave densities. Other functions $h$ allow for classes of densities with heavier tails than the log-concave class. We first investigate when the maximum likelihood estimator $hatp$ exists for the class $mathcalP(h)$ for various choices of monotone transformations $h$, including decreasing and increasing functions $h$. The resulting models for increasing transformations $h$ extend the classes of log-convex densities studied previously in the econometrics literature, corresponding to $h(y)=exp(y)$. We then establish consistency of the maximum likelihood estimator for fairly general functions $h$, including the log-concave class $mathcalP(e^{-y})$ and many others. In a final section, we provide asymptotic minimax lower bounds for the estimation of $p$ and its vector of derivatives at a fixed point $x_0$ under natural smoothness hypotheses on $h$ and $g$. The proofs rely heavily on results from convex analysis.

Recommendations

• Maximum likelihood estimation of a multi-dimensional log-concave density. With discussion and authors' reply
• Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
• Quasi-concave density estimation
• Adaptation in multivariate log-concave density estimation
• Computing Maximum Likelihood Estimators of Convex Density Functions

Cites work

• scientific article; zbMATH DE number 3121989 (Why is no real title available?)
• scientific article; zbMATH DE number 193483 (Why is no real title available?)
• scientific article; zbMATH DE number 3393603 (Why is no real title available?)
• scientific article; zbMATH DE number 3417266 (Why is no real title available?)
• A Riemannian interpolation inequality à la Borell, Brascamp and Lieb
• Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference
• Computing maximum likelihood estimators of a log-concave density function
• Consistency of multivariate log-concave density estimators
• Convex Analysis
• Convex set functions in d-space
• Distinctness of the eigenvalues of a quadratic form in a multivariate sample
• Estimation of a convex function: Characterizations and asymptotic theory.
• Geometrizing rates of convergence. II
• Inference and modeling with log-concave distributions
• Limit distribution theory for maximum likelihood estimation of a log-concave density
• Logconcavity versus logconvexity: A complete characterization
• Maximum likelihood estimation of a log-concave density and its distribution function: basic properties and uniform consistency
• Minimax lower bounds and moduli of continuity
• Nonparametric estimation of multivariate convex-transformed densities
• On convexity of measures
• On extensions of the Brunn-Minkowski and Prekopa-Leindler theorems, including inequalities for log concave functions, and with an application to the diffusion equation
• Quasi-concave density estimation
• Rates of convergence for minimum contrast estimators
• Some remarks about the convolution of unimodal functions
• Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
• Uniform Central Limit Theorems
• Weak convergence and empirical processes. With applications to statistics
• r-convex functions

Cited in

(42)

• Local continuity of log-concave projection, with applications to estimation under model misspecification
• Multivariate density estimation using dimension reducing information and tail flattening transformations for truncated or censored data
• Maximum likelihood estimation for totally positive log-concave densities
• Nearly Nonparametric Multivariate Density Estimates That Incorporate Marginal Parametric Density Information
• Editorial: Special issue on ``Nonparametric inference under shape constraints
• Semiparametric time series models with log-concave innovations: maximum likelihood estimation and its consistency
• Adaptation in log-concave density estimation
• Nonparametric estimation of multivariate scale mixtures of uniform densities
• Bracketing numbers of convex and m-monotone functions on polytopes
• Adaptation in multivariate log-concave density estimation
• A Computational Framework for Multivariate Convex Regression and Its Variants
• A Bayesian nonparametric approach to log-concave density estimation
• A new computational framework for log-concave density estimation
• Recent progress in log-concave density estimation
• Maximum likelihood estimation of a multi-dimensional log-concave density. With discussion and authors' reply
• Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
• Univariate log-concave density estimation with symmetry or modal constraints
• Optimal rates of convergence for convex set estimation from support functions
• Two-dimensional density estimation using smooth invertible transformations
• Quasi-concave density estimation
• Nonparametric estimation of multivariate convex-transformed densities
• Variational analysis of constrained M-estimators
• Global risk bounds and adaptation in univariate convex regression
• Fusion of hard and soft information in nonparametric density estimation
• Nonparametric least squares estimation of a multivariate convex regression function
• Optimization of relative arbitrage
• Approximation and estimation of s-concave densities via Rényi divergences
• A central limit theorem for the Hellinger loss of Grenander‐type estimators
• Transformation-based nonparametric estimation of multivariate densities
• Confidence Bands for a Log-Concave Density
• Confidence intervals for multiple isotonic regression and other monotone models
• Set structured global empirical risk minimizers are rate optimal in general dimensions
• Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density
• Log-concavity and strong log-concavity: a review
• Nonparametric estimation of multivariate density with direct and auxiliary data and application
• Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
• Approximation by log-concave distributions, with applications to regression
• Inference and modeling with log-concave distributions
• The limiting behavior of isotonic and convex regression estimators when the model is misspecified
• Optimal rates for estimation of two-dimensional totally positive distributions
• Inference for Local Parameters in Convexity Constrained Models
• Bi-log-concave distribution functions

Describes a project that uses

Uses Software

• logcondens

This page was built for publication: Nonparametric estimation of multivariate convex-transformed densities

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q620567)