Nonparametric estimation by convex programming

DOI10.1214/08-AOS654zbMATH Open1173.62024arXiv0908.3108WikidataQ57392906 ScholiaQ57392906MaRDI QIDQ834340FDOQ834340

Authors: Anatoli Juditsky, Arkadi Nemirovski 

Publication date: 19 August 2009

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: The problem we concentrate on is as follows: given (1) a convex compact set $X$ in ${mathbbR}^n$, an affine mapping $xmapstoA(x)$, a parametric family $p_{mu}(cdot)$ of probability densities and (2) $N$ i.i.d. observations of the random variable $omega$, distributed with the density $p_{A(x)}(cdot)$ for some (unknown) $xinX$, estimate the value $g^{T}x$ of a given linear form at $x$. For several families $p_{mu}(cdot)$ with no additional assumptions on $X$ and $A$, we develop computationally efficient estimation routines which are minimax optimal, within an absolute constant factor. We then apply these routines to recovering $x$ itself in the Euclidean norm.

Full work available at URL: https://arxiv.org/abs/0908.3108

Recommendations

• Optimal rates of convergence for convex set estimation from support functions
• Adaptive estimation of planar convex sets
• Nonparametric estimation of convex models via mixtures
• Computing Maximum Likelihood Estimators of Convex Density Functions
• Estimating linear and quadratic forms via indirect observations

zbMATH Keywords

convex optimizationoracle inequalitiesminimax estimationestimation of linear functionalsPE tomography

Mathematics Subject Classification ID

Density estimation (62G07) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Convex programming (90C25)

Cites Work

• Smoothing methods in statistics
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• All of Nonparametric Statistics
• Lectures on modern convex optimization. Analysis, algorithms, and engineering applications
• Title not available (Why is that?)
• Geometrizing rates of convergence. II
• Asymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates
• Title not available (Why is that?)
• Approximation dans les espaces m�triques et th�orie de l'estimation
• Title not available (Why is that?)
• Optimal filtering of square-integrable signals in Gaussian noise
• Wavelets, approximation, and statistical applications
• Title not available (Why is that?)
• Title not available (Why is that?)
• Minimax theory of image reconstruction
• Statistical estimation and optimal recovery
• A note on nonparametric estimation of linear functionals.
• Introduction to Nonparametric Regression
• Minimax risk over hyperrectangles, and implications
• Stochastic curve estimation
• On spatially adaptive estimation of nonparametric regression
• Sharp adaptive estimation of linear functionals.
• Renormalization exponents and optimal pointwise rates of convergence

Cited In (22)

• Estimating a Convex Function in Nonparametric Regression
• A novel method for non-probabilistic convex modelling based on data from practical engineering
• Statistical Inference via Convex Optimization
• On polyhedral estimation of signals via indirect observations
• Near-optimality of linear recovery from indirect observations
• Nonlinear estimation based on conversion-sample optimization
• Nonparametric estimation of convex models via mixtures
• Near-optimal recovery of linear and \(N\)-convex functions on unions of convex sets
• Hypothesis testing by convex optimization
• An asymptotic property of nonlinear estimators arising as solutions to a certain class of convex programming problems
• Nonparametric least squares estimation of a multivariate convex regression function
• Adaptive estimation of planar convex sets
• On sequential hypotheses testing via convex optimization
• Estimating linear functionals of a sparse family of Poisson means
• On deconvolution of distribution functions
• Estimation from nonlinear observations via convex programming with application to bilinear regression
• On Design of Polyhedral Estimates in Linear Inverse Problems
• Multidimensional linear functional estimation in sparse Gaussian models and robust estimation of the mean
• Nonparametric frontier estimation by linear programming
• Augmented minimax linear estimation
• NONPARAMETRIC MAXIMUM LIKELIHOOD ESTIMATION OF A CONCAVE RECEIVER OPERATING CHARACTERISTIC CURVE VIA GEOMETRIC PROGRAMMING
• Estimating linear and quadratic forms via indirect observations

This page was built for publication: Nonparametric estimation by convex programming

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q834340)