Penalized maximum likelihood estimation and effective dimension

DOI10.1214/15-AIHP720MaRDI QIDQ520783zbMATH OpenOpenAlexFDO

Authors V. G. Spokoiny

Publication date 6 April 2017

Published in Annales de l'Institut Henri Poincaré. Probabilités et Statistiques (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1205.0498, https://projecteuclid.org/euclid.aihp/1486544896

zbMATH Keywords

maximum likelihood estimationpenaltyWilks and Fisher expansions

Mathematics Subject Classification ID

Point estimation (62F10) Parametric tolerance and confidence regions (62F25) Estimation in multivariate analysis (62H12) Generalized linear models (logistic models) (62J12)

Abstract: This paper extends some prominent statistical results including emph{Fisher Theorem and Wilks phenomenon} to the penalized maximum likelihood estimation with a quadratic penalization. It appears that sharp expansions for the penalized MLE ( ilde{ hetav}_{G} ) and for the penalized maximum likelihood can be obtained without involving any asymptotic arguments, the results only rely on smoothness and regularity properties of the of the considered log-likelihood function. The error of estimation is specified in terms of the effective dimension (p_G ) of the parameter set which can be much smaller than the true parameter dimension and even allows an infinite dimensional functional parameter. In the i.i.d. case, the Fisher expansion for the penalized MLE can be established under the constraint "(p_G^{2}/n) is small" while the remainder in the Wilks result is of order (p_G^{3}/n ).

Recommendations

• Asymptotic analysis of penalized likelihood and related estimators
• Model selection and sharp asymptotic minimaxity
• scientific article; zbMATH DE number 4147329
• A nonparametric Cramér-Rao inequality for estimators of statistical functionals.

Cited in

(13)

• On Dantzig and Lasso estimators of the drift in a high dimensional Ornstein-Uhlenbeck model
• The likelihood ratio test in high-dimensional logistic regression is asymptotically a rescaled Chi-square
• Large ball probabilities, Gaussian comparison and anti-concentration
• Large sample properties of the SCAD-penalized maximum likelihood estimation on high dimen\-sions
• scientific article; zbMATH DE number 795291 (Why is no real title available?)
• Gaussian approximation for penalized Wasserstein barycenters
• On accuracy of Gaussian approximation in Bayesian semiparametric problems
• Empirical Bayes inference in sparse high-dimensional generalized linear models
• Advances in Bayesian model selection consistency for high-dimensional generalized linear models
• On Lasso estimator for the drift function in diffusion models
• Accuracy of Gaussian approximation for high-dimensional posterior distributions
• Inexact Laplace approximation and the use of posterior mean in Bayesian inference
• MM for penalized estimation

This page was built for publication: Penalized maximum likelihood estimation and effective dimension

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q520783)