Parametric estimation. Finite sample theory
From MaRDI portal
Abstract: The paper aims at reconsidering the famous Le Cam LAN theory. The main features of the approach which make it different from the classical one are as follows: (1) the study is nonasymptotic, that is, the sample size is fixed and does not tend to infinity; (2) the parametric assumption is possibly misspecified and the underlying data distribution can lie beyond the given parametric family. These two features enable to bridge the gap between parametric and nonparametric theory and to build a unified framework for statistical estimation. The main results include large deviation bounds for the (quasi) maximum likelihood and the local quadratic bracketing of the log-likelihood process. The latter yields a number of important corollaries for statistical inference: concentration, confidence and risk bounds, expansion of the maximum likelihood estimate, etc. All these corollaries are stated in a nonclassical way admitting a model misspecification and finite samples. However, the classical asymptotic results including the efficiency bounds can be easily derived as corollaries of the obtained nonasymptotic statements. At the same time, the new bracketing device works well in the situations with large or growing parameter dimension in which the classical parametric theory fails. The general results are illustrated for the i.i.d. setup as well as for generalized linear and median estimation. The results apply for any dimension of the parameter space and provide a quantitative lower bound on the sample size yielding the root-n accuracy.
Recommendations
Cites work
- A theorem on majorizing measures
- Asymptotics in statistics. Some basic concepts.
- Concentration inequalities using the entropy method
- Hellinger-consistency of certain nonparametric maximum likelihood estimators
- scientific article; zbMATH DE number 3169867 (Why is no real title available?)
- scientific article; zbMATH DE number 3733065 (Why is no real title available?)
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- Local quantile regression
- Majorizing measures without measures
- Majorizing measures: The generic chaining
- Minimum contrast estimators on sieves: Exponential bounds and rates of convergence
- Model selection via testing: an alternative to (penalized) maximum likelihood estimators.
- Parametric estimation. Finite sample theory
- Rates of convergence for minimum contrast estimators
- The Generic Chaining
- Weak convergence and empirical processes. With applications to statistics
Cited in
(38)- Chernoff index for Cox test of separate parametric families
- Finite sample nonparametric inference and large sample efficiency.
- Inaccuracy rates and Hodges-Lehmann large deviation rates for parametric inferences with nuisance parameters
- Bounding the difference between true and nominal rejection probabilities in tests of hypotheses about instrumental variables models
- Decentralized and parallel primal and dual accelerated methods for stochastic convex programming problems
- Iteratively reweighted _1-penalized robust regression
- On Dantzig and Lasso estimators of the drift in a high dimensional Ornstein-Uhlenbeck model
- Finite-sample analysis of \(M\)-estimators using self-concordance
- Bayesian model selection and the concentration of the posterior of hyperparameters
- Properties of the Bayesian parameter estimation of a regression based on Gaussian processes
- On rank estimators in increasing dimensions
- On efficient randomized algorithms for finding the PageRank vector
- Local quantile regression
- Rejoinder on: ``Local quantile regression
- Finite sample Bernstein-von Mises theorem for semiparametric problems
- Multiscale change point detection
- Properties of the posterior distribution of a regression model based on Gaussian random fields
- Uniform properties of the local maximum likelihood estimate
- Critical dimension in profile semiparametric estimation
- Critical dimension in the semiparametric Bernstein-von Mises theorem
- scientific article; zbMATH DE number 7625184 (Why is no real title available?)
- Stochastic approximation versus sample average approximation for Wasserstein barycenters
- One-Step Estimation with Scaled Proximal Methods
- Nonasymptotic one- and two-sample tests in high dimension with unknown covariance structure
- Bernstein-von Mises theorem and misspecified models: a review
- On accuracy of Gaussian approximation in Bayesian semiparametric problems
- High-dimensional composite quantile regression: optimal statistical guarantees and fast algorithms
- Recent theoretical advances in decentralized distributed convex optimization
- Recent Theoretical Advances in Non-Convex Optimization
- A diffusion process perspective on posterior contraction rates for parameters
- Robust calibration of computer models based on Huber loss
- Robust estimators of functional single index models for longitudinal data
- High-probability complexity bounds for non-smooth stochastic convex optimization with heavy-tailed noise
- Advances in Bayesian model selection consistency for high-dimensional generalized linear models
- Improved dimension dependence in the Bernstein-von Mises theorem via a new Laplace approximation bound
- Parametric estimation. Finite sample theory
- Bootstrap confidence sets under model misspecification
- Finite sample behavior of a sieve profile estimator in the single index mode
This page was built for publication: Parametric estimation. Finite sample theory
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q741810)
