Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist
From MaRDI portal
Publication:2044372
Abstract: In a regular full exponential family, the maximum likelihood estimator (MLE) need not exist in the traditional sense. However, the MLE may exist in the completion of the exponential family. Existing algorithms for finding the MLE in the completion solve many linear programs; they are slow in small problems and too slow for large problems. We provide new, fast, and scalable methodology for finding the MLE in the completion of the exponential family. This methodology is based on conventional maximum likelihood computations which come close, in a sense, to finding the MLE in the completion of the exponential family. These conventional computations construct a likelihood maximizing sequence of canonical parameter values which goes uphill on the likelihood function until they meet a convergence criteria. Nonexistence of the MLE in this context results from a degeneracy of the canonical statistic of the exponential family, the canonical statistic is on the boundary of its support. There is a correspondance between this boundary and the null eigenvectors of the Fisher information matrix. Convergence of Fisher information along a likelihood maximizing sequence follows from cumulant generating function (CGF) convergence along a likelihood maximizing sequence, conditions for which are given. This allows for the construction of necessarily one-sided confidence intervals for mean value parameters when the MLE exists in the completion. We demonstrate our methodology on three examples in the main text and three additional examples in the Appendix. We show that when the MLE exists in the completion of the exponential family, our methodology provides statistical inference that is much faster than existing techniques.
Recommendations
- Likelihood inference in exponential families and directions of recession
- Existence of Maximum Likelihood Estimates for Multi‐dimensional Exponential Families
- Generalized maximum likelihood estimates for exponential families
- Long range search for maximum likelihood in exponential families
- scientific article; zbMATH DE number 4121215
Cites work
- A note on A. Albert and J. A. Anderson's conditions for the existence of maximum likelihood estimates in logistic regression models
- Approximating faces of marginal polytopes in discrete hierarchical models
- Aster models for life history analysis
- Closures of exponential families
- Convex Analysis
- Convex cores of measures on R d
- Existence of MLEs for discrete linear exponential models
- Generalized maximum likelihood estimates for exponential families
- scientific article; zbMATH DE number 5988004 (Why is no real title available?)
- scientific article; zbMATH DE number 3976123 (Why is no real title available?)
- scientific article; zbMATH DE number 44577 (Why is no real title available?)
- scientific article; zbMATH DE number 3509596 (Why is no real title available?)
- scientific article; zbMATH DE number 3600759 (Why is no real title available?)
- scientific article; zbMATH DE number 3602484 (Why is no real title available?)
- scientific article; zbMATH DE number 1354815 (Why is no real title available?)
- scientific article; zbMATH DE number 720750 (Why is no real title available?)
- scientific article; zbMATH DE number 1022519 (Why is no real title available?)
- scientific article; zbMATH DE number 6107964 (Why is no real title available?)
- scientific article; zbMATH DE number 3451986 (Why is no real title available?)
- Information projections revisited
- Instability, sensitivity, and degeneracy of discrete exponential families
- Likelihood inference in exponential families and directions of recession
- Maximum likelihood estimation in log-linear models
- On limiting towards the boundaries of exponential families.
- On the existence of maximum likelihood estimates in logistic regression models
- On the geometry of discrete exponential families with application to exponential random graph models
- Polyhedral conditions for the nonexistence of the MLE for hierarchical log-linear models
- The compactification of generalized linear models
- The phase transition for the existence of the maximum likelihood estimate in high-dimensional logistic regression
Cited in
(7)- Long range search for maximum likelihood in exponential families
- Likelihood inference in exponential families and directions of recession
- Confidence intervals for discrete log-linear models when MLE does not exist
- Existence of Maximum Likelihood Estimates for Multi‐dimensional Exponential Families
- glmdr
- Maximum likelihood estimation of the linear model with equicorrelated errors
- Verifying the existence of maximum likelihood estimates for generalized linear models
This page was built for publication: Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2044372)
