The compactification of generalized linear models

From MaRDI portal





The main purpose of this paper is to unify and extend the existing theory of `estimated zeroes' in log-linear and logit models. To this end it is shown that every generalized linear model (GLM) can be embedded in a larger model with a compact parameter space and a continuous likelihood (a `CGLM'). Clearly in a CGLM the maximum likelihood estimate (MLE) always exists, easing a major data analysis problem. In the mean-value parametrization, the construction of the CGLM is remarkably simple; except in a rather pathological and rare case, estimated expected values are always finite. In the \(\beta\)-parametrization however, the compactification is more complex; the MLE need not correspond to a finite \(\hat\beta\), as is well known for estimated zeroes in log-linear models. The boundary distributions of CGLMs are classified in four categories: `inadmissible', `degenerate', `Chentsov', and `constrained'. For a large class of GLMs, including all GLMs with canonical link functions and probit models, the MLE in the corresponding CGLM exists and is unique. Even stronger, the likelihood has no other local maxima. Equivalent algebraic and geometric conditions [in the vein of \textit{S. J. Haberman}, see ``The analysis of frequency data. (1974; Zbl 0325.62017), and \textit{A. Albert} and \textit{J. A. Anderson}, see Biometrika 71, 1-10 (1984; Zbl 0543.62020)], necessary for the existence of the MLE in the GLM corresponding to a finite \(\hat\beta\), are given. For a large class of GLMs these conditions are also sufficient. Even for log-linear models this seems to be a new result.











This page was built for publication: The compactification of generalized linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4696593)