The maximum likelihood threshold of a path diagram

From MaRDI portal



Abstract: Linear structural equation models postulate noisy linear relationships between variables of interest. Each model corresponds to a path diagram, which is a mixed graph with directed edges that encode the domains of the linear functions and bidirected edges that indicate possible correlations among noise terms. Using this graphical representation, we determine the maximum likelihood threshold, that is, the minimum sample size at which the likelihood function of a Gaussian structural equation model is almost surely bounded. Our result allows the model to have feedback loops and is based on decomposing the path diagram with respect to the connected components of its bidirected part. We also prove that if the sample size is below the threshold, then the likelihood function is almost surely unbounded. Our work clarifies, in particular, that standard likelihood inference is applicable to sparse high-dimensional models even if they feature feedback loops.


For a random vector $X=(X_1, \ldots , X_p)$ a linear structural equation model incoporates linear constraints of the form: \[ X_i = \lambda_{0i} + \sum_{j \ne i} \lambda_{ij}X_j + \varepsilon_i, \quad i=1, \dots, p, \] where $\varepsilon$ is a random error vector, assumed to be normal with zero mean and variance-covariance matrix $\Omega=(\omega_{ij})$, and the $\lambda$s are real parameters. The structure of the model is summarized in a mixed graph $(V,D,B)$ where: $V=\{1, \dots, p\}$ represents the set of variables; $D \subset V \times V$ is a directed graph that captures the structure of the $\lambda$ coefficients ($i \rightarrow j \notin D$ if and only if $\lambda_{ij} = 0$); and $B$ is a set containing $2$-element subsets (bidirected edges) of $V$ describing the correlation structure of $\varepsilon$ ($\omega_{ij} = 0$ when $i \ne j$ and $i \leftrightarrow j \notin B$). \par In this paper, the authors compute the maximum likelihood threshold (mlt) of such models. The mlt is the minimum sample size $N$ such that the likelihood function is bounded a.s. for any sample size $n \ge N$. The resulting formula has a simple expression, since it is enough to take all the connected components $C_1, \dots, C_l$ of the bidirected part of the mixed graph, and to compute, for each $C_j$, the cardinality of the union of $C_j$ with the parents of its elements.











This page was built for publication: The maximum likelihood threshold of a path diagram

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2414096)