Switching regression models and causal inference in the presence of discrete latent variables

MaRDI QIDQ4969082zbMATH OpenFDO

Authors Rune Christiansen, Jonas Peters

Publication date 5 October 2020

Full work available at URL https://arxiv.org/abs/1808.05541, https://jmlr.csail.mit.edu/papers/v21/19-407.html

zbMATH Keywords

invariancelatent variableshidden Markov modelscausal discoveryswitching regression models

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Nonparametric hypothesis testing (62G10) Causal inference from observational studies (62D20)

Abstract: Given a response $Y$ and a vector $X=(X^1,dots,X^d)$ of $d$ predictors, we investigate the problem of inferring direct causes of $Y$ among the vector $X$. Models for $Y$ that use all of its causal covariates as predictors enjoy the property of being invariant across different environments or interventional settings. Given data from such environments, this property has been exploited for causal discovery. Here, we extend this inference principle to situations in which some (discrete-valued) direct causes of $Y$ are unobserved. Such cases naturally give rise to switching regression models. We provide sufficient conditions for the existence, consistency and asymptotic normality of the MLE in linear switching regression models with Gaussian noise, and construct a test for the equality of such models. These results allow us to prove that the proposed causal discovery method obtains asymptotic false discovery control under mild conditions. We provide an algorithm, make available code, and test our method on simulated data. It is robust against model violations and outperforms state-of-the-art approaches. We further apply our method to a real data set, where we show that it does not only output causal predictors, but also a process-based clustering of data points, which could be of additional interest to practitioners.

Recommendations

• Causal Dantzig: fast inference in linear structural equation models with hidden variables under additive interventions
• scientific article; zbMATH DE number 6276218
• scientific article
• Invariant causal prediction for sequential data
• Identification in causal models with hidden variables

Cites work

• scientific article; zbMATH DE number 45532 (Why is no real title available?)
• scientific article; zbMATH DE number 1220667 (Why is no real title available?)
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• 10.1162/153244303321897717
• A constrained formulation of maximum-likelihood estimation for normal mixture distributions
• A linear non-Gaussian acyclic model for causal discovery
• A modular system of algorithms for unconstrained minimization
• Asymptotic normality of the maximum likelihood estimator in state space models
• Asymptotic normality of the maximum-likelihood estimator for general hidden Markov models
• Causal inference by using invariant prediction: identification and confidence intervals. With discussion and authors' reply
• Causal inference for statistics, social, and biomedical sciences. An introduction
• Causal inference through a witness protection program
• Causality. Models, reasoning, and inference
• Causation, prediction, and search
• Characterization and greedy learning of interventional Markov equivalence classes of directed acyclic graphs
• Direct Calculation of the Information Matrix via the EM Algorithm
• Discrete Parameter Variation: Efficient Estimation of a Switching Regression Model
• Distinguishing cause from effect using observational data: methods and benchmarks
• Elements of causal inference. Foundations and learning algorithms
• Estimating high-dimensional intervention effects from observational data
• Estimating the Propagation Rate of a Viral Infection of Potato Plants via Mixtures of Regressions
• Extended conditional independence and applications in causal inference
• Identifiability of Finite Mixtures
• Information-geometric approach to inferring causal directions
• Invariant causal prediction for sequential data
• Learning stable and predictive structures in kinetic systems
• Learning the structure of linear latent variable models
• Markov chains: models, algorithms and applications
• Markov-switching generalized additive models
• Maximum-likelihood estimation for hidden Markov models
• Mixtures of linear regressions
• Pattern recognition and machine learning.
• Statistics for high-dimensional data. Methods, theory and applications.
• The hidden life of latent variables: Bayesian learning with mixed graph models

Cited in

(1)

• Reconstructing regime-dependent causal relationships from observational time series

Describes a project that uses

Uses Software

• CausalKinetiX
• JCI

This page was built for publication: Switching regression models and causal inference in the presence of discrete latent variables

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4969082)