Markov Neighborhood Regression for High-Dimensional Inference
From MaRDI portal
Computational methods for problems pertaining to statistics (62-08) Nonparametric regression and quantile regression (62G08) Probabilistic graphical models (62H22) Applications of statistics to biology and medical sciences; meta analysis (62P10) Learning and adaptive systems in artificial intelligence (68T05)
Abstract: This paper proposes an innovative method for constructing confidence intervals and assessing p-values in statistical inference for high-dimensional linear models. The proposed method has successfully broken the high-dimensional inference problem into a series of low-dimensional inference problems: For each regression coefficient , the confidence interval and -value are computed by regressing on a subset of variables selected according to the conditional independence relations between the corresponding variable and other variables. Since the subset of variables forms a Markov neighborhood of in the Markov network formed by all the variables , the proposed method is coined as Markov neighborhood regression. The proposed method is tested on high-dimensional linear, logistic and Cox regression. The numerical results indicate that the proposed method significantly outperforms the existing ones. Based on the Markov neighborhood regression, a method of learning causal structures for high-dimensional linear models is proposed and applied to identification of drug sensitive genes and cancer driver genes. The idea of using conditional independence relations for dimension reduction is general and potentially can be extended to other high-dimensional or big data problems as well.
Recommendations
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Estimation of high-dimensional partially-observed discrete Markov random fields
- Consistent estimation of the basic neighborhood of Markov random fields
- Two-Sample Inference for High-Dimensional Markov Networks
- High Dimensional Inference With Random Maximum A-Posteriori Perturbations
- Markov-modulated multivariate linear regression
- Fast Markov Chain Monte Carlo for High-Dimensional Bayesian Regression Models With Shrinkage Priors
- A nonparametric Bayesian technique for high-dimensional regression
- High-dimensional empirical likelihood inference
- Nearest neighbor regression estimation for null-recurrent Markov time series
Cites work
- \(p\)-values for high-dimensional regression
- A Direct Approach to False Discovery Rates
- A significance test for the lasso
- A split-and-merge Bayesian variable selection approach for ultrahigh dimensional regression
- An Equivalent Measure of Partial Correlation Coefficients for High-Dimensional Gaussian Graphical Models
- Asymptotic properties of Lasso+mLS and Lasso+Ridge in sparse high-dimensional linear regression
- Bayesian Subset Modeling for High-Dimensional Generalized Linear Models
- Causation, prediction, and search
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Confidence intervals for low dimensional parameters in high dimensional linear models
- Estimating the false discovery rate using the stochastic approximation algorithm
- Exact post-selection inference, with application to the Lasso
- Group Bound: Confidence Intervals for Groups of Variables in Sparse High Dimensional Regression Without Assumptions on the Design
- High-dimensional graphs and variable selection with the Lasso
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- High-dimensional variable selection
- High-dimensional variable selection with reciprocal \(L_{1}\)-regularization
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- scientific article; zbMATH DE number 3624650 (Why is no real title available?)
- scientific article; zbMATH DE number 1134987 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Learning Moral Graphs in Construction of High-Dimensional Bayesian Networks for Mixed Data
- Local causal and Markov blanket induction for causal discovery and feature selection for classification. Part I: Algorithms and empirical evaluation
- Model selection and estimation in the Gaussian graphical model
- Nearly unbiased variable selection under minimax concave penalty
- Nonconcave penalized likelihood with a diverging number of parameters.
- On asymptotically optimal confidence regions and tests for high-dimensional models
- On the conditions used to prove oracle results for the Lasso
- Partial likelihood
- Rates of convergence of the adaptive LASSO estimators to the oracle distribution and higher order refinements by the bootstrap
- Relaxed Lasso
- Shotgun Stochastic Search for “Largep” Regression
- Sparse inverse covariance estimation with the graphical lasso
- Statistical significance in high-dimensional linear models
- Statistics for high-dimensional data. Methods, theory and applications.
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- Sure independence screening in generalized linear models with NP-dimensionality
- Uniform post-selection inference for least absolute deviation regression and other Z-estimation problems
- Using Markov blankets for causal structure learning
- Valid post-selection inference
- Variable selection and dependency networks for genomewide data
- Variable selection in high-dimensional linear models: partially faithful distributions and the PC-simple algorithm
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variance estimation using refitted cross-validation in ultrahigh dimensional regression
Cited in
(11)- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- A perturbation method for inference on regularized regression estimates
- Drawing inferences for high-dimensional linear models: a selection-assisted partial regression and smoothing approach
- scientific article; zbMATH DE number 6253918 (Why is no real title available?)
- Statistical inference and large-scale multiple testing for high-dimensional regression models
- Time-varying dynamic Bayesian network learning for an fMRI study of emotion processing
- Bayesian Structure Learning in Undirected Gaussian Graphical Models: Literature Review with Empirical Comparison
- Hub Detection in Gaussian Graphical Models
- A novel framework for online supervised learning with feature selection
- Extended fiducial inference: toward an automated process of statistical inference
- Extended fiducial inference for individual treatment effects via deep neural networks
This page was built for publication: Markov Neighborhood Regression for High-Dimensional Inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5881128)
