Theory of optimal Bayesian feature filtering
From MaRDI portal
Abstract: Optimal Bayesian feature filtering (OBF) is a supervised screening method designed for biomarker discovery. In this article, we prove two major theoretical properties of OBF. First, optimal Bayesian feature selection under a general family of Bayesian models reduces to filtering if and only if the underlying Bayesian model assumes all features are mutually independent. Therefore, OBF is optimal if and only if one assumes all features are mutually independent, and OBF is the only filter method that is optimal under at least one model in the general Bayesian framework. Second, OBF under independent Gaussian models is consistent under very mild conditions, including cases where the data is non-Gaussian with correlated features. This result provides conditions where OBF is guaranteed to identify the correct feature set given enough data, and it justifies the use of OBF in non-design settings where its assumptions are invalid.
Recommendations
- Toward a Fundamental Theory of Optimal Feature Selection: Part I
- scientific article; zbMATH DE number 702950
- A Bayesian boosting theorem
- Towards understanding sparse filtering: a theoretical perspective
- Model free feature screening with dependent variable in ultrahigh dimensional binary classification
Cites work
- scientific article; zbMATH DE number 6114088 (Why is no real title available?)
- scientific article; zbMATH DE number 3673348 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 1092005 (Why is no real title available?)
- scientific article; zbMATH DE number 777884 (Why is no real title available?)
- scientific article; zbMATH DE number 3426640 (Why is no real title available?)
- scientific article; zbMATH DE number 3357742 (Why is no real title available?)
- A review of Bayesian variable selection methods: what, how and which
- Bayesian Minimum Mean-Square Error Estimation for Classification Error—Part I: Definition and the Bayesian MMSE Error Estimator for Discrete Classification
- Bayesian Minimum Mean-Square Error Estimation for Classification Error—Part II: Linear Classification of Gaussian Models
- Bayesian Variable Selection in Linear Regression
- Bayesian variable selection and estimation for group Lasso
- Bayesian variable selection for probit mixed models applied to gene selection
- Bolstered error estimation
- Heterogeneous reciprocal graphical models
- Incorporating grouping information in Bayesian variable selection with applications in genomics
- Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray Experiments
- Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
- Nonlinear models using Dirichlet process mixtures
- Nonparametric Bayesian inference in biostatistics
- Performance of feature-selection methods in the classification of high-dimension data
- Probability Theory
- Scalable variational inference for Bayesian variable selection in regression, and its accuracy in genetic association studies
- Shared kernel Bayesian screening
- Spike and slab variable selection: frequentist and Bayesian strategies
- Statistical decision theory and Bayesian analysis. 2nd ed
- The Adaptive Lasso and Its Oracle Properties
- The Bayesian Lasso
- The Exact Likelihood Ratio Test for Equality of Two Normal Populations
- Two-sample Bayesian nonparametric hypothesis testing
Cited in
(2)
This page was built for publication: Theory of optimal Bayesian feature filtering
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2057352)
