Information Theory and Mixing Least-Squares Regressions

DOI10.1109/TIT.2006.878172zbMath1309.94051MaRDI QIDQ3548098

Publication date: 21 December 2008

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Mathematics Subject Classification ID

Bayesian problems; characterization of Bayes procedures (62C10) Information theory (general) (94A15) Statistical aspects of information-theoretic topics (62B10)

Related Items

Model averaging for generalized linear models in fragmentary data prediction, Optimal Model Averaging Based on Generalized Method of Moments, Model averaging assisted sufficient dimension reduction, Model averaging for interval-valued data, Mallows model averaging with effective model size in fragmentary data prediction, Recursive SURE for iterative reweighted least square algorithms, Solution of linear ill-posed problems by model selection and aggregation, PAC-Bayesian high dimensional bipartite ranking, Performance Assessment of High-dimensional Variable Identification, Consistency of BIC Model Averaging, Semiparametric model averaging prediction for dichotomous response, On improvability of model selection by model averaging, Mixing partially linear regression models, Cross-validation-based model averaging in linear models with response missing at random, Choice of weights in FMA estimators under general parametric models, Ordered smoothers with exponential weighting, Frequentist model averaging estimation for the censored partial linear quantile regression model, Exponential weights in multivariate regression and a low-rankness favoring prior, An oracle inequality for quasi-Bayesian nonnegative matrix factorization, Exponential weighting and oracle inequalities for projection estimates, Model averaging procedure for partially linear single-index models, Toward optimal model averaging in regression models with time series errors, Bayesian linear regression with sparse priors, Toward an objective and reproducible model choice via variable selection deviation, Non-local methods with shape-adaptive patches (NLM-SAP), AN ASYMPTOTIC THEORY FOR LEAST SQUARES MODEL AVERAGING WITH NESTED MODELS, PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting, Aggregation of predictors for nonstationary sub-linear processes and online adaptive forecasting of time varying autoregressive processes, Inference and Estimation for Random Effects in High-Dimensional Linear Mixed Models, Frequentist Model Averaging for Undirected Gaussian Graphical Models, Optimal model averaging based on forward-validation, User-friendly Introduction to PAC-Bayes Bounds, Sharp oracle inequalities for aggregation of affine estimators, Focused information criterion and model averaging for generalized additive partial linear models, A Scalable Frequentist Model Averaging Method, Simple proof of the risk bound for denoising by exponential weights for asymmetric noise distributions, Theory of adaptive estimation, Model averaging for varying-coefficient partially linear measurement error models, Optimal model selection in heteroscedastic regression using piecewise polynomial functions, Spatial weights matrix selection and model averaging for spatial autoregressive models, Sparse regression learning by aggregation and Langevin Monte-Carlo, PAC-Bayesian bounds for sparse regression estimation with exponential weights, On the optimality of the aggregate with exponential weights for low temperatures, Mirror averaging with sparsity priors, Model averaging by jackknife criterion in models with dependent data, Estimator selection with respect to Hellinger-type risks, Adaptively combined forecasting for discrete response time series, A general framework for Bayes structured linear models, Parsimonious Model Averaging With a Diverging Number of Parameters, Frequentist model averaging with missing observations, Concentration inequalities for the exponential weighting method, Aggregation of affine estimators, Estimation and variable selection with exponential weights, Statistical inference in compound functional models, Focused vector information criterion model selection and model averaging regression with missing response, Frequentist model averaging estimation: a review, Model averaging with covariates that are missing completely at random, Bayesian fractional posteriors, Aggregation for Gaussian regression, Simultaneous adaptation to the margin and to complexity in classification, RECURSIVE FORECAST COMBINATION FOR DEPENDENT HETEROGENEOUS DATA, Optimal bounds for aggregation of affine estimators, Learning by mirror averaging, Structured, Sparse Aggregation, Least squares model averaging by Mallows criterion, Exponential screening and optimal rates of sparse estimation, Estimator selection in the Gaussian setting, On some recent advances on high dimensional Bayesian statistics, Model averaging estimator in ridge regression and its large sample properties, High-dimensional regression with unknown variance, Sparse estimation by exponential weighting, Mixing least-squares estimators when the variance is unknown, Generalized mirror averaging and \(D\)-convex aggregation, Minimax predictive density for sparse count data, Inference without compatibility: using exponential weighting for inference on a parameter of a linear model, On the exponentially weighted aggregate with the Laplace prior, A MOM-based ensemble method for robustness, subsampling and hyperparameter tuning, Aggregation by exponential weighting, sharp PAC-Bayesian bounds and sparsity, Least squares model averaging based on generalized cross validation, USING MACRO DATA TO OBTAIN BETTER MICRO FORECASTS, Second-order Stein: SURE for SURE and other applications in high-dimensional inference, Sharp oracle inequalities for low-complexity priors, Model averaging for multiple quantile regression with covariates missing at random, Localized Gaussian width of \(M\)-convex hulls with applications to Lasso and convex aggregation, Sparsity Oriented Importance Learning for High-Dimensional Linear Regression, Nonstructural analysis of productivity growth for the industrialized countries: a jackknife model averaging approach, Focused Information Criterion and Model Averaging in Quantile Regression, Online learning and forecast combination in unbalanced panels, Distribution theory of the least squares averaging estimator, Model selection and model averaging for semiparametric partially linear models with missing data, Interval Estimation by Frequentist Model Averaging, Adaptive estimation over anisotropic functional classes via oracle approach, Jackknife model averaging for quantile regressions