A constructive approach to the estimation of dimension reduction directions

DOI10.1214/009053607000000352MaRDI QIDQ129272zbMATH OpenOpenAlexFDO

Authors Yingcun Xia, Yingcun Xia

Publication date 1 December 2007

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/math/0701761, https://projecteuclid.org/euclid.aos/1201012976

zbMATH Keywords

conditional density functionconvergence of algorithmdouble-kernel smoothingefficient dimension reductionroot-\(n\) consistency

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Nonparametric statistical resampling methods (62G09) Characterization and structure theory for multivariate probability distributions; copulas (62H05)

Abstract: In this paper, we propose two new methods to estimate the dimension-reduction directions of the central subspace (CS) by constructing a regression model such that the directions are all captured in the regression mean. Compared with the inverse regression estimation methods (e.g. Li, 1991, 1992; Cook and Weisberg, 1991), the new methods require no strong assumptions on the design of covariates or the functional relation between regressors and the response variable, and have better performance than the inverse regression estimation methods for finite samples. Compared with the direct regression estimation methods (e.g. H"ardle and Stoker, 1989; Hristache, Juditski, Polzehl and Spokoiny, 2001; Xia, Tong, Li and Zhu, 2002), which can only estimate the directions of CS in the regression mean, the new methods can detect the directions of CS exhaustively. Consistency of the estimators and the convergence of corresponding algorithms are proved.

Recommendations

• Sliced Regression for Dimension Reduction
• Direction estimation in single-index regressions
• A semiparametric approach to dimension reduction
• On dimension reduction in regressions with multivariate responses
• On Directional Regression for Dimension Reduction

Cites work

• scientific article; zbMATH DE number 991833 (Why is no real title available?)
• scientific article; zbMATH DE number 3620754 (Why is no real title available?)
• scientific article; zbMATH DE number 1220060 (Why is no real title available?)
• scientific article; zbMATH DE number 1157169 (Why is no real title available?)
• scientific article; zbMATH DE number 4001209 (Why is no real title available?)
• scientific article; zbMATH DE number 1833046 (Why is no real title available?)
• scientific article; zbMATH DE number 837911 (Why is no real title available?)
• scientific article; zbMATH DE number 3256930 (Why is no real title available?)
• scientific article; zbMATH DE number 3334700 (Why is no real title available?)
• A constructive approach to the estimation of dimension reduction directions
• A general class of exponential inequalities for martingales and ratios
• ASYMPTOTIC DISTRIBUTIONS FOR TWO ESTIMATORS OF THE SINGLE-INDEX MODEL
• An Adaptive Estimation of Dimension Reduction Space
• Contour regression: a general approach to dimension reduction
• Dimension Reduction for the Conditionalkth Moment in Regression
• Dimension reduction for conditional mean in regression
• Direct Semiparametric Estimation of Single-Index Models with Discrete Covariates
• Direct estimation of the index coefficient in a single-index model
• Direction estimation in single-index regressions
• Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems
• Exploring Regression Structure Using Nonparametric Functional Estimation
• Investigating Smooth Multiple Regression by the Method of Average Derivatives
• Nonlinear time series. Nonparametric and parametric methods
• On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein's Lemma
• On semiparametric \(M\)-estimation in single-index regression
• Optimal smoothing in single-index models
• Principal Hessian Directions for regression with measurement error
• Sliced Inverse Regression for Dimension Reduction
• Structure adaptive approach for dimension reduction.
• Totally positive matrices
• Weak and strong uniform consistency of kernel regression estimates

Cited in

(only showing first 100 items - show all)

• An adaptive composite quantile approach to dimension reduction
• Successive direction extraction for estimating the central subspace in a multiple-index regres\-sion
• Concordance-based estimation approaches for the optimal sufficient dimension reduction score
• Dimension reduction and estimation in the secondary analysis of case-control studies
• Rank reducible varying coefficient model
• Heteroscedasticity checks for single index models
• A new algorithm for estimating the effective dimension-reduction subspace
• Estimation in linear regression models with measurement errors subject to single-indexed distortion
• Sufficient dimension reduction in regressions through cumulative Hessian directions
• Model-based reinforcement learning with dimension reduction
• Direction estimation in single-index regressions
• Projection expectile regression for sufficient dimension reduction
• General directional regression
• Estimation for single-index models via martingale difference divergence
• Direction estimation in single-index models via distance covariance
• A structured covariance ensemble for sufficient dimension reduction
• A constructive approach to the estimation of dimension reduction directions
• Quantile-slicing estimation for dimension reduction in regression
• Minimum average variance estimation with group Lasso for the multivariate response central mean subspace
• Sufficient dimension reduction for feasible and robust estimation of average causal effect
• Robust estimation for partial linear single-index models
• Estimating central subspaces via inverse third moments
• A brief review of linear sufficient dimension reduction through optimization
• Efficient estimation in sufficient dimension reduction
• Local linear regression on manifolds and its geometric interpretation
• A unified approach to sufficient dimension reduction
• A simple two-sample test in high dimensions based on \(L^2\)-norm
• Metric Learning via Cross-Validation
• Dimension reduction based on conditional multiple index density function
• On hybrid methods of inverse regression-based algorithms
• Sliced-Inverse-Regression--Aided Rotated Compressive Sensing Method for Uncertainty Quantification
• Distributed estimation in heterogeneous reduced rank regression: with application to order determination in sufficient dimension reduction
• A Semiparametric Approach to Model Effect Modification
• Covariate information matrix for sufficient dimension reduction
• On post dimension reduction statistical inference
• Estimating the conditional single-index error distribution with a partial linear mean regression
• Enhancing sparsity of Hermite polynomial expansions by iterative rotations
• Efficient estimation in heteroscedastic single-index models
• On IPW-based estimation of conditional average treatment effects
• MAVE
• Fusing sufficient dimension reduction with neural networks
• Surrogate space based dimension reduction for nonignorable nonresponse
• Functional sufficient dimension reduction through average Fréchet derivatives
• A Review on Sliced Inverse Regression, Sufficient Dimension Reduction, and Applications
• A note on structural adaptive dimension reduction
• Quasi-likelihood estimation of the single index conditional variance model
• Functional single index models for longitudinal data
• Direct estimation of the derivative of quadratic mutual information with application in supervised dimension reduction
• Improvement of some multidimensional estimates by reduction of dimensionality
• Contour projected dimension reduction
• A semiparametric approach to dimension reduction
• On efficient dimension reduction with respect to a statistical functional of interest
• An ensemble of inverse moment estimators for sufficient dimension reduction
• Sufficient dimension reduction via squared-loss mutual information estimation
• On Directional Regression for Dimension Reduction
• Sparse sufficient dimension reduction with heteroscedasticity
• A robust adaptive-to-model enhancement test for parametric single-index models
• Robust inference of conditional average treatment effects using dimension reduction
• Semiparametric marginal and association regression methods for clustered binary data
• Quantile based dimension reduction in censored regression
• Sufficient dimension reduction based on an ensemble of minimum average variance estimators
• Ensemble sufficient dimension folding methods for analyzing matrix-valued data
• Dimension reduction using the generalized gradient direction
• Local Walsh-average-based estimation and variable selection for single-index models
• Dimension reduction based on weighted variance estimate
• A Projective Approach to Conditional Independence Test for Dependent Processes
• Robust Inference for Nonstationary Time Series with Possibly Multiple Changing Periodic Structures
• A Novel Estimation Method in Generalized Single Index Models
• A post-screening diagnostic study for ultrahigh dimensional data
• An Outer-Product-of-Gradient Approach to Dimension Reduction and its Application to Classification in High Dimensional Space
• Penalized Weighted Variance Estimate for Dimension Reduction
• Conditional density estimation with dimensionality reduction via squared-loss conditional entropy minimization
• Online sparse sliced inverse regression for high-dimensional streaming data
• Sparse dimension reduction for survival data
• Single index Fréchet regression
• A METHOD OF LOCAL INFLUENCE ANALYSIS IN SUFFICIENT DIMENSION REDUCTION
• A note on the semiparametric approach to dimension reduction
• Robust dimension reduction using sliced inverse median regression
• Sufficient dimension reduction on marginal regression for gaps of recurrent events
• Advance of the sufficient dimension reduction
• Gradient-based kernel variable selection for support vector hazards machine
• Sufficient dimension reduction via direct estimation of the gradients of logarithmic conditional densities
• On forward sufficient dimension reduction for categorical and ordinal responses
• Model checking for regressions: an approach bridging between local smoothing and global smoothing methods
• Dimension reduction regressions with measurement errors subject to additive distortion
• Testing the Linear Mean and Constant Variance Conditions in Sufficient Dimension Reduction
• Estimation and variable selection for single-index models with non ignorable missing data
• High-dimensional variable screening under multicollinearity
• Distributed Sufficient Dimension Reduction for Heterogeneous Massive Data
• Central subspaces review: methods and applications
• On the single-index model estimate of the conditional density function: consistency and implementation
• Sufficient dimension reduction with simultaneous estimation of effective dimensions for time-to-event data
• Gradient-based approach to sufficient dimension reduction with functional or longitudinal covariates
• New forest-based approaches for sufficient dimension reduction
• Tail inverse regression: dimension reduction for prediction of extremes
• Robust MAVE through nonconvex penalized regression
• Semiparametric jump-preserving estimation for single-index models
• Sliced average variance estimation for tensor data
• Specification testing of partially linear single-index models: a groupwise dimension reduction-based adaptive-to-model approach
• Ultrahigh-dimensional sufficient dimension reduction for censored data with measurement error in covariates

This page was built for publication: A constructive approach to the estimation of dimension reduction directions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q129272)