A Statistical Learning Approach to Modal Regression
From MaRDI portal
Abstract: This paper studies the nonparametric modal regression problem systematically from a statistical learning view. Originally motivated by pursuing a theoretical understanding of the maximum correntropy criterion based regression (MCCR), our study reveals that MCCR with a tending-to-zero scale parameter is essentially modal regression. We show that nonparametric modal regression problem can be approached via the classical empirical risk minimization. Some efforts are then made to develop a framework for analyzing and implementing modal regression. For instance, the modal regression function is described, the modal regression risk is defined explicitly and its extit{Bayes} rule is characterized; for the sake of computational tractability, the surrogate modal regression risk, which is termed as the generalization risk in our study, is introduced. On the theoretical side, the excess modal regression risk, the excess generalization risk, the function estimation error, and the relations among the above three quantities are studied rigorously. It turns out that under mild conditions, function estimation consistency and convergence may be pursued in modal regression as in vanilla regression protocols, such as mean regression, median regression, and quantile regression. However, it outperforms these regression models in terms of robustness as shown in our study from a re-descending M-estimation view. This coincides with and in return explains the merits of MCCR on robustness. On the practical side, the implementation issues of modal regression including the computational algorithm and the tuning parameters selection are discussed. Numerical assessments on modal regression are also conducted to verify our findings empirically.
Recommendations
- Nonparametric statistical learning based on modal regression
- Regularized modal regression with data-dependent hypothesis spaces
- Empirical likelihood based modal regression
- Nonparametric modal regression
- A new regression model: modal linear regression
- Modal linear regression using log-concave distributions
- Modal regression estimation for linear models with longitudinal data
- Modal regression based on nonparametric quantile estimator
- Robust nonparametric regression and modality
- Statistical learning from a regression perspective
Cites work
- A new regression model: modal linear regression
- A nonparametric conditional mode estimate
- A Note on Ergodic Processes Prediction via Estimation of the Conditional Mode Function
- A note on prediction via estimation of the conditional mode function
- An Iterative Procedure for Estimating the Mode
- Consistency analysis of an empirical minimum error entropy algorithm
- Convexity, Classification, and Risk Bounds
- Correntropy: Properties and Applications in Non-Gaussian Signal Processing
- Estimation of the mode
- Functional time series prediction via conditional mode estimation
- Generalized Correntropy for Robust<?Pub _newline ?>Adaptive Filtering
- Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
- Information theoretic learning. Renyi's entropy and kernel perspectives
- Learning Theory
- Learning theory approach to minimum error entropy criterion
- Learning under \((1 + \epsilon)\)-moment conditions
- Learning with correntropy-induced losses for regression with mixture of symmetric stable noise
- Learning with the maximum correntropy criterion induced losses for regression
- Local modal regression
- Local Rademacher complexities
- Maximum likelihood estimation of isotonic modal regression
- Mode regression
- Modelling Beyond Regression Functions: An Application of Multimodal Regression to Speed–Flow Data
- Multi-kernel regularized classifiers
- Neural Network Learning
- Non linear parametric mode regression
- Non-parametric estimation of the conditional mode
- Nonparametric forecasting: a comparison of three kernel-based methods
- Nonparametric modal regression
- Nonparametric modal regression in the presence of measurement error
- On Estimation of a Probability Density Function and Mode
- On semiparametric mode regression estimation
- Optimal learning with Gaussians and correntropy loss
- Optimum kernel estimators
- Quadratic mode regression
- Rates of consistency for nonparametric estimation of the mode in absence of smoothness assumptions
- Regression towards the mode
- Robust Inference for Generalized Linear Models
- Robust Principal Component Analysis Based on Maximum Correntropy Criterion
- Robust variable selection for nonlinear models with diverging number of parameters
- Robust Variable Selection With Exponential Squared Loss
- Semiparametric econometric estimators for a truncated regression model: a review with an extension
- Semiparametric mixtures of nonparametric regressions
- Statistical behavior and consistency of classification methods based on convex risk minimization.
- Support Vector Machines
- The estimation of the gradient of a density function, with applications in pattern recognition
- The mode functional is not elicitable
Cited in
(51)- Nonparametric statistical learning based on modal regression
- Kernel-based maximum correntropy criterion with gradient descent method
- Some asymptotic properties of kernel regression estimators of the mode for stationary and ergodic continuous time processes
- Learning with correntropy-induced losses for regression with mixture of symmetric stable noise
- Quantile regression approach to conditional mode estimation
- Empirical likelihood based modal regression
- Error analysis on regularized regression based on the maximum correntropy criterion
- Modal additive models with data-driven structure identification
- Nonparametric modal regression
- Modal linear regression models with additive distortion measurement errors
- Modal regression based on nonparametric quantile estimator
- Modal regression models based on B-splines
- New insights into learning with correntropy-based regression
- A Framework of Learning Through Empirical Gain Maximization
- Comparison theorems on large-margin learning
- Learning theory of minimum error entropy under weak moment conditions
- Robust kernel-based distribution regression
- Regularized modal regression with data-dependent hypothesis spaces
- Online minimum error entropy algorithm with unbounded sampling
- Optimal learning with Gaussians and correntropy loss
- Half-quadratic alternating direction method of multipliers for robust orthogonal tensor approximation
- Robust estimation for nonrandomly distributed data
- Distributed penalized modal regression for massive data
- Statistical Inference with Local Optima
- Robust partially linear trend filtering for regression estimation and structure discovery
- Bootstrap Inference for Quantile-based Modal Regression
- Semiparametric partially linear varying coefficient modal regression
- Optimal subsampling for modal regression in massive data
- Maximum correntropy criterion regression models with tending-to-zero scale parameters
- Nonparametric modal regression with mixed variables and application to analyze the GDP data
- On the convergence of gradient descent for robust functional linear regression
- Large margin unified machines with non-i.i.d. process
- Fuzzy modeling using the similarity-based approximate reasoning system
- Conditional mode: an approach via smoothed quantile regression
- Maximum correntropy regression model with mixture of triangular noise
- Nonparametric spatial mode-oriented regression
- \textit{smoothEM}: a new approach for the simultaneous assessment of smooth patterns and spikes
- Mode-adaptive factor models
- A robust and efficient change point detection method for high-dimensional linear models
- Semiparametric modal regression with varying coefficients and measurement error
- Modal volatility function
- Online updating mode learning for streaming datasets
- Optimal Subsampling for Functional Quasi-Mode Regression with Big Data
- Semi-functional varying coefficient mode-based regression
- Modal regression models based on B-splines
- Tikhonov regularization for Gaussian empirical gain maximization in RKHS is consistent
- Advances in modal regression: from theoretical foundations to practical implementations
- Parametric modal regression with error contaminated covariates
- ModeKoff: a unified modal-based variable screening method for high-dimensional data with FDR control
- Learning under \((1 + \epsilon)\)-moment conditions
- On empirical estimation of mode based on weakly dependent samples
This page was built for publication: A Statistical Learning Approach to Modal Regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4969033)
