A Statistical Learning Approach to Modal Regression
From MaRDI portal
Publication:4969033
Abstract: This paper studies the nonparametric modal regression problem systematically from a statistical learning view. Originally motivated by pursuing a theoretical understanding of the maximum correntropy criterion based regression (MCCR), our study reveals that MCCR with a tending-to-zero scale parameter is essentially modal regression. We show that nonparametric modal regression problem can be approached via the classical empirical risk minimization. Some efforts are then made to develop a framework for analyzing and implementing modal regression. For instance, the modal regression function is described, the modal regression risk is defined explicitly and its extit{Bayes} rule is characterized; for the sake of computational tractability, the surrogate modal regression risk, which is termed as the generalization risk in our study, is introduced. On the theoretical side, the excess modal regression risk, the excess generalization risk, the function estimation error, and the relations among the above three quantities are studied rigorously. It turns out that under mild conditions, function estimation consistency and convergence may be pursued in modal regression as in vanilla regression protocols, such as mean regression, median regression, and quantile regression. However, it outperforms these regression models in terms of robustness as shown in our study from a re-descending M-estimation view. This coincides with and in return explains the merits of MCCR on robustness. On the practical side, the implementation issues of modal regression including the computational algorithm and the tuning parameters selection are discussed. Numerical assessments on modal regression are also conducted to verify our findings empirically.
Recommendations
- Nonparametric statistical learning based on modal regression
- Regularized modal regression with data-dependent hypothesis spaces
- Empirical likelihood based modal regression
- Nonparametric modal regression
- A new regression model: modal linear regression
- Modal linear regression using log-concave distributions
- Modal regression estimation for linear models with longitudinal data
- Modal regression based on nonparametric quantile estimator
- Robust nonparametric regression and modality
- Statistical learning from a regression perspective
Cites work
- A Note on Ergodic Processes Prediction via Estimation of the Conditional Mode Function
- A new regression model: modal linear regression
- A nonparametric conditional mode estimate
- A note on prediction via estimation of the conditional mode function
- An Iterative Procedure for Estimating the Mode
- Consistency analysis of an empirical minimum error entropy algorithm
- Convexity, Classification, and Risk Bounds
- Correntropy: Properties and Applications in Non-Gaussian Signal Processing
- Estimation of the mode
- Functional time series prediction via conditional mode estimation
- Generalized Correntropy for Robust<?Pub _newline ?>Adaptive Filtering
- Global rates of convergence of the MLEs of log-concave and \(s\)-concave densities
- Information theoretic learning. Renyi's entropy and kernel perspectives
- Learning Theory
- Learning theory approach to minimum error entropy criterion
- Learning under \((1 + \epsilon)\)-moment conditions
- Learning with correntropy-induced losses for regression with mixture of symmetric stable noise
- Learning with the maximum correntropy criterion induced losses for regression
- Local Rademacher complexities
- Local modal regression
- Maximum likelihood estimation of isotonic modal regression
- Mode regression
- Modelling Beyond Regression Functions: An Application of Multimodal Regression to Speed–Flow Data
- Multi-kernel regularized classifiers
- Neural Network Learning
- Non linear parametric mode regression
- Non-parametric estimation of the conditional mode
- Nonparametric forecasting: a comparison of three kernel-based methods
- Nonparametric modal regression
- Nonparametric modal regression in the presence of measurement error
- On Estimation of a Probability Density Function and Mode
- On semiparametric mode regression estimation
- Optimal learning with Gaussians and correntropy loss
- Optimum kernel estimators
- Quadratic mode regression
- Rates of consistency for nonparametric estimation of the mode in absence of smoothness assumptions
- Regression towards the mode
- Robust Inference for Generalized Linear Models
- Robust Principal Component Analysis Based on Maximum Correntropy Criterion
- Robust Variable Selection With Exponential Squared Loss
- Robust variable selection for nonlinear models with diverging number of parameters
- Semiparametric econometric estimators for a truncated regression model: a review with an extension
- Semiparametric mixtures of nonparametric regressions
- Statistical behavior and consistency of classification methods based on convex risk minimization.
- Support Vector Machines
- The estimation of the gradient of a density function, with applications in pattern recognition
- The mode functional is not elicitable
Cited in
(35)- Learning with correntropy-induced losses for regression with mixture of symmetric stable noise
- Nonparametric modal regression with mixed variables and application to analyze the GDP data
- Half-quadratic alternating direction method of multipliers for robust orthogonal tensor approximation
- On empirical estimation of mode based on weakly dependent samples
- Distributed penalized modal regression for massive data
- Semiparametric partially linear varying coefficient modal regression
- On the convergence of gradient descent for robust functional linear regression
- Nonparametric statistical learning based on modal regression
- Statistical Inference with Local Optima
- Nonparametric modal regression
- Online minimum error entropy algorithm with unbounded sampling
- Robust kernel-based distribution regression
- Regularized modal regression with data-dependent hypothesis spaces
- Large margin unified machines with non-i.i.d. process
- Error analysis on regularized regression based on the maximum correntropy criterion
- Modal linear regression models with additive distortion measurement errors
- Bootstrap Inference for Quantile-based Modal Regression
- Modal regression based on nonparametric quantile estimator
- Comparison theorems on large-margin learning
- Modal additive models with data-driven structure identification
- Robust partially linear trend filtering for regression estimation and structure discovery
- Learning under \((1 + \epsilon)\)-moment conditions
- Empirical likelihood based modal regression
- Robust estimation for nonrandomly distributed data
- New insights into learning with correntropy-based regression
- Kernel-based maximum correntropy criterion with gradient descent method
- Fuzzy modeling using the similarity-based approximate reasoning system
- Modal regression models based on B-splines
- A Framework of Learning Through Empirical Gain Maximization
- Quantile regression approach to conditional mode estimation
- Optimal subsampling for modal regression in massive data
- Maximum correntropy criterion regression models with tending-to-zero scale parameters
- Learning theory of minimum error entropy under weak moment conditions
- Optimal learning with Gaussians and correntropy loss
- Some asymptotic properties of kernel regression estimators of the mode for stationary and ergodic continuous time processes
This page was built for publication: A Statistical Learning Approach to Modal Regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4969033)
