Multi-target regression via input space expansion: treating targets as inputs
From MaRDI portal
Publication:1689552
Abstract: In many practical applications of supervised learning the task involves the prediction of multiple target variables from a common set of input variables. When the prediction targets are binary the task is called multi-label classification, while when the targets are continuous the task is called multi-target regression. In both tasks, target variables often exhibit statistical dependencies and exploiting them in order to improve predictive accuracy is a core challenge. A family of multi-label classification methods address this challenge by building a separate model for each target on an expanded input space where other targets are treated as additional input variables. Despite the success of these methods in the multi-label classification domain, their applicability and effectiveness in multi-target regression has not been studied until now. In this paper, we introduce two new methods for multi-target regression, called Stacked Single-Target and Ensemble of Regressor Chains, by adapting two popular multi-label classification methods of this family. Furthermore, we highlight an inherent problem of these methods - a discrepancy of the values of the additional input variables between training and prediction - and develop extensions that use out-of-sample estimates of the target variables during training in order to tackle this problem. The results of an extensive experimental evaluation carried out on a large and diverse collection of datasets show that, when the discrepancy is appropriately mitigated, the proposed methods attain consistent improvements over the independent regressions baseline. Moreover, two versions of Ensemble of Regression Chains perform significantly better than four state-of-the-art methods including regularization-based multi-task learning methods and a multi-objective random forest approach.
Recommendations
- Multi-target prediction: a unifying view on problems and methods
- scientific article; zbMATH DE number 6276187
- Multi-target support vector regression via correlation regressor chains
- Multi-task regression using minimal penalties
- Ensembles for multi-target regression with random output selections
- Multi-output regression on the output manifold
- Feature ranking for multi-target regression
- Least square regularized regression for multitask learning
- Multi-label classification via multi-target regression on data streams
Cites work
- scientific article; zbMATH DE number 5957307 (Why is no real title available?)
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 1086070 (Why is no real title available?)
- scientific article; zbMATH DE number 6253944 (Why is no real title available?)
- scientific article; zbMATH DE number 6276187 (Why is no real title available?)
- A Dirty Model for Multiple Sparse Regression
- Approximations of the critical region of the fbietkan statistic
- Bagging predictors
- Combining instance-based learning and logistic regression for multilabel classification
- Computationally efficient convolved multiple output Gaussian processes
- Convex multi-task feature learning
- Efficient Monte Carlo methods for multi-dimensional learning with classifier chains
- First order regression
- Kernels for vector-valued functions: a review
- Modern Multivariate Statistical Techniques
- Multi-target regression via input space expansion: treating targets as inputs
- Multilabel classification with principal label space transformation
- Multivariate regression analysis and canonical variates
- Not all traces on the circle come from functions of least gradient in the disk
- On label dependence and loss minimization in multi-label classification
- Reduced-rank regression for the multivariate linear model
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- Statistical comparisons of classifiers over multiple data sets
- Stochastic gradient boosting.
- The elements of statistical learning. Data mining, inference, and prediction
Cited in
(26)- Prediction of arch dam deformation via correlated multi-target stacking
- Fast and accurate pseudoinverse with sparse matrix reordering and incremental approach
- Incremental predictive clustering trees for online semi-supervised multi-target regression
- Regularization-based model tree for multi-output regression
- Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency
- Interpretable multi-label classification by means of multivariate linear regression
- A deep multitask learning approach for air quality prediction
- Progressive random \(k\)-labelsets for cost-sensitive multi-label classification
- Multi-label classification with weighted classifier selection and stacked ensemble
- scientific article; zbMATH DE number 6276187 (Why is no real title available?)
- Multi-target prediction: a unifying view on problems and methods
- Learning-augmented heuristics for scheduling parallel serial-batch processing machines
- Model averaging for sparse seemingly unrelated regression using Bayesian networks among the errors
- An ensemble-adaptive tree-based chain framework for multi-target regression problems
- Alternating DCA for reduced-rank multitask linear regression with covariance matrix estimation
- Multi-target support vector regression via correlation regressor chains
- Orthogonal canonical correlation analysis and applications
- Ensembles for multi-target regression with random output selections
- Feature ranking for multi-target regression
- Multi-label classification via multi-target regression on data streams
- A modified primal-dual algorithm for matrix completion problems
- Robust multi-target regression with improved stochastic configuration networks and its applications
- An improved inertial alternating direction method for low rank matrix completion problems
- Multi-target regression via input space expansion: treating targets as inputs
- JGPR: a computationally efficient multi-target Gaussian process regression algorithm
- Parsimonious mixture-of-experts based on mean mixture of multivariate normal distributions
This page was built for publication: Multi-target regression via input space expansion: treating targets as inputs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1689552)
