Holonomic extended least angle regression
From MaRDI portal
Publication:2221323
Abstract: One of the main problems studied in statistics is the fitting of models. Ideally, we would like to explain a large dataset with as few parameters as possible. There have been numerous attempts at automatizing this process. Most notably, the Least Angle Regression algorithm, or LARS, is a computationally efficient algorithm that ranks the covariates of a linear model. The algorithm is further extended to a class of distributions in the generalized linear model by using properties of the manifold of exponential families as dually flat manifolds. However this extension assumes that the normalizing constant of the joint distribution of observations is easy to compute. This is often not the case, for example the normalizing constant may contain a complicated integral. We circumvent this issue if the normalizing constant satisfies a holonomic system, a system of linear partial differential equations with a finite-dimensional space of solutions. In this paper we present a modification of the holonomic gradient method and add it to the extended LARS algorithm. We call this the holonomic extended least angle regression algorithm, or HELARS. The algorithm was implemented using the statistical software R, and was tested with real and simulated datasets.
Recommendations
- Least angle regression. (With discussion)
- Extended differential geometric LARS for high-dimensional GLMs with general dispersion parameter
- Holonomic gradient method for two-way contingency tables
- An ordinary differential equation-based solution path algorithm
- Estimation of exponential-polynomial distribution by holonomic gradient descent
Cites work
- <inline-formula> <tex-math notation="LaTeX">$\ell _{p}$ </tex-math></inline-formula>-Regularized Least Squares <inline-formula> <tex-math notation="LaTeX">$(0<p<1)$ </tex-math></inline-formula>
- L 1-Regularization Path Algorithm for Generalized Linear Models
- A family of embedded Runge-Kutta formulae
- A first course in numerical methods
- Algorithms for \(b\)-functions, restrictions, and algebraic local cohomology groups of \(D\)-modules
- An estimation procedure for contingency table models based on nested geometry
- Calculation of orthant probabilities by the holonomic gradient method
- Differential Geometric Least Angle Regression: A Differential Geometric Approach to Sparse Generalized Linear Models
- Edge selection based on the geometry of dually flat spaces for Gaussian graphical models
- Estimation of exponential-polynomial distribution by holonomic gradient descent
- Estimation of non-normalized statistical models by score matching
- Foundations of linear and generalized linear models
- Gröbner Bases
- Holonomic gradient descent and its application to the Fisher-Bingham integral
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Least angle regression. (With discussion)
- Model selection and estimation in the Gaussian graphical model
- Proper local scoring rules
Cited in
(2)
This page was built for publication: Holonomic extended least angle regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2221323)
