Fast hyperbolic wavelet regression meets ANOVA
From MaRDI portal
Publication:6165230
Abstract: We use hyperbolic wavelet regression for the fast reconstruction of high-dimensional functions having only low dimensional variable interactions. Compactly supported periodic Chui-Wang wavelets are used for the tensorized hyperbolic wavelet basis. In a first step we give a self-contained characterization of tensor product Sobolev-Besov spaces on the -torus with arbitrary smoothness in terms of the decay of such wavelet coefficients. In the second part we perform and analyze scattered-data approximation using a hyperbolic cross type truncation of the basis expansion for the associated least squares method. The corresponding system matrix is sparse due to the compact support of the wavelets, which leads to a significant acceleration of the matrix vector multiplication. In case of i.i.d. samples we can even bound the approximation error with high probability by loosing only -terms that do not depend on compared to the best approximation. In addition, if the function has low effective dimension (i.e. only interactions of few variables), we qualitatively determine the variable interactions and omit ANOVA terms with low variance in a second step in order to increase the accuracy. This allows us to suggest an adapted model for the approximation. Numerical results show the efficiency of the proposed method.
Recommendations
- Variable transformations in combination with wavelets and ANOVA for high-dimensional approximation
- Grouped transformations and regularization in high-dimensional explainable ANOVA approximation
- Approximation of high-dimensional periodic functions with Fourier-based methods
- Learning multivariate functions with low-dimensional structures using polynomial bases
- ANOVA approximation with mixed tensor product basis on scattered points
Cites work
- scientific article; zbMATH DE number 52869 (Why is no real title available?)
- scientific article; zbMATH DE number 1049042 (Why is no real title available?)
- scientific article; zbMATH DE number 884917 (Why is no real title available?)
- A note on sampling recovery of multivariate functions in the uniform norm
- ANOVA kernels and RKHS of zero mean functions for model-based sensitivity analysis
- Approximation numbers of Sobolev embeddings-sharp constants and tractability
- Approximation of functions of few variables in high dimensions
- Approximation of high-dimensional periodic functions with Fourier-based methods
- Discrete least squares polynomial approximation with random evaluations - application to parametric and stochastic elliptic PDEs
- Error Estimates for Multivariate Regression on Discretized Function Spaces
- Estimating Mean Dimensionality of Analysis of Variance Decompositions
- Experiments: planning, analysis, and optimization
- Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates
- Hyperbolic cross approximation. Lecture notes given at the courses on constructive approximation and harmonic analysis, Barcelona, Spain, May 30 -- June 3, 2016
- Hyperbolic wavelet approximation
- Interpretable approximation of high-dimensional data
- Iterative Solution Methods
- Numerical Fourier analysis
- On decompositions of multivariate functions
- On the convergence rate of sparse grid least squares regression
- On the stability and accuracy of least squares approximations
- Optimal pointwise sampling for \(L^2\) approximation
- Optimal weighted least-squares methods
- Optimized tensor-product approximation spaces
- Regularity and approximability of electronic wave functions
- Sparse grid quadrature in high dimensions with applications in finance and insurance
- Sparse grids
- Sparse grids and applications. Selected contributions based on the presentations at the workshop, Bonn, Germany, May 16--20, 2011
- Sparse grids for boundary integral equations
- Support Vector Machines
- Ten Lectures on Wavelets
- Tensor products of Sobolev-Besov spaces and applications to approximation from the hyperbolic cross
- The smoothing effect of the ANOVA decomposition
- Tractability of multivariate problems. Volume I: Linear information
- Tractability of multivariate problems. Volume II: Standard information for functionals.
- Tractability of multivariate problems. Volume III: Standard information for operators
- User-friendly tail bounds for sums of random matrices
- Worst-case recovery guarantees for least squares approximation using random samples
- \(N\)-widths and \(\varepsilon \)-dimensions for high-dimensional approximations
Cited in
(3)
This page was built for publication: Fast hyperbolic wavelet regression meets ANOVA
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6165230)
