Spectral tensor-train decomposition
From MaRDI portal
Abstract: The accurate approximation of high-dimensional functions is an essential task in uncertainty quantification and many other fields. We propose a new function approximation scheme based on a spectral extension of the tensor-train (TT) decomposition. We first define a functional version of the TT decomposition and analyze its properties. We obtain results on the convergence of the decomposition, revealing links between the regularity of the function, the dimension of the input space, and the TT ranks. We also show that the regularity of the target function is preserved by the univariate functions (i.e., the "cores") comprising the functional TT decomposition. This result motivates an approximation scheme employing polynomial approximations of the cores. For functions with appropriate regularity, the resulting extit{spectral tensor-train decomposition} combines the favorable dimension-scaling of the TT decomposition with the spectral convergence rate of polynomial approximations, yielding efficient and accurate surrogates for high-dimensional functions. To construct these decompositions, we use the sampling algorithm exttt{TT-DMRG-cross} to obtain the TT decomposition of tensors resulting from suitable discretizations of the target function. We assess the performance of the method on a range of numerical examples: a modifed set of Genz functions with dimension up to , and functions with mixed Fourier modes or with local features. We observe significant improvements in performance over an anisotropic adaptive Smolyak approach. The method is also used to approximate the solution of an elliptic PDE with random input data. The open source software and examples presented in this work are available online.
Recommendations
- A continuous analogue of the tensor-train decomposition
- Tensor-product approximation to operators and functions in high dimensions
- TT ranks of approximate tensorizations of some smooth functions
- \(O(d \log N)\)-quantics approximation of \(N\)-\(d\) tensors in high-dimensional numerical modeling
- Higher-order principal component analysis for the approximation of tensors in tree-based low-rank formats
Cites work
- \(O(d \log N)\)-quantics approximation of \(N\)-\(d\) tensors in high-dimensional numerical modeling
- A Jacobi-Type Method for Computing Orthogonal Tensor Decompositions
- A least-squares approximation of partial differential equations with high-dimensional random inputs
- A literature survey of low-rank tensor approximation techniques
- A new scheme for the tensor representation
- Adaptive Smolyak Pseudospectral Approximations
- An Anisotropic Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
- Analysis of individual differences in multidimensional scaling via an \(n\)-way generalization of ``Eckart-Young decomposition
- Approximation of 2d²^d matrices using tensor decomposition
- Approximation rates for the hierarchical tensor format in periodic Sobolev spaces
- Calculation of Gauss Quadrature Rules
- Chebyshev and Fourier spectral methods.
- Constructive representation of functions in low-rank tensor formats
- Continuous analogues of matrix factorizations
- Efficient low-rank approximation of the stochastic Galerkin matrix in tensor formats
- Generalized spectral decomposition for stochastic nonlinear problems
- Hierarchical Singular Value Decomposition of Tensors
- High dimensional polynomial interpolation on sparse grids
- High-Order Collocation Methods for Differential Equations with Random Inputs
- How to find a good submatrix
- scientific article; zbMATH DE number 3787516 (Why is no real title available?)
- scientific article; zbMATH DE number 3574390 (Why is no real title available?)
- scientific article; zbMATH DE number 3599198 (Why is no real title available?)
- scientific article; zbMATH DE number 3605460 (Why is no real title available?)
- scientific article; zbMATH DE number 1012640 (Why is no real title available?)
- scientific article; zbMATH DE number 2107939 (Why is no real title available?)
- scientific article; zbMATH DE number 3321507 (Why is no real title available?)
- scientific article; zbMATH DE number 5179816 (Why is no real title available?)
- Implementing Spectral Methods for Partial Differential Equations
- Karhunen-Loève approximation of random fields by generalized fast multipole methods
- Model reduction based on proper generalized decomposition for the stochastic steady incompressible Navier-Stokes equations
- Non-intrusive low-rank separated approximation of high-dimensional stochastic models
- On selecting a maximum volume sub-matrix of a matrix and related problems
- Polynomial Chaos Expansion of Random Coefficients and the Solution of Stochastic Partial Differential Equations in the Tensor Train Format
- Polynomial interpolation results in Sobolev spaces
- Proper generalized decompositions and separated representations for the numerical solution of high dimensional stochastic problems
- Pseudo-skeleton approximations by matrices of maximal volume
- Quantics-TT collocation approximation of parameter-dependent and stochastic elliptic PDEs
- Sampling and low-rank tensor approximation of the response surface
- Solving stochastic systems with low-rank tensor compression
- Sparse pseudospectral approximation method
- Spectral Methods
- Tensor approximations of matrices generated by asymptotically smooth functions
- Tensor Decompositions and Applications
- Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem
- Tensor spaces and numerical tensor calculus
- Tensor-structured Galerkin approximation of parametric and stochastic elliptic PDEs
- Tensor-train decomposition
- The best \(L^ 2\)-approximation by finite sums of functions with separable variables
- The Eigen-Values and Singular Values of Integral Equations†
- The Mathematical Theory of Finite Element Methods
- The Optimum Addition of Points to Quadrature Formulae
- The proper generalized decomposition for advanced numerical simulations. A primer
- To be or not to be intrusive? The solution of parametric and stochastic equations -- the ``plain vanilla Galerkin case
- TT-cross approximation for multidimensional arrays
Cited in
(50)- On the spectral problem for trivariate functions
- A continuous analogue of the tensor-train decomposition
- M-PCM-OFFD: an effective output statistics estimation method for systems of high dimensional uncertainties subject to low-order parameter interactions
- Rank-adaptive tensor methods for high-dimensional nonlinear PDEs
- Faster tensor train decomposition for sparse data
- Efficient randomized tensor-based algorithms for function approximation and low-rank kernel interactions
- Deep composition of tensor-trains using squared inverse Rosenblatt transports
- Dynamic tensor approximation of high-dimensional nonlinear PDEs
- Tensor-train decomposition for image recognition
- FFT-based homogenisation accelerated by low-rank tensor approximations
- Global optimization based on TT-decomposition
- Approximation and sampling of multivariate probability distributions in the tensor train decomposition
- Gradient-based optimization for regression in the functional tensor-train format
- A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
- Analysis of tensor approximation schemes for continuous functions
- Tensor algorithms for advanced sensitivity metrics
- Functional Tucker approximation using Chebyshev interpolation
- Rank bounds for approximating Gaussian densities in the tensor-train format
- SOTT: greedy approximation of a tensor as a sum of tensor trains
- Performance of the low-rank TT-SVD for large dense tensors on modern multicore CPUs
- Spectrum Cartography via Coupled Block-Term Tensor Decomposition
- Tensor ring decomposition: optimization landscape and one-loop convergence of alternating least squares
- Sparse low-rank separated representation models for learning from data
- Efficient uncertainty quantification of a fully nonlinear and dispersive water wave model with random inputs
- Low-rank approximation of continuous functions in Sobolev spaces with dominating mixed smoothness
- Low-rank tensor methods for partial differential equations
- Generative modeling via tensor train sketching
- Data-Driven Tensor Train Gradient Cross Approximation for Hamilton–Jacobi–Bellman Equations
- Probabilistic partition of unity networks for high‐dimensional regression problems
- State estimation in nonlinear parametric time dependent systems using tensor train
- Tensor rank reduction via coordinate flows
- Black Box Approximation in the Tensor Train Format Initialized by ANOVA Decomposition
- Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction
- Approximation by tree tensor networks in high dimensions: Sobolev and compositional functions
- Active Learning of Tree Tensor Networks using Optimal Least Squares
- Deep Importance Sampling Using Tensor Trains with Application to a Priori and a Posteriori Rare Events
- Efficient quadratures for high-dimensional Bayesian data assimilation
- Computing statistical moments via tensorization of polynomial chaos expansions
- Learning to solve Bayesian inverse problems: an amortized variational inference approach using Gaussian and flow guides
- Approximation in the extended functional tensor train format
- Tensor nonconvex unified prior for tensor recovery
- The generalized tensor decomposition with heterogeneous tensor product for third-order tensors
- Tensor train approximation of multivariate Gaussian density by scaling and squaring
- Approximating maps into manifolds with lower curvature bounds
- Coordinate-adaptive integration of PDEs on tensor manifolds
- A tensor-train reduced basis solver for parameterized partial differential equations on Cartesian grids
- Weighted sparsity and sparse tensor networks for least squares approximation
- Generative learning of continuous data by tensor networks
- Inverse graph limit problem of the graphon multi-agent systems
- Iterative algorithms for the post-processing of high-dimensional data
This page was built for publication: Spectral tensor-train decomposition
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2818241)
