Tensor networks and hierarchical tensors for the solution of high-dimensional partial differential equations

DOI10.1007/s10208-016-9317-9zbMath1357.65153OpenAlexW2343408237MaRDI QIDQ506609

Markus Bachmayr, André Uschmajew, Reinhold Schneider

Publication date: 1 February 2017

Published in: Foundations of Computational Mathematics (Search for Journal in Brave)

Full work available at URL: https://depositonce.tu-berlin.de/handle/11303/15835

zbMATH Keywords

Fokker-Planck equationsingular value decompositionLangevin equationRiemannian manifoldsSchrödinger equationmolecular dynamicslow-rank approximationuncertainty quantificationhierarchical tensorshigh-dimensional partial differential equationstruncated iteration methods

Mathematics Subject Classification ID

NLS equations (nonlinear Schrödinger equations) (35Q55) PDEs in connection with quantum mechanics (35Q40) Fokker-Planck equations (35Q84) Numerical solution of discretized equations for initial value and initial-boundary value problems involving PDEs (65M22)

Related Items

Dynamic tensor approximation of high-dimensional nonlinear PDEs ⋮ Rank-Adaptive Time Integration of Tree Tensor Networks ⋮ Low-rank tensor reconstruction of concentrated densities with application to Bayesian inversion ⋮ Tensor rank bounds for point singularities in \(\mathbb{R}^3\) ⋮ Learning with tree tensor networks: complexity estimates and model selection ⋮ The Optimization Landscape for Fitting a Rank-2 Tensor with a Rank-1 Tensor ⋮ Solving phase-field models in the tensor train format to generate microstructures of bicontinuous composites ⋮ Particle number conservation and block structures in matrix product states ⋮ Multilevel Picard approximations of high-dimensional semilinear partial differential equations with locally monotone coefficient functions ⋮ Approximating Optimal feedback Controllers of Finite Horizon Control Problems Using Hierarchical Tensor Formats ⋮ Quantized Tensor FEM for Multiscale Problems: Diffusion Problems in Two and Three Dimensions ⋮ A parallel low-rank solver for the six-dimensional Vlasov-Maxwell equations ⋮ Adaptive Nonintrusive Reconstruction of Solutions to High-Dimensional Parametric PDEs ⋮ A posteriori error analysis and adaptivity for high-dimensional elliptic and parabolic boundary value problems ⋮ Low-rank tensor methods for partial differential equations ⋮ Perturbation of Higher-Order Singular Values ⋮ Implicit integration of nonlinear evolution equations on tensor manifolds ⋮ Streaming Tensor Train Approximation ⋮ Approximation theory of tree tensor networks: tensorized univariate functions ⋮ Constrained Optimization with Low-Rank Tensors and Applications to Parametric Problems with PDEs ⋮ Geometry of tree-based tensor formats in tensor Banach spaces ⋮ Tensor rank reduction via coordinate flows ⋮ Numerical solution of a class of third order tensor linear equations ⋮ Pricing High-Dimensional Bermudan Options with Hierarchical Tensor Formats ⋮ High-dimensional density estimation with tensorizing flow ⋮ Active Learning of Tree Tensor Networks using Optimal Least Squares ⋮ Stochastic Methods for Solving High-Dimensional Partial Differential Equations ⋮ Numerical methods for the deterministic second moment equation of parabolic stochastic PDEs ⋮ The numerical approximation of nonlinear functionals and functional differential equations ⋮ Stability of low-rank tensor representations and structured multilevel preconditioning for elliptic PDEs ⋮ HT-AWGM: a hierarchical Tucker-adaptive wavelet Galerkin method for high-dimensional elliptic problems ⋮ Dynamically orthogonal tensor methods for high-dimensional nonlinear PDEs ⋮ Higher-order principal component analysis for the approximation of tensors in tree-based low-rank formats ⋮ Sampling-free Bayesian inversion with adaptive hierarchical tensor representations ⋮ Geometric Methods on Low-Rank Matrix and Tensor Manifolds ⋮ Adaptive Hierarchical Subtensor Partitioning for Tensor Compression ⋮ Parallel tensor methods for high-dimensional linear PDEs ⋮ Efficient tree decomposition of high-rank tensors ⋮ Spectral methods for nonlinear functionals and functional differential equations ⋮ Prospects of tensor-based numerical modeling of the collective electrostatics in many-particle systems ⋮ Rank-adaptive tensor methods for high-dimensional nonlinear PDEs ⋮ Variational Monte Carlo -- bridging concepts of machine learning and high-dimensional partial differential equations ⋮ Tree-based tensor formats ⋮ Correlation length in random MPS and PEPS ⋮ Existence of dynamical low-rank approximations to parabolic problems ⋮ Non-intrusive tensor reconstruction for high-dimensional random PDEs ⋮ Adaptive stochastic Galerkin FEM for lognormal coefficients in hierarchical tensor representations ⋮ Stability analysis of hierarchical tensor methods for time-dependent PDEs ⋮ Mathematical methods in quantum molecular dynamics. Abstracts from the workshop held April 21--27, 2019 ⋮ Adaptive low-rank approximations for operator equations: Accuracy control and computational complexity ⋮ Stable als approximation in the TT-format for rank-adaptive tensor completion ⋮ Committor functions via tensor networks ⋮ Approximative Policy Iteration for Exit Time Feedback Control Problems Driven by Stochastic Differential Equations using Tensor Train Format ⋮ The linear span of uniform matrix product states

Uses Software

• LOBPCG
• ALEA
• MCTDH
• CheMPS2

Cites Work

• Fast Solution of Parabolic Problems in the Tensor Train/Quantized Tensor Train Format with Initial Application to the Fokker--Planck Equation
• Stochastic Processes and Applications
• Fundamentals of reduced basis method for problems governed by parametrized PDEs and applications
• Time Integration of Tensor Trains
• Tensor Spaces and Hierarchical Tensor Representations
• Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem
• Most Tensor Problems Are NP-Hard
• A projection method to solve linear systems in tensor format
• Preconditioned Low-Rank Methods for High-Dimensional Elliptic PDE Eigenvalue Problems
• Applied Multiway Data Analysis
• Signal Recovery by Proximal Forward-Backward Splitting
• Algorithms for Numerical Analysis in High Dimensions
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Tensor Decompositions and Applications
• Tensor-Train Decomposition
• TT-cross approximation for multidimensional arrays
• Computation of extreme eigenvalues in higher dimensions using block tensor train format
• Tensor-sparsity of solutions to high-dimensional elliptic partial differential equations
• CheMPS2: a free open-source spin-adapted implementation of the density matrix renormalization group for ab initio quantum chemistry
• A mathematical introduction to compressive sensing
• \(L^{\infty}\) estimation of tensor truncations
• The geometry of algorithms using hierarchical tensors
• On the approximation of high-dimensional differential equations in the hierarchical Tucker format
• Low-rank tensor completion by Riemannian optimization
• Proper generalized decomposition for nonlinear convex problems in tensor Banach spaces
• Adaptive stochastic Galerkin FEM
• Superfast wavelet transform using quantics-TT approximation. I: Application to Haar wavelets.
• The Hackbusch conjecture on tensor formats
• Convergence rates of best \(N\)-term Galerkin approximations for a class of elliptic SPDEs
• The density-matrix renormalization group in the age of matrix product states
• Tensorisation of vectors and their efficient convolution
• \(O(d \log N)\)-quantics approximation of \(N\)-\(d\) tensors in high-dimensional numerical modeling
• Iterative hard thresholding for compressed sensing
• Recursive decomposition of multidimensional tensors
• A new tensor decomposition
• Nonlinear tensor product approximation of functions
• Adaptive near-optimal rank tensor approximation for high-dimensional operator equations
• On low-rank approximability of solutions to high-dimensional operator equations and eigenvalue problems
• Approximate iterations for structured matrices
• From quantum to classical molecular dynamics: Reduced models and numerical analysis.
• Well-posedness of convex maximization problems on Stiefel manifolds and orthogonal tensor product approximations
• Finitely correlated states on quantum spin chains
• Critical points of matrix least squares distance functions
• Quantized tensor-structured finite elements for second-order elliptic PDEs in two dimensions
• Optimization problems in contracted tensor networks
• Existence and computation of low Kronecker-rank approximations for large linear systems of tensor product structure
• On minimal subspaces in tensor representations
• Black box approximation of tensors in hierarchical Tucker format
• Musings on multilinear fitting
• Variational calculus with sums of elementary tensors of fixed rank
• Tree-based tensor formats
• A new scheme for the tensor representation
• Optimization on the hierarchical Tucker manifold - applications to tensor completion
• Adaptive stochastic Galerkin FEM with hierarchical tensor representations
• Low rank tensor recovery via iterative hard thresholding
• Iterative methods based on soft thresholding of hierarchical tensors
• On manifolds of tensors of fixed TT-rank
• An introduction to hierarchical (\(\mathcal H\)-) rank and TT-rank of tensors with examples
• Approximation rates for the hierarchical tensor format in periodic Sobolev spaces
• A projector-splitting integrator for dynamical low-rank approximation
• Analysis of individual differences in multidimensional scaling via an \(n\)-way generalization of ``Eckart-Young decomposition
• Adaptive Low-Rank Methods: Problems on Sobolev Spaces
• Adaptive low-rank methods for problems on Sobolev spaces with error control in L₂
• On Local Convergence of Alternating Schemes for Optimization of Convex Problems in the Tensor Train Format
• Low-Rank Matrix Completion by Riemannian Optimization
• Dynamical Approximation by Hierarchical Tucker and Tensor-Train Tensors
• A literature survey of low-rank tensor approximation techniques
• Normalized Iterative Hard Thresholding for Matrix Completion
• A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion
• CONVERGENCE OF A GREEDY ALGORITHM FOR HIGH-DIMENSIONAL CONVEX NONLINEAR PROBLEMS
• The Alternating Linear Scheme for Tensor Optimization in the Tensor Train Format
• Local Convergence of the Alternating Least Squares Algorithm for Canonical Tensor Approximation
• Tree Adaptive Approximation in the Hierarchical Tensor Format
• A tensor approximation method based on ideal minimal residual formulations for the solution of high-dimensional problems
• Alternating Minimal Energy Methods for Linear Systems in Higher Dimensions
• Low-Rank Tensor Methods with Subspace Correction for Symmetric Eigenvalue Problems
• A new convergence proof for the higher-order power method and generalizations
• Multilevel preconditioning and low-rank tensor iteration for space-time simultaneous discretizations of parabolic PDEs
• Kolmogorov widths and low-rank approximations of parametric elliptic PDEs
• Convergence Results for Projected Line-Search Methods on Varieties of Low-Rank Matrices Via Łojasiewicz Inequality
• Hierarchical Singular Value Decomposition of Tensors
• A Singular Value Thresholding Algorithm for Matrix Completion
• On the Approximation Quality of Markov State Models
• ANALYTIC REGULARITY AND POLYNOMIAL APPROXIMATION OF PARAMETRIC AND STOCHASTIC ELLIPTIC PDE'S
• Dynamical Tensor Approximation
• Tensor-Structured Galerkin Approximation of Parametric and Stochastic Elliptic PDEs
• Sparse tensor discretizations of high-dimensional parametric and stochastic PDEs
• Algebraic Wavelet Transform via Quantics Tensor Train Decomposition
• Tensor Spaces and Numerical Tensor Calculus
• Breaking the Curse of Dimensionality, Or How to Use SVD in Many Dimensions
• On the geometry of tensor network states
• ON THE OPTIMAL POLYNOMIAL APPROXIMATION OF STOCHASTIC PDES BY GALERKIN AND COLLOCATION METHODS
• Diffusion Maps, Reduction Coordinates, and Low Dimensional Representation of Stochastic Systems
• Low-Rank Tensor Krylov Subspace Methods for Parametrized Linear Systems
• Polynomial Chaos in Stochastic Finite Elements
• On the efficient computation of high-dimensional integrals and the approximation by exponential sums
• Spectral Methods for Uncertainty Quantification
• The Geometry of Algorithms with Orthogonality Constraints
• On the Early History of the Singular Value Decomposition
• A Multilinear Singular Value Decomposition
• Numerical operator calculus in higher dimensions
• An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
• Numerical tensor calculus
• Solution of Linear Systems and Matrix Inversion in the TT-Format