Fundamental tensor operations for large-scale data analysis using tensor network formats

DOI10.1007/S11045-017-0481-0zbMATH Open1448.94107arXiv1405.7786OpenAlexW2593392256MaRDI QIDQ784596FDOQ784596

Authors: Namgil Lee, Andrzej Cichocki 

Publication date: 3 August 2020

Published in: Multidimensional Systems and Signal Processing (Search for Journal in Brave)

Abstract: We discuss extended definitions of linear and multilinear operations such as Kronecker, Hadamard, and contracted products, and establish links between them for tensor calculus. Then we introduce effective low-rank tensor approximation techniques including Candecomp/Parafac (CP), Tucker, and tensor train (TT) decompositions with a number of mathematical and graphical representations. We also provide a brief review of mathematical properties of the TT decomposition as a low-rank approximation technique. With the aim of breaking the curse-of-dimensionality in large-scale numerical analysis, we describe basic operations on large-scale vectors, matrices, and high-order tensors represented by TT decomposition. The proposed representations can be used for describing numerical methods based on TT decomposition for solving large-scale optimization problems such as systems of linear equations and symmetric eigenvalue problems.

Full work available at URL: https://arxiv.org/abs/1405.7786

Recommendations

• Tensor networks for dimensionality reduction and large-scale optimization. I: Low-rank tensor decompositions
• Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 2 Applications and Future Perspectives
• Numerical tensor calculus
• A literature survey of low-rank tensor approximation techniques
• Parallel Algorithms for Tensor Train Arithmetic

zbMATH Keywords

big datamultilinear operatortensor calculusmatrix product statetensor networkscontracted productgeneralized Tucker modelmatrix product operatorstrong Kronecker producttensor train

Mathematics Subject Classification ID

Multilinear algebra, tensor calculus (15A69) Vector and tensor algebra, theory of invariants (15A72) Quadratic and bilinear forms, inner products (15A63) Orthogonalization in numerical linear algebra (65F25) Informational aspects of data analysis and big data (94A16)

Cites Work

• Ideal spatial adaptation by wavelet shrinkage
• Tensor Decompositions and Applications
• Sparse grids
• Tensor-train decomposition
• Hierarchical Singular Value Decomposition of Tensors
• Breaking the Curse of Dimensionality, Or How to Use SVD in Many Dimensions
• A Multilinear Singular Value Decomposition
• Tensor spaces and numerical tensor calculus
• A literature survey of low-rank tensor approximation techniques
• Title not available (Why is that?)
• Alternating minimal energy methods for linear systems in higher dimensions
• The density-matrix renormalization group in the age of matrix product states
• Optimization problems in contracted tensor networks
• A new scheme for the tensor representation
• Multilevel Toeplitz matrices generated by tensor-structured vectors and convolution with logarithmic complexity
• The alternating linear scheme for tensor optimization in the tensor train format
• Approximation of \(2^d\times2^d\) matrices using tensor decomposition
• Computation of extreme eigenvalues in higher dimensions using block tensor train format
• Low-Rank Explicit QTT Representation of the Laplace Operator and Its Inverse
• Solution of Linear Systems and Matrix Inversion in the TT-Format
• \(O(d \log N)\)-quantics approximation of \(N\)-\(d\) tensors in high-dimensional numerical modeling
• The strong Kronecker product
• On manifolds of tensors of fixed TT-rank
• On minimal subspaces in tensor representations
• Low-rank tensor methods with subspace correction for symmetric eigenvalue problems
• A note on tensor chain approximation
• Regularized computation of approximate pseudoinverse of large matrices using low-rank tensor train decompositions
• Estimating a few extreme singular values and vectors for large-scale matrices in tensor train format

Cited In (26)

• User-defined tensor data analysis
• An improved quantum network communication model based on compressed tensor network states
• Nonnegative tensor patch dictionary approaches for image compression and deblurring applications
• Bayesian Dynamic Tensor Regression
• Constrained tensorial total variation problem based on an alternating conditional gradient algorithm
• Regularized computation of approximate pseudoinverse of large matrices using low-rank tensor train decompositions
• Title not available (Why is that?)
• The tensor network theory library
• On computing high-dimensional Riemann theta functions
• Low-Rank Explicit QTT Representation of the Laplace Operator and Its Inverse
• Tensor-train format solution with preconditioned iterative method for high dimensional time-dependent space-fractional diffusion equations with error analysis
• Tensor spaces and numerical tensor calculus
• On manifolds of tensors of fixed TT-rank
• Global and extended global Hessenberg processes for solving Sylvester tensor equation with low-rank right-hand side
• Tensor train-Karhunen-Loève expansion: new theoretical and algorithmic frameworks for representing general non-Gaussian random fields
• Krylov subspace projection method for Sylvester tensor equation with low rank right-hand side
• Noniterative tensor network‐based algorithm for Volterra system identification
• The LSQR method for solving tensor least-squares problems
• Large scale tensor analysis by computer
• On the complexity of finding tensor ranks
• Extended Krylov subspace methods for solving Sylvester and Stein tensor equations
• Tensor networks for dimensionality reduction and large-scale optimization. I: Low-rank tensor decompositions
• An accelerated tensorial double proximal gradient method for total variation regularization problem
• Block tensor train decomposition for missing data estimation
• Bayesian variable selection for matrix autoregressive models
• Estimating a few extreme singular values and vectors for large-scale matrices in tensor train format

Uses Software

• TT Toolbox
• GitHub

This page was built for publication: Fundamental tensor operations for large-scale data analysis using tensor network formats

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q784596)