The Optimization Landscape for Fitting a Rank-2 Tensor with a Rank-1 Tensor

DOI10.1137/17M112213XzbMath1398.65138OpenAlexW2804269238MaRDI QIDQ3176269

Xue Gong, Martin J. Mohlenkamp, Todd R. Young

Publication date: 19 July 2018

Published in: SIAM Journal on Applied Dynamical Systems (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/17m112213x

zbMATH Keywords

alternating least squarestensor approximationcanonical tensor format

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Vector and tensor algebra, theory of invariants (15A72) Multilinear algebra, tensor calculus (15A69) Dynamical systems in numerical analysis (37N30)

Related Items

The Dynamics of Swamps in the Canonical Tensor Approximation Problem, Unnamed Item

Uses Software

• Multilinear Engine

Cites Work

• Enhanced Line Search: A Novel Method to Accelerate PARAFAC
• Function minimization by conjugate gradients
• Least-Squares Proper Generalized Decompositions for Weakly Coercive Elliptic Problems
• Most Tensor Problems Are NP-Hard
• Sparse grids for the Schrödinger equation
• Convergence of the Iterates of Descent Methods for Analytic Cost Functions
• Estimates for Some Computational Techniques in Linear Algebra
• Algorithms for Numerical Analysis in High Dimensions
• Unitary Triangularization of a Nonsymmetric Matrix
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Tensor Decompositions and Applications
• Tensor-Train Decomposition
• Uncertainty propagation in orbital mechanics via tensor decomposition
• Low-rank separated representation surrogates of high-dimensional stochastic functions: application in Bayesian inference
• Proper generalized decompositions and separated representations for the numerical solution of high dimensional stochastic problems
• On the convergence of a greedy rank-one update algorithm for a class of linear systems
• On the non-existence of optimal solutions and the occurrence of ``degeneracy in the CANDECOMP/PARAFAC model
• On the third secant variety
• Greedy algorithms for high-dimensional eigenvalue problems
• Tensor networks and hierarchical tensors for the solution of high-dimensional partial differential equations
• On the deterministic solution of multidimensional parametric models using the proper generalized decomposition
• On the generic and typical ranks of 3-tensors
• A priori model reduction through proper generalized decomposition for solving time-dependent partial differential equations
• On the regularity of the electronic Schrödinger equation in Hilbert spaces of mixed derivatives
• Low-rank Kronecker-product approximation to multi-dimensional nonlocal operators I. Separable approximation of multi-variate functions
• Low-rank Kronecker-product approximation to multi-dimensional nonlocal operators II. HKT representation of certain operators
• On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition
• The hyperbolic cross space approximation of electronic wavefunctions
• Adaptive near-optimal rank tensor approximation for high-dimensional operator equations
• Kruskal's condition for uniqueness in Candecomp/Parafac when ranks and \(k\)-ranks coincide
• A comparison of algorithms for fitting the PARAFAC model
• Well-posedness of convex maximization problems on Stiefel manifolds and orthogonal tensor product approximations
• Regularity and approximability of electronic wave functions
• On uniqueness conditions for Candecomp/Parafac and Indscal with full column rank in one mode
• Generic and typical ranks of multi-way arrays
• A least-squares approximation of partial differential equations with high-dimensional random inputs
• Principal component analysis of three-mode data by means of alternating least squares algorithms
• Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics
• Multilinear models: applications in spectroscopy. With comments by Jan de Leeuw, Pieter M. Kroonenberg and Donald S. Burdick and a rejoinder by the authors
• Finding the limit of diverging components in three-way Candecomp/Parafac -- a demonstration of its practical merits
• Orbit uncertainty propagation and sensitivity analysis with separated representations
• Ranks of tensors and a generalization of secant varieties
• Some convergence results on the regularized alternating least-squares method for tensor decomposition
• Musings on multilinear fitting
• Variational calculus with sums of elementary tensors of fixed rank
• A regularized Newton method for the efficient approximation of tensors represented in the canonical tensor format
• Best rank one approximation of real symmetric tensors can be chosen symmetric
• Fast cubature of volume potentials over rectangular domains by approximate approximations
• Degeneracy in Candecomp/Parafac explained for \(p\times p\times 2\) arrays of rank \(p+1\) or higher
• Sufficient conditions for uniqueness in Candecomp/Parafac and Indscal with random component matrices
• Geometric singular perturbation theory in biological practice
• DMRG approach to fast linear algebra in the TT-format
• Degeneracy in Candecomp/Parafac and Indscal explained for several three-sliced arrays with a two-valued typical rank
• Analysis of individual differences in multidimensional scaling via an \(n\)-way generalization of ``Eckart-Young decomposition
• Sparse grid spaces for the numerical solution of the electronic Schrödinger equation
• Orthogonal Tensor Decompositions
• Rank-One Approximation to High Order Tensors
• On the Best Rank-1 Approximation of Higher-Order Supersymmetric Tensors
• Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to A PDE With Random Data
• Adaptive low-rank methods for problems on Sobolev spaces with error control in L₂
• Optimization-Based Algorithms for Tensor Decompositions: Canonical Polyadic Decomposition, Decomposition in Rank-$(L_r,L_r,1)$ Terms, and a New Generalization
• A Three-Way Jordan Canonical Form as Limit of Low-Rank Tensor Approximations
• On the Uniqueness of the Canonical Polyadic Decomposition of Third-Order Tensors---Part I: Basic Results and Uniqueness of One Factor Matrix
• On the Uniqueness of the Canonical Polyadic Decomposition of Third-Order Tensors---Part II: Uniqueness of the Overall Decomposition
• Maximum Block Improvement and Polynomial Optimization
• A Nonlinear GMRES Optimization Algorithm for Canonical Tensor Decomposition
• Candecomp/Parafac: From Diverging Components to a Decomposition in Block Terms
• Local Convergence of the Alternating Least Squares Algorithm for Canonical Tensor Approximation
• A tensor approximation method based on ideal minimal residual formulations for the solution of high-dimensional problems
• On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors
• A new convergence proof for the higher-order power method and generalizations
• Convergence Results for Projected Line-Search Methods on Varieties of Low-Rank Matrices Via Łojasiewicz Inequality
• Structure of the Hessian matrix and an economical implementation of Newton’s method in the problem of canonical approximation of tensors
• Best Low Multilinear Rank Approximation of Higher-Order Tensors, Based on the Riemannian Trust-Region Scheme
• Hierarchical Singular Value Decomposition of Tensors
• Optimized general sparse grid approximation spaces for operator equations
• On Uniqueness of the nth Order Tensor Decomposition into Rank-1 Terms with Linear Independence in One Mode
• QTT approximation of elliptic solution operators in higher dimensions
• On Uniqueness of the Canonical Tensor Decomposition with Some Form of Symmetry
• Tensor-Structured Galerkin Approximation of Parametric and Stochastic Elliptic PDEs
• Learning to Predict Physical Properties using Sums of Separable Functions
• A Decomposition for Three-Way Arrays
• Breaking the Curse of Dimensionality, Or How to Use SVD in Many Dimensions
• On the fast computation of high dimensional volume potentials
• A Least-Squares Method for Sparse Low Rank Approximation of Multivariate Functions
• Orthogonal Low Rank Tensor Approximation: Alternating Least Squares Method and Its Global Convergence
• A nonlinearly preconditioned conjugate gradient algorithm for rank‐R canonical tensor approximation
• Approximating a wavefunction as an unconstrained sum of Slater determinants
• Multivariate Regression and Machine Learning with Sums of Separable Functions
• Uniqueness Conditions for Constrained Three-Way Factor Decompositions with Linearly Dependent Loadings
• A Method to Avoid Diverging Components in the Candecomp/Parafac Model for Generic $I\timesJ\times2$ Arrays
• Some History of the Conjugate Gradient and Lanczos Algorithms: 1948–1976
• A Multilinear Singular Value Decomposition
• On the Best Rank-1 and Rank-(R₁ ,R₂ ,. . .,R_N) Approximation of Higher-Order Tensors
• Numerical operator calculus in higher dimensions
• Numerical tensor calculus
• Solution of Linear Systems and Matrix Inversion in the TT-Format
• Capturing the Interelectron Cusp Using a Geminal Layer on an Unconstrained Sum of Slater Determinants
• Canonical Polyadic Decomposition with a Columnwise Orthonormal Factor Matrix
• Improved Uniqueness Conditions for Canonical Tensor Decompositions with Linearly Dependent Loadings
• A center-of-mass principle for the multiparticle Schrödinger equation
• Fast Multidimensional Convolution in Low-Rank Tensor Formats via Cross Approximation
• ON THE COMPUTATION OF HIGH‐DIMENSIONAL POTENTIALS OF ADVECTION–DIFFUSION OPERATORS
• Sparse grids
• Low Complexity Damped Gauss--Newton Algorithms for CANDECOMP/PARAFAC
• Low-Rank Approximation of Generic $p \timesq \times2$ Arrays and Diverging Components in the Candecomp/Parafac Model
• Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem