Subtracting a best rank-1 approximation may increase tensor rank
From MaRDI portal
(Redirected from Subtracting a best rank-1 approximation may increase tensor rank)
Abstract: It has been shown that a best rank-R approximation of an order-k tensor may not exist when R>1 and k>2. This poses a serious problem to data analysts using tensor decompositions. It has been observed numerically that, generally, this issue cannot be solved by consecutively computing and subtracting best rank-1 approximations. The reason for this is that subtracting a best rank-1 approximation generally does not decrease tensor rank. In this paper, we provide a mathematical treatment of this property for real-valued 2x2x2 tensors, with symmetric tensors as a special case. Regardless of the symmetry, we show that for generic 2x2x2 tensors (which have rank 2 or 3), subtracting a best rank-1 approximation results in a tensor that has rank 3 and lies on the boundary between the rank-2 and rank-3 sets. Hence, for a typical tensor of rank 2, subtracting a best rank-1 approximation increases the tensor rank.
It is known that a best rank-\(R\) approximation of an order-\(k\) tensor may not exist when \(R\geq 2\) and \(k\geq 3\). This poses a serious problem to data analysts using tensor decompositions. It has been observed numerically that, generally, this issue cannot be solved by consecutively computing and subtracting best rank-\(1\) approximations. NEWLINENEWLINEIn the present paper the authors provide a mathematical treatment of this property for real-valued \(2\times 2\times 2\) tensors, with symmetric tensors as a special case. Regardless of the symmetry, they show that for generic \(2\times 2\times 2\) tensors (which have rank \(2\) or \(3\)), subtracting a best rank-\(1\) approximation results in a tensor that has rank \(3\) and lies on the boundary between the rank-\(2\) and rank-\(3\) sets. Hence, for a typical tensor of rank \(2\), subtracting a best rank-\(1\) approximation increases the tensor rank.
Recommendations
- Subtracting a best rank‐1 approximation from p × p × 2(p≥2) tensors
- On best rank-\(2\) and rank-\((2,2,2)\) approximations of order-\(3\) tensors
- On the Best Rank-1 and Rank-(R1 ,R2 ,. . .,RN) Approximation of Higher-Order Tensors
- Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem
- The Best rank-\((R_1,R_2,R_3)\) approximation of tensors by means of a geometric Newton method
Cites work
- A Method to Avoid Diverging Components in the Candecomp/Parafac Model for Generic $I\timesJ\times2$ Arrays
- Analysis of individual differences in multidimensional scaling via an \(n\)-way generalization of ``Eckart-Young decomposition
- Applied Multiway Data Analysis
- Decomposition of quantics in sums of powers of linear forms
- Degeneracy in Candecomp/Parafac and Indscal explained for several three-sliced arrays with a two-valued typical rank
- Degeneracy in Candecomp/Parafac explained for \(p\times p\times 2\) arrays of rank \(p+1\) or higher
- Explicit Candecomp/Parafac solutions for a contrived 2\(\times 2\times 2\) array of rank three
- scientific article; zbMATH DE number 976329 (Why is no real title available?)
- Independent component analysis, a new concept?
- Low-Rank Approximation of Generic p \timesq \times2 Arrays and Diverging Components in the Candecomp/Parafac Model
- On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition
- On the Best Rank-1 and Rank-(R1 ,R2 ,. . .,RN) Approximation of Higher-Order Tensors
- On the best rank-1 approximation of higher-order supersymmetric tensors
- On the best rank-1 approximation to higher-order symmetric tensors
- On the non-existence of optimal solutions and the occurrence of ``degeneracy in the CANDECOMP/PARAFAC model
- Optimal Evaluation of Pairs of Bilinear Forms
- PARAFAC-based unified tensor modeling for wireless communication systems with application to blind multiuser equalization
- Rank and eigenvalues of a supersymmetric tensor, the multivariate homogeneous polynomial and the algebraic hypersurface it defines
- Rank and optimal computation of generic tensors
- Rank-one approximation to high order tensors
- Simplicity of core arrays in three-way principal component analysis and the typical rank of \(p\times q\times 2\) arrays
- Symmetric Tensors and Symmetric Tensor Rank
- Tensor Decompositions and Applications
- Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem
- Tensor-based techniques for the blind separation of DS-CDMA signals
- The invariant theory of binary forms
- Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics
- Typical rank and indscal dimensionality for symmetric three-way arrays of order I 2 2 or I 3 3
Cited in
(20)- A very brief introduction to nonnegative tensors from the geometric viewpoint
- A tensor rank theory and maximum full rank subtensors
- Complex best \(r\)-term approximations almost always exist in finite dimensions
- Tensor Decompositions for Learning Latent Variable Models (A Survey for ALT)
- A literature survey of low-rank tensor approximation techniques
- A constructive algorithm for decomposing a tensor into a finite sum of orthonormal rank-1 terms
- Successive Rank-One Approximations for Nearly Orthogonally Decomposable Symmetric Tensors
- Cayley's hyperdeterminant: A combinatorial approach via representation theory
- Subtracting a best rank‐1 approximation from p × p × 2(p≥2) tensors
- On best rank-\(2\) and rank-\((2,2,2)\) approximations of order-\(3\) tensors
- A higher order unscented transform
- On the hyperdeterminant for \(2\times 2\times 3\) arrays
- On the Uniqueness and Perturbation to the Best Rank-One Approximation of a Tensor
- Tensor Rank and the Ill-Posedness of the Best Low-Rank Approximation Problem
- Factorization strategies for third-order tensors
- The Euclidean distance degree of an algebraic variety
- Rank of a tensor and quantum entanglement
- Decomposing tensors via rank-one approximations
- Decomposition loci of tensors
- When does subtracting a rank-one approximation decrease tensor rank?
This page was built for publication: Subtracting a best rank-1 approximation may increase tensor rank
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5962281)
