A nonlinearly preconditioned conjugate gradient algorithm for rank‐R canonical tensor approximation

DOI10.1002/nla.1963zbMath1363.65041arXiv1407.5183OpenAlexW2963626304MaRDI QIDQ3466246

Manda Winlaw, Hans De Sterck

Publication date: 1 February 2016

Published in: Numerical Linear Algebra with Applications (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1407.5183

zbMATH Keywords

algorithmconvergence accelerationnonlinear optimizationnonlinear conjugate gradient methodalternating least squarescanonical tensor decompositionnonlinear preconditioning

Mathematics Subject Classification ID

Iterative numerical methods for linear systems (65F10) Multilinear algebra, tensor calculus (15A69) Preconditioners for iterative methods (65F08)

Related Items (9)

Linearly preconditioned nonlinear conjugate gradient acceleration of the PX-EM algorithm ⋮ The Optimization Landscape for Fitting a Rank-2 Tensor with a Rank-1 Tensor ⋮ On the Asymptotic Linear Convergence Speed of Anderson Acceleration, Nesterov Acceleration, and Nonlinear GMRES ⋮ Nonlinearly Preconditioned Optimization on Grassmann Manifolds for Computing Approximate Tucker Tensor Decompositions ⋮ On the asymptotic linear convergence speed of Anderson acceleration applied to ADMM ⋮ The Dynamics of Swamps in the Canonical Tensor Approximation Problem ⋮ Sparse low-rank separated representation models for learning from data ⋮ Unnamed Item ⋮ Computing the Gradient in Optimization Algorithms for the CP Decomposition in Constant Memory through Tensor Blocking

Uses Software

• TensorToolbox
• Poblano
• Multilinear Engine
• Anderson

Cites Work

• Unnamed Item
• Unnamed Item
• Tensor Decompositions and Applications
• A comparison of algorithms for fitting the PARAFAC model
• On the efficient solution of nonlinear finite element equations. I
• Numerical solution of nonlinear elliptic partial differential equations by a generalized conjugate gradient method
• Analysis of individual differences in multidimensional scaling via an \(n\)-way generalization of ``Eckart-Young decomposition
• Composing Scalable Nonlinear Algebraic Solvers
• A literature survey of low-rank tensor approximation techniques
• A Nonlinear GMRES Optimization Algorithm for Canonical Tensor Decomposition
• Local Convergence of the Alternating Least Squares Algorithm for Canonical Tensor Approximation
• Steepest descent preconditioning for nonlinear GMRES optimization
• Two classes of multisecant methods for nonlinear acceleration
• Anderson Acceleration for Fixed-Point Iterations
• Conjugate direction methods with variable storage
• Krylov Subspace Acceleration of Nonlinear Multigrid with Application to Recirculating Flows
• Function minimization by conjugate gradients
• Iterative Procedures for Nonlinear Integral Equations
• Methods of conjugate gradients for solving linear systems
• Benchmarking optimization software with performance profiles.

This page was built for publication: A nonlinearly preconditioned conjugate gradient algorithm for rank‐R canonical tensor approximation