The Geometry of Algorithms with Orthogonality Constraints
From MaRDI portal
Abstract: In this paper we develop new Newton and conjugate gradient algorithms on the Grassmann and Stiefel manifolds. These manifolds represent the constraints that arise in such areas as the symmetric eigenvalue problem, nonlinear eigenvalue problems, electronic structures computations, and signal processing. In addition to the new algorithms, we show how the geometrical framework gives penetrating new insights allowing us to create, understand, and compare algorithms. The theory proposed here provides a taxonomy for numerical linear algebra algorithms that provide a top level mathematical view of previously unrelated algorithms. It is our hope that developers of new algorithms and perturbation theories will benefit from the theory, methods, and examples in this paper.
Recommendations
- scientific article; zbMATH DE number 4137244
- scientific article; zbMATH DE number 1444288
- The algebraic degree of geometric optimization problems
- Geometric Duality Results and Approximation Algorithms for Convex Vector Optimization Problems
- Geometric algorithms and combinatorial optimization
- scientific article; zbMATH DE number 3229230
- scientific article; zbMATH DE number 66476
- Geometric algorithms for discreteness and faithfulness
- Geometry and complexity of O'Hara's algorithm
- scientific article; zbMATH DE number 6909291
Cited in
(only showing first 100 items - show all)- Inference for eigenvalues and eigenvectors of Gaussian symmetric matrices
- Descent methods for optimization on homogeneous manifolds
- A time-varying Newton algorithm for adaptive subspace tracking
- A feasible method for optimization with orthogonality constraints
- Consistency of restricted maximum likelihood estimators of principal components
- Estimation in a linear multivariate measurement error model with a change point in the data
- Smale's point estimate theory for Newton's method on Lie groups
- Differential-geometric Newton method for the best rank-\((R _{1}, R _{2}, R _{3})\) approximation of tensors
- Primal central paths and Riemannian distances for convex sets
- Conjugate gradient algorithm for optimization under unitary matrix constraint
- Some \(LP\) algorithms using orthogonal matrices
- The continuous-time Rayleigh quotient flow on the sphere
- Kantorovich's theorem on Newton's method in Riemannian manifolds
- The multimode Procrustes problem
- Introduction to face recognition and evaluation of algorithm performance
- Convergence rate analysis for the higher order power method in best rank one approximations of tensors
- Monotonicity on homogeneous spaces
- Parametric domain decomposition for accurate reduced order models: applications of MP-LROM methodology
- Sufficient dimension reduction constrained through sub-populations
- Interpolation on symmetric spaces via the generalized polar decomposition
- Kähler structures on spaces of framed curves
- Uncertainty quantification for complex systems with very high dimensional response using Grassmann manifold variations
- \(H_2\) order-reduction for bilinear systems based on Grassmann manifold
- Kantorovich's theorem on Newton's method under majorant condition in Riemannian manifolds
- Sparse exploratory factor analysis
- A matrix-free implementation of Riemannian Newton's method on the Stiefel manifold
- Efficient spectral computation of the stationary states of rotating Bose-Einstein condensates by preconditioned nonlinear conjugate gradient methods
- A trust-region method for H₂ model reduction of bilinear systems on the Stiefel manifold
- Optimization problems with orthogonal matrix constraints
- Equiangular subspaces in Euclidean spaces
- Direct search methods on reductive homogeneous spaces
- Singular divergence instability thresholds of kinematically constrained circulatory systems
- A note on lack of strong duality for quadratic problems with orthogonal constraints
- On minimization on Stiefel manifolds
- The Riccati algorithm for eigenvalues and invariant subspaces of matrices with inexpensive action
- Optimal low-rank approximation to a correlation matrix
- Generalized neural networks for spectral analysis: dynamics and Liapunov functions
- A regularized kernel CCA contrast function for ICA
- On optimizing the sum of the Rayleigh quotient and the generalized Rayleigh quotient on the unit sphere
- Central limit theorem for partial linear eigenvalue statistics of Wigner matrices
- Numerical analysis of finite dimensional approximations of Kohn-Sham models
- \texttt{libCreme}: an optimization library for evaluating convex-roof entanglement measures
- Rank-preserving geometric means of positive semi-definite matrices
- Projected nonmonotone search methods for optimization with orthogonality constraints
- Distributions of distances and volumes of balls in homogeneous lens spaces
- On approximate diagonalization of third order symmetric tensors by orthogonal transformations
- Nonlinear damped oscillators on Riemannian manifolds: numerical simulation
- On polynomial time methods for exact low-rank tensor completion
- First order optimality conditions and steepest descent algorithm on orthogonal Stiefel manifolds
- A Riemannian conjugate gradient method for optimization on the Stiefel manifold
- Maximization of the sum of the trace ratio on the Stiefel manifold. I: Theory
- Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold
- Riemannian conjugate gradient methods with inverse retraction
- Newton's method for the parameterized generalized eigenvalue problem with nonsquare matrix pencils
- A locally optimal rank revealing product decomposition
- The Grassmannian of affine subspaces
- Two adaptive scaled gradient projection methods for Stiefel manifold constrained optimization
- Dynamical reduced basis methods for Hamiltonian systems
- Adaptive regularization with cubics on manifolds
- The gradient projection algorithm for smooth sets and functions in nonconvex case
- Spectral residual method for nonlinear equations on Riemannian manifolds
- A Lagrangian approach to extremal curves on Stiefel manifolds
- Learning a consensus affinity matrix for multi-view clustering via subspaces merging on Grassmann manifold
- Variational Bayes on manifolds
- The gradient projection method with Armijo's step size on manifolds
- An alternate gradient method for optimization problems with orthogonality constraints
- Advanced topics in sliced inverse regression
- Tensor Q-rank: new data dependent definition of tensor rank
- Global convergence of Riemannian line search methods with a Zhang-Hager-type condition
- A Krylov-Schur-like method for computing the best rank-\((r_1,r_2,r_3)\) approximation of large and sparse tensors
- Maximizing sum of coupled traces with applications
- Spline estimation of functional principal components via manifold conjugate gradient algorithm
- A generalized geometric spectral conjugate gradient algorithm for finding zero of a monotone tangent vector field on a constant curvature Hadamard manifold
- Nondegeneracy of eigenvectors and singular vector tuples of tensors
- A sweep-based low-rank method for the discrete ordinate transport equation
- Riemannian optimization with a preconditioning scheme on the generalized Stiefel manifold
- \(p\)-almost Hadamard matrices and \(\lambda\)-planes
- Efficient quasi-geodesics on the Stiefel manifold
- A low-rank method for two-dimensional time-dependent radiation transport calculations
- Parametric reduced order modeling-based discrete velocity method for simulation of steady rarefied flows
- A long short-term memory embedding for hybrid uplifted reduced order models
- Non intrusive method for parametric model order reduction using a bi-calibrated interpolation on the Grassmann manifold
- Multiway \(p\)-spectral graph cuts on Grassmann manifolds
- Implicit algorithms for eigenvector nonlinearities
- A parallel orbital-updating based optimization method for electronic structure calculations
- A variational framework for computing Wannier functions using dictionary learning
- Measure estimation on manifolds: an optimal transport approach
- Extracting a low-dimensional predictable time series
- Optimization on flag manifolds
- On the stability of POD basis interpolation on Grassmann manifolds for parametric model order reduction
- Optimal thermal actuation for mirror temperature control
- Riemannian conjugate gradient methods for computing the extreme eigenvalues of symmetric tensors
- Topology of tensor ranks
- High-dimensional Kuramoto models on Stiefel manifolds synchronize complex networks almost globally
- On the rotational invariant \(L_1\)-norm PCA
- Orthogonal incremental non-negative matrix factorization algorithm and its application in image classification
- A Riemannian optimization approach for solving the generalized eigenvalue problem for nonsquare matrix pencils
- Damped Newton's method on Riemannian manifolds
- Second order optimality on orthogonal Stiefel manifolds
- Epilepsy detection in EEG using Grassmann discriminant analysis method
This page was built for publication: The Geometry of Algorithms with Orthogonality Constraints
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4243507)
