Riemannian optimization on unit sphere with p-norm and its applications

DOI10.1007/S10589-023-00477-0MaRDI QIDQ6133300zbMATH OpenOpenAlexFDO

Authors Hiroyuki Sato

Publication date 24 July 2023

Published in Computational Optimization and Applications (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2202.11597

zbMATH Keywords

Lasso regressionsphereRiemannian optimization\(p\)-normbox-constrained optimizationnonnegative PCA

Mathematics Subject Classification ID

Programming in abstract spaces (90C48)

Abstract: This paper deals with Riemannian optimization on the unit sphere in terms of $p$-norm with general $p>1$. As a Riemannian submanifold of the Euclidean space, the geometry of the sphere with $p$-norm is investigated, and several geometric tools used for Riemannian optimization, such as retractions and vector transports, are proposed and analyzed. Applications to Riemannian optimization on the sphere with nonnegative constraints and $L_p$-regularization-related optimization are also discussed. As practical examples, the former includes nonnegative principal component analysis and the latter is closely related to the Lasso regression and box-constrained problems. Numerical experiments verify that Riemannian optimization on the sphere with $p$-norm has substantial potential for such applications, and the proposed framework provides a theoretical basis for such optimization.

Recommendations

• Riemannian optimization and its applications
• Stochastic proximal gradient method FOR \(\ell_1\) regularized optimization over a sphere
• A Riemannian smoothing steepest descent method for non-Lipschitz optimization on embedded submanifolds of \(\mathbb{R}^n\)
• Simple algorithms for optimization on Riemannian manifolds with constraints
• Riemannian preconditioning

Cites work

• scientific article; zbMATH DE number 3540341 (Why is no real title available?)
• scientific article; zbMATH DE number 3551792 (Why is no real title available?)
• scientific article; zbMATH DE number 2107836 (Why is no real title available?)
• scientific article; zbMATH DE number 6438182 (Why is no real title available?)
• scientific article; zbMATH DE number 5223994 (Why is no real title available?)
• scientific article; zbMATH DE number 5060482 (Why is no real title available?)
• A Broyden class of quasi-Newton methods for Riemannian optimization
• A Dai-Yuan-type Riemannian conjugate gradient method with the weak Wolfe conditions
• A NOTE ON THE SQUARED SLACK VARIABLES TECHNIQUE FOR NONLINEAR OPTIMIZATION
• A Riemannian BFGS method without differentiated retraction for nonconvex optimization problems
• A new, globally convergent Riemannian conjugate gradient method
• Comparing Measures of Sparsity
• Global convergence of Hager-Zhang type Riemannian conjugate gradient method
• Manopt, a Matlab toolbox for optimization on manifolds
• Newton's method on Riemannian manifolds and a geometric model for the human spine
• Optimization methods on Riemannian manifolds and their application to shape space
• Projection-like retractions on matrix manifolds
• Riemannian Stochastic Variance Reduced Gradient Algorithm with Retraction and Vector Transport
• Riemannian conjugate gradient methods with inverse retraction
• Riemannian conjugate gradient methods: general framework and specific algorithms with convergence analyses
• Riemannian optimization and its applications
• Simple algorithms for optimization on Riemannian manifolds with constraints
• Sufficient descent Riemannian conjugate gradient methods
• Tikhonov, Ivanov and Morozov regularization for support vector machine learning

Cited in

(3)

• A robust, discrete-gradient descent procedure for optimisation with time-dependent PDE and norm constraints
• A p-spherical section property for matrix Schatten-p quasi-norm minimization
• Gradient projection method on the sphere, complementarity problems and copositivity

This page was built for publication: Riemannian optimization on unit sphere with \(p\)-norm and its applications

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6133300)