Gauss-Newton method for convex composite optimizations on Riemannian manifolds (Q452337): Difference between revisions
From MaRDI portal
Created a new Item |
ReferenceBot (talk | contribs) Changed an Item |
||
(5 intermediate revisions by 5 users not shown) | |||
Property / author | |||
Property / author: Jin-Hua Wang / rank | |||
Property / author | |||
Property / author: Chong Li / rank | |||
Property / author | |||
Property / author: Jin-Hua Wang / rank | |||
Normal rank | |||
Property / author | |||
Property / author: Chong Li / rank | |||
Normal rank | |||
Property / review text | |||
The notions of quasi-regularity for \(p_0 \in M\) (a Riemannian manifold), quasi-regular radius \(r_{p_0}\) and quasi-regular bound function \(\beta{p_0}\) attached to a quasi-regular point \(p_0\) are extended to Riemannian manifolds. The authors show that if the initial point \(p_0\) is a quasi-regular point with \((r_{p_0}, \beta_{p_0})\) and if \(DF\) (\(F\) is a nonlinear Fréchet differentiable mapping from \(\mathbb R^m\) to \(\mathbb R^n\), \(DF(p)\) denotes the derivative of \(F\) at \(p\)) satisfies a Lipschitz type condition, then the Gauss-Newton sequence \(\{p_n\}\) generated by the algorithm \(R (\eta, \Delta, p_0)\) converges at a quadratic rate to some \(p^*\) with \(F(p^*) \in C\) (in particular, \(p^*\) solves: \(\min_{p\in M} f(p):=h(F(p))\), where \(h\) is a real-valued convex function on \(\mathbb R\)). Furthermore, two applications to special cases, one is for the case of regularities of Riemannian manifolds and the other is for the case when \(C\) is a cone and \((DF (p_0)(.)-C)\) is surjective, are proposed. Main result: The authors extend the Gauss-Newton method to a Riemannian manifold to solve the convex composite optimization on the Riemannian manifold \(M\)which is formulated as follows: \[ \min_{p \in M} f(p):=h(F(p)).\tag{1} \] The majorizing function technique to establish the semi-local convergence of sequences generated by the Gauss-Newton method for the convex composite function \(h_0F\) on the Riemannian manifold is used. The extended Gauss-Newton for the convex composite optimization problem on Riemannian manifold (1) is defined. The authors extend the notion of the quasi-regular point to Riemannian manifolds and specialize own results in two important cases: the classical Lipschitz condition and the \(\gamma\)-condition (implies the \(L\)-average Lipschitz condition) which have been used extensively in the study of convergence of Newton's method both in Banach spaces and Riemannian manifolds. If \(F\) satisfies the \(\gamma\)-condition at \(p_0\) in \(B (p_0, r)\), \(DF\) satisfies the \(L\)-average Lipschitz condition in \(B (p_0, r)\) with \(L\) given by \(L(u) = \frac{2 \gamma}{(1- \gamma u)^3}\) for each \(u\) with \(0 \leq u < \frac{1}{\gamma}\). For a regular point \(p_0\) of \(F(p) \in C\) there exist constants \(r>0\) and \(\beta_0 >0\) such that \(\Lambda (p) \neq \emptyset\) and \(d (0, \Lambda (p)) \leq \beta (d(p_0,p))d(F(p),C)\) for all \(p \in B (p_0,r)\) holds for \(r\) and \(\beta (.)= \beta_0\), consequently, \(p_0\) is a quasi-regular point with the quasi-regular radius \(r_{p_0} \geq r\) and the quasi-regular bound function \(\beta_{p_0} (.) \leq p_0\) on \([0,r]\). | |||
Property / review text: The notions of quasi-regularity for \(p_0 \in M\) (a Riemannian manifold), quasi-regular radius \(r_{p_0}\) and quasi-regular bound function \(\beta{p_0}\) attached to a quasi-regular point \(p_0\) are extended to Riemannian manifolds. The authors show that if the initial point \(p_0\) is a quasi-regular point with \((r_{p_0}, \beta_{p_0})\) and if \(DF\) (\(F\) is a nonlinear Fréchet differentiable mapping from \(\mathbb R^m\) to \(\mathbb R^n\), \(DF(p)\) denotes the derivative of \(F\) at \(p\)) satisfies a Lipschitz type condition, then the Gauss-Newton sequence \(\{p_n\}\) generated by the algorithm \(R (\eta, \Delta, p_0)\) converges at a quadratic rate to some \(p^*\) with \(F(p^*) \in C\) (in particular, \(p^*\) solves: \(\min_{p\in M} f(p):=h(F(p))\), where \(h\) is a real-valued convex function on \(\mathbb R\)). Furthermore, two applications to special cases, one is for the case of regularities of Riemannian manifolds and the other is for the case when \(C\) is a cone and \((DF (p_0)(.)-C)\) is surjective, are proposed. Main result: The authors extend the Gauss-Newton method to a Riemannian manifold to solve the convex composite optimization on the Riemannian manifold \(M\)which is formulated as follows: \[ \min_{p \in M} f(p):=h(F(p)).\tag{1} \] The majorizing function technique to establish the semi-local convergence of sequences generated by the Gauss-Newton method for the convex composite function \(h_0F\) on the Riemannian manifold is used. The extended Gauss-Newton for the convex composite optimization problem on Riemannian manifold (1) is defined. The authors extend the notion of the quasi-regular point to Riemannian manifolds and specialize own results in two important cases: the classical Lipschitz condition and the \(\gamma\)-condition (implies the \(L\)-average Lipschitz condition) which have been used extensively in the study of convergence of Newton's method both in Banach spaces and Riemannian manifolds. If \(F\) satisfies the \(\gamma\)-condition at \(p_0\) in \(B (p_0, r)\), \(DF\) satisfies the \(L\)-average Lipschitz condition in \(B (p_0, r)\) with \(L\) given by \(L(u) = \frac{2 \gamma}{(1- \gamma u)^3}\) for each \(u\) with \(0 \leq u < \frac{1}{\gamma}\). For a regular point \(p_0\) of \(F(p) \in C\) there exist constants \(r>0\) and \(\beta_0 >0\) such that \(\Lambda (p) \neq \emptyset\) and \(d (0, \Lambda (p)) \leq \beta (d(p_0,p))d(F(p),C)\) for all \(p \in B (p_0,r)\) holds for \(r\) and \(\beta (.)= \beta_0\), consequently, \(p_0\) is a quasi-regular point with the quasi-regular radius \(r_{p_0} \geq r\) and the quasi-regular bound function \(\beta_{p_0} (.) \leq p_0\) on \([0,r]\). / rank | |||
Normal rank | |||
Property / reviewed by | |||
Property / reviewed by: Jan Lovíšek / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 65K05 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 65J15 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 90C25 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 90C48 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 53C25 / rank | |||
Normal rank | |||
Property / zbMATH DE Number | |||
Property / zbMATH DE Number: 6084586 / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Gauss-Newton method | |||
Property / zbMATH Keywords: Gauss-Newton method / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Riemannian manifolds | |||
Property / zbMATH Keywords: Riemannian manifolds / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
\(L\)-average Lipschitz condition | |||
Property / zbMATH Keywords: \(L\)-average Lipschitz condition / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
quasi-regularity | |||
Property / zbMATH Keywords: quasi-regularity / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
convergence criterion | |||
Property / zbMATH Keywords: convergence criterion / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
algorithm | |||
Property / zbMATH Keywords: algorithm / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
regular point | |||
Property / zbMATH Keywords: regular point / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
convex process | |||
Property / zbMATH Keywords: convex process / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
sequence | |||
Property / zbMATH Keywords: sequence / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
convex composite optimization | |||
Property / zbMATH Keywords: convex composite optimization / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
semi-local convergence | |||
Property / zbMATH Keywords: semi-local convergence / rank | |||
Normal rank | |||
Property / MaRDI profile type | |||
Property / MaRDI profile type: MaRDI publication profile / rank | |||
Normal rank | |||
Property / full work available at URL | |||
Property / full work available at URL: https://doi.org/10.1007/s10898-010-9638-1 / rank | |||
Normal rank | |||
Property / OpenAlex ID | |||
Property / OpenAlex ID: W2085379846 / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Newton's method on Riemannian manifolds and a geometric model for the human spine / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Nonsmooth analysis and Hamilton--Jacobi equations on Riemannian manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Some global optimization problems on Stiefel manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Stability and regular points of inequality systems / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: An Exact Penalization Viewpoint of Constrained Optimization / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Descent methods for composite nondifferentiable optimization problems / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: A Gauss-Newton method for convex composite optimization / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Newton's method on Riemannian manifolds: covariant alpha theory / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Proximal Point Algorithm On Riemannian Manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Singularities of monotone vector fields and an extragradient-type algorithm / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Kantorovich's theorem on Newton's method in Riemannian manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Optimal Error Bounds for the Newton–Kantorovich Theorem / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Q3897665 / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Optimization and dynamical systems / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Strong uniqueness and second order convergence in nonlinear discrete approximation / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Nonsmooth analysis on smooth manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Monotone vector fields and the proximal point algorithm on Hadamard manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Majorizing Functions and Convergence of the Gauss–Newton Method for Convex Composite Optimization / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Convergence of the Newton method and uniqueness of zeros of vector fields on Riemannian manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Newton's method on Riemannian manifolds: Smale's point estimate theory under the γ-condition / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Newton's method for sections on Riemannian manifolds: Generalized covariant \(\alpha \)-theory / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: On convergence of the Gauss-Newton method for convex composite optimization. / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Existence of solutions for variational inequalities on Riemannian manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Optimization criteria and geometric algorithms for motion and structure estimation / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: The geometry of the Newton method on non-compact Lie groups / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Q4060241 / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Sectional curvatures in nonlinear optimization / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Stability Theory for Systems of Inequalities. Part I: Linear Systems / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Stability Theory for Systems of Inequalities, Part II: Differentiable Nonlinear Systems / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Normed Convex Processes / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Extension of Newton's method to nonlinear functions with values in a cone / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Convex Analysis / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Monotone processes of convex and concave type / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: First- and Second-Order Epi-Differentiability in Nonlinear Programming / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Covariance, subspace, and intrinsic Crame/spl acute/r-Rao bounds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Optimization Techniques on Riemannian Manifolds / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Extended Newton's method for mappings on Riemannian manifolds with values in a cone / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Uniqueness of the singular points of vector fields on Riemannian manifolds under the \(\gamma\)-condition / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Convergence of Newton’s method and inverse function theorem in Banach space / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Convergence on the iteration of Halley family in weak conditions / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Local and global behavior for algorithms of solving equations / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Local properties of algorithms for minimizing nonsmooth composite functions / rank | |||
Normal rank | |||
Property / cites work | |||
Property / cites work: Classification of four-dimensional estimation algebras / rank | |||
Normal rank | |||
links / mardi / name | links / mardi / name | ||
Latest revision as of 17:40, 5 July 2024
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Gauss-Newton method for convex composite optimizations on Riemannian manifolds |
scientific article |
Statements
Gauss-Newton method for convex composite optimizations on Riemannian manifolds (English)
0 references
20 September 2012
0 references
The notions of quasi-regularity for \(p_0 \in M\) (a Riemannian manifold), quasi-regular radius \(r_{p_0}\) and quasi-regular bound function \(\beta{p_0}\) attached to a quasi-regular point \(p_0\) are extended to Riemannian manifolds. The authors show that if the initial point \(p_0\) is a quasi-regular point with \((r_{p_0}, \beta_{p_0})\) and if \(DF\) (\(F\) is a nonlinear Fréchet differentiable mapping from \(\mathbb R^m\) to \(\mathbb R^n\), \(DF(p)\) denotes the derivative of \(F\) at \(p\)) satisfies a Lipschitz type condition, then the Gauss-Newton sequence \(\{p_n\}\) generated by the algorithm \(R (\eta, \Delta, p_0)\) converges at a quadratic rate to some \(p^*\) with \(F(p^*) \in C\) (in particular, \(p^*\) solves: \(\min_{p\in M} f(p):=h(F(p))\), where \(h\) is a real-valued convex function on \(\mathbb R\)). Furthermore, two applications to special cases, one is for the case of regularities of Riemannian manifolds and the other is for the case when \(C\) is a cone and \((DF (p_0)(.)-C)\) is surjective, are proposed. Main result: The authors extend the Gauss-Newton method to a Riemannian manifold to solve the convex composite optimization on the Riemannian manifold \(M\)which is formulated as follows: \[ \min_{p \in M} f(p):=h(F(p)).\tag{1} \] The majorizing function technique to establish the semi-local convergence of sequences generated by the Gauss-Newton method for the convex composite function \(h_0F\) on the Riemannian manifold is used. The extended Gauss-Newton for the convex composite optimization problem on Riemannian manifold (1) is defined. The authors extend the notion of the quasi-regular point to Riemannian manifolds and specialize own results in two important cases: the classical Lipschitz condition and the \(\gamma\)-condition (implies the \(L\)-average Lipschitz condition) which have been used extensively in the study of convergence of Newton's method both in Banach spaces and Riemannian manifolds. If \(F\) satisfies the \(\gamma\)-condition at \(p_0\) in \(B (p_0, r)\), \(DF\) satisfies the \(L\)-average Lipschitz condition in \(B (p_0, r)\) with \(L\) given by \(L(u) = \frac{2 \gamma}{(1- \gamma u)^3}\) for each \(u\) with \(0 \leq u < \frac{1}{\gamma}\). For a regular point \(p_0\) of \(F(p) \in C\) there exist constants \(r>0\) and \(\beta_0 >0\) such that \(\Lambda (p) \neq \emptyset\) and \(d (0, \Lambda (p)) \leq \beta (d(p_0,p))d(F(p),C)\) for all \(p \in B (p_0,r)\) holds for \(r\) and \(\beta (.)= \beta_0\), consequently, \(p_0\) is a quasi-regular point with the quasi-regular radius \(r_{p_0} \geq r\) and the quasi-regular bound function \(\beta_{p_0} (.) \leq p_0\) on \([0,r]\).
0 references
Gauss-Newton method
0 references
Riemannian manifolds
0 references
\(L\)-average Lipschitz condition
0 references
quasi-regularity
0 references
convergence criterion
0 references
algorithm
0 references
regular point
0 references
convex process
0 references
sequence
0 references
convex composite optimization
0 references
semi-local convergence
0 references
0 references
0 references
0 references
0 references
0 references
0 references