Adaptive algorithms for first principal eigenvector computation (Q557636)

From MaRDI portal
Revision as of 13:04, 10 June 2024 by ReferenceBot (talk | contribs) (‎Changed an Item)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
scientific article
Language Label Description Also known as
English
Adaptive algorithms for first principal eigenvector computation
scientific article

    Statements

    Adaptive algorithms for first principal eigenvector computation (English)
    0 references
    30 June 2005
    0 references
    The paper is really devoted to applications of simple iterative algorithms for finding approximations \(w_k\) of the first principal eigenvector of an unknown matrix \(A\) when only its approximations \(A_k \) are given. These \(A_k\) are generated by a sequence of random observation vectors \(x_k\in {\mathbb R}^n\); for example, \(A_k\equiv x_kx_k^T\), \(A_k\equiv \beta A_{k-1}+k^{-1}(x_kx_k^T-\beta A_{k-1}).\) Several gradient methods of the type \(w_{k+1}=w_k+\tau_kr(w_k,A_k)\) are considered with different objective functions; some of them deal with the Rayleigh quotient \(\lambda_k\) and have \(r(w_k,A_k)\) of the form \(r(w_k,A_k)\equiv [x_kx_k^T]^m(A_kw_k-\lambda_k(w_k)w_k) \) where \(m\in \{0,-1,1\}\). As an intermediate step in analyzing stochastic convergence, the ordinary differential equation \(dw/{dt}=\lim_{k}E[r(w,A_k)]\) is used. Convergence of known methods and of two new modifications are discussed. Numerical examples deal mainly with \(n=10\), \(k=250\), \(k=500.\)
    0 references
    0 references
    0 references
    0 references
    0 references
    correlation matrix of a random vector sequence
    0 references
    first principal eigenvector
    0 references
    stochastic approximation
    0 references
    adaptive iterative algorithms
    0 references
    gradient methods
    0 references
    stochastic convergence
    0 references
    numerical examples
    0 references
    principal component analysis
    0 references
    0 references
    0 references