Adaptive algorithms for first principal eigenvector computation (Q557636)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Adaptive algorithms for first principal eigenvector computation
scientific article

    Statements

    Adaptive algorithms for first principal eigenvector computation (English)
    0 references
    30 June 2005
    0 references
    The paper is really devoted to applications of simple iterative algorithms for finding approximations \(w_k\) of the first principal eigenvector of an unknown matrix \(A\) when only its approximations \(A_k \) are given. These \(A_k\) are generated by a sequence of random observation vectors \(x_k\in {\mathbb R}^n\); for example, \(A_k\equiv x_kx_k^T\), \(A_k\equiv \beta A_{k-1}+k^{-1}(x_kx_k^T-\beta A_{k-1}).\) Several gradient methods of the type \(w_{k+1}=w_k+\tau_kr(w_k,A_k)\) are considered with different objective functions; some of them deal with the Rayleigh quotient \(\lambda_k\) and have \(r(w_k,A_k)\) of the form \(r(w_k,A_k)\equiv [x_kx_k^T]^m(A_kw_k-\lambda_k(w_k)w_k) \) where \(m\in \{0,-1,1\}\). As an intermediate step in analyzing stochastic convergence, the ordinary differential equation \(dw/{dt}=\lim_{k}E[r(w,A_k)]\) is used. Convergence of known methods and of two new modifications are discussed. Numerical examples deal mainly with \(n=10\), \(k=250\), \(k=500.\)
    0 references
    0 references
    0 references
    0 references
    0 references
    correlation matrix of a random vector sequence
    0 references
    first principal eigenvector
    0 references
    stochastic approximation
    0 references
    adaptive iterative algorithms
    0 references
    gradient methods
    0 references
    stochastic convergence
    0 references
    numerical examples
    0 references
    principal component analysis
    0 references
    0 references
    0 references