Nonmonotone Barzilai-Borwein gradient algorithm for \(\ell_1\)-regularized nonsmooth minimization in compressive sensing (Q474971)

From MaRDI portal





scientific article
Language Label Description Also known as
default for all languages
No label defined
    English
    Nonmonotone Barzilai-Borwein gradient algorithm for \(\ell_1\)-regularized nonsmooth minimization in compressive sensing
    scientific article

      Statements

      Nonmonotone Barzilai-Borwein gradient algorithm for \(\ell_1\)-regularized nonsmooth minimization in compressive sensing (English)
      0 references
      0 references
      0 references
      0 references
      25 November 2014
      0 references
      The authors propose, analyze and test a new practical algorithm to solve the separable nonsmooth minimization problem consisting of an \(\ell_1\)-norm regularized term and a continuously differentiable term. This type of problem mainly appears in signal/image processing, compressive sensing, machine learning, and linear inverse problem. However, the problem is challenging because of the non-smoothness of the regularization term. For various practical problems, either the computing efforts of the Hessian matrices are very expensive or the evaluation of the Hessian is difficult, the Hessian is not even available analytically. These challenges lead to the quasi-Newton method, which generates a series of Hessian approximation through the use of the gradient while maintaining a fast rate of convergence.
      0 references
      0 references
      nonsmooth optimization
      0 references
      nonconvex optimization
      0 references
      Barzilai-Borwein gradient algorithm
      0 references
      nonmonotone line search
      0 references
      \(\ell_1\) regularization
      0 references
      compressive sensing
      0 references
      gradient algorithm
      0 references
      iteration
      0 references
      numerical experiments
      0 references
      smooth term
      0 references
      globally convergent
      0 references
      quasi-Newton method
      0 references
      Hessian approximation
      0 references
      positive components
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references

      Identifiers

      0 references
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references