A multilevel approach for nonnegative matrix factorization

DOI10.1016/J.CAM.2011.10.002MaRDI QIDQ2428091zbMATH OpenOpenAlexFDO

Authors Nicolas Gillis, François Glineur

Publication date 24 April 2012

Published in Journal of Computational and Applied Mathematics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1009.0881

zbMATH Keywords

algorithmsnumerical examplesconvergence accelerationnonnegative matrix factorizationimage processingtext miningnonnegative least squaresmultigrid/multilevel methods

Mathematics Subject Classification ID

Direct numerical methods for linear systems and matrix inversion (65F05) Factorization of matrices (15A23) Numerical solutions to overdetermined systems, pseudoinverses (65F20) Image processing (compression, reconstruction, etc.) in information and communication theory (94A08) Positive matrices and their generalizations; cones of matrices (15B48)

Abstract: Nonnegative Matrix Factorization (NMF) is the problem of approximating a nonnegative matrix with the product of two low-rank nonnegative matrices and has been shown to be particularly useful in many applications, e.g., in text mining, image processing, computational biology, etc. In this paper, we explain how algorithms for NMF can be embedded into the framework of multilevel methods in order to accelerate their convergence. This technique can be applied in situations where data admit a good approximate representation in a lower dimensional space through linear transformations preserving nonnegativity. A simple multilevel strategy is described and is experimentally shown to speed up significantly three popular NMF algorithms (alternating nonnegative least squares, multiplicative updates and hierarchical alternating least squares) on several standard image datasets.

Recommendations

• Fast nonnegative matrix factorization: an active-set-like method and comparisons
• Nonnegative Matrix Factorization Based on Alternating Nonnegativity Constrained Least Squares and Active Set Method
• Accelerating nonnegative matrix factorization algorithms using extrapolation
• Nonnegative matrix factorization: model, algorithms and applications
• Analysis on a nonnegative matrix factorization and its applications

Cites work

• scientific article; zbMATH DE number 4078694 (Why is no real title available?)
• scientific article; zbMATH DE number 467276 (Why is no real title available?)
• scientific article; zbMATH DE number 1561761 (Why is no real title available?)
• scientific article; zbMATH DE number 3797119 (Why is no real title available?)
• scientific article; zbMATH DE number 883145 (Why is no real title available?)
• Algorithms and applications for approximate nonnegative matrix factorization
• Fast nonnegative matrix factorization: an active-set-like method and comparisons
• Hierarchical ALS Algorithms for Nonnegative Matrix and 3D Tensor Factorization
• Learning the parts of objects by non-negative matrix factorization
• Nonnegative Matrix Factorization Based on Alternating Nonnegativity Constrained Least Squares and Active Set Method
• Nonnegative matrix factorization for spectral data analysis
• Nonnegativity constraints in numerical analysis
• On the complexity of nonnegative matrix factorization
• On the rate of convergence of the image space reconstruction algorithm
• Projected Gradient Methods for Nonnegative Matrix Factorization
• Recursive Trust-Region Methods for Multiscale Nonlinear Optimization
• SVD based initialization: A head start for nonnegative matrix factorization
• Using underapproximations for sparse nonnegative matrix factorization

Cited in

(16)

• Accelerating nonnegative matrix factorization algorithms using extrapolation
• MGProx: a nonsmooth multigrid proximal gradient method with adaptive restriction for strongly convex optimization
• A survey on surrogate approaches to non-negative matrix factorization
• Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework
• LibNMF -- a library for nonnegative matrix factorization
• Multi-agent solver for non-negative matrix factorization based on optimization.
• Parallel nonnegative matrix factorization algorithm on the distributed memory platform
• Multilevel one-way dissection factorization
• Accelerated parallel and distributed algorithm using limited internal memory for nonnegative matrix factorization
• DC-NMF: nonnegative matrix factorization based on divide-and-conquer for fast clustering and topic modeling
• Image nonnegative factorization: formulation and numerical strategies
• Hyperplane-based nonnegative matrix factorization with label information
• A convergent algorithm for orthogonal nonnegative matrix factorization
• Updating/downdating the NonNegative Matrix Factorization
• NMF versus ICA for blind source separation
• Neural nonnegative matrix factorization for hierarchical multilayer topic modeling

This page was built for publication: A multilevel approach for nonnegative matrix factorization

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2428091)