Bidirectional nonnegative deep model and its optimization in learning

DOI10.1155/2016/5975120MaRDI QIDQ1659217zbMATH OpenOpenAlexWikidataFDO

Authors Xianhua Zeng, Zhengyi He, Hong Yu, Shengwei Qu

Publication date 15 August 2018

Published in Journal of Optimization (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://doi.org/10.1155/2016/5975120

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07)

Review text

Summary: Nonnegative matrix factorization (NMF) has been successfully applied in signal processing as a simple two-layer nonnegative neural network. Projective NMF (PNMF) with fewer parameters was proposed, which projects a high-dimensional nonnegative data onto a lower-dimensional nonnegative subspace. Although PNMF overcomes the problem of out-of-sample of NMF, it does not consider the nonlinear characteristic of data and is only a kind of narrow signal decomposition method. In this paper, we combine the PNMF with deep learning and nonlinear fitting to propose a bidirectional nonnegative deep learning (BNDL) model and its optimization learning algorithm, which can obtain nonlinear multilayer deep nonnegative feature representation. Experiments show that the proposed model can not only solve the problem of out-of-sample of NMF but also learn hierarchical nonnegative feature representations with better clustering performance than classical NMF, PNMF, and Deep Semi-NMF algorithms.

Recommendations

• Nonparametric Bayesian nonnegative matrix factorization
• Nonnegative matrix factorization with local similarity learning
• Efficient nonnegative matrix factorization via projected Newton method
• Nonnegative matrix factorization: model, algorithms and applications
• A modified non-monotonic projection gradient method for non-negative matrix factorization

Cites work

• Learning deep architectures for AI
• Learning the parts of objects by non-negative matrix factorization
• Projective Nonnegative Graph Embedding
• Reducing the Dimensionality of Data with Neural Networks

Cited in

(1)

• Maximum lateness scheduling on two-person cooperative games with variable processing times and common due date

Describes a project that uses

Uses Software

• darch

This page was built for publication: Bidirectional nonnegative deep model and its optimization in learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1659217)