Bayesian network based label correlation analysis for multi-label classifier chain

DOI10.1016/J.INS.2020.12.010zbMATH Open1484.68198arXiv1908.02172OpenAlexW3112713339MaRDI QIDQ2124164FDOQ2124164

Sam Kwong, Ran Wang, Ke Li, Suhe Ye

Publication date: 14 April 2022

Published in: Information Sciences (Search for Journal in Brave)

Abstract: Classifier chain (CC) is a multi-label learning approach that constructs a sequence of binary classifiers according to a label order. Each classifier in the sequence is responsible for predicting the relevance of one label. When training the classifier for a label, proceeding labels will be taken as extended features. If the extended features are highly correlated to the label, the performance will be improved, otherwise, the performance will not be influenced or even degraded. How to discover label correlation and determine the label order is critical for CC approach. This paper employs Bayesian network (BN) to model the label correlations and proposes a new BN-based CC method (BNCC). First, conditional entropy is used to describe the dependency relations among labels. Then, a BN is built up by taking nodes as labels and weights of edges as their dependency relations. A new scoring function is proposed to evaluate a BN structure, and a heuristic algorithm is introduced to optimize the BN. At last, by applying topological sorting on the nodes of the optimized BN, the label order for constructing CC model is derived. Experimental comparisons demonstrate the feasibility and effectiveness of the proposed method.

Full work available at URL: https://arxiv.org/abs/1908.02172

Recommendations

• Expressive power of binary relevance and chain classifiers based on Bayesian networks for multi-label classification
• Decision functions for chain classifiers based on Bayesian networks for multi-label classification
• Classifier chains: a review and perspectives
• An analysis of chaining in multi-label classification
• Efficient Monte Carlo methods for multi-dimensional learning with classifier chains

zbMATH Keywords

Bayesian networkmulti-label learningscoring functiontopological sortingclassifier chainlabel correlation

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05) Probabilistic graphical models (62H22)

Cites Work

• A Bayesian method for the induction of probabilistic networks from data
• Title not available (Why is that?)
• Topological sorting of large networks
• ML-KNN: A lazy learning approach to multi-label learning
• Multilabel classification via calibrated label ranking
• Multi-Label Image Categorization With Sparse Factor Representation
• Robust non-negative sparse graph for semi-supervised multi-label learning with missing labels
• Decision functions for chain classifiers based on Bayesian networks for multi-label classification
• A vector-valued support vector machine model for multiclass problem
• Discovering and orienting the edges connected to a target variable in a DAG via a sequential local learning approach
• A novel approach for learning label correlation with application to feature selection of multi-label data
• Improving multi-label classification with missing labels by learning label-specific features
• Multilabel Image Classification Via High-Order Label Correlation Driven Active Learning

Cited In (5)

• Risk spillover network structure learning for correlated financial assets: a directed acyclic graph approach
• Feature selection for multi-labeled data based on label enhancement technique and mutual information
• Learning the structure of Bayesian networks with ancestral and/or heuristic partition
• Additive noise model structure learning based on rank correlation
• Hybrid learning based on Fisher linear discriminant

Uses Software

• ML-KNN

This page was built for publication: Bayesian network based label correlation analysis for multi-label classifier chain

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2124164)