Feature selection for hierarchical classification via joint semantic and structural information of labels

Hai Huang, Huan Liu

Research output: Contribution to journalArticle

Abstract

Hierarchical Classification is widely used in many real-world applications, where the label space is exhibited as a tree or a Directed Acyclic Graph (DAG) and each label has rich semantic descriptions. Feature selection, as a type of dimension reduction technique, has proven to be effective in improving the performance of machine learning algorithms. However, many existing feature selection methods cannot be directly applied to hierarchical classification problems since they ignore the hierarchical relations and take no advantage of the semantic information in the label space. In this paper, we propose a novel feature selection framework based on semantic and structural information of labels. First, we transform the label description into a mathematical representation and calculate the similarity score between labels as the semantic regularization. Second, we investigate the hierarchical relations in a tree structure of the label space as the structural regularization. Finally, we impose two regularization terms on a sparse learning based model for feature selection. Additionally, we adapt the proposed model to a DAG case, which makes our method more general and robust in many real-world tasks. Experimental results on real-world datasets demonstrate the effectiveness of the proposed framework for hierarchical classification domains.

Original languageEnglish (US)
Article number105655
JournalKnowledge-Based Systems
Volume195
DOIs
StatePublished - May 11 2020

Keywords

  • Feature selection
  • Hierarchical classification
  • Label hierarchical structure
  • Label semantic similarity

ASJC Scopus subject areas

  • Management Information Systems
  • Software
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Feature selection for hierarchical classification via joint semantic and structural information of labels'. Together they form a unique fingerprint.

  • Cite this