Linear dimensionality reduction for multi-label classification

Shuiwang Ji, Jieping Ye

Research output: Chapter in Book/Report/Conference proceedingConference contribution

80 Scopus citations

Abstract

Dimensionality reduction is an essential step in high-dimensional data analysis. Many dimensionality reduction algorithms have been applied successfully to multi-class and multi-label problems. They are commonly applied as a separate data preprocessing step before classification algorithms. In this paper, we study a joint learning framework in which we perform dimensionality reduction and multi-label classification simultaneously. We show that when the least squares loss is used in classification, this joint learning decouples into two separate components, i.e., dimensionality reduction followed by multi-label classification. This analysis partially justifies the current practice of a separate application of dimensionality reduction for classification problems. We extend our analysis using other loss functions, including the hinge loss and the squared hinge loss. We further extend the formulation to the more general case where the input data for different class labels may differ, overcoming the limitation of traditional dimensionality reduction algorithms. Experiments on benchmark data sets have been conducted to evaluate the proposed joint formulations.

Original languageEnglish (US)
Title of host publicationIJCAI-09 - Proceedings of the 21st International Joint Conference on Artificial Intelligence
PublisherInternational Joint Conferences on Artificial Intelligence
Pages1077-1082
Number of pages6
ISBN (Print)9781577354260
StatePublished - Jan 1 2009
Event21st International Joint Conference on Artificial Intelligence, IJCAI 2009 - Pasadena, United States
Duration: Jul 11 2009Jul 16 2009

Publication series

NameIJCAI International Joint Conference on Artificial Intelligence
ISSN (Print)1045-0823

Conference

Conference21st International Joint Conference on Artificial Intelligence, IJCAI 2009
CountryUnited States
CityPasadena
Period7/11/097/16/09

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Linear dimensionality reduction for multi-label classification'. Together they form a unique fingerprint.

  • Cite this

    Ji, S., & Ye, J. (2009). Linear dimensionality reduction for multi-label classification. In IJCAI-09 - Proceedings of the 21st International Joint Conference on Artificial Intelligence (pp. 1077-1082). (IJCAI International Joint Conference on Artificial Intelligence). International Joint Conferences on Artificial Intelligence.