Discriminant analysis for unsupervised feature selection

Jiliang Tang, Xia Hu, Huiji Gao, Huan Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Scopus citations

Abstract

Feature selection has been proven to be efficient in preparing high dimensional data for data mining and machine learning. As most data is unlabeled, unsupervised feature selection has attracted more and more attention in recent years. Discriminant analysis has been proven to be a powerful technique to select discriminative features for supervised feature selection. To apply discriminant analysis, we usually need label information which is absent for unlabeled data. This gap makes it challenging to apply discriminant analysis for unsupervised feature selection. In this paper, we investigate how to exploit discriminant analysis in unsupervised scenarios to select discriminative features. We introduce the concept of pseudo labels, which enable discriminant analysis on unlabeled data, propose a novel unsupervised feature selection framework DisUFS which incorporates learning discriminative features with generating pseudo labels, and develop an effective algorithm for DisUFS. Experimental results on different types of real-world data demonstrate the effectiveness of the proposed framework DisUFS.

Original languageEnglish (US)
Title of host publicationSIAM International Conference on Data Mining 2014, SDM 2014
PublisherSociety for Industrial and Applied Mathematics Publications
Pages938-946
Number of pages9
Volume2
ISBN (Print)9781510811515
DOIs
Publication statusPublished - 2014
Event14th SIAM International Conference on Data Mining, SDM 2014 - Philadelphia, United States
Duration: Apr 24 2014Apr 26 2014

Other

Other14th SIAM International Conference on Data Mining, SDM 2014
CountryUnited States
CityPhiladelphia
Period4/24/144/26/14

    Fingerprint

ASJC Scopus subject areas

  • Computer Science Applications
  • Software

Cite this

Tang, J., Hu, X., Gao, H., & Liu, H. (2014). Discriminant analysis for unsupervised feature selection. In SIAM International Conference on Data Mining 2014, SDM 2014 (Vol. 2, pp. 938-946). Society for Industrial and Applied Mathematics Publications. https://doi.org/10.1137/1.9781611973440.107