Efficient sparse group feature selection via nonconvex optimization

Shuo Xiang, Xiaotong Shen, Jieping Ye

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Scopus citations

Abstract

Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and parameter estimation. In this paper, we expand a nonconvex paradigm to sparse group feature selection, which is motivated by applications that require identifying the underlying group structure and performing feature selection simultaneously. The main contributions of this article are twofold: (1) computationally, we introduce a nonconvex sparse group feature selection model and present an efficient optimization algorithm, of which the key step is a projection with two coupled constraints; (2) statistically, we show that the proposed model can reconstruct the oracle estimator. Therefore, consistent feature selection and parameter estimation can be achieved. Numerical results on synthetic and real-world data suggest that the proposed nonconvex method compares favorably against its competitors, thus achieving desired goal of delivering high performance.

Original languageEnglish (US)
Title of host publication30th International Conference on Machine Learning, ICML 2013
PublisherInternational Machine Learning Society (IMLS)
Pages284-292
Number of pages9
EditionPART 1
StatePublished - 2013
Event30th International Conference on Machine Learning, ICML 2013 - Atlanta, GA, United States
Duration: Jun 16 2013Jun 21 2013

Other

Other30th International Conference on Machine Learning, ICML 2013
CountryUnited States
CityAtlanta, GA
Period6/16/136/21/13

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Sociology and Political Science

Fingerprint Dive into the research topics of 'Efficient sparse group feature selection via nonconvex optimization'. Together they form a unique fingerprint.

  • Cite this

    Xiang, S., Shen, X., & Ye, J. (2013). Efficient sparse group feature selection via nonconvex optimization. In 30th International Conference on Machine Learning, ICML 2013 (PART 1 ed., pp. 284-292). International Machine Learning Society (IMLS).