Rank-one matrix pursuit for matrix completion

Zheng Wang, Ming Jun Lai, Zhaosong Lu, Wei Fan, Hasan Davulcu, Jieping Ye

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

Low rank matrix completion has been applied successfully in a wide range of machine learning applications, such as collaborative filtering, image inpainting and Microarray data imputation. However, many existing algorithms are not scalable to large-scale problems, as they involve computing singular value decomposition. In this paper, we present an efficient and scalable algo-rithm for matrix completion. The key idea is to extend the well-known orthogonal matching pursuit from the vector case to the matrix case. In each iteration, we pursue a rank-one matrix basis generated by the top singular vector pair of the current approximation residual and update the weights for all rank-one matrices obtained up to the current iteration. We further propose a novel weight updating rule to reduce the time and storage complexity, making the proposed algorithm scalable to large matrices. We establish the linear convergence of the proposed algorithm. The fast convergence is achieved due to the proposed construction of matrix bases and the estimation of the weights. We empirically evaluate the proposed algorithm on many real-world large-scale datasets. Results show that our algorithm is much more efficient than state-of-the- Art matrix completion algorithms while achieving similar or better prediction performance.

Original languageEnglish (US)
Title of host publication31st International Conference on Machine Learning, ICML 2014
PublisherInternational Machine Learning Society (IMLS)
Pages1260-1268
Number of pages9
ISBN (Electronic)9781634393973
StatePublished - Jan 1 2014
Event31st International Conference on Machine Learning, ICML 2014 - Beijing, China
Duration: Jun 21 2014Jun 26 2014

Publication series

Name31st International Conference on Machine Learning, ICML 2014
Volume2

Other

Other31st International Conference on Machine Learning, ICML 2014
CountryChina
CityBeijing
Period6/21/146/26/14

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Software

Fingerprint Dive into the research topics of 'Rank-one matrix pursuit for matrix completion'. Together they form a unique fingerprint.

  • Cite this

    Wang, Z., Lai, M. J., Lu, Z., Fan, W., Davulcu, H., & Ye, J. (2014). Rank-one matrix pursuit for matrix completion. In 31st International Conference on Machine Learning, ICML 2014 (pp. 1260-1268). (31st International Conference on Machine Learning, ICML 2014; Vol. 2). International Machine Learning Society (IMLS).