Scalable learning of collective behavior based on sparse social dimensions

Lei Tang, Huan Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

131 Scopus citations

Abstract

The study of collective behavior is to understand how individuals behave in a social network environment. Oceans of data generated by social media like Facebook, Twitter, Flickr and YouTube present opportunities and challenges to studying collective behavior in a large scale. In this work, we aim to learn to predict collective behavior in social media. In particular, given information about some individuals, how can we infer the behavior of unobserved individuals in the same network? A social-dimension based approach is adopted to address the heterogeneity of connections presented in social media. However, the networks in social media are normally of colossal size, involving hundreds of thousands or even millions of actors. The scale of networks entails scalable learning of models for collective behavior prediction. To address the scalability issue, we propose an edge-centric clustering scheme to extract sparse social dimensions. With sparse social dimensions, the social-dimension based approach can efficiently handle networks of millions of actors while demonstrating comparable prediction performance as other non-scalable methods.

Original languageEnglish (US)
Title of host publicationACM 18th International Conference on Information and Knowledge Management, CIKM 2009
Pages1107-1116
Number of pages10
DOIs
StatePublished - Dec 1 2009
EventACM 18th International Conference on Information and Knowledge Management, CIKM 2009 - Hong Kong, China
Duration: Nov 2 2009Nov 6 2009

Publication series

NameInternational Conference on Information and Knowledge Management, Proceedings

Conference

ConferenceACM 18th International Conference on Information and Knowledge Management, CIKM 2009
CountryChina
CityHong Kong
Period11/2/0911/6/09

    Fingerprint

Keywords

  • Behavior prediction
  • Edge-centric clustering
  • Relational learning
  • Social dimensions
  • Social media

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Business, Management and Accounting(all)

Cite this

Tang, L., & Liu, H. (2009). Scalable learning of collective behavior based on sparse social dimensions. In ACM 18th International Conference on Information and Knowledge Management, CIKM 2009 (pp. 1107-1116). (International Conference on Information and Knowledge Management, Proceedings). https://doi.org/10.1145/1645953.1646094