Efficient overlap and content reuse detection in blogs and online news articles.

Jong Wook Kim, Kasim Candan, Junichi Tatemura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

24 Scopus citations

Abstract

The use of blogs to track and comment on real world (political, news, entertainment) events is growing. Similarly, as more individuals start relying on the Web as their primary information source and as more traditional media outlets try reaching consumers through alternative venues, the number of news sites on the Web is also continuously increasing. Content-reuse, whether in the form of extensive quotations or content borrowing across media outlets, is very common in blogs and news entries outlets tracking the same real-world event. Knowledge about which web entries re-use content from which others can be an effective asset when organizing these entries for presentation. On the other hand, this knowledge is not cheap to acquire: considering the size of the related space web entries, it is essential that the techniques developed for identifying re-use are fast and scalable. Furthermore, the dynamic nature of blog and news entries necessitates incremental processing for reuse detection. In this paper, we develop a novel qSign algorithm that efficiently and effectively analyze the blogosphere for quotation and reuse identification. Experiment results show that with qSign processing time gains from 10X to 100X are possible while maintaining reuse detection rates of upto 90%. Furthermore, processing time gains can be pushed multiple orders of magnitude (from 100X to 1000X) for 70% recall. Copyright is held by the International World Wide Web Conference Committee (IW3C2).

Original languageEnglish (US)
Title of host publicationWWW'09 - Proceedings of the 18th International World Wide Web Conference
Pages81-90
Number of pages10
DOIs
StatePublished - Dec 1 2009
Event18th International World Wide Web Conference, WWW 2009 - Madrid, Spain
Duration: Apr 20 2009Apr 24 2009

Publication series

NameWWW'09 - Proceedings of the 18th International World Wide Web Conference

Other

Other18th International World Wide Web Conference, WWW 2009
CountrySpain
CityMadrid
Period4/20/094/24/09

Keywords

  • Reuse detection
  • Weblogs

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Efficient overlap and content reuse detection in blogs and online news articles.'. Together they form a unique fingerprint.

  • Cite this

    Kim, J. W., Candan, K., & Tatemura, J. (2009). Efficient overlap and content reuse detection in blogs and online news articles. In WWW'09 - Proceedings of the 18th International World Wide Web Conference (pp. 81-90). (WWW'09 - Proceedings of the 18th International World Wide Web Conference). https://doi.org/10.1145/1526709.1526721