Complex Pattern Ranking (CPR): Evaluating top-k pattern queries over event streams

Xinxin Wang, Kasim Candan, Junehwa Song

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Most existing approaches to complex event processing over streaming data rely on the assumption that the matches to the queries are rare and that the goal of the system is to identify these few matches within the incoming deluge of data. In many applications, such as user credit card purchase pattern monitoring, however the matches to the user queries are in fact plentiful and the system has to efficiently sift through these many matches to locate only the few most preferable matches. In this paper, we propose a complex pattern ranking (CPR) framework for specifying top-k pattern queries over streaming data, present new algorithms to support top-k pattern queries in data streaming environments, and verify the effectiveness and efficiency of the proposed algorithms. The algorithms we develop identify top-k matching results satisfying both patterns and additional criteria. To support real-time processing of the data streams, instead of computing top-k results from scratch for each time window, we maintain top-k results dynamically as new events come and old ones expire. We also develop new top-k join execution strategies that are able to adapt to the changing situations (e.g., sorted and random access costs, join rates) without having to assume a priori presence of distributed stream statistics. Experiments show significant improvements over existing approaches.

Original languageEnglish (US)
Title of host publicationDEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems
Pages279-290
Number of pages12
DOIs
StatePublished - Aug 26 2011
Event5th ACM International Conference on Distributed Event-Based Systems, DEBS'11 - New York, NY, United States
Duration: Jul 11 2011Jul 15 2011

Publication series

NameDEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems

Other

Other5th ACM International Conference on Distributed Event-Based Systems, DEBS'11
CountryUnited States
CityNew York, NY
Period7/11/117/15/11

Keywords

  • complex event processing
  • pattern ranking
  • topk query

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Fingerprint Dive into the research topics of 'Complex Pattern Ranking (CPR): Evaluating top-k pattern queries over event streams'. Together they form a unique fingerprint.

Cite this