High-performance composite event monitoring system supporting large numbers of queries and sources

SangJeong Lee, Youngki Lee, Byoungjip Kim, Kasim Candan, Yunseok Rhee, Junehwa Song

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper presents a novel data structure, called Event-centric Composable Queue (ECQ), a basic building block of a new scalable composite event monitoring (CEM) framework, SCEMon. In particular, we focus on the scalability issues when large numbers of CEM queries and event sources exist in upcoming CEM environments. To address these challenges effectively, we take an event-centric sharing approach rather than dealing with queries and sources separately. ECQ is a shared queue, which stores incoming event instances of a primitive event class. ECQs are designed to facilitate efficient shared evaluations of multiple queries over very large volumes of event streams from numerous event sources. ECQs are composable and form a single shared network within which multiple queries are simultaneously evaluated. In this paper, we present efficient shared processing techniques operating on top of the proposed shared ECQ network. The performance evaluation shows that the proposed approach achieves a high level of scalability compared to conventional separate processing approaches in large-scale CEM environments.

Original languageEnglish (US)
Title of host publicationDEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems
Pages137-148
Number of pages12
DOIs
StatePublished - 2011
Event5th ACM International Conference on Distributed Event-Based Systems, DEBS'11 - New York, NY, United States
Duration: Jul 11 2011Jul 15 2011

Other

Other5th ACM International Conference on Distributed Event-Based Systems, DEBS'11
CountryUnited States
CityNew York, NY
Period7/11/117/15/11

Fingerprint

Monitoring
Composite materials
Scalability
Processing
Data structures

Keywords

  • composite event monitoring
  • event streams
  • scalable processing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Cite this

Lee, S., Lee, Y., Kim, B., Candan, K., Rhee, Y., & Song, J. (2011). High-performance composite event monitoring system supporting large numbers of queries and sources. In DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems (pp. 137-148) https://doi.org/10.1145/2002259.2002280

High-performance composite event monitoring system supporting large numbers of queries and sources. / Lee, SangJeong; Lee, Youngki; Kim, Byoungjip; Candan, Kasim; Rhee, Yunseok; Song, Junehwa.

DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems. 2011. p. 137-148.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lee, S, Lee, Y, Kim, B, Candan, K, Rhee, Y & Song, J 2011, High-performance composite event monitoring system supporting large numbers of queries and sources. in DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems. pp. 137-148, 5th ACM International Conference on Distributed Event-Based Systems, DEBS'11, New York, NY, United States, 7/11/11. https://doi.org/10.1145/2002259.2002280
Lee S, Lee Y, Kim B, Candan K, Rhee Y, Song J. High-performance composite event monitoring system supporting large numbers of queries and sources. In DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems. 2011. p. 137-148 https://doi.org/10.1145/2002259.2002280
Lee, SangJeong ; Lee, Youngki ; Kim, Byoungjip ; Candan, Kasim ; Rhee, Yunseok ; Song, Junehwa. / High-performance composite event monitoring system supporting large numbers of queries and sources. DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems. 2011. pp. 137-148
@inproceedings{91bdc3e05a6e43f8b90393de47d245ab,
title = "High-performance composite event monitoring system supporting large numbers of queries and sources",
abstract = "This paper presents a novel data structure, called Event-centric Composable Queue (ECQ), a basic building block of a new scalable composite event monitoring (CEM) framework, SCEMon. In particular, we focus on the scalability issues when large numbers of CEM queries and event sources exist in upcoming CEM environments. To address these challenges effectively, we take an event-centric sharing approach rather than dealing with queries and sources separately. ECQ is a shared queue, which stores incoming event instances of a primitive event class. ECQs are designed to facilitate efficient shared evaluations of multiple queries over very large volumes of event streams from numerous event sources. ECQs are composable and form a single shared network within which multiple queries are simultaneously evaluated. In this paper, we present efficient shared processing techniques operating on top of the proposed shared ECQ network. The performance evaluation shows that the proposed approach achieves a high level of scalability compared to conventional separate processing approaches in large-scale CEM environments.",
keywords = "composite event monitoring, event streams, scalable processing",
author = "SangJeong Lee and Youngki Lee and Byoungjip Kim and Kasim Candan and Yunseok Rhee and Junehwa Song",
year = "2011",
doi = "10.1145/2002259.2002280",
language = "English (US)",
isbn = "9781450309059",
pages = "137--148",
booktitle = "DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems",

}

TY - GEN

T1 - High-performance composite event monitoring system supporting large numbers of queries and sources

AU - Lee, SangJeong

AU - Lee, Youngki

AU - Kim, Byoungjip

AU - Candan, Kasim

AU - Rhee, Yunseok

AU - Song, Junehwa

PY - 2011

Y1 - 2011

N2 - This paper presents a novel data structure, called Event-centric Composable Queue (ECQ), a basic building block of a new scalable composite event monitoring (CEM) framework, SCEMon. In particular, we focus on the scalability issues when large numbers of CEM queries and event sources exist in upcoming CEM environments. To address these challenges effectively, we take an event-centric sharing approach rather than dealing with queries and sources separately. ECQ is a shared queue, which stores incoming event instances of a primitive event class. ECQs are designed to facilitate efficient shared evaluations of multiple queries over very large volumes of event streams from numerous event sources. ECQs are composable and form a single shared network within which multiple queries are simultaneously evaluated. In this paper, we present efficient shared processing techniques operating on top of the proposed shared ECQ network. The performance evaluation shows that the proposed approach achieves a high level of scalability compared to conventional separate processing approaches in large-scale CEM environments.

AB - This paper presents a novel data structure, called Event-centric Composable Queue (ECQ), a basic building block of a new scalable composite event monitoring (CEM) framework, SCEMon. In particular, we focus on the scalability issues when large numbers of CEM queries and event sources exist in upcoming CEM environments. To address these challenges effectively, we take an event-centric sharing approach rather than dealing with queries and sources separately. ECQ is a shared queue, which stores incoming event instances of a primitive event class. ECQs are designed to facilitate efficient shared evaluations of multiple queries over very large volumes of event streams from numerous event sources. ECQs are composable and form a single shared network within which multiple queries are simultaneously evaluated. In this paper, we present efficient shared processing techniques operating on top of the proposed shared ECQ network. The performance evaluation shows that the proposed approach achieves a high level of scalability compared to conventional separate processing approaches in large-scale CEM environments.

KW - composite event monitoring

KW - event streams

KW - scalable processing

UR - http://www.scopus.com/inward/record.url?scp=80051928711&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80051928711&partnerID=8YFLogxK

U2 - 10.1145/2002259.2002280

DO - 10.1145/2002259.2002280

M3 - Conference contribution

AN - SCOPUS:80051928711

SN - 9781450309059

SP - 137

EP - 148

BT - DEBS'11 - Proceedings of the 5th ACM International Conference on Distributed Event-Based Systems

ER -