research-article

Cordies: expressive event correlation in distributed systems

Authors:

Gerald G. Koch,

Boris Koldehofe,

Kurt RothermelAuthors Info & Claims

DEBS '10: Proceedings of the Fourth ACM International Conference on Distributed Event-Based Systems

Pages 26 - 37

https://doi.org/10.1145/1827418.1827424

Published: 12 July 2010 Publication History

Abstract

Complex Event Processing (CEP) is the method of choice for the observation of system states and situations by means of events. A number of systems have been introduced that provide CEP in selected environments. Some are restricted to centralised systems, or to systems with synchronous communication, or to a limited space of event relations that are defined in advance. Many modern systems, though, are inherently distributed and asynchronous, and require a more powerful CEP. We present Cordies, a distributed system for the detection of correlated events that is designed for the operation in large-scale, heterogeneous networks and adapts dynamically to changing network conditions. With its expressive language to describe event relations, it is suitable for environments where neither the event space nor the situations of interest are predefined but are constantly adapted. In addition, Cordies supports Quality-of-Service (QoS) for communication in distributed event correlation detection.

References

[1]

R. Adaikkalavan and S. Chakravarthy. SnoopIB: interval-based event specification and detection for active databases. Data Knowl. Eng., 59(1):139--165, 2006.

Digital Library

[2]

R. Adaikkalavan and S. Chakravarthy. Event specification and processing for advanced applications: Generalization and formalization. In DEXA, pages 369--379, 2007.

Digital Library

[3]

A. Adi and O. Etzion. Amit - the situation manager. The VLDB Journal, 13(2):177--203, 2004.

Digital Library

[4]

J. F. Allen. Maintaining knowledge about temporal intervals. Commun. ACM, 26(11):832--843, 1983.

Digital Library

[5]

J. Bailey and S. Mikulás. Expressiveness issues and decision problems for active database event queries. In ICDT '01: Proc. 8th Int. Conf. on Database Theory, pages 68--82. Springer-Verlag, 2001.

Digital Library

[6]

C. Bornhövd and A. P. Buchmann. CREAM: An infrastructure for distributed, heterogeneous event-based applications, 2003.

[7]

F. Bry and M. Eckert. Rule-based composite event queries: The language xchangeeq and its semantics. Lecture Notes in Computer Science, 4524:16--30, 2007.

Digital Library

[8]

A. T. Campbell, S. B. Eisenman, N. D. Lane, E. Miluzzo, R. A. Peterson, H. Lu, X. Zheng, M. Musolesi, K. Fodor, and G.-S. Ahn. The rise of people-centric sensing. IEEE Internet Computing, 12(4):12--21, 2008.

Digital Library

[9]

J. Carlson and B. Lisper. An event detection algebra for reactive systems. In EMSOFT '04: Proc. 4th ACM Int. conf. on Embedded software, pages 147--154. ACM, 2004.

Digital Library

[10]

S. Chakravarthy and D. Mishra. Snoop: An expressive event specification language for active databases. Data Knowledge Engineering, 14(1):1--26, 1994.

Digital Library

[11]

C.-H. Chen-Ritzo, C. Harrison, J. Paraszczak, and F. Parr. Instrumenting the planet. IBM J. Res. Dev., 53(3):1:1--1:16, 2009.

Digital Library

[12]

S. Courtenage. Specifying and detecting composite events in content-based publish/subscribe systems. Proc. 22nd Int. Conf. on Distributed Computing Systems Workshops, pages 602--607, 2002.

Digital Library

[13]

M. J. Franklin, S. R. Jeffery, S. Krishnamurthy, and F. Reiss. Design considerations for high fan-in systems: The HiFi approach. In CIDR, pages 290--304, 2005.

[14]

S. Gatziu and K. Dittrich. Detecting composite events in active database systems using petri nets. Proc. 4th Int. Workshop on Research Issues in Data Engineering, pages 2--9, 1994.

[15]

N. H. Gehani, H. V. Jagadish, and O. Shmueli. Event specification in an active object-oriented database. In SIGMOD '92: Proc. ACM Int. Conf. on Management of Data, pages 81--90. ACM, 1992.

Digital Library

[16]

D. Haage, R. Holz, H. Niedermayer, and P. Laskov. CLIO - a cross-layer information service for overlay network optimization. In Kommunikation in Verteilten Systemen (KiVS) 2009, 2009.

[17]

A. Hinze and A. Voisard. A parameterized algebra for event notification services. In TIME '02: Proc. 9th Int. Symposium on Temporal Representation and Reasoning, page 61. IEEE Computer Society, 2002.

Digital Library

[18]

G. G. Koch, B. Koldehofe, and K. Rothermel. Higher confidence in event correlation using uncertainty restrictions. In Proc. 28th IEEE Int. Conf. on Distributed Computing Systems Workshops (ICDCSW '08). IEEE Computer Society, 2008.

Digital Library

[19]

G. Li and H.-A. Jacobsen. Composite subscriptions in content-based publish/subscribe systems. In Middleware 2005, number 3970 in Lecture Notes in Computer Science, pages 249--269. Springer, 2005.

Digital Library

[20]

G. Li, V. Muthusamy, and H.-A. Jacobsen. Adaptive content-based routing in general overlay topologies. In Middleware '08: Proc. 9th ACM/IFIP/USENIX Int. Conf. on Middleware, pages 1--21. Springer, 2008.

Digital Library

[21]

C. Liebig, M. Cilia, and A. Buchmann. Event composition in time-dependent distributed systems. In COOPIS '99: Proc. 4th IECIS Int. Conf. on Cooperative Information Systems, page 70. IEEE Computer Society, 1999.

Digital Library

[22]

D. C. Luckham. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley Longman Publishing Co., Inc., 2001.

Digital Library

[23]

A. Mackworth. Consistency in networks of relations. Artificial Intelligence, 8(1):99--118, 1977. Reprinted in Readings in Artificial Intelligence, B. L. Webber and N. J. Nilsson (eds.), Tioga Publ. Col., pp. 69--78, 1981.

Digital Library

[24]

M. Mansouri-Samani and M. Sloman. GEM: A generalized event monitoring language for distributed systems. IEE/IOP/BCS Distributed Systems Engineering Journal, 4:96--108, 1997.

[25]

A. Nagargadde, S. Varadarajan, and K. Ramamritham. Semantic characterization of real world events. In DASFAA, pages 675--687. Springer, 2005.

Digital Library

[26]

A. Nagargadde, S. Varadarajan, and K. Ramamritham. Representation and processing of information related to real world events. Know.-Based Syst., 20(1):1--16, 2007.

Digital Library

[27]

P. Pietzuch, J. Ledlie, J. Shneidman, M. Roussopoulos, M. Welsh, and M. Seltzer. Network-aware operator placement for stream-processing systems. In ICDE '06: Proc. 22nd Int. Conf. on Data Engineering, page 49. IEEE Computer Society, 2006.

Digital Library

[28]

P. R. Pietzuch, B. Shand, and J. Bacon. Composite event detection as a generic middleware extension. Network, IEEE, 18:44--55, 2004.

Digital Library

[29]

S. Rizou, F. Dürr, and K. Rothermel. Solving the Multi-operator Placement Problem in Large-Scale Operator Networks. Technical Report 2009/03, University of Stuttgart, Collaborative Research Center 627, 2009.

[30]

S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice-Hall, Englewood Cliffs, NJ, 2nd edition edition, 2003.

Digital Library

[31]

C. Sánchez, S. Sankaranarayanan, H. Sipma, T. Zhang, D. Dill, and Z. Manna. Event correlation: Language and semantics. Lecture Notes in Computer Science, 2855:323--339, 2003.

[32]

B. Schilling, B. Koldehofe, U. Pletat, and K. Rothermel. Distributed heterogeneous event processing: Enhancing scalability and interoperability of cep in an industrial context. In DEBS '10: Proc. 4th Int. Conf. on Distributed Event-based Systems. ACM, 2010.

Digital Library

[33]

S. Schwiderski. Monitoring the Behaviour of Distributed Systems. PhD thesis, Selwyn College, University of Cambridge, 1996.

[34]

S. Schwiderski-Grosche and K. Moody. The SpaTeC composite event language for spatio-temporal reasoning in mobile systems. In DEBS '09: Proc. 3rd ACM Int. Conf. on Distributed Event-Based Systems, pages 1--12. ACM, 2009.

Digital Library

[35]

M. A. Tariq, G. G. Koch, B. Koldehofe, and K. Rothermel. Dynamic publish/subscribe to meet subscriber-defined delay and bandwidth constraints. In Euro-Par'10: Proc. 16th Int. Euro-Par Conf. Springer, 2010.

Digital Library

[36]

O. Waldhorst, C. Blankenhorn, D. Haage, R. Holz, G. Koch, B. Koldehofe, F. Lampi, C. Mayer, and S. Mies. Spontaneous Virtual Networks: On the Road towards the Internet's Next Generation. it --- Information Technology Special Issue on Next Generation Internet, 50(6), Dec. 2008.

[37]

E. Yoneki and J. Bacon. Unified semantics for event correlation over time and space in hybrid network environments. In On the Move to Meaningful Internet Systems 2005: CoopIS, DOA, and ODBASE, volume 3760, pages 366--384. Springer Verlag, 2005.

Digital Library

[38]

D. Zimmer and R. Unland. On the semantics of complex events in active database management systems. Int. Conf. on Data Engineering, 0:392, 1999.

Digital Library

Cited By

Bédard AHallé S(2023)Formal verification for event stream processingInformation and Computation10.1016/j.ic.2023.105058293:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.ic.2023.105058
Flouris IGiatrakos NDeligiannakis AGarofalakis M(2022)Network-wide complex event processing over geographically distributed data sourcesInformation Systems10.1016/j.is.2019.10144288:COnline publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.is.2019.101442
Verma RBrazauskas JSafronov VDanish MLewis IMortier R(2021)RACERProceedings of the 29th International Conference on Advances in Geographic Information Systems10.1145/3474717.3484270(634-637)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3474717.3484270
Show More Cited By

Index Terms

Cordies: expressive event correlation in distributed systems
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Modeling the Software Execution of CEP in DCEP-Sim
DEBS '19: Proceedings of the 13th ACM International Conference on Distributed and Event-based Systems

DCEP-Sim facilitates simulation of distributed CEP where the latency and bandwidth limitations in the network are well reflected, but it currently lacks models to simulate the temporal behavior of event processing. In this demonstration, we use a ...
A scalable complex event processing system and evaluations of its performance
DEBS '12: Proceedings of the 6th ACM International Conference on Distributed Event-Based Systems

This paper describes a scalable context delivery platform (SCTXPF) and our evaluations of it. The SCTXPF receives a large number of events from various event sources and a large number of complex event processing (CEP) rules from various services/...
A Hybrid Complex Event Service Based on IoT Resource Models
ICWS '15: Proceedings of the 2015 IEEE International Conference on Web Services

Traditional Complex Event systems (CEP) did not consider the computation requirements of continuous dynamic behavior such as differential equations. In addition, the event composition rules were predefined before the CEP engine began working. The rule ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DEBS '10: Proceedings of the Fourth ACM International Conference on Distributed Event-Based Systems

July 2010

303 pages

ISBN:9781605589275

DOI:10.1145/1827418

Co-chair:
Peter Pietzuch
Imperial College London, UK
,
Conference Chair:
Jean Bacon
University of Cambridge, UK
,
Program Chairs:
Joe Sventek
University of Glasgow, UK
,
Ugur Cetintemel
Brown University, Rhode Island

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DEBS '10

Sponsor:

DEBS '10: The 4th ACM International Conference on Distributed Event-based Systems

July 12 - 15, 2010

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 145 of 583 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
607
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bédard AHallé S(2023)Formal verification for event stream processingInformation and Computation10.1016/j.ic.2023.105058293:COnline publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1016/j.ic.2023.105058
Flouris IGiatrakos NDeligiannakis AGarofalakis M(2022)Network-wide complex event processing over geographically distributed data sourcesInformation Systems10.1016/j.is.2019.10144288:COnline publication date: 21-Apr-2022
https://dl.acm.org/doi/10.1016/j.is.2019.101442
Verma RBrazauskas JSafronov VDanish MLewis IMortier R(2021)RACERProceedings of the 29th International Conference on Advances in Geographic Information Systems10.1145/3474717.3484270(634-637)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3474717.3484270
Luthra MKoldehofe BDanger NWeisenberger PSalvaneschi GStavrakakis I(2021)TCEP: Transitions in operator placement to adapt to dynamic network environmentsJournal of Computer and System Sciences10.1016/j.jcss.2021.05.003122(94-125)Online publication date: Dec-2021
https://doi.org/10.1016/j.jcss.2021.05.003
Giatrakos NArtikis ADeligiannakis AGarofalakis M(2019)Uncertainty-Aware Event Analytics over Distributed SettingsProceedings of the 13th ACM International Conference on Distributed and Event-based Systems10.1145/3328905.3329763(175-186)Online publication date: 24-Jun-2019
https://dl.acm.org/doi/10.1145/3328905.3329763
Wang CGill CLu C(2019)Real-Time Middleware for Cyber-Physical Event ProcessingACM Transactions on Cyber-Physical Systems10.1145/32188163:3(1-25)Online publication date: 20-Aug-2019
https://dl.acm.org/doi/10.1145/3218816
Roudjane MRebaine DKhoury RHalle S(2019)Predictive Analytics for Event Stream Processing2019 IEEE 23rd International Enterprise Distributed Object Computing Conference (EDOC)10.1109/EDOC.2019.00029(171-182)Online publication date: Oct-2019
https://doi.org/10.1109/EDOC.2019.00029
Giatrakos NAlevizos EArtikis ADeligiannakis AGarofalakis M(2019)Complex event recognition in the Big Data era: a surveyThe VLDB Journal10.1007/s00778-019-00557-wOnline publication date: 25-Jul-2019
https://doi.org/10.1007/s00778-019-00557-w
Symvoulidis CTsoumas IKyriazis D(2019)Towards the Identification of Context in 5G InfrastructuresIntelligent Computing10.1007/978-3-030-22868-2_31(406-418)Online publication date: 9-Jul-2019
https://doi.org/10.1007/978-3-030-22868-2_31
Luthra M(2018)Adapting to Dynamic User Environments in Complex Event Processing System using TransitionsProceedings of the 12th ACM International Conference on Distributed and Event-based Systems10.1145/3210284.3226051(274-277)Online publication date: 25-Jun-2018
https://dl.acm.org/doi/10.1145/3210284.3226051
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents