research-article

Data Dissemination supporting collaborative complex event processing: characteristics and open issues

Authors:

Roberto Baldoni,

Leonardo QuerzoniAuthors Info & Claims

DD4LCCI '10: Proceedings of the First International Workshop on Data Dissemination for Large Scale Complex Critical Infrastructures

Pages 3 - 8

https://doi.org/10.1145/1862821.1862822

Published: 27 April 2010 Publication History

Abstract

Most distributed applications today receive events, process them and in turn create new events which are sent to other processes. Business intelligence, air traffic control, collaborative security, complex system software management are examples of such applications. In these applications basic events, potentially occurred at different sites, are correlated in order to detect complex event patterns formed by basic events that could have temporal and spatial relationships among them. In this context, a fundamental functionality is the data dissemination that brings events from event producers to event consumers where complex event patterns are detected. In this paper we discuss the characteristics that a Data Dissemination service should have in order to support in the best way the complex event pattern detection functionality. We consider event traffic can reach thousands of events per second coming from different event sources; that is, the data dissemination service has to sustain high throughput. Finally, we present an assessment of a number of technologies that can be used to disseminate data in the earlier mentioned context, discussing scenarios where those technologies can be effectively deployed.

References

[1]

}}Zookeeper documentation. http://hadoop.apache.org/zookeeper/docs/r3.2.1/zookeeperOver.html.

[2]

}}Where Complex Event Processing meets Open Source: Esper and NEsper. http://esper.codehaus.org/, 2009.

[3]

}}FBI investigates 9 Million ATM scam. http://www.myfoxny.com/dpp/news/090202\_FBI\_Investigates\_9\_Million\_ATM\_Scam, 2010.

[4]

}}Google appengine. http://code.google.com/appengine/, 2010.

[5]

}}JBoss Drools Fusion. http://www.jboss.org/drools/drools-fusion.html, 2010.

[6]

}}Jgroups. http://www.jgroups.org//, 2010.

[7]

}}Real time messaging and integration middleware. http://www.rti.com/, 2010.

[8]

}}Update: Credit card firm hit by DDoS attack. http://www.computerworld.com/securitytopics/security/story/0,10801,96099,00.html, 2010.

[9]

}}M. Balazinska, H. Balakrishnan, and M. Stonebraker. Contract-based load management in federated distributed systems. In NSDI, pages 197--210, 2004.

Digital Library

[10]

}}R. Baldoni, L. Querzoni, and S. Scipioni. Event-based data dissemination on inter-administrative domains: Is it viable? In FTDCS08, pages 44--50, Washington, DC, USA, 2008. IEEE Computer Society.

Digital Library

[11]

}}K. Birman. Rethinking multicast for massive-scale platforms. In ICDCS, page 1, 2009.

Digital Library

[12]

}}K. P. Birman. The process group approach to reliable distributed computing. Commun. ACM, 36(12):36--53, 103, 1993.

Digital Library

[13]

}}K. P. Birman and T. A. Joseph. Exploiting virtual synchrony in distributed systems. In SOSP, pages 123--138, 1987.

Digital Library

[14]

}}V. Bortnikov, G. V. Chockler, A. Roytman, and M. Spreitzer. Bulletin Board: A Scalable and Robust Eventually Consistent Shared Memory over a Peer-to-Peer Overlay. In ACM LADIS 2009, 2009.

[15]

}}A. Corsaro, L. Querzoni, S. Scipioni, S. T. Piergiovanni, and A. Virgillito. Quality of service in publish/subscribe middleware. In R. Baldoni and G. Cortese, editors, Global Data Management. IOS Press, 2006.

[16]

}}P. Costa and G. P. Picco. Semi-probabilistic content-based publish-subscribe. In Proceedings of the 25th IEEE International Conference on Distributed Computing Systems, pages 575--585, Washington, DC, USA, 2005. IEEE Computer Society.

Digital Library

[17]

}}G. DeCandia et al. Dynamo: amazon's highly available key-value store. In SOSP, pages 205--220, 2007.

Digital Library

[18]

}}A. Demers et al. Epidemic algorithms for replicated database maintenance. In PODC '87: Proceedings of the sixth annual ACM Symposium on Principles of distributed computing, pages 1--12, New York, NY, USA, 1987. ACM.

Digital Library

[19]

}}O. Etzion. Event Processing Architecture and Patterns. DEBS Tutorial, July 2008.

[20]

}}Y. Huang, N. Feamser, A. Lakhina, and J. J. Xu. Diagnosing network disruptions with network-wide analysis. In SIGMETRICS'07, San Diego, California, USA, 12-16 June 2007.

Digital Library

[21]

}}D. Jeffrey and S. Ghemawat. MapReduce: simplified data processing on large clusters. Commun. ACM, 51(1):107--113, 2008.

Digital Library

[22]

}}C. Liebig, M. Cilia, and A. Buchmann. Event composition in time-dependent distributed systems. In Proceedings of the Fourth IECIS International Conference on Cooperative Information Systems, page 70, Washington, DC, USA, 1999. IEEE Computer Society.

Digital Library

[23]

}}G. Lodi et al. Defending financial infrastructures through early warning systems: the intelligence cloud approach. In Proceedings of the 5th Annual Workshop on Cyber Security and Information Intelligence Research, pages 1--4, New York, NY, USA, 2009. ACM.

Digital Library

[24]

}}S. Microsystem. Java Message Service (JMS). http://java.sun.com/products/jms/, 2008.

[25]

}}NESSI. NESSI Strategic Agenda, 2009.

[26]

}}P. R. Pietzuch. Hermes: A Scalable Event-Based Middleware. In Ph.D. Thesis, University of Cambridge, 2004.

[27]

}}R. Van Renesse, K. P. Birman, and W. Vogels. Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Trans. Comput. Syst., 21(2):164--206, 2003.

Digital Library

[28]

}}Y. Vigfusson et al. Dr. multicast: Rx for data center communication scalability. In EUROSYS, 2010.

Digital Library

[29]

}}W. Vogels. Eventually consistent. Commun. ACM, 52(1):40--44, 2009.

Digital Library

[30]

}}G. Zhang and M. Parashar. Cooperative detection and protection against network attacks using decentralized information sharing. Cluster Computing, 13(1):67--86, March 2010.

Digital Library

[31]

}}C. V. Zhou, C. Leckie, and S. Karunasekera. A survey of coordinated attacks and collaborative intrusion detection. Computer and Security 29 (2010), pages 124--140, 2009.

Digital Library

Cited By

Lu XYin JLi YDeng SZhu M(2012)An efficient data dissemination approach for cloud monitoringProceedings of the 10th international conference on Service-Oriented Computing10.1007/978-3-642-34321-6_58(733-747)Online publication date: 12-Nov-2012
https://dl.acm.org/doi/10.1007/978-3-642-34321-6_58

Index Terms

Data Dissemination supporting collaborative complex event processing: characteristics and open issues

Recommendations

Complex event processing with T-REX

Several application domains involve detecting complex situations and reacting to them. This asks for a Complex Event Processing (CEP) middleware specifically designed to timely process large amounts of event notifications as they flow from the ...
Towards complex actions for complex event processing
DEBS '13: Proceedings of the 7th ACM international conference on Distributed event-based systems

Complex actions are a natural extension for complex event processing languages needed by many applications like emergency management. In particular interactions with external actuators that are common in those applications pose challenges that need to ...
Stream reasoning and complex event processing in ETALIS
On linked spatiotemporal data and geo-ontologies

Addressing dynamics and notifications in the Semantic Web realm has recently become an important area of research. Run time data is continuously generated by multiple social networks, sensor networks, various on-line services and so forth. How to get ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

DD4LCCI '10: Proceedings of the First International Workshop on Data Dissemination for Large Scale Complex Critical Infrastructures

April 2010

42 pages

ISBN:9781605589176

DOI:10.1145/1862821

Conference Chairs:
Christian Esposito
University of Naples Federico II, Italy
,
Aniruddha Gokhale
Vanderbilt University
,
Domenico Cotroneo
University of Naples Federico II, Italy
,
Douglas C. Schmidt
Vanderbilt University

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Universidad Politécnica de Valencia, Spain
Ministerio de Ciencia e Innovación, Spain
Generalitat Valenciana, Spain

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EDCC '10

Sponsor:

EDCC '10: European Dependable Computing Conference

April 27, 2010

Valencia, Spain

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
211
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lu XYin JLi YDeng SZhu M(2012)An efficient data dissemination approach for cloud monitoringProceedings of the 10th international conference on Service-Oriented Computing10.1007/978-3-642-34321-6_58(733-747)Online publication date: 12-Nov-2012
https://dl.acm.org/doi/10.1007/978-3-642-34321-6_58

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents