research-article

Reliable messaging to millions of users with migratorydata

Authors:

Florentin Olariu,

Etienne RivièreAuthors Info & Claims

Middleware '17: Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference: Industrial Track

Pages 1 - 7

https://doi.org/10.1145/3154448.3154449

Published: 11 December 2017 Publication History

Abstract

Web-based notification services are used by a large range of businesses to selectively distribute live updates to customers, following the publish/subscribe (pub/sub) model. Typical deployments can involve millions of subscribers expecting ordering and delivery guarantees together with low latencies. Notification services must be vertically and horizontally scalable, and adopt replication to provide a reliable service. We report our experience building and operating MigratoryData, a highly-scalable notification service. We discuss the typical requirements of MigratoryData customers, and describe the architecture and design of the service, focusing on scalability and fault tolerance. Our evaluation demonstrates the ability of MigratoryData to handle millions of concurrent connections and support a reliable notification service despite server failures and network disconnections.

References

[1]

Raphaël Barazzutti, Pascal Felber, Christof Fetzer, Emanuel Onica, Jean-François Pineau, Marcelo Pasin, Etienne Rivière, and Stefan Weigert. 2013. StreamHub: A Massively Parallel Architecture for High-performance Content-based Publish/Subscribe. In 7th ACM Intl. Conf. on Distributed Event-based Systems (DEBS).

Digital Library

[2]

Paolo Bellavista, Antonio Corradi, and Andrea Reale. 2014. Quality of Service in Wide Scale Publish & Subscribe Systems. IEEE Communications Surveys Tutorials 16, 3 (2014), 1591--1616.

[3]

Miguel Castro, Peter Druschel, Anne-Marie Kermarrec, and Antony Rowstron. 2002. Scribe: A large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in Communication 20, 8 (2002).

Digital Library

[4]

Gregory Chockler, Roie Melamed, Yoav Tock, and Roman Vitenberg. 2007. Spider-Cast: a scalable interest-aware overlay for topic-based pub/sub communication. In Inaugural ACM Intl. Conf. on Distributed Event-Based Systems (DEBS).

[5]

Angelo Corsaro, Leonardo Querzoni, Sirio Scipioni, Sara Tucci Piergiovanni, and Antonino Virgillito. 2006. Quality of service in publish/subscribe middleware. Global Data Management 19, 20 (2006), 1--22.

[6]

Philippe Dobbelaere and Kyumars Sheykh Esmaili. 2017. Kafka Versus RabbitMQ: A Comparative Study of Two Industry Reference Publish/Subscribe Implementations: Industry Paper. In 11th ACM International Conference on Distributed and Event-based Systems (DEBS).

Digital Library

[7]

Patrick Th. Eugster, Pascal A. Felber, Rachid Guerraoui, and Anne-Marie Kermarrec. 2003. The Many Faces of Publish/Subscribe. ACM Comp. Sur. 35, 2 (June 2003), 114--131.

Digital Library

[8]

Wenjing Fang, Beihong Jin, Biao Zhang, Yuwei Yang, and Ziyuan Qin. 2011. Design and evaluation of a Pub/Sub service in the cloud. In IEEE International Conference on Cloud and Service Computing (CSC). 32--39.

Digital Library

[9]

Patrick Hunt, Mahadev Konar, Flavio P. Junqueira, and Benjamin Reed. 2010. ZooKeeper: wait-free coordination for internet-scale systems. In USENIX technical conference (ATC).

[10]

H.-A. Jacobsen, A. Cheung, G. Lia, B. Maniymaran, V. Muthusamy, and R. S. Kazemzadeh. 2009. The PADRES Publish/Subscribe System. In Handbook of Research on Adv. Dist. Event-Based Sys., Pub./Sub. and Message Filtering Tech.

[11]

EunYoung Jeong, Shinae Wood, Muhammad Jamshed, Haewon Jeong, Sunghwan Ihm, Dongsu Han, and KyoungSoo Park. 2014. mTCP: a Highly Scalable User-level TCP Stack for Multicore Systems. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

[12]

Piyush Maheshwari and Michael Pang. 2005. Benchmarking Message-oriented Middleware: TIB/RV Versus SonicMQ. Concurr. Comput. : Pract. Exper. 17, 12 (Oct. 2005), 1507--1526.

[13]

Amirhossein Malekpour, Antonio Carzaniga, Giovanni Toffetti Carughi, and Fernando Pedone. 2011. Probabilistic FIFO Ordering in Publish/Subscribe Networks. In 10th IEEE Intl. Symp. on Network Computing and Applications (NCA).

Digital Library

[14]

Miguel Matos, Pascal Felber, Rui Oliveira, Jose Pereira, and Etienne Rivière. 2013. Scaling up Publish/Subscribe Overlays using Interest Correlation for Link Sharing. IEEE Trans. on Par. and Dist. Sys. (TPDS) 24, 12 (2013), 2462--2471.

Digital Library

[15]

Wiriyang Pipatsakulroj, Vasaka Visoottiviseth, and Ryousei Takano. 2017. muMQ: A Lightweight and Scalable MQTT Broker. In IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN).

[16]

Mihai Rotaru. 2015. How MigratoryData solved the C10M problem: 10 Million Concurrent Connections on a Single Commodity Server (entry in MigratoryData Blog). (2015).

[17]

Mihai Rotaru. 2016. Fast C10M: MigratoryData running on Zing JVM achieves near 1 Gbps messaging to 10 million concurrent users with 15 millisecond consistent latency (entry in Azul Systems Blog). (2016).

[18]

Arjun Roy, Hongyi Zeng, Jasmeet Bagga, and Alex C. Snoeren. 2017. Passive Realtime Datacenter Fault Detection and Localization. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI).

[19]

Gil Tene, Balaji Iyengar, and Michael Wolf. 2011. C4: The Continuously Concurrent Compacting Collector. SIGPLAN Notices 46, 11 (June 2011), 79--88.

Digital Library

[20]

Ye Zhao, Kyungbaek Kim, and Nalini Venkatasubramanian. 2013. DYNATOPS: A Dynamic Topic-based Publish/Subscribe Architecture. In 7th ACM International Conference on Distributed Event-based Systems (DEBS).

Digital Library

Cited By

Zhao YSaeed AAmmar MZegura E(2021)Scouting the Path to a Million-Client ServerPassive and Active Measurement10.1007/978-3-030-72582-2_20(337-354)Online publication date: 30-Mar-2021
https://doi.org/10.1007/978-3-030-72582-2_20
Doblander CKhatayee AJacobsen HPierre GFerreira PShrira L(2018)PreDictProceedings of the 19th International Middleware Conference10.1145/3274808.3274822(174-186)Online publication date: 26-Nov-2018
https://dl.acm.org/doi/10.1145/3274808.3274822

Index Terms

Reliable messaging to millions of users with migratorydata
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
  2. Dependable and fault-tolerant systems and networks

Recommendations

A Scalability Framework for Reliable Services
SSIRI-C '11: Proceedings of the 2011 Fifth International Conference on Secure Software Integration and Reliability Improvement - Companion

In service-oriented computing, service consumers subscribe published services, and service providers deploy and manage services. Due to the heterogeneity of services, and high evolvability of services, services can suffer from reliability. This paper ...
StreamHub: a massively parallel architecture for high-performance content-based publish/subscribe
DEBS '13: Proceedings of the 7th ACM international conference on Distributed event-based systems

By routing messages based on their content, publish/subscribe (pub/sub) systems remove the need to establish and maintain fixed communication channels. Pub/sub is a natural candidate for designing large-scale systems, composed of applications running in ...
Publish/subscribe in the VRESCo SOA runtime
DEBS '08: Proceedings of the second international conference on Distributed event-based systems

Event-based systems and the publish/subscribe style are widely used to notify subscribers when certain events of interest occur. In the context of Service-oriented Architecture (SOA) and Web services, event notifications can be used to address one issue ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Middleware '17: Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference: Industrial Track

December 2017

55 pages

ISBN:9781450352000

DOI:10.1145/3154448

Program Chairs:
Xiaoyun Zhu
HyperPilot
,
Indrajit Roy
Google

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery

In-Cooperation

USENIX Assoc: USENIX Assoc
IFIP

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Union
Romanian National Authority for Scientific Research and Innovation

Conference

Middleware '17

Sponsor:

ACM

Middleware '17: 18th International Middleware Conference

December 11 - 15, 2017

Nevada, Las Vegas

Acceptance Rates

Middleware '17 Paper Acceptance Rate 7 of 20 submissions, 35%;

Overall Acceptance Rate 203 of 948 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
159
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhao YSaeed AAmmar MZegura E(2021)Scouting the Path to a Million-Client ServerPassive and Active Measurement10.1007/978-3-030-72582-2_20(337-354)Online publication date: 30-Mar-2021
https://doi.org/10.1007/978-3-030-72582-2_20
Doblander CKhatayee AJacobsen HPierre GFerreira PShrira L(2018)PreDictProceedings of the 19th International Middleware Conference10.1145/3274808.3274822(174-186)Online publication date: 26-Nov-2018
https://dl.acm.org/doi/10.1145/3274808.3274822

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents