research-article

Large-scale parallel server system with multi-component jobs

Authors:

Alexander L. StolyarAuthors Info & Claims

Queueing Systems, Volume 98, Issue 1-2

Pages 21 - 48

https://doi.org/10.1007/s11134-021-09686-y

Published: 01 June 2021 Publication History

Abstract

A broad class of parallel server systems is considered, for which we prove the steady-state asymptotic independence of server workloads, as the number of servers goes to infinity, while the system load remains sub-critical. Arriving jobs consist of multiple components. There are multiple job classes, and each class may be of one of two types, which determines the rule according to which the job components add workloads to the servers. The model is broad enough to include as special cases some popular queueing models with redundancy, such as cancel-on-start and cancel-on-completion redundancy. Our analysis uses mean-field process representation and the corresponding mean-field limits. In essence, our approach relies almost exclusively on three fundamental properties of the model: (a) monotonicity, (b) work conservation and (c) the property that, on average, “new arriving workload prefers to go to servers with lower workloads.”

References

[1]

Adan I, Kleiner I, Righter R, and Weiss G FCFS parallel service systems and matching models Perform. Eval. 2018 127 253-272

[2]

Ayesta U, Bodas T, and Verloop IM On a unifying product form framework for redundancy models Perform. Eval. 2018 127 93-119

[3]

Ayesta U, Bodas T, and Verloop IM On redundancy-d with cancel-on-start aka join-shortest-work (d) ACM SIGMETRICS Perform. Eval. Rev. 2018 46 2 24-26

[4]

Bramson M Stability of join the shortest queue networks Ann. Appl. Probab. 2011 21 1568-1625

[5]

Bramson M, Lu Y, and Prabhakar B Asymptotic independence of queues under randomized load balancing Queueing Syst. 2012 71 247-292

[6]

Foss S and Chernova N On the stability of a partially accessible multi-station queue with state-dependent routing Queueing Syst. 1998 29 55-73

[7]

Gardner K, Harchol-Balter M, Scheller-Wolf A, Velednitsky M, and Zbarsky S Redundancy-d: the power of d choices for redundancy Oper. Res. 2017 65 4 1078-1094

[8]

Gardner K, Zbarsky S, Doroudi S, Harchol-Balter M, and Hyytia E Reducing latency via redundant requests: exact analysis ACM SIGMETRICS Perform. Eval. Rev. 2015 43 1 347-360

[9]

Greenberg A, Malyshev V, and Popov S Stochastic model of massively parallel computation Markov Process. Relat. Fields 1997 2 473-490

[10]

Hellemans T, Bodas T, and Van Houdt B Performance analysis of workload dependent load balancing policies Proc. ACM Meas. Anal. Comput. Syst. 2019 3 2 35

[11]

Pang G, Talreja R, and Whitt W Martingale proofs of many-server heavy-traffic limits for Markovian queues Probab. Surv. 2007 4 193-267

[12]

Shah NB, Lee K, and Ramchandran K When do redundant requests reduce latency? IEEE Trans. Commun. 2015 64 2 715-722

[13]

Stolyar AL Pull-based load distribution in large-scale heterogeneous service systems Queueing Syst. 2015 80 4 341-361

[14]

Stolyar AL Pull-based load distribution among heterogeneous parallel servers: the case of multiple routers Queueing Syst. 2017 85 1–2 31-65

[15]

Vulimiri, A., Godfrey, P., Mittal, R., Sherry, J., Ratnasamy, S., Shenker, S.: Low latency via redundancy. CoNEXT 2013—Proceedings of the 2013 ACM International Conference on Emerging Networking Experiments and Technologies. Association for Computing Machinery, pp. 283–294 (2013)

[16]

Vvedenskaya N, Dobrushin R, and Karpelevich F Queueing system with selection of the shortest of two queues: an asymptotic approach Probl. Inf. Transm. 1996 32 1 20-34

Cited By

Gast NVan Houdt B(2024)Approximations to Study the Impact of the Service Discipline in Systems with RedundancyACM SIGMETRICS Performance Evaluation Review10.1145/3673660.365504552:1(1-2)Online publication date: 13-Jun-2024
https://dl.acm.org/doi/10.1145/3673660.3655045
Gast NVan Houdt BGaretto MMarin ACiucu FFanti GRighter R(2024)Approximations to Study the Impact of the Service Discipline in Systems with RedundancyAbstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems10.1145/3652963.3655045(1-2)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3652963.3655045
Gast NVan Houdt B(2024)Approximations to Study the Impact of the Service Discipline in Systems with RedundancyProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36390408:1(1-33)Online publication date: 21-Feb-2024
https://dl.acm.org/doi/10.1145/3639040
Show More Cited By

Index Terms

Large-scale parallel server system with multi-component jobs

Index terms have been assigned to the content through auto-classification.

Recommendations

Asymptotic independence of queues under randomized load balancing

Randomized load balancing greatly improves the sharing of resources while being simple to implement. In one such model, jobs arrive according to a rate- N Poisson process, with <1, in a system of N rate-1 exponential server queues. In Vvedenskaya et ...
Heavy-traffic limits for many-server queues with service interruptions

We establish many-server heavy-traffic limits for G/M/n+M queueing models, allowing customer abandonment (the +M), subject to exogenous regenerative service interruptions. With unscaled service interruption times, we obtain a FWLLN for the queue-length ...
Asymptotic optimality of a greedy randomized algorithm in a large-scale service system with general packing constraints

We consider a service system model primarily motivated by the problem of efficient assignment of virtual machines to physical host machines in a network cloud, so that the number of occupied hosts is minimized.There are multiple types of arriving ...

Comments

Information & Contributors

Information

Published In

cover image Queueing Systems: Theory and Applications

Queueing Systems: Theory and Applications Volume 98, Issue 1-2

Jun 2021

202 pages

ISSN:0257-0130

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC part of Springer Nature 2021.

Publisher

J. C. Baltzer AG, Science Publishers

United States

Publication History

Published: 01 June 2021

Accepted: 18 January 2021

Revision received: 17 December 2020

Received: 19 June 2020

Author Tags

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gast NVan Houdt B(2024)Approximations to Study the Impact of the Service Discipline in Systems with RedundancyACM SIGMETRICS Performance Evaluation Review10.1145/3673660.365504552:1(1-2)Online publication date: 13-Jun-2024
https://dl.acm.org/doi/10.1145/3673660.3655045
Gast NVan Houdt BGaretto MMarin ACiucu FFanti GRighter R(2024)Approximations to Study the Impact of the Service Discipline in Systems with RedundancyAbstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems10.1145/3652963.3655045(1-2)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3652963.3655045
Gast NVan Houdt B(2024)Approximations to Study the Impact of the Service Discipline in Systems with RedundancyProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36390408:1(1-33)Online publication date: 21-Feb-2024
https://dl.acm.org/doi/10.1145/3639040
Kielanski GHellemans TVan Houdt B(2023)Join-Up-To(m): improved hyperscalable load balancingQueueing Systems: Theory and Applications10.1007/s11134-023-09897-5105:3-4(291-316)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11134-023-09897-5

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents