research-article

Public Access

Performance Evaluation of Multi-Path TCP for Data Center and Cloud Workloads

Authors:

Lucas Chaufournier,

Ahmed Ali-Eldin,

Prateek Sharma,

Prashant Shenoy,

Don TowsleyAuthors Info & Claims

ICPE '19: Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering

Pages 13 - 24

https://doi.org/10.1145/3297663.3310295

Published: 04 April 2019 Publication History

Abstract

Today's cloud data centers host a wide range of applications including data analytics, batch processing, and interactive processing. These applications require high throughput, low latency, and high reliability from the network. Satisfying these requirements in the face of dynamically varying network conditions remains a challenging problem. Multi-Path TCP (MPTCP) is a recently proposed IETF extension to TCP that divides a conventional TCP flow into multiple subflows so as to utilize multiple paths over the network. Despite the theoretical and practical benefits of MPTCP, its effectiveness for cloud applications and environments remains unclear as there has been little work to quantify the benefits of MPTCP for real cloud applications. We present a broad empirical study of the effectiveness and feasibility of MPTCP for data center and cloud applications, under different network conditions. Our results show that while MPTCP provides useful bandwidth aggregation, congestion avoidance, and improved resiliency for some cloud applications, these benefits do not apply uniformly across applications, especially in cloud settings.

References

[1]

M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In ACM SIGCOMM Computer Communication Review, volume 38, pages 63--74. ACM, 2008.

Digital Library

[2]

M. Alizadeh, T. Edsall, S. Dharmapurikar, R. Vaidyanathan, et al. Conga: Distributed congestion-aware load balancing for datacenters. In ACM SIGCOMM Computer Communication Review, volume 44, pages 503--514, 2014.

Digital Library

[3]

M. Alizadeh, A. Greenberg, D. A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, and M. Sridharan. Data center tcp (dctcp). In ACM SIGCOMM computer communication review, volume 40, pages 63--74. ACM, 2010.

Digital Library

[4]

B. Arzani, A. Gurney, S. Cheng, R. Guerin, and B. T. Loo. Deconstructing mptcp performance. In Network Protocols (ICNP), 2014 IEEE 22nd International Conference on, pages 269--274. IEEE, 2014.

Digital Library

[5]

S. Barré, C. Paasch, and O. Bonaventure. Multipath tcp: from theory to practice. NETWORKING 2011, pages 444--457, 2011.

[6]

T. Benson, A. Akella, and D. A. Maltz. Network traffic characteristics of data centers in the wild. In Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, pages 267--280. ACM, 2010.

Digital Library

[7]

Y.-C. Chen, Y.-s. Lim, R. J. Gibbens, E. M. Nahum, R. Khalili, and D. Towsley. A measurement-based study of multipath tcp performance over wireless networks. In ACM IMC, pages 455--468, 2013.

Digital Library

[8]

Y.-C. Chen and D. Towsley. On bufferbloat and delay analysis of multipath tcp in wireless networks. In Networking Conference, 2014 IFIP, pages 1--9. IEEE, 2014.

[9]

B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In Proceedings of the 1st ACM symposium on Cloud computing, pages 143--154. ACM, 2010.

Digital Library

[10]

Y. Cui, L. Wang, X. Wang, H. Wang, and Y. Wang. Fmtcp: A fountain code-based multipath transmission control protocol. IEEE/ACM Transactions on Networking (TON), 23(2): 465--478, 2015.

Digital Library

[11]

S. Deng, R. Netravali, A. Sivaraman, and H. Balakrishnan. Wifi, lte, or both?: Measuring multi-homed wireless internet performance. In ACM IMC, pages 181--194, 2014.

Digital Library

[12]

Z. Ding, R. R. Hoare, A. K. Jones, and R. Melhem. Level-wise scheduling algorithm for fat tree interconnection networks. In Proceedings of the 2006 ACM/IEEE conference on Supercomputing, page 96. ACM, 2006.

Digital Library

[13]

S. Ferlin, Ö. Alay, T. Dreibholz, D. A. Hayes, and M. Welzl. Revisiting congestion control for multipath tcp with shared bottleneck detection. In IEEE INFOCOM, pages 1--9, 2016.

[14]

S. Ferlin-Oliveira, T. Dreibholz, and Ö. Alay. Tackling the challenge of buffer bloat in multi-path transport over heterogeneous wireless networks. In IEEE IWQoS, pages 123--128, 2014.

[15]

A. Ford, C. Raiciu, M. Handley, S. Barre, and J. Iyengar. Architectural guidelines for multipath TCP development. RFC 6182, Mar. 2011.

[16]

A. Ford, C. Raiciu, M. Handley, and O. Bonaventure. TCP extensions for multipath operation with multiple addresses. RFC 6824, 2013.

[17]

P. Gill, N. Jain, and N. Nagappan. Understanding network failures in data centers: measurement, analysis, and implications. In ACM SIGCOMM Computer Communication Review, volume 41, pages 350--361. ACM, 2011.

Digital Library

[18]

A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. Vl2: a scalable and flexible data center network. In ACM SIGCOMM computer communication review, volume 39, pages 51--62. ACM, 2009.

Digital Library

[19]

M. P. Grosvenor, M. Schwarzkopf, I. Gog, R. N. Watson, A. W. Moore, S. Hand, and J. Crowcroft. Queues don't matter when you can jump them! In NSDI, pages 1--14, 2015.

Digital Library

[20]

B. Han, F. Qian, L. Ji, V. Gopalakrishnan, and N. Bedminster. Mp-dash: Adaptive video streaming over preference-aware multipath. In ACM CoNEXT, pages 129--143, 2016.

Digital Library

[21]

H. Han, S. Shakkottai, C. V. Hollot, R. Srikant, and D. Towsley. Multi-path TCP: A joint congestion control and routing scheme to exploit path diversity in the Internet. IEEE/ACM Transactions on Networking, 14: 1260--1271, 2006.

Digital Library

[22]

S. Hassayoun, J. Iyengar, and D. Ros. Dynamic window coupling for multipath congestion control. In IEEE ICNP, pages 341--352, 2011.

Digital Library

[23]

K. He, E. Rozner, K. Agarwal, W. Felter, J. Carter, and A. Akella. Presto: Edge-based load balancing for fast datacenter networks. ACM SIGCOMM Computer Communication Review, 45(4):465--478, 2015.

Digital Library

[24]

E. Higgs. Spark Terasort. https://github.com/ehiggs/spark-terasort.

[25]

P. Key, L. Massoulié, and D. Towsley. Path selection and multipath congestion control. In INFOCOM 2007. 26th IEEE International Conference on Computer Communications. IEEE, pages 143--151. IEEE, 2007.

Digital Library

[26]

R. Khalili, N. Gast, M. Popovic, U. Upadhyay, and J.-Y. Le Boudec. MPTCP is not pareto-optimal: Performance issues and a possible solution. In Proceedings of the 8th International Conference on Emerging Networking Experiments and Technologies (CoNext), pages 1--12. ACM, 2012.

Digital Library

[27]

D. Kreutz, F. M. Ramos, P. E. Verissimo, C. E. Rothenberg, S. Azodolmolky, and S. Uhlig. Software-defined networking: A comprehensive survey. Proceedings of the IEEE, 103(1):14--76, 2015.

[28]

T. A. Le, C. S. Hong, M. A. Razzaque, S. Lee, and H. Jung. ecmtcp: an energy-aware congestion control algorithm for multipath tcp. IEEE communications letters, 16(2):275--277, 2012.

[29]

M. Li, A. Lukyanenko, Z. Ou, A. Yla-Jaaski, S. Tarkoma, M. Coudron, and S. Secci. Multipath transmission for the internet: A survey. IEEE Communications Surveys Tutorials, vol. PP, (99):1--41, 2016.

Digital Library

[30]

K. Ousterhout, R. Rasti, S. Ratnasamy, S. Shenker, B.-G. Chun, and V. ICSI. Making sense of performance in data analytics frameworks. In NSDI, volume 15, pages 293--307, 2015.

Digital Library

[31]

C. Paasch and S. Barre. Multipath TCP in the Linux kernel. http://www.multipath-tcp.org.

[32]

C. Paasch, S. Ferlin, O. Alay, and O. Bonaventure. Experimental evaluation of multipath tcp schedulers. In Proceedings of the 2014 ACM SIGCOMM workshop on Capacity sharing workshop, pages 27--32. ACM, 2014.

Digital Library

[33]

J. Qadir, A. Ali, K.-L. A. Yau, A. Sathiaseelan, and J. Crowcroft. Exploiting the power of multiplicity: a holistic survey of network-layer multipath. IEEE Communications Surveys & Tutorials, 17(4):2176--2213, 2015.

[34]

C. Raiciu, S. Barre, C. Pluntke, A. Greenhalgh, D. Wischik, and M. Handley. Improving datacenter performance and robustness with multipath tcp. In ACM SIGCOMM Computer Communication Review, volume 41, pages 266--277. ACM, 2011.

Digital Library

[35]

C. Raiciu, M. Handly, and D. Wischik. Coupled congestion control for multipath transport protocols. RFC 6356, Oct 2011.

[36]

C. Raiciu, D. Niculescu, M. Bagnulo, and M. J. Handley. Opportunistic mobility with multipath TCP. pages 7--12, 2011.

Digital Library

[37]

C. Raiciu, C. Paasch, S. Barre, A. Ford, M. Honda, F. Duchene, O. Bonaventure, and M. Handley. How hard can it be? Designing and implementing a deployable multipath TCP. 2012.

[38]

C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch. Heterogeneity and dynamicity of clouds at scale: Google trace analysis. In Proceedings of the Third ACM Symposium on Cloud Computing, SoCC '12, pages 7:1--7:13, New York, NY, USA, 2012. ACM.

Digital Library

[39]

A. Roy, H. Zeng, J. Bagga, G. Porter, and A. C. Snoeren. Inside the social network's (datacenter) network. In ACM SIGCOMM Computer Communication Review, volume 45, pages 123--137. ACM, 2015.

Digital Library

[40]

A. Roy, H. Zeng, J. Bagga, G. Porter, and A. C. Snoeren. Inside the social network's (datacenter) network. In ACM SIGCOMM Computer Communication Review, volume 45, pages 123--137. ACM, 2015.

Digital Library

[41]

A. Trivedi, P. Stuedi, J. Pfefferle, R. Stoica, B. Metzler, I. Koltsidas, and N. Ioannou. On the {ir}relevance of network performance for data processing. In 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 16), Denver, CO, 2016. USENIX Association.

Digital Library

[42]

E. Vanini, R. Pan, M. Alizadeh, T. Edsall, and P. Taheri. Let it flow: Resilient asymmetric load balancing with flowlet switching. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). USENIX Association.

Digital Library

[43]

D. Wischik, M. Handley, and M. B. Braun. The resource pooling principle. ACM SIGCOMM Computer Communication Review, 38(5):47--52, 2008.

Digital Library

[44]

D. Wischik, C. Raiciu, A. Greenhalgh, and M. Handley. Design, implementation and evaluation of congestion control for multipath tcp. In NSDI, 2011.

Digital Library

[45]

D. Wischik, C. Raiciu, and M. Handley. Balancing resource pooling and equipoise in multipath transport. ACM SIGCOMM, 2010.

[46]

T. Wood, P. J. Shenoy, A. Venkataramani, and M. S. Yousif. Black-box and gray-box strategies for virtual machine migration. In NSDI, 2007.

Digital Library

[47]

K. Zarifis, R. Miao, M. Calder, E. Katz-Bassett, M. Yu, and J. Padhye. Dibs: Just-in-time congestion mitigation for data centers. In Proceedings of the Ninth European Conference on Computer Systems, page 6. ACM, 2014.

Digital Library

[48]

J. Zhao, J. Liu, H. Wang, and C. Xu. Multipath tcp for datacenters: From energy efficiency perspective. In INFOCOM 2017-IEEE Conference on Computer Communications, IEEE, pages 1--9. IEEE, 2017.

Cited By

Dhawaskar Sathyanarayana SLee KGrunwald DHa SSchulzrinne HKohler EMaltz DMisra V(2023)Converge: QoE-driven Multipath Video Conferencing over WebRTCProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604822(637-653)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604822
Maliszewski AGriebler DRoloff Eda Rosa Righi RNavaux P(2023)Evaluation Model and Performance Analysis of NIC Aggregations in Containerized Private Clouds2023 International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW)10.1109/SBAC-PADW60351.2023.00025(101-107)Online publication date: 17-Oct-2023
https://doi.org/10.1109/SBAC-PADW60351.2023.00025
Naji Saif MNiranjan Aradhya SHezam Murshed BFarhan Alnaggar OAli I(2023)Multi‐objective container scheduling and multi‐path routing for elastic business process management in autonomic multi‐tenant cloudConcurrency and Computation: Practice and Experience10.1002/cpe.758435:6(1-1)Online publication date: 24-Jan-2023
https://doi.org/10.1002/cpe.7584
Show More Cited By

Index Terms

Performance Evaluation of Multi-Path TCP for Data Center and Cloud Workloads
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Cloud computing
2. Networks
  1. Network performance evaluation
    1. Network experimentation
  2. Network protocols
    1. Transport protocols

Recommendations

Analysis for TCP in data center networks

The unfairness caused by bandwidth sharing via TCP in data center networks is called TCP Outcast problem. Some researchers show that the throughput of a flow with small Round Trip Time (RTT) is less than that with large RTT which is completely contrary ...
Randomizing TCP payload size for TCP fairness in data center networks

As many-to-one traffic patterns prevail in data center networks, TCP flows often suffer from severe unfairness in sharing bottleneck bandwidth, which is known as the TCP outcast problem. The cause of the TCP outcast problem is the bursty packet losses ...
TCP incast solutions in data center networks: A classification and survey
Abstract
In recent years, Data Centers Networks (DCNs) have been deployed to serve as the backbone to support the extensive variety of services offered through the Internet like social networking, web hosting, and e-commerce. The Transmission ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '19: Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering

April 2019

348 pages

ISBN:9781450362399

DOI:10.1145/3297663

General Chairs:
Varsha Apte
IIT Bombay, India
,
Antinisca Di Marco
University of L'Aquila, Italy
,
Program Chairs:
Marin Litoiu
York University, Canada
,
José Merseguer
Universidad de Zaragoza, Spain

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

ICPE '19

Sponsor:

ICPE '19: Tenth ACM/SPEC International Conference on Performance Engineering

April 7 - 11, 2019

Mumbai, India

Acceptance Rates

ICPE '19 Paper Acceptance Rate 13 of 71 submissions, 18%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
579
Total Downloads

Downloads (Last 12 months)103
Downloads (Last 6 weeks)11

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dhawaskar Sathyanarayana SLee KGrunwald DHa SSchulzrinne HKohler EMaltz DMisra V(2023)Converge: QoE-driven Multipath Video Conferencing over WebRTCProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604822(637-653)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3603269.3604822
Maliszewski AGriebler DRoloff Eda Rosa Righi RNavaux P(2023)Evaluation Model and Performance Analysis of NIC Aggregations in Containerized Private Clouds2023 International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW)10.1109/SBAC-PADW60351.2023.00025(101-107)Online publication date: 17-Oct-2023
https://doi.org/10.1109/SBAC-PADW60351.2023.00025
Naji Saif MNiranjan Aradhya SHezam Murshed BFarhan Alnaggar OAli I(2023)Multi‐objective container scheduling and multi‐path routing for elastic business process management in autonomic multi‐tenant cloudConcurrency and Computation: Practice and Experience10.1002/cpe.758435:6(1-1)Online publication date: 24-Jan-2023
https://doi.org/10.1002/cpe.7584
Dani VNagar SPawar V(2022)An Analysis of Multipath TCP for Improving Network PerformanceInnovations in Bio-Inspired Computing and Applications10.1007/978-3-030-96299-9_16(160-169)Online publication date: 22-Feb-2022
https://doi.org/10.1007/978-3-030-96299-9_16
Khan TSohail AQureshi KIqbal SJeon G(2021)Multipath transport control protocol for 5G mobile augmented reality networksInternational Journal of Communication Systems10.1002/dac.477835:5Online publication date: 9-Mar-2021
https://doi.org/10.1002/dac.4778
Shishira SKandasamy A(2020)A Conceptual Framework for Intelligent Management of Workloads in Cloud Environment2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC)10.1109/ICCMC48092.2020.ICCMC-0006(33-37)Online publication date: Mar-2020
https://doi.org/10.1109/ICCMC48092.2020.ICCMC-0006
Yan MZhang BZhao GKuang XLiu LZhang R(2020)An Intelligent File Transfer Optimization for Poor Network ConditionsSecurity and Privacy in Social Networks and Big Data10.1007/978-981-15-9031-3_21(234-244)Online publication date: 22-Sep-2020
https://doi.org/10.1007/978-981-15-9031-3_21
Hou JHou DTao BQi HDi XRen WCong L(2020)Performance Analysis of MPTCP Under High Load Based on SDN EnvironmentMobile Wireless Middleware, Operating Systems and Applications10.1007/978-3-030-62205-3_5(57-68)Online publication date: 5-Nov-2020
https://doi.org/10.1007/978-3-030-62205-3_5
Maliszewski ARoloff EGriebler DGaspary LNavaux P(2020)Performance Impact of IEEE 802.3ad in Container-Based Clouds for HPC ApplicationsComputational Science and Its Applications – ICCSA 202010.1007/978-3-030-58817-5_13(158-167)Online publication date: 30-Sep-2020
https://doi.org/10.1007/978-3-030-58817-5_13

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents