research-article

Jetway: minimizing costs on inter-datacenter video traffic

Authors:

Bo LiAuthors Info & Claims

MM '12: Proceedings of the 20th ACM international conference on Multimedia

Pages 259 - 268

https://doi.org/10.1145/2393347.2393388

Published: 29 October 2012 Publication History

Abstract

It is typical for video streaming service providers (such as NetFlix) to rely on services from cloud providers (such as Amazon), in order to build a scalable video streaming platform with high availability. The trend is largely driven by the fact that cloud providers deploy a number of datacenters inter-connected by high-capacity links, spanning different geographical regions. Video traffic across datacenters, such as video replication and transit server-to-customer video serving, constitutes a large portion of a cloud provider's inter-datacenter traffic. Charged by ISPs, such inter-datacenter video traffic incurs substantial operational costs to a cloud provider. In this paper, we argue that costs incurred by such inter-datacenter video traffic can be reduced or even minimized by carefully choosing paths, and by assigning flow rates on each inter-datacenter link along every path. We present Jetway, a new set of algorithms designed to minimize cloud providers' operational costs on inter-datacenter video traffic, by optimally routing video flows in an online fashion. Algorithms in Jetway are designed by following a methodical approach based on an in-depth theoretical analysis. As a highlight of this paper, we have built a real-world system framework to implement and deploy Jetway in the Amazon EC2 datacenters. With both simulations and real-world experiments using our implementation, we show that Jetway effectively helps transmitting videos across datacenters with reduced costs to cloud providers and satisfactory real-world performance.

References

[1]

A. Cockcroft, "Netflix in the Cloud," 2011. {Online}. Available: http://velocityconf.com/velocity2011/public/schedule/detail/17785

[2]

V. K. Adhikari, Y. Guo, F. Hao, M. Varvello, V. Hilt, M. Steiner, and Z.-L. Zhang, "Unreeling Netflix: Understanding and Improving Multi-CDN Movie Delivery," in Proc. IEEE INFOCOM, 2012.

[3]

Amazon, "Amazon CloudFront," 2012. {Online}. Available: http://aws.amazon.com/cloudfront/

[4]

____, "Amazon S3: Object Size Limit Now 5 TB," December 2010. {Online}. Available: http://aws.typepad.com/aws/2010/12/amazon-s3-object-size-limit.html

[5]

A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel, "The Cost of a Cloud: Research Problems in Data Center Networks," SIGCOMM Comput. Commun. Rev., vol. 39, no. 1, pp. 68--73, 2009.

Digital Library

[6]

Z. Zhang, M. Zhang, A. Greenberg, Y. C. Hu, R. Mahajan, and B. Christian, "Optimizing Cost and Performance in Online Service Provider Networks," in Proc. 7th Conference on Networked Systems Design and Implementation (NSDI), 2010, pp. 1--15.

Digital Library

[7]

I. RouteScience Technologies, "Route Optimization for Ebusiness Applications," White Paper, 2003.

[8]

V. Valancius, C. Lumezanu, N. Feamster, R. Johari, and V. V. Vazirani, "How Many Tiers? Pricing in the Internet Transit Market," in Proc. ACM SIGCOMM, 2011, pp. 194--205.

Digital Library

[9]

N. Laoutaris, M. Sirivianos, X. Yang, and P. Rodriguez, "Inter-Datecenter Bulk Transfers with NetStitcher," in Proc. ACM SIGCOMM, 2011.

Digital Library

[10]

D. K. Goldberg, L. Qiu, H. Xie, Y. R. Yang, and Y. Zhang, "Optimizing Cost and Performance for Multihoming," in Proc. ACM SIGCOMM, 2004, pp. 79--92.

Digital Library

[11]

T. Benson, A. Anand, A. Akella, and M. Zhang, "The Case for Fine-Grained Traffic Engineering in Data Centers," in Proc. ACM SIGCOMM Workshop: Research on Enterprise Networking (WREN), 2010.

Digital Library

[12]

T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms, 3rd ed. The MIT Press, 2009.

Digital Library

[13]

T. Radzik, "Fast Deterministic Approximation for the Multicommodity Flow Problem," in Proc. 6th Annual ACM Symposium on Discrete Algorithms (SODA), 1995, pp. 486--492.

Digital Library

[14]

A. Goldberg and R. Tarjan, "Solving Minimum-Cost Flow Problems by Successive Approximation," in Proc. 9th ACM Symposium on Theory of Computing (SOTC), 1987, pp. 7--18.

Digital Library

[15]

D. Karger and S. Plotkin, "Adding Multiple Cost Constraints to Combinatorial Optimization Problems, with Applications to Multicommodity Flows," in Proc. 27th ACM Symposium on Theory of Computing (SOTC), 1995, pp. 18--25.

Digital Library

[16]

B. Awerbuch and R. Khandekar, "Greedy Distributed Optimization of Multi-Commodity Flows," Distributed Computing, vol. 21, pp. 317--329, 2009.

Digital Library

[17]

B. Awerbuch, R. Khandekar, and S. Rao, "Distributed Algorithms for Multicommodity Flow Problems via Approximate Steepest Descent Framework," in Proc. 18th Annual ACM Symposium on Discrete Algorithms (SODA), 2007, pp. 949--957.

Digital Library

[18]

Y. Wu, C. Wu, B. Li, L. Zhang, Z. Li, and F. C. Lau, "Scalling Social Media Appliations into Geo-Distributed Clouds," in Proc. IEEE INFOCOM, 2012.

[19]

Z. Liu, M. Lin, A. Wierman, S. H. Low, and L. L. Andrew, "Greening Geographical Load Balancing," SIGMETRICS Perform. Eval. Rev., vol. 39, pp. 193--204, 2011.

Digital Library

[20]

A. Mahimkar, A. Chiu, R. Doverspike, M. D. Feuer, P. Magill, E. Mavrogiorgis, J. Pastor, S. L. Woodward, and J. Yates, "Bandwidth on Demand for Inter-Data Center Communication," in Proc. 10th ACM Workshop on Hot Topics in Networks (HotNets), 2011, pp. 1--6.

Digital Library

[21]

R. Krishnan, H. V. Madhyastha, S. Srinivasan, S. Jain, A. Krishnamurthy, T. Anderson, and J. Gao, "Moving Beyond End-to-End Path Information to Optimize CDN Performance," in Proc. 9th Internet Measurement Conference (IMC), 2009, pp. 190--201.

Digital Library

[22]

V. K. Adhikari, S. Jain, and Z.-L. Zhang, "YouTube Traffic Dynamics and Its Interplay with a Tier-1 ISP: An ISP Perspective," in Proc. 10th Internet Measurement Conference (IMC), 2010, pp. 431--443.

Digital Library

[23]

Y. Chen, S. Jain, V. Adhikari, Z.-L. Zhang, and K. Xu, "A First Look at Inter-Data Center Traffic Characteristics via Yahoo! Datasets," in Proc. IEEE INFOCOM, 2011, pp. 1620--1628.

Cited By

Zhao GWang JXu HYu ZQiao C(2023)COIN: Cost-Efficient Traffic Engineering with Various Pricing Schemes in CloudsIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10229001(1-10)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10229001
Chen HZhan HTan HXu HShan WChen SLi X(2022)Online Traffic Allocation Based on Percentile Charging for Practical CDNs2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS)10.1109/IWQoS54832.2022.9812878(1-10)Online publication date: 10-Jun-2022
https://doi.org/10.1109/IWQoS54832.2022.9812878
Fatemipour BShi WSt-Hilaire M(2022)A Cost-Effective and Multi-Source-Aware Replica Migration Approach for Geo-Distributed Data Centers2022 IEEE Cloud Summit10.1109/CloudSummit54781.2022.00009(17-22)Online publication date: Oct-2022
https://doi.org/10.1109/CloudSummit54781.2022.00009
Show More Cited By

Index Terms

Jetway: minimizing costs on inter-datacenter video traffic
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Inter-datacenter bulk transfers with netstitcher
SIGCOMM '11: Proceedings of the ACM SIGCOMM 2011 conference

Large datacenter operators with sites at multiple locations dimension their key resources according to the peak demand of the geographic area that each site covers. The demand of specific areas follows strong diurnal patterns with high peak to valley ...
EcoFlow: An Economical and Deadline-Driven Inter-Datacenter Video Flow Scheduling System
MM '15: Proceedings of the 23rd ACM international conference on Multimedia

Cloud providers are charged by ISPs for inter-datacenter transfers under the dominant percentile-based charging models. In order to minimize the payment costs, existing works aim to keep the traffic on each link under the charging volume. However, these ...
Path persistence in the cloud: A study of the effects of inter-region traffic engineering in a large cloud provider's network

A commonly held belief is that traffic engineering and routing changes are infrequent. However, based on our measurements over a number of years of traffic between data centers in one of the largest cloud provider's networks, we found that it is common ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '12: Proceedings of the 20th ACM international conference on Multimedia

October 2012

1584 pages

ISBN:9781450310895

DOI:10.1145/2393347

General Chairs:
Noboru Babaguchi
Osaka University, Japan
,
Kiyoharu Aizawa
The University of Tokyo, Japan
,
John Smith
IBM, USA
,
Program Chairs:
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Thomas Plagemann
University of Oslo, Norway
,
Xian-Sheng Hua
Microsoft, USA
,
Rong Yan
Facebook, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '12

Sponsor:

SIGMM

MM '12: ACM Multimedia Conference

October 29 - November 2, 2012

Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
450
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhao GWang JXu HYu ZQiao C(2023)COIN: Cost-Efficient Traffic Engineering with Various Pricing Schemes in CloudsIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10229001(1-10)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10229001
Chen HZhan HTan HXu HShan WChen SLi X(2022)Online Traffic Allocation Based on Percentile Charging for Practical CDNs2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS)10.1109/IWQoS54832.2022.9812878(1-10)Online publication date: 10-Jun-2022
https://doi.org/10.1109/IWQoS54832.2022.9812878
Fatemipour BShi WSt-Hilaire M(2022)A Cost-Effective and Multi-Source-Aware Replica Migration Approach for Geo-Distributed Data Centers2022 IEEE Cloud Summit10.1109/CloudSummit54781.2022.00009(17-22)Online publication date: Oct-2022
https://doi.org/10.1109/CloudSummit54781.2022.00009
Chen HZhan HZhang PTan H(2022)PeCo: Minimizing Bandwidth Cost for CDN Systems2022 8th International Conference on Big Data Computing and Communications (BigCom)10.1109/BigCom57025.2022.00017(71-78)Online publication date: Aug-2022
https://doi.org/10.1109/BigCom57025.2022.00017
Luo LJin QXie JSun GYu H(2021)Cost-Efficient Scheduling of Multicast Transfers with Deadline Guarantees Across Edge DatacentersIEEE Transactions on Services Computing10.1109/TSC.2021.3128427(1-1)Online publication date: 2021
https://doi.org/10.1109/TSC.2021.3128427
Shen HQiu C(2021)Scheduling Inter-Datacenter Video Flows for Cost EfficiencyIEEE Transactions on Services Computing10.1109/TSC.2018.284186814:3(834-849)Online publication date: 1-May-2021
https://doi.org/10.1109/TSC.2018.2841868
Mseddi ASalahuddin MZhani MElbiaze HGlitho R(2021)Efficient Replica Migration Scheme for Distributed Cloud Storage SystemsIEEE Transactions on Cloud Computing10.1109/TCC.2018.28587929:1(155-167)Online publication date: 1-Jan-2021
https://doi.org/10.1109/TCC.2018.2858792
Padhy NKumar Mishra RSatapathy SRaju K(2020)An automation API for authentication and security for file uploads in the cloud storage environmentIntelligent Decision Technologies10.3233/IDT-19012914:3(393-407)Online publication date: 29-Sep-2020
https://doi.org/10.3233/IDT-190129
Lu XKong FLiu XYin JXiang QYu H(2020)Bulk Savings for Bulk Transfers: Minimizing the Energy-Cost for Geo-Distributed Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2017.27391608:1(73-85)Online publication date: 1-Jan-2020
https://doi.org/10.1109/TCC.2017.2739160
Yassine AShirehjini AShirmohammadi S(2020)Bandwidth On-Demand for Multimedia Big Data Transfer Across Geo-Distributed Cloud Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2016.26173698:4(1189-1198)Online publication date: 1-Oct-2020
https://doi.org/10.1109/TCC.2016.2617369
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents