poster

Understanding internet video sharing site workload: a view from data center design

Authors:

Kenji YoshihiraAuthors Info & Claims

WWW '08: Proceedings of the 17th international conference on World Wide Web

Pages 1097 - 1098

https://doi.org/10.1145/1367497.1367674

Published: 21 April 2008 Publication History

Get Access

Abstract

In this paper we measured and analyzed the workload on Yahoo! Video, the 2nd largest U.S. video sharing site, to understand its nature and the impact on online video data center design. We discovered interesting statistical properties on both static and temporal dimensions of the workload including file duration and popularity distributions, arrival rate dynamics and predictability, and workload stationarity and burstiness. Complemented with queueing-theoretic techniques, we further extended our understanding on the measurement data with a virtual design on the workload and capacity management components of a data center assuming the same workload as measured, which reveals key results regarding the impact of Service Level Agreements (SLAs) and workload scheduling schemes on the design and operations of such large-scale video distribution systems.

References

[1]

Youtube. http://www.youtube.com.

Google Scholar

[2]

ComScore Video Metrix report: U.S. Viewers Watched an Average of 3 Hours of Online Video in July, 2007.

Google Scholar

[3]

L. Cherkasova and L. Staley. Measuring the Capacity of a Streaming Media Server in a Utility Data Center Environment. In MULTIMEDIA'02, New York, NY, USA, 2002. ACM.

Digital Library

Google Scholar

[4]

M. J. Swain and D. H. Ballard. Color Indexing}. Int. J. Comput. Vision, 7(1):11--32, 1991.

Digital Library

Google Scholar

[5]

W. Whitt. Partitioning Customers into Service Groups. Management Science, 45(11):1579--1592, Nov 1999.

Digital Library

Google Scholar

Cited By

View all

Chi YMoon HHacigümüş HTatemura J(2011)SLA-treeProceedings of the 14th International Conference on Extending Database Technology10.1145/1951365.1951383(129-140)Online publication date: 21-Mar-2011
https://dl.acm.org/doi/10.1145/1951365.1951383
Yoshihara NTode HMurakami K(2010)Buffer management mechanism suitable for TCP streaming in QoS-aware IP routerProceedings of the 7th IEEE conference on Consumer communications and networking conference10.5555/1834217.1834413(876-880)Online publication date: 9-Jan-2010
https://dl.acm.org/doi/10.5555/1834217.1834413
Yoshihara NTode HMurakami K(2010)Buffer Management Mechanism Suitable for TCP Streaming in QoS-Aware IP Router2010 7th IEEE Consumer Communications and Networking Conference10.1109/CCNC.2010.5421577(1-5)Online publication date: Jan-2010
https://doi.org/10.1109/CCNC.2010.5421577
Show More Cited By

Index Terms

Understanding internet video sharing site workload: a view from data center design
1. Hardware
  1. Communication hardware, interfaces and storage
2. Networks

Recommendations

Understanding Internet Video sharing site workload: A view from data center design

Internet Video sharing sites, led by YouTube , have been gaining popularity in a dazzling speed, which also brings massive workload to their service data centers. In this paper we analyze Yahoo! Video, the 2nd largest U.S. video sharing site, to ...
A Tandem Queueing model for an appointment-based service system

We develop a queueing model for an appointment-based service system that consists of two queues in tandem: the appointment queue followed by the service queue. Customers join the appointment queue when they call for appointments, stay there (not ...
Stabilizing Customer Abandonment in Many-Server Queues with Time-Varying Arrivals

An algorithm is developed to determine time-dependent staffing levels to stabilize the time-dependent abandonment probabilities and expected delays at positive target values in the M_t/GI/s_t + GI many-server queueing model, which has a nonhomogeneous ...

Comments

Information & Contributors

Information

Published In

WWW '08: Proceedings of the 17th international conference on World Wide Web

April 2008

1326 pages

ISBN:9781605580852

DOI:10.1145/1367497

General Chairs:
Jinpeng Huai
Beihang University, China
,
Robin Chen
AT&T Labs, USA
,
Hsiao-Wuen Hon
Microsoft Research Asia, China
,
Yunhao Liu
HK University of Science and Technology, Hong Kong
,
Program Chairs:
Wei-Ying Ma
Microsoft Research Asia, China
,
Andrew Tomkins
Yahoo! Research, USA
,
Xiaodong Zhang
The Ohio State University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

WWW '08

Sponsor:

WWW '08: The 17th International World Wide Web Conference

April 21 - 25, 2008

Beijing, China

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
227
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chi YMoon HHacigümüş HTatemura J(2011)SLA-treeProceedings of the 14th International Conference on Extending Database Technology10.1145/1951365.1951383(129-140)Online publication date: 21-Mar-2011
https://dl.acm.org/doi/10.1145/1951365.1951383
Yoshihara NTode HMurakami K(2010)Buffer management mechanism suitable for TCP streaming in QoS-aware IP routerProceedings of the 7th IEEE conference on Consumer communications and networking conference10.5555/1834217.1834413(876-880)Online publication date: 9-Jan-2010
https://dl.acm.org/doi/10.5555/1834217.1834413
Yoshihara NTode HMurakami K(2010)Buffer Management Mechanism Suitable for TCP Streaming in QoS-Aware IP Router2010 7th IEEE Consumer Communications and Networking Conference10.1109/CCNC.2010.5421577(1-5)Online publication date: Jan-2010
https://doi.org/10.1109/CCNC.2010.5421577
Zhang HJiang GYoshihira KChen HSaxena ANunez MMiller B(2009)Resilient workload managerProceedings of the 6th international conference industry session on Autonomic computing and communications industry session10.1145/1555312.1555318(19-28)Online publication date: 15-Jun-2009
https://dl.acm.org/doi/10.1145/1555312.1555318

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Understanding Internet Video sharing site workload: A view from data center design

A Tandem Queueing model for an appointment-based service system

Stabilizing Customer Abandonment in Many-Server Queues with Time-Varying Arrivals