research-article

Public Access

Sprocket: A Serverless Video Processing Framework

Authors:

Liz Izhikevich,

Geoffrey M. Voelker,

George PorterAuthors Info & Claims

SoCC '18: Proceedings of the ACM Symposium on Cloud Computing

Pages 263 - 274

https://doi.org/10.1145/3267809.3267815

Published: 11 October 2018 Publication History

Abstract

Sprocket is a highly configurable, stage-based, scalable, serverless video processing framework that exploits intra-video parallelism to achieve low latency. Sprocket enables developers to program a series of operations over video content in a modular, extensible manner. Programmers implement custom operations, ranging from simple video transformations to more complex computer vision tasks, in a simple pipeline specification language to construct custom video processing pipelines. Sprocket then handles the underlying access, encoding and decoding, and processing of video and image content across operations in a highly parallel manner. In this paper we describe the design and implementation of the Sprocket system on the AWS Lambda serverless cloud infrastructure, and evaluate Sprocket under a variety of conditions to show that it delivers its performance goals of high parallelism, low latency, and low cost (10s of seconds to process a 3,600 second video 1000-way parallel for less than $3).

References

[1]

Ananthanarayanan, G., Agarwal, S., Kandula, S., Greenberg, A., Stoica, I., Harlan, D., and Harris, E. Scarlett: Coping with Skewed Content Popularity in MapReduce Clusters. In Proceedings of the Sixth European Conference on Computer Systems (EuroSys) (Salzburg, Austria, April 2011), ACM, pp. 287--300.

Digital Library

[2]

Ananthanarayanan, G., Ghodsi, A., Shenker, S., and Stoica, I. Effective Straggler Mitigation: Attack of the Clones. In Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI) (Lombard, IL, April 2013), USENIX Association, pp. 185--198.

Digital Library

[3]

Ananthanarayanan, G., Kandula, S., Greenberg, A., Stoica, I., Lu, Y., Saha, B., and Harris, E. Reining in the Outliers in Map-Reduce Clusters Using Mantri. In Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation (OSDI) (Vancouver, BC, Canada, October 2010), USENIX Association, pp. 265--278.

Digital Library

[4]

Avengers Trailer. https://www.youtube.com/watch?v=eMobkagZu64.

[5]

Avnur, R., and Hellerstein, J. M. Eddies: Continuously Adaptive Query Processing. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (SIGMOD) (Dallas, TX, May 2000), pp. 261--272.

Digital Library

[6]

Borkar, V., Carey, M., Grover, R., Onose, N., and Vernica, R. Hyracks: A Flexible and Extensible Foundation for Data-Intensive Computing. In Proceedings of the 27th IEEE International Conference on Data Engineering (ICDE) (Hanover, Germany, April 2011), pp. 1151--1162.

Digital Library

[7]

Cisco Visual Networking Index: Forecast and Methodology, 2016--2021. https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/complete-white-paper-c11-481360.html.

[8]

Colbert Interview. https://www.youtube.com/watch?v=Y6XXMGUb5kU.

[9]

MPEG Dash Industry Forum. http://dashif.org/.

[10]

Dean, J., and Ghemawat, S. MapReduce: Simplified Data Processing on Large Clusters. In Proceedings of the 6th Conference on Symposium on Operating Systems Design & Implementation (OSDI) (San Francisco, CA, December 2004), USENIX Association, pp. 137--149.

Digital Library

[11]

Earth. https://www.youtube.com/watch?v=wnhvanMdx4s.

[12]

Fouladi, S., Wahby, R. S., Shacklett, B., Balasubramaniam, K. V., Zeng, W., Bhalerao, R., Sivaraman, A., Porter, G., and Winstein, K. Encoding, Fast and Slow: Low-Latency Video Processing Using Thousands of Tiny Threads. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI) (Boston, MA, Mar. 2017).

Digital Library

[13]

Google Cloud Functions. https://cloud.google.com/functions/.

[14]

Google Cloud Vision API. https://cloud.google.com/vision/.

[15]

Apache Hadoop. http://hadoop.apache.org/.

[16]

Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A. D., Katz, R., Shenker, S., and Stoica, I. Mesos: A Platform for Fine-grained Resource Sharing in the Data Center. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI) (Boston, MA, March 2011), USENIX Association, pp. 295--308.

Digital Library

[17]

Huang, Q., Ang, P., Nykiel, T., Tverdokhlib, I., Yajurvedi, A., IV, P. D., Yan, X., Bykov, M., Liang, C., Talwar, M., Mathur, A., Kulkarni, S., Burke, M., and Lloyd, W. SVE: Distributed Video Processing at Facebook Scale. In Proceedings of the 26th ACM Symposium on Operating Systems Principles (SOSP) (Shanghai, China, October 2017), ACM.

Digital Library

[18]

Isard, M., Budiu, M., Yu, Y., Birrell, A., and Fetterly, D. Dryad: Distributed Data-parallel Programs from Sequential Building Blocks. In Proceedings of the 2nd ACM European Conference on Computer Systems (EuroSys) (Lisbon, Portugal, 2007), ACM, pp. 59--72.

Digital Library

[19]

Jonas, E., Pu, Q., Venkataraman, S., Stoica, I., and Recht, B. Occupy the Cloud: Distributed Computing for the 99%. In Proceedings of the ACM Symposium on Cloud Computing (SoCC) (Santa Clara, CA, September 2017), ACM, pp. 445--451.

Digital Library

[20]

Apache Kafka. https://kafka.apache.org/.

[21]

Kwon, Y., Balazinska, M., Howe, B., and Rolia, J. Skew-Resistant Parallel Processing of Feature-Extracting Scientific User-Defined Functions. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC) (Indianapolis, Indiana, June 2010), ACM, pp. 75--86.

Digital Library

[22]

Kwon, Y., Balazinska, M., Howe, B., and Rolia, J. A Study of Skew in MapReduce Applications. The 5th Open Cirrus Summit, 2011.

[23]

Kwon, Y., Balazinska, M., Howe, B., and Rolia, J. SkewTune: Mitigating Skew in Mapreduce Applications. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data (SIGMOD) (Scottsdale, Arizona, May 2012), ACM, pp. 25--36.

Digital Library

[24]

Low, Y., Bickson, D., Gonzalez, J., Guestrin, C., Kyrola, A., and Hellerstein, J. M. Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud. Proceedings of the VLDB Endowment Vol. 5, No. 8 (2012), 716--727.

Digital Library

[25]

Microsoft Computer Vision and Cognitive Services API. https://azure.microsoft.com/en-us/services/cognitive-services/computer-vision/.

[26]

Nature. https://www.youtube.com/watch?v=eMobkagZu64.

[27]

AWS Rekognition. https://aws.amazon.com/rekognition/.

[28]

Sintel. https://www.youtube.com/watch?v=qR5vOXbZsI4.

[29]

Apache Spark. http://spark.apache.org/.

[30]

AWS Step Functions. https://aws.amazon.com/step-functions/.

[31]

Tears of Steel. https://www.youtube.com/watch?v=OHOpb2fS-cM.

[32]

Apache Tez. https://tez.apache.org.

[33]

Wang, L., Li, M., Zhang, Y., Ristenpart, T., and Swift, M. Peeking Behind the Curtains of Serverless Platforms. In Proceedings of the 2018 USENIX Annual Technical Conference (USENIX ATC) (Boston, MA, July 2018), USENIX Association, pp. 133--145.

Digital Library

[34]

Apache Yarn. https://hortonworks.com/apache/yarn/.

[35]

Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M. J., Shenker, S., and Stoica, I. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation (NSDI) (San Jose, CA, April 2012), USENIX Association, pp. 2--2.

Digital Library

[36]

Zaharia, M., Konwinski, A., Joseph, A. D., Katz, R., and Stoica, I. Improving MapReduce Performance in Heterogeneous Environments. In Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation (OSDI) (San Diego, CA, December 2008), USENIX Association, pp. 29--42.

Digital Library

[37]

Zhang, H., Ananthanarayanan, G., Bodik, P., Philipose, M., Bahl, P., and Freedman, M. J. Live Video Analytics at Scale with Approximation and Delay-Tolerance. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI) (Boston, MA, March 2017), USENIX Association, pp. 377--392.

Digital Library

Cited By

Mallellu SMaheswari V. Aluvalu RKantipudi M(2024)Function as a Service (FaaS) for Fast, Efficient, Scalable SystemsServerless Computing Concepts, Technology and Architecture10.4018/979-8-3693-1682-5.ch008(134-151)Online publication date: 5-Apr-2024
https://doi.org/10.4018/979-8-3693-1682-5.ch008
Kuchipudi RPalamakula RMurthy T(2024)Resource Allocation in Serverless ComputingServerless Computing Concepts, Technology and Architecture10.4018/979-8-3693-1682-5.ch002(20-29)Online publication date: 5-Apr-2024
https://doi.org/10.4018/979-8-3693-1682-5.ch002
Giagkos DTzenetopoulos AMasouros DXydis SCatthoor FSoudris D(2024)AI-Driven QoS-Aware Scheduling for Serverless Video Analytics at the EdgeInformation10.3390/info1508048015:8(480)Online publication date: 13-Aug-2024
https://doi.org/10.3390/info15080480
Show More Cited By

Index Terms

Sprocket: A Serverless Video Processing Framework

Recommendations

Study on the Sprocket Profile and Dynamic Analysis of Roller Chain System
ICCMS '10: Proceedings of the 2010 Second International Conference on Computer Modeling and Simulation - Volume 02

Roller chain drives are recognized to be one of the most effective forms of power transmission in mechanical systems. However the mesh between chain and sprocket is generally not a conjugate action. The noise and vibration in such systems can be a ...
A Conceptual Platform of SLA in Cloud Computing
DASC '11: Proceedings of the 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing

Cloud computing is a promising technology, where the infrastructure, developing platform, software and storage are delivered as a service. With the development of cloud computing, more and more cloud service providers emerge. However, there are no ...
Cloud service engineering
ICSE '10: Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2

Building on compute and storage virtualization, Cloud Computing provides scalable, network-centric, abstracted IT infrastructure, platforms, and applications as on-demand services that are billed by consumption. Cloud Service Engineering is the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SoCC '18: Proceedings of the ACM Symposium on Cloud Computing

October 2018

546 pages

ISBN:9781450360111

DOI:10.1145/3267809

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

SoCC '18

Sponsor:

SoCC '18: ACM Symposium on Cloud Computing

October 11 - 13, 2018

CA, Carlsbad, USA

Acceptance Rates

Overall Acceptance Rate 169 of 722 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

114
Total Citations
View Citations
2,216
Total Downloads

Downloads (Last 12 months)564
Downloads (Last 6 weeks)54

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mallellu SMaheswari V. Aluvalu RKantipudi M(2024)Function as a Service (FaaS) for Fast, Efficient, Scalable SystemsServerless Computing Concepts, Technology and Architecture10.4018/979-8-3693-1682-5.ch008(134-151)Online publication date: 5-Apr-2024
https://doi.org/10.4018/979-8-3693-1682-5.ch008
Kuchipudi RPalamakula RMurthy T(2024)Resource Allocation in Serverless ComputingServerless Computing Concepts, Technology and Architecture10.4018/979-8-3693-1682-5.ch002(20-29)Online publication date: 5-Apr-2024
https://doi.org/10.4018/979-8-3693-1682-5.ch002
Giagkos DTzenetopoulos AMasouros DXydis SCatthoor FSoudris D(2024)AI-Driven QoS-Aware Scheduling for Serverless Video Analytics at the EdgeInformation10.3390/info1508048015:8(480)Online publication date: 13-Aug-2024
https://doi.org/10.3390/info15080480
Deka RGhosh ANanda SBarik RSaikia M(2024)Smart Healthcare System in Server-Less Environment: Concepts, Architecture, Challenges, Future DirectionsComputers10.3390/computers1304010513:4(105)Online publication date: 19-Apr-2024
https://doi.org/10.3390/computers13040105
LI ZZHAO YCHEN QGUO M(2024)Serverless computing based on dynamic-addressable sessionSCIENTIA SINICA Informationis10.1360/SSI-2023-015554:3(582)Online publication date: 11-Mar-2024
https://doi.org/10.1360/SSI-2023-0155
Chen QQian JChe YLin ZWang JZhou JSong LLiang YWu JZheng WLiu WLi LLiu FTan KSekar VYu MSeneviratne AVeitch D(2024)YuanRong: A Production General-purpose Serverless System for Distributed Applications in the CloudProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672216(843-859)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672216
Duc Nguyen HChien A(2024)A Foundation for Real-time Applications onFunction-as-a-ServiceACM SIGMETRICS Performance Evaluation Review10.1145/3649477.364949751:4(54-65)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1145/3649477.3649497
Hui XXu YGuo ZShen XMencagli GDazzi PLowenthal DBadia R(2024)ESG: Pipeline-Conscious Efficient Scheduling of DNN Workflows on Serverless Platforms with Shareable GPUsProceedings of the 33rd International Symposium on High-Performance Parallel and Distributed Computing10.1145/3625549.3658657(42-55)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3625549.3658657
Wen ZChen QNiu YSong ZDeng QLiu F(2024)Joint Optimization of Parallelism and Resource Configuration for Serverless Function StepsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.336513435:4(560-576)Online publication date: Apr-2024
https://doi.org/10.1109/TPDS.2024.3365134
Liu FNiu Y(2024)Demystifying the Cost of Serverless Computing: Towards a Win-Win DealIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.333084935:1(59-72)Online publication date: Jan-2024
https://doi.org/10.1109/TPDS.2023.3330849
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents