FaaSCell: A Case for Intra-node Resource Management: Work-In-Progress
Authors: 
Christos Katsakioris, Chloe Alverti, 
Konstantinos Nikas, 
Stratos Psomadakis, Vasileios Karakostas, 
Nectarios KozirisAuthors Info & Claims
Christos Katsakioris, Chloe Alverti, Konstantinos Nikas, Stratos Psomadakis, Vasileios Karakostas, Nectarios KozirisAuthors Info & ClaimsPages 57 - 60
Abstract
Open-source FaaS platforms have recently shown rapid growth, which is usually manifested as extension or specialization of existing cloud-native components and systems -mainly over Kubernetes- since they are provably capable of standing their ground against production-level needs. Despite its advances, the cloud-native ecosystem has focused mostly on container-based deployments so far. FaaS workloads' need for massive colocation [1] without sacrificing security guarantees, pushes multi-tenancy to its limits.
References
[1]
Alexandru Agache, Marc Brooker, Andreea Florescu, Alexandra Iordache, Anthony Liguori, Rolf Neugebauer, Phil Piwonka, and Diana-Maria Popa. 2020. Firecracker: Lightweight Virtualization for Serverless Applications. In Proceedings of the 17th Usenix Conference on Networked Systems Design and Implementation (Santa Clara, CA, USA) (NSDI'20). USENIX Association, USA, 419--434.
[2]
Mohamed Alzayat, Jonathan Mace, Peter Druschel, and Deepak Garg. 2022. Groundhog: Efficient Request Isolation in FaaS.
[3]
Inc. or its affiliates Amazon.com. 2023. Firecracker Containerd. Retrieved February 24, 2023 from https://github.com/firecracker-microvm/firecracker-containerd/
[4]
Anjali, Tyler Caraza-Harter, and Michael M. Swift. 2020. Blending Containers and Virtual Machines: A Study of Firecracker and GVisor. In Proceedings of the 16th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (Lausanne, Switzerland) (VEE '20). Association for Computing Machinery, New York, NY, USA, 101--113.
[5]
Lixiang Ao, George Porter, and Geoffrey M. Voelker. 2022. FaaSnap: FaaS Made Fast Using Snapshot-Based VMs. In Proceedings of the Seventeenth European Conference on Computer Systems (Rennes, France) (EuroSys '22). Association for Computing Machinery, New York, NY, USA, 730--746.
[6]
Apache Software Foundation (ASF). 2023. Open Source Serverless Cloud Platform. Retrieved February 24, 2023 from https://openwhisk.apache.org/
[7]
The Cloud Hypervisor Authors. 2023. Cloud Hypervisor - Run Cloud Virtual Machines Securely and Efficiently. Linux Foundation. Retrieved February 24, 2023 from https://www.cloudhypervisor.org/
[8]
The Cloud-Hypervisor Authors. 2023. Snapshot and Restore. Retrieved February 24, 2023 from https://github.com/cloud-hypervisor/cloud-hypervisor/blob/main/docs/snapshot_restore.md
[9]
The Firecracker Authors. 2023. Firecracker Snapshotting. Retrieved February 24, 2023 from https://github.com/firecracker-microvm/firecracker/blob/main/docs/snapshotting/snapshot-support.md
[10]
The Kubernetes Authors. 2023. Container Runtime Interface (CRI). Retrieved February 24, 2023 from https://kubernetes.io/docs/concepts/architecture/cri/
[11]
The Knative Authors. 2023. Knative is an Open-Source Enterprise-level solution to build Serverless and Event Driven Applications. Retrieved February 24, 2023 from https://knative.dev/
[12]
The Kata Containers Authors. 2023. Kata Containers - Open Source Container Runtime Software. Retrieved February 24, 2023 from https://katacontainers.io/
[13]
Fabrice Bellard. 2005. QEMU, a Fast and Portable Dynamic Translator. In 2005 USENIX Annual Technical Conference (USENIX ATC 05). USENIX Association, Anaheim, CA. https://www.usenix.org/conference/2005-usenix-annual-technical-conference/qemu-fast-and-portable-dynamic-translator
[14]
The containerd Authors. 2023. containerd - An industry-standard container runtime with an emphasis on simplicity, robustness and portability. Retrieved February 24, 2023 from https://containerd.io/
[15]
The containerd Authors. 2023. TTRPC - Protocol Specification. Retrieved February 24, 2023 from https://github.com/containerd/ttrpc/blob/main/PROTOCOL.md
[16]
Dong Du, Tianyi Yu, Yubin Xia, Binyu Zang, Guanglu Yan, Chenggang Qin, Qixuan Wu, and Haibo Chen. 2020. Catalyzer: Sub-Millisecond Startup for Serverless Computing with Initialization-Less Booting. In Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems (Lausanne, Switzerland) (ASPLOS '20). Association for Computing Machinery, New York, NY, USA, 467--481.
[17]
Alex Ellis and OpenFaaS Ltd. 2023. OpenFaaS - Serverless Functions, Made Simple. Retrieved February 24, 2023 from https://www.openfaas.com/
[18]
Open Infrastructure Foundation. 2023. Github Issue #5268 - Implement a runtimers hypervisor plugin for Firecracker. Retrieved February 24, 2023 from https://github.com/kata-containers/kata-containers/issues/5268
[19]
The Linux Foundation. 2023. Open Container Initiative. Retrieved February 24, 2023 from https://opencontainers.org/
[20]
Alexander Fuerst and Prateek Sharma. 2021. FaasCache: Keeping Serverless Computing Alive with Greedy-Dual Caching. In Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (Virtual, USA) (ASPLOS '21). Association for Computing Machinery, New York, NY, USA, 386--400.
[21]
Google. 2023. gVisor: an application kernel for containers. Google. Retrieved February 24, 2023 from https://gvisor.dev/
[22]
Carl Hewitt. 2010. Actor Model of Computation: Scalable Robust Information Systems.
[23]
Carl Hewitt, Peter Bishop, and Richard Steiger. 1973. A Universal Modular ACTOR Formalism for Artificial Intelligence. In Proceedings of the 3rd International Joint Conference on Artificial Intelligence (Stanford, USA) (IJCAI'73). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 235--245.
[24]
Amazon Web Services Inc. 2023. AWS Fargate - Serverless compute for containers. Amazon Web Services Inc. Retrieved February 24, 2023 from https://aws.amazon.com/fargate/
[25]
Amazon Web Services Inc. 2023. AWS Lambda - Run code without thinking about servers or clusters. Amazon Web Services Inc. Retrieved February 24, 2023 from https://aws.amazon.com/lambda/
[26]
Docker Inc. 2023. Docker run reference. Retrieved February 24, 2023 from https://docs.docker.com/engine/reference/run/
[27]
Eric Johnson. 2022. Reducing Java cold starts on AWS Lambda functions with SnapStart. Amazon Web Services Inc. Retrieved February 24, 2023 from https://aws.amazon.com/blogs/compute/reducing-java-cold-starts-on-aws-lambda-functions-with-snapstart/
[28]
Kostis Kaffes, Neeraja J. Yadwadkar, and Christos Kozyrakis. 2022. Hermod: Principled and Practical Scheduling for Serverless Functions. In Proceedings of the 13th Symposium on Cloud Computing (San Francisco, California) (SoCC '22). Association for Computing Machinery, New York, NY, USA, 289--305.
[29]
Christos Katsakioris, Chloe Alverti, Vasileios Karakostas, Konstantinos Nikas, Georgios Goumas, and Nectarios Koziris. 2022. FaaS in the Age of (Sub-)μs I/O: A Performance Analysis of Snapshotting. In Proceedings of the 15th ACM International Conference on Systems and Storage (Haifa, Israel) (SYSTOR '22). Association for Computing Machinery, New York, NY, USA, 13--25.
[30]
Zijun Li, Jiagan Cheng, Quan Chen, Eryu Guan, Zizheng Bian, Yi Tao, Bin Zha, Qiang Wang, Weidong Han, and Minyi Guo. 2022. RunD: A Lightweight Secure Container Runtime for High-density Deployment and High-concurrency Startup in Serverless Computing. In 2022 USENIX Annual Technical Conference (USENIX ATC 22). USENIX Association, Carlsbad, CA, 53--68. https://www.usenix.org/conference/atc22/presentation/li-zijun-rund
[31]
Anup Mohan, Harshad Sane, Kshitij Doshi, Saikrishna Edupuganti, Naren Nayak, and Vadim Sukhomlinov. 2019. Agile Cold Starts for Scalable Serverless. In 11th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 19). USENIX Association, Renton, WA. https://www.usenix.org/conference/hotcloud19/presentation/mohan
[32]
Djob Mvondo, Mathieu Bacou, Kevin Nguetchouang, Lucien Ngale, Stéphane Pouget, Josiane Kouam, Renaud Lachaize, Jinho Hwang, Tim Wood, Daniel Hagimont, Noël De Palma, Bernabé Batchakui, and Alain Tchana. 2021. OFC: An Opportunistic Caching System for FaaS Platforms. In Proceedings of the Sixteenth European Conference on Computer Systems (Online Event, United Kingdom) (EuroSys '21). Association for Computing Machinery, New York, NY, USA, 228--244.
[33]
Orestis Lagkas Nikolos, Georgios Goumas, and Nectarios Koziris. 2022. Deverlay: Container Snapshots For Virtual Machines. In 2022 22nd IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid). 11--20.
[34]
Rohan Basu Roy, Tirthak Patel, and Devesh Tiwari. 2022. IceBreaker: Warming Serverless Functions Better with Heterogeneity. In Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (Lausanne, Switzerland) (ASPLOS '22). Association for Computing Machinery, New York, NY, USA, 753--767.
[35]
Mohammad Shahrad, Rodrigo Fonseca, Inigo Goiri, Gohar Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, and Ricardo Bianchini. 2020. Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider. In 2020 USENIX Annual Technical Conference (USENIX ATC 20). USENIX Association, 205--218. https://www.usenix.org/conference/atc20/presentation/shahrad
[36]
Wonseok Shin, Wook-Hee Kim, and Changwoo Min. 2022. Fireworks: A Fast, Efficient, and Safe Serverless Framework Using VM-Level Post-JIT Snapshot. In Proceedings of the Seventeenth European Conference on Computer Systems (Rennes, France) (EuroSys '22). Association for Computing Machinery, New York, NY, USA, 663--677.
[37]
Gaetano Somma, Constantine Ayimba, Paolo Casari, Simon Pietro Romano, and Vincenzo Mancuso. 2020. When Less is More: Core-Restricted Container Provisioning for Serverless Computing. In IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 1153--1159.
[38]
Amoghvarsha Suresh and Anshul Gandhi. 2019. FnSched: An Efficient Scheduler for Serverless Functions. In Proceedings of the 5th International Workshop on Serverless Computing (Davis, CA, USA) (WOSC '19). Association for Computing Machinery, New York, NY, USA, 19--24.
[39]
Yue Tan, David Liu, Nanqinqin Li, and Amit Levy. 2021. How Low Can You Go? Practical cold-start performance limits in FaaS.
[40]
Dmitrii Ustiugov, Plamen Petrov, Marios Kogias, Edouard Bugnion, and Boris Grot. 2021. Benchmarking, Analysis, and Optimization of Serverless Function Snapshots. In Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (Virtual, USA) (ASPLOS '21). Association for Computing Machinery, New York, NY, USA, 559--572.
[41]
Ao Wang, Shuai Chang, Huangshi Tian, Hongqi Wang, Haoran Yang, Huiba Li, Rui Du, and Yue Cheng. 2021. FaaSNet: Scalable and Fast Provisioning of Custom Serverless Container Runtimes at Alibaba Cloud Function Compute. In 2021 USENIX Annual Technical Conference (USENIX ATC 21). USENIX Association, 443--457. https://www.usenix.org/conference/atc21/presentation/wang-ao
[42]
Kai-Ting Amy Wang, Rayson Ho, and Peng Wu. 2019. Replayable Execution Optimized for Page Sharing for a Managed Runtime Environment. In Proceedings of the Fourteenth EuroSys Conference 2019 (Dresden, Germany) (EuroSys '19). Association for Computing Machinery, New York, NY, USA, Article 39, 16 pages.
[43]
Song Wu, Zhiheng Tao, Hao Fan, Zhuo Huang, Xinmin Zhang, Hai Jin, Chen Yu, and Chun Cao. 2022. Container lifecycle-aware scheduling for serverless computing. Software: Practice and Experience 52, 2 (2022), 337--352. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/spe.3016
[44]
Hanfei Yu, Athirai A. Irissappane, Hao Wang, and Wes J. Lloyd. 2021. FaaSRank: Learning to Schedule Functions in Serverless Platforms. In 2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). 31--40.
[45]
Ziming Zhao, Mingyu Wu, Jiawei Tang, Binyu Zang, Zhaoguo Wang, and Haibo Chen. 2023. BeeHive: Sub-Second Elasticity for Web Services with Semi-FaaS Execution. In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 (Vancouver, BC, Canada) (ASPLOS 2023). Association for Computing Machinery, New York, NY, USA, 74--87.
Recommendations
A Case of Multi-Resource Fairness for Serverless Workflows (Work In Progress Paper)
ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance EngineeringServerless platforms have exploded in popularity in recent years, but, today, these platforms are still unsuitable for large classes of applications. They perform well for batch-oriented workloads that perform coarse transformations over data ...
Resource management in cloud computing
Cloud computing has emerged as a popular computing paradigm for hosting large computing systems and services. Recently, significant research is carried out on Resource Management (RM) techniques that focus on the efficient sharing of cloud resources ...
Model-based cloud resource management with TOSCA and OCCI
AbstractWith the advent of cloud computing, different cloud providers with heterogeneous cloud services (compute, storage, network, applications, etc.) and their related Application Programming Interfaces (APIs) have emerged. This heterogeneity ...
Comments
Information & Contributors
Information
Published In
May 2023
64 pages
ISBN:9798400701856
DOI:10.1145/3592533
Copyright © 2023 Owner/Author(s).
This work is licensed under a Creative Commons Attribution-NoDerivs International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 May 2023
Check for updates
Qualifiers
- Short-paper
Funding Sources
Conference
SESAME '23
Sponsor:
SESAME '23: 1st Workshop on SErverless Systems, Applications and MEthodologies
May 8, 2023
Rome, Italy
Upcoming Conference
EuroSys '25
- Sponsor:
- sigops
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 305Total Downloads
- Downloads (Last 12 months)165
- Downloads (Last 6 weeks)22
Reflects downloads up to 15 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in