Serverless Workflow Management on the Computing Continuum: A Mini-Survey
Pages 146 - 150
Abstract
The growing desire among application providers for a cost model based on pay-per-use, combined with the need for a seamlessly integrated platform to manage the complex workflows of their applications, has spurred the emergence of a promising computing paradigm known as serverless computing. Although serverless computing was initially considered for cloud environments, it has recently been extended to other layers of the computing continuum, i.e., edge and fog. This extension emphasizes that the proximity of computational resources to data sources can further reduce costs and improve performance and energy efficiency. However, orchestrating the computing continuum in complex application workflows, including a set of serverless functions, introduces new challenges. This paper investigates the opportunities and challenges introduced by serverless computing for workflow management systems (WMS) on the computing continuum. In addition, the paper provides a taxonomy of state-of-the-art WMSs and reviews their capabilities.
References
[1]
2023. OpenWhisk. https://openwhisk.apache.org/ Accessed: 2023--11--20.
[2]
Austin Aske and Xinghui Zhao. 2018. Supporting Multi-Provider Serverless Computing on the Edge. In Workshop Proceedings of the 47th International Conference on Parallel Processing (ICPP Workshops '18). ACM.
[3]
Mohammad S Aslanpour et al. 2021. Serverless Edge Computing: Vision and Challenges. In Proceedings of the 2021 Australasian Computer Science Week Multiconference.
[4]
Mohammad Sadegh Aslanpour et al. 2022. Energy-Aware Resource Scheduling for Serverless Edge Computing. In 2022 22nd IEEE Intl. Symp. on Cluster, Cloud and Internet Computing. IEEE.
[5]
Barcelona-Pons et al. 2021. Benchmarking Parallelism in FaaS platforms. Future Generation Computer Systems (2021).
[6]
Krzysztof Burkat et al. 2021. Serverless Containers-Rising Viable Approach to Scientific Workflows. In 2021 IEEE 17th International Conference on eScience (eScience). IEEE.
[7]
Rodrigo N Calheiros et al. 2011. CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms. Software: Practice and experience (2011).
[8]
Paul Castro et al. 2019. The Rise of Serverless Computing. Commun. ACM (2019).
[9]
Chen Chen et al. 2023. S-Cache: Function Caching for Serverless Edge Computing. In Proceedings of the 6th International Workshop on Edge Systems, Analytics and Networking.
[10]
Anirban Das et al. 2020. Performance Optimization for Edge-Cloud Serverless Platforms via Dynamic Task Placement. In 2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID). IEEE.
[11]
Anirban Das et al. 2020. Skedulix: Hybrid Cloud Scheduling for Cost-Efficient Execution of Serverless Applications. In 2020 IEEE 13th Intl. Conf. on Cloud Computing. IEEE.
[12]
Datadog. 2023. Datadog. The State of Serverless, August 2023. https://www. datadoghq.com/state-of-serverless/ Accessed: 2023--11--20.
[13]
Ewa Deelman et al. 2015. Pegasus, a workflow management system for science automation. Future Generation Computer Systems (2015).
[14]
Paolo Di Francesco et al. 2019. Architecting with Microservices: A Systematic Mapping Study. Journal of Systems and Software (2019).
[15]
Klimentina Djeparoska and Marjan Gusev. 2023. Limitations of AWS and GCP Serverless Functions. In 2023 31st Telecommunications Forum (TELFOR). IEEE.
[16]
Simon Eismann et al. 2020. Predicting the Costs of Serverless Workflows. In Int. Conf. on Performance Engineering. ACM.
[17]
Tarek Elgamal et al. 2018. Costless: Optimizing Cost of Serverless Computing through Function Fusion and Placement. In 2018 IEEE/ACM Symp. on Edge Computing. IEEE.
[18]
Reza Farahani et al. 2023. Towards Sustainable Serverless Processing of Massive Graphs on the Computing Continuum. In Proc. of the 1st Workshop on Serverless, Extreme-Scale, and Sustainable Graph Processing Systems.
[19]
Marios Fragkoulis et al. 2023. A survey on the evolution of stream processing systems. The VLDB Journal (2023).
[20]
Sukhpal Singh Gill et al. 2024. Modern computing: vision and challenges. Telematics and Informatics Reports (2024).
[21]
Jashwant Raj Gunasekaran et al. 2019. Spock: Exploiting Serverless Functions for SLO and Cost Aware Resource Procurement in Public Cloud. In 2019 IEEE 12th Intl. Conf. on Cloud Computing. IEEE.
[22]
Scott Haines. 2022.WorkflowOrchestration with Apache Airflow. In Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications. Springer.
[23]
Matthijs Jansen et al. 2023. The SPEC-RG Reference Architecture for the Compute Continuum. In 2023 IEEE/ACM 23rd Intl. Symp. on Cluster, Cloud and Internet Computing. IEEE.
[24]
Hongseok Jeon et al. 2019. A CloudSim-Extension for Simulating Distributed Functions-as-a-Service. In International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT).
[25]
Aji John et al. 2019. SWEEP: Accelerating Scientific Research Through Scalable Serverless Workflows. In IEEE/ACM International Conference UCC Companion. ACM.
[26]
Eric Jonas et al. 2017. Occupy the Cloud: Distributed Computing for the 99%. In Proceedings of the 2017 symposium on cloud computing.
[27]
S Jounaid. 2020. OpenDC Serverless: Design, Implementation and Evaluation of a FaaS Platform Simulator. Ph.D. thesis, Vrije Universiteit Amsterdam.
[28]
Samuel Kounev et al. 2023. Serverless Computing: What It Is, and What It Is Not? Commun. ACM (2023).
[29]
Liuyan Liu et al. 2019. Dependent Task Placement and Scheduling with Function Configuration in Edge computing. In Proc. of the Intl. Symp. on Quality of Service.
[30]
Ashraf Mahgoub et al. 2021. {SONIC}: Application-aware Data Passing for Chained Serverless Applications. In 2021 USENIX Annual Technical Conference (USENIX ATC 21). 285--301.
[31]
Ashraf Mahgoub et al. 2022. {ORION} and the Three Rights: Sizing, Bundling, and Prewarming for Serverless {DAGs}. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22).
[32]
Ashraf Mahgoub et al. 2022. WISEFUSE: Workload Characterization and DAG Transformation for Serverless Workflows. Proc. of the ACM on Measurement and Analysis of Computing Systems (2022).
[33]
Nima Mahmoudi et al. 2019. Optimizing Serverless Computing: Introducing an Adaptive Function Placement Algorithm. In Proceedings of the 29th Annual International Conference on Computer Science and Software Engineering.
[34]
Nima Mahmoudi and Hamzeh Khazaei. 2021. SimFaaS: A Performance Simulator for Serverless Computing Platforms. In Int. Conf. on Cloud Computing and Services Science.
[35]
Redowan Mahmud et al. 2020. Application Management in Fog Computing Environments: A Taxonomy, Review and Future Directions. ACM Computing Surveys (CSUR) (2020).
[36]
Maciej Malawski et al. 2020. Serverless Execution of Scientific Workflows: Experiments with HyperFlow, AWS Lambda and Google Cloud Functions. Future Generation Computer Systems (2020).
[37]
Kien Nguyen et al. 2023. Serverless Computing Lifecycle Model for Edge Cloud Deployments. In 2023 IEEE International Conference on Communications Workshops (ICC Workshops). IEEE.
[38]
OpenFaaS. 2023. OpenFaaS. https://www.openfaas.com/ Accessed: 2023--11--20.
[39]
Li Pan et al. 2022. Retention-Aware Container Caching for Serverless Edge Computing. In IEEE INFOCOM 2022-IEEE Conference on Computer Communications. IEEE.
[40]
Philipp Raith et al. 2023. faaS-sim: A Trace-Driven Simulation Framework for Serverless Edge Computing Platforms. Software: Practice and Experience (2023).
[41]
Thomas Rausch et al. 2021. Optimized Container Scheduling for Data-Intensive Serverless Edge Computing. Future Generation Computer Systems (2021).
[42]
Thomas Rausch et al. 2021. Optimized Container Scheduling for Data-Intensive Serverless Edge Computing. Future Generation Computer Systems (2021).
[43]
Sebastián Risco et al. 2021. Serverless Workflows for Containerised Applications in the Cloud Continuum. Journal of Grid Computing (2021).
[44]
Sashko Ristov et al. 2022. Colder than the Warm Start and Warmer than the Cold Start! Experience the Spawn Start in FaaS Providers. In Proceedings of the 2022 Workshop on Advanced tools, programming languages, and PLatforms for Implementing and Evaluating algorithms for Distributed systems.
[45]
Sashko Ristov et al. 2022. SimLess: simulate serverless workflows and their twins and siblings in federated FaaS. In Proceedings of the 13th Symposium on Cloud Computing.
[46]
Sashko Ristov et al. 2023. Large-scale Graph Processing and Simulation with Serverless Workflows in Federated FaaS. In Companion of the 2023 ACM/SPEC International Conference on Performance Engineering.
[47]
Gabriele Russo Russo et al. 2023. Serverledge: Decentralized Function-as-a- Service for the Edge-Cloud Continuum. In 2023 IEEE Intl. Conf. on Pervasive Computing and Communications. IEEE.
[48]
Josep Sampe et al. 2021. Outsourcing Data Processing Jobs with Lithops. IEEE Transactions on Cloud Computing (2021).
[49]
Hossein Shafiei et al. 2022. Serverless Computing: A survey of Opportunities, Challenges, and Applications. Comput. Surveys (2022).
[50]
Yang Tang et al. 2020. Lambdata: Optimizing Serverless Computing by Making Data Intents Explicit. In 2020 IEEE 13th International Conference on Cloud Computing (CLOUD).
[51]
Ali Tariq et al. 2020. Sequoia: Enabling Quality-of-Service in Serverless Computing. In Proceedings of the 11th ACM symposium on cloud computing.
[52]
Erwin van Eyk. 2019. SimFaaS. https://github.com/erwinvaneyk/simfaas. Accessed: 2024-02-07.
[53]
Erwin Van Eyk et al. 2018. Serverless Is More: From PaaS to Present Cloud Computing. IEEE Internet Computing (2018).
[54]
Laurens Versluis and Alexandru Iosup. 2021. A survey of domains in workflow scheduling in computing infrastructures: Community and keyword analysis, emerging trends, and taxonomies. Future generation computer systems (2021).
[55]
Fuhui Wu et al. 2015. Workflow scheduling in cloud: a survey. The Journal of Supercomputing (2015).
[56]
Song Wu et al. 2021. Container Lifecycle-Aware Scheduling for Serverless Computing. Software: Practice and Experience (2021).
[57]
Mengting Yan et al. 2016. Building a Chatbot with Serverless Computing. In Proceedings of the 1st International Workshop on Mashups of Things and APIs.
[58]
Hanfei Yu et al. 2021. Harvesting Idle Resources in Serverless Computing via Reinforcement Learning. arXiv preprint arXiv:2108.12717 (2021).
Index Terms
- Serverless Workflow Management on the Computing Continuum: A Mini-Survey
Recommendations
Serverless Computing: A Survey of Opportunities, Challenges, and Applications
The emerging serverless computing paradigm has attracted attention from both academia and industry. This paradigm brings benefits such as less operational complexity, a pay-as-you-go pricing model, and an auto-scaling feature. The paradigm opens up new ...
Towards Seamless Serverless Computing Across an Edge-Cloud Continuum
UCC '23: Proceedings of the IEEE/ACM 16th International Conference on Utility and Cloud ComputingServerless computing has emerged as an attractive paradigm due to the efficiency of development and the ease of deployment without managing any underlying infrastructure. Nevertheless, serverless computing approaches face numerous challenges to unlock ...
Self-Provisioning Infrastructures for the Next Generation Serverless Computing
AbstractServerless computing has ushered in a transformative paradigm, with a promise to alleviate developers from the intricacies of infrastructure management. However, current serverless platforms predominantly offer only serverless compute ...
Comments
Information & Contributors
Information
Published In
May 2024
305 pages
ISBN:9798400704451
DOI:10.1145/3629527
- General Chairs:
- Simonetta Balsamo,
- William Knottenbelt,
- Program Chairs:
- Cristina L. Abad,
- Weiyi Shang
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 May 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
Conference
ICPE '24
Sponsor:
ICPE '24: 15th ACM/SPEC International Conference on Performance Engineering
May 7 - 11, 2024
London, United Kingdom
Acceptance Rates
Overall Acceptance Rate 252 of 851 submissions, 30%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 262Total Downloads
- Downloads (Last 12 months)262
- Downloads (Last 6 weeks)68
Reflects downloads up to 16 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in