research-article

Open access

Towards Sustainable Serverless Processing of Massive Graphs on the Computing Continuum

Authors:

Dragi Kimovski,

Alexandru Iosup, and

Radu ProdanAuthors Info & Claims

ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

April 2023

Pages 221 - 226

https://doi.org/10.1145/3578245.3585331

Published: 15 April 2023 Publication History

Abstract

With the ever-increasing volume of data and the demand to analyze and comprehend it, graph processing has become an essential approach for solving complex problems in various domains, like social networks, bioinformatics, and finance. Despite the potential benefits of current graph processing platforms, they often encounter difficulties supporting diverse workloads, models, and languages. Moreover, existing platforms suffer from limited portability and interoperability, resulting in redundant efforts and inefficient resource and energy utilization due to vendor and even platform lock-in. To bridge the aforementioned gaps, the Graph-Massivizer project, funded by the Horizon Europe research and innovation program, conducts research and develops a high-performance, scalable, and sustainable platform for information processing and reasoning based on the massive graph (MG) representation of extreme data. In this paper, we briefly introduce the Graph-Massivizer platform. We explore how the emerging serverless computing paradigm can be leveraged to devise a scalable graph analytics tool over a codesigned computing continuum infrastructure. Finally, we sketch seven crucial research questions in our design and outline three ongoing and future research directions for addressing them.

References

[1]

Cristina Abad, Ian T Foster, Nikolas Herbst, and Alexandru Iosup. 2021. Serverless computing (Dagstuhl seminar 21201). In Dagstuhl Reports. Schloss Dagstuhl- Leibniz-Zentrum für Informatik.

[2]

Hamilton Wilfried Yves Adoni, Tarik Nahhal, Moez Krichen, Brahim Aghezzaf, and Abdeltif Elbyed. 2020. A survey of current challenges in partitioning and pro- cessing of graph-structured data in parallel and distributed systems. Distributed and Parallel Databases (2020).

[3]

Apache. 2020. Apache Giraph. Retrieved 2023-02--12 from https://giraph.apache. org/

[4]

Apache. 2020. Apache OpenWhisk. Retrieved 2023-02--12 from https://openwhisk. apache.org/

[5]

Mohammad Sadegh Aslanpour, Adel N Toosi, Muhammad Aamir Cheema, and Raj Gaire. 2022. Energy-aware resource scheduling for serverless edge computing. In 2022 22nd IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid). IEEE.

[6]

Setia Blog. 2020. Apache Giraph. Retrieved 2023-02--12 from https://www.sentiatechblog.com/aws-re-invent-2020-day-3-optimizing- lambda-cost-with-multi-threading?utm_source=reddit&utm_medium=social& utm_campaign=day3_lambda

[7]

Yevgeniy Brikman. 2019. Terraform: Up & Running: Writing Infrastructure as Code. O'Reilly Media.

[8]

Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache flink: Stream and batch processing in a single engine. The Bulletin of the Technical Committee on Data Engineering (2015).

[9]

Paul Castro, Vatche Ishakian, Vinod Muthusamy, and Aleksander Slominski. 2019. The rise of serverless computing. Commun. ACM (2019).

[10]

Janneth Chicaiza and Priscila Valdiviezo-Diaz. 2021. A comprehensive survey of knowledge graph-based recommender systems: Technologies, development, and contributions. Information (2021).

[11]

Avery Ching, Sergey Edunov, Maja Kabiljo, Dionysios Logothetis, and Sambavi Muthukrishnan. 2015. One trillion edges: Graph processing at facebook-scale. Proceedings of the VLDB Endowment (2015).

Digital Library

[12]

Marcin Copik, Grzegorz Kwasniewski, Maciej Besta, Michal Podstawski, and Torsten Hoefler. 2021. SeBS: A Serverless Benchmark Suite for Function-as-a- Service Computing. Association for Computing Machinery.

[13]

Cordingly, Robert and Shu, Wen and Lloyd, Wes J. 2020. Predicting performance and cost of serverless computing functions with SAAF. In 2020 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech). IEEE.

[14]

Muhammed Golec, Ridvan Ozturac, Zahra Pooranian, Sukhpal Singh Gill, and Rajkumar Buyya. 2021. IFaaSBus: A security-and privacy-based lightweight framework for serverless computing using IoT and machine learning. IEEE Transactions on Industrial Informatics (2021).

[15]

Joseph E. Gonzalez, Reynold S. Xin, Ankur Dave, Daniel Crankshaw, Michael J. Franklin, and Ion Stoica. 2014. GraphX: Graph Processing in a Distributed Dataflow Framework. In USENIX OSDI.

[16]

Ryan Hancock, Sreeharsha Udayashankar, Ali José Mashtizadeh, and Samer Al- Kiswany. 2022. OrcBench: A Representative Serverless Benchmark. In 2022 IEEE 15th International Conference on Cloud Computing (CLOUD).

[17]

Safiollah Heidari and Rajkumar Buyya. 2019. A cost-efficient auto-scaling algo- rithm for large-scale graph processing in cloud environments with heterogeneous resources. IEEE Transactions on Software Engineering (2019).

[18]

Safiollah Heidari, Yogesh Simmhan, Rodrigo N Calheiros, and Rajkumar Buyya. 2018. Scalable graph processing frameworks: A taxonomy and open challenges. ACM Computing Surveys (CSUR) (2018).

[19]

Alexandru Iosup, Alexandru Uta, Laurens Versluis, Georgios Andreadis, Erwin Van Eyk, Tim Hegeman, Sacheendra Talluri, Vincent Van Beek, and Lucian Toader. 2018. Massivizing computer systems: a vision to understand, design, and engineer computer ecosystems through and beyond modern distributed systems. In 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS). IEEE.

[20]

Matthijs Jansen, Auday Al-Dulaimy, Alessandro V Papadopoulos, Animesh Trivedi, and Alexandru Iosup. 2022. The SPEC-RG Reference Architecture for the Edge Continuum. arXiv preprint arXiv:2207.04159 (2022).

[21]

Eric Jonas, Qifan Pu, Shivaram Venkataraman, Ion Stoica, and Benjamin Recht. 2017. Occupy the cloud: Distributed computing for the 99%. In Proceedings of the 2017 symposium on cloud computing.

Digital Library

[22]

Daniel Kelly, Frank Glavin, and Enda Barrett. 2020. Serverless Computing: Behind the Scenes of Major Platforms. In 2020 IEEE 13th International Conference on Cloud Computing (CLOUD).

[23]

Youngbin Kim and Jimmy Lin. 2018. Serverless data analytics with flint. In 2018 IEEE 11th International Conference on Cloud Computing (CLOUD). IEEE.

[24]

Eren Kurshan and Hongda Shen. 2020. Graph computing for financial crime and fraud detection: Trends, challenges and outlook. International Journal of Semantic Computing (2020).

[25]

Redowan Mahmud, Kotagiri Ramamohanarao, and Rajkumar Buyya. 2020. Ap- plication management in fog computing environments: A taxonomy, review and future directions. ACM Computing Surveys (CSUR) (2020).

[26]

Claudio Martella, Roman Shaposhnik, Dionysios Logothetis, and Steve Harenberg. 2015. Practical graph analytics with apache giraph. Springer.

[27]

Stefan Nastic, Thomas Rausch, Ognjen Scekic, Schahram Dustdar, Marjan Gusev, Bojana Koteska, Magdalena Kostoska, Boro Jakimovski, Sasko Ristov, and Radu Prodan. 2017. A serverless real-time data analytics platform for edge computing. IEEE Internet Computing (2017).

Digital Library

[28]

Pavlopoulos, Georgios A and Secrier, Maria and Moschopoulos, Charalampos N and Soldatos, Theodoros G and Kossida, Sophia and Aerts, Jan and Schneider, Reinhard and Bagos, Pantelis G. 2011. Using graph theory to analyze biological networks. BioData mining (2011).

[29]

Stefan Pedratscher, Sasko Ristov, and Thomas Fahringer. 2022. M2FaaS: Trans- parent and fault tolerant FaaSification of Node. js monolith code blocks. Future Generation Computer Systems 135 (2022), 57--71.

Digital Library

[30]

Radu Prodan, Dragi Kimovski, Andrea Bartolini, Michael Cochez, Alexandru Iosup, Evgeny Kharlamov, Jo?e Roanec, Laurentiu Vasiliu, and Ana Lucia Varbanescu. 2022. Towards Extreme and Sustainable Graph Processing for Urgent Societal Challenges in Europe. In 2022 IEEE Cloud Summit. IEEE.

[31]

Sashko Ristov, Simon Brandacher, Michael Felderer, and Ruth Breu. 2022. GoDe- ploy: Portable Deployment of Serverless Functions in Federated FaaS. In 2022 IEEE Cloud Summit. https://doi.org/10.1109/CloudSummit54781.2022.00012

[32]

Sashko Ristov, Mika Hautz, Christian Hollaus, and Radu Prodan. 2022. SimLess: Simulate Serverless Workflows and Their Twins and Siblings in Federated FaaS. Association for Computing Machinery.

[33]

Narayanan Sundaram, Nadathur Rajagopalan Satish, Md Mostofa Ali Patwary, Subramanya R Dulloor, Satya Gautam Vadlamudi, Dipankar Das, and Pradeep Dubey. 2015. Graphmat: High performance graph analytics made productive. arXiv preprint arXiv:1503.07241 (2015).

[34]

Márk Szalay, Péter Mátray, and László Toka. 2021. Real-time task scheduling in a FaaS cloud. In 2021 IEEE 14th International Conference on Cloud Computing (CLOUD). IEEE.

[35]

Lucian Toader, Alexandru Uta, Ahmed Musaafir, and Alexandru Iosup. 2019. Graphless: Toward serverless graph processing. In 2019 18th International Sym- posium on Parallel and Distributed Computing (ISPDC). IEEE.

[36]

Erwin Van Eyk, Lucian Toader, Sacheendra Talluri, Laurens Versluis, Alexandru Uta, and Alexandru Iosup. 2018. Serverless is more: From paas to present cloud computing. IEEE Internet Computing (2018).

Cited By

Cordingly RLloyd W(2023)Enabling Serverless Sky Computing2023 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E59103.2023.00038(232-235)Online publication date: 25-Sep-2023
https://doi.org/10.1109/IC2E59103.2023.00038
Cordingly RKaur JDwivedi DLloyd W(2023)Towards Serverless Sky Computing: An Investigation on Global Workload Distribution to Mitigate Carbon Intensity, Network Latency, and Cost2023 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E59103.2023.00015(59-69)Online publication date: 25-Sep-2023
https://doi.org/10.1109/IC2E59103.2023.00015

Index Terms

Towards Sustainable Serverless Processing of Massive Graphs on the Computing Continuum
1. Networks
  1. Network services
    1. Cloud computing
2. Theory of computation
  1. Design and analysis of algorithms
    1. Graph algorithms analysis

Recommendations

Large-scale Graph Processing and Simulation with Serverless Workflows in Federated FaaS
ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

Serverless computing offers an affordable and easy way to code lightweight functions that can be invoked based on some events to perform simple tasks. For more complicated processing, multiple serverless functions can be orchestrated as a directed ...
Read More
Designing a Sustainable Serverless Graph Processing Tool on the Computing Continuum
Euro-Par 2023: Parallel Processing Workshops
Abstract
Graph processing has become increasingly popular and essential for solving complex problems in various domains, like social networks. However, the processing of graphs on a massive scale poses critical challenges, such as inefficient utilization ...
Read More
Graph Greenifier: Towards Sustainable and Energy-Aware Massive Graph Processing in the Computing Continuum
ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

Our society is increasingly digital, and its processes are increasingly digitalized. As an emerging technology for the digital society, graphs provide a universal abstraction to represent concepts and objects, and the relationships between them. However, ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '23 Companion: Companion of the 2023 ACM/SPEC International Conference on Performance Engineering

April 2023

421 pages

ISBN:9798400700729

DOI:10.1145/3578245

General Chairs:
Marco Vieira
University of Coimbra, Portugal
,
Valeria Cardellini
University of Rome Tor Vergata, Italy
,
Program Chairs:
Antinisca Di Marco
University of L'Aquila, Italy
,
Petr Tuma
Charles University, Czechia

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 April 2023

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Horizon Europe research and innovation program of the European Union

Conference

ICPE '23

Sponsor:

ICPE '23: ACM/SPEC International Conference on Performance Engineering

April 15 - 19, 2023

Coimbra, Portugal

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
235
Total Downloads

Downloads (Last 12 months)161
Downloads (Last 6 weeks)17

Other Metrics

View Author Metrics

Citations

Cited By

Cordingly RLloyd W(2023)Enabling Serverless Sky Computing2023 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E59103.2023.00038(232-235)Online publication date: 25-Sep-2023
https://doi.org/10.1109/IC2E59103.2023.00038
Cordingly RKaur JDwivedi DLloyd W(2023)Towards Serverless Sky Computing: An Investigation on Global Workload Distribution to Mitigate Carbon Intensity, Network Latency, and Cost2023 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E59103.2023.00015(59-69)Online publication date: 25-Sep-2023
https://doi.org/10.1109/IC2E59103.2023.00015

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents