Abstract
In the Internet of Things (IoT) era, the demand for efficient and responsive computing systems has surged. Edge computing, which processes data closer to the source, has emerged as a promising solution to address the challenges of latency and bandwidth limitations. However, the dynamic nature of edge environments necessitates intelligent load-balancing strategies to optimize resource utilization and minimize service latency. This paper proposes a novel load-balancing approach that leverages learning automata (LA) to distribute real-time tasks between edge and cloud servers dynamically. By continuously learning from past experiences, the algorithm adapts to changing workloads and network conditions, ensuring optimal task allocation. The proposed algorithm employs a Service Time Measurement (STM) metric to evaluate servers' performance and make informed decisions about task distribution. The algorithm effectively balances the workload between edge and cloud servers by considering factors such as task complexity, server capacity, and network latency. Through extensive simulations, we demonstrate the superior performance of our proposed algorithm compared to existing techniques. Our approach significantly reduces average service time, minimizes task waiting time, optimizes network traffic, and increases the number of successful task executions on edge servers. Compared to previous approaches that partially addressed workload balancing, ALBLA offers a more comprehensive solution that optimizes resource utilization and minimizes energy consumption. Additionally, ALBLA's adaptive nature makes it well-suited for dynamic edge-cloud environments with fluctuating workloads. Our proposed approach contributes to developing more efficient, responsive, and scalable IoT systems by addressing the challenges inherent in edge computing environments.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
No datasets were generated or analysed during the current study.
References
Apat HK, Nayak R, Sahoo B (2023) A comprehensive review on Internet of Things application placement in Fog computing environment. Internet Things 100866
Oliveira F, Costa DG, Assis F, Silva I (2024) Internet of intelligent things: a convergence of embedded systems, edge computing and machine learning. Internet Things 101153
Choudhury A, Ghose M, Islam A (2024) Machine learning-based computation offloading in multi-access edge computing: a survey. J Syst Arch 103090
Khaledian N, Voelp M, Azizi S, Shirvani MH (2024) AI-based & heuristic workflow scheduling in cloud and fog computing: a systematic review. Clust Comput 27(8):10265–10298. https://doi.org/10.1007/s10586-024-04442-2
Shahmirzadi D, Khaledian N, Rahmani AM (2024) Analyzing the impact of various parameters on job scheduling in the Google cluster dataset. Clust Comput 27(6):7673–7687. https://doi.org/10.1007/s10586-024-04377-8
Huaranga-Junco E, González-Gerpe S, Castillo-Cara M, Cimmino A, García-Castro R (2024) From cloud and fog computing to federated-fog computing: a comparative analysis of computational resources in real-time IoT applications based on semantic interoperability. Futur Gener Comput Syst 159:134–150
Cao J, Lam K-Y, Lee L-H, Liu X, Hui P, Xiang Su (2023) Mobile augmented reality: user interfaces, frameworks, and intelligence. ACM Comput Surv 55(9):1–36
Chen Y, Lin Y, Zheng Z, Yu P, Shen J, Guo M (2022) Preference-aware edge server placement in the internet of things. IEEE Internet Things J 9(2):1289–1299
Wu H, Geng J, Bai X, Jin S (2024) Deep reinforcement learning-based online task offloading in mobile edge computing networks. Inf Sci 654:119849
Khaledian N, Khamforoosh K, Akraminejad R, Abualigah L, Javaheri D (2024) An energy-efficient and deadline-aware workflow scheduling algorithm in the fog and cloud environment. Computing 106(1):109–137. https://doi.org/10.1007/s00607-023-01215-4
Sarhadi A, Torkestani JA (2023) Cost-effective scheduling and load balancing algorithms in cloud computing using learning automata. Comput Inf 42(1):1. https://doi.org/10.31577/cai-2023-1-37
Liang H, Zhang X, Zhang J, Li Q, Zhou S, Zhao L (2019) A novel adaptive resource allocation model based on SMDP and reinforcement learning algorithm in vehicular cloud system. IEEE Trans Veh Technol 68(10):10018–10029. https://doi.org/10.1109/TVT.2019.2937842
Gosavi A (2009) Reinforcement learning: a tutorial survey and recent advances. Inf J Comput 21(2):178–192. https://doi.org/10.1287/ijoc.1080.0305
Khaledian N, Khamforoosh K, Azizi S, Maihami V (2023) IKH-EFT: an improved method of workflow scheduling using the krill herd algorithm in the fog-cloud environment. Sustain Comput Inform Syst 37:100834
Lin J, Huang S, Zhang H, Yang X, Zhao P (2023) A deep-reinforcement-learning-based computation offloading with mobile vehicles in vehicular edge computing. IEEE Internet Things J 10(17):15501–15514
Zhao J, Li Q, Ma X, Richard YuF (2023) Computation offloading for edge intelligence in two-tier heterogeneous networks. IEEE Trans Netw Sci Eng 11(2):1872–1884
Wang D, Yi Y, Yan S, Wan Na, Zhao J (2023) A node trust evaluation method of vehicle-road-cloud collaborative system based on federated learning. Ad Hoc Netw 138:103013
Oroojlooy A, Hajinezhad D (2023) A review of cooperative multi-agent deep reinforcement learning. Appl Intell 53(11):13677–13722
Abofathi Y, Anari B, Masdari M (2024) A learning automata based approach for module placement in fog computing environment. Expert Syst Appl 237:121607
Vafashoar R, Morshedlou H, Rezvanian A, Meybodi MR (2021) Cellular learning automata: theory and applications, vol 307. Springer
Su S, Xiang Ju (2023) A cellular learning automata-based approach for self-protection and coverage problem in the Internet of Things. Internet Things 22:100718
Wang X, Gaoyang Wu (2024) Learning automata based routing and content delivery for vehicular named data networking. Eng Appl Artif Intell 136:109043
Billard E, Lakshmivarahan S (1998) Simulation of period-doubling behaviour in distributed learning automata. In: Proceedings of the 1998 ACM symposium on applied computing, pp 690–695
Zhan W, Luo C, Wang J, Wang C, Min G, Duan H, Zhu Q (2020) Deep-reinforcement-learning-based offloading scheduling for vehicular edge computing. IEEE Internet Things J 7(6):5449–5465
Dong L, Wu W, Guo Q, Satpute MN, Znati T, Du DZ (2021) Reliability-aware offloading and allocation in multilevel edge computing system. IEEE Trans Reliab 70(1):200–211. https://doi.org/10.1109/TR.2019.2909279
Wang J, Liu K, Li B, Liu T, Li R, Han Z (2020) Delay-sensitive multi-period computation offloading with reliability guarantees in fog networks. IEEE Trans Mob Comput 19(9):2062–2075. https://doi.org/10.1109/TMC.2019.2918773
Lim J, Lee D (2020) A load balancing algorithm for mobile devices in edge cloud computing environments. Electronics 9(4):4. https://doi.org/10.3390/electronics9040686
Hoseiny F, Azizi S, Shojafar M, Tafazolli R (2021) Joint QoS-aware and cost-efficient task scheduling for fog-cloud resources in a volunteer computing system. ACM Trans Internet Technol. https://doi.org/10.48550/ARXIV.2104.13974
Liu T, Fang L, Zhu Y, Tong W, Yang Y (2022) A near-optimal approach for online task offloading and resource allocation in edge-cloud orchestrated computing. IEEE Trans Mob Comput 21(8):2687–2700. https://doi.org/10.1109/TMC.2020.3045471
Li J et al (2022) Maximizing user service satisfaction for delay-sensitive iot applications in edge computing. IEEE Trans Parallel Distrib Syst 33(5):1199–1212. https://doi.org/10.1109/TPDS.2021.3107137
Dai F, Liu G, Mo Q, Xu W, Huang B (2023) Correction to: task offloading for vehicular edge computing with edge-cloud cooperation. World Wide Web 26(2):633–633. https://doi.org/10.1007/s11280-022-01064-9
Long S, Zhang Y, Deng Q, Pei T, Ouyang J, Xia Z (2023) An efficient task offloading approach based on multi-objective evolutionary algorithm in cloud- edge collaborative environment. IEEE Trans Netw Sci Eng 10(2):645–657. https://doi.org/10.1109/TNSE.2022.3217085
Tang T, Li C, Liu F (2023) Collaborative cloud-edge-end task offloading with task dependency based on deep reinforcement learning. Comput Commun 209:78–90. https://doi.org/10.1016/j.comcom.2023.06.021
Laili Y, Guo F, Ren L, Li X, Li Y, Zhang L (2023) Parallel scheduling of large-scale tasks for industrial cloud-edge collaboration. IEEE Internet Things J 10(4):3231–3242. https://doi.org/10.1109/JIOT.2021.3139689
Siyadatzadeh R et al (2023) ReLIEF: a reinforcement-learning-based real-time task assignment strategy in emerging fault-tolerant fog computing. IEEE Internet Things J 10(12):1075210763. https://doi.org/10.1109/JIOT.2023.3240007
Ebrahim Pourian R, Fartash M, Akbari Torkestani J (2022) A new approach to the resource allocation problem in fog computing based on learning automata. Cybern Syst. https://doi.org/10.1080/01969722.2022.2145653
Du Z, Peng C, Yoshinaga T, Wu C (2023) A Q-learning-based load balancing method for real-time task processing in edge-cloud networks. Electronics. https://doi.org/10.3390/electronics12153254
Liu L, Zhu H, Wang T, Tang M (2024) A fast and efficient task offloading approach in edge-cloud collaboration environment. Electronics 13(2):2. https://doi.org/10.3390/electronics13020313
Ullah I, Lim HK, Seok YJ et al (2023) Optimizing task offloading and resource allocation in edge-cloud networks: a DRL approach. J Cloud Comp 12:112. https://doi.org/10.1186/s13677-023-00461-3
Rahmani TA, Belalem G, Mahmoudi SA et al (2024) Machine learning-driven energy-efficient load balancing for real-time heterogeneous systems. Clust Comput 27:4883–4908. https://doi.org/10.1007/s10586-023-04215-3
Wehbi O, Arisdakessian S, Wahab OA et al (2023) Fedmint: Intelligent bilateral client selection in federated learning with newcomer IoT devices. IEEE Internet Things J 10(23):20884–20898
Bai J, Chen Y (2023) The node selection strategy for federated learning in UAV-assisted edge computing environment. IEEE Internet Things J 10(15):13908–13919
Sonmez C, Ozgovde A, Ersoy C (2018) EdgeCloudSim: an environment for performance evaluation of edge computing systems. Trans Emerg Telecommun Technol 29(11):e3493. https://doi.org/10.1002/ett.3493
Goyal T, Singh A, Agrawal A (2012) Cloudsim: a simulator for cloud computing infrastructure and modelling. Int Conf Model Optim Comput 38:3566–3572. https://doi.org/10.1016/j.proeng.2012.06.412
Hensen B (2023) A systematic literature review of mixed reality learning approaches. In: De Paolis LT, Arpaia P, Sacco M (eds) Extended reality. Springer Nature Switzerland, Cham, pp 15–34
Ahmed S, Irfan S, Kiran N, Masood N, Anjum N, Ramzan N (2023) Remote health monitoring systems for elderly people: a survey. Sensors. https://doi.org/10.3390/s23167095
Jaseena KU, Kovoor BC (2022) Deterministic weather forecasting models based on intelligent predictors: a survey. J King Saud Univ Comput Inf Sci 34(6):3393–3412. https://doi.org/10.1016/j.jksuci.2020.09.009
Aazam M, Huh EN (2014) Broker as a service (baas) pricing and resource estimation model. In: 2014 IEEE 6th international conference on cloud computing technology and science, pp 463–468. IEEE
Dinh TQ, Tang J, La QD, Quek TQS (2017) Offloading in mobile edge computing: task allocation and computational frequency scaling. IEEE Trans Commun 65(8):3571–3584
Mao Y, Zhang J, Letaief KB (2017) Dynamic computation offloading for mobile-edge computing with energy harvesting devices. IEEE J Sel Areas Commun 34(12):3590–3605
Wang S, Zhao Y, Xu J, Yuan J, Hsu CH (2019) Edge server placement in mobile edge computing. J Parallel Distrib Comput 127:160–168
Zhou Z, Shojafar M, Alazab M, Abawajy J, Li F (2021) AFED-EF: an energy-efficient VM allocation algorithm for IoT applications in a cloud data center. IEEE Trans Green Commun Netw 5(2):658–669. https://doi.org/10.1109/TGCN.2021.3067309
Zhou Z, Abawajy J, Chowdhury M, Hu Z, Li K, Cheng H, Li F (2018) Minimizing SLA violation and power consumption in Cloud data centres using adaptive energy-aware algorithms. Future Gener Comput Syst 86:836–850
Zhou Z, Shojafar M, Alazab M, Li F (2022) IECL: an intelligent energy consumption model for cloud manufacturing. IEEE Trans Industr Inf 18(12):8967–8976
Funding
No funding was obtained for this study.
Author information
Authors and Affiliations
Contributions
Mehdi Ghorbani: Methodology, Software, Visualization, Investigation. Navid Khaledian: Supervisor, Conceptualization, Methodology, Writing- Original draft preparation. Setareh Moazzami: Data curation, Writing- Reviewing and Editing, Validation.
Corresponding author
Ethics declarations
Conflict of interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ghorbani, M., Khaledian, N. & Moazzami, S. ALBLA: an adaptive load balancing approach in edge-cloud networks utilizing learning automata. Computing 107, 34 (2025). https://doi.org/10.1007/s00607-024-01380-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00607-024-01380-0