Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Article Types

Countries / Regions

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Search Results (1,720)

Search Parameters:
Keywords = multi-agent systems

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
25 pages, 2718 KiB  
Article
Group Consensus Using Event-Triggered Control for Second-Order Multi-Agent Systems under Asynchronous DoS Attack
by Yuhang Pan, Yongqing Yang and Chushu Yi
Appl. Sci. 2024, 14(16), 7304; https://doi.org/10.3390/app14167304 - 19 Aug 2024
Viewed by 220
Abstract
This paper explores the group consensus problem of second-order multi-agent systems (MAS) under asynchronous denial-of-service (DoS) attacks. Asynchronous DoS attacks involve the interruption of certain communication links, allowing the MAS to be reimagined as a switching system with a persistent dwell time (PDT). [...] Read more.
This paper explores the group consensus problem of second-order multi-agent systems (MAS) under asynchronous denial-of-service (DoS) attacks. Asynchronous DoS attacks involve the interruption of certain communication links, allowing the MAS to be reimagined as a switching system with a persistent dwell time (PDT). The agents in each group can be divided into three types, which are inter-act agents, intra-act agents with zero in-degree, and other agents. Then, according to the properties of the different agents, suitable agents are pinned. By leveraging the concepts of switching topology and the PDT, a suitable event-triggered control protocol is designed, along with the establishment of conditions to ensure the group consensus of the MAS. Moreover, through the construction of topology-dependent Lyapunov functions, the achievement of group consensus within the MAS under asynchronous DoS attacks is demonstrated. Subsequently, a numerical example is presented to validate the effectiveness of the proposed results. Full article
20 pages, 8689 KiB  
Article
Effects of Machine Learning and Multi-Agent Simulation on Mining and Visualizing Tourism Tweets as Not Summarized but Instantiated Knowledge
by Shun Hattori, Yuto Fujidai, Wataru Sunayama and Madoka Takahara
Electronics 2024, 13(16), 3276; https://doi.org/10.3390/electronics13163276 - 19 Aug 2024
Viewed by 337
Abstract
Various technologies with AI (Artificial Intelligence), DS (Data Science), and/or IoT (Internet of Things) have been starting to be pervasive in e-tourism (i.e., smart tourism). However, most of them for a target (e.g., what to do in such a tourism spot as Hikone [...] Read more.
Various technologies with AI (Artificial Intelligence), DS (Data Science), and/or IoT (Internet of Things) have been starting to be pervasive in e-tourism (i.e., smart tourism). However, most of them for a target (e.g., what to do in such a tourism spot as Hikone Castle) utilize their “typical/major signals” (e.g., taking a photo) as summarized knowledge based on “The Principle of Majority”, and tend to filter out not only their noises but also their valuable “peculiar/minor signals” (e.g., view Sawayama Castle) as instantiated knowledge. Therefore, as a challenge to salvage not only “typical signals” but also “peculiar signals” without noises for e-tourism, this paper compares various methods of ML (Machine Learning) to text-classify a tweet as being a “tourism tweet” or not, to precisely mine tourism tweets as not summarized but instantiated knowledge. In addition, this paper proposes a MAS (Multi-Agent Simulation), powered with artisoc, for visualizing “tourism tweets”, including not only “typical signals” but also “peculiar signals”, whose number can be enormous, as not summarized but instantiated knowledge, i.e., instances of them without any summarization, and validates the effects of the proposed MAS by conducting some experiments with subjects. Full article
(This article belongs to the Special Issue New Advances in Multi-agent Systems: Control and Modelling)
Show Figures

Figure 1

23 pages, 4667 KiB  
Article
Study of Flexibility Transformation in Thermal Power Enterprises under Multi-Factor Drivers: Application of Complex-Network Evolutionary Game Theory
by Lefeng Cheng, Pan Peng, Wentian Lu, Pengrong Huang and Yang Chen
Mathematics 2024, 12(16), 2537; https://doi.org/10.3390/math12162537 - 16 Aug 2024
Viewed by 400
Abstract
With the increasing share of renewable energy in the grid and the enhanced flexibility of the future power system, it is imperative for thermal power companies to explore alternative strategies. The flexible transformation of thermal power units is an effective strategy to address [...] Read more.
With the increasing share of renewable energy in the grid and the enhanced flexibility of the future power system, it is imperative for thermal power companies to explore alternative strategies. The flexible transformation of thermal power units is an effective strategy to address the previously mentioned challenges; however, the factors influencing the diffusion of this technology merit further investigation, yet they have been seldom examined by scholars. To address this gap, this issue is examined using an evolutionary game model of multi-agent complex networks, and a more realistic group structure is established through heterogeneous group differentiation. With factors such as group relationships, diffusion paths, compensation electricity prices, and subsidy intensities as variables, several diffusion scenarios are developed for research purposes. The results indicate that when upper-level enterprises influence the decision-making of lower-level enterprises, technology diffusion is significantly accelerated, and enhanced communication among thermal power enterprises further promotes diffusion. Among thermal power enterprises, leveraging large and medium-sized enterprises to promote the flexibility transformation of units proves to be an effective strategy. With regard to factors like the compensation price for depth peak shaving, the initial application ratio of groups, and the intensity of government subsidies, the compensation price emerges as the key factor. Only with a high compensation price can the other two factors effectively contribute to promoting technology diffusion. Full article
Show Figures

Figure 1

25 pages, 6112 KiB  
Article
Multi-Agent Cross-Domain Collaborative Task Allocation Problem Based on Multi-Strategy Improved Dung Beetle Optimization Algorithm
by Yuxiang Zhou, Faxing Lu, Junfei Xu and Ling Wu
Appl. Sci. 2024, 14(16), 7175; https://doi.org/10.3390/app14167175 - 15 Aug 2024
Viewed by 284
Abstract
Cross-domain cooperative task allocation is a complex and challenging issue in the field of multi-agent task allocation that requires urgent attention. This paper proposes a task allocation method based on the multi-strategy improved dung beetle optimization (MSIDBO) algorithm, aiming to solve the problem [...] Read more.
Cross-domain cooperative task allocation is a complex and challenging issue in the field of multi-agent task allocation that requires urgent attention. This paper proposes a task allocation method based on the multi-strategy improved dung beetle optimization (MSIDBO) algorithm, aiming to solve the problem of fully distributed multi-agent cross-domain cooperative task allocation. This method integrates two key objective functions: target allocation and control allocation. We propose a target allocation model based on the optimal comprehensive efficiency, cluster load balancing, and economic benefit maximization, and a control allocation model leveraging the radar detection ability and control data link connectivity. To address the limitations of the original dung beetle optimization algorithm in solving such problems, four revolutionary strategies are introduced to improve its performance. The simulation results demonstrate that our proposed task allocation algorithm significantly improves the cross-domain collaboration efficiency and meets the real-time requirements for multi-agent task allocation on various scales. Specifically, our optimization performance was, on average, 32.5% higher compared to classical algorithms like the particle swarm optimization algorithm and the dung beetle optimization algorithm and its improved forms. Overall, our proposed scheme enhances system effectiveness and robustness while providing an innovative and practical solution for complex task allocation problems. Full article
Show Figures

Figure 1

16 pages, 430 KiB  
Article
Multi-Agent Deep-Q Network-Based Cache Replacement Policy for Content Delivery Networks
by Janith K. Dassanayake, Minxiao Wang, Muhammad Z. Hameed and Ning Yang
Future Internet 2024, 16(8), 292; https://doi.org/10.3390/fi16080292 - 14 Aug 2024
Viewed by 266
Abstract
In today’s digital landscape, content delivery networks (CDNs) play a pivotal role in ensuring rapid and seamless access to online content across the globe. By strategically deploying a network of edge servers in close proximity to users, CDNs optimize the delivery of digital [...] Read more.
In today’s digital landscape, content delivery networks (CDNs) play a pivotal role in ensuring rapid and seamless access to online content across the globe. By strategically deploying a network of edge servers in close proximity to users, CDNs optimize the delivery of digital content. One key mechanism involves caching frequently requested content at these edge servers, which not only alleviates the load on the source CDN server but also enhances the overall user experience. However, the exponential growth in user demands has led to increased network congestion, subsequently reducing the cache hit ratio within CDNs. To address this reduction, this paper presents an innovative approach for efficient cache replacement in a dynamic caching environment while maximizing the cache hit ratio via a cooperative cache replacement policy based on reinforcement learning. This paper presents an innovative approach to enhance the performance of CDNs through an advanced cache replacement policy based on reinforcement learning. The proposed system model depicts a mesh network of CDNs, with edge servers catering to user requests, and a main source CDN server. The cache replacement problem is initially modeled as a Markov decision process, and it is extended to a multi-agent reinforcement learning problem. We propose a cooperative cache replacement algorithm based on a multi-agent deep-Q network (MADQN), where the edge servers cooperatively learn to efficiently replace the cached content to maximize the cache hit ratio. Experimental results are presented to validate the performance of our proposed approach. Notably, our MADQN policy exhibits superior cache hit ratios and lower average delays compared to traditional caching policies. Full article
(This article belongs to the Special Issue Industrial Internet of Things (IIoT): Trends and Technologies)
Show Figures

Figure 1

17 pages, 6375 KiB  
Article
Designing a Candidate Multi-Epitope Vaccine against Transmissible Gastroenteritis Virus Based on Immunoinformatic and Molecular Dynamics
by Yihan Bai, Mingxia Zhou, Naidong Wang, Yi Yang and Dongliang Wang
Int. J. Mol. Sci. 2024, 25(16), 8828; https://doi.org/10.3390/ijms25168828 - 13 Aug 2024
Viewed by 408
Abstract
Transmissible gastroenteritis virus (TGEV) is an etiological agent of enteric disease that results in high mortality rates in piglets. The economic impact of the virus is considerable, causing significant losses to the pig industry. The development of an efficacious subunit vaccine to provide [...] Read more.
Transmissible gastroenteritis virus (TGEV) is an etiological agent of enteric disease that results in high mortality rates in piglets. The economic impact of the virus is considerable, causing significant losses to the pig industry. The development of an efficacious subunit vaccine to provide promising protection against TGEV is of the utmost importance. The viral antigen, spike glycoprotein (S), is widely regarded as one of the most effective antigenic components for vaccine research. In this study, we employed immunoinformatics and molecular dynamics approaches to develop an ‘ideal’ multi-epitope vaccine. Firstly, the dominant, non-toxic, highly antigenic T (Th, CTL) and B cell epitopes predicted from the TGEV S protein were artificially engineered in tandem to design candidate subunit vaccines. Molecular docking and dynamic simulation results demonstrate that it exhibits robust interactions with toll-like receptor 4 (TLR4). Of particular significance was the finding that the vaccine was capable of triggering an immune response in mammals, as evidenced by the immune simulation results. The humoral aspect is typified by elevated levels of IgG and IgM, whereas the cellular immune aspect is capable of eliciting the robust production of interleukins and cytokines (IFN-γ and IL-2). Furthermore, the adoption of E. coli expression systems for the preparation of vaccines will also result in cost savings. This study offers logical guidelines for the development of a secure and efficacious subunit vaccine against TGEV, in addition to providing a novel theoretical foundation and strategy to prevent associated CoV infections. Full article
(This article belongs to the Special Issue Advanced Research in Biomolecular Design for Medical Applications)
Show Figures

Figure 1

28 pages, 1196 KiB  
Article
Advanced Observation-Based Bipartite Containment Control of Fractional-Order Multi-Agent Systems Considering Hostile Environments, Nonlinear Delayed Dynamics, and Disturbance Compensation
by Asad Khan, Muhammad Awais Javeed, Saadia Rehman, Azmat Ullah Khan Niazi and Yubin Zhong
Fractal Fract. 2024, 8(8), 473; https://doi.org/10.3390/fractalfract8080473 - 13 Aug 2024
Viewed by 421
Abstract
This paper introduces an advanced observer-based control strategy designed for fractional multi-agent systems operating in hostile environments. We take into account the dynamic nature of the agents with nonlinear delayed dynamics and consider external disturbances affecting the system. The manuscript presents an improved [...] Read more.
This paper introduces an advanced observer-based control strategy designed for fractional multi-agent systems operating in hostile environments. We take into account the dynamic nature of the agents with nonlinear delayed dynamics and consider external disturbances affecting the system. The manuscript presents an improved observation-based control approach tailored for fractional-order multi-agent systems functioning in challenging conditions. We also establish various applicable conditions governing the creation of observers and disturbance compensation controllers using the fractional Razmikhin technique, signed graph theory, and matrix transformation. Furthermore, our investigation includes observation-based control on switching networks by employing a typical Lyapunov function approach. Finally, the effectiveness of the proposed strategy is demonstrated through the analysis of two simulation examples. Full article
(This article belongs to the Topic Fractional Calculus: Theory and Applications, 2nd Edition)
Show Figures

Figure 1

21 pages, 2816 KiB  
Article
Adaptive Hybrid Beamforming Codebook Design Using Multi-Agent Reinforcement Learning for Multiuser Multiple-Input–Multiple-Output Systems
by Manasjyoti Bhuyan, Kandarpa Kumar Sarma, Debashis Dev Misra, Koushik Guha and Jacopo Iannacci
Appl. Sci. 2024, 14(16), 7109; https://doi.org/10.3390/app14167109 - 13 Aug 2024
Viewed by 488
Abstract
This paper presents a novel approach to designing beam codebooks for downlink multiuser hybrid multiple-input–multiple-output (MIMO) wireless communication systems, leveraging multi-agent reinforcement learning (MARL). The primary objective is to develop an environment-specific beam codebook composed of non-interfering beams, learned by cooperative agents within [...] Read more.
This paper presents a novel approach to designing beam codebooks for downlink multiuser hybrid multiple-input–multiple-output (MIMO) wireless communication systems, leveraging multi-agent reinforcement learning (MARL). The primary objective is to develop an environment-specific beam codebook composed of non-interfering beams, learned by cooperative agents within the MARL framework. Machine learning (ML)-based beam codebook design for downlink communications have been based on channel state information (CSI) feedback or only reference signal received power (RSRP), consisting of an offline training and user clustering phase. In massive MIMO, the full CSI feedback data is of large size and is resource-intensive to process, making it challenging to implement efficiently. RSRP alone for a stand-alone base station is not a good marker of the position of a receiver. Hence, in this work, uplink CSI estimated at the base station along with feedback of RSRP and binary acknowledgment of the accuracy of received data is utilized to design the beamforming codebook at the base station. Simulations using sub-array antenna and ray-tracing channel demonstrate the proposed system’s ability to learn topography-aware beam codebook for arbitrary beams serving multiple user groups simultaneously. The proposed method extends beyond mono-lobe and fixed beam architectures by dynamically adapting arbitrary shaped beams to avoid inter-beam interference, enhancing the overall system performance. This work leverages MARL’s potential in creating efficient beam codebooks for hybrid MIMO systems, paving the way for enhanced multiuser communication in future wireless networks. Full article
(This article belongs to the Special Issue New Challenges in MIMO Communication Systems)
Show Figures

Figure 1

22 pages, 1006 KiB  
Article
Network-Centric Formation Control and Ad Hoc Communication with Localisation Analysis in Multi-UAV Systems
by Jack Devey, Palvir Singh Gill, George Allen, Essa Shahra and Moad Idrissi
Machines 2024, 12(8), 550; https://doi.org/10.3390/machines12080550 - 13 Aug 2024
Viewed by 528
Abstract
In recent years, the cost-effectiveness and versatility of Unmanned Aerial Vehicles (UAVs) have led to their widespread adoption in both military and civilian applications, particularly for operations in remote or hazardous environments where human intervention is impractical. The use of multi-agent UAV systems [...] Read more.
In recent years, the cost-effectiveness and versatility of Unmanned Aerial Vehicles (UAVs) have led to their widespread adoption in both military and civilian applications, particularly for operations in remote or hazardous environments where human intervention is impractical. The use of multi-agent UAV systems has notably increased for complex tasks such as surveying and monitoring, driving extensive research and development in control, communication, and coordination technologies. Evaluating and analysing these systems under dynamic flight conditions present significant challenges. This paper introduces a mathematical model for leader–follower structured Quadrotor UAVs that encapsulates their dynamic behaviour, incorporating a novel multi-agent ad hoc coordination network simulated via COOJA. Simulation results with a pipeline surveillance case study demonstrate the efficacy of the coordination network and show that the system offers various improvements over contemporary pipeline surveillance approaches. Full article
(This article belongs to the Special Issue Advanced Control and Path Planning of Unmanned Aerial Vehicles (UAVs))
Show Figures

Figure 1

22 pages, 1406 KiB  
Article
Multi-Layer Energy Management and Strategy Learning for Microgrids: A Proximal Policy Optimization Approach
by Xiaohan Fang, Peng Hong, Shuping He, Yuhao Zhang and Di Tan
Energies 2024, 17(16), 3990; https://doi.org/10.3390/en17163990 - 12 Aug 2024
Viewed by 405
Abstract
An efficient energy management system (EMS) enhances microgrid performance in terms of stability, safety, and economy. Traditional centralized or decentralized energy management systems are unable to meet the increasing demands for autonomous decision-making, privacy protection, global optimization, and rapid collaboration simultaneously. This paper [...] Read more.
An efficient energy management system (EMS) enhances microgrid performance in terms of stability, safety, and economy. Traditional centralized or decentralized energy management systems are unable to meet the increasing demands for autonomous decision-making, privacy protection, global optimization, and rapid collaboration simultaneously. This paper proposes a hierarchical multi-layer EMS for microgrid, comprising supply layer, demand layer, and neutral scheduling layer. Additionally, common mathematical optimization methods struggle with microgrid scheduling decision problem due to challenges in mechanism modeling, supply–demand uncertainty, and high real-time and autonomy requirements. Therefore, an improved proximal policy optimization (PPO) approach is proposed for the multi-layer EMS. Specifically, in the centrally managed supply layer, a centralized PPO algorithm is utilized to determine the optimal power generation strategy. In the decentralized demand layer, an auction market is established, and multi-agent proximal policy optimization (MAPPO) algorithm with an action-guidance-based mechanism is employed for each consumer, to implement individual auction strategy. The neutral scheduling layer interacts with other layers, manages information, and protects participant privacy. Numerical results validate the effectiveness of the proposed multi-layer EMS framework and the PPO-based optimization methods. Full article
(This article belongs to the Section A1: Smart Grids and Microgrids)
Show Figures

Figure 1

17 pages, 5068 KiB  
Article
MADDPG-Based Deployment Algorithm for 5G Network Slicing
by Lu Zhang, Junwei Li, Qianwen Yang, Chenglin Xu and Feng Zhao
Electronics 2024, 13(16), 3189; https://doi.org/10.3390/electronics13163189 - 12 Aug 2024
Viewed by 401
Abstract
One of the core features of 5G networks is the ability to support multiple services on the same infrastructure, with network slicing being a key technology. However, existing network slicing architectures have limitations in efficiently handling slice requests with different requirements, particularly when [...] Read more.
One of the core features of 5G networks is the ability to support multiple services on the same infrastructure, with network slicing being a key technology. However, existing network slicing architectures have limitations in efficiently handling slice requests with different requirements, particularly when addressing high-reliability and high-demand services, where many issues remain unresolved. For example, predicting whether actual physical resources can meet network slice request demands and achieving flexible, on-demand resource allocation for different types of slice requests are significant challenges. To address the need for more flexible and efficient service demands, this paper proposes a 5G network slicing deployment algorithm based on the Multi-Agent Deep Deterministic Policy Gradient (MADDPG). Firstly, a new 5G network slicing deployment system framework is established, which measures resources for three typical 5G network slicing scenarios (eMBB, mMTC, uRLLC) and processes different types of slice requests by predicting slice request traffic. Secondly, by adopting the multi-agent approach of MADDPG, the algorithm enhances cooperation between multiple service requests, decentralizes action selection for requests, and schedules resources separately for the three types of slice requests, thereby optimizing resource allocation. Finally, simulation results demonstrate that the proposed algorithm significantly outperforms existing algorithms in terms of resource efficiency and slice request acceptance rate, showcasing the advantages of multi-agent approaches in slice request handling. Full article
Show Figures

Figure 1

25 pages, 10697 KiB  
Article
Three-Dimensional Coverage Path Planning for Cooperative Autonomous Underwater Vehicles: A Swarm Migration Genetic Algorithm Approach
by Yangmin Xie, Wenbo Hui, Dacheng Zhou and Hang Shi
J. Mar. Sci. Eng. 2024, 12(8), 1366; https://doi.org/10.3390/jmse12081366 - 11 Aug 2024
Viewed by 417
Abstract
Cooperative marine exploration tasks involving multiple autonomous underwater vehicles (AUVs) present a complex 3D coverage path planning challenge that has not been fully addressed. To tackle this, we employ an auto-growth strategy to generate interconnected paths, ensuring simultaneous satisfaction of the obstacle avoidance [...] Read more.
Cooperative marine exploration tasks involving multiple autonomous underwater vehicles (AUVs) present a complex 3D coverage path planning challenge that has not been fully addressed. To tackle this, we employ an auto-growth strategy to generate interconnected paths, ensuring simultaneous satisfaction of the obstacle avoidance and space coverage requirements. Our approach introduces a novel genetic algorithm designed to achieve equivalent and energy-efficient path allocation among AUVs. The core idea involves defining competing gene swarms to facilitate path migration, corresponding to path allocation actions among AUVs. The fitness function incorporates models for both energy consumption and optimal path connections, resulting in iterations that lead to optimal path assignment among AUVs. This framework for multi-AUV coverage path planning eliminates the need for pre-division of the working space and has proven effective in 3D underwater environments. Numerous experiments validate the proposed method, showcasing its comprehensive advantages in achieving equitable path allocation, minimizing overall energy consumption, and ensuring high computational efficiency. These benefits contribute to the success of multi-AUV cooperation in deep-sea information collection and environmental surveillance. Full article
(This article belongs to the Section Ocean Engineering)
Show Figures

Figure 1

25 pages, 3921 KiB  
Article
Graph Neural Network Based Asynchronous Federated Learning for Digital Twin-Driven Distributed Multi-Agent Dynamical Systems
by Xuanzhu Sheng, Yang Zhou and Xiaolong Cui
Mathematics 2024, 12(16), 2469; https://doi.org/10.3390/math12162469 - 9 Aug 2024
Viewed by 400
Abstract
The rapid development of artificial intelligence (AI) and 5G paradigm brings infinite possibilities for data annotation for new applications in the industrial Internet of Things (IIoT). However, the problem of data annotation consistency under distributed architectures and growing concerns about issues such as [...] Read more.
The rapid development of artificial intelligence (AI) and 5G paradigm brings infinite possibilities for data annotation for new applications in the industrial Internet of Things (IIoT). However, the problem of data annotation consistency under distributed architectures and growing concerns about issues such as data privacy and cybersecurity are major obstacles to improving the quality of distributed data annotation. In this paper, we propose a reputation-based asynchronous federated learning approach for digital twins. First, this paper integrates digital twins into an asynchronous federated learning framework, and utilizes a smart contract-based reputation mechanism to enhance the interconnection and internal interaction of asynchronous mobile terminals. In addition, in order to enhance security and privacy protection in the distributed smart annotation system, this paper introduces blockchain technology to optimize the data exchange, storage, and sharing process to improve system security and reliability. The data results show that the consistency of our proposed FedDTrep distributed intelligent labeling system reaches 99%. Full article
(This article belongs to the Special Issue Advanced Control of Complex Dynamical Systems with Applications)
Show Figures

Figure 1

19 pages, 9250 KiB  
Article
Multi-Agent Deep Reinforcement Learning Based Dynamic Task Offloading in a Device-to-Device Mobile-Edge Computing Network to Minimize Average Task Delay with Deadline Constraints
by Huaiwen He, Xiangdong Yang, Xin Mi, Hong Shen and Xuefeng Liao
Sensors 2024, 24(16), 5141; https://doi.org/10.3390/s24165141 - 8 Aug 2024
Viewed by 602
Abstract
Device-to-device (D2D) is a pivotal technology in the next generation of communication, allowing for direct task offloading between mobile devices (MDs) to improve the efficient utilization of idle resources. This paper proposes a novel algorithm for dynamic task offloading between the active MDs [...] Read more.
Device-to-device (D2D) is a pivotal technology in the next generation of communication, allowing for direct task offloading between mobile devices (MDs) to improve the efficient utilization of idle resources. This paper proposes a novel algorithm for dynamic task offloading between the active MDs and the idle MDs in a D2D–MEC (mobile edge computing) system by deploying multi-agent deep reinforcement learning (DRL) to minimize the long-term average delay of delay-sensitive tasks under deadline constraints. Our core innovation is a dynamic partitioning scheme for idle and active devices in the D2D–MEC system, accounting for stochastic task arrivals and multi-time-slot task execution, which has been insufficiently explored in the existing literature. We adopt a queue-based system to formulate a dynamic task offloading optimization problem. To address the challenges of large action space and the coupling of actions across time slots, we model the problem as a Markov decision process (MDP) and perform multi-agent DRL through multi-agent proximal policy optimization (MAPPO). We employ a centralized training with decentralized execution (CTDE) framework to enable each MD to make offloading decisions solely based on its local system state. Extensive simulations demonstrate the efficiency and fast convergence of our algorithm. In comparison to the existing sub-optimal results deploying single-agent DRL, our algorithm reduces the average task completion delay by 11.0% and the ratio of dropped tasks by 17.0%. Our proposed algorithm is particularly pertinent to sensor networks, where mobile devices equipped with sensors generate a substantial volume of data that requires timely processing to ensure quality of experience (QoE) and meet the service-level agreements (SLAs) of delay-sensitive applications. Full article
(This article belongs to the Section Communications)
Show Figures

Figure 1

18 pages, 6127 KiB  
Article
Fault-Tolerant Optimal Consensus Control for Heterogeneous Multi-Agent Systems
by Yandong Li, Yongan Liu, Ling Zhu and Zehua Zhang
Appl. Sci. 2024, 14(16), 6904; https://doi.org/10.3390/app14166904 - 7 Aug 2024
Viewed by 328
Abstract
This study explores fault-tolerant consensus in leader–following heterogeneous multi-agent systems, focusing on actuator failures in uncrewed aerial vehicles (UAVs) and uncrewed ground vehicles (UGVs). An optimization-based fault-tolerant consensus algorithm is proposed. The algorithm utilizes the Euler–Lagrange formula to ensure system consistency under actuator [...] Read more.
This study explores fault-tolerant consensus in leader–following heterogeneous multi-agent systems, focusing on actuator failures in uncrewed aerial vehicles (UAVs) and uncrewed ground vehicles (UGVs). An optimization-based fault-tolerant consensus algorithm is proposed. The algorithm utilizes the Euler–Lagrange formula to ensure system consistency under actuator failures, with the Lyapunov stability theory proving the asymptotic stability of the consistency error. The algorithm is applied to heterogeneous multi-agent systems of UAVs and UGVs to derive optimal fault-tolerant consensus control laws for each vehicle type. Simulation experiments give evidence for the feasibility of the proposed control strategy. Full article
Show Figures

Figure 1

Back to TopTop