Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Next Article in Journal
A Consolidated Linearised Progressive Flooding Simulation Method for Onboard Decision Support
Previous Article in Journal
Experimental Research on the Low-Cycle Fatigue Crack Growth Rate for a Stiffened Plate of EH36 Steel for Use in Ship Structures
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Three-Dimensional Coverage Path Planning for Cooperative Autonomous Underwater Vehicles: A Swarm Migration Genetic Algorithm Approach

1
Shanghai Key Laboratory of Intelligent Manufacturing and Robotics, Shanghai University, Shanghai 200444, China
2
School of Future Technology, Shanghai University, Shanghai 200444, China
3
School of Department of Automation, Shanghai University, Shanghai 200444, China
*
Author to whom correspondence should be addressed.
J. Mar. Sci. Eng. 2024, 12(8), 1366; https://doi.org/10.3390/jmse12081366
Submission received: 15 July 2024 / Revised: 6 August 2024 / Accepted: 9 August 2024 / Published: 11 August 2024
(This article belongs to the Section Ocean Engineering)

Abstract

:
Cooperative marine exploration tasks involving multiple autonomous underwater vehicles (AUVs) present a complex 3D coverage path planning challenge that has not been fully addressed. To tackle this, we employ an auto-growth strategy to generate interconnected paths, ensuring simultaneous satisfaction of the obstacle avoidance and space coverage requirements. Our approach introduces a novel genetic algorithm designed to achieve equivalent and energy-efficient path allocation among AUVs. The core idea involves defining competing gene swarms to facilitate path migration, corresponding to path allocation actions among AUVs. The fitness function incorporates models for both energy consumption and optimal path connections, resulting in iterations that lead to optimal path assignment among AUVs. This framework for multi-AUV coverage path planning eliminates the need for pre-division of the working space and has proven effective in 3D underwater environments. Numerous experiments validate the proposed method, showcasing its comprehensive advantages in achieving equitable path allocation, minimizing overall energy consumption, and ensuring high computational efficiency. These benefits contribute to the success of multi-AUV cooperation in deep-sea information collection and environmental surveillance.

1. Introduction

The oceans are a treasure trove of underwater resources and hydrographic data. Monitoring water quality at various depths is essential for environmental surveillance, ecological studies, resource discovery, and disaster warning as seen in the methane release from natural gas hydrate extraction [1]. Real-time monitoring helps prevent marine pollution and mitigate geological and meteorological disasters. With growing interest in marine exploration, autonomous underwater vehicles (AUVs) have emerged as efficient tools, offering low energy use, stealth, and maneuverability, and enabling the collection of high-quality, precise data that are difficult to acquire through traditional means [2]. Due to the deep sea’s vastness and complexity, multi-AUV systems have become a leading approach for underwater exploration, enhancing efficiency, coverage, and reducing time costs [3,4].
Finding optimal coverage paths is essential to ensure that multi-AUV systems can explore the entire working area in complex 3D spaces with obstacles [2], a challenge commonly known as the multi-agent coverage path planning (MACPP) problem [5]. Unlike 2D space coverage path planning (CPP) for applications such as unmanned surface vehicles (USVs) scanning, MACPP for AUVs must address three-dimensional spaces with distributed obstacles (usually caused by the irregular sea floor shape) as shown in Figure 1. This task involves multiple requirements: (1) handling complex obstacle avoidance in 3D space, (2) ensuring the coverage of all passable workspaces, (3) minimizing overall energy consumption, and (4) maintaining relatively consistent working paths among agents to optimize the time efficiency of the collective operation. MACPP, which considers only path allocation and spatial coverage, is classified as a non-deterministic polynomial (NP)-hard problem [6]. Considering all these aspects increases the problem’s complexity, which has not yet been fully addressed.
The existing research on CPP problems is summarized in Table 1. Methods for individual agent CPP include the random coverage approach [7], the zig-zag algorithm for round-trip coverage [8], the spanning tree coverage (STC) algorithm [9], the Glasius Bio-inspired Neural Network (GBNN) [10], and reinforcement learning (RL) [11]. Except for the random method, all these methods have been extended to MACPP applications. An extended idea involves environment representation methods, which divide the workspace into several independent parts according to the number of agents, and then solve the problem using single-agent CPP in each area. The related works, for example, include using space division methods combining zig-zag algorithms [12] or STC [13,14,15]. Another category is agent dynamic interaction methods, where each agent strategically determines its path based on individual goals, interaction with others, and the environment. This includes GBNN [16] and multi-agent reinforcement learning (MARL) [17,18] methods.
Table 1 compares the ability of these methods to address the four requirements of 3D MACPP mentioned in this paper. Overall, no single method provides a complete solution to this problem. The random, zig-zag, and GBNN methods do not optimize energy consumption or ensure evenly assigned paths. While the spanning tree coverage algorithm addresses even path assignment, it lacks the mathematical foundation to extend a 2D spanning tree to 3D. RL is a promising new tool, but due to its lack of mathematical completeness, it cannot guarantee full coverage of the entire workspace.
This article, therefore, introduces a comprehensive solution for MACPP in 3D space. Specifically, it resolves the MACPP problem for AUVs in underwater environments, considering all four cooperative path planning requirements. The innovative contributions of this paper can be summarized as follows:
(1)
We introduce a novel framework for MACPP that comprises two essential steps: autonomous coverage path growth and path allocation. Instead of first dividing the space, we allow short paths to grow and occupy the entire 3D workspace, which is named the snap coverage trails auto-growth (SCTG) algorithm. Then, we address the path evenness and energy optimization problems by optimizing the path allocation and connection among agents. Consequently, the four requirements are fulfilled through these two separate steps.
(2)
We propose a Swarm Migration Genetic Algorithm (SMGA) to solve the path allocation and connection problem. This innovative genetic algorithm introduces the concept of swarms to the traditional GA. The migration operation among swarms of genes provides a mechanism for multi-agent allocation negotiation. Additionally, to adapt to the path planning problem, a unique double chromosome structure is defined to facilitate the exchange of paths among AUVs. The new migration operation achieves efficient gene flow between different swarms with low computational resource consumption, thereby improving the global convergence ability of the algorithm.
(3)
The aforementioned method is applied to facilitate the collaborative exploration undertaken by multiple AUVs within a 3D underwater environment, improving the adaptability and work efficiency of full coverage path planning in underwater environments. Notably, this marks the first MACPP work conducted in 3D space, to the best knowledge of the authors. Experimental results show that the proposed algorithm effectively solves standard problems, including comprehensive indicators such as overall energy consumption, fair path allocation, and computational efficiency.
The remaining sections of this paper are organized as follows: In Section 2, the related works emphasize the novelty of the proposed algorithms concerning the existing body of research. Section 3 presents the problem formulation of multi-AUV 3D coverage path planning in a complex subsea environment. The multi-AUV 3D CPP based on the snap coverage trails auto-growth (SCTG) algorithm, and the SMGA is discussed in Section 4. Section 5 presents the simulation results and performance comparison. Finally, Section 6 concludes the paper with remarks.

2. Related Works

The CPP problem has received extensive research attention over several decades; it involves generating an optimal path to cover a specific area of interest [19]. In the context of a multi-AUV system, the problem of MACPP can be defined as the generation of a set of paths that can cover all free 3D space and avoid obstacles at the same time, and the paths are to be assigned equally among the agents. The MACPP algorithms in previous studies are typically classified into two categories: environment representation methods and the agent dynamic interaction method [5].

2.1. Environment Representation Methods

Environment representation methods involve initially dividing the work area into several independent parts based on the number of agents, and then solving the problem by using a single-agent CPP in each respective area [20].
In the division of task areas, some researchers have used the Voronoi algorithm [21,22,23] and an improved precise cell decomposition [24] method to divide the entire region into multiple subregions, allowing the agents to complete the coverage task in the assigned subregions, respectively. A similar rectangle decomposition algorithm [25] is proposed for enhancing the speed of region segmentation. However, these partitioning algorithms do not achieve a distribution of the task area on average. The divide areas for multi-robot coverage path planning (DARP) algorithm [26] is proposed as an approach for achieving average partitioning. By continuously iterating the values of the grid evaluation matrix, the algorithm can gradually achieve the goal of achieving an average distribution of regions among multiple agents. However, it is important to note that the different initial positions of the agents significantly impact the speed and effectiveness of the partitioning process.
After partitioning the space, it is essential to strategically plan the path for covering each distinct area block. A large number of researchers have applied the spanning tree coverage (STC) method [9,13,14,15,27] to single-agent CPP after delineating regions. A minimum STC algorithm is then employed to minimize conflicts among the agents [28]. However, this algorithm falls short in achieving the complete coverage of areas such as holes or similar unidirectionally connected spaces. As another widely used algorithm for intra-area coverage, the GBNN algorithm is a biologically inspired neural network CPP algorithm that generates coverage paths by adjusting neuron activity values [2,29,30]. However, when agents encounter consecutive obstacles, a path planned by a human template is necessary to prevent agents from falling into a dead zone.
Environment representation methods ensure comprehensive coverage of the working space and prevent path repetition by constraining agents’ movements to distinct subregions. However, challenges arise due to variations in agent numbers, initial positions, and the intricate distribution of obstacles, making it difficult to achieve consistently reasonable partitioning results. Finding a universally applicable division strategy for all conditions becomes especially challenging, and this difficulty escalates when addressing scenarios in 3D space.

2.2. Agent Dynamic Interaction Methods

The agent dynamic interaction methods are characterized by the real-time coordination of multiple agents, wherein each agent strategically determines its continuous working path based on individual goals and environmental conditions. This continuous path planning enables agents to avoid conflicts and collisions, promoting cooperative and efficient task execution. Some researchers have made enhancements to the GBNN algorithm by incorporating considerations for multiple agents regarding each other as dynamic obstacles [31,32,33]. This allows for the automatic generation of coverage paths within the working area based on the neural network activity values derived from the global map.
In recent years, there has been growing interest in combining collaborative coverage planning problems with reinforcement learning to achieve new breakthroughs [11,17,34]. Some researchers utilize a dual guidance mechanism for area coverage path planning [18]. An approach involves training multiple agents to interact with the target environment using the convolutional neural network (CNN) algorithm. This training allows the agents to achieve the overall area coverage requirement while working together and avoiding conflicts [35]. Reinforcement learning-based path planning algorithms offer advantages such as high adaptability, robustness, and improved performance in uncertain environments. However, these methods typically require a substantial amount of high-quality data for training. Additionally, selecting an appropriate model structure and tuning algorithm hyperparameters significantly increase the complexity of algorithm development and debugging.
In the GBNN algorithm, agents adhere to rule-based behavior, while agents in reinforcement methods acquire appropriate behavior through extensive data learning. Both approaches typically exhibit high execution efficiency. However, reinforcement methods demand substantial training efforts and may exhibit suboptimal performance when applied to environments that differ significantly from their training datasets. In contrast, GBNN, relying on straightforward interactive rules, falls short of meeting the combined requirements, including the evenness of the energy consumption distribution and an overall short working time, in intricate environments.
The framework introduced in this paper shares the inherent logic more akin to that of agent dynamic interaction methods. However, as illustrated in Figure 2, instead of consolidating path generation and allocation into a single step, our approach addresses the path coverage issue through an initial path auto-growth method. Subsequently, path segments are allocated in a second step through negotiation among agents using a newly proposed Swarm Migration Genetic Algorithm. This decouples the MACPP problem, simplifying coverage path generation in 3D space. The optimization, featuring combined objectives such as complete area coverage, high computational efficiency, strong adaptability to complex environments, and improved balance in path assignment and energy consumption, can thus be achieved. The detailed approach for these two steps will be elucidated in Section 4.1 and Section 4.2, respectively.

3. Multi-AUV CPP Problem Formulation

3.1. Problem Statement

The underwater mission environment is a three-dimensional space denoted by , which is discretized into a finite number of ( x , y , z ) coordinates:
= x , y , z : x 0 , l , y 0 , w , z h , 0
where ( x , y , z ) denotes the discrete coordinates, and  ( l , w , h ) represents the length, width, and depth range of the working space, respectively. The obstacles are distributed in a known set O of cells, and the area to be covered is denoted as Π = O .
Assumption 1.
All AUVs covered in this paper are isomorphic agents with an identical detection depth of d p , detection width of d w , and turning radius of d r during the coverage mission.
The impact of layering and gridding, following Assumption 1 within a working space, is depicted in Figure 3. The inter-layer spacing is denoted as d p , and the grid size of the horizontal layers d l is determined by the maximum of d w and d r . Obstacle areas are illustrated in blue cells, while areas to be covered are depicted in flesh-colored cells. Irregularly shaped obstacles are approximated as external cuboids, which may classify some free spaces around the obstacle as impassable. However, this method aligns with the common strategy of expanding obstacle boundaries and map simplification found in many existing studies [2,36].
Assumption 2.
The kinematics and dynamics of the AUVs are designed to accommodate right-angle turns with the selected d l and d p values.
We assume that AUVs can follow the planned paths through right-angle turns in Assumption 2. Similar assumptions were used in previous studies [37,38,39], which tended to prioritize traversability and path length during the path planning phase. To account for kinematic constraints, we consider the AUV turning capability (i.e., the turning radius in all directions) when determining the size of the mapping grid. This ensures that the planned paths align closely with the motion capabilities of the AUV.
Assumption 3.
The battery capacity carried by the AUVs is sufficient to support each round-trip mission from the initial location to the designated operation area. That is, the batteries are able to support the need of the AUVs to continuously consume electrical energy.
As shown in Assumption 3, we assume that the AUVs carry enough battery capacity at a time to support a round-trip mission from the initial location to the designated operational area and reach the scheduled resupply point after completing the tasks.
In the initial phase, our objective is to identify a set of disjoint paths, denoted as snap coverage trails Q, capable of fully covering the unoccupied region within the 3D space as described in Definition 1. Subsequently, these trails must be assigned to the AUVs. Assuming a specific assignment strategy yields M trail groups Q i , i = 1 , , M ; the next step involves determining the optimal sequence for connecting all trails within Q i to construct a continuous operational path P i as described in Definition 2.
Definition 1.
Snap coverage trails Q are a set of short paths that fully cover the free region Π.
Q = Q 1 , Q 2 , , Q M Q 1 Q 2 Q M = Π
where M is the total number of snap coverage trails Q, and  Q M is the M-th trail.
Definition 2.
The planned path P i for the i-th AUV is defined as a sequence of snap coverage trails Q with designated endpoint orders. The trails Q are connected following the designated order shown in Equation (3):
P i = ± Q x 1 , ± Q x 2 , ± Q x n i , i 1 , 2 , , M r
where Q x j Q , j 1 , 2 , , n i represents a trail having the order of endpoints as S 1 x , S 2 x with the sign +, and  S 2 x , S 1 x with the sign −, n i is the number of trails allocated to the i-th AUV, and  M r is the number of AUVs.
Based on the aforementioned definition, the MACPP can be reformulated as a doublefold problem: (1) generate a trail set Q to comprehensively cover all unoccupied space, (2) allocate trails to distinguish AUVs as Q i , i = 1 , , M , and establish the optimal connectivity sequence within Q i to construct a continuous path P i for each AUV. This paper addresses the first problem through a path auto-generation algorithm in Section 4.1, while the second problem is resolved by tackling a constraint multi-objective optimization problem in Section 4.2.

3.2. AUV Energy Consumption Model

The motion of an AUV during task execution comprises three primary modes: horizontal linear movement, vertical jumping, and horizontal steering.
The horizontal linear motion is depicted in Figure 4a, and the energy consumption f a i of the i-th AUV moving from J 1 to J 2 is calculated by the following equation [40]:
f a i = 1 2 ρ C F ( α o ) S x V o 2 d x i + 1 2 ρ C F ( α o ) S y V o 2 d y i
where 1 2 ρ C F ( α o ) S x V o 2 and 1 2 ρ C F ( α o ) S y V o 2 denote the drag force on the i-th AUV in the x and y directions, respectively. ρ denotes the density of seawater; C F ( α o ) represents the resistance coefficient at the angle α c between the drag force and the direction of motion; S x and S y indicate the force-bearing length in the x and y directions, respectively; V o is the velocity of the ocean; d x i represents the distance sailed by the i-th AUV along the x-axis; and d y i represents the distance sailed by the i-th AUV along the y-axis.
The vertical jumping motion is shown in Figure 4b, and the energy consumption of the i-th AUV floating up or sinking from H 1 to H 2 is calculated by the following Equation [39,40,41]:
f b i = λ p 1 2 ρ C F ( β o ) S z V o 2 d z i ± G B d z i
where λ p indicates the energy consumption correction factor of the AUV in different depth scenarios; the first term denotes the drag force on the i-th AUV in the z direction, and the second represents the amount of change in the gravitational potential energy. C F ( β o ) represents the resistance coefficient at the angle β c between the drag force and the direction of motion; S z indicates the force-bearing length in the z directions; G B denotes a combination of the gravity and buoyancy; and d z i represents the distance sailed by the i-th AUV along the z-axis.
The common turning styles mainly include “Flat-shaped”, “U-shaped”, “Bulb-shaped”, and “Hook-shaped” [42]. As illustrated in Figure 4c, we only consider the “U-shaped” turnings in this paper. The following equation is the energy consumption of the turning process for the i-th AUV:
f c i = L T N T i · π d l 2 + d l tan ψ
where ψ is the angle between the guide direction and the boundary,  L T is the single turning path length, and N T i is the number of turns of the i-th AUV.

4. Methodology

4.1. Auto-Growth of the Snap Coverage Trails

Snap coverage trails Q are short paths with a combined complete coverage of the 3D free space. The term “short” is relative to the total continuous path length required for the AUV to accomplish its mission. Considering the complex obstacle distributions in the underwater environment, we design a snap coverage trails auto-growth (SCTG) algorithm for efficient trail generation as depicted at the top of the framework figure in Figure 2. The underwater three-dimensional space is layered according to the detection depth d p , and the trails growth in the k-th layer is shown in Figure 5. Firstly, the lower-left grid is selected as the starting point of the first trail growth. The growth direction of each trail is determined by comparing the values of T x and T y , where T x represents the maximum generatable length in the x-axis direction and T y represents the maximum generatable length in the y-axis direction. If the starting point has T x > T y , the trail grows along the x-axis direction. If the starting point has T x T y , the trail grows along the y-axis direction.
The impassible region Ω k is the union of the k-th layer already grown region A c o v and the obstacle region O k , denoted as Ω k = A c o v O k . For each new generated trail Q n e w , its corresponding region needs to be stored in A c o v , and the range of region Ω k is updated. The current generated trail Q n e w is checked to determine if it fully covers the grid column where the starting point is located. If the column is not fully covered, the first uncovered grid in that column along the y-axis is selected as the new starting point. If the column is fully covered, the first uncovered grid in the next column along the y-axis is selected as the new starting point. The growth direction of the new trails follows the same scheme as mentioned earlier, where the longest side is selected from the x and y axes as the growth direction. When A c o v in each layer of space equals the entire region of free grid cells, the trails stop growing autonomously, and  Ω stops being updated. This marks the completion of the overall growth of snap coverage trails Q in the underwater multi-layer space. The SCTG algorithm is formally presented as shown in Algorithm 1.
Algorithm 1: Snap coverage trails Q auto-growth algorithm.
Jmse 12 01366 i001

4.2. SMGA for Trail Assignment

The remaining problem to be solved is to assign trails to the AUVs from the original set of snap coverage trails Q. The SMGA as illustrated in the lower part of the framework figure in Figure 2 is proposed for solving this path allocation and ordering problem, with the optimal connection described in Section 4.2.2. The specific pseudocode for SMGA has been provided in Algorithm 2.
Algorithm 2: Swarm migration genetic algorithm.
Jmse 12 01366 i002

4.2.1. Chromosomes Design

As illustrated in Figure 6, the basic idea for SMGA is to design a chromosome structure in swarms, and each swarm represents the path cluster for an AUV. The sequence of the genes in a swarm stands for the path connection sequence for the specific AUV.
Correspondingly, each chromosome includes two parts C h r o m _ p and C h r o m _ r . The former includes M r swarms denoted as C h r o m _ p 1 , , C h r o m _ p M r , where C h r o m _ p i is the trail index sequence for the i-th AUV. C h r o m _ r has the same length as C h r o m _ p , and it records the AUV index for each trail in the current chromosome.
A population for the GA consists of multiple chromosomes and can be represented by:
P o p = C h r o m _ p 1 C h r o m _ r 1 C h r o m _ p 2 C h r o m _ r 2 C h r o m _ p N C h r o m _ r N
C h r o m _ p i = [ C h r o m _ p 1 i , , C h r o m _ p M r i ] , i 1 , 2 , , N
where P o p is the overall population, C h r o m _ p i is the trail index, C h r o m _ r i is the arrangement code of the AUV index corresponding to C h r o m _ p i , and N is the number of individuals in the population.
As a result, each row in P o p corresponds to a double-layer chromosome, and individual chromosomes represent information in two aspects: (1) the assignment of the trails Q to different AUVs in the second layer in C h r o m _ r i , and (2) the sequence of the trails Q belonging to an AUV in C h r o m _ p i .

4.2.2. Fitness Function

The fitness function is a crucial metric for evaluating the quality of chromosomes for all swarms. Essentially, it defines the cost function for the multi-AUV CPP problem in Section 3.1. Based on the problem formulation, the fitness function should include the path assignment unevenness and the total energy consumption. During path allocation, the allocation results among AUVs and the system’s overall energy consumption are optimized based on the fitness function, iteratively. When the fitness function converges to a minimum value, it indicates that the allocation evenness and energy consumption have reached optimal levels, resulting in a cooperative win for the agents.
The balance of the snap coverage trails Q i allocation is represented by their variations in paths P i . For a given chromosome, the sequence of the trails in one swarm is determined. However, the endpoint connection sequence is not fixed, and we need to obtain the optimal connectivity for the planned paths P i of each AUV. As shown in Figure 7, the connection sequence of the endpoints between two neighbor trails can affect the total path length.
We construct a dynamic programming problem to find the best connection method of the endpoints for a given trail sequence. The state transition equations are defined in Equations (9) and (10). The two states for the p-th trail connection are defined as d [ 1 , p ] and d [ 2 , p ] . They represent the travel cost of connecting S 1 p or S 2 p . d i s ( · , · ) is the distance between two endpoints. With the state equations defined above, dynamic programming can be applied to find the endpoint sequence with the smallest travel cost, which can be calculated by Equation (11):
d [ 1 , p ] = min ( d i s ( S 1 p , S 1 p 1 ) + d [ 2 , p 1 ] , d i s ( S 1 p , S 2 p 1 ) + d [ 1 , p 1 ] )
d [ 2 , p ] = min ( d i s ( S 2 p , S 1 p 1 ) + d [ 2 , p 1 ] , d i s ( S 2 p , S 2 p 1 ) + d [ 1 , p 1 ] )
P i = min ( d [ 1 , n i ] , d [ 2 , n i ] )
where n i is the number of trails allocated to the i-th AUV, and P i represents the path length for each AUV.

4.2.3. Swarm Migration Operations

Then, the constraints for the optimization problem in Section 3.1 are given as Equation (12). The first condition ensures that no trail is assigned to more than one AUV, and the second condition ensures that all the trails Q are assigned:
P i P j = , i , j 1 , 2 , , M r P 1 P 2 P M r = Q
The optimization problem’s cost function accounts for two key practical considerations. First, it aims to conserve the operational energy of the AUVs. Second, it seeks to achieve a balanced distribution of the working path among the AUVs. This not only reduces their collaborative working time but also ensures the optimal designation of the trail connection sequence. It is formulated by Equation (13):
F = ω 1 · i = 1 M r E c i + ω 2 · 1 M r i = 1 M r P i 1 M r i = 1 M r P i 2
where ω i are the weight factors. The first term is the total energy consumption, and the second term evaluates the path length inequality among the AUVs. E c i and P i can be calculated from Equations (11) and (14), respectively.
E c i = f a i + f b i + f c i , i 1 , 2 , , M r
where E c i represents the task energy consumption of the i-th AUV, and f a i , f b i , and f c i are calculated by Equations (4)–(6), respectively.

4.2.4. Population Initialization

SMGA exhibits a higher diversity of chromosomes and faces greater challenges in achieving convergence compared to the single-population genetic algorithm. Therefore, in this paper, we use an enhanced K-means algorithm to assign trails for the initialization of the swarms. The coordinates of endpoints for all trails Q can be obtained through the work in Section 4.1. With these endpoint coordinates, the distance matrix between different endpoints can be calculated. In accordance with Figure 7, 4 different ways to connect two trails that do not include the starting point are identified. The sum of the distances between the 4 endpoints is taken, and by averaging them, the average distance between the two trails can be obtained. By iterating this process for all trails Q, the overall average distance matrix for trails can be calculated. To obtain a relatively good initial population chromosome using the K-means algorithm, the average distance matrix and M r can be used as inputs. The K-means algorithm can be applied to cluster the trails Q based on their distance matrix, and the resulting clusters can be used to initialize the chromosomes of the population. This way, a relatively good initial population chromosome for further genetic operations can be obtained.
Some nature species exhibit behavior for individuals moving from one swarm to another. For instance, in certain bird species, individuals may leave their original flock and join another flock to seek better feeding opportunities or find a more suitable breeding partner. Inspired by such behavior, we propose a swarm migration algorithm that mimics this behavior. Genetic operations in SMGA mainly include operations such as selection, variation, migration, and crossover. The selection and variation operations are similar to traditional GA and are not elaborated here. The migration and crossover operations involve swarm interactions and are explained in detail below.
Migration encourages individuals to move among swarms. For the MACPP problem, it corresponds to changing the assignment of some trails from one AUV to another. As illustrated in Figure 6, the first step in the migration operation is to find the swarms that need to be operated. In this article, we compare the total path lengths for each swarm. The one with the longest path is considered too crowded, and some individuals should migrate to the swarm with the shortest path length. In the second step, some individuals are selected for migration. The migrants are chosen such that their length is closest in the swarm to the difference between the longest and average path lengths.
Crossover is the basic genetic operation of the traditional GA and is widely used in single swarm operations. However, in SMGA, the interactions between chromosomes of different swarms must be considered. As shown in Figure 8, a division operation is performed on the chromosomes of different individuals performing crossovers. Two parent chromosomes are copied and the selected swarm is exchanged at the crossover point. Gene conflicts are handled between the remaining swarms by filling in missing or duplicate entities in order. If the offspring chromosomes need to add new entities to complete, we follow the principle of maintaining the swarm and add the entities to the original swarm to which they belong as shown in chromosome C l d 2 in Figure 8 with (6,3).

5. Experimental Results and Discussion

In the ensuing sections, we undertake three categories of experiments: the 3D MACPP performance evaluation, ablation experiments, and comparative experiments. For the 3D MACPP tests, we utilize two distinct three-dimensional underwater maps to assess the efficacy of our SCTG-SMGA algorithm. Following that, three sets of ablation experiments are carried out to assess the performance variations of the SCTG-SMGA algorithm under different configurations of critical parameters. Lastly, we benchmark the performance of the SCTG-SMGA algorithm against two previous MACPP methods. The methodologies are executed in Matlab R2022b software on a computer equipped with an Intel®Xeon® 8124 M 3.00 GHz CPU and 256 GB of memory.

5.1. Performance Validation Experiments

The relevant experimental parameters for the 3D MACPP tests are detailed in Table 2. The values of the energy consumption parameters, including ρ , C F ( α o ) , C F ( β o ) , S x , S y , S z , V o , and G B are sourced from the literature [40,41]. The AUV optimal detection ranges d l and d p are defined based on the findings presented in [43]. The values of ω 1 and ω 2 were determined through sensitivity analyses, and fine-tuning efforts were applied to strike a balance between path allocation and total energy consumption. We seek to minimize the overall energy consumption while maintaining the balance of assigning paths among the agents, so the weight of ω 1 is generally taken to be higher than that of ω 2 .
As depicted in Figure 9a,b, our study employs two distinct 3D underwater maps to evaluate the SCTG-SMGA algorithm. First, 3D Map1 presents a complex environment with numerous obstacles, while 3D Map2 features a more scattered small obstacle scenario with more passable spaces. Figure 10a,b showcase the SCTG-SMGA algorithm’s three-dimensional coverage path planning outcomes for scenarios with 3 and 6 agents in 3D Map1, and Figure 10c,d depict the corresponding results in 3D Map2. There are a total of 6 vertical layers in both maps. With 3 agents, we observe the interlacement of paths by different agents within the same layer, ensuring a balanced distribution of paths. However, with 6 agents, the algorithm tends to assign one agent to each layer to prevent inter-layer jumping, thus minimizing the overall energy consumption.
The raw data containing path lengths, energy consumption, and algorithm execution time are presented in Table 3. From the average values, path allocation for 3 agents is evenly distributed in both maps, but the balance diminishes with 6 agents due to the algorithm favoring minimizing total energy cost by avoiding inter-layer jumps. Total energy consumptions are comparable for both 3 and 6 agent scenarios. Map2 requires slightly more energy for full exploration due to its larger open spaces. The converge time costs for 3-agent cases are 53.69% and 56.76% of the 6-agent cases for Maps 1 and 2, respectively, suggesting a nearly proportional relationship between the number of agents and algorithm running time. In summary, the SCTG-SMGA successfully accomplished its role in achieving balanced and efficient path planning among AUVs within intricate 3D environments.

5.2. Ablation Experiments

This study conducts three sets of ablation experiments to evaluate how the performance of SCTG-SMGA varies with changes in the parameters. The experiments MACPP with 3 agents are carried out under different conditions, including variations in depth coefficients ( λ p ), the presence or absence of swarm clustering initialization, and different numbers of migration paths.
The parameter λ p denotes the cost associated with inter-layer jumping. MACPP results for the two 3D maps with λ p values of 50, 500, and 5000 are depicted in Figure 11 and Table 4. As λ p increases, the SCTG-SMGA algorithm tends to reduce inter-layer jumps to prevent a significant increase in the total energy costs. Consequently, with λ p assigned a very large value of 5000, the algorithm allocates two neighboring layers for each AUV to avoid any unnecessary jumps.
The MACPP for 3D Map1 with and without swarm clustering initialization (as in Section 4.2.4) and the corresponding convergence curves are depicted in Figure 12. Convergence of the SMGA is considered achieved when the difference in F between iterations is less than 0.08 of its own value. When swarm clustering is initialized, the algorithm converges at the 1043th iteration with a fitness value of 123.67. Without swarm clustering initialization, convergence occurs at the 1508th iteration with a fitness value of 158.53. The final fitness value with clustering initialization is 78.01% of the convergence value without initialization clustering, with a convergence speed that is 30.84% higher. Similarly, the results of three-dimensional coverage path planning are presented for 3D Map2 with and without swarm clustering initialization in Figure 13. The trends align with the performance for 3D Map1, achieving a fitness value of 67.96% and 45.60% fewer converging iterations when incorporating clustering initialization. The initialization considerably decreases the number of iterations to converge and improves the final performance.
The migration number among swarms in the SMGA is the final parameter under examination. In Figure 14, the MACPP results for 3D Map1 with migration path numbers 1 and 5 are depicted in (a) and (b), respectively, with corresponding convergence curves in (c) and (d). Similarly, Figure 15 shows the MACPP results for 3D Map2 with migration path numbers 1 and 5 in (a) and (b), with corresponding convergence curves in (c) and (d). For both maps, the impact of elevating the migration number from 1 to 5 is uniform: it expedites the convergence speed by 61.79% and 29.10%, respectively, concurrently elevating the final fitness value by 6.06% and 9.6%, respectively. This aligns with the expectation that a higher migration number accelerates the allocation of entities among different swarms. However, it also compromises some capacity for nuanced adjustments, resulting in a slightly larger final fitness value.

5.3. Comparative Experiments

Due to the absence of existing research on MACPP methods specifically tailored for 3D environments, comparative experiments must be conducted in 2D complex maps. We have selected GBNN [29] and DARP-STC [26] algorithms for comparison. GBNN is an innovative bio-inspired CPP algorithm recognized for its rapid computational speed. DARP-STC is widely employed in 2D CPP due to its superior multi-agent balanced allocation. As illustrated in Figure 16, this paper presents three sets of comparative experiments for the algorithm, involving non-concave 2D maps with varying obstacle distributions, including hollow shapes and narrow connections.
The coverage path generation outcomes for the SCTG-SMGA, GBNN, and DARP-STC algorithms with 3, 4, and 5 agents are depicted in Figure 17, Figure 18 and Figure 19, respectively. The paths generated by the SCTG-SMGA algorithm demonstrate a more evenly distributed coverage compared to the GBNN algorithm and notably involve fewer turns compared to the DARP-STC algorithm.
Quantitative results concerning the path length, number of turns, and energy consumption for the three algorithms are summarized in Table 5. The SCTG-SMGA algorithm offers substantial advantages in minimizing the overall energy consumption of tasks. Across all map scenarios, SCTG-SMGA exhibits the lowest total energy consumption (with marginal differences of 0.5% in 2D Map3, slightly trailing the GBNN algorithm). Its average task energy consumption is 97.38% and 93% of the other two methods. Despite not explicitly optimizing for energy consumption evenness, the proposed algorithm achieves the minimum standard deviation in energy distribution among agents in the majority of scenarios.
When multi-AUVs collaborate to perform coverage tasks, the balanced allocation paths among the agents are maintained under the premise of minimizing the overall energy consumption so as to achieve maximization of the overall efficiency of the multi-AUV system. Achieving minimal energy use with a relatively balanced path distribution is particularly crucial for underwater missions where the AUVs have limited onboard energy resources. In terms of path length, SCTG-SMGA maintains a favorable balance among AUVs, with an average standard deviation of 467 m, representing only 0.017% of the total path length. DARP-STC demonstrates exceptional performance in evenly allocating the path to different AUVs, with a path length standard deviation of only 157 m. However, this achievement comes at the cost of significantly higher energy consumption, introducing a total energy 7.04% higher than SCTG-SMGA due to a large number of turning actions. On the other hand, GBNN exhibits a path length standard deviation as large as 3.89 × 10 5 m, which could result in unbalanced workloads and low overall working efficiency during multi-AUV cooperation. Overall, SCTG-SMGA demonstrates impressive performance in both path allocation evenness and total energy savings, making it a compelling choice as a planner for multi-AUV cooperation.
In terms of computational time costs, SCTG-SMGA exhibits the most efficient performance, outperforming in five out of nine tests. Its time costs display a nearly linear correlation with the number of agents. Known for swift execution, GBNN remains highly competitive with our SCTG-SMGA method, showing only a modest 1.80% increase in the average time cost. Conversely, DARP-STC not only has significantly longer time consumption than the other two but also exhibits heightened sensitivity to both map configurations and initial agent conditions. The longest runtime, 60.89 s, is recorded on 2D Map2 for four agents, despite not having the largest agent count in the tests. In summary, SCTG-SMGA achieves commendable performance with minimal time cost in most cases.
Overall, experiments demonstrate that SCTG-SMGA achieves a better balance between path allocation and energy optimization. On the contrary, the optimization objectives of GBNN and DARP-STC align with the energy consumption and path allocation evenness factors in this study, respectively. While GBNN often achieves optimal energy consumption, its path allocation is highly inefficient, potentially leading to system inefficiencies. Conversely, DARP-STC ensures even path distribution but results in numerous turns, increasing energy consumption. Additionally, SCTG-SMGA generally outperforms in algorithmic running time. However, due to the stochastic nature of genetic algorithms, SCTG-SMGA may yield different results when run multiple times. Typically, it provides good planning results, but in the event of an anomaly where the algorithm converges to a local minimum, it may be necessary to adjust key GA parameters to achieve better outcomes.

6. Conclusions

This paper presents a comprehensive solution for the MACPP problem in the challenging marine domain of 3D underwater space, specifically focusing on AUV applications. The introduced framework, consisting of autonomous coverage path growth and path allocation, adeptly addresses the intricate challenges posed by multi-agent cooperative path planning in complex underwater environments. The SMGA is introduced as an innovative approach, showcasing its effectiveness in optimizing both the allocation and intelligent connectivity of multi-agent coverage paths. The algorithm’s incorporation of a novel migration operation, along with path clustering in the initialization phase, contributes to improved convergence capabilities.
The experimental application of the proposed method to the cooperative exploration task of multiple AUVs in a 3D underwater environment demonstrates its effectiveness in considering comprehensive metrics, including overall energy consumption, path allocation balance, and computational efficiency. The results indicate a significant reduction in task energy consumption when compared with previous works, highlighting the algorithm’s efficiency under varying map complexities. Furthermore, ablation experiments are conducted to explore the algorithm’s sensitivity to parameter variations, shedding light on the impact of depth coefficients, swarm clustering initialization, and the number of migration paths. These experiments provide valuable insights into the algorithm’s robustness and performance under different conditions. Comparative experiments with existing methods, including GBNN and DARP-STC, showcase the superiority of the proposed SCTG-SMGA algorithm in achieving a balanced path allocation among AUVs, minimizing energy consumption, and demonstrating competitive computational efficiency. However, due to the stochastic nature of genetic algorithms, SCTG-SMGA may yield different results when run multiple times. Typically, it provides good planning results, but in the event of an anomaly where the algorithm converges to a local minimum, it may be necessary to adjust key GA parameters to achieve better outcomes.
In summary, this paper contributes to the field of multi-agent cooperative path planning in 3D underwater environments. In addition, the proposed framework and algorithm offer a practical and efficient solution to challenges beyond multi-AUV underwater missions, such as more general task allocation problems. In future work, the proposed framework and algorithm can be extended to address broader challenges beyond multi-AUV underwater missions. For instance, with a modified fitness model and path generation mechanism that interacts with the environment, this method could enable rapid path replanning for clusters of unmanned systems in dynamic environments.

Author Contributions

Conceptualization, Y.X. and H.S.; methodology, Y.X.; software, W.H. and D.Z.; validation, W.H. and D.Z.; formal analysis, Y.X. and W.H.; investigation, Y.X. and W.H.; resources, Y.X.; data curation, Y.X. and W.H.; writing—original draft preparation, Y.X. and W.H.; writing—review and editing, Y.X., W.H. and H.S.; visualization, W.H. and D.Z.; supervision, Y.X. and H.S.; project administration, Y.X. and H.S.; funding acquisition, Y.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China (Grant No. 2021YFC2803003), and the National Natural Science Foundation of China (Grant No. 62173220).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The link to our data can be found at: https://github.com/Atlantis-piao/3D-MACPP-Data (accessed on 8 August 2024).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Chen, L.; Feng, Y.; Kogawa, T.; Okajima, J.; Komiya, A.; Maruyama, S. Construction and simulation of reservoir scale layered model for production and utilization of methane hydrate: The case of nankai trough japan. Energy 2018, 143, 128–140. [Google Scholar] [CrossRef]
  2. Cai, W.; Zhang, S.; Zhang, M.; Wang, C. Improved binn based underwater topography scanning coverage path planning for auv in internet of underwater things. IEEE Internet Things J. 2023, 10, 18375–18386. [Google Scholar] [CrossRef]
  3. Xin, B.; Zhang, J.; Chen, J.; Wang, Q.; Qu, Y. Overview of research on transformation of multi-auv formations. Complex Syst. Model. Simul. 2021, 1, 1–14. [Google Scholar] [CrossRef]
  4. Hadi, B.; Khosravi, A.; Sarhadi, P. Cooperative motion planning and control of a group of autonomous underwater vehicles using twin-delayed deep deterministic policy gradient. Appl. Ocean Res. 2024, 147, 103977. [Google Scholar] [CrossRef]
  5. Almadhoun, R.; Taha, T.; Seneviratne, L.; Zweiri, Y. A survey on multi-robot coverage path planning for model reconstruction and mapping. SN Appl. Sci. 2019, 1, 847. [Google Scholar] [CrossRef]
  6. Kong, C.S.; Peng, N.A.; Rekleitis, I. Distributed coverage with multi-robot system. In Proceedings of the 2006 IEEE International Conference on Robotics and Automation (ICRA 2006), Orlando, FL, USA, 15–19 May 2006; pp. 2423–2429. [Google Scholar]
  7. Hideg, A.; Blázovics, L. Area coverage using distributed randomized methods. In 2016 Cybernetics & Informatics (K&I); IEEE: Piscataway, NJ, USA, 2016; pp. 1–5. [Google Scholar]
  8. Jia, D.; Wermelinger, M.; Diethelm, R.; Krüsi, P.; Hutter, M. Coverage path planning for legged robots in unknown environments. In Proceedings of the 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), Lausanne, Switzerland, 23–27 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 68–73. [Google Scholar]
  9. Gabriely, Y.; Rimon, E. Spanning-tree based coverage of continuous areas by a mobile robot. Ann. Math. Artif. Intell. 2001, 31, 77–98. [Google Scholar] [CrossRef]
  10. Sun, B.; Zhu, X.; Zhang, W.; Zhu, D.; Chu, Z. Three dimensional auv complete coverage path planning with glasius bio-inspired neural network. In Proceedings of the International Conference on Intelligent Robotics and Applications, Newcastle, NSW, Australia, 9–11 August 2018; Springer: Cham, Switzerland, 2018; pp. 125–136. [Google Scholar]
  11. Wu, J.; Cheng, L.; Chu, S.; Song, Y. An autonomous coverage path planning algorithm for maritime search and rescue of persons-in-water based on deep reinforcement learning. Ocean Eng. 2024, 291, 116403. [Google Scholar] [CrossRef]
  12. Fevgas, G.; Lagkas, T.; Argyriou, V.; Sarigiannidis, P. Coverage path planning methods focusing on energy efficient and cooperative strategies for unmanned aerial vehicles. Sensors 2022, 22, 1235. [Google Scholar] [CrossRef] [PubMed]
  13. Agmon, N.; Hazon, N.; Kaminka, G.A. Constructing spanning trees for efficient multi-robot coverage. In Proceedings of the 2006 IEEE International Conference on Robotics and Automation, Orlando, FL, USA, 15–19 May 2006; pp. 1698–1703. [Google Scholar]
  14. Gao, G.-Q.; Xin, B. A-stc: Auction-based spanning tree coverage algorithm formotion planning of cooperative robots. Front. Inf. Technol. Electron. Eng. 2019, 20, 18–31. [Google Scholar] [CrossRef]
  15. Lu, J.; Zeng, B.; Tang, J.; Lam, T.L. Tmstc*: A turn-minimizing algorithm for multi-robot coverage path planning. arXiv 2022, arXiv:2212.02231. [Google Scholar] [CrossRef]
  16. Zhu, D.; Tian, C.; Jiang, X.; Luo, C. Multi-auvs cooperative complete coverage path planning based on gbnn algorithm. In Proceedings of the 2017 29th Chinese Control and Decision Conference (CCDC), Chongqing, China, 28–30 May 2017; IEEE: Piscataway, NJ, USA, 2017; pp. 6761–6766. [Google Scholar]
  17. Xing, B.; Wang, X.; Liu, Z. The wide-area coverage path planning strategy for deep-sea mining vehicle cluster based on deep reinforcement learning. J. Mar. Sci. Eng. 2024, 12, 316. [Google Scholar] [CrossRef]
  18. Liu, Y.; Hu, J.; Dong, W. Decentralized coverage path planning with reinforcement learning and dual guidance. arXiv 2022, arXiv:2210.07514. [Google Scholar]
  19. Cabreira, T.M.; Brisolara, L.B.; Paulo, F.J.R. Survey on coverage path planning with unmanned aerial vehicles. Drones 2019, 3, 4. [Google Scholar] [CrossRef]
  20. Zhao, L.; Bai, Y. Energy efficient coverage path planning for usv-assisted inland bathymetry under current effects: An analysis on sweep direction. Ocean Eng. 2024, 305, 117910. [Google Scholar] [CrossRef]
  21. Fang, C.; Anstee, S. Coverage path planning for harbour seabed surveys using an autonomous underwater vehicle. In Proceedings of the Oceans’10 IEEE, Sydney, NSW, Australia, 24–27 May 2010. [Google Scholar]
  22. Nair, V.G.; Guruprasad, K.R. Gm-vpc: An algorithm for multi-robot coverage of known spaces using generalized voronoi partition. Robotica 2020, 38, 845–860. [Google Scholar] [CrossRef]
  23. Li, L.; Li, Y.; Wang, Y.; Xu, G.; Wang, H.; Gao, P.; Feng, X. Multi-auv coverage path planning algorithm using side-scan sonar for maritime search. Ocean Eng. 2024, 300, 117396. [Google Scholar]
  24. Chen, G.; Shen, Y.; Duan, X.; Wan, J.; Yan, T.; He, B. Coverage path planning based on improved exact cellular decomposition method in ocean survey. In Proceedings of the Global Oceans 2020: Singapore–US Gulf Coast, Biloxi, MS, USA, 5–30 October 2020. [Google Scholar]
  25. Li, W.-H.; Zhao, T.; Dian, S.-Y. A multi-robot coverage path planning method based on genetic algorithm. In Proceedings of the 2021 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC), Chengdu, China, 18–20 June 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 13–18. [Google Scholar]
  26. Kapoutsis, A.C.; Chatzichristofis, S.A.; Kosmatopoulos, E.B. Darp: Divide areas algorithm for optimal multi-robot coverage path planning. J. Intell. Robot. Syst. 2017, 86, 663–680. [Google Scholar] [CrossRef]
  27. Luo, H.; Lin, H.; Zhu, T.; Kang, Z. Complete coverage path planning of uuv for marine mine countermeasure using grid division and spanning tree. In Proceedings of the 2019 Chinese Control And Decision Conference (CCDC), Nanchang, China, 3–5 June 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 5016–5021. [Google Scholar]
  28. Tang, J.; Sun, C.; Zhang, X. Mstc: Multi-robot coverage path planning under physical constrain. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021; pp. 2518–2524. [Google Scholar]
  29. Zhu, D.; Tian, C.; Sun, B.; Luo, C. Complete coverage path planning of autonomous underwater vehicle based on gbnn algorithm. J. Intell. Robot. Syst. 2019, 94, 237–249. [Google Scholar] [CrossRef]
  30. Tang, F. Coverage path planning of unmanned surface vehicle based on improved biological inspired neural network. Ocean Eng. 2023, 278, 114354. [Google Scholar] [CrossRef]
  31. Muthugala, M.A.V.J.; Samarakoon, S.M.B.P.; Elara, M.R. Toward energy-efficient online complete coverage path planning of a ship hull maintenance robot based on glasius bio-inspired neural network. Expert Syst. Appl. 2022, 187, 115940. [Google Scholar]
  32. Gao, L.; Lv, W.; Yan, X.; Han, Y. Complete coverage path planning algorithm based on energy compensation and obstacle vectorization. Expert Syst. Appl. 2022, 203, 117495. [Google Scholar] [CrossRef]
  33. Yi, L.; Wan, A.Y.S.; Le, A.V.; Hayat, A.A.; Tang, Q.R.; Mohan, R.E. Complete coverage path planning for reconfigurable omni-directional mobile robots with varying width using gbnn(n). Expert Syst. Appl. 2023, 228, 120349. [Google Scholar] [CrossRef]
  34. Wu, G.; Wang, M.; Guo, L. Complete coverage path planning based on improved genetic algorithm for unmanned surface vehicle. J. Mar. Sci. Eng. 2024, 12, 1025. [Google Scholar] [CrossRef]
  35. Jonnarth, A.; Zhao, J.; Felsberg, M. End-to-end reinforcement learning for online coverage path planning in unknown environments. arXiv 2023, arXiv:2306.16978. [Google Scholar]
  36. Zhang, Y.; Wang, Q.; Shen, Y.; Wang, T.; Dai, N.; He, B. Multi-auv cooperative search method based on dynamic optimal coverage. Ocean Eng. 2023, 288, 116168. [Google Scholar] [CrossRef]
  37. Zeng, Z.; Lian, L.; Sammut, K.; He, F.; Tang, Y.; Lammas, A. A survey on path planning for persistent autonomy of autonomous underwater vehicles. Ocean Eng. 2015, 110, 303–313. [Google Scholar] [CrossRef]
  38. Zhan, B.; An, S.; He, Y.; Wang, L. Three-dimensional path planning for auvs based on standard particle swarm optimization algorithm. J. Mar. Sci. Eng. 2022, 10, 1253. [Google Scholar] [CrossRef]
  39. Cheng, C.; Sha, Q.; He, B.; Li, G. Path planning and obstacle avoidance for auv: A review. Ocean Eng. 2021, 235, 109355. [Google Scholar] [CrossRef]
  40. Du, X.; Chen, D.; Yan, Z. Research on control method of unmanned underwater vehicle dynamic positioning based on energy consumption optimization. Int. J. Adv. Robot. Syst. 2020, 17, 1729881420933835. [Google Scholar] [CrossRef]
  41. Fossen, T.I. Handbook of Marine Craft Hydrodynamics and Motion Control; John Wiley & Sons: Hoboken, NJ, USA, 2011. [Google Scholar]
  42. Jin, J.; Tang, L. Coverage path planning on three-dimensional terrain for arable farming. J. Field Robot. 2011, 28, 424–440. [Google Scholar] [CrossRef]
  43. Yordanova, V.; Gips, B. Coverage path planning with track spacing adaptation for autonomous underwater vehicles. IEEE Robot. Autom. Lett. 2020, 5, 4774–4780. [Google Scholar] [CrossRef]
Figure 1. Multi-AUVs carrying out marine exploration tasks in deep-sea 3D environment. The red arrows indicate the path of the AUVs’ motion.
Figure 1. Multi-AUVs carrying out marine exploration tasks in deep-sea 3D environment. The red arrows indicate the path of the AUVs’ motion.
Jmse 12 01366 g001
Figure 2. A novel framework for MACPP in a 3D multi-layer space.
Figure 2. A novel framework for MACPP in a 3D multi-layer space.
Jmse 12 01366 g002
Figure 3. Effect of space layering and gridding.
Figure 3. Effect of space layering and gridding.
Jmse 12 01366 g003
Figure 4. Energy consumption models for AUVs in different modes. (a) Energy consumption analysis of the AUV in the x and y directions, and (b) in z direction. (c) Energy consumption analysis of AUV in a single turn.
Figure 4. Energy consumption models for AUVs in different modes. (a) Energy consumption analysis of the AUV in the x and y directions, and (b) in z direction. (c) Energy consumption analysis of AUV in a single turn.
Jmse 12 01366 g004
Figure 5. The process of autonomous growth in snap coverage trails Q k in the k-th layer. (ah) present the generation results of each trail.
Figure 5. The process of autonomous growth in snap coverage trails Q k in the k-th layer. (ah) present the generation results of each trail.
Jmse 12 01366 g005
Figure 6. Schematics of multiple swarm migration operator.
Figure 6. Schematics of multiple swarm migration operator.
Jmse 12 01366 g006
Figure 7. Ordering of trails and sequence of all possible endpoint connections.
Figure 7. Ordering of trails and sequence of all possible endpoint connections.
Jmse 12 01366 g007
Figure 8. Schematics of multiple swarm crossover operator.
Figure 8. Schematics of multiple swarm crossover operator.
Jmse 12 01366 g008
Figure 9. Two maps, (a) 3D Map1 and (b) 3D Map2, for 3D MACPP tests.
Figure 9. Two maps, (a) 3D Map1 and (b) 3D Map2, for 3D MACPP tests.
Jmse 12 01366 g009
Figure 10. The coverage path planning results for three and six agents under the 3D maps. (a) Coverage path results for three agents in 3D Map1. (b) Coverage path results for six agents in 3D Map1. (c) Coverage path results for three agents in 3D Map2. (d) Coverage path results for six agents in 3D Map2.
Figure 10. The coverage path planning results for three and six agents under the 3D maps. (a) Coverage path results for three agents in 3D Map1. (b) Coverage path results for six agents in 3D Map1. (c) Coverage path results for three agents in 3D Map2. (d) Coverage path results for six agents in 3D Map2.
Jmse 12 01366 g010
Figure 11. The coverage path planning results for three agents under different λ p in 3D maps. (a) Coverage path results for λ p = 50 in 3D Map1. (b) Coverage path results for λ p = 500 in 3D Map1. (c) Coverage path results for λ p = 5000 in 3D Map1. (d) Coverage path results for λ p = 50 in 3D Map2. (e) Coverage path results for λ p = 500 in 3D Map2. (f) Coverage path results for λ p = 5000 in 3D Map2.
Figure 11. The coverage path planning results for three agents under different λ p in 3D maps. (a) Coverage path results for λ p = 50 in 3D Map1. (b) Coverage path results for λ p = 500 in 3D Map1. (c) Coverage path results for λ p = 5000 in 3D Map1. (d) Coverage path results for λ p = 50 in 3D Map2. (e) Coverage path results for λ p = 500 in 3D Map2. (f) Coverage path results for λ p = 5000 in 3D Map2.
Jmse 12 01366 g011
Figure 12. The coverage path planning results and convergence curve for three agents under 3D Map1 with and without initialization of the swarm clustering. (a) Coverage path results with initialization of the swarm clustering. (b) Coverage path results without initialization of the swarm clustering. (c) Convergence curve with initialization of the swarm clustering. (d) Convergence curve without initialization of the swarm clustering.
Figure 12. The coverage path planning results and convergence curve for three agents under 3D Map1 with and without initialization of the swarm clustering. (a) Coverage path results with initialization of the swarm clustering. (b) Coverage path results without initialization of the swarm clustering. (c) Convergence curve with initialization of the swarm clustering. (d) Convergence curve without initialization of the swarm clustering.
Jmse 12 01366 g012
Figure 13. The coverage path planning results and convergence curve for three agents under 3D Map2 with and without initialization of the swarm clustering. (a) Coverage path results with initialization of the swarm clustering. (b) Coverage path results without initialization of the swarm clustering. (c) Convergence curve with initialization of the swarm clustering. (d) Convergence curve without initialization of the swarm clustering.
Figure 13. The coverage path planning results and convergence curve for three agents under 3D Map2 with and without initialization of the swarm clustering. (a) Coverage path results with initialization of the swarm clustering. (b) Coverage path results without initialization of the swarm clustering. (c) Convergence curve with initialization of the swarm clustering. (d) Convergence curve without initialization of the swarm clustering.
Jmse 12 01366 g013
Figure 14. The coverage path planning results and convergence curve for three agents under 3D Map1 with different numbers of migration paths. (a) Coverage path results with 1 migration path. (b) Coverage path results with 5 migration paths. (c) Convergence curve with 1 migration path. (d) Convergence curve with 5 migration paths.
Figure 14. The coverage path planning results and convergence curve for three agents under 3D Map1 with different numbers of migration paths. (a) Coverage path results with 1 migration path. (b) Coverage path results with 5 migration paths. (c) Convergence curve with 1 migration path. (d) Convergence curve with 5 migration paths.
Jmse 12 01366 g014
Figure 15. The coverage path planning results and convergence curve for three agents under 3D Map2 with different numbers of migration paths. (a) Coverage path results with 1 migration path. (b) Coverage path results with 5 migration paths. (c) Convergence curve with 1 migration path. (d) Convergence curve with 5 migration paths.
Figure 15. The coverage path planning results and convergence curve for three agents under 3D Map2 with different numbers of migration paths. (a) Coverage path results with 1 migration path. (b) Coverage path results with 5 migration paths. (c) Convergence curve with 1 migration path. (d) Convergence curve with 5 migration paths.
Jmse 12 01366 g015
Figure 16. Three categories of comparative experimental maps: (a) 2D Map1, (b) 2D Map2, and (c) 2D Map3.
Figure 16. Three categories of comparative experimental maps: (a) 2D Map1, (b) 2D Map2, and (c) 2D Map3.
Jmse 12 01366 g016
Figure 17. The results of coverage by three agents under different algorithms in 2D Map1. The first column (a,d,g) displays the path results of our algorithm under 3, 4, and 5 agents respectively. The second (b,e,h) and third columns (c,f,i) show the path results of the GBNN and DARP-STC algorithms accordingly.
Figure 17. The results of coverage by three agents under different algorithms in 2D Map1. The first column (a,d,g) displays the path results of our algorithm under 3, 4, and 5 agents respectively. The second (b,e,h) and third columns (c,f,i) show the path results of the GBNN and DARP-STC algorithms accordingly.
Jmse 12 01366 g017
Figure 18. The results of coverage by three agents under different algorithms in 2D Map2. The first column (a,d,g) displays the path results of our algorithm under 3, 4, and 5 agents respectively. The second (b,e,h) and third columns (c,f,i) show the path results of the GBNN and DARP-STC algorithms accordingly.
Figure 18. The results of coverage by three agents under different algorithms in 2D Map2. The first column (a,d,g) displays the path results of our algorithm under 3, 4, and 5 agents respectively. The second (b,e,h) and third columns (c,f,i) show the path results of the GBNN and DARP-STC algorithms accordingly.
Jmse 12 01366 g018
Figure 19. The results of coverage by three agents under different algorithms in 2D Map3. The first column (a,d,g) displays the path results of our algorithm under 3, 4, and 5 agents respectively. The second (b,e,h) and third columns (c,f,i) show the path results of the GBNN and DARP-STC algorithms accordingly.
Figure 19. The results of coverage by three agents under different algorithms in 2D Map3. The first column (a,d,g) displays the path results of our algorithm under 3, 4, and 5 agents respectively. The second (b,e,h) and third columns (c,f,i) show the path results of the GBNN and DARP-STC algorithms accordingly.
Jmse 12 01366 g019
Table 1. Competence of various methods under multiple requirements.
Table 1. Competence of various methods under multiple requirements.
3D Workspace with ObstaclesComplete Workspace CoverageMinimum Energy ConsumptionEven Path Assignment
Random coverage approach [7]
zig-zag algorithm [12]
STC [13,14,15]
GBNN [16]
RL [17,18]
SCTG-SMGA (Ours)
Table 2. Experimental parameters.
Table 2. Experimental parameters.
ParameterValueParameterValue
ρ 1.00 × 10 3 kg/m3 S y 1.00 × 10 1 m
C F ( α o ) 3.00 × 10 1 S z 1.50 × 10 0 m
C F ( β o ) 5.00 × 10 1 V o 2.00 × 10 1 m/s
S x 5.00 × 10 1 m d l 1.30 × 10 2 m
ω 1 5.00 × 10 6 ω 2 1.00 × 10 4
G B 5.00 × 10 4 N d p 2.00 × 10 1 m
Table 3. Experimental data of SCTG-SMGA algorithm in 3D maps.
Table 3. Experimental data of SCTG-SMGA algorithm in 3D maps.
TypeAgentsSCTG-SMGA algorithm
Path length of each agent (m)Average length (m)Algorithm execution time (s)
3D Map13 1.82 × 10 5 1.81 × 10 5 1.82 × 10 5 --- 1.82 × 10 5 65.78
6 9.26 × 10 4 8.96 × 10 4 9.24 × 10 4 9.13 × 10 4 9.07 × 10 4 8.85 × 10 4 9.08 × 10 4 122.52
3D Map23 1.85 × 10 5 1.90 × 10 5 1.90 × 10 5 --- 1.88 × 10 5 71.87
6 9.63 × 10 4 9.70 × 10 4 9.37 × 10 4 9.50 × 10 4 9.11 × 10 4 9.20 × 10 4 9.42 × 10 4 126.61
TypeAgentsEnergy consumption of each agent (kJ)Average energy (kJ)Total energy consumption (kJ)
3D Map13 4.26 × 10 7 4.34 × 10 7 4.32 × 10 7 --- 4.31 × 10 7 1.29 × 10 8
6 2.19 × 10 7 2.21 × 10 7 2.17 × 10 7 2.20 × 10 7 2.11 × 10 7 2.13 × 10 7 2.17 × 10 7 1.30 × 10 8
3D Map23 4.51 × 10 7 4.42 × 10 7 4.45 × 10 7 --- 4.46 × 10 7 1.34 × 10 8
6 2.23 × 10 7 2.20 × 10 7 2.19 × 10 7 2.20 × 10 7 2.21 × 10 7 2.24 × 10 7 2.21 × 10 7 1.33 × 10 8
Table 4. Experimental data under different λ p in 3D maps.
Table 4. Experimental data under different λ p in 3D maps.
Type λ p Path length of each agent (m)Average length (m)Algorithm converge time (s)
3D Map150 1.81 × 10 5 1.82 × 10 5 1.82 × 10 5 1.82 × 10 5 66.71
500 1.81 × 10 5 1.82 × 10 5 1.82 × 10 5 1.82 × 10 5 65.98
5000 1.85 × 10 5 1.78 × 10 5 1.82 × 10 5 1.82 × 10 5 64.65
3D Map250 1.91 × 10 5 1.85 × 10 5 1.89 × 10 5 1.88 × 10 5 61.98
500 1.88 × 10 5 1.91 × 10 5 1.87 × 10 5 1.88 × 10 5 63.62
5000 1.88 × 10 5 1.91 × 10 5 1.86 × 10 5 1.88 × 10 5 59.34
Type λ p Energy consumption of each agent (kJ)Average energy (kJ)Total energy consumption (kJ)
3D Map150 4.30 × 10 7 4.32 × 10 7 4.36 × 10 7 4.33 × 10 7 1.30 × 10 8
500 1.34 × 10 8 1.35 × 10 8 1.34 × 10 8 1.35 × 10 8 4.04 × 10 8
5000 6.36 × 10 8 6.13 × 10 8 6.25 × 10 8 6.25 × 10 8 1.87 × 10 9
3D Map250 4.49 × 10 7 4.37 × 10 7 4.49 × 10 7 4.45 × 10 7 1.33 × 10 8
500 1.37 × 10 8 1.46 × 10 8 1.38 × 10 8 1.41 × 10 8 4.22 × 10 8
5000 6.46 × 10 8 6.51 × 10 8 6.40 × 10 8 6.46 × 10 8 1.94 × 10 9
Table 5. Comparison of experimental data under three algorithms.
Table 5. Comparison of experimental data under three algorithms.
TypeAgentsLength standard deviation (m)Total Length (m)Number of turns
SCTG-SMGAGBNNDARP-STCSCTG-SMGAGBNNDARP-STCSCTG-SMGAGBNNDARP-
STC
2D Map1336839051245 2.71 × 10 5 2.92 × 10 5 2.71 × 10 5 154176261
430641083225 2.72 × 10 5 2.86 × 10 5 2.71 × 10 5 158168290
565925671208 2.72 × 10 5 2.88 × 10 5 2.71 × 10 5 154160357
2D Map23324696760 2.49 × 10 5 2.55 × 10 5 2.48 × 10 5 130134203
422567941225 2.48 × 10 5 2.55 × 10 5 2.48 × 10 5 126132295
541631453255 2.48 × 10 5 2.48 × 10 5 2.48 × 10 5 133140251
2D Map33738406020 3.20 × 10 5 3.21 × 10 5 3.18 × 10 5 138132270
4294376180 3.20 × 10 5 3.18 × 10 5 3.18 × 10 5 134136276
587436274255 3.21 × 10 5 3.22 × 10 5 3.18 × 10 5 130128310
TypeAgentsEnergy standard deviation (kJ)Total energy consumption (kJ)Algorithm execution time (s)
SCTG-SMGAGBNNDARP-STCSCTG-SMGAGBNNDARP-STCSCTG-SMGAGBNNDARP-
STC
2D Map13 2.77 × 10 5 7.54 × 10 6 3.63 × 10 5 5.46 × 10 7 5.91 × 10 7 5.80 × 10 7 6.556.8411.43
4 2.07 × 10 5 8.31 × 10 6 4.10 × 10 5 5.49 × 10 7 5.78 × 10 7 5.89 × 10 7 18.4019.2526.12
5 1.36 × 10 5 5.07 × 10 6 5.45 × 10 5 5.48 × 10 7 5.79 × 10 7 6.10 × 10 7 25.4927.7539.15
2D Map23 1.77 × 10 5 1.21 × 10 7 4.14 × 10 5 4.98 × 10 7 5.10 × 10 7 5.19 × 10 7 14.819.4820.91
4 2.79 × 10 5 1.32 × 10 7 7.53 × 10 5 4.95 × 10 7 5.10 × 10 7 5.49 × 10 7 20.3220.1660.89
5 2.49 × 10 5 5.99 × 10 6 3.94 × 10 5 4.97 × 10 7 4.99 × 10 7 5.35 × 10 7 25.1829.5735.39
2D Map33 4.03 × 10 5 6.52 × 10 6 6.50 × 10 5 6.31 × 10 7 6.31 × 10 7 6.69 × 10 7 8.956.9914.89
4 3.20 × 10 5 6.62 × 10 6 2.03 × 10 5 6.29 × 10 7 6.26 × 10 7 6.71 × 10 7 12.6712.3718.23
5 4.79 × 10 5 6.49 × 10 6 1.01 × 10 5 6.30 × 10 7 6.31 × 10 7 6.82 × 10 7 15.0817.6922.67
Note: Bold numbers represent the optimal data in that case.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xie, Y.; Hui, W.; Zhou, D.; Shi, H. Three-Dimensional Coverage Path Planning for Cooperative Autonomous Underwater Vehicles: A Swarm Migration Genetic Algorithm Approach. J. Mar. Sci. Eng. 2024, 12, 1366. https://doi.org/10.3390/jmse12081366

AMA Style

Xie Y, Hui W, Zhou D, Shi H. Three-Dimensional Coverage Path Planning for Cooperative Autonomous Underwater Vehicles: A Swarm Migration Genetic Algorithm Approach. Journal of Marine Science and Engineering. 2024; 12(8):1366. https://doi.org/10.3390/jmse12081366

Chicago/Turabian Style

Xie, Yangmin, Wenbo Hui, Dacheng Zhou, and Hang Shi. 2024. "Three-Dimensional Coverage Path Planning for Cooperative Autonomous Underwater Vehicles: A Swarm Migration Genetic Algorithm Approach" Journal of Marine Science and Engineering 12, no. 8: 1366. https://doi.org/10.3390/jmse12081366

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop