Search Results (192)

This paper presents a novel integration of Systems Engineering (SE) methodologies and Industry 4.0 (I4.0) technologies in the design of robotic systems, focusing on enhancing underwater robotic missions. Using the conceptual design of an underwater exploration vehicle as a case study, we demonstrate how SE can systematically incorporate I4.0 tools to improve mission performance and meet stakeholder expectations. The study begins with an overview of the SE approach, emphasizing the conceptual design stage and aligning it with the application and case study of design theories. We then explore various I4.0 technologies, highlighting their functional benefits rather than technical specifics and addressing design methods for I4.0. Remotely Operated Vehicles (ROVs) are examined in terms of classification, components, and tasks, showcasing their evolution driven by technological advancements, thus tackling the complexity and design of complex systems. The core of our study involves defining stakeholder expectations, using quality function deployment for requirements definition, and performing a functional and logical decomposition of the ROV system. To deal with design fixation within the design team, we developed a tool to help integrate new technologies by also empathizing with their functional capabilities rather than the technology itself. Our approach underscores the importance of understanding and incorporating new technologies functionally, aligning with the transition towards Industry/Society 5.0. This work not only illustrates the synergy between SE and I4.0, but also offers a structured methodology for advancing the design and functionality of complex systems, setting a blueprint for future developments in this field. Full article

Although the ocean is rich in energy and covers a vast portion of the planet, the present results of underwater target identification are not sufficient because of the complexity of the underwater environment. An enhanced technique based on YOLOv8 is proposed to solve the problems of low identification accuracy and low picture quality in the target detection of current underwater robots. Firstly, considering the issue of model parameters, only the convolution of the ninth layer is modified, and the deformable convolution is designed to be adaptive. Certain parts of the original convolution are replaced with DCN v3, in order to address the issue of the deformation of underwater photos with fewer parameters and more effectively capture the deformation and fine details of underwater objects. Second, the ability to recognize multi-scale targets is improved by employing SPPFCSPC, and the ability to express features is improved by combining high-level semantic features with low-level shallow features. Lastly, using WIoU loss v3 instead of the CIoU loss function improves the overall performance of the model. The enhanced algorithm mAP achieves 86.5%, an increase of 2.1% over the YOLOv8s model, according to the results of the testing of the underwater robot grasping. This meets the real-time detection needs of underwater robots and significantly enhances the performance of the object detection model. Full article

Improvements to ArduSub for the BlueROV2 (BROV2) Heavy, necessary for accurate simulation and autonomous controller design, were implemented and validated in this work. The simulation model was made more accurate with new data obtained from real-world testing and values from the literature. The manual control algorithm in the BROV2 firmware was replaced with one compatible with automatic control. In a Robot Operating System (ROS), a proportional–derivative (PD) controller to assist augmented reality (AR) pilots in controlling angular degrees of freedom (DOF) of the vehicle was implemented. Open-loop testing determined the yaw hydrodynamic model of the vehicle. A general mathematical method to determine PD gains as a function of the desired closed-loop performance was outlined. Testing was carried out in the updated simulation environment. Step response testing found that a modified derivative gain was necessary. Comparable real-world results were obtained using settings determined in the simulation environment. Frequency response testing of the modified yaw control law discovered that the bandwidth of the nonlinear system had a one-to-one correspondence with the desired closed-loop natural frequency of a simplified linear approximation. The control law was generalized for angular DOF and linear DOF were operated with open-loop control. A full six-DOF simulated dive demonstrated excellent tracking. Full article

Over the past thirty years, the red gorgonian Paramuricea clavata in the Mediterranean Sea has faced increasing threats, including heat waves and human activities such as artisanal and recreational fishing. Epibiosis on damaged gorgonian colonies is generally used as an indirect indication of stressed conditions. The density and height of P. clavata and the percentage of colonies affected by epibiosis and entangled in lost fishing gear were monitored to investigate the phenomenon and its trend over time in the Ligurian Sea. Analyses were based on transects collected during ROV campaigns between 2015 and 2022 at depths of 33–90 m. A strong correlation was observed between fishing efforts in the study area and the level of epibiosis. Maximal percentages of colonies affected by epibiosis and entanglement were recorded at depths of 50–70 m. Temporally, marine heat waves before 2019 were identified as the primary cause of damage to P. clavata. The decrease in epibiosis percentages after 2019, despite the 2022 heat wave, may be due to a quick recovery ability of the populations and a reduction in fishing activities during the COVID-19 lockdown in 2020. Long-term monitoring programmes are essential to understand the changes in marine benthic communities exposed to different stressors. Full article

ROV operators often encounter challenges with orientation awareness while operating underwater, primarily due to relying solely on 2D camera feeds to manually control the ROV robot arm. This limitation in underwater visibility and orientation awareness, as observed among Malaysian ROV operators, can compromise the accuracy of arm placement, and pose a risk of tool damage if not handle with care. To address this, a 3D orientation monitoring system for ROVs has been developed, leveraging measurement sensors with nine degrees of freedom (DOF). These sensors capture crucial parameters such as roll, pitch, yaw, and heading, providing real-time data on the ROV’s position along the X, Y, and Z axes to ensure precise orientation. These data are then utilized to generate and process 3D imaging and develop a corresponding 3D model of the operational ROV underwater, accurately reflecting its orientation in a visual representation by using an open-source platform. Due to constraints set by an agreement with the working class ROV operators, only short-term tests (up to 1 min) could be performed at the dockyard. A video demonstration of a working class ROV replica moving and reflecting in a 3D simulation in real-time was also presented. Despite these limitations, our findings demonstrate the feasibility and potential of a cost-effective 3D orientation visualization system for working class ROVs. With mean absolute error (MAE) error less than 2%, the results align with the performance expectations of the actual working ROV. Full article

We conducted an experiment of planting a dead cow and a metal-framed cage with cameras on the 1629 m deep sea floor off the southeast coast of Hainan Island in the northwestern South China Sea, using ROV diving and setting up a video camera on the cage to observe animals who came to eat the bait. The deep-sea cameras captured footage of eight Pacific sleeper sharks (Somniosus pacificus) swimming and feeding around the dead cow. To our knowledge, this is the first time the occurrence of such a shark species has been reported in the South China Sea. Eight individuals were differentiated based on the characteristic differences displayed in the images, with lengths of 1.9 to 5.1 m estimated. The video camera also recorded the predators’ behavior of tearing at the dead cow on the seabed. It was discovered that Pacific sleeper sharks are not strictly solitary and exhibit queue-feeding behavior. This study is significant as it documents a record of a data-scarce shark species, for which little information is available in the literature. It also documents an expansion of the species’ known habitat from the north Pacific Ocean into the South China Sea. Such sharks diving into the deep sea to predate on dead animals also suggests that occurrences of large chunks of dead organic bodies falling onto the deep sea might have been more frequent than we previously thought in the South China Sea. The findings have implications for understanding the geographic connectivity of large swimming animals between the South China Sea and the Pacific Ocean and provide scientific evidence for formulating conservation and management strategies for sharks and other large animals in the oceans. Full article

Large amounts of video images have been collected for decades by scientific and governmental organizations in deep (>1000 m) water using manned and unmanned submersibles and towed cameras. The collected images were analyzed individually or were mosaiced in small areas with great effort. Here, we provide a workflow for utilizing modern photogrammetry to construct virtual geological outcrops hundreds or thousands of meters in length from these archived video images. The photogrammetry further allows quantitative measurements of these outcrops, which were previously unavailable. Although photogrammetry had been carried out in recent years in the deep sea, it had been limited to small areas with pre-defined overlapping dive paths. Here, we propose a workflow for constructing virtual outcrops from archived exploration dives, which addresses the complicating factors posed by single non-linear and variable-speed vehicle paths. These factors include poor navigation, variable lighting, differential color attenuation due to variable distance from the seafloor, and variable camera orientation with respect to the vehicle. In particular, the lack of accurate navigation necessitates reliance on image quality and the establishment of pseudo-ground-control points to build the photogrammetry model. Our workflow offers an inexpensive method for analyzing deep-sea geological environments from existing video images, particularly when coupled with rock samples. Full article

Marine ecosystems serve as vital indicators of biodiversity, providing habitats for diverse flora and fauna. Canada’s extensive coastal regions encompass a rich range of marine habitats, necessitating accurate mapping techniques utilizing advanced technologies, such as remote sensing (RS). This study focused on a study area in Pistolet Bay in Newfoundland and Labrador (NL), Canada, with an area of approximately 170 km² and depths varying between 0 and −28 m. Considering the relatively large coverage and shallow depths of water of the study area, it was decided to use airborne bathymetric Light Detection and Ranging (LiDAR) data, which used green laser pulses, to map the marine habitats in this region. Along with this LiDAR data, Remotely Operated Vehicle (ROV) footage, high-resolution multispectral drone imagery, true color Google Earth (GE) imagery, and shoreline survey data were also collected. These datasets were preprocessed and categorized into five classes of Eelgrass, Rockweed, Kelp, Other vegetation, and Non-Vegetation. A marine habitat map of the study area was generated using the features extracted from LiDAR data, such as intensity, depth, slope, and canopy height, using an object-based Random Forest (RF) algorithm. Despite multiple challenges, the resulting habitat map exhibited a commendable classification accuracy of 89%. This underscores the efficacy of the developed Artificial Intelligence (AI) model for future marine habitat mapping endeavors across the country. Full article

Despite major economic and technological advances, much of the ocean remains unexplored, which has led to the use of remotely operated vehicles (ROVs) and gliders for surveying. ROVs and underwater gliders are essential for ocean data collection. Gliders, which control their own buoyancy, are particularly effective unmanned platforms for long-term observations. The traditional method of recovering the glider on a small boat is a risky operation and depends on the skill of the workers. Therefore, a safer, more efficient, and automated system is needed to recover them. In this study, we propose a lightweight artificial neural network for underwater glider detection that is efficient for learning and inference. In order to have a smaller parameter size and faster inference, a convolutional neural network (CNN) vision encoder in an artificial neural network splits an image of a glider into a number of elongated patches that overlap to better preserve the spatial information of the pixels in the horizontal and vertical directions. Global max-pooling, which computes the maximum over all the spatial locations of an input feature, was used to activate the most salient feature vectors at the end of the encoder. As a result of the inference of the glider detection models on the test dataset, the average precision (AP), which indicates the probability that an object is located within the predicted bounding box, shows that the proposed model achieves AP = 99.7%, while the EfficientDet-D2 model for comparison of detection performance achieves AP = 69.2% at an intersection over union (IOU) threshold of 0.5. Similarly, the proposed model achieves an AP of 78.9% and the EfficientDet-D2 model achieves an AP of 50.5% for an IOU threshold of 0.75. These results show that accurate prediction is possible within a wide range of recall for glider position inference in a real ocean environment. Full article

Remotely operated vehicles (ROVs) provide practical solutions for a wide range of activities in a particularly challenging domain, despite their dependence on support ships and operators. Recent advancements in AI, machine learning, predictive analytics, control theories, and sensor technologies offer opportunities to make ROVs (semi) autonomous in their operations and to remotely test and monitor their dynamics. This study moves towards that goal by formulating a complete navigation, guidance, and control (NGC) system for a six DoF BlueROV2, offering a solution to the current challenges in the field of marine robotics, particularly in the areas of power supply, communication, stability, operational autonomy, localization, and trajectory planning. The vehicle can operate (semi) autonomously, relying on a sensor acoustic USBL localization system, tethered communication with the surface vessel for power, and a line of sight (LOS) guidance system. This strategy transforms the path control problem into a heading control problem, aligning the vehicle’s movement with a dynamically calculated reference point along the desired path. The control system uses PID controllers implemented in the navigator flight controller board. Additionally, an infrastructure has been developed that synchronizes and communicates between the real ROV and its digital twin within the Unity environment. The digital twin acts as a visual representation of the ROV’s movements and considers hydrodynamic behaviors. This approach combines the physical properties of the ROV with the advanced simulation and analysis capabilities of its digital counterpart. All findings were validated at the Point Rouge port located in Marseille and at the port of Ancona. The NGC implemented has proven positive vehicle stability and trajectory tracking in time despite external interferences. Additionally, the digital part has proven to be a reliable infrastructure for a future bidirectional communication system. Full article

The objective of this study was to perform fault diagnosis (FD) specific to various faults that can occur in the thrusters of remotely operated vehicles (ROVs) during hovering control. Underwater thrusters are predominantly utilized as propulsion systems in the majority of ROVs and are essential components for implementing motions such as trajectory tracking and hovering. Faults in the underwater thrusters can limit the operational capabilities of ROVs, leading to permanent damage. Therefore, this study focused on the FD for faults frequently caused by external factors such as entanglement with floating debris and propeller breakage. For diagnosing faults, a data-based technique that identifies patterns according to data characteristics was utilized. In imitation of the fault situations, data for normal, breakage and entangled conditions were acquired, and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) was employed to differentiate between these fault conditions. The proposed methodology was validated by configuring an ROV and conducting experiments in an engineering water tank to verify the performance of the FD. Full article

In this paper, a fractional active disturbance rejection control (FADRC) scheme is proposed for remotely operated vehicles (ROVs) to enhance high-precision positioning and docking control in the presence of ocean current disturbances and model uncertainties. The scheme comprises a double closed-loop fractional-order ${\mathrm{PI}}^{\lambda }{\mathrm{D}}^{\mu }$ controller (DFOPID) and a model-assisted finite-time sliding-mode extended state observer (MFSESO). Among them, DFOPID effectively compensates for non-matching disturbances, while its fractional-order term enhances the dynamic performance and steady-state accuracy of the system. MFSESO contributes to enhancing the estimation accuracy through the integration of sliding-mode technology and model information, ensuring the finite-time convergence of observation errors. Numerical simulations and pool experiments have shown that the proposed control scheme can effectively resist disturbances and successfully complete high-precision tasks in the absence of an accurate model. This underscores the independence of this control scheme on accurate model data of an operational ROV. Meanwhile, it also has the advantages of a simple structure and easy parameter tuning. The FADRC scheme presented in this paper holds practical significance and can serve as a valuable reference for applications involving ROVs. Full article

In humanitarian aid scenarios, the model of cumulative capacitated vehicle routing problem can be used in vehicle scheduling, aiming at delivering materials to recipients as quickly as possible, thus minimizing their wait time. Traditional approaches focus on this metric, but practical implementations must also consider factors such as driver labor intensity and the capacity for on-site decision-making. To evaluate driver workload, the operation times of relief vehicles are typically used, and multi-objective modeling is employed to facilitate on-site decision-making. This paper introduces a multi-objective cumulative capacitated vehicle routing problem considering operation time (MO-CCVRP-OT). Our model is bi-objective, aiming to minimize both the cumulative wait time of disaster-affected areas and the extra expenditures incurred by the excess operation time of rescue vehicles. Based on the traditional grey wolf optimizer algorithm, this paper proposes a dynamic grey wolf optimizer algorithm with floating 2-opt (DGWO-F2OPT), which combines real number encoding with an equal-division random key and ROV rules for decoding; in addition, a dynamic non-dominated solution set update strategy is introduced. To solve MO-CCVRP-OT efficiently and increase the algorithm’s convergence speed, a multi-objective improved floating 2-opt (F2OPT) local search strategy is proposed. The utopia optimum solution of DGWO-F2OPT has an average value of two fitness values that is 6.22% lower than that of DGWO-2OPT. DGWO-F2OPT’s average fitness value in the algorithm comparison trials is 16.49% less than that of NS-2OPT. In the model comparison studies, MO-CCVRP-OT is 18.72% closer to the utopian point in Euclidean distance than CVRP-OT. Full article

The expansion of the open-pit exploitation of mineral raw materials, and especially the energy resources of fossil fuels, makes open-pit coal mines spatially dominant objects of large mining basins. Exploitation activities are accompanied by negative ecological impacts on the environment, which requires the integral planning, revitalization, reclamation, and rehabilitation of the disturbed area for human use in the post-exploitation period. The post-exploitation remediation and rehabilitation of open-pit mining areas and disposal sites, i.e., space disturbed by mining activities and accompanying facilities, are complex synthetic multidisciplinary multiphase engineering project tasks. In this paper, a hybrid fuzzy MCDM model (Multiple-Criteria Decision-Making) was developed for the selection of a reclamation solution for the Tamnava-West Field open-pit mine. IMF SWARA (Improved Fuzzy Stepwise Weight Assessment Ratio Analysis) was applied to define the weights of 12 criteria of different structures used in the evaluation of reclamation solutions. The Fuzzy ROV (Range of Value) method was applied to select the reclamation solution from a total of 11 solutions previously obtained using a process approach. The results of the hybrid IMF SWARA—Fuzzy ROV model show that forestry is the best solution for the Tamnava-West Field open-pit mine. After the results had been obtained, verification analyses of the proposed model were performed and the best stable proposed reclamation solution was determined. Full article

Background: Many scoring systems, algorithms, and guidelines have been developed to aid in the evaluation and diagnosis of acute appendicitis (AA). Many of these algorithms advocate against the routine use of radiological investigations when there is a high clinical suspicion of AA. However, there has been a significant rise in the use of imaging techniques for diagnosing AA in the past two decades. This is a national study aimed at assessing the adherence of residents assigned to the emergency department to the clinical guidelines for diagnosing AA. Methods: We introduced a case study of a male patient with highly suspicious clinical findings of AA to all surgical and emergency medicine residents assigned to the emergency department with the autonomy to make critical decisions to determine the preferred way of diagnosing AA. Results: A total of 62.4% of all relevant residents participated in this survey; 69.6% reported that the Alvarado score was eight or higher, and 82.1% estimated that the next step recommended by most clinical guidelines was appendectomy without further abdominal imaging tests. However, 83.4% chose to perform an imaging test to establish the diagnosis of AA. Conclusions: Our study revealed a notable non-adherence to clinical guidelines in diagnosing AA. Given the significance of these guidelines, we assert that adopting medical recommendations should not solely depend on individual education but should also be incorporated as a departmental policy. Full article