1. Introduction
During the last few years, the rapid development of science and technology has accelerated the process of ocean exploration, which has led to the continuous development and utilization of marine resources. Important marine structures, marine equipment, and sea bridges have contributed to economic development as well as scientific and technological advancement [
1,
2,
3,
4,
5]. As part of these efforts, marine equipment assists people in exploring the ocean’s resources, including both physical and chemical resources [
6,
7,
8,
9]; sea bridges facilitate coastal transportation and promote regional development, etc. Due to the increasing number of navigable ships and various complex environmental factors, there has been an increase in the risk of ship-bridge collisions and ship-marine equipment collisions. Maritime collisions can cause serious damage to marine structures [
10,
11,
12,
13,
14], further threatening the safety of people and the economy. As shown in
Figure 1, such issues are receiving increasing attention.
A major contribution to the economic efficiency of marine equipment and the safety of personnel is the research conducted on collision risk reduction methods. The majority of current collision risk reduction strategies are passive collision avoidance strategies. Passive collision avoidance methods, however, have disadvantages, such as low economic efficiency and limited flexibility. As a result, people gradually began to explore active collision avoidance methods. However, traditional active collision avoidance methods mainly rely on sensors, radar, and other devices, resulting in the following limitations: route planning accuracy cannot be adapted to complex sea conditions and bad weather, high reliance on seafarers’ manual judgment, high data processing complexity, and limited detection ranges. The field of information and computer technology has undergone rapid development in recent years. Computing and processing information has become much more efficient thanks to advances in technologies, such as cloud computing, high-performance processors, big data analytics, and Artificial Intelligence. Active collision avoidance methods have been optimized through the use of artificial intelligence techniques.
Figure 2 illustrates the relevance of using Artificial Intelligence to optimize the development of active collision avoidance techniques.
The purpose of this paper is to contribute to the advancement of the field and to provide a guide for its future development. After conducting keyword searches in the Web of Science, Arxiv, and other repositories, layer-by-layer screening was conducted to identify the literature that met the requirements of this paper. The paper begins by reviewing some cases of passive collision avoidance and discussing its shortcomings, followed by a chronological review of active collision avoidance techniques. The purpose of this paper is to review the application of different algorithms of Artificial Intelligence in order to optimize traditional active collision avoidance and path planning, as well as to conduct a discussion and analysis to identify some challenges and shortcomings. To address these difficulties, we also provide some constructive suggestions and development perspectives. Some aspects of this paper can serve as a guide for the development of the field.
2. Passive Collision Avoidance Case
By reviewing some classic cases of passive collision avoidance and analyzing them through discussion, the article indirectly discovers the potential of passive collision avoidance.
The Flexible Floating Collision Prevention System (FFCPS) prevents collisions between uncontrolled vessels and non-navigational bridges.
Figure 3 illustrates this: (A) Schematic diagram of Flexible Floating Collision-Prevention System; (B) Floating structure; (C) Mooring system. The system is composed of a cable chain, a floating structure, and a mooring system. By sliding the anchor, the mooring system serves to position the system and absorb the impact energy of the system. In order to prevent damage to the mooring chains and the connecting cable chains, movable anchors are used. However, this device is less flexible, more difficult to install, and requires a high level of maintenance due to the complexity of the sea state [
15].
In
Figure 4, a protective jacket structure of offshore steel jackets is used to protect bridges from collisions. As a result of this structure, the bridge is able to maintain good stability when it is struck [
16].
Figure 5 illustrates a passive collision avoidance device for a tethered anchor floating suspension bridge proposed by Moe et al. Each floater is attached to a floating structure by a tether. By increasing the amount of diving, drag, and hydrodynamic mass added during a collision, the barrier dissipates energy [
17].
To protect bridges against ship impacts, there is an energy dissipation device with a low-cost steel frame structure. There is a vertically supported crash cap attached to the pier by a series of steel girders arranged in a frame. It is designed to dissipate energy while limiting the force transmitted to the protected pier by forming a plastic hinge [
18].
Bridge pier impact loads can be reduced by using a floating two-stage buffer collision-prevention system (FTBCPS). Anti-collision stages consist of two main components. The first step in reducing the velocity of the ship and changing the ship’s initial direction of movement is to stretch and fracture the polyester ropes. Secondly, it consumes the ship’s kinetic energy due to the damage and deformation caused by the FTBCPS and the ship [
19].
The adaptive arresting vessel device (AAVD) is used for the protection of bridges in non-navigable waters from ship collisions. They discussed and determined the key parameters that affect the arresting effect of AAVD through a scale model experiment and preliminarily evaluated the feasibility of AAVD. The AAVD full-scale test section has been constructed, and the stopping ship collision test has been conducted. According to the experimental results, the system is capable of stopping a yawing ship effectively, demonstrating the feasibility and reliability of both the technology principle and the engineering design, as shown in
Figure 6 [
20].
All the above-mentioned passive collision avoidance cases share a number of common characteristics. The design of marine equipment or the design of protection devices achieves energy absorption in order to achieve cushioning impact resistance through the design of the structural design. There are, however, a number of shortcomings associated with these collision avoidance methods:
Passive collision avoidance technology can only play a protective role in the event of a collision but cannot prevent a collision from occurring in the first place;
Increasing the structural strength and impact resistance of offshore facilities requires the use of more materials and more complex designs, which increases the cost of passive collision avoidance technologies and puts some pressure on companies’ financials;
In order to ensure their effectiveness and reliability, passive collision avoidance technologies need to be regularly inspected and maintained. As a result, these maintenance tasks are expensive in terms of human resources, materials, and financial resources;
As offshore facilities vary in size and shape and specific design and testing are required for each offshore facility, which increases the cost and difficulty of designing and building offshore facilities.
3. Active Collision Avoidance Methods
Offshore active collision avoidance methods are capable of preventing collisions to a certain extent. Active collision avoidance methods have great potential for optimizing the disadvantages of passive collision avoidance methods due to their ability to reduce the probability of collision events to a large extent.
3.1. Development Process
Active collision prevention at sea has been developed in four stages.
Figure 7 illustrates this. The first phase of the development occurred between the early 1900s and the 1940s. Active collision avoidance at sea was primarily achieved through manual observation and the most basic radar system during this period. The second phase of development occurred between the 1950s and the 1980s. During this time period, automated navigation systems were introduced, which utilized sensors and computer technology to monitor a vessel’s location, speed, and heading. The third stage, between the 1990s and early 2000s, witnessed the gradual development of maritime active collision avoidance technology, which combined ship and shore-based communications with advances in information technology. During the fourth stage, from the early 21st century to the present, laser radar, sonar, and camera technology have made maritime active obstacle avoidance technology more accurate and reliable. At the same time, methods such as machine learning for running path planning and algorithms for image processing and pattern recognition are also being explored. As a result of these technologies, collision avoidance can be enhanced by analyzing and identifying different obstacles in real-time.
3.1.1. Phase I
The development of technology was at a low point at the beginning of this period. Sailors’ experience and visual observation were the primary means of avoiding collisions at sea [
21]. Radar was first introduced to ships in 1922. Researchers from the US Navy placed transmitters and receivers across the Atlantic and observed that ships passing through the beam’s path caused the received signal to fluctuate [
22]. In addition, in 1928, L. S. Alder obtained a provisional patent for Naval radar in the UK [
23]. While useful for navigation and obstacle avoidance, these radar systems are more limited and cannot provide detailed information about obstacles. Commercial ships began using radar in 1939 [
24].
3.1.2. Phase II
Under the auspices of the Air Force, the MIT Instrumentation Laboratory began developing Inertial navigation instruments in the 1950s [
25]. The development of Inertial navigation instruments for ships has also been gradual since then [
26]. Using accelerometers and gyroscopes, inertial navigation systems calculate a vessel’s position, speed, and heading by measuring its acceleration and angular velocity. Due to the problem of error accumulation, such systems can provide a relatively high degree of accuracy but must be used in conjunction with other navigational systems [
27,
28,
29]. In 1973, the United States began developing the Global Positioning System (GPS), which provides more accurate positional information for automated navigation systems [
30]. In the 1980s, autonomous navigation systems were introduced to the world of navigation. Computer technology and sensors are used in autonomous navigation systems in order to achieve autonomous vessel control and collision avoidance. A vessel’s course, speed, and maneuver can be automatically adjusted based on preset rules and goals in order to avoid collisions and optimize navigational efficiency [
31,
32]. The technology, however, requires further improvement in terms of precision and accuracy.
3.1.3. Phase III
In the 1990s, remote monitoring systems were introduced into maritime navigation [
33]. Remote monitoring systems transmit real-time information about a ship’s position, speed, and heading to shore-based control centers using satellite communications and terrestrial transmission equipment. By analyzing this data and providing timely navigation advice and navigational warnings, shore-based control centers can assist ships in avoiding potentially dangerous areas. It was in the 2000s that intelligent navigation systems began to be applied to ships. In an intelligent navigation system, radar, satellite navigation, communications, and computer technology are utilized to provide highly automated monitoring of the surroundings of a ship in real-time, as well as collision avoidance decisions based on that information [
34,
35].
3.1.4. Phase IV
In 2008, LiDAR technology began to be used in the field of active obstacle avoidance at sea. In LiDAR, a laser beam is emitted, and its reflected signal is measured to determine the distance between a target object and a sensor [
36]. Advances in sonar technology led to further refinements in maritime obstacle avoidance systems in the early 2010s [
37]. Since then, computer vision [
38] and artificial intelligence [
39] have been used in the development of marine obstacle avoidance systems.
3.2. Traditional Methods
There are several active collision avoidance methods at sea, including Automatic Identification Systems (AIS), Automatic Radar Plotting Aids (ARPA), Electronic Chart Display and Information Systems (ECDIS), Vessel Traffic Management Systems (VTMIS), and observation methods that rely heavily on manual labor, including navigational watch and sailor observation. Because the last category of methods can be viewed as a purely manual method based on the crew’s experience, some systems have developed, such as collision avoidance rules [
40]. This section does not provide a detailed description of them.
3.2.1. Autonomous Identification System
The Autonomous Identification System (AIS) is a system that uses sensors, such as radar, Automatic Identification System (AIS), and satellite imagery to monitor and identify ships in the maritime industry [
41]. In Autonomous Identification Systems, AIS is one of the most widely used technologies. The AIS is based on the Global Automatic Ship Identification System (GMDSS).
An AIS transmits and receives information about a ship’s position, speed, course, and name using VHF radio waves. A good mastery of position and speed enables AIS to perform a number of functions, including autonomous collision avoidance and operation supervision [
42,
43]
A study has been conducted on the potential impact of Automatic Identification Systems (AIS) on ship bridges on the safety of maritime navigation. According to the study, 8% of the AIS transmissions in the sample contained at least one piece of inaccurate data, and the reliability of the data provided by AIS often failed to meet requirements [
44].
A proposed Automatic Identification System (AIS) was proposed by Saravanan et al. in order to prevent fishermen from crossing international maritime borders and to assist them in avoiding collisions [
45].
3.2.2. Automatic Radar Plotting Aid
Through the use of radar technology, the ARPA system detects ships and other obstacles around them and calculates their position, speed, and direction. ARPA uses this data to automatically plot the movements of other vessels and predict their future locations. Captains and crews can utilize this predictive data to identify potential hazards and take appropriate action to avoid them [
46].
According to one study, Automated Radar Plotting Aid (ARPA) systems are often mistaken for inland waterway structures and land objects in inland rivers and harbors [
47].
3.2.3. Electronic Chart Display and Information System
The ECDIS system is a collision warning system that is based on electronic charts and navigation systems. The system integrates information about a ship’s position and navigation with data from nautical charts in order to provide warnings and recommendations regarding ship maneuvers [
48].
It is possible to adjust the scale of an electronic nautical chart by using the zoom function. However, excessive zooming in or out may cause a false sense of security, as it may lead to misinterpretations of the accuracy of routes and hazards. As a result of zooming in and out, certain specific features and information may be automatically hidden or displayed, which may interfere with a mariner’s overall understanding of the navigational environment. Therefore, mariners should exercise caution when using the zoom function and always maintain a thorough understanding and visual observation of the entire course at all times [
49].
3.2.4. Vessel Traffic Management System
The purpose of vessel traffic management systems is to monitor maritime traffic and provide real-time traffic intelligence and risk assessments to assist captains and crews in making informed decisions [
50]. Thus, the method produces a final avoidance result that is highly dependent on the operations of the crew.
3.3. Associated AI-Algorithms
According to the review above, active collision avoidance offers greater potential in terms of economic benefits and other factors than passive collision avoidance. Traditional active collision avoidance techniques, however, have some disadvantages. With the application of artificial intelligence methods to maritime active collision technology, some of these drawbacks have been overcome [
51]. The majority of collision problems at sea occur during complex sea states, including adverse weather conditions, busy shipping lanes, ocean currents, and coastlines. Active obstacle avoidance methods cannot cope well with complex sea conditions, but artificial intelligence provides a better solution to avoid collisions in complex sea conditions. In addition, sophisticated algorithms and the use of big data technology can ensure compliance with COLREGs in the event of an accident or an emergency situation. Various AI algorithms are discussed in this section.
3.3.1. Ant Colony Optimization Algorithm
It is a meta-heuristic algorithm based on the path taken by ant colonies in search of food. The ACO algorithm solves the optimization problem by simulating the release of pheromones by ants in their environment [
52,
53].
Figure 8 illustrates a simple model of the ACO algorithm. Similarly, ships are capable of simulating their intentions by releasing pheromones and planning collision avoidance paths based on the pheromones left by their surroundings. Using an iterative optimization process, the ACO algorithm considers the interactions between ships and the environment in order to find the best collision avoidance paths, thereby improving safety and efficiency. The best collision avoidance scheme can be determined by taking into account several factors, such as course distance, speed, ship type, etc.
An analysis of the path planning problem for autonomous surface ships found that the “Ant Colony Optimization” algorithm yielded superior results. By using the algorithm, the model is able to determine the best trajectory for maneuvering [
54].
Based on ant colony optimization (ACO), Lazarowska presents a new approach to path planning in dynamic environments. An unmanned surface vehicle (USV)’s navigation, guidance, and control system incorporates an intelligent obstacle detection and avoidance system, which can be used as part of the decision support system on board [
55].
An incoming ant colony optimization algorithm (ACO) can be used to avoid collisions between unmanned surface vehicles (USVs). Using this algorithm, we are able to solve the problems of insufficient search capability, slow convergence, and falling into local optima [
56].
A path-planning algorithm proposed by Fu et al. makes it possible for submarines to navigate safely in complex underwater environments. The algorithm consists of a global path-planning component and a local dynamic obstacle avoidance component. Global path planning is accomplished using an improved Artificial Potential Field Ant Colony Optimization (APF-ACO) algorithm, which yields shorter paths, fewer inflection points, and greater stability than other similar algorithms [
57].
Underwater vehicles in high-energy environments can be avoided by using the ant colony optimization (ACO) algorithm [
58].
Using an improved ant colony clustering algorithm, Liu et al. automatically select an appropriate search range by a clustering algorithm that matches the complexity of different environments. As a result, USV can fully utilize its limited computational resources and improve the performance of path planning [
59].
3.3.2. Particle Swarm Optimization Algorithm
Particle Swarm Optimization (PSO) is a group intelligence-based optimization algorithm. As shown in
Figure 9, based on the behavior of a flock of birds or a school of fish, the PSO algorithm solves complex problems by simulating the behavior of individual birds as they search for food in the search space. In the PSO algorithm, the position and velocity of the particles are updated based on the experiences of each particle and the collective experience of the whole flock by viewing the search space as the position of the particle population. By comparing its own optimal position with the optimal position of the whole population (global optimal solution), each particle adjusts its position and velocity to better explore the search space [
60,
61,
62].
An improved Tent mapping is introduced to address the problem of premature convergence of PSO in a study on the effectiveness of the Chaotic Particle Swarm Optimization (CPSO) algorithm in ship collision avoidance based on the analysis of existing collision avoidance strategies [
63].
The PSO algorithm was used by Wang et al. to find safe and smooth sailing routes as well as efficient sailing speeds. According to the results, the proposed method can effectively achieve a safe and smooth sailing route and a fast speed for a ship experiencing an accident [
64].
Based on standard encounter types, Kang et al. simulated several maritime traffic scenarios. These scenarios are used to test the proposed PSO algorithm [
65].
In complex ocean environments, an autonomous underwater vehicle (AUV) path planning strategy has been developed. Using particle swarm optimization (PSO) algorithms and local path modification (LPM)-based replanning schemes, the strategy continuously optimizes the optimal trajectory and avoids collisions with static and dynamic obstacles [
66].
3.3.3. Genetic Algorithm
As an optimization algorithm, Genetic Algorithm (GA) simulates the process of biological evolution. By simulating natural selection, genetic variation, and gene crossover, it seeks to determine the best solution.
Figure 10 shows the basic process of the Genetic Algorithm. A Genetic Algorithm encodes the solution to the problem as an individual (chromosome) consisting of a string of genes. Each gene represents a variable in the problem, and each individual represents a possible solution. To form a population, an initial set of individuals is randomly selected. An individual’s fitness is evaluated by a fitness function; the higher the fitness, the greater the likelihood of the individual’s selection. To generate new individuals, a selection operation is performed based on the selection probability, followed by crossover and mutation operations. A solution that satisfies the stopping condition is iterated until an optimal solution is found [
67,
68]. It is possible to apply genetic algorithms to the problem of ship active collision avoidance in order to determine the most effective collision avoidance strategy. Every individual can represent a possible navigation strategy, including parameters such as heading and speed. Through continuous iteration and evolution, the genetic algorithm searches for the globally optimal collision avoidance strategy. Each individual’s fitness is evaluated by a fitness function, which considers factors such as distance, speed, and heading to other ships. Selection, crossover, and mutation operations are performed based on the fitness to produce new individuals.
Genetic Algorithms and artificial intelligence are being used to develop a decision support tool for ship collision avoidance route planning and alerting. By considering the international regulations for the prevention of collisions at sea (COLREGS) and the safety domain of ships, it provides theoretically crucial recommendations for the shortest collision avoidance routes from an economic perspective [
69].
To study how to assist the crew in determining and controlling the ship’s course, Ito, Zhnng, and Yoshida used a genetic algorithm [
70].
A quadratic optimization genetic algorithm combining the ship motion characteristics was proposed by Wang et al. in order to achieve automatic route planning under complex navigation environments [
71].
An effective collision avoidance system depends on the ability to determine the best trajectory. The mathematical model of ship maneuvering motion is described by Cheng, Liu, and Zhang as the basis for the ship collision avoidance system. To determine the ship trajectory in inland waterways, taking into account different navigational constraints, an optimization method based on genetic algorithms is applied [
72].
In a marine environment with strong currents and enhanced spatiotemporal variability, A. Alvarez, Caiti, and Onken proposed a genetic algorithm for autonomous submersible path planning. Finding a safe path is the objective [
73].
3.3.4. Reinforcement Learning Algorithms
By interacting with the environment, Reinforcement Learning (RL) learns optimal behavioral strategies in a dynamic environment. By observing feedback and reward signals from the environment, it optimizes the decision-making process through trial and error.
Figure 11 illustrates a typical framework for a reinforcement learning (RL) scenario. There are three main components of Reinforcement Learning: The Agent, the Environment, and the Reward. As a result of observing the state of the environment, the Agent chooses to perform an action. In response to the Agent’s action, the Environment provides a new State and a corresponding Reward. Based on the observed feedback, the intelligent body updates its strategy in order to maximize the cumulative reward by learning to choose the best course of action from the current situation [
74,
75,
76].
In order to improve the path planning capability of AUVs in unknown environments, Chu et al. proposed a deep reinforcement learning (DRL) method based on dual deep Q networks (DDQN) [
77].
Rongcai, Hongwei, and Kexin developed an autonomous collision avoidance system based on deep reinforcement learning in open water to address the challenge of planning local paths for multiple vessels in complex, dynamic environments [
78].
An obstacle avoidance autonomous surface ship (ASV) strategy was developed by Zhou et al. based on reinforcement learning [
79].
Xu et al. proposed an intelligent hybrid collision avoidance algorithm based on deep reinforcement learning to achieve autonomous collision avoidance for unmanned surface vehicles (USVs) [
80].
Deep reinforcement learning and rolling wave planning are used to improve the performance of an unmanned surface vehicle (USV). A path planner is used to generate a potential path for the entire trip without specifying motion details, and a decision module is used to avoid dynamically generated obstacles and navigate through the agent in the near future [
81].
A deep reinforcement learning (DRL) algorithm-based autonomous navigation decision algorithm for maritime autonomous surface ships (MASS) was proposed by Zhang et al. It consists of two layers: a scene segmentation layer and an autonomous navigation decision layer. According to the International Code for Collision Avoidance at Sea (COLREG), the scenario segmentation layer quantifies the sub-scenarios [
82].
In a continuous state space environment, Wang et al. proposed a new algorithm for avoiding impact potholes called Approximate Representation Strong Chemical Learning (AR-RL) (2023) [
83].
For unmanned surface vehicles (USVs), Fan et al. propose a collision avoidance algorithm that complies with international regulations (COLREGs) in order to prevent collisions at sea. USVs are trained to navigate safely and efficiently using reinforcement learning and a finite Markov decision process [
84].
An autonomous ship path tracking and collision avoidance system can be improved by using a deep reinforcement learning algorithm. By ensuring that a vessel follows a predefined path, the proposed algorithm avoids collisions when encountering a moving vessel [
85].
3.3.5. Artificial Neural Network
An artificial neural network (ANN) mimics the structure and function of a neural network in the human brain.
Figure 12 shows the simple structure of an artificial neural network. By simulating the connections between neurons and the transmission of electrical signals, it realizes information processing and learning. By learning and training, artificial neural networks are capable of extracting features from input data and performing tasks such as pattern recognition, classification, and prediction [
86,
87,
88,
89,
90,
91,
92,
93].
It is possible to apply artificial neural network algorithms to the problem of ship active collision avoidance. Firstly, it is necessary to collect and prepare relevant navigational data, such as ship position, speed, heading, and radar data. As a result of these data, an artificial neural network model is trained to learn the ship’s behavior patterns and laws. By inputting real-time ship navigation data into the trained neural network model, predicted ship behaviors or decision-making suggestions can be obtained after the training has been completed. The ship can actively take collision avoidance measures based on these predictions, such as adjusting course and speed or communicating with other vessels in the area.
To predict the future position of manually controlled vessels, Simsir et al. proposed an artificial neural network (ANN) that utilizes data from manually controlled vessels [
93,
94].
To prevent collisions between vessels on the high seas, Kim and Park developed an artificial neural network (ANN). In the study, it was found that the ANN is capable of providing timely and appropriate collision avoidance actions based on information from navigational equipment, such as radars and automatic identification systems (AIS). For training, ANNs may require large quantities of data, which can be time-consuming and expensive [
95].
3.4. Other Technologies
Yilmaz et al. investigated the problem of path planning for autonomous underwater vehicles (AUVs) in the context of adaptive sampling. They developed a mathematical formulation called MILP, which is capable of handling multiple AUVs and multi-day sampling. MILP can model all constraints required by various problem scenarios. As a result, the problem formulation can be extended and modified in the future [
96].
Based on historical successful collision avoidance cases, Gao et al. propose to employ an encoder-decoder neural network based on a sequence-to-sequence (Seq2Seq) model [
97].
A multi-trajectory planning algorithm has been proposed for automated underwater vehicles (AUVs) in complex underwater environments by Gong et al. [
98].
A dynamic predictive guidance technique has been proposed by Kozynchenko et al. for the purpose of preventing collisions at sea. This technique is based on an optimal control problem formulation and a nonlinear model of a three-dimensional ship. The simulation results demonstrate the feasibility and effectiveness of the proposed technique and software. Further research and development of ship collision avoidance systems can be conducted using the simulation framework developed [
99].
MahmoudZadeh et al. investigated the underwater rendezvous problem, which involves a single automated underwater vehicle (AUV) meeting a leading underwater rescue vessel in a chaotic and variable operating environment. A nonlinear optimal control problem (NOCP) was formulated and solved using an evolutionary algorithm. To adapt to the changing environment, a new online path-planning mechanism was developed and implemented on a follower AUV [
100].
Liu et al. proposed a hybrid clustering model to analyze maritime traffic patterns and detect anomalies in ports. Combining K-Means and DBSCAN algorithms, the model clusters ship trajectories based on their departure and destination characteristics as well as their dynamic and spatial characteristics [
101].
A model for real-time multi-vessel collision risk analysis and collision avoidance decision-making was proposed by Hu et al. Using fuzzy logic, the model calculates collision risk and determines whether to change course or speed in order to avoid a collision. To reduce the number of maritime accidents caused by human error and failure, the model provides early warning and decision support to the officer of the watch (OOW) [
102].
To enhance the autonomy of an unmanned surface vehicle (USV), Guardeño et al. propose a new algorithm called Robust Reactive Static Obstacle Avoidance System (RRSOAS). A prior knowledge of the USV’s mathematical model and controller is not required in order to use the algorithm. Rather, it uses an estimated closed-loop model (ECLM) to estimate the likely future trajectory of the USV and accounts for prediction errors caused by uncertainty by modeling the shape of the USV as a time-varying ellipse. Using an occupancy probability grid as the environment model updated by the LiDAR sensor model, the algorithm utilizes a variable prediction horizon and exponential resolution to discretize the decision space [
103].
Guardeño et al. proposed a new static automatic adjustment environment for obstacle avoidance (ATESOA) method for unmanned surface vehicles (USVs). By using a simplified model of the LiDAR sensor, this environment allows the adaptation of different SOA methods. The proposed ATESOA can be adapted to different SOA methods and used to evaluate the performance of these methods in different scenarios with varying obstacle distributions [
104].
Using a sequential conditional generation adversarial network (seq-cGan), Gao et al. proposed a new method for avoiding ship collisions. To make appropriate anthropomorphic collision avoidance decisions, the proposed method does not require a risk assessment procedure [
105].
4. Discussion and Result
4.1. Difficulties and Limitations
In this paper, we review the use of artificial intelligence-related techniques to achieve active collision avoidance. To build a model using AI-related techniques, a large amount of data is required. According to the above review, artificial intelligence has four major limitations and difficulties when it comes to implementing active collision avoidance technology, including difficulties obtaining data, the complexity of algorithms that meet the needs, hardware limitations, and robustness and security issues.
4.1.1. Difficulty in Accessing Data
For active collision avoidance to be realized, there is a great deal of data support, but obtaining these data is not easy, and it is also necessary to label and process these data, which is also a time-consuming and laborious process. In addition, this problem is a particular challenge associated with the application of deep learning methods in the field of active collision prevention. Here are some of the current limitations in this area:
- (1)
A large amount of data is required to realize active collision avoidance, including vehicle trajectory, traffic light status, road conditions, etc. It is, however, not an easy task to obtain these data since it requires a considerable amount of time and resources, both human and material;
- (2)
A problem with data annotation is that the collected raw data must be annotated and processed, such as annotating the vehicle trajectory, annotating the status of traffic signals, etc., which is also time-consuming and labor-intensive;
- (3)
There are a number of issues related to data quality. For example, there may be uncollected data or noise in the data as a result of weather, light, and other factors. This will also impact the accuracy and stability of an algorithm;
- (4)
Privacy issues: Data collected involve sensitive information such as personal privacy, which must be protected and processed, increasing the difficulty of acquiring and processing the data.
4.1.2. Algorithmic Complexity
Active collision avoidance techniques require the use of complex algorithms for decision-making and prediction, which require high levels of accuracy and stability while simultaneously taking into account a wide range of different situations and factors, making the algorithms more complex and difficult to perform.
- (1)
Active collision avoidance technologies require complex computer vision and image processing algorithms to perceive and understand the environment around the vehicle, including the trajectory of the vehicle, the status of traffic lights, and road conditions;
- (2)
Active collision avoidance technology must make decisions based on the results of environment sensing, such as whether to brake, whether to avoid obstacles, etc., which requires the use of complex algorithms;
- (3)
As part of active collision avoidance technology, the technology must be able to predict and plan for future traffic conditions, such as predicting the trajectory of other vehicles, planning their own routes, etc., which requires the application of complex algorithms for prediction and planning;
- (4)
In order to determine whether it is necessary to brake or avoid obstacles within a few hundred milliseconds, active collision avoidance technology must respond in real-time, for instance, within a few hundred milliseconds. Real-time response algorithms are, therefore, necessary for efficient collision avoidance technology.
4.1.3. Hardware Limitations
In order to implement active collision avoidance technology, hardware devices, such as high-precision sensors and computer processors, must be used, which adds cost and complexity and impacts aspects such as vehicle weight and energy consumption.
- (1)
In order to achieve active collision avoidance technology, high-precision sensors are required, such as LIDAR, cameras, millimeter wave radar, etc. For accurate environmental perception, these sensors should be capable of high accuracy, high resolution, high frame rate, etc;
- (2)
A high-performance computer processor is required to realize active collision avoidance technology, such as GPUs, FPGAs, etc. In order to enable quick data processing and decision-making, these processors must have high speeds, low latency, and high concurrency;
- (3)
In order to implement active collision avoidance technology, a large number of hardware devices will be used, resulting in an increase in the weight and energy consumption of the marine vehicle, which will have an adverse effect on its performance and endurance;
- (4)
Hardware devices, such as high-precision sensors and computer processors, are expensive and add complexity and difficulty to the system, which increases the cost and difficulty of developing an active collision avoidance system.
4.1.4. Robustness and Security
Algorithms based on artificial intelligence are susceptible to adversarial attacks and interference. A number of factors can affect the accuracy and reliability of algorithms, including deceptive sensor inputs and malicious interference. Therefore, it is important to ensure the robustness and security of algorithms.
- (1)
It is possible for attackers to spoof an active collision avoidance system by modifying sensor data in order to generate incorrect decisions. To improve the robustness of the system, it is necessary to detect and filter sensor inputs that appear anomalous, as well as to use multiple sensors for redundant detection;
- (2)
Attackers may attempt to interfere with the normal operation of the AI active collision avoidance system by jamming its communications or control systems. In order to prevent malicious interference and intrusion, it is necessary to strengthen the system’s cybersecurity measures, such as the use of encrypted communication, authentication, and access control techniques.
4.2. Suggestions and Future Prospects
Following the above discussion and analysis, the following suggestions and outlooks are offered.
4.2.1. Recommendations on Data Issues
- (1)
Incorporating advanced sensor technologies, such as LIDAR, cameras, millimeter wave radar, etc., can improve the accuracy and quality of data collection, thereby reducing the difficulty of processing and labeling the data;
- (2)
By developing smarter data labeling and processing algorithms using machine learning and other technologies, the efficiency and accuracy of data labeling and processing can be improved, thereby reducing the difficulty associated with obtaining data;
- (3)
Simulators can be utilized for data acquisition in order to reduce the cost and time of the acquisition process as well as improve the quality of the data acquired;
- (4)
In order to facilitate the circulation and utilization of data, we should promote data sharing and openness. By doing so, the difficulty of acquiring data will be reduced, and the development and application of artificial intelligence will be facilitated.
4.2.2. Recommendations on Algorithmic Issues
- (1)
Improve the accuracy and stability of algorithms by using deep learning technologies: Deep learning technologies are capable of learning features and laws from data automatically, therefore improving the accuracy and stability of algorithms and reducing their complexity;
- (2)
An introduction to multimodal information: Multimodal information can provide richer data sources, including data collected with multiple sensors, such as LIDAR, cameras, millimeter wave radar, etc., enhancing the accuracy and reliability of environment perception.
- (3)
Improve algorithm architecture: Optimizing algorithm architecture can enhance the efficiency and speed of algorithms, for example, by utilizing parallel computing, distributed computing, and other technologies so as to improve their ability to respond in real time.
4.2.3. Recommendations on Hardware Issues
- (1)
New sensor technologies: The development of new sensor technologies, such as microwave radar and infrared sensors, will improve the accuracy and performance of the sensors as well as reduce the cost and energy consumption;
- (2)
Optimization of hardware design: By optimizing hardware design, for example, by using lightweight materials, optimizing circuit design, etc., it is possible to reduce the weight and energy consumption of hardware equipment as well as other aspects of the impact, thus improving the vehicle’s performance and range;
- (3)
Developing computer processors with higher performance and lower power consumption to meet the demand for real-time processing of large amounts of data and execution of complex algorithms. In addition, it may be possible to improve computational efficiency and speed by using techniques based on distributed computing and parallel processing.
4.2.4. Recommendations on Robustness and Security Issues
- (1)
Evaluation and testing of models: It is essential to conduct a comprehensive evaluation and testing of models. There is a need to develop specialized evaluation and testing methods to detect and fix potential vulnerabilities and bugs, as well as to validate the robustness and security of algorithms under different adversarial attacks and interference scenarios;
- (2)
Improve the interpretability and trustworthiness of AI algorithms so that their decision-making processes can be understood and verified. Improve the reliability and acceptability of AI systems through the development of explanation mechanisms, transparency frameworks, and model visualization methods;
- (3)
Development of database technology: Database techniques are used to create training datasets containing data on the marine environment of various types, sizes, and situations. The data may include information regarding the position and speed of the ship, the currents, waves, water depths, weather conditions, as well as many other factors. AI systems can make accurate predictions and decisions by synthesizing these diverse data sets;
- (4)
Using artificial intelligence and machine learning, decision-support systems can analyze data on the marine environment and make recommendations for action based on the specific circumstances of a ship. A system such as this can assist ships in making collective decisions to avoid collisions and provide an additional level of safety;
- (5)
Developing a data-sharing and collaboration platform will allow ships to share and access real-time marine environmental data, as well as promote information sharing and collaboration. The ships will be able to better understand the dynamics of the surrounding ships and make corresponding decisions, thereby improving overall navigational safety.
5. Limitations of the Article
Using a time-tracing approach, this paper examines the development of active collision avoidance at sea as well as some cases of passive and active collision avoidance. The main AI algorithms applied to active collision avoidance techniques are reviewed on this basis in order to provide an overview of the potential of AI approaches to the maritime collision problem. During the review and discussion, some limitations of the development of this field are highlighted, as well as some directions for research, but the review of this paper is biased toward current research status in artificial intelligence algorithms, with a limited focus on real-world application cases. As a result, there are some limitations to the scope of the article.
Author Contributions
Conceptualization, Y.Z. and D.Z.; methodology, Y.Z. and D.Z.; software, D.Z.; validation, D.Z. and Y.Z.; formal analysis, Y.Z. and D.Z.; investigation, H.J. and D.Z.; re-sources, D.Z.; data curation, Y.Z.; writing—original draft preparation, Y.Z.; writing—review and editing, D.Z.; visualization, Y.Z.; supervision, D.Z.; funding acquisition, D.Z. and H.J. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the Program for Scientific Research Start-up Funds of Guangdong Ocean University, grant number 060302072101, the Zhanjiang Marine Youth Talent Project- Comparative Study and Optimization of Horizontal Lifting of Subsea Pipeline, grant number 2021E5011 and the National Natural Science Foundation of China, grant number 62272109.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Jing, G.; Yuan, X.; Song, W. Driving forces on the development of China’s marine economy: Efficiency and spatial perspective. Ocean. Coast. Manag. 2022, 224, 106192. [Google Scholar]
- Zheng, Q.; He, S.; Huang, L.; Zheng, X.; Pan, Y.; Shahtahmassebi, A.R.; Shen, Z.; Yu, Z.; Wang, K. Assessing the impacts of Chinese sustainable ground transportation on the dynamics of Urban growth: A case study of the Hangzhou Bay bridge. Sustainability 2016, 8, 666. [Google Scholar] [CrossRef]
- Li, J.; Jiang, Y.; Guan, W.; Lu, J. Agglomeration effects or port-related benefits? (Re) Location patterns of basic maritime industries: The case of Dalian City, China. Marit. Policy Manag. 2022, 49, 685–701. [Google Scholar] [CrossRef]
- Nan, L.; Luan, W.X.; Jiang, Y.P. Research on the development potential of China’s strategic marine industries--marine engineering equipment manufacturing industry. Adv. Mater. Res. 2013, 694, 3626–3631. [Google Scholar]
- Qian, F.; Sheng, Y. Study on the relationship between modernized economic system construction and transfer and transformation of scientific and technological achievements. In Advances in Intelligent System and Computing, Proceedings of the Thirteenth International Conference on Management Science and Engineering Management, Chisinau, Moldova, 30 July–2 August 2020; Xu, J., Duca, G., Ahmed, S.E., Márquez, F.P.G., Hajiyev, A., Eds.; Springer International Publishing: Cham, Switzerland, 2020; Volume 2. [Google Scholar]
- Xie, L.J.; Jiang, J.C.; Huang, A.C.; Tang, Y.; Liu, Y.C.; Zhou, H.L.; Xing, Z.X. Calorimetric evaluation of thermal stability of organic liquid hydrogen storage materials and metal oxide additives. Energies 2022, 15, 2236. [Google Scholar] [CrossRef]
- Zhang, C.Z.; Xie, L.J.; Tang, Y.; Li, Y.; Jiang, J.C.; Huang, A.C. Thermal Safety Evaluation of Silane Polymer Compounds as Electrolyte Additives for Silicon-Based Anode Lithium-Ion Batteries. Processes 2022, 10, 1581. [Google Scholar] [CrossRef]
- Aminian, E.; Saffari, H. Experimental analysis of dropwise condensation heat transfer on a finned tube: Impact of pitch size. Proc. Inst. Mech. Eng. Part A J. Power Energy 2022, 236, 752–759. [Google Scholar] [CrossRef]
- Aminian, E.; Kamali, M.; Vatanjoo, E.; Saffari, H. Theoretical analysis on condensation heat transfer on microstructured hybrid hydrophobic-hydrophilic tube. Heat Mass Transf. 2022, 58, 1207–1221. [Google Scholar] [CrossRef]
- Senderud, K. Modelling and Analysis of Floating Bridge Concepts Exposed to Environmental Loads and Ship Collision. Master’s Thesis, NTNU (Norwegian University of Science and Technology), Trondheim, Norway, 2018. [Google Scholar]
- Sha, Y.; Amdahl, J.; Dørum, C.; Yu, Z. Numerical investigation of the collision damage and residual strength of a floating bridge girder. In Proceedings of the ASME 2018 37th International Conference on Ocean, Offshore and Arctic Engineering, Madrid, Spain, 17–22 June 2018; American Society of Mechanical Engineers: New York, NY, USA, 2018; Volume 51326. [Google Scholar]
- Wan, L.; Magee, A.R.; Hellan, Ø.; Arnstein, W.; Ang, K.K.; Wang, C.M. Initial design of a double curved floating bridge and global hydrodynamic responses under environmental conditions. In Proceedings of the ASME 2017 36th International Conference on Ocean, Offshore and Arctic Engineering, Trondheim, Norway, 25–30 June 2017; American Society of Mechanical Engineers: New York, NY, USA, 2017; Volume 57779. [Google Scholar]
- Kvåle, K.A.; Øiseth, O.; Rönnquist, A.; Remseth, S. Simulation and Monitoring of Floating Bridge Behaviour. Earthq. Eng. Struct. Dyn. Mem. Ragnar Sigbjörnsson Sel. Top. 2018, 277–296. [Google Scholar]
- Mjaaland, A.L.; Øvstebø, A.M. Dynamic Response of a Multi-Span Suspension Bridge with Floating Pylons. Master’s Thesis, NTNU (Norwegian University of Science and Technology), Trondheim, Norway, 2017. [Google Scholar]
- Chen, X.J.; Yu, W.; Wu, G.H.; Temarel, P.; Liu, J.Y. A static position-adjustment method for the motion prediction of the Flexible Floating Collision-Prevention System. Mar. Struct. 2018, 57, 152–164. [Google Scholar] [CrossRef]
- Baidurya, B.; Basu, R.; Ma, K.-T. Developing target reliability for novel structures: The case of the Mobile Offshore Base. Mar. Struct. 2001, 14, 37–58. [Google Scholar]
- Moe, O.H.; Sha, Y.; Veie, J.; Amdahl, J. Analysis of tether anchored floating suspension bridge subjected to large ship collisions. Procedia Eng. 2017, 199, 2488–2493. [Google Scholar] [CrossRef]
- Wang, W.; Morgenthal, G.; Kraus, M. Numerical evaluation of a novel crashworthy device for pier protection from barge impact. Eng. Struct. 2020, 212, 110535. [Google Scholar] [CrossRef]
- Lu, K.; Chen, X.J.; Gao, Z.; Cheng, L.Y.; Wu, G.H. Initial response mechanism and local contact stiffness analysis of the floating two-stage buffer collision-prevention system under ship colliding. Adv. Struct. Eng. 2021, 24, 2227–2241. [Google Scholar] [CrossRef]
- Chen, W.; Wang, Y.G.; Li, W.; Yang, L.M.; Liu, J.; Dong, X.L.; Zhu, H.H.; Wang, F. An adaptive arresting vessel device for protecting bridges over non-navigable water against vessel collision. Eng. Struct. 2021, 237, 112145. [Google Scholar] [CrossRef]
- Miyoshi, T.; Fujimoto, S.; Rooks, M.; Konishi, T.; Suzuki, R. Rules required for operating maritime autonomous surface ships from the viewpoint of seafarers. J. Navig. 2022, 75, 384–399. [Google Scholar] [CrossRef]
- Howeth Linwood, S. History of Communications Electronics in the United States Navy; US Government Printing Office: Washington, DC, USA, 1963.
- Coales, J.F. The Origins and Development of Radar in the Royal Navy, 1935–1945 with Particular Reference to Decimetric Gunnery Equipments. In The Development of Radar Equipments for the Royal Navy, 1935–1945; Palgrave Macmillan: London, UK, 1935; pp. 5–66. [Google Scholar]
- Bole, A.G.; Wall, A.D.; Norris, A.; Dineley, W.O. Radar and ARPA Manual: Radar and Target Tracking for Professional Mariners, Yachtsmen and Users of Marine Radar; Elsevier: Amsterdam, The Netherlands, 2005. [Google Scholar]
- Wrigley, W. History of inertial navigation. Navigation 1977, 24, 1–6. [Google Scholar] [CrossRef]
- Zinchenko, S.M.; Nosov, P.S.; Mateichuk, V.M.; Mamenko, P.P.; Grosheva, O.O. Use of Navigation Simulator for Development and Testing Ship Control Systems; eKSMAIR: Kherson, Ukraine, 2019. [Google Scholar]
- Bar-Itzhack, I.Y.; Berman, N. Control theoretic approach to inertial navigation systems. J. Guid. Control. Dyn. 1988, 11, 237–245. [Google Scholar] [CrossRef]
- Woodman, O.J. An Introduction to Inertial Navigation, No. UCAM-CL-TR-696; University of Cambridge, Computer Laboratory: Cambridge, UK, 2007. [Google Scholar]
- Tazartes, D. An historical perspective on inertial navigation systems. In Proceedings of the 2014 International Symposium on Inertial Sensors and Systems (ISISS), Laguna Beach, CA, USA, 25–26 February 2014; IEEE: New York, NY, USA, 2014. [Google Scholar]
- Kumar, S.; Moore, K.B. The evolution of global positioning system (GPS) technology. J. Sci. Educ. Technol. 2002, 11, 59–80. [Google Scholar] [CrossRef]
- Perera, L.P.; Ferrari, V.; Santos, F.P.; Hinostroza, M.A.; Soares, C.G. Experimental evaluations on ship autonomous navigation and collision avoidance by intelligent guidance. IEEE J. Ocean. Eng. 2014, 40, 374–387. [Google Scholar] [CrossRef]
- Ahvenjärvi, S. The human element and autonomous ships. TransNav Int. J. Mar. Navig. Saf. Sea Transp. 2016, 10, 517–521. [Google Scholar] [CrossRef]
- Famme, J.B.; Taylor, B. Integration of ship control systems for total ship survivability. Nav. Eng. J. 1992, 104, 210–218. [Google Scholar] [CrossRef]
- Perera, L.P.; Oliveira, P.; Soares, C.G. Maritime traffic monitoring based on vessel detection, tracking, state estimation, and trajectory prediction. IEEE Trans. Intell. Transp. Syst. 2012, 13, 1188–1200. [Google Scholar] [CrossRef]
- Thomas, S.; Howells, G.; Maier, K.M. Autonomous ship collision avoidance navigation concepts, technologies and techniques. J. Navig. 2008, 61, 129–142. [Google Scholar]
- Halterman, R.; Bruch, M. Velodyne HDL-64E lidar for unmanned surface vehicle obstacle detection. In Unmanned Systems Technology XII, Proceedings of the SPIE, Defense, Security and Sensing, Orlando, FL, USA, 7 May 2010; SPIE: Bellingham, WA, USA, 2010; Volume 7692, p. 7692. [Google Scholar]
- Grasty, S.E.; Campbell, M.D.; Matthew, D. Campbell. Understanding and quantifying bias in visual fisheries surveys using advanced technology. Fisheries 2019, 44, 212–215. [Google Scholar] [CrossRef]
- Sable, C.; Abu-Tair, M.; Naeem, W. An automatic COLREGs-compliant obstacle avoidance system for an unmanned surface vehicle. Proc. Inst. Mech. Eng. Part M J. Eng. Marit. Environ. 2014, 228, 108–121. [Google Scholar]
- Chun, D.H.; Roh, M.I.; Lee, H.W.; Ha, J.; Yu, D. Deep reinforcement learning-based collision avoidance for an autonomous ship. Ocean Eng. 2021, 234, 109216. [Google Scholar] [CrossRef]
- He, Y.; Jin, Y.; Huang, L.; Xiong, Y.; Chen, P.; Mou, J. Quantitative analysis of COLREG rules and seamanship for autonomous collision avoidance at open sea. Ocean Eng. 2017, 140, 281–291. [Google Scholar] [CrossRef]
- Emmens, T.; Amrit, C.; Abdi, A.; Ghosh, M. The promises and perils of Automatic Identification System data. Expert Syst. Appl. 2021, 178, 114975. [Google Scholar] [CrossRef]
- Tetreault, B.J. Use of the Automatic Identification System (AIS) for maritime domain awareness (MDA). In Proceedings of the Oceans 2005 MTS/IEEE, Washington, DC, USA, 17–23 September 2005; IEEE: New York, NY, USA, 2005. [Google Scholar]
- Robards, M.D.; Silber, G.K.; Adams, J.D.; Arroyo, J.; Lorenzini, D.; Schwehr, K.; Amos, J. Conservation science and policy applications of the marine vessel Automatic Identification System (AIS)—A review. Bull. Mar. Sci. 2016, 92, 75–103. [Google Scholar] [CrossRef]
- Harati-Mokhtari, A.; Wall, A.; Brooks, P.; Wang, J. Automatic Identification System (AIS): Data reliability and human error implications. J. Navig. 2007, 60, 373–389. [Google Scholar] [CrossRef]
- Saravanan, K.; Aswini, S.; Kumar, R.; Son, L.H. How to prevent maritime border collision for fisheries?-A design of Real-Time Automatic Identification System. Earth Sci. Inform. 2019, 12, 241–252. [Google Scholar] [CrossRef]
- Schryver, J.C. Evaluation of Automatic Radar Plotting Aids (ARPA) Display Modes and Traffic Assessment through CAORF Simulation of Collision Avoidance Situations, No. CAORF-13-8128-02; Maritime Administration: Washington, DC, USA, 1983. [Google Scholar]
- Ma, F.; Wu, Q.; Yan, X.; Chu, X.; Zhang, D. Classification of automatic radar plotting aid targets based on improved fuzzy C-means. Transp. Res. Part C: Emerg. Technol. 2015, 51, 180–195. [Google Scholar] [CrossRef]
- Weintrit, A. The Electronic Chart Display and Information System (ECDIS): An Operational Handbook; CRC Press: Boca Raton, FL, USA, 2009. [Google Scholar]
- Rutkowski, G. ECDIS limitations, data reliability, alarm management and safety settings recommended for passage planning and route monitoring on VLCC tankers. TransNav Int. J. Mar. Navig. Saf. Sea Transp. 2018, 12, 6. [Google Scholar] [CrossRef]
- van Westrenen, F. Modelling arrival control in a vessel traffic management system. Cogn. Technol. Work 2014, 16, 501–508. [Google Scholar] [CrossRef]
- Khanday, A.M.U.D.; Khan, Q.R.; Rabani, S.T. Detecting textual propaganda using machine learning techniques. Baghdad Sci. J. 2021, 18, 199. [Google Scholar] [CrossRef]
- Marco, D.; Birattari, M.; Stutzle, T. Ant colony optimization. IEEE Comput. Intell. Mag. 2006, 1, 28–39. [Google Scholar]
- Blum, C. Ant colony optimization: Introduction and recent trends. Phys. Life Rev. 2005, 2, 353–373. [Google Scholar] [CrossRef]
- Escario, J.B.; Jimenez, J.F.; Giron-Sierra, J.M. Optimisation of autonomous ship manoeuvres applying ant colony optimisation metaheuristic. Expert Syst. Appl. 2012, 39, 10120–10139. [Google Scholar] [CrossRef]
- Lazarowska, A. Ship’s trajectory planning for collision avoidance at sea based on ant colony optimisation. J. Navig. 2015, 68, 291–307. [Google Scholar] [CrossRef]
- Wang, H.; Guo, F.; Yao, H.; He, S.; Xu, X. Collision avoidance planning method of USV based on improved ant colony optimization algorithm. IEEE Access 2019, 7, 52964–52975. [Google Scholar] [CrossRef]
- Jun, F.; Lv, T.; Li, B. Underwater submarine path planning based on artificial potential field ant colony algorithm and velocity obstacle method. Sensors 2022, 22, 3652. [Google Scholar]
- Aghababa, M.P.; Amrollahi, M.H.; Borjkhani, M. Application of GA, PSO, and ACO algorithms to path planning of autonomous underwater vehicles. J. Mar. Sci. Appl. 2012, 11, 378–386. [Google Scholar] [CrossRef]
- Liu, X.; Li, Y.; Zhang, J.; Zheng, J.; Yang, C. Self-adaptive dynamic obstacle avoidance and path planning for USV under complex maritime environment. IEEE Access 2019, 7, 114945–114954. [Google Scholar] [CrossRef]
- Dongshu, W.; Tan, D.; Liu, L. Particle swarm optimization algorithm: An overview. Soft Comput. 2018, 22, 387–408. [Google Scholar]
- Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the ICNN’95-International Conference on Neural Networks, Perth, WA, Australia, 27 November–1 December 1995; IEEE: New York, NY, USA, 1995; Volume 4. [Google Scholar]
- Pedersen, M.E.H.; Chipperfield, A.J. Simplifying particle swarm optimization. Appl. Soft Comput. 2010, 10, 618–628. [Google Scholar] [CrossRef]
- Liu, L.; He, D.; Ma, Y.; Li, T.; Li, J. Research on ships collision avoidance based on chaotic particle swarm optimization. Advances in Smart Vehicular Technology, Transportation, Communication and Applications. In Proceedings of the First International Conference on Smart Vehicular Technology, Transportation, Communication and Applications, Kaohsiung, Taiwan, 6–8 November 2017; Springer International Publishing: Cham, Switzerland, 2018. [Google Scholar]
- Wang, K.; Yan, X.; Yuan, Y.; Jiang, X.; Lodewijks, G.; Negenborn, R.R. PSO-based method for safe sailing route and efficient speeds decision-support for sea-going ships encountering accidents. In Proceedings of the 2017 IEEE 14th International Conference on Networking, Sensing and Control (ICNSC), Calabria, Italy, 16–18 May 2017; IEEE: New York, NY, USA, 2017. [Google Scholar]
- Kang, Y.T.; Chen, W.J.; Zhu, D.Q.; Wang, J.H.; Xie, Q.M. Collision avoidance path planning for ships by particle swarm optimization. J. Mar. Sci. Technol. 2018, 26, 3. [Google Scholar]
- Zhuang, Y.; Sharma, S.; Subudhi, B.; Huang, H.; Wan, J. Efficient collision-free path planning for autonomous underwater vehicles in dynamic environments with a hybrid optimization algorithm. Ocean. Eng. 2016, 127, 190–199. [Google Scholar] [CrossRef]
- Mirjalili, S. Genetic algorithm. Evolutionary Algorithms and Neural Networks: Theory and Applications; Springer: Berlin/Heidelberg, Germany, 2019; pp. 43–55. [Google Scholar]
- Sourabh, K.; Chauhan, S.S.; Kumar, V. A review on genetic algorithm: Past, present, and future. Multimed. Tools Appl. 2021, 80, 8091–8126. [Google Scholar]
- Tsou, M.C.; Kao, S.L.; Su, C.M. Decision support from genetic algorithms for ship collision avoidance route planning and alerts. J. Navig. 2010, 63, 167–182. [Google Scholar] [CrossRef]
- Masanori, I.; Zhnng, F.; Yoshida, N. Collision avoidance control of ship with genetic algorithm. In Proceedings of the 1999 IEEE International Conference on Control Applications (Cat. No. 99CH36328), Kohala Coast, HI, USA, 22–27 August 1999; IEEE: New York, NY, USA, 1999; Volume 2. [Google Scholar]
- Wang, L.; Zhang, Z.; Zhu, Q.; Ma, S. Ship route planning based on double-cycling genetic algorithm considering ship maneuverability constraint. Ieee Access 2020, 8, 190746–190759. [Google Scholar] [CrossRef]
- Cheng, X.D.; Liu, Z.Y.; Zhang, X.T. Trajectory optimization for ship collision avoidance system using genetic algorithm. In Proceedings of the OCEANS 2006-Asia Pacific, Singapore, 16–19 May 2006; IEEE: New York, NY, USA, 2006. [Google Scholar]
- Alberto, A.; Caiti, A.; Onken, R. Evolutionary path planning for autonomous underwater vehicles in a variable ocean. IEEE J. Ocean. Eng. 2004, 29, 418–429. [Google Scholar]
- Co-Reyes, J.D.; Miao, Y.; Peng, D.; Real, E.; Levine, S.; Le, Q.V.; Lee, H.; Faust, A. Evolving reinforcement learning algorithms. arXiv 2021, arXiv:2101.03958. [Google Scholar]
- Wang, Q.; Zhongli, Z. Reinforcement learning model, algorithms and its application. In Proceedings of the 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC), Jilin, China, 19–22 August 2011; IEEE: New York, NY, USA, 2011. [Google Scholar]
- Oh, J.; Hessel, M.; Czarnecki, W.M.; Xu, Z.; van Hasselt, H.P.; Singh, S.; Silver, D. Discovering reinforcement learning algorithms. Adv. Neural Inf. Process. Syst. 2020, 33, 1060–1070. [Google Scholar]
- Chu, Z.; Wang, F.; Lei, T.; Luo, C. Path planning based on deep reinforcement learning for autonomous underwater vehicles under ocean current disturbance. IEEE Trans. Intell. Veh. 2022, 8, 108–120. [Google Scholar] [CrossRef]
- Zheng, R.; Hongwei, X.; Kexin, Y. Autonomous collision avoidance system in a multi-ship environment based on proximal policy optimization method. Ocean. Eng. 2023, 272, 113779. [Google Scholar]
- Zhou, C.; Wang, Y.; Wang, L.; He, H. Obstacle avoidance strategy for an autonomous surface vessel based on modified deep deterministic policy gradient. Ocean. Eng. 2022, 243, 110166. [Google Scholar] [CrossRef]
- Xu, X.; Lu, Y.; Liu, G.; Cai, P.; Zhang, W. COLREGs-abiding hybrid collision avoidance algorithm based on deep reinforcement learning for USVs. Ocean. Eng. 2022, 247, 110749. [Google Scholar] [CrossRef]
- Etemad, M.; Zare, N.; Sarvmaili, M.; Soares, A.; Brandoli Machado, B.; Matwin, S. Using deep reinforcement learning methods for autonomous vessels in 2d environments. In Advances in Artificial Intelligence, Proceedings of the 33rd Canadian Conference on Artificial Intelligence, Canadian AI 2020, Ottawa, ON, Canada, 13–15 May 2020, Proceedings 33; Springer International Publishing: Cham, Switzerland, 2020. [Google Scholar]
- Zhang, X.; Wang, C.; Liu, Y.; Chen, X. Decision-making for the autonomous navigation of maritime autonomous surface ships based on scene division and deep reinforcement learning. Sensors 2019, 19, 4055. [Google Scholar] [CrossRef]
- Wang, C.; Zhang, X.; Yang, Z.; Bashir, M.; Lee, K. Collision avoidance for autonomous ship using deep reinforcement learning and prior-knowledge-based approximate representation. Front. Mar. Sci. 2023, 9. [Google Scholar] [CrossRef]
- Yunsheng, F.; Sun, Z.; Wang, G. A novel reinforcement learning collision avoidance algorithm for USVs based on maneuvering characteristics and COLREGs. Sensors 2022, 22, 2099. [Google Scholar]
- Luman, Z.; Roh, M.-I.; Lee, S.-J. Control method for path following and collision avoidance of autonomous ship based on deep reinforcement learning. J. Mar. Sci. Technol. 2019, 27, 1. [Google Scholar]
- Wang, S.C.; Wang, S.C. Artificial neural network. Interdiscip. Comput. Java Program. 2003, 81–100. [Google Scholar]
- Krogh, A. What are artificial neural networks? Nat. Biotechnol. 2008, 26, 195–197. [Google Scholar] [CrossRef]
- Jinming, Z.; Han, Y.; So, S.-S. Overview of artificial neural networks. In Artificial Neural Networks: Methods and Applications; Humana Press: Totowa, NJ, USA, 2009; pp. 14–22. [Google Scholar]
- Zhang, Z. Artificial neural network. In Multivariate Time Series Analysis in Climate and Environmental Research; Springer: Berlin/Heidelberg, Germany, 2018; pp. 1–35. [Google Scholar]
- Hassoun, M.H. Fundamentals of Artificial Neural Networks; MIT Press: Cambridge, MA, USA, 1995. [Google Scholar]
- Steven, W. Artificial neural networks. In Advanced Methodologies and Technologies in Artificial Intelligence, Computer Simulation, and Human-Computer Interaction; IGI Global: Hershey, PA, USA, 2019; pp. 40–53. [Google Scholar]
- Priddy, K.L.; Keller, P.E. Artificial Neural Networks: An Introduction; SPIE Press: Bellingham, WA, USA, 2005; Volume 68. [Google Scholar]
- Dave, A.; McNeill, G. Artificial neural networks technology. Kaman Sci. Corp. 1992, 258, 1–83. [Google Scholar]
- Simsir, U.; Amasyalı, M.F.; Bal, M.; Çelebi, U.B.; Ertugrul, S. Decision support system for collision avoidance of vessels. Appl. Soft Comput. 2014, 25, 369–378. [Google Scholar] [CrossRef]
- Namgung, H.; Jeong, J.S.; Kim, J.S.; Kim, K.I. Inference model of collision risk Index based on artificial neural network using ship near-collision data. J. Phys. Conf. Ser. 2019, 1357. [Google Scholar] [CrossRef]
- Yilmaz, N.K.; Evangelinos, C.; Lermusiaux, P.F.; Patrikalakis, N.M. Path planning of autonomous underwater vehicles for adaptive sampling using mixed integer linear programming. IEEE J. Ocean. Eng. 2008, 33, 522–537. [Google Scholar] [CrossRef]
- Gao, M.; Shi, G.Y. Ship-collision avoidance decision-making learning of unmanned surface vehicles with automatic identification system data based on encoder—Decoder automatic-response neural networks. J. Mar. Sci. Eng. 2020, 8, 754. [Google Scholar] [CrossRef]
- Gong, Y.J.; Huang, T.; Ma, Y.N.; Jeon, S.W.; Zhang, J. MTrajPlanner: A Multiple-Trajectory Planning Algorithm for Autonomous Underwater Vehicles. IEEE Trans. Intell. Transp. Syst. 2023, 24, 3714–3727. [Google Scholar] [CrossRef]
- Kozynchenko, A.I.; Kozynchenko, S.A. Applying the dynamic predictive guidance to ship collision avoidance: Crossing case study simulation. Ocean. Eng. 2018, 164, 640–649. [Google Scholar] [CrossRef]
- Mahmoud Zadeh, S.; Yazdani, A.M.; Sammut, K.; Powers, D.M. Online path planning for AUV rendezvous in dynamic cluttered undersea environment using evolutionary algorithms. Appl. Soft Comput. 2018, 70, 929–945. [Google Scholar] [CrossRef]
- Liu, L.; Zhang, Y.; Hu, Y.; Wang, Y.; Sun, J.; Dong, X. A hybrid-clustering model of ship trajectories for maritime traffic patterns analysis in port area. J. Mar. Sci. Eng. 2022, 10, 342. [Google Scholar] [CrossRef]
- Hu, Y.; Zhang, A.; Tian, W.; Zhang, J.; Hou, Z. Multi-ship collision avoidance decision-making based on collision risk index. J. Mar. Sci. Eng. 2020, 8, 640. [Google Scholar] [CrossRef]
- Guardeño, R.; López, M.J.; Sánchez, J.; González, A.; Consegliere, A. A robust reactive static obstacle avoidance system for surface marine vehicles. Sensors 2020, 20, 6262. [Google Scholar] [CrossRef] [PubMed]
- Guardeño, R.; López, M.J.; Sánchez, J.; Consegliere, A. AutoTuning environment for static obstacle avoidance methods applied to USVs. J. Mar. Sci. Eng. 2020, 8, 300. [Google Scholar] [CrossRef]
- Gao, M.; Shi, G.Y. Ship collision avoidance anthropomorphic decision-making for structured learning based on AIS with Seq-CGAN. Ocean. Eng. 2020, 217, 107922. [Google Scholar] [CrossRef]
| Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).