1. Introduction
Marine transportation has rapidly grown in recent years, and cross-national trade has become more and more frequent. In this context, the maritime transportation industry has substantially facilitated the development of the global economy, while ship intelligence is widely expected to play a central role in improving efficiency [
1,
2]. However, with the increasing demand for maritime traffic, the marine environment has become more complex and crowded, which significantly increases the risk of marine traffic accidents. In the meantime, authoritative maritime accident investigations elaborate that human failures cause about 80% of marine accidents [
3,
4]. Most intelligent decision-making tools for ships were designed to limit the occurrence of maritime traffic accidents and ensure navigation safety. In particular, the ability to plan a reasonable path while providing emergency decision making is an essential guarantee in ship driving, which is regarded as a core competency of ship intelligence. On this occasion, collision avoidance is also a critical research field for many maritime experts and scholars [
5,
6].
In this paper, the fast marching (FM) method is chosen due to its good performance in both situation modeling and path planning [
7,
8], and the collision avoidance problem for ships in complex restricted waters is considered. In general, both static and dynamic obstacles are included in complex restricted waters, which is significantly different from that in open waters [
9,
10]. The presence of static obstacles (such as shorelines, islands, etc.) and the limitation of water depth significantly reduce the navigable area. In this situation, the collision avoidance solutions in open waters may lead to a potential risk of conflicting with shorelines or shallows. Frequently used path planning algorithms generate solutions only according to the current situation, which is quite different from human navigators. An experienced ship navigator always makes appropriate decisions in navigation based on reasonable anticipations and inferences. Therefore, it is vital to consider the evolution of the navigational situation when providing collision avoidance paths. The real challenge is to accurately model such evolution.
To address these issues, a novel collision avoidance path planning method based on FM was proposed, which considers spatial–temporal interaction effects. At the same time, a novel model was introduced to simulate the situation anticipation of human navigators. The main contribution of the proposed path planning method for autonomous ships are as follows: (1) the FM method is used to create a unified obstacle representation model that is specifically designed to describe the path planning space in complex waters; (2) the spatial–temporal interaction effects of dynamic obstacles are considered and integrated into the construction of planning space; and (3) a path optimization technique based on the trajectory prediction of dynamic objects is put forward for improved flexibility.
The rest of this paper is organized as follows. In
Section 2, typical path planning algorithms are reviewed and analyzed.
Section 3 describes the flow chart of the path planning approach and the detail of path planning and optimization. Several simulations are conducted in
Section 4 to validate the proposed approach.
Section 5 concludes this paper and discusses future research.
2. Literature Review
With the development of the shipping industry, more and more academics have focused on the path planning of autonomous ships. Currently, path planning algorithms for ships can be classified into three categories: traditional algorithms, bionic intelligence–based algorithms, and machine learning–based algorithms.
The A*, velocity obstacle (VO) and artificial potential field (APF) algorithms are the most common traditional path planning methods. He et al. [
11] devised a dynamic path planning method for collision avoidance based on the A* algorithm and ship navigation rules. The results of the experiments reveal that the method may provide more reasonable paths in complex scenarios to trade-off navigation risk and economic efficiency. However, the planned routes are rarely smooth enough for ships to follow. Zhang et al. [
12] combined the VO algorithm and the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs) to create a path planning method that allows ships to operate safely in a dynamic environment. The simulation results indicate that the method is capable of giving a deterministic and effective path for collision avoidance in a variety of encounter situations. Nonetheless, in some circumstances, the VO may generate a local minimum solution. Petres et al. [
13] used the APF algorithm to construct a virtual gravitational field to steer the ship to the target waypoint in a complex navigation environment. Zhu et al. [
14] proposed a novel path planning algorithm for ship automatic collision avoidance based on a modified APF method considering the constraints of both the COLREGs and the motion characteristics of the ship. Experimental results reveal that the proposed method is accurate and reliable, and satisfies the demands of engineering applications. Despite the fact that the APF has the advantages of simple algorithm structure and high computational efficiency, it is easy to fall into local minimum and target point oscillation.
The genetic algorithm (GA), ant colony optimization (ACO) algorithm and particle swarm optimization (PSO) algorithm are examples of bionic intelligence–based path planning methods. Ning et al. [
15] developed a global search path planning technique by merging the multi-objective decision theory with the GA. Experimental results demonstrate that the path planning strategy is quite effective at collision avoidance. Lyridis [
16] developed an improved ACO with fuzzy logic to deal with local path planning of unmanned surface vehicles (USVs) by taking into account wind, current, wave, and dynamic obstacles. Experiments reveal that the modified algorithm achieves a faster convergence speed. Zhao et al. [
17] demonstrated a hybrid multi-criteria ship routing method based on an improved PSO algorithm. The strategy tries to optimize the meteorological risk, fuel consumption, and navigation time associated with a ship. Experiments show that the route planning algorithm can create a number of possible paths while ensuring safety, environmental friendliness, and economic viability. It serves as a resource for captains and shipping companies when deciding on a route. Kang et al. [
18] adopted the PSO algorithm to produce the shortest path from the start point to the goal point. Simulation results show that the algorithm is capable of obtaining a COLREGs-compliant and practical navigation path for all four traffic scenarios. However, such bionic intelligence algorithms typically require more prior information and a considerable amount of calculation, which leads to issues such as long calculation time and local minimum; therefore, they are primarily utilized in auxiliary decision-making systems rather than autonomous navigation systems.
Reinforcement learning (RL) based path planning algorithms are the most prevalent form of machine learning–based path planning methods. Chen et al. [
19] proposed a Q-learning–based path planning and maneuvering approach for unmanned cargo ships. This method can achieve the best behavioral strategy through training and learning. However, this solution cannot solve the problem of high-dimensional space, and a large q-table may result in slow convergence. Zhou et al. [
20] suggested a deep reinforcement learning (DRL) based path planning method for USVs integrating the motion model and collision risk assessment mechanism. The algorithm was tested in both virtual and physical environments. Zhang et al. [
21] offered a hierarchical DRL autonomous navigation decision model to implement ship path planning in the port environment. The experimental findings show that the DRL algorithm may significantly improve the safety of ships and the ability of obstacle avoidance. Woo et al. [
22] proposed a DRL-based decision-making algorithm to realize the path planning of collision avoidance. A visual grid map representation and a COLREGs-based reward function were specially designed for the approach. Despite the DRL’s excellent learning ability and stability, the disparity between the training world and the real world makes the DRL-based solutions challenging to apply.
In summary, although there are numerous path planning methods, few of them can provide appropriate solutions for collision avoidance in complex restricted waters. On the one hand, a unified planning space representation model, which is the fundament of path planning algorithms, needs to be established in advance for both static (shorelines, islands, etc.) and dynamic (target ships or TSs) obstacles. On the other hand, the trajectory prediction of the moving object needs to be further investigated to acquire a path optimization strategy. In order to address the above issues, this research constructs a unified representation model by configuring different FM speed functions for static and dynamic obstacles, and then formulates a path optimization strategy with the help of trajectory prediction. Through the above improving measures, the proposed method can provide a collision-free path, while ensuring the safety and economy of autonomous ships in complex scenarios.
3. A Proposed Approach
This research proposes a novel path planning approach for ship collision avoidance considering spatial–temporal interaction effects. To elaborate the approach in detail, this section describes how it works while planning a path. First of all, the flow chart of the suggested method is introduced in detail. Secondly, in order to describe the situation of navigation scenarios, the planning space representation is designed for both static and dynamic obstacles. Eventually, a path planning approach is put forward with an optimization scheme.
3.1. Flow Chart of the Approach
The flow chart of the discussed method and its algorithmic presentation is shown in
Figure 1. There are five main steps in the proposed method as follows:
Step 1 is to set the FM method parameters, which is the basis of planning space representation.
Step 2 is to plan a preliminary path. In this step, the route is scheduled based on an initial representation of the planning space and used to predict the own ship’s (OS’s) trajectory.
Step 3 is to forecast the minimum relative distance and the corresponding time. In this procedure, the accuracy of the trajectory prediction of the own ship (OS) and TSs directly affects the efficiency of path planning results.
Step 4 is to determine the encounter situation, which is the foundation for path optimization.
Step 5 is to re-plan the path for collision avoidance.
After that, if the planned path cannot be further optimized and is safe enough, it will be applied for collision avoidance. Otherwise, it is necessary to go back to Step 3 or Step 1 for the path planning updating process.
3.2. Planning Space Representation
Safety is always one of the priority issues for ships in path planning problems. In order to generate safe trajectories, it is necessary to correctly represent the environment in which the path planning algorithm executes, which is especially crucial for ship navigation in complex environments. A suitable safety distance between the OS and obstacles (static and dynamic) during the entire voyage should always be maintained. This section describes the FM-based planning space representation for static and dynamic obstacles.
3.2.1. Fast Marching (FM) Method
The FM method was first proposed by Sethian [
23] to solve the eikonal equation by using a single-pass algorithm. The eikonal equation is defined as follows:
where
represents the point in metric space, i.e.,
in 2D space and
in 3D space.
denotes the travel time of interface front at point
, whereas
indicates the local propagating speed at point
.
The FM method calculates the value at every point in accordance with a strategy that is similar to the Dijkstra algorithm [
24]. In addition, the FM method is usually applied on a grid map with three categories of points: (1) Far points, which denote the points at which the interface front has not yet arrived, and whose travel times are not yet computed; (2) Trial points, which represent the points at which the front will arrive soon, and whose travel times have already been calculated but may be updated in later computations; and (3) Accepted points, which indicate the points that the front has already passed, and whose travel times will not be changed.
Starting from the original Accepted point, the travel times of the points on the grid map are iteratively calculated. In the beginning, all points of the grid map are marked as Far points and infinity travel times, and the start point is marked as the Accepted point, whose arrival time is set to zero. During each iteration, points adjacent to the Accepted point are marked as Trial points, and travel times of these points are calculated. After that, the Trial point with the shortest travel time will be marked as the Accepted point, and a new iteration begins. This strategy is based on the fact that the travel time
at any point only depends on the neighboring points. In fact, such neighboring points generally have smaller values. The specific calculation process refers to [
7,
8].
In this research, the FM method is used to model the planning space with different local propagating speed function .
3.2.2. Static Obstacle Representation
There are numerous static obstacles in offshore and inland waters, including shorelines, islands, buoys, etc., which reduce the collision-free area and threaten the navigation safety of ships. Therefore, it is of great essence to model the risk of static obstacles. Considering the same distribution of risk surrounding static obstacles, when applying the FM method to static obstacle representation, the speed function
is generally set to a constant value (e.g.,
equals 1). Furthermore, different safety distance thresholds can be configured according to different application scenarios. As shown in
Figure 2a, it is the binary map, which includes static obstacles such as coastlines and several islands.
Figure 2b is an example of the static obstacle representation called
whose distance threshold
is 100 m. The dark color denotes a high level of risk, and the light represents a low level of risk. Once the distance threshold is determined, the representation of static obstacles at time
is constant, i.e.,
.
3.2.3. Dynamic Obstacle Representation
The representation of dynamic obstacles in the path planning space has been of great interest. In order to ensure the consistency of planning space, the FM method is also adopted to represent the dynamic obstacles in this research. However, constant speed functions are not suitable considering the fact that different directions around dynamic obstacles have different risk distributions. Therefore, a specific speed function has been devised as illustrated in
Figure 3.
is the angle relative to the course of a dynamic obstacle, and
is the speed function of the FM method used for dynamic obstacles, which is defined as follows:
where the values of
and
depend on
. There are four different cases: Case 1,
,
and
are set to
and
, respectively; Case 2,
,
is equal to
and
is equal to
; Case 3,
,
and
are, respectively,
and
; Case 4,
,
a equals to
, and the corresponding
equals
. In addition, the safety distance thresholds in the four directions of the bow, starboard, stern, and port are denoted with
,
,
, and
, respectively, and meet the following conditions:
Based on the above model, the representations called
of dynamic obstacles are easy to be modeled. As shown in
Figure 4, the representation of a dynamic obstacle is modeled with different configurations.
Figure 4a shows the representation with a configuration that
,
,
, and
are set to 4.0, 1.0, 1.0, and 1.0, respectively, and the corresponding safety distance thresholds
,
,
, and
are
,
,
and
. As for
Figure 4b, the parameter
and distance threshold
are changed to 1.5 and 75 m. The choice of the above parameters is partially inspired by the work in [
25].
The representation of dynamic obstacles at time is labeled with . Different from static obstacles, the representation of dynamic obstacles varies over time, which means that is usually not equal to when .
3.3. Path Planning Approach
In this section, the proposed path planning method is detailed in-depth. Firstly, the trajectories of OS and target ship (TS) are predicted. Then, a preliminary path is produced. Finally, an iterative calculation is performed to obtain a better path.
3.3.1. Trajectory Prediction of OS and TS
The trajectory prediction of OS is based on the assumption that OS travels along the path at a constant speed. It should be noted that the path points are parameterized with arc length from the start point [
26]. Then, a path can be denoted with
, where
is a point on the path and the corresponding
is the arc length of the path between the current and the start points. Hence, the trajectory of OS can be characterized as follows:
where
is the predicted position of OS at time
, and
indicates the velocity of OS. When
,
equals
, which means that the OS is located at the start point of the current path.
In addition, the trajectory prediction of TS is also significant for collision avoidance [
27,
28]. The most basic and widely used method for predicting the trajectory of TS is based on the premise that the TS maintains its velocity and ignores external environmental disturbances [
27]. In this work, such a trajectory prediction method is adopted. Therefore, the trajectory of TS based on the position of TS at time
can be defined as follows:
where
denotes the predicted position of TS at time
, and
indicates the known position of TS at time
.
is the velocity of TS.
It is worth noting that the external environmental disturbances and the collision avoidance intentions are not included in the present trajectory prediction methods. However, once a new trajectory prediction method is achieved, it can directly replace the current method without any additional effort.
3.3.2. Preliminary Planning
The path planning approach can be divided into three steps. The first step is to compute the planning space representation
. Based on the
, in step two, the FM method is executed from the start point to generate a joint potential field, namely, the travel time map [
8]. The last step is to produce the path based on the joint potential field by applying a gradient descent algorithm.
Based upon the representation of static and dynamic obstacles mentioned above, the preliminary planning space representation
at time
can be calculated as follows:
Then, the preliminary path
can be produced according to
. As shown in
Figure 5a, the solid red line is the preliminary path planned in a crossing scenario.
3.3.3. Path Optimization
Since the path is generated based on the position of dynamic obstacles at the current moment, there may still be a potential risk for the OS navigating along this path. Hence, a path optimization method needs to be specified for the safety of the OS. The proposed path optimization scheme can be summed up in the following steps:
Step 1 is to predict the trajectories and based on Equations (4) and (5) and path .
Step 2 is to calculate the minimum relative distance and the corresponding time based on the trajectories of OS and TS.
Step 3 is to forecast the position at time of TS with Equation (5).
Step 4 is to update the dynamic obstacle representation based on and regenerate the planning space representation with Equation (6).
Step 5 is to plan the new path for collision avoidance.
The proposed path optimization is an iterative process. The iteration will be finished when the minimum relative distance converges to the maximum and meets the safety requirements of OS. Otherwise, it is necessary to reconfigure the parameters of the FM method and re-execute the path planning algorithm.
Figure 5b shows the path optimization process. The three iteratively generated paths
,
, and
are denoted by the solid red, solid green, and solid blue lines, respectively.
5. Conclusions
In this research, a novel path planning method for ship collision avoidance has been developed using the FM method and trajectory prediction. The introduction of different speed functions for the FM method ensures that the representation of a complex scenario with static and dynamic obstacles can be modelled in a unified space. In addition, a path optimization scheme integrated trajectory prediction has been designed, ensuring that a reasonable collision-free path in complex restricted waters can always be found. Such a path planning strategy can potentially support autonomous ships to undertake missions with improved intelligence.
In terms of future work, one possible improvement is that the navigation rules should be considered more comprehensively. Usually, a collision avoidance decision should be made by adhering to the COLREGs. Only several rules in COLREGs are considered and discussed in our research. Therefore, it is of great significance to consider a complete rule system and establish a corresponding mathematical model. In addition, a more precise and practical rule-constrained trajectory prediction algorithm will considerably improve the performance of the proposed path planning approach.
Another potential improvement is to find an appropriate strategy to configure the parameters of the FM speed function in practical environmental constraints. As discussed previously, the static obstacle has a constant speed function, and the dynamic obstacle has an anisotropic speed function. The key distinction between dynamic and static obstacles is velocity. Hence, it is necessary to take the velocity of obstacles into consideration when selecting parameters for the FM speed function. In practice, the historical data of ship encounters can be a direct clue in the searching of parameters’ values.