Next Article in Journal
Editorial: Biomedical Data in Human–Machine Interaction
Next Article in Special Issue
An Improved Genetic Algorithm for the Recovery System of USVs Based on Stern Ramp Considering the Influence of Currents
Previous Article in Journal
Detection of Water Contaminants by Organic Transistors as Gas Sensors in a Bottom-Gate/Bottom-Contact Cross-Linked Structure
Previous Article in Special Issue
An H-GrabCut Image Segmentation Algorithm for Indoor Pedestrian Background Removal
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Trajectory Planner for UAVs Based on Potential Field Obtained by a Kinodynamic Gene Regulation Network

1
College of Engineering, Shantou University, Shantou 515063, China
2
Key Laboratory of Intelligent Manufacturing Technology, Shantou University, Ministry of Education, Shantou 515063, China
3
International Cooperation Base of Evolutionary Intelligence and Robotics, Shantou University, Shantou 515063, China
*
Authors to whom correspondence should be addressed.
Sensors 2023, 23(18), 7982; https://doi.org/10.3390/s23187982
Submission received: 29 July 2023 / Revised: 12 September 2023 / Accepted: 12 September 2023 / Published: 20 September 2023

Abstract

:
Quadrotor unmanned aerial vehicles (UAVs) often encounter intricate environmental and dynamic limitations in real-world applications, underscoring the significance of proficient trajectory planning for ensuring both safety and efficiency during flights. To tackle this challenge, we introduce an innovative approach that harmonizes sophisticated environmental insights with the dynamic state of a UAV within a potential field framework. Our proposition entails a quadrotor trajectory planner grounded in a kinodynamic gene regulation network potential field. The pivotal contribution of this study lies in the amalgamation of environmental perceptions and kinodynamic constraints within a newly devised gene regulation network (GRN) potential field. By enhancing the gene regulation network model, the potential field becomes adaptable to the UAV’s dynamic conditions and its surroundings, thereby extending the GRN into a kinodynamic GRN (K-GRN). The trajectory planner excels at charting courses that guide the quadrotor UAV through intricate environments while taking dynamic constraints into account. The amalgamation of environmental insights and kinodynamic constraints within the potential field framework bolsters the adaptability and stability of the generated trajectories. Empirical results substantiate the efficacy of our proposed methodology.

1. Introduction

The successful implementation of autonomous drone navigation has immense value in scientific studies and various industries as it liberates their applications from limitations and paves the way for diverse deployments. Despite this progress, the pursuit of safe and efficient navigation in unknown environments poses significant challenges. To achieve secure and efficient navigation, it is of paramount importance for drones to accurately represent and effectively utilize environmental information during trajectory planning.
A widely adopted technique for representing the distance between a quadrotor and objects in its environment is the Euclidean signed distance field (ESDF), which utilizes gradients. The ESDF has proven to be effective in motion planning for single-agent scenarios, providing valuable insights for autonomous navigation.
Nevertheless, it has limitations in certain application scenarios. For instance, its ability to represent all objects in an environment as obstacles may not adequately capture the complexity of cooperative swarm motions or environments with multiple layers of semantic information. This limitation impedes the successful completion of flight tasks in complex scenarios.
To address these challenges, this study proposed a novel gradient potential field, termed the kino-gene regulatory network (K-GRN) potential field, which is based on a GRN model. By considering the kinematic state of a quadrotor, the objective was to enhance trajectory planning and improve the overall navigation performance. Additionally, we introduced the K-GRN planner, which is a local trajectory planning framework that leverages the kinodynamic GRN potential field to generate optimized flight paths.
Inspired by the intricate interactions observed in organisms, a GRN model was used to generate a gradient potential field. This approach has found extensive application in swarm robot morphology generation and serves as a foundation for the development of autonomous systems. Based on the previous work by Li [1], who utilized the GRN potential field for shape generation and cooperative motion of a swarm of drones without communication, this study further enhanced the potential field by incorporating the kinematic state of the robots. This enhancement enabled the design of a local trajectory planning framework using the proposed potential field, thereby ensuring improved navigation capabilities.
The contributions of this study are as follows. First, we propose an improved GRN potential field that demonstrates its applicability in achieving safe and efficient trajectory planning for drones. Second, we introduce the incorporation of the kinematic characteristics of agents, enabling the extension of the potential field from a spatial domain to a state space, thus, enriching navigation capabilities. Finally, based on these contributions, we establish constraint rules for the trajectory search and develop a comprehensive framework for local planning that further enhances the overall navigation system.
The remainder of this paper is organized as follows. In Section 2, we present a comprehensive review of the related work, encompassing GRN, trajectory planning for unmanned aerial vehicles (UAVs) in positional environments, and the application of bio-inspired algorithms in UAV navigation. Section 3 outlines the enhancements made to the GRN potential field and presents the framework of the proposed method. We present a real-time planning algorithm based on the K-GRN potential field in Section 4. In Section 5, we describe the experimental setup and results for validating the effectiveness of our proposed approach. Finally, in Section 6, we present the conclusions by summarizing the key findings and contributions and provide insights into potential avenues for future research and development.

2. Related Work

2.1. GRN Model in UAV Control

In recent years, GRNs have attracted considerable attention in the design of control methods for robot control [2,3]. Taylor et al. [4] introduced a GRN–cell adhesion model (CAM) control method that combines a CAM with a GRN model. This approach enables the spatial and temporal differentiation of protein expression across swarm robots, which are treated as artificial cells with virtual membranes and artificial cell adhesion molecules. Guo et al. [5,6] applied a GRN model to generate adaptive patterns for swarm robots. Each robot possessed two genes that produced proteins to control its movements in the x and y directions via GRN mechanisms. These proteins enabled the robots to move within the boundaries of predefined shapes.
Furthermore, evolutionary algorithms are utilized to optimize robot motion parameters. However, this method relies on global coordinates, which are often challenging for robots to obtain in real-world applications. To address this issue, Guo et al. [7] proposed a GRN-based method for selecting a reference robot and establishing a local coordinate system. Each robot contributed to the formation of an uneven B-spline pattern using a local coordinate system. Building on this local coordinate system, Jin et al. [8] introduced a hierarchical gene regulatory network (H-GRN) for adaptive pattern generation, specifically for trapping targets in dynamic environments. Oh et al. [9] expanded an H-GRN model to achieve area coverage. To address the challenges related to merging and separating patterns during multi-target entrapment and obstacle avoidance, Oh et al. [10] proposed an enhanced H-GRN (EH-GRN) structure that incorporates obstacles and targets as inputs and evolves the GRN to generate a morphogen gradient space. Similarly, Meng and Guo [11] introduced an evolving GRN method to adjust the structure and parameters of the GRN.
Recently, Wu et al. [12] proposed a collaborative GRN (C-GRN) model that enables peer collaboration between agents. This model enables agents to discover and reinforce weak areas in the formed patterns. Yuan et al. [13] combined a tracking-based H-GRN with a leader–follower model and introduced a TH-GRN model that is suitable for dynamic and complex environments. Fan et al. [14] used a genetic programming approach to design a design automation framework for the gene regulatory network.
In summary, the utilization of a GRN is widespread for generating gradient fields that depict environmental information and direct robot movement. However, the current studies either rely solely on gradient information to guide robot behavior or address a GRN method as a distinct upper-level structure, separate from a lower-level planning controller.
The proposed GRN structure is based on VG-Swarm [1] improvement, which expands the dimensions of the GRN potential field and incorporates the state space of drones. We designed a real-time trajectory-planning method specifically tailored to this framework.

2.2. Bio-Inspired Path Planning

Bio-inspired algorithms have recently attracted substantial attention owing to their efficacy in solving complex optimization problems while maintaining balance among their components. In the domain of path planning problems, studies have increasingly focused on harnessing the power of bio-inspired algorithms to optimize these problems [15,16,17,18].
Swarm intelligence is derived from the self-organizational behavior observed in biological systems inspired by this swarm intelligence, we have developed a number of swarm intelligence algorithms, among which the most notable are particle swarm optimization (PSO) and ant colony optimization (ACO). For example, Phung et al. [19] proposed an enhanced discrete PSO algorithm tailored to UAV inspection path planning. They replaced the inspection path-planning problem with a solution derived from the extended traveling salesman problem. ACO, originally introduced by Dorigo et al. in 1999 [20], enables ants to cooperatively discover the shortest path between a nest and its food sources using pheromone guidance. Nonetheless, both the ACO and PSO algorithms encounter challenges related to slow convergence speeds when the computational complexity rapidly increases, which is undesirable for real-time planning in complex environments.
Another noteworthy bio-inspired algorithm is the evolutionary algorithm. Sun et al. employed an adaptive multi-objective differential evolution (DE) algorithm in a multi-robot system [21]. Patlea et al. presented an improved genetic algorithm (GA) that employed a binary code matrix for mobile robot navigation in complex environments [22]. However, similar to the ACO and PSO algorithms, the time complexity of evolutionary algorithms is typically high, posing obstacles to achieving real-time performance in complex environments.
One limitation of the bio-inspired algorithms is their lack of effectiveness in real-time path-planning problems. This is because of the requirement for the learning processes, such as the modification of path selection probabilities using an objective function, as observed in ant colony optimization. Among these bio-inspired methods, a GRN model offers a superior option because of its capability to generate gradient fields in real-time. For the first time, we introduced a real-time trajectory planning framework using a potential field generated from a GRN model.

2.3. UAVs Navigation with Gradient Field

Gradient-based motion planning is the dominant approach for generating local trajectories in UAVs, formulating the motion planning as an unconstrained nonlinear optimization problem. The introduction of the Euclidean signed distance field (ESDF) in robotic motion planning by Ratliff et al. [23] has enabled planning frameworks to directly optimize trajectories in a configuration space using its abundant gradient information. However, discrete-time trajectory optimization [23,24] is unsuitable for drones because of its sensitivity to dynamic constraints. To address this limitation, a continuous-time polynomial trajectory optimization method for UAV planning was proposed by [25]. Despite its merits, the method carries a significant computational burden due to the integration of the potential function, and even with random restarts, the success rate of this method approximates only 70%. To address these challenges, Ratliff et al. [23] introduced a B-spline parameterization of trajectories leveraging convex hull properties. In [26], the success rate was significantly improved by finding a collision-free initial path as the front end, and further improvements were made by considering the kinodynamic constraints [27]. Zhou et al. [28] enhanced system robustness by incorporating perception awareness. Among these approaches, the ESDF is crucial in evaluating the distance to nearby obstacles based on the gradient magnitude and direction.
Oleynikova [29] and Han [30] proposed incremental methods for ESDF generation, namely, Voxblox and FIESTA, respectively. Although these methods are highly efficient for dynamic updating, they only provide information on obstacles and neglect other important environmental information in the generated ESDF. Therefore, there is a substantial need to design a gradient field for real-time trajectory planning that can effectively represent environmental information as comprehensively as possible.

3. Kinodynamic GRN Potential Field

Our method improves upon the framework of a GRN model in a VG-Swarm [1], as shown in Figure 1. Within this enhanced framework, the method for computing the GRN concentration in each cell is calculated through Equations (1)–(6).
d T i d t = 2 T i + γ i T i
d O j d t = 2 O j + β j O j
d N m d t = 2 N m + η m N m
N = m = 1 n n N m T = i = 1 n t T i O = j = 1 n o O j
d M d t = M + sig 1 T 2 , θ , k + sig O 2 , θ , k + sig N 2 , θ , k
sig ( x , θ , k ) = 1 1 + e k ( x θ )
γ i , β j , and η m are positive numbers representing the position of the target, obstacles, and neighboring UAVs, respectively. T i represents the protein concentration formed by the i t h target in the environment ( γ i stands for the position information of the i t h target), O j represents the protein concentration formed by the j t h obstacle ( β j stands for the position information of the j t h obstacle), and N m represents the protein concentration formed by the m t h neighboring UAV ( η m stands for the position information of the m t h neighboring UAV). T, O, and N are the combined concentrations produced by all the targets, obstacles, and neighbors, respectively. ∇ is the Laplace operator, which is defined as the second derivative of T i , O j , and N m . The concentration field obtained by calculating M is used to generate entrapping patterns.
Equations (1) and (2) can be revised to Equations (7) and (8), respectively, which are crucial operations in the GRN model for generating a gradient field.
T i = e t d t a r , i
O j = e t d o b s , j
where d t a r , i represents the Euclidean distance between the agent and the i t h target, and d o b s , j represents the distance between the agent and the j t h obstacle. Notably, the VG-Swarm considers only the distance between the objects and agents during the guidance control process. To address this limitation, we propose a specialized GRN method for trajectory planning called kinodynamic GRN. Unlike the VG-Swarm, the kinodynamic GRN introduces the concept of the state transition cost. We assume that any point within the grid can serve as an intermediate node for UAV movement. By sampling the states of these intermediate nodes, denoted by X k + 1 ( p , v ) , we can calculate the state transition costs to the obstacle and target nodes, denoted by L X k + 1 , X o b s and L X k + 1 , X t a r , respectively. These costs can be expressed using Equations (9) and (10).
L x k + 1 , x tar = 0 τ k + 1 , t a r u k + 1 , tar d t + ρ τ k + 1 , tar
L x k + 1 , x o b s = 0 τ k + 1 , o b s u k + 1 , o b s d t + ρ τ k + 1 , o b s
where u k + 1 , t a r and τ k + 1 , t a r , respectively, represent the optimal input and optimal time required to transition from the state X k + 1 to the target state. They are determined using the Pontryagin minimum principle, as expressed in Equation (11).
p μ * ( t ) = 1 6 α μ t 3 + 1 2 β μ t 2 + v μ c + p μ c α μ β μ = 1 T 3 12 6 T 6 T 2 T 2 p μ g p μ c v μ c T v μ g v μ c J * ( T ) = μ { x , y , z } 1 3 α μ 2 T 3 + α μ β μ T 2 + β μ 2 T
Next, the Euclidean distance in Equations (7) and (8) is replaced by the state transition cost, as expressed by Equations (9) and (10), thereby forming the protein concentration expressions (Equations (12) and (13)) for environmental information in the kinodynamic GRN potential field.
T i = e t L x k + 1 , x t a r
O j = e t L x k + 1 , x o b s
In the path-planning process, we also consider the current state of the agent to ensure that the planned path is executable. Hence, the current kinematic state of an individual drone, denoted as X k , is considered. We define the forward cost, L X k , X k + 1 , using Equation (14), which represents the cost of transitioning from state X k to X k + 1 .
L x k , x k + 1 = 0 τ k , k + 1 u k , k + 1 d t + ρ τ k , k + 1
Finally, the generation of the potential field is expressed using Equations (15)–(19), where M k + 1 denotes the protein concentration in the sampled state X k + 1 .
T = i = 1 n t T i , O = j = 1 n o O j
J 0 = e t L x k , x k + 1
M k + 1 = sig 1 T 2 , θ , k + sig O 2 , θ , k + sig 1 J 0 2 , θ , k
sig ( x , θ , k ) = 1 1 + e k ( x θ )
As illustrated in Algorithm 1, during the construction of the K-GRN potential field, the grid map needs to be initialized first. Following that, the grids within M are iterated over, during which the state sampling occurs to acquire candidate states. Subsequently, these candidate states within each grid are revisited to compute their associated costs and integrate them into the GRN model. This process ultimately yields concentration information for the specific candidate states at that particular position.
Algorithm 1 Generation of K-GRN Field
Notation: Concentration M, Environment E cost L State X e ;
Initialize:   M l n i t M a p ( M , X )
1:
for  M i in M: do
2:
    for  X i in X k + 1 : do
3:
         ( L X k + 1 , X t a r ) EvaluateCostToTarget ( X j , E )
4:
         ( L X k + 1 , X o b s ) EvaluateCostToObstacle ( X j , E )
5:
         ( L X k , X k + 1 ) EvaluateCostTolnstance ( X j , E )
6:
        if ¬ isCollsionFree() then
7:
                M ( i , j ) CulculateKGRNConcentration ( L X k + 1 , X t a r , L X k + 1 , X o b s , L X k , X k + 1 )
8:
        else
9:
              SetlnfConcentration ( M ( i , j ) )
10:
        end if
11:
    end for
12:
end for
13:
return M
In this context, M constitutes an assortment of state samples within specific ranges across each grid of the map, indicating the concentration of K-GRN at that position under that particular state. E encompasses environmental data, which include obstacles, objectives, and optionally, neighboring drones. X represents the state of the UAV, wherein X k signifies the present state, X k + 1 denotes the sampled candidate state, and X o b s and X t a r , respectively, refer to the states when the drone encounters an obstacle and when it reaches the target destination. L embodies the cost associated with state transitions, wherein the subscripts of L align with the originating state and the terminal state.
In summary, the K-GRN potential field is a specialized set of potentials crafted for the purpose of trajectory planning. In comparison to the alternative approaches, the potential field molded by K-GRN can embrace a wider array of environmental data, incorporating elements such as obstacles, target points, and neighboring information. It formulates distinct potential fields surrounding these elements to effectively steer the trajectory planning procedure. Furthermore, K-GRN factors in more intricate state information across multiple dimensions, encompassing both the UAV’s current state and the projected future states. This holistic approach ensures the traceability of trajectories and significantly elevates the safety standards for the drone.

4. Trajectory Planner Based on K-GRN Potential Field

As mentioned in Section 3, the concentration gradient field of the K-GRN incorporates both environmental information and kinematic considerations to facilitate trajectory planning. However, maintaining a continuous gradient field throughout the planning process can be computationally demanding and impractical, especially for real-time planning in dynamic environments. To address this challenge and improve planner efficiency, we propose a sampling-based approach. Instead of computing the concentration values for all the grid cells, we selectively sample the grid points of interest within the drone’s feasible input range. These sampled points represent potential locations that can be navigated by the drone. By focusing on these points, we can significantly reduce the computational burden and calculate the concentration information efficiently. This approach enables us to strike a balance between computational efficiency and the accurate representation of the environmental information necessary for effective trajectory planning.
A flowchart of the trajectory planner is shown in Figure 2. Initially, a grid map is created in which each grid cell is affected by the protein concentration produced by objects in the environment, including the targets and obstacles. The current input u τ and its corresponding time τ for the drone are sampled. The cost of the drone executing a trajectory segment is computed using the sampled final state. The path with the lowest cost is selected, and the search process is continued until the vicinity of the target is reached.

5. Experiments

The simulation experiments were conducted using UE4 to evaluate the performance of the proposed approach, which can incorporate a wide range of realistic physical models and introduce the various challenges to drone flight. We designed six different scenes, each with two levels of obstacle density, as shown in Figure 3. In each experiment, the obstacles were randomly generated to ensure a diverse and dynamic environment. The navigation task was repeated 100 times for each scene to obtain statistically significant results. In each trial, a random target point within a distance range of 15–20 m was set for the drone. The success or failure of the task was determined based on whether the drone successfully reached the target without colliding with obstacles or experiencing a crash. Through these experiments, we assessed the robustness and effectiveness of the proposed trajectory planner in various challenging scenarios.
To evaluate the effect of different gradient fields on trajectory generation, we conducted experiments to compare various approaches. Specifically, our proposed method was compared against two other approaches: one that utilizes the ESDF-based method, which derives its potential field formation from [30], and another that does not incorporate a potential field at all, as described in [31]. The experimental results are presented in Table 1. In the table, EF refers to the planning method using ESDF, while NF refers to the planning method that does not use potential fields. "Success" is defined as the drone’s capability to traverse from the starting point to the endpoint (within a proximity of roughly 0.3 m) in a jungle setting without colliding with obstacles.
Notably, the proposed method, which integrated both environmental and state information, required a slightly longer computation time than the compared methods. However, the paths generated by the proposed approach strike a balance between safety and efficiency. We observed significant improvements in both the success rate of the trajectory execution and the average flight speed of the drone compared with the benchmark methods. These findings demonstrate the effectiveness of the proposed approach in generating trajectories that consider both safety and efficiency. Despite the slightly longer computation time, the benefits gained in terms of the improved success rate and flight speed render the proposed method a favorable choice for trajectory planning in dynamic environments.
We have also conducted experiments to showcase the efficacy of integrating the dynamics information of drones and their candidate points into the potential field. This underscores the essentiality of evolving from GRN to K-GRN, as presented in Table 2. In the table, KF refers to the planning method that integrates kinematic information into the potential field, while NKF refers to other potential field planning methods that do not include dynamic information. NF is a planning method that does not use potential fields. In the identical scenario and utilizing the same experimental approach, we conducted a comparative analysis of the proposed approach, which involves the K-GRN potential field, against the performance of the GRN potential field without the integration of motion dynamics. Additionally, we contrasted these with navigation task planning methods that do not rely on potential fields. The experimental results underscore a distinct advantage in navigation success rates for the trajectory planning method guided by K-GRN. As previously discussed in this paper, one of the key advantages of K-GRN over other approaches lies in its ability to ensure trajectory traceability, thus bolstering drone safety. Concerning the time of generating potential field t f i e l d , our method shows a minor drawback in terms of the duration needed for potential field formation. However, when evaluating the overall planning time, which encompasses both t f i e l d and t p l a n , we still maintain a significant edge over alternative planning methods. Despite the slightly longer computational time required for potential field generation, the proposed method demonstrated superior performance in terms of the navigation task success rate and planning time compared with the other two methods. This highlights the effectiveness of the proposed approach in dynamic environments and its potential as an ideal choice for trajectory planning.
To evaluate the effectiveness of our trajectory planning framework, we compared it with two state-of-the-art methods: the Ego-planner [31] and the Fast-planner [28]. The Fast-Planner utilizes the ESDF for path search and incorporates the kinematic information in the search process, whereas the Ego-planner proposes a real-time planning method that does not rely on the ESDF. We conducted a series of experiments on six scenes with two obstacle-density levels. Both benchmark methods were open-source, and we used their default parameters for the experiments.
Table 3 presents a comparison between K-GRN and two state-of-the-art (SOTA) methods across two distinct scenarios. In this context, employing the same experimental methodology, we conducted separate comparisons of the drone’s navigation success rates, average flight speeds, and planned trajectory lengths under each condition.
Across all scenes, our proposed method significantly outperformed the two benchmark methods in terms of both success rates and average speeds. This demonstrates the effectiveness of the proposed approach in achieving successful navigation while maintaining rapid flight speed. However, our paths tended to be slightly longer than those generated by the other methods, due to our emphasis on flight safety. This trade-off ensures a higher level of safety during the flight.
Furthermore, Figure 4 displays the real-time speed variations among the three algorithms in dense scenes. It is worth highlighting that the presented algorithm showcases notably seamless speed transitions across the entire navigation journey. The pronounced speed reduction captured in the graph aligns with the drone executing obstacle avoidance maneuvers. While navigating through an identical course, our approach strategically adopts a safer path-planning strategy, prioritizing the avoidance of densely wooded narrow passages. Consequently, despite generating a lengthier route, this is a paramount benefit of our method.
To evaluate the practical efficacy of the K-GRN planner, we conducted relevant simulation experiments. The simulation environment was designed to replicate a real jungle scenario. In this scenario, we had the drone shuttles through the jungle. As shown in Figure 5, the UAV’s obstacle avoidance process, guided by the K-GRN planner, is depicted. It is clear that the drone could detect obstacles in advance, perform evasive maneuvers, and navigate successfully while maintaining a safe distance from the obstacles. Figure 6 displays the trajectory of the drone as it shuttles through the jungle environment.
In summary, our proposed method outperformed the benchmark methods in terms of success rate and average speed across various obstacle-density scenarios. The experimental results validated the superiority of the proposed approach, highlighting its potential to advance the field of UAV trajectory planning.

6. Conclusions

In this study, we have introduced an improved GRN potential field, termed the K-GRN potential field, specifically designed for trajectory planning. This potential field incorporates the costs of state transitions for intelligent agents to assist planners in generating smooth and efficient trajectories. Additionally, we have designed a planner that searches for the optimal trajectory using input sampling, requiring only a search for the path with the lowest cost within the established potential field. Through benchmark comparisons, we have validated the advantages of incorporating the state space in the GRN potential fields, the effectiveness of the K-GRN potential field in trajectory planning, and the performance of the K-GRN-guided planner compared with state-of-the-art methods. The results demonstrated that the proposed method offered superior paths in terms of both safety and effectiveness for drone flight.
Our approach also displays specific limitations: Driven by safety considerations, we embraced a cautious planning strategy, which results in a difficulty in devising optimal paths within complex scenarios. Similarly, due to this rationale, despite attaining advantages in average speed, our method encountered difficulties in outperforming the SOTA approach with regards to the highest planned speed. In forthcoming endeavors, we aim to enhance the K-GRN methodology by integrating adaptive planning strategies, thereby enabling it to demonstrate diverse obstacle avoidance performances across a spectrum of scenario complexities. Furthermore, we aim to extend the application of the K-GRN potential fields to drone swarm missions and explore their application in achieving cooperative flight in environments without communication capabilities.

Author Contributions

Conceptualization, J.H., W.L. and Z.F.; methodology, J.H., D.C. and Z.F.; software, J.H. and D.C.; validation, J.H., D.C., Z.F. and W.L.; formal analysis, J.H. and D.C.; investigation, J.H. and D.C.; resources, J.H.; data curation, D.C.; writing—original draft preparation, J.H., D.C., Z.F. and W.L.; writing—review and editing, J.H., D.C., Z.F. and W.L.; visualization, J.H. and D.C.; supervision, Z.F. and W.L.; project administration, J.H., D.C., Z.F. and W.L.; funding acquisition, J.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported in part by the National Key R&D Program of China (grant number 2021ZD0111501, 2021ZD0111502), the Key Laboratory of Digital Signal and Image Processing of Guangdong Province, the Key Laboratory of Intelligent Manufacturing Technology (Shantou University), Ministry of Education, the Science and Technology Planning Project of Guangdong Province of China (grant number 180917144960530), the Project of Educational Commission of Guangdong Province of China (grant number 2017KZDXM032), the State Key Lab of Digital Manufacturing Equipment & Technology (grant number DMETKF2019020), National Natural Science Foundation of China (grant number 62176147), STU Scientific Research Foundation for Talents (grant number NTF21001), Science and Technology Planning Project of Guangdong Province of China (grant number 2019A050520001, 2021A0505030072, 2022A1515110660), Science and Technology Special Funds Project of Guangdong Province of China (grant number STKJ2021176, STKJ2021019), and Guangdong Special Support Program for Outstanding Talents (2021JC06X549).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
UAVUnmanned aerial vehicles
GRNGene regulation network
K-GRNKinodynamic GRN
ESDFEuclidean signed distance field
CAMCell adhesion model
GRN-CAMGene regulation network-cell adhesion model
H-GRNHierarchical GRN
EH-GRNEnhanced H-GRN
C-GRNCollaborative GRN
TH-GRNTracking-based H-GRN
VG-SwarmA vision-based gene regulation network For UAVs swarm behavior emergence
PSOParticle swarm optimization
ACOAnt colony optimization
DEDifferential evolution
GAGenetical algorithm
UE4Unreal engine 4
KFKinodynamic GRN field
NKFGRN Field Without Kinodynamic

References

  1. Li, H.; Cai, Y.; Hong, J.; Xu, P.; Cheng, H.; Zhu, X.; Hu, B.; Hao, Z.; Fan, Z. VG-Swarm: A Vision-Based Gene Regulation Network for UAVs Swarm Behavior Emergence. IEEE Robot. Autom. Lett. 2023, 8, 1175–1182. [Google Scholar] [CrossRef]
  2. Guo, H.; Meng, Y.; Jin, Y. Self-adaptive multi-robot construction using gene regulatory networks. In Proceedings of the 2009 IEEE Symposium on Artificial Life, Nashville, TN, USA, 3 March–2 April 2009; pp. 53–60. [Google Scholar]
  3. Guo, H.; Jin, Y.; Meng, Y. A morphogenetic framework for self-organized multirobot pattern formation and boundary coverage. ACM Trans. Auton. Adapt. Syst. (TAAS) 2012, 7, 15. [Google Scholar] [CrossRef]
  4. Taylor, T.; Ottery, P.; Hallam, J. Pattern Formation for Multi-Robot Applications: Robust, Self-Repairing Systems Inspired by Genetic Regulatory Networks and Cellular Self-Organisation; Tech. Rep. EDI-INF-RR-0971; University of Edinburgh: Edinburgh, UK, 2007. [Google Scholar]
  5. Guo, H.; Meng, Y.; Jin, Y. A cellular mechanism for multi-robot construction via evolutionary multi-objective optimization of a gene regulatory network. BioSystems 2009, 98, 193–203. [Google Scholar] [CrossRef] [PubMed]
  6. Jin, Y.; Guo, H.; Meng, Y. Robustness analysis and failure recovery of a bio-inspired self-organizing multi-robot system. In Proceedings of the 2009 Third IEEE International Conference on Self-Adaptive and Self-Organizing Systems, San Francisco, CA, USA, 14–18 September 2009; pp. 154–164. [Google Scholar]
  7. Guo, H.; Meng, Y.; Jin, Y. Swarm robot pattern formation using a morphogenetic multi-cellular based self-organizing algorithm. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 3205–3210. [Google Scholar]
  8. Jin, Y.; Guo, H.; Meng, Y. A hierarchical gene regulatory network for adaptive multirobot pattern formation. IEEE Trans. Syst. Man, Cybern. Part B 2012, 42, 805–816. [Google Scholar]
  9. Oh, H.; Jin, Y. Adaptive swarm robot region coverage using gene regulatory networks. In Proceedings of the Advances in Autonomous Robotics Systems: 15th Annual Conference, TAROS 2014, Birmingham, UK, 1–3 September 2014; Proceedings 15. Springer: Berlin/Heidelberg, Germany, 2014; pp. 197–208. [Google Scholar]
  10. Oh, H.; Jin, Y. Evolving hierarchical gene regulatory networks for morphogenetic pattern formation of swarm robots. In Proceedings of the 2014 IEEE Congress on Evolutionary Computation (CEC), Beijing, China, 6–11 July 2014; pp. 776–783. [Google Scholar]
  11. Meng, Y.; Guo, H. Evolving network motifs based morphogenetic approach for self-organizing robotic swarms. In Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation, Philadelphia, PA, USA, 7–11 July 2012; pp. 137–144. [Google Scholar]
  12. Wu, M.; Zhou, Y.; Zhu, X.; Ma, L.; Yuan, Y.; Fang, T.; Wang, J.; Bao, W.; Fan, Z. Cooperation-based gene regulatory network for target entrapment. In Proceedings of the Advances in Swarm Intelligence: 10th International Conference, ICSI 2019, Chiang Mai, Thailand, 26–30 July 2019; Proceedings, Part I 10. Springer: Berlin/Heidelberg, Germany, 2019; pp. 60–69. [Google Scholar]
  13. Yuan, Y.; Fan, Z.; Zhu, X.; Wu, M.; Ma, L.; Fang, T.; Wang, Z.; Bao, W.; Zhou, Y.; Chen, H.; et al. Th-grn model based collective tracking in confined environment. In Proceedings of the Advances in Swarm Intelligence: 10th International Conference, ICSI 2019, Chiang Mai, Thailand, 26–30 July 2019; Proceedings, Part II 10. Springer: Berlin/Heidelberg, Germany, 2019; pp. 33–43. [Google Scholar]
  14. Fan, Z.; Wang, Z.; Li, W.; Zhu, X.; Hu, B.; Zou, A.M.; Bao, W.; Gu, M.; Hao, Z.; Jin, Y. Automated pattern generation for swarm robots using constrained multi-objective genetic programming. Swarm Evol. Comput. 2023, 81, 101337. [Google Scholar] [CrossRef]
  15. Borges, C.D.B.; Almeida, A.M.A.; Júnior, I.C.P.; Junior, J.J.d.M.S. A strategy and evaluation method for ground global path planning based on aerial images. Expert Syst. Appl. 2019, 137, 232–252. [Google Scholar] [CrossRef]
  16. Peng, Y.; Li, S.W.; Hu, Z.Z. A self-learning dynamic path planning method for evacuation in large public buildings based on neural networks. Neurocomputing 2019, 365, 71–85. [Google Scholar] [CrossRef]
  17. Huang, Y.; Chen, J.; Wang, H.; Su, G. A method of 3D path planning for solar-powered UAV with fixed target and solar tracking. Aerosp. Sci. Technol. 2019, 92, 831–838. [Google Scholar] [CrossRef]
  18. Saha, O.; Dasgupta, P.; Woosley, B. Real-time robot path planning from simple to complex obstacle patterns via transfer learning of options. Auton. Robot. 2019, 43, 2071–2093. [Google Scholar] [CrossRef]
  19. Phung, M.D.; Quach, C.H.; Dinh, T.H.; Ha, Q. Enhanced discrete particle swarm optimization path planning for UAV vision-based surface inspection. Autom. Constr. 2017, 81, 25–33. [Google Scholar] [CrossRef]
  20. Dorigo, M.; Maniezzo, V.; Colorni, A. Ant system: Optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. Part B 1996, 26, 29–41. [Google Scholar] [CrossRef] [PubMed]
  21. Sun, Z.; Wu, J.; Yang, J.; Huang, Y.; Li, C.; Li, D. Path planning for GEO-UAV bistatic SAR using constrained adaptive multiobjective differential evolution. IEEE Trans. Geosci. Remote Sens. 2016, 54, 6444–6457. [Google Scholar] [CrossRef]
  22. Patle, B.; Parhi, D.; Jagadeesh, A.; Kashyap, S.K. Matrix-Binary Codes based Genetic Algorithm for path planning of mobile robot. Comput. Electr. Eng. 2018, 67, 708–728. [Google Scholar] [CrossRef]
  23. Ratliff, N.; Zucker, M.; Bagnell, J.A.; Srinivasa, S. CHOMP: Gradient optimization techniques for efficient motion planning. In Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan, 12–17 May 2009; pp. 489–494. [Google Scholar]
  24. Kalakrishnan, M.; Chitta, S.; Theodorou, E.; Pastor, P.; Schaal, S. STOMP: Stochastic trajectory optimization for motion planning. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 4569–4574. [Google Scholar]
  25. Oleynikova, H.; Burri, M.; Taylor, Z.; Nieto, J.; Siegwart, R.; Galceran, E. Continuous-time trajectory optimization for online uav replanning. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Republic of Korea, 9–14 October 2016; pp. 5332–5339. [Google Scholar]
  26. Gao, F.; Lin, Y.; Shen, S. Gradient-based online safe trajectory generation for quadrotor flight in complex environments. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 24–28 September 2017; pp. 3681–3688. [Google Scholar]
  27. Ding, W.; Gao, W.; Wang, K.; Shen, S. An efficient b-spline-based kinodynamic replanning framework for quadrotors. IEEE Trans. Robot. 2019, 35, 1287–1306. [Google Scholar] [CrossRef]
  28. Zhou, B.; Pan, J.; Gao, F.; Shen, S. Raptor: Robust and perception-aware trajectory replanning for quadrotor fast flight. IEEE Trans. Robot. 2021, 37, 1992–2009. [Google Scholar] [CrossRef]
  29. Oleynikova, H.; Taylor, Z.; Fehr, M.; Siegwart, R.; Nieto, J. Voxblox: Incremental 3d euclidean signed distance fields for on-board mav planning. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 24–28 September 2017; pp. 1366–1373. [Google Scholar]
  30. Han, L.; Gao, F.; Zhou, B.; Shen, S. Fiesta: Fast incremental euclidean distance fields for online motion planning of aerial robots. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, 3–8 November 2019; pp. 4423–4430. [Google Scholar]
  31. Zhou, X.; Wang, Z.; Ye, H.; Xu, C.; Gao, F. Ego-planner: An esdf-free gradient-based local planner for quadrotors. IEEE Robot. Autom. Lett. 2020, 6, 478–485. [Google Scholar] [CrossRef]
Figure 1. Schematic of the structure of the vision-based GRN. Each cell represents an individual UAV and is composed of an upper and lower layer. In the upper layer, sensory proteins p 1 , p 2 , and p 3 receive information about the positions of targets, obstacles, and neighboring robots, respectively, forming corresponding concentration fields. Protein M 1 integrates the concentration field from p 1 and p 2 , while protein M 2 integrates the concentration field from M 1 and p 3 . These proteins influence the production of actuating proteins G 1 and G 2 in the lower layer, which, respectively, represent entrapping patterns and the moving direction of the UAV. G 1 and G 2 also affect the production of protein P, which ultimately determines the dynamic position of the UAV. Moreover, protein P in one cell influences the gene expression of the neighboring cells in the system.
Figure 1. Schematic of the structure of the vision-based GRN. Each cell represents an individual UAV and is composed of an upper and lower layer. In the upper layer, sensory proteins p 1 , p 2 , and p 3 receive information about the positions of targets, obstacles, and neighboring robots, respectively, forming corresponding concentration fields. Protein M 1 integrates the concentration field from p 1 and p 2 , while protein M 2 integrates the concentration field from M 1 and p 3 . These proteins influence the production of actuating proteins G 1 and G 2 in the lower layer, which, respectively, represent entrapping patterns and the moving direction of the UAV. G 1 and G 2 also affect the production of protein P, which ultimately determines the dynamic position of the UAV. Moreover, protein P in one cell influences the gene expression of the neighboring cells in the system.
Sensors 23 07982 g001
Figure 2. Flow diagram of the trajectory planner.
Figure 2. Flow diagram of the trajectory planner.
Sensors 23 07982 g002
Figure 3. Illustrations of the two different scenes with varying obstacle densities. (a) Dense jungle scene. (b) Sparse jungle scene.
Figure 3. Illustrations of the two different scenes with varying obstacle densities. (a) Dense jungle scene. (b) Sparse jungle scene.
Sensors 23 07982 g003
Figure 4. Real-time Velocity Variation of UAV during the Experiment: (a) Velocity Curve of GRN-planner. (b) Velocity Curve of Fast-planner. (c) Velocity Curve of Ego-planner.
Figure 4. Real-time Velocity Variation of UAV during the Experiment: (a) Velocity Curve of GRN-planner. (b) Velocity Curve of Fast-planner. (c) Velocity Curve of Ego-planner.
Sensors 23 07982 g004
Figure 5. (ac): Obstacle avoidance trajectories of a drone guided by the K-GRN planner in a jungle scenario.
Figure 5. (ac): Obstacle avoidance trajectories of a drone guided by the K-GRN planner in a jungle scenario.
Sensors 23 07982 g005
Figure 6. Trajectories of the drone as it shuttles through the jungle environment.
Figure 6. Trajectories of the drone as it shuttles through the jungle environment.
Sensors 23 07982 g006
Table 1. Effect of Different Gradient Fields on Trajectory Generation.
Table 1. Effect of Different Gradient Fields on Trajectory Generation.
PolicySuccess RateMax Velocity (m/s)Average Velocity (m/s)Slove Time (ms)
EF0.694.132.656.55
NF0.643.812.471.49
GRN0.723.932.716.88
The numbers in bold represent the optimal data for this column.
Table 2. Performance Comparison of Different Planning Methods After Incorporating UAV Kinematics Information into GRN Potential Field.
Table 2. Performance Comparison of Different Planning Methods After Incorporating UAV Kinematics Information into GRN Potential Field.
PolicySuccess Rate t field (ms) t plan (ms)
KF0.725.220.91
NKF0.694.884.47
NF0.5502.90
The numbers in bold represent the optimal data for this column.
Table 3. Comparison of UAV Navigation Performance in Scenes with Different Obstacle Densities.
Table 3. Comparison of UAV Navigation Performance in Scenes with Different Obstacle Densities.
Dense SceneSparse Scene
PolicySuccess RateAverage Velocity (m/s)Trajectory Length (m)Success RateAverage Velocity (m/s)Trajectory Length (m)
GRN-planner0.562.0171.290.722.7158.13
Fast-planner0.471.9565.760.692.6555.43
Ego-planner0.531.8867.180.642.4749.90
The numbers in bold represent the optimal data for this column.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hong, J.; Chen, D.; Li, W.; Fan, Z. Trajectory Planner for UAVs Based on Potential Field Obtained by a Kinodynamic Gene Regulation Network. Sensors 2023, 23, 7982. https://doi.org/10.3390/s23187982

AMA Style

Hong J, Chen D, Li W, Fan Z. Trajectory Planner for UAVs Based on Potential Field Obtained by a Kinodynamic Gene Regulation Network. Sensors. 2023; 23(18):7982. https://doi.org/10.3390/s23187982

Chicago/Turabian Style

Hong, Juncao, Diquan Chen, Wenji Li, and Zhun Fan. 2023. "Trajectory Planner for UAVs Based on Potential Field Obtained by a Kinodynamic Gene Regulation Network" Sensors 23, no. 18: 7982. https://doi.org/10.3390/s23187982

APA Style

Hong, J., Chen, D., Li, W., & Fan, Z. (2023). Trajectory Planner for UAVs Based on Potential Field Obtained by a Kinodynamic Gene Regulation Network. Sensors, 23(18), 7982. https://doi.org/10.3390/s23187982

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop