Next Article in Journal
A Novel Approach for Solving the N-Queen Problem Using a Non-Sequential Conflict Resolution Algorithm
Next Article in Special Issue
An Energy-Efficient Scheme Design for NOMA-Based UAV-Assisted MEC Systems
Previous Article in Journal
ShiftTransUNet: An Efficient Deep Learning Model for Medical Image Segmentation Using ShiftViT Framework
Previous Article in Special Issue
A Multi-Model Architecture Based on Deep Learning for Longitudinal Available Overload Prediction of Commercial Subsonic Aircraft with Actuator Faults
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning

1
Faculty of Smart Vehicle System Engineering, Chosun University, Gwangju 61452, Republic of Korea
2
Department of Electronic Engineering, Gachon University, Seongnam-si 13120, Republic of Korea
*
Author to whom correspondence should be addressed.
Electronics 2024, 13(20), 4064; https://doi.org/10.3390/electronics13204064
Submission received: 24 September 2024 / Revised: 11 October 2024 / Accepted: 14 October 2024 / Published: 16 October 2024
(This article belongs to the Special Issue Control and Applications of Intelligent Unmanned Aerial Vehicle)

Abstract

:
For the safe autonomous operations of unmanned aerial vehicles (UAVs) and ground control stations (GCS), including autonomous battery replacement, wireless power transfer, and more, the precise landing of UAVs on GCS is essential. Accurate landing is only possible when the link capacity strength exceeds a certain threshold, but this is often disturbed due to complex terrain. To address this, we developed an extremum seeking (ES)-based radio signal strength optimization (RSSO) algorithm, ES-RSSO, designed to find the optimal positions of the UAV using radio communication signals. This ensures energy-efficient path planning while guaranteeing the minimum received signal strength indication (RSSI) capacity. This algorithm is particularly useful in obstacle-rich environments, where UAVs are limited in power resources. Simulation results demonstrate a 2.37% decrease in the mean, a 62.08% improvement in variance, and a 3.72% decrease in the integration strength of the link capacity when ES-RSSO is applied. These results confirm that the RADIO.rssi maintenance ability remains above a critical boundary level, supporting robust communication links and energy-efficient path planning. Throughout the study, we showed how, in many cases, simply moving the UAV a few meters can significantly improve the communication link.

1. Introduction

1.1. Background

An uncountable number of small and lightweight unmanned aerial vehicle (UAV) applications have emerged over the past decades, and crashes involving UAVs, leading to hazardous accidents, have also increased. These accidents can be caused by various factors, including improper handling, battery usage beyond safe limits, carelessness, strong winds, detached propellers due to loose screws, communication disconnections, or sensor malfunctions such as global positioning system (GPS) or inertial measurement unit (IMU) failures due to strong magnetic fields. Among the causes of UAV accidents listed above, it was preliminarily analyzed and revealed that nearly one-third of the cases examined experienced a loss of communication link [1].
We propose an extremum seeking (ES) [2,3,4]-based radio signal strength optimization (RSSO) algorithm, ES-RSSO, to enhance the wireless data link capacity between the UAV and the ground control station (GCS). This ensures strong and stabilized communication while achieving energy-efficient path planning and guaranteeing a minimum received signal strength indication (RSSI) capacity.
The RSSI in the radio communication between the UAV and the GCS represents a power measurement at the receiver [5]. Although the definition of RSSI is outlined in the IEEE 802.11 standard [6], the unit of RSSI is not explicitly defined in the standard. Instead, the power level measured at the receiver is conventionally expressed in milliwatts ( m W ), or sometimes in decibels relative to one milliwatt ( d B m ), where 0 d B m equals 1 m W [7].
The RSSI typically decreases when the UAV is far from the GCS or blocked by obstacles and increases when it is close to the GCS [8,9]. In UAVs equipped with Pixhawk [10] and Mission Planner [11], the micro air vehicle link (MAVLink) [12] support in SiK radios [13] includes two key message parameters: RADIO.rssi and RADIO.remrssi [14]. RADIO.rssi represents the RSSI level received by the local radio, while RADIO.remrssi represents the RSSI level received by the remote radio.
This paper focuses on maintaining reliable UAV communication by ensuring the signal strength (RADIO.rssi) stays above a threshold, enabling energy-efficient path planning. We show that slight UAV movements can greatly enhance the communication link, offering an energy-saving approach. Using the ES-RSSO algorithm, strong communication with minimal power supports mission plans like autonomous wireless charging [15,16,17].

1.2. Literature Review

The literature review of research related to the proposed ES-RSSO-based path planning is summarized in Table 1, with detailed analysis in the following subsections. This method is more advantageous for practical applications due to its fast convergence and suitability for real-time path planning.

1.2.1. Path Optimization

If the UAV operates within the range of the telemetry modem and a robust communication strength is required from departure to destination, a path optimization method will be needed to maintain communication quality.
Zhang et al. developed a methodology to obtain the radio map-based optimal 3D path based on an equivalent SPP in graph theory [18]. Dong et al. presented a UAV anti-jamming communication methodology by incorporating two radio maps (signal power and signal-to-interference plus noise ratio (SINR) maps) into the heuristic, graph-based A* algorithm to achieve the optimal path based on the SPP [19]. Zhou et al. developed a non-convex semi-infinite optimization formulation to maximize the average worst-case SINR under strict energy availability constraints, using the S-procedure and SCA methods [20]. Khamidehi et al. developed a two-step path optimization method; (1) federated learning-based outage probability model generation, and (2) RRT-based path planning [21]. El-Gayar et al. proposed a 6G network model and caching strategy using UAVs, based on non-orthogonal multiple access and orthogonal multiple access systems, to improve the cache hit rate over time. This ultimately results in improvements in energy efficiency, content distribution, latency, and transmission speeds in communication [22]. Zhang et al. presented convex optimization and graph theory techniques to achieve a near-optimal solution for minimizing UAV mission completion time, with an optimized path subject to the minimum signal-to-noise ratio (SNR) requirement and the maximum UAV speed constraint [23]. Li et al. proposed a QiER-based DRL technique to simultaneously minimize the time cost and expected outage duration, aiming to establish a high-quality ground-to-air (G2A) transmission-capable UAV path [24]. Shamsoshoara et al. utilized IRL-based Q-learning and DRL to maximize the G2A uplink throughput and minimize ground user equipment interference [25].

1.2.2. Distance Extension Optimization

If the UAV flies beyond the range of the telemetry modem, the level of RADIO.rssi drops below a critical threshold, eventually leading to a loss of communication with the GCS. Numerous studies have been conducted to increase communication distance.
Li et al. employed a communication relay system between two UAVs to extend the communication range and overcome beyond-line-of-sight (BLOS) situations [26]. Wu et al. extended the range of BLOS UAV communication by utilizing multi-UAV mounted aerial flying base stations (FBS) and optimizing communication scheduling, association, trajectory, and power control [27]. Tran et al. addressed the UAV relay-assisted internet of things (IoT) wireless network by employing full-duplex radio communication to overcome both the data transfer latency of IoT sensors and the data storage limitation of UAVs, focusing on resource allocation and trajectory optimization [28].
Compared to the references listed above which utilize the concept of the UAV relay to extend communication distance, the proposed ES-RSSO algorithm can find energy-efficient paths (i.e., requiring less energy consumption) in normal situations and extend the communication distance in emergency situations by increasing the signal strength using leftover energy.

1.2.3. Coverage Optimization

If UAVs fly over a boundary region within a flying ad hoc network (FANET) while minimizing time or energy consumption, a CPP optimization technique is required.
Daniel et al. proposed a method leveraging public wireless communication infrastructures, utilizing civilian concepts of operations to address chemical, biological, radiological, and nuclear reconnaissance. This approach aims to overcome communication delays and reliability constraints [29]. Pan et al. presented a two-stage approach using pre-programmed locations and PSO/D for UAV trajectory and resource allocation, aiming to maximize average throughput under the constraints of co-channel interference and completion time [30]. Shi et al. proposed a UAV CPP method that satisfies the required network quality of service (QoS) by utilizing a heuristic PSO algorithm [31]. Hu et al. developed SCA and block coordinate descent techniques to optimize UAV paths over large areas, minimizing propulsion energy while achieving the sensing resolutions required for communication-assisted radar sensing [32]. Lee et al. presented a MILP-based UDG model to optimize multiple UAV flight times for the FBS missions, aiming to satisfy QoS while considering 5G/6G mobile SNR wireless network interference [33]. Khan et al. introduced a multiple UAV-based FANET strategy that considers RSSI to identify the location of wireless nodes in both 2D and 3D by developing a path loss model and a decision tree machine learning classifier [34].

1.3. Contribution

To maintain communication signal strength above a preset boundary for energy-efficient and minimum RSSI capacity-guaranteed path planning, we propose a method to find the local minimum RSSI value as the UAV flies along the planned trajectory using the ES-RSSO algorithm. This method is particularly useful when the UAV is located in relatively complex environments. It can be applied by iteratively running the ES-RSSO algorithm, simply reinitializing the UAV’s position to one different from the previously visited local maximum. The ES-RSSO algorithm computes the optimized RSSI path by identifying the gradient of the link capacity map, generated from the RSSI data using a washout filter, demodulator, integrator, and additional components.

1.4. Article Organization

The structure of this paper is as follows. Section 2 introduces the mission. Section 3 outlines the problem formulation, and Section 4 describes the simulation results. Lastly, Section 5 presents the conclusion and discusses future work.

2. Mission

2.1. Scenario

The UAV is equipped with sensors, a flight controller (FC), an optimization module, and a transceiver, as shown in Figure 1. The UAV flies from a takeoff waypoint to a landing waypoint while collecting RSSI data in real-time, computing to find the local minimum, and finally relocating to the identified local minima.

2.2. Typical RSSI and MAVLink Log Graphs

Figure 2a shows a typical graph of the RSSI levels for the radio communication between the UAV and the GCS. As depicted in Figure 2a, the signal strength clearly decreases when the UAV moves farther from the GCS and increases as it approaches the GCS. MAVLink support in SiK radios includes two key message parameters: RADIO.rssi and RADIO.remrssi. The RADIO.rssi represents the RSSI level received by the local radio, while the RADIO.remrssi represents the RSSI level received by the remote radio.
Figure 2b shows a typical MAVLink log graph of the radio communication between the UAV and the GCS. The four graphs in Figure 2b represent the signal strength received by the GCS, the signal strength received by the UAV, the noise received by the GCS, and the noise received by the UAV.

2.3. Overview of the ES-RSSO Algorithm

Figure 3 illustrates the overall logic of the ES-RSSO algorithm, which is used to determine the position of the minimum link capacity in the radio communication between the UAV and the GCS. The GCS, running MATLAB R2024a software with the ES-RSSO algorithm, receives the Pth UAV position Θ p from the physical UAV through the MatMav communication interface [37]. The ES-RSSO algorithm then computes the optimal Pth UAV position Θ p * , which has the lowest RSSI link capacity, and uses it as the next waypoint of the Pth UAV.

3. Problem Formulation

3.1. Problem Setup

The UAV continuously seeks the local minimum position where the link capacity reaches its lowest local value. Additionally, the UAV must fly from the takeoff waypoint to the landing waypoint in the shortest possible time. This fundamental problem can be formulated as follows:
min E r Θ * , s . t .   min E T ,
where r represents the sum of the RSSI link capacity during the flight from the departure to the destination location ( d B m ), Θ * is the optimal value of Θ ( m ), Θ is the position coordinate of the UAV ( m ), i.e., Θ = x , y , z , and T is the mission completion time ( s ).
To solve Equation (1), the hierarchy of mission planning is constructed as shown in Figure 4, which outlines the detailed steps described in Figure 3. According to Figure 4, the UAV continuously measures the RSSI link capacity, replacing the existing lowest RSSI value with any newly detected higher RSSI value. Since the ES-RSSO algorithm cannot always find the global minimum, the mission planning hierarchy also includes a mechanism to escape from the local minimum RSSI positions.

3.2. ES-RSSO Algorithm

The ES-RSSO algorithm primarily consists of two filters: an output compensator C o and an input compensator C i , as shown in Figure 5. The s C o filter primarily removes the white noise n from the incoming RSSI link capacity signal R , while the C i / s filter integrates the incoming demodulated signal ξ with a 1 sin ω 1 t Φ 1 . The value of Θ , which is calculated by summing the a 2 sin ω 2 t Φ 2 and the output signal from the C i / s filter, Θ ^ , is used to find the gradient of the link capacity in the RSSI map. Depending on the sign of α , Θ ^ directs the UAV either towards increasing RSSI link capacity or in the opposite direction. Using the outcome of the ES-RSSO algorithm, Θ , we calculate the RSSI link capacity r by continuously updating the 3D RSSI link capacity map. This process repeats until the UAV reaches the destination waypoint and lands.
In Figure 5, since r t + 1 = r t Θ t , we can transform this into the Laplace domain as R s = R Θ ( s ) . Thus, the calculated UAV position, Θ , can be represented in the Laplace domain as follows:
Θ s = C i s C o s R Θ s + N s a 1 ω 1 ω 1 2 + s 2 cos Φ 1 + ω 1 ω 1 2 + s 2 s i n Φ 1 + a 2 ω 2 ω 2 2 + s 2 cos Φ 2 + ω 2 ω 2 2 + s 2 s i n Φ 2

3.3. UAV Dynamics

A quadrotor-type UAV is used throughout the paper. Simple proportional–integral–differential (PID) controllers are applied to control the x , y , and z positions, as well as the pitch, roll, and yaw angles, respectively [39]. The quadrotor UAV dynamics used in this paper are as follows:
x ¨ y ¨ z ¨ = cos ϕ sin θ cos ψ + sin ϕ sin ψ 1 m cos ϕ sin θ sin ψ sin ϕ cos ψ 1 m cos ϕ cos θ 1 m U 1 + 0 0 g , ϕ ¨ θ ¨ ψ ¨ = θ ˙ ψ ˙ I y I z I x J r I x θ ˙ w 1 + w 3 w 2 w 4 + l I x U 2 ϕ ˙ ψ ˙ I z I x I y J r I y ϕ ˙ w 1 + w 3 w 2 w 4 + l I y U 3 ϕ ˙ θ ˙ I x I y I z + 1 I z U 4 ,
where x , y , and z represent the UAV position ( m ), ϕ , θ , and ψ are the roll, pitch, and yaw angles ( r a d ), m is the UAV mass ( k g ), g is the gravitational acceleration ( m / s 2 ), I x , I y , and I z are the body inertias ( k g · m 2 ), J r is the rotor inertia ( k g · m 2 ), and l is the arm length ( m ). The system’s inputs ( U 1 , U 2 , U 3 , U 4 , and Ω ) can be rewritten as follows:
U 1 = b Ω 1 2 + Ω 2 2 + Ω 3 2 + Ω 4 2 , U 2 = b Ω 4 2 Ω 2 2 , U 3 = b Ω 3 2 Ω 1 2 , U 4 = d Ω 2 2 + Ω 4 2 Ω 1 2 Ω 3 2 , Ω = Ω 2 + Ω 4 Ω 1 Ω 3 ,
where U is the input vector ( k g · m / s 2 ), Ω is the rotor speed ( r a d / s ), b is the thrust coefficient (dimensionless), and d is the drag coefficient (dimensionless).

4. Simulation Result

All simulations are performed in the MATLAB/Simulink environment, as shown in Figure 6a, using a quadrotor vehicle with the following initial system properties: Θ i n i t = [ 0 ,   0 ,   0 ]   m , ϕ ,   θ ,   ψ i n i t = [ 0 ,   0 ,   0 ]   r a d , ϕ ˙ ,   θ ˙ ,   ψ ˙ i n i t = [ 0 ,   0 ,   0 ]   r a d / s , v i n i t = [ 0 ,   0 ,   0 ]   m / s , a i n i t = 0 ,   0 ,   0   m / s 2 , v m i n 2 = 0   m / s , v m a x 2 = 10   m / s , A l t i t u d e m i n = 1   m , and A l t i t u d e n o r m a l = 10   m . The time step used is 0.01 s . The simulations were run on a desktop with an Intel® Core™ i5-4590 CPU (3.30 G H z ), a 64-bit operating system, and 8.00 G B of RAM.
In Figure 6b, the RSSI profile over the soccer field (image sourced from Google Earth) was obtained by flying a quadrotor UAV at a height of 10 m under the wind speed of approximately 2 m / s . For the flight experiment, we used a PX4 Pro-powered F450 quadrotor [40] equipped with a three-layered IMU-based Pixhawk 2.1 FC, an RFD900x 915 M H z telemetry modem, QGroundControl [41], a Pixhawk 2.1 Here+ RTK [42], and a 4s 3300 m A h battery pack. These components were used in the outdoor autopilot experiment, which followed a pre-established energy-efficient path. Notably, the Pixhawk 2.1 Here+ RTK was utilized to achieve centimeter-level accuracy in autopilot path following. We saved the telemetry radio data collected during the quadrotor’s flight and extracted the RSSI data from it. Additionally, we converted the GPS coordinates to Earth-Centered Earth-Fixed (ECEF) coordinates. The converted GPS data were used for the x and y positions, while the extracted RSSI data were used for the z-axis.
For the simulation experiments, the quadrotor UAV is set to fly from Θ i n i t = [ 0 ,   0 ,   0 ]   m to Θ e n d = [ 45 ,   32.5 ,   10 ]   m in the ECEF coordinates, as shown in Figure 7. In Figure 6b, the UAV is represented by circles in four different colors, with each color corresponding to a rotor of the quadrotor. The GCS, depicted as a red circle in Figure 7a, is represented as a yellow rectangle in Figure 6b at the center of the soccer field.
According to Figure 8a, the RSSI value tends to increase over time, indicating that the quadrotor UAV slightly modifies its trajectory as it flies towards the final waypoint. Since the ES-RSSO algorithm is designed to find the local minimum, the UAV occasionally falls into local RSSI minimum positions, as reflected by the fluctuating RSSI values shown in Figure 8b.
Lastly, Table 2 summarizes the simulation results, showing a 2.37% decrease in the mean, a 62.08% improvement in variance, and a 3.72% decrease in the integration strength of the link capacity when the ES-RSSO is applied. The results show that the RADIO.rssi remains consistently above the critical threshold, guaranteeing reliable communication links and facilitating energy-efficient path planning when the ES-RSSO is implemented.
The integration strength of the link capacity represents the area under each graph in Figure 8a. Additionally, Figure 8b illustrates the RSSI variance during the UAV’s flight.

5. Conclusions

In this paper, we demonstrated a method for finding the minimum RSSI trajectory using the ES-RSSO algorithm. Although the ES-RSSO algorithm occasionally falls into local minimum RSSI values, it generally performs well. It guides the UAV to follow an increasing RSSI value during mission planning. According to the simulation results, the ES-RSSO algorithm calculates gradually varying position trajectories, ensuring that the UAV’s attitude remains stable while maintaining the minimum required RSSI level.
In contrast to most previously published path optimization literature, which primarily focuses on optimal path planning such as the shortest or fastest route, the minimum RSSI trajectory proposed by the ES-RSSO algorithm helps to reduce unnecessary energy consumption in modulating and demodulating MAVLink messages by finding the optimal positions of the UAV using radio communication signals. This ensures energy-efficient path planning while guaranteeing the minimum RSSI capacity, which eventually results in the extended mission flight time.
In the future, to address the semi-global convergence issue of the proposed ES-RSSO algorithm, we plan to explore the integration of techniques such as SCA, RRT, QiER-based DRL, and IRL-based DRL with ES-RSSO. The increased computation time resulting from a more complex algorithm set will be mitigated by using a high-performance, graphics card-based mission computer alongside the FC. Alternatively, a weighted centroid localization algorithm can be applied to assign different weights to each computation algorithm depending on the mission scenarios to effectively address the trade-offs of each involved algorithm.
We will conduct additional flight experiments using an F450 quadrotor equipped with a Pixhawk FC, Here+ RTK GPS, and other components [43] to construct a 3D RSSI map while simultaneously operating the ES-RSSO algorithm to find the optimal path that results in the minimum RSSI trajectory for energy-efficient flight. We plan to introduce abrupt variations in RSSI in real-time, simulating environmental disturbances. With real-time 3D RSSI mapping and an improved ES-RSSO algorithm, we aim to achieve more energy-efficient, minimum RSSI capacity-guaranteed path planning.

Author Contributions

S.J. provided conceptualization, data curation, funding acquisition, methodology, writing—original draft; Y.-J.K. provided the software, supervision, validation, writing—review & editing. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by a research fund from Chosun University, 2024, under Grant K208419005.

Data Availability Statement

The data presented in this study are available on request from the corresponding author due to privacy reasons.

Conflicts of Interest

The author declares no conflicts of interest.

Acronyms

BLOSBeyond-line-of-sight
CPPCoverage path planning
DRLDeep reinforcement learning
ESExtremum seeking
FANETFlying ad hoc network
FBSFlying base station
FCFlight controller
IRLInverse reinforcement learning
G2AGround-to-air
GCSGround control station
GPSGlobal positioning system
IMUInertial measurement unit
MAVLinkMicro air vehicle link
MILPMixed integer linear programming
PIDProportional–integral–differential
PSOParticle swarm optimization
PSO/DParticle swarm optimization algorithm based on decomposition
QiERQuantum-inspired experience replay
QoSQuality of service
RRTRapidly exploring random trees
RSSIReceived signal strength indication
RSSORadio signal strength optimization
SCASuccessive convex approximation
SINRSignal-to-interference plus noise ratio
SNRSignal-to-noise ratio
SPPShortest path problem
UAVUnmanned aerial vehicle
UDGUnit disk graph

Nomenclature

a 1 sin ω 1 t Φ 1 Demodulation signal m
a 2 sin ω 2 t Φ 2 Modulation signal m
α Sign valueNo unit+1, −1
b Thrust coefficientNo unit
C i Input compensatorNo unit
C o Output compensatorNo unit
d Drag coefficientNo unit
g Gravitational acceleration m / s 2 9.81
I x ,   I y ,   I z Body inertia k g · m 2 0.0173, 0.0173, 0.0223
J r Rotor inertia k g · m 2
l Arm length m
m UAV mass k g 2.7
n White noise m
Ω Rotor speed r a d / s
ω 1 Forcing frequency of the demodulation signal r a d / s
ω 2 Forcing frequency of the modulation signal r a d / s
Φ 1 Phase of the demodulation signal r a d
Φ 2 Phase of the modulation signal r a d
ϕ ,   θ ,   ψ Roll, pitch, and yaw angles r a d
r RSSI link capacity d B m
T Mission completion time s
Θ Modulated signal (i.e., UAV position) m
Θ ^ Estimated UAV position m
Θ * Optimum value of Θ m
U Input vector k g · m / s 2
W UAV waypoint list m
x ,   y ,   z UAV position m
ξ Demodulated signal m

References

  1. Wild, G.; Murray, J.; Baxter, G. Exploring Civil Drone Accidents and Incidents to Help Prevent Potential Air Disasters. Aerospace 2016, 3, 22. [Google Scholar] [CrossRef]
  2. Ariyur, K.B.; Krstic, M. Real-Time Optimization by Extremum-Seeking Control; Wiley: Hoboken, NJ, USA, 2003. [Google Scholar]
  3. Ariyur, K.B.; Bommalingaiahnapallya, C.; Kazi, S.S. Improving Wireless Data Link Capacity. U.S. Patent WO2006088850A1, 24 August 2006. [Google Scholar]
  4. Ariyur, K.B.; Krstic, M. Analysis and Design of Multivariable Extremum Seeking. In Proceedings of the American Control Conference, Anchorage, AK, USA, 8–10 May 2002. [Google Scholar]
  5. Sauter, M. From GSM to LTE: An Introduction to Mobile Networks and Mobile Broadband; Wiley: Hoboken, NJ, USA, 2011. [Google Scholar]
  6. IEEE 802.11-2007; IEEE Standard for Information Technology—Telecommunications and Information Exchange between Systems—Local and Metropolitan Area Networks—Specific Requirements—Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications. IEEE Standards Association: Piscataway, NJ, USA, 2007. Available online: https://standards.ieee.org/ieee/802.11/3605/ (accessed on 18 September 2024).
  7. Royland, D. Dead Reckoning System for UAV Using RSSI and Extremum Seeking Control. Master’s Thesis, Norwegian University of Science and Technology, Trondheim, Norway, 2016. [Google Scholar]
  8. Fang, Z.; Zhao, Z.; Geng, D.; Xuan, Y.; Du, L.; Cui, X. RSSI Variability Characterization and Calibration Method in Wireless Sensor Network. In Proceedings of the IEEE International Conference on Information and Automation, Harbin, China, 20–23 June 2010. [Google Scholar]
  9. Dong, Q.; Dargie, W. Evaluation of the Reliability of RSSI for Indoor Localization. In Proceedings of the International Conference on Wireless Communications in Underground and Confined Areas, Clermont Ferrand, France, 28–30 August 2012. [Google Scholar]
  10. PX4 Guide (Main), Hex Cube Black Flight Controller. Available online: https://docs.px4.io/main/en/flight_controller/pixhawk-2.html (accessed on 18 September 2024).
  11. ArduPilot, Mission Planner Home. Available online: https://ardupilot.org/planner/# (accessed on 18 September 2024).
  12. MAVLINK, MAVLink Developer Guide. Available online: https://mavlink.io/en/ (accessed on 18 September 2024).
  13. ArduPilot, SiK Telemetry Radio. Available online: https://ardupilot.org/copter/docs/common-sik-telemetry-radio.html (accessed on 18 September 2024).
  14. ArduPilot, SiK Radio—Advanced Configuration. Available online: https://ardupilot.org/copter/docs/common-3dr-radio-advanced-configuration-and-technical-information.html (accessed on 18 September 2024).
  15. Jung, S.; Ariyur, K.B. Automated Wireless Recharging for Small UAVs. Int. J. Aeronaut. Space Sci. 2017, 18, 588–600. [Google Scholar] [CrossRef]
  16. Jung, S.; Lee, T.; Mina, T.; Ariyur, K.B. Inductive or Magnetic Recharging for Small UAVs. In Proceedings of the SAE Aerospace Electronics and Avionics Systems Conference, Phoenix, AZ, USA, 30 October–1 November 2012. [Google Scholar]
  17. Jung, S.; Kim, H. Autolanding Mission Planning of the IT Convergence Hoverable UAV. J. Korea Converg. Soc. 2017, 8, 9–16. [Google Scholar] [CrossRef]
  18. Zhang, S.; Zhang, R. Radio Map-Based 3D Path Planning for Cellular-Connected UAV. IEEE Trans. Wirel. Commun. 2021, 20, 1975–1989. [Google Scholar] [CrossRef]
  19. Dong, Y.; He, C.; Wang, Z.; Zhang, L. Radio Map Assisted Path Planning for UAV Anti-Jamming Communications. IEEE Signal Process. Lett. 2022, 29, 607–611. [Google Scholar] [CrossRef]
  20. Zhou, L.; Zhao, X.; Guan, X.; Song, E.; Zeng, X.; Shi, Q. Robust Trajectory Planning for UAV Communication Systems in the Presence of Jammers. Chin. J. Aeronaut. 2022, 35, 265–274. [Google Scholar] [CrossRef]
  21. Khamidehi, B.; Sousa, E.S. Federated Learning for Cellular-Connected UAVs: Radio Mapping and Path Planning. In Proceedings of the IEEE Global Communications Conference, Taipei, Taiwan, 7–11 December 2020. [Google Scholar]
  22. El-Gayar, M.M.; Ajour, M.N. Resource Allocation in UAV-Enabled NOMA Networks for Enhanced Six-G Communications Systems. Electronics 2023, 12, 5033. [Google Scholar] [CrossRef]
  23. Zhang, S.; Zeng, Y.; Zhang, R. Cellular-Enabled UAV Communication: Trajectory Optimization under Connectivity Constraint. In Proceedings of the IEEE International Conference on Communications, Kansas City, MO, USA, 20–24 May 2018. [Google Scholar]
  24. Li, Y.; Aghvami, A.H.; Dong, D. Path Planning for Cellular-Connected UAV: A DRL Solution with Quantum-Inspired Experience Replay. IEEE Trans. Wirel. Commun. 2022, 21, 7897–7912. [Google Scholar] [CrossRef]
  25. Shamsoshoara, A.; Lotfi, F.; Mousavi, S.; Afghah, F.; Guvenc, I. Joint Path Planning and Power Allocation of a Cellular-Connected UAV using Apprenticeship Learning via Deep Inverse Reinforcement Learning. Comput. Netw. 2024, 254, 110789. [Google Scholar] [CrossRef]
  26. Li, B.; Jiang, Y.; Sun, J.; Cai, L.; Wen, C. Development and Testing of a Two-UAV Communication Relay System. Sensors 2016, 16, 1696. [Google Scholar] [CrossRef] [PubMed]
  27. Wu, Q.; Zeng, Y.; Zhang, R. Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks. IEEE Trans. Wirel. Commun. 2018, 17, 2109–2121. [Google Scholar] [CrossRef]
  28. Tran, D.; Nguyen, V.; Chatzinotas, S.; Vu, T.X.; Ottersten, B. UAV Relay-Assisted Emergency Communications in IoT Networks: Resource Allocation and Trajectory Optimization. IEEE Trans. Wirel. Commun. 2022, 21, 1621–1637. [Google Scholar] [CrossRef]
  29. Daniel, K.; Rohde, S.; Wietfeld, C. Leveraging Public Wireless Communication Infrastructures for UAV-Based Sensor Networks. In Proceedings of the IEEE International Conference on Technologies for Homeland Security, Waltham, MA, USA, 8–10 November 2010. [Google Scholar]
  30. Pan, Y.; Da, X.; Hu, H.; Huang, Y.; Zhang, M.; Cumanan, K.; Dobre, O.A. Joint Optimization of Trajectory and Resource Allocation for Time-Constrained UAV-Enabled Cognitive Radio Networks. IEEE Trans. Veh. Technol. 2022, 71, 5576–5580. [Google Scholar] [CrossRef]
  31. Shi, L.; Xu, S. UAV Path Planning with QoS Constraint in Device-to-Device 5G Networks using Particle Swarm Optimization. IEEE Access 2020, 8, 137884–137896. [Google Scholar] [CrossRef]
  32. Hu, S.; Yuan, X.; Ni, W.; Wang, X. Trajectory Planning of Cellular-Connected UAV for Communication-Assisted Radar Sensing. IEEE Trans. Commun. 2022, 70, 6385–6396. [Google Scholar] [CrossRef]
  33. Lee, J.; Friderikos, V. Interference-Aware Path Planning Optimization for Multiple UAVs in Beyond 5G Networks. J. Commun. Netw. 2022, 24, 125–138. [Google Scholar] [CrossRef]
  34. Khan, I.U.; Alturki, R.; Alyamani, H.J.; Ikram, M.A.; Aziz, M.A.; Hoang, V.T.; Cheema, T.A. RSSI-Controlled Long-Range Communication in Secured IoT-Enabled Unmanned Aerial Vehicles. Mob. Inf. Syst. 2021, 2021, 5523553. [Google Scholar] [CrossRef]
  35. Scheinker, A. 100 Years of Extremum Seeking: A Survey. Automatica 2024, 161, 111481. [Google Scholar] [CrossRef]
  36. Long, Y.; He, H. Robot Path Planning Based on Deep Reinforcement Learning. In Proceedings of the IEEE Conference on Telecommunications, Optics and Computer Science, Shenyang, China, 11–13 December 2020. [Google Scholar]
  37. Zahana, M.A. MatMav Guide. Available online: https://mzahana.gitbooks.io/matmav-guide/content/ (accessed on 18 September 2024).
  38. MathWorks, Extremum Seeking Control. Available online: https://mathworks.com/help/slcontrol/ug/extremum-seeking-control.html (accessed on 18 September 2024).
  39. Jung, S.; Ariyur, K.B. Strategic Cattle Roundup using Multiple Quadrotor UAVs. Int. J. Aeronaut. Space Sci. 2017, 18, 315–326. [Google Scholar] [CrossRef]
  40. Droncode, PX4 Pro. Available online: https://dronecode.diyrobocars.com/ (accessed on 18 September 2024).
  41. Droncode, QGroundControl. Available online: https://qgroundcontrol.com/ (accessed on 18 September 2024).
  42. ArduPilot, CubePilot Here+ RTK GPS. Available online: https://ardupilot.org/copter/docs/common-here-plus-gps.html (accessed on 18 September 2024).
  43. Jung, S. Development of Path Planning Tool for Unmanned System Considering Energy Consumption. Appl. Sci. 2019, 9, 3341. [Google Scholar] [CrossRef]
Figure 1. Mission overview.
Figure 1. Mission overview.
Electronics 13 04064 g001
Figure 2. Typical RSSI and MAVLink log graphs [14]: (a) RSSI; (b) MAVLink.
Figure 2. Typical RSSI and MAVLink log graphs [14]: (a) RSSI; (b) MAVLink.
Electronics 13 04064 g002
Figure 3. Overall logic of the ES-RSSO algorithm.
Figure 3. Overall logic of the ES-RSSO algorithm.
Electronics 13 04064 g003
Figure 4. Hierarchy of mission planning.
Figure 4. Hierarchy of mission planning.
Electronics 13 04064 g004
Figure 5. ES-RSSO algorithm overview [38].
Figure 5. ES-RSSO algorithm overview [38].
Electronics 13 04064 g005
Figure 6. MATLAB/Simulink simulation: (a) block diagram; (b) flight trajectory with corresponding RSSI trajectory.
Figure 6. MATLAB/Simulink simulation: (a) block diagram; (b) flight trajectory with corresponding RSSI trajectory.
Electronics 13 04064 g006
Figure 7. Flight experiment: (a) flight test to obtain RSSI telemetry data; (b) F450 quadrotor UAV.
Figure 7. Flight experiment: (a) flight test to obtain RSSI telemetry data; (b) F450 quadrotor UAV.
Electronics 13 04064 g007
Figure 8. RSSI variance: (a) RSSI vs. time; (b) RSSI vs. position.
Figure 8. RSSI variance: (a) RSSI vs. time; (b) RSSI vs. position.
Electronics 13 04064 g008
Table 1. Comparative analysis of the proposed method with the related literature.
Table 1. Comparative analysis of the proposed method with the related literature.
Path
Optimization
Distance Extension
Optimization
Coverage
Optimization
LiteraturePropose Method[18,19,20,21,22,23,24,25][26,27,28][29,30,31,32,33,34]
Basic
Ideology
Radio map-based path planningXest path planning
(shortest, fastest, etc.)
Communication beyond the limits of telemetry rangeCoverage path planning (CPP)
Mission
Goal
-
Mission time
-
Energy efficiency
-
Mission time
-
Energy efficiency
Multi-UAV-based communication relayResource allocation
Optimization TechniqueES-RSSO
-
Graph theory-based shortest path problem (SPP)
-
Successive convex approximation (SCA)
-
Rapidly-exploring random trees (RRT)
-
Quantum-inspired experience replay (QiER)-based deep reinforcement learning (DRL)
-
Inverse reinforcement learning (IRL)-based Q-learning and DRL
Heuristic convex optimization
-
Particle swarm optimization algorithm based on decomposition (PSO/D)
-
SCA and block coordinate descent techniques
-
Mixed integer linear programming (MILP)-based unit disk graph (UDG) model
-
Path loss model and decision tree machine learning classifier
Pros
-
Fast convergence time to maximize or minimize unknown dynamic functions
-
Widely verified robustness [35]
Better Xest path optimization achieved through the Q-learning algorithm based on the Markov decision process and DRL [36]A relatively simple yet efficient iterative algorithm
-
Simple framework
-
High convergence speed
ConsSemi-global convergence
-
Relatively slow computation time for optimum convergence
-
High training time and data requirements for DRL
Table 2. Comparison simulation result of with and without ES-RSSO algorithm application.
Table 2. Comparison simulation result of with and without ES-RSSO algorithm application.
MeanVarianceIntegration
w/ES-RSSO ( d B m )182.176312.3866850.1319
w/o ES-RSSO ( d B m )186.594632.6610882.9339
Improvement ( % )2.3762.083.72
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Jung, S.; Kim, Y.-J. Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning. Electronics 2024, 13, 4064. https://doi.org/10.3390/electronics13204064

AMA Style

Jung S, Kim Y-J. Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning. Electronics. 2024; 13(20):4064. https://doi.org/10.3390/electronics13204064

Chicago/Turabian Style

Jung, Sunghun, and Young-Joon Kim. 2024. "Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning" Electronics 13, no. 20: 4064. https://doi.org/10.3390/electronics13204064

APA Style

Jung, S., & Kim, Y. -J. (2024). Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning. Electronics, 13(20), 4064. https://doi.org/10.3390/electronics13204064

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop