Next Issue
Volume 7, March
Previous Issue
Volume 7, January
 
 

Drones, Volume 7, Issue 2 (February 2023) – 82 articles

Cover Story (view full-size image): We propose a fully automatic approach to overcome not only individual maize extraction but also the trait quantification challenge of structural components from unmanned aerial system (UAS) imagery. For that, two flights were performed over maize trials using a camera onboard a UAS platform. RGB images were processed using a standard photogrammetric pipeline to obtain a final scaled 3D point cloud. Individual plants were extracted using deep learning. Next, we employed a connected component algorithm to the maize endmembers. Finally, we robustly applied a Laplacian-based contraction skeleton algorithm to compute several structural component traits from each plant. Our test trial reveals the viability of computing 3D phenotypic traits of maize on the basis of a UAS imagery-based point cloud. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list.
  • You may sign up for e-mail alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.
Order results
Result details
Section
Select all
Export citation of selected articles as:
16 pages, 21603 KiB  
Article
Capacity Analysis of Power Beacon-Assisted Industrial IoT System with UAV Data Collector
by Aleksandra Cvetković, Vesna Blagojević and Jelena Manojlović
Drones 2023, 7(2), 146; https://doi.org/10.3390/drones7020146 - 20 Feb 2023
Cited by 3 | Viewed by 1923
Abstract
The performance analysis of an energy constrained Internet of Things (IoT) system with unmanned aerial vehicle (UAV) is provided in this paper. In the considered system, a power beacon is used for the energy supply of a sensor node that has no other [...] Read more.
The performance analysis of an energy constrained Internet of Things (IoT) system with unmanned aerial vehicle (UAV) is provided in this paper. In the considered system, a power beacon is used for the energy supply of a sensor node that has no other power sources, while the UAV is used for the collection of sensor data. The outage and capacity performances are analyzed under the assumption of a Nakagami-m fading environment, for the case when the power and information transfer are performed based on the time-switching protocol and the UAV is randomly positioned at a certain height. Based on the provided analysis we derive the exact closed-form expressions for the outage probability, the outage capacity and the ergodic capacity of the power beacon assisted IoT system. The analytical results are confirmed using an independent simulation method. The performed analysis demonstrates the impact of various system and channel parameters on system performances. Full article
(This article belongs to the Special Issue Advances of Unmanned Aerial Vehicle Communication)
Show Figures

Figure 1

22 pages, 4102 KiB  
Article
A Path-Planning Method Considering Environmental Disturbance Based on VPF-RRT*
by Zhihao Chen, Jiabin Yu, Zhiyao Zhao, Xiaoyi Wang and Yang Chen
Drones 2023, 7(2), 145; https://doi.org/10.3390/drones7020145 - 20 Feb 2023
Cited by 9 | Viewed by 2566
Abstract
In the traditional rapidly exploring random tree (RRT) algorithm, the planned path is not smooth, the distance is long, and the fault tolerance rate of the planned path is low. Disturbances in an environment can cause unmanned surface vessels (USVs) to deviate from [...] Read more.
In the traditional rapidly exploring random tree (RRT) algorithm, the planned path is not smooth, the distance is long, and the fault tolerance rate of the planned path is low. Disturbances in an environment can cause unmanned surface vessels (USVs) to deviate from their planned path during navigation. Therefore, this paper proposed a path-planning method considering environmental disturbance based on virtual potential field RRT* (VPF-RRT*). First, on the basis of the RRT* algorithm, a VPF-RRT* algorithm is proposed for planning the planning path. Second, an anti-environmental disturbance method based on a deep recurrent neural networks PI (DRNN-PI) controller is proposed to allow the USV to eliminate environmental disturbance and maintain its track along the planning path. Comparative simulation experiments between the proposed algorithm and the other algorithms were conducted within two different experimental scenes. In the path-planning simulation experiment, the VPF-RRT* algorithm had a shorter planning path and a smaller total turning angle when compared to the RRT* algorithm. In the path-tracking simulation experiment, when using the proposed algorithm, the USV could effectively compensate for the impact of environmental disturbance and maintain its navigation along the planning path. In order to avoid the contingency of the experiment and verify the effectiveness and generality of the proposed algorithm, three experiments were conducted. The simulation results verify the effectiveness of the proposed algorithm. Full article
(This article belongs to the Special Issue Unmanned Surface Vehicle)
Show Figures

Figure 1

23 pages, 4292 KiB  
Article
A Comparative Study between NMPC and Baseline Feedback Controllers for UAV Trajectory Tracking
by Bryan S. Guevara, Luis F. Recalde, José Varela-Aldás, Victor H. Andaluz, Daniel C. Gandolfo and Juan M. Toibero
Drones 2023, 7(2), 144; https://doi.org/10.3390/drones7020144 - 20 Feb 2023
Cited by 9 | Viewed by 3455
Abstract
Transport, rescue, search, surveillance, and disaster relief tasks are some applications that can be developed with unmanned aerial vehicles (UAVs), where accurate trajectory tracking is a crucial property to operate in a cluttered environment or under uncertainties. However, this is challenging due to [...] Read more.
Transport, rescue, search, surveillance, and disaster relief tasks are some applications that can be developed with unmanned aerial vehicles (UAVs), where accurate trajectory tracking is a crucial property to operate in a cluttered environment or under uncertainties. However, this is challenging due to high nonlinear dynamics, system constraints, and uncertainties presented in cluttered environments. Hence, uncertainties in the form of unmodeled dynamics, aerodynamic effects, and external disturbances such as wind can produce unstable feedback control schemes, introducing significant positional tracking errors. This work presents a detailed comparative study between controllers such as nonlinear model predictive control (NMPC) and non-predictive baseline feedback controllers, with particular attention to tracking accuracy and computational efficiency. The development of the non-predictive feedback controller schemes was divided into inverse differential kinematics and inverse dynamic compensation of the aerial vehicle. The design of the two controllers uses the mathematical model of UAV and nonlinear control theory, guaranteeing a low computational cost and an asymptotically stable algorithm. The NMPC formulation was developed considering system constraints, where the simplified dynamic model was included; additionally, the boundaries in control actions and a candidate Lyapunov function guarantees the stability of the control structure. Finally, this work uses the commercial simulator DJI brand and DJI Matrice 100 UAV in real-world experiments, where the NMPC shows a reduction in tracking error, indicating the advantages of this formulation. Full article
(This article belongs to the Special Issue Conceptual Design, Modeling, and Control Strategies of Drones-II)
Show Figures

Figure 1

14 pages, 2533 KiB  
Article
Wheat Lodging Segmentation Based on Lstm_PSPNet Deep Learning Network
by Jun Yu, Tao Cheng, Ning Cai, Xin-Gen Zhou, Zhihua Diao, Tianyi Wang, Shizhou Du, Dong Liang and Dongyan Zhang
Drones 2023, 7(2), 143; https://doi.org/10.3390/drones7020143 - 18 Feb 2023
Cited by 19 | Viewed by 2288
Abstract
Lodging is one of the major issues that seriously affects wheat quality and yield. To obtain timely and accurate wheat lodging information and identify the potential factors leading to lodged wheat in wheat breeding programs, we proposed a lodging-detecting model coupled with unmanned [...] Read more.
Lodging is one of the major issues that seriously affects wheat quality and yield. To obtain timely and accurate wheat lodging information and identify the potential factors leading to lodged wheat in wheat breeding programs, we proposed a lodging-detecting model coupled with unmanned aerial vehicle (UAV) image features of wheat at multiple plant growth stages. The UAV was used to collect canopy images and ground lodging area information at five wheat growth stages. The PSPNet model was improved by combining the convolutional LSTM (ConvLSTM) timing model, inserting the convolutional attention module (CBAM) and the Tversky loss function. The effect of the improved PSPNet network model in monitoring wheat lodging under different image sizes and different growth stages was investigated. The experimental results show that (1) the improved Lstm_PSPNet model was more effective in lodging prediction, and the precision reached 0.952; (2) choosing an appropriate image size could improve the segmentation accuracy, with the optimal image size in this study being 468 × 468; and (3) the model of Lstm_PSPNet improved its segmentation accuracy sequentially from early flowering to late maturity, and the three evaluation metrics increased sequentially from 0.932 to 0.952 for precision, from 0.912 to 0.940 for recall, and from 0.922 to 0.950 for F1-Score, with good extraction at mid and late reproductive stages. Therefore, the lodging information extraction model proposed in this study can make full use of temporal sequence features to improve image segmentation accuracy and effectively extract lodging areas at different growth stages. The model can provide more comprehensive reference and technical support for monitoring the lodging of wheat crops at different growth stages. Full article
Show Figures

Figure 1

29 pages, 8735 KiB  
Article
Trajectory Planning for Multiple UAVs and Hierarchical Collision Avoidance Based on Nonlinear Kalman Filters
by Warunyu Hematulin, Patcharin Kamsing, Peerapong Torteeka, Thanaporn Somjit, Thaweerath Phisannupawong and Tanatthep Jarawan
Drones 2023, 7(2), 142; https://doi.org/10.3390/drones7020142 - 18 Feb 2023
Cited by 3 | Viewed by 2739
Abstract
Fully autonomous trajectory planning for multiple unmanned aerial vehicles (UAVs) is significant for building the next generation of the logistics industry without human control. This paper presents a method to enable multiple UAVs to fly in the same trajectory without collision. It benefits [...] Read more.
Fully autonomous trajectory planning for multiple unmanned aerial vehicles (UAVs) is significant for building the next generation of the logistics industry without human control. This paper presents a method to enable multiple UAVs to fly in the same trajectory without collision. It benefits several applications, such as smart cities and transfer goods, during the COVID-19 pandemic. Different types of nonlinear state estimation are deployed to test the position estimation of drones by treating the information from AirSim as offline dynamic data. The obtained global positioning system sensor data and magnetometer sensor data are determined as the measurement model. The experiment in the simulation is separated into (1) the localization state, (2) the rendezvous state, in which the proposed rendezvous strategy is presented by using the relation between velocity and displacement through the setting area, and (3) the full mission state, which combines both the localization and rendezvous states. The localization state results show the best RMSE in the case of full GPS available at 0.21477 m and 0.25842 m in the case of a GPS outage during a period of time by implementing the ensemble Kalman filter. Similarly, the ensemble Kalman filter performs well with an RMSE of 0.5112414 m in the rendezvous state and demonstrates exceptional performance in the full mission state. Moreover, the experiment is implemented in a real-world situation with some basic drone kits as proof that the proposed rendezvous strategy can truly operate. Full article
(This article belongs to the Special Issue Multi-UAVs Control)
Show Figures

Figure 1

21 pages, 2712 KiB  
Article
An Energy-Effective and QoS-Guaranteed Transmission Scheme in UAV-Assisted Heterogeneous Network
by Jinxi Zhang, Weidong Gao, Gang Chuai and Zhixiong Zhou
Drones 2023, 7(2), 141; https://doi.org/10.3390/drones7020141 - 17 Feb 2023
Cited by 6 | Viewed by 2466
Abstract
In this article, we consider a single unmanned aerial vehicle (UAV)-assisted heterogeneous network in a disaster area, which includes a UAV, ground cellular users, and ground sensor users. The cellular data and sensing data are transmitted to UAVs by cellular users and sensor [...] Read more.
In this article, we consider a single unmanned aerial vehicle (UAV)-assisted heterogeneous network in a disaster area, which includes a UAV, ground cellular users, and ground sensor users. The cellular data and sensing data are transmitted to UAVs by cellular users and sensor users, due to the outage of the ground wireless network caused by the disaster. In this scenario, we aim to minimize the energy consumption of all the users, to extend their communication time and facilitate rescue. At the same time, cellular users and sensor users have different rate requirements, hence the quality of service (QoS) of the users should be guaranteed. To solve these challenges, we propose an energy-effective relay selection and resource-allocation algorithm. First, to solve the problem of insufficient coverage of the single UAV network, we propose to perform multi-hop transmission for the users outside the UAV’s coverage by selecting suitable relays in an energy-effective manner. Second, for the cellular users and sensor users inside the coverage of the UAV but with different QoS requirements, we design a non-orthogonal multiple access (NOMA)-based transmission scheme to improve spectrum efficiency. Deep reinforcement learning is exploited to dynamically adjust the power level and allocated sub-bands for inside users to reduce energy consumption and improve QoS satisfaction. The simulation results show that the proposed NOMA transmission scheme can achieve 9–17% and 15–32% performance gain on the reduction of transmit power and the improvement of QoS satisfaction, respectively, compared with state-of-the-art NOMA transmission schemes and orthogonal multiple access scheme. Full article
Show Figures

Figure 1

16 pages, 11600 KiB  
Article
Piloting an Unmanned Aerial Vehicle to Explore the Floristic Variations of Inaccessible Cliffs along Island Coasts
by Seongjun Kim, Chang Woo Lee, Hwan-Joon Park, Byoung-Doo Lee, Nam Young Kim, Jung Eun Hwang, Hyeong Bin Park, Jiae An and JuHyoung Baek
Drones 2023, 7(2), 140; https://doi.org/10.3390/drones7020140 - 17 Feb 2023
Cited by 6 | Viewed by 1946
Abstract
Coastal cliffs are important in plant ecology as a unique frontier between terrestrial and marine ecosystems. This study piloted close-range photogrammetry with an unmanned aerial vehicle (UAV) to clarify floristic patterns using 26 inaccessible coastal cliffs in a warm-temperate, preserved island (area: 6.5 [...] Read more.
Coastal cliffs are important in plant ecology as a unique frontier between terrestrial and marine ecosystems. This study piloted close-range photogrammetry with an unmanned aerial vehicle (UAV) to clarify floristic patterns using 26 inaccessible coastal cliffs in a warm-temperate, preserved island (area: 6.5 km2). UAV-based flora data were analyzed in terms of cliff aspect (Type-N: northwestern aspect of the island, Type-S: other island aspects) and elevation. The studied coastal cliffs contained 94 flora taxa, of which 13 and 12 taxa were found from either Type-N or Type-S cliffs only. Type-S cliffs retained a larger number of epiphyte and evergreen species but a smaller number of deciduous species than Type-N cliffs (p < 0.05), and 4 out of 8 detected epiphyte species dwelled in Type-S cliffs only. Additionally, the elevation of coastal cliffs was positively related to the proportion of tree and epiphyte species (r = 0.608, p < 0.001) but negatively related to the proportion of herbs (r = −0.649, p < 0.001). These patterns corresponded to differing microclimates such as the severity of cold and dry conditions during winter. We expect that UAV-based approaches will help understand plant ecology under harsh, challenging environments beyond the speculation with traditionally accessible sites only. Full article
(This article belongs to the Section Drones in Ecology)
Show Figures

Figure 1

22 pages, 676 KiB  
Article
A Computation Offloading Scheme for UAV-Edge Cloud Computing Environments Considering Energy Consumption Fairness
by Bongjae Kim, Joonhyouk Jang, Jinman Jung, Jungkyu Han, Junyoung Heo and Hong Min
Drones 2023, 7(2), 139; https://doi.org/10.3390/drones7020139 - 16 Feb 2023
Cited by 10 | Viewed by 3291
Abstract
A heterogeneous computing environment has been widely used with UAVs, edge servers, and cloud servers operating in tandem. Various applications can be allocated and linked to the computing nodes that constitute this heterogeneous computing environment. Efficiently offloading and allocating computational tasks is essential, [...] Read more.
A heterogeneous computing environment has been widely used with UAVs, edge servers, and cloud servers operating in tandem. Various applications can be allocated and linked to the computing nodes that constitute this heterogeneous computing environment. Efficiently offloading and allocating computational tasks is essential, especially in these heterogeneous computing environments with differentials in processing power, network bandwidth, and latency. In particular, UAVs, such as drones, operate using minimal battery power. Therefore, energy consumption must be considered when offloading and allocating computational tasks. This study proposed an energy consumption fairness-aware computational offloading scheme based on a genetic algorithm (GA). The proposed method minimized the differences in energy consumption by allocating and offloading tasks evenly among drones. Based on performance evaluations, our scheme improved the efficiency of energy consumption fairness, as compared to previous approaches, such as Liu et al.’s scheme. We showed that energy consumption fairness was improved by up to 120%. Full article
(This article belongs to the Special Issue Edge Computing and IoT Technologies for Drones)
Show Figures

Figure 1

22 pages, 1427 KiB  
Article
A Distributed Collaborative Allocation Method of Reconnaissance and Strike Tasks for Heterogeneous UAVs
by Hanqiang Deng, Jian Huang, Quan Liu, Tuo Zhao, Cong Zhou and Jialong Gao
Drones 2023, 7(2), 138; https://doi.org/10.3390/drones7020138 - 15 Feb 2023
Cited by 13 | Viewed by 2507
Abstract
Unmanned aerial vehicles (UAVs) are becoming more and more widely used in battlefield reconnaissance and target strikes because of their high cost-effectiveness, but task planning for large-scale UAV swarms is a problem that needs to be solved. To solve the high-risk problem caused [...] Read more.
Unmanned aerial vehicles (UAVs) are becoming more and more widely used in battlefield reconnaissance and target strikes because of their high cost-effectiveness, but task planning for large-scale UAV swarms is a problem that needs to be solved. To solve the high-risk problem caused by incomplete information for the combat area and the potential coordination between targets when a heterogeneous UAV swarm performs reconnaissance and strike missions, this paper proposes a distributed task-allocation algorithm. The method prioritizes tasks by evaluating the swarm’s capability superiority to tasks to reduce the search space, uses the time coordination mechanism and deterrent maneuver strategy to reduce the risk of reconnaissance missions, and uses the distributed negotiation mechanism to allocate reconnaissance tasks and coordinated strike tasks. The simulation results under the distributed framework verify the effectiveness of the distributed negotiation mechanism, and the comparative experiments under different strategies show that the time coordination mechanism and the deterrent maneuver strategy can effectively reduce the mission risk when the target is unknown. The comparison with the centralized global optimization algorithm verifies the efficiency and effectiveness of the proposed method when applied to large-scale UAV swarms. Since the distributed negotiation task-allocation architecture avoids dependence on the highly reliable network and the central node, it can further improve the reliability and scalability of the swarm, and make it applicable to more complex combat environments. Full article
(This article belongs to the Special Issue Multi-UAV Networks)
Show Figures

Figure 1

18 pages, 23718 KiB  
Article
Communication Manager for Hyper-Connected RPAS Environments
by Victor Sanchez-Aguero, Francisco Valera, Ivan Vidal and Borja Nogales
Drones 2023, 7(2), 137; https://doi.org/10.3390/drones7020137 - 15 Feb 2023
Cited by 2 | Viewed by 2223
Abstract
The revolution of Remotely Piloted Aircraft Systems (RPASs), both in the commercial and the research field, has accelerated the arrival of innovative and complex services to the civilian environment within non-segregated airspace. The extensive deployment of these services will still require solving relevant [...] Read more.
The revolution of Remotely Piloted Aircraft Systems (RPASs), both in the commercial and the research field, has accelerated the arrival of innovative and complex services to the civilian environment within non-segregated airspace. The extensive deployment of these services will still require solving relevant challenges in several topics, such as regulation, security, or diverse technical defiance. In particular, the services to be provided increasingly demand network resources and performance improvements. This scenario will be strongly exacerbated by the upcoming resources provided by the 5G/6G architectures, where Remotely Piloted Aircrafts (RPAs) will likely support multiple communication interfaces and will be able to establish multi-hop network connectivity with numerous devices leading to an unprecedented hyper-connected RPA environment. In addition, future RPASs will have to enhance the management of their connectivity capabilities to comply with the latest regulations, which demand an uninterrupted link for the Control and Non-Payload Communications (CNPC). This article presents a flexible Communication Infrastructure Manager (CIM) based on Software-Defined Networking (SDN) and virtualization technologies capable of handling the complexity inherent to this ecosystem and being adapted to different operation requirements to cope with all these communication challenges. Finally, the article shows several validation experiences to demonstrate the potential of the CIM versus the standard approach. Full article
(This article belongs to the Special Issue UAVs in 5G and beyond Networks)
Show Figures

Figure 1

54 pages, 33702 KiB  
Review
Configurations and Applications of Multi-Agent Hybrid Drone/Unmanned Ground Vehicle for Underground Environments: A Review
by Chris Dinelli, John Racette, Mario Escarcega, Simon Lotero, Jeffrey Gordon, James Montoya, Chase Dunaway, Vasileios Androulakis, Hassan Khaniani, Sihua Shao, Pedram Roghanchi and Mostafa Hassanalian
Drones 2023, 7(2), 136; https://doi.org/10.3390/drones7020136 - 14 Feb 2023
Cited by 29 | Viewed by 8764
Abstract
Subterranean openings, including mines, present a unique and challenging environment for robots and autonomous exploration systems. Autonomous robots that are created today will be deployed in harsh and unexplored landscapes that humanity is increasingly encountering in its scientific and technological endeavors. Terrestrial and [...] Read more.
Subterranean openings, including mines, present a unique and challenging environment for robots and autonomous exploration systems. Autonomous robots that are created today will be deployed in harsh and unexplored landscapes that humanity is increasingly encountering in its scientific and technological endeavors. Terrestrial and extraterrestrial environments pose significant challenges for both humans and robots: they are inhospitable and inaccessible to humans due to a lack of space or oxygen, poor or no illumination, unpredictable terrain, a GPS-denied environment, and a lack of satellite imagery or mapping information of any type. Underground mines provide a good physical simulation for these types of environments, and thus, can be useful for testing and developing highly sought-after autonomous navigation frameworks for autonomous agents. This review presents a collective study of robotic systems, both of individual and hybrid types, intended for deployment in such environments. The prevalent configurations, practices for their construction and the hardware equipment of existing multi-agent hybrid robotic systems will be discussed. It aims to provide a supplementary tool for defining the state of the art of coupled Unmanned Ground Vehicle (UGV)–Unmanned Aerial Vehicle (UAV) systems implemented for underground exploration and navigation purposes, as well as to provide some suggestions for multi-agent robotic system solutions, and ultimately, to support the development of a semi-autonomous hybrid UGV–UAV system to assist with mine emergency responses. Full article
Show Figures

Figure 1

20 pages, 28117 KiB  
Article
A Robust and Efficient Loop Closure Detection Approach for Hybrid Ground/Aerial Vehicles
by Yutong Wang, Bin Xu, Wei Fan and Changle Xiang
Drones 2023, 7(2), 135; https://doi.org/10.3390/drones7020135 - 14 Feb 2023
Cited by 4 | Viewed by 2431
Abstract
Frequent and dramatic viewpoint changes make loop closure detection of hybrid ground/aerial vehicles extremely challenging. To address this issue, we present a robust and efficient loop closure detection approach based on the state-of-the-art simultaneous localization and mapping (SLAM) framework and pre-trained deep learning [...] Read more.
Frequent and dramatic viewpoint changes make loop closure detection of hybrid ground/aerial vehicles extremely challenging. To address this issue, we present a robust and efficient loop closure detection approach based on the state-of-the-art simultaneous localization and mapping (SLAM) framework and pre-trained deep learning models. First, the outputs of the SuperPoint network are processed to extract both tracking features and additional features used in loop closure. Next, binary-encoded SuperPoint descriptors are applied with a method based on Bag of VisualWords (BoVW) to detect loop candidates efficiently. Finally, the combination of SuperGlue and SuperPoint descriptors provides correspondences of keypoints to verify loop candidates and calculate relative poses. The system is evaluated on the public datasets and a real-world hybrid ground/aerial vehicles dataset. The proposed approach enables reliable loop detection, even when the relative translation between two viewpoints exceeds 7 m or one of the Euler angles is above 50°. Full article
(This article belongs to the Section Drone Design and Development)
Show Figures

Figure 1

17 pages, 15087 KiB  
Article
Fast and High-Quality Monocular Depth Estimation with Optical Flow for Autonomous Drones
by Tomoyasu Shimada, Hiroki Nishikawa, Xiangbo Kong and Hiroyuki Tomiyama
Drones 2023, 7(2), 134; https://doi.org/10.3390/drones7020134 - 14 Feb 2023
Cited by 2 | Viewed by 4269
Abstract
Recent years, autonomous drones have attracted attention in many fields due to their convenience. Autonomous drones require precise depth information so as to avoid collision to fly fast and both of RGB image and LiDAR point cloud are often employed in applications based [...] Read more.
Recent years, autonomous drones have attracted attention in many fields due to their convenience. Autonomous drones require precise depth information so as to avoid collision to fly fast and both of RGB image and LiDAR point cloud are often employed in applications based on Convolutional Neural Networks (CNNs) to estimate the distance to obstacles. Such applications are implemented onboard embedded systems. In order to precisely estimate the depth, such CNN models are in general so complex to extract many features that the computational complexity increases, requiring long inference time. In order to solve the issue, we employ optical flow to aid in-depth estimation. In addition, we propose a new attention structure that makes maximum use of optical flow without complicating the network. Furthermore, we achieve improved performance without modifying the depth estimator by adding a perceptual discriminator in training. The proposed model is evaluated through accuracy, error, and inference time on the KITTI dataset. In the experiments, we have demonstrated the proposed method achieves better performance by up to 34% accuracy, 55% error reduction and 66% faster inference time on Jetson nano compared to previous methods. The proposed method is also evaluated through a collision avoidance in simulated drone flight and achieves the lowest collision rate of all estimation methods. These experimental results show the potential of proposed method to be used in real-world autonomous drone flight applications. Full article
(This article belongs to the Special Issue Edge Computing and IoT Technologies for Drones)
Show Figures

Figure 1

25 pages, 11167 KiB  
Article
An Automatic Visual Inspection of Oil Tanks Exterior Surface Using Unmanned Aerial Vehicle with Image Processing and Cascading Fuzzy Logic Algorithms
by Mohammed A. H. Ali, Muhammad Baggash, Jaloliddin Rustamov, Rawad Abdulghafor, Najm Al-Deen N. Abdo, Mubarak H. G. Abdo, Talep S. Mohammed, Ameen A. Hasan, Ali N. Abdo, Sherzod Turaev and Yusoff Nukman
Drones 2023, 7(2), 133; https://doi.org/10.3390/drones7020133 - 13 Feb 2023
Cited by 5 | Viewed by 3051
Abstract
This paper presents an automatic visual inspection of exterior surface defects of oil tanks using unmanned aerial vehicles (UAVs) and image processing with two cascading fuzzy logic algorithms. Corrosion is one of the defects that has a serious effect on the safety of [...] Read more.
This paper presents an automatic visual inspection of exterior surface defects of oil tanks using unmanned aerial vehicles (UAVs) and image processing with two cascading fuzzy logic algorithms. Corrosion is one of the defects that has a serious effect on the safety of the surface of oil and gas tanks. At present, human inspection, and climbing robots inspection are the dominant approach for rust detection in oil and gas tanks. However, there are many shortcomings to this approach, such as taking longer, high cost, and covering less surface area inspection of the tank. The purpose of this research is to detect the rust in oil tanks by localizing visual inspection technology using UAVs, as well as to develop algorithms to distinguish between defects and noise. The study focuses on two basic aspects of oil tank inspection through the images captured by the UAV, namely, the detection of defects and the distinction between defects and noise. For the former, an image processing algorithm was developed to improve or remove noise, adjust the brightness of the captured image, and extract features to identify defects in oil tanks. Meanwhile, for the latter aspect, a cascading fuzzy logic algorithm and threshold algorithm were developed to distinguish between defects and noise levels and reduce their impact through three stages of processing: The first stage of fuzzy logic aims to distinguish between defects and low noise generated by the appearance of objects on the surface of the tank, such as trees or stairs, and reduce their impact. The second stage aims to distinguish between defects and medium noise generated by shadows or the presence of small objects on the surface of the tank and reduce their impact. The third stage of the thresholding algorithm aims to distinguish between defects and high noise generated by sedimentation on the surface of the tank and reduce its impact. The samples were classified based on the output of the third stage of the threshold process into defective or non-defective samples. The proposed algorithms were tested on 180 samples and the results show its superiority in the inspection and detection of defects with an accuracy of 83%. Full article
(This article belongs to the Special Issue Intelligent Image Processing and Sensing for Drones)
Show Figures

Figure 1

23 pages, 632 KiB  
Article
Service Function Chain Scheduling in Heterogeneous Multi-UAV Edge Computing
by Yangang Wang, Hai Wang, Xianglin Wei, Kuang Zhao, Jianhua Fan, Juan Chen, Yongyang Hu and Runa Jia
Drones 2023, 7(2), 132; https://doi.org/10.3390/drones7020132 - 13 Feb 2023
Cited by 7 | Viewed by 1901
Abstract
Supporting Artificial Intelligence (AI)-enhanced intelligent applications on the resource-limited Unmanned Aerial Vehicle (UAV) platform is difficult due to the resource gap between the two. It is promising to partition an AI application into a service function (SF) chain and then dispatch the SFs [...] Read more.
Supporting Artificial Intelligence (AI)-enhanced intelligent applications on the resource-limited Unmanned Aerial Vehicle (UAV) platform is difficult due to the resource gap between the two. It is promising to partition an AI application into a service function (SF) chain and then dispatch the SFs onto multiple UAVs. However, it is still a challenging task to efficiently schedule the computation and communication resources of multiple UAVs to support a large number of SF chains (SFCs). Under the multi-UAV edge computing paradigm, this paper formulates the SFC scheduling problem as a 0–1 nonlinear integer programming problem. Then, a two-stage heuristic algorithm is put forward to solve this problem. At the first stage, if the resources are surplus, the SFCs are deployed to UAV edge servers in parallel based on our proposed pairing principle between SFCs and UAVs for minimizing the completion time sum of tasks. In contrast, a revenue maximization heuristic method is adopted to deploy the arrived SFCs in a serial service mode when the resource is insufficient. A series of experiments are conducted to evaluate the performance of our proposal. Results show that our algorithm outperforms other benchmark algorithms in the completion time sum of tasks, the overall revenue, and the task execution success ratio Full article
(This article belongs to the Special Issue Multi-UAV Networks)
Show Figures

Figure 1

23 pages, 3010 KiB  
Article
Two-Step Approach toward Alignment of Spatiotemporal Wide-Area Unmanned Aerial Vehicle Imageries
by Hyeonseok Lee, Semo Kim, Dohun Lim, Seoung-Hun Bae, Lae-Hyong Kang and Sungchan Kim
Drones 2023, 7(2), 131; https://doi.org/10.3390/drones7020131 - 12 Feb 2023
Viewed by 2062
Abstract
Recently, analysis and decision-making based on spatiotemporal unmanned aerial vehicle (UAV) high-resolution imagery are gaining significant attention in smart agriculture. Constructing a spatiotemporal dataset requires multiple UAV image mosaics taken at different times. Because the weather or a UAV flight trajectory is subject [...] Read more.
Recently, analysis and decision-making based on spatiotemporal unmanned aerial vehicle (UAV) high-resolution imagery are gaining significant attention in smart agriculture. Constructing a spatiotemporal dataset requires multiple UAV image mosaics taken at different times. Because the weather or a UAV flight trajectory is subject to change when the images are taken, the mosaics are typically unaligned. This paper proposes a two-step approach, composed of global and local alignments, for spatiotemporal alignment of two wide-area UAV mosaics of high resolution. The first step, global alignment, finds a projection matrix that initially maps keypoints in the source mosaic onto matched counterparts in the target mosaic. The next step, local alignment, refines the result of the global alignment. The proposed method splits input mosaics into patches and applies individual transformations to each patch to enhance the remaining local misalignments at patch level. Such independent local alignments may result in new artifacts at patch boundaries. The proposed method uses a simple yet effective technique to suppress those artifacts without harming the benefit of the local alignment. Extensive experiments validate the proposed method by using several datasets for highland fields and plains in South Korea. Compared with a recent work, the proposed method improves the accuracy of alignment by up to 13.21% over the datasets. Full article
Show Figures

Figure 1

21 pages, 4932 KiB  
Article
Design and Implementation of UAV Velocity Controller Based on Reference Model Sliding Mode Control
by Qi Wang, Wei Wang, Satoshi Suzuki, Akio Namiki, Hongxun Liu and Ziran Li
Drones 2023, 7(2), 130; https://doi.org/10.3390/drones7020130 - 10 Feb 2023
Cited by 9 | Viewed by 4130
Abstract
In recent years, multi-rotor unmanned aerial vehicles (UAV) have been widely applied for various applications; however, they are yet to be as commonly utilized in certain industrial transportation applications. Thus, this work designed and implemented a reference model-based integral sliding mode control (SMC) [...] Read more.
In recent years, multi-rotor unmanned aerial vehicles (UAV) have been widely applied for various applications; however, they are yet to be as commonly utilized in certain industrial transportation applications. Thus, this work designed and implemented a reference model-based integral sliding mode control (SMC) method applied to the velocity controller of a multi-rotor UAV. The designed controller was compared with an integral SMC scheme, and then the controller and modeling robustness were verified. Finally, the proposed method was applied to an industrial six-rotor UAV. Three experiments involving target-tracking, fixed-point hovering, and robustness verification were executed. A load of approximately 81.5% of the UAV’s self-weight was used to verify the robustness of the proposed scheme against parameter uncertainty. This work will serve as a meaningful reference for the application of the SMC in practical industrial applications. Full article
Show Figures

Figure 1

20 pages, 86247 KiB  
Article
SunMap: Towards Unattended Maintenance of Photovoltaic Plants Using Drone Photogrammetry
by David Hernández-López, Esteban Ruíz de Oña, Miguel A. Moreno and Diego González-Aguilera
Drones 2023, 7(2), 129; https://doi.org/10.3390/drones7020129 - 10 Feb 2023
Cited by 5 | Viewed by 3453
Abstract
Global awareness of environmental issues has boosted interest in renewable energy resources, among which solar energy is one of the most attractive renewable sources. The massive growth of PV plants, both in number and size, has motivated the development of new approaches for [...] Read more.
Global awareness of environmental issues has boosted interest in renewable energy resources, among which solar energy is one of the most attractive renewable sources. The massive growth of PV plants, both in number and size, has motivated the development of new approaches for their inspection and monitoring. In this paper, a rigorous drone photogrammetry approach using optical Red, Green and Blue (RGB) and Infrared Thermography (IRT) images is applied to detect one of the most common faults (hot spots) in photovoltaic (PV) plants. The latest advances in photogrammetry and computer vision (i.e., Structure from Motion (SfM) and multiview stereo (MVS)), together with advanced and robust analysis of IRT images, are the main elements of the proposed methodology. We developed an in-house software application, SunMap, that allows automatic, accurate, and reliable detection of hot spots on PV panels. Along with the identification and geolocation of malfunctioning PV panels, SunMap provides high-quality cartographic products by means of 3D models and true orthophotos that provide additional support for maintenance operations. Validation of SunMap was performed in two different PV plants located in Spain, generating positive results in the detection and geolocation of anomalies with an error incidence lower than 15% as validated by the manufacturer’s standard electrical tests. Full article
Show Figures

Figure 1

21 pages, 11486 KiB  
Article
Numerical Simulation and Analysis of Droplet Drift Motion under Different Wind Speed Environments of Single-Rotor Plant Protection UAVs
by Juan Wang, Xiaoyi Lv, Bohong Wang, Xinguo Lan, Yingbin Yan, Shengde Chen and Yubin Lan
Drones 2023, 7(2), 128; https://doi.org/10.3390/drones7020128 - 10 Feb 2023
Cited by 9 | Viewed by 2669
Abstract
Unmanned aerial vehicles (UAVs) have been widely used in plant protection, and the mechanism of droplet deposition drift while spraying with the 3WQF120-12 produced by Quanfeng Aviation, a representative model of single-rotor plant protection UAVs in China, still requires more research. This study [...] Read more.
Unmanned aerial vehicles (UAVs) have been widely used in plant protection, and the mechanism of droplet deposition drift while spraying with the 3WQF120-12 produced by Quanfeng Aviation, a representative model of single-rotor plant protection UAVs in China, still requires more research. This study used a combination of computational fluid dynamics (CFD) and wind tunnel experiments to analyze the droplet deposition drift pattern of the 3WQF120-12 single-rotor plant protection UAV. The CFD modeling of the nozzle was confirmed to be feasible using wind tunnel experiments. Pearson correlation analysis was performed between experimental and simulated values, and multiple correlation coefficients reached above 0.89, which is a robust correlation. In this study, CFD simulations were performed to simulate the drift of UAV spray droplets under the rotor wind field and the combined effect of front and side winds. The deposition of droplets at different heights was simulated. The UAV’s spraying conditions at different flight speeds, side wind magnitudes, and spraying heights were evaluated. According to the CFD simulation results of the 3WQF120-12 plant protection UAV, the recommended flight height is 1–3 m, the recommended flight speed is below 3 m/s, and the recommended ambient wind speed is within 3 m/s. The simulation results were verified by the field test, and the trend of the field experimental data and CFD simulation results are qualitatively consistent to verify the reasonableness and feasibility of the simulation’s data. The simulated results were similar to the curves and spray area of the field test results at operating heights of 1.5 m and 3.5 m. Full article
(This article belongs to the Special Issue Recent Advances in Crop Protection Using UAV and UGV)
Show Figures

Figure 1

21 pages, 1102 KiB  
Article
Towards a Quantitative Approach for Determining DAA System Risk Ratio
by Kris Ellis and Iryna Borshchova
Drones 2023, 7(2), 127; https://doi.org/10.3390/drones7020127 - 10 Feb 2023
Cited by 2 | Viewed by 2407
Abstract
Specific Operations Risk Assessment (SORA) is a methodology developed by the Joint Authority on Rulemaking for Unmanned Systems (JARUS) for safely conducting and evaluating Remotely Piloted Aircraft Systems (RPAS) operations in specific airspace. Many regulators, including Transport Canada (TC), the civilian aviation authority [...] Read more.
Specific Operations Risk Assessment (SORA) is a methodology developed by the Joint Authority on Rulemaking for Unmanned Systems (JARUS) for safely conducting and evaluating Remotely Piloted Aircraft Systems (RPAS) operations in specific airspace. Many regulators, including Transport Canada (TC), the civilian aviation authority in Canada, have adopted the SORA approach to guide RPAS operators in their applications for Beyond Visual Line of Sight (BVLOS) flight. Although the qualitative approach on how to assess the performance of a Detect and Avoid (DAA) system is outlined in the SORA, a quantitative and agreed-upon approach, on how to ensure that the specific DAA system meets the required Risk Ratio criteria, has yet to be established. This paper proposes a practical approach to determining the Risk Ratio, considering sensor performance, RPA maneuvering characteristics, and airspace specifics. The developed approach relies on publicly available modelling frameworks and airspace models. Illustrative examples of applying the method to determine the Risk Ratio of specific DAA systems are presented in the paper along with a discussion on the challenges of implementing SORA into BVLOS regulations for RPAS. Full article
Show Figures

Figure 1

14 pages, 2633 KiB  
Article
Distributed Antenna in Drone Swarms: A Feasibility Study
by Stuart William Harmer and Gianluca De Novi
Drones 2023, 7(2), 126; https://doi.org/10.3390/drones7020126 - 10 Feb 2023
Cited by 7 | Viewed by 3505
Abstract
Unmanned aerial vehicles offer a versatile platform for the realization of phased array antenna systems, enabling multiple antenna elements to be distributed spatially in an agile, flexible, and cost-effective manner. Deploying individual antenna elements on single drones and using a swarm of such [...] Read more.
Unmanned aerial vehicles offer a versatile platform for the realization of phased array antenna systems, enabling multiple antenna elements to be distributed spatially in an agile, flexible, and cost-effective manner. Deploying individual antenna elements on single drones and using a swarm of such drones to create an antenna array has the potential to be a disruptive technology. Antenna directivity is limited by the physical aperture size as compared to the wavelength of the radiation being transmitted/received, with electrically larger antennas giving a higher directivity at the cost of an increased size and weight. The authors presented a brief feasibility study using a simple mathematical model implemented in software to explore the predicted performance of the novel UAV deployed antenna array, the limitations of such a system, and the potential applications where such a capability would be beneficial. The authors concluded that it is possible to achieve a suitably coherent superposition of electromagnetic radiation at frequencies of ~1 GHz and lower with current global positioning technologies which offer centimeter scale positioning accuracy and with current drone positioning systems used to control drone swarms. Full article
Show Figures

Figure 1

22 pages, 15585 KiB  
Article
RSIn-Dataset: An UAV-Based Insulator Detection Aerial Images Dataset and Benchmark
by Feng Shuang, Sheng Han, Yong Li and Tongwei Lu
Drones 2023, 7(2), 125; https://doi.org/10.3390/drones7020125 - 10 Feb 2023
Cited by 11 | Viewed by 3091
Abstract
Power line inspection is an important part of the smart grid. Efficient real-time detection of power devices on the power line is a challenging problem for power line inspection. In recent years, deep learning methods have achieved remarkable results in image classification and [...] Read more.
Power line inspection is an important part of the smart grid. Efficient real-time detection of power devices on the power line is a challenging problem for power line inspection. In recent years, deep learning methods have achieved remarkable results in image classification and object detection. However, in the power line inspection based on computer vision, datasets have a significant impact on deep learning. The lack of public high-quality power scene data hinders the application of deep learning. To address this problem, we built a dataset for power line inspection scenes, named RSIn-Dataset. RSIn-Dataset contains 4 categories and 1887 images, with abundant backgrounds. Then, we used mainstream object detection methods to build a benchmark, providing reference for insulator detection. In addition, to address the problem of detection inefficiency caused by large model parameters, an improved YoloV4 is proposed, named YoloV4++. It uses a lightweight network, i.e., MobileNetv1, as the backbone, and employs the depthwise separable convolution to replace the standard convolution. Meanwhile, the focal loss is implemented in the loss function to solve the impact of sample imbalance. The experimental results show the effectiveness of YoloV4++. The mAP and FPS can reach 94.24% and 53.82 FPS, respectively. Full article
Show Figures

Figure 1

20 pages, 7780 KiB  
Article
Distributed Bearing-Only Formation Control for UAV-UWSV Heterogeneous System
by Shaoshi Li, Xingjian Wang, Shaoping Wang and Yuwei Zhang
Drones 2023, 7(2), 124; https://doi.org/10.3390/drones7020124 - 10 Feb 2023
Cited by 14 | Viewed by 2379
Abstract
This paper investigates the bearing-only formation control problem of a heterogeneous multi-vehicle system, which includes unmanned aerial vehicles (UAVs) and unmanned surface vehicles (UWSVs). The interactions among vehicles are described by a particular class of directed and acyclic graphs, namely heterogeneous leader-first follower [...] Read more.
This paper investigates the bearing-only formation control problem of a heterogeneous multi-vehicle system, which includes unmanned aerial vehicles (UAVs) and unmanned surface vehicles (UWSVs). The interactions among vehicles are described by a particular class of directed and acyclic graphs, namely heterogeneous leader-first follower (HLFF) graphs. Under the HLFF structure, a UAV is selected as the leader, moving with the reference dynamics, while the followers, including both UAVs and UWSVs, are responsible for controlling the position with regard to the neighbors in the formation. To solve the problem, we propose a velocity-estimation-based control scheme, which consists of a distributed observer for estimating the reference velocity of each vehicle and a distributed formation control law for achieving the desired formation based on the estimations and bearing measurements. Moreover, it is shown that the translation and scale of the formation can be uniquely determined by the leader UAV. The theoretical analysis demonstrated the finite-time convergence of the velocity estimation and the asymptotic convergence of the formation tracking. Comparative simulation results are provided to substantiate the effectiveness of the proposed method. Full article
(This article belongs to the Special Issue Swarm Intelligence in Multi-UAVs)
Show Figures

Figure 1

34 pages, 8892 KiB  
Article
UAV Path Planning Optimization Strategy: Considerations of Urban Morphology, Microclimate, and Energy Efficiency Using Q-Learning Algorithm
by Anderson Souto, Rodrigo Alfaia, Evelin Cardoso, Jasmine Araújo and Carlos Francês
Drones 2023, 7(2), 123; https://doi.org/10.3390/drones7020123 - 9 Feb 2023
Cited by 20 | Viewed by 3729
Abstract
The use of unmanned aerial vehicles (UAVS) has been suggested as a potential communications alternative due to their fast implantation, which makes this resource an ideal solution to provide support in scenarios such as natural disasters or intentional attacks that may cause partial [...] Read more.
The use of unmanned aerial vehicles (UAVS) has been suggested as a potential communications alternative due to their fast implantation, which makes this resource an ideal solution to provide support in scenarios such as natural disasters or intentional attacks that may cause partial or complete disruption of telecommunications services. However, one limitation of this solution is energy autonomy, which affects mission life. With this in mind, our group has developed a new method based on reinforcement learning that aims to reduce the power consumption of UAV missions in disaster scenarios to circumvent the negative effects of wind variations, thus optimizing the timing of the aerial mesh in locations affected by the disruption of fiber-optic-based telecommunications. The method considers the K-means to stagger the position of the resource stations—from which the UAVS launched—within the topology of Stockholm, Sweden. For the UAVS’ locomotion, the Q-learning approach was used to investigate possible actions that the UAVS could take due to urban obstacles randomly distributed in the scenario and due to wind speed. The latter is related to the way the UAVS are arranged during the mission. The numerical results of the simulations have shown that the solution based on reinforcement learning was able to reduce the power consumption by 15.93% compared to the naive solution, which can lead to an increase in the life of UAV missions. Full article
(This article belongs to the Special Issue AAM Integration: Strategic Insights and Goals)
Show Figures

Figure 1

24 pages, 3224 KiB  
Article
Quadrotor Path Planning and Polynomial Trajectory Generation Using Quadratic Programming for Indoor Environments
by Muhammad Awais Arshad, Jamal Ahmed and Hyochoong Bang
Drones 2023, 7(2), 122; https://doi.org/10.3390/drones7020122 - 9 Feb 2023
Cited by 4 | Viewed by 5352
Abstract
This study considers the problem of generating optimal, kino-dynamic-feasible, and obstacle-free trajectories for a quadrotor through indoor environments. We explore methods to overcome the challenges faced by quadrotors for indoor settings due to their higher-order vehicle dynamics, relatively limited free spaces through the [...] Read more.
This study considers the problem of generating optimal, kino-dynamic-feasible, and obstacle-free trajectories for a quadrotor through indoor environments. We explore methods to overcome the challenges faced by quadrotors for indoor settings due to their higher-order vehicle dynamics, relatively limited free spaces through the environment, and challenging optimization constraints. In this research, we propose a complete pipeline for path planning, trajectory generation, and optimization for quadrotor navigation through indoor environments. We formulate the trajectory generation problem as a Quadratic Program (QP) with Obstacle-Free Corridor (OFC) constraints. The OFC is a collection of convex overlapping polyhedra that model tunnel-like free connecting space from current configuration to goal configuration. Linear inequality constraints provided by the polyhedra of OFCs are used in the QP for real-time optimization performance. We demonstrate the feasibility of our approach, its performance, and its completeness by simulating multiple environments of differing sizes and varying obstacle densities using MATLAB Optimization Toolbox. We found that our approach has higher chances of convergence of optimization solver as compared to current approaches for challenging scenarios. We show that our proposed pipeline can plan complete paths and optimize trajectories in a few hundred milliseconds and within approximately ten iterations of the optimization solver for everyday indoor settings. Full article
Show Figures

Figure 1

15 pages, 3707 KiB  
Article
Sensitivity of LiDAR Parameters to Aboveground Biomass in Winter Spelt
by Carsten Montzka, Marco Donat, Rahul Raj, Philipp Welter and Jordan Steven Bates
Drones 2023, 7(2), 121; https://doi.org/10.3390/drones7020121 - 9 Feb 2023
Cited by 2 | Viewed by 2147
Abstract
Information about the current biomass state of crops is important to evaluate whether the growth conditions are adequate in terms of water and nutrient supply to determine if there is need to react to diseases and to predict the expected yield. Passive optical [...] Read more.
Information about the current biomass state of crops is important to evaluate whether the growth conditions are adequate in terms of water and nutrient supply to determine if there is need to react to diseases and to predict the expected yield. Passive optical Unmanned Aerial Vehicle (UAV)-based sensors such as RGB or multispectral cameras are able to sense the canopy surface and record, e.g., chlorophyll-related plant characteristics, which are often indirectly correlated to aboveground biomass. However, direct measurements of the plant structure can be provided by LiDAR systems. In this study, different LiDAR-based parameters are evaluated according to their relationship to aboveground fresh and dry biomass (AGB) for a winter spelt experimental field in Dahmsdorf, Brandenburg, Germany. The parameters crop height, gap fraction, and LiDAR intensity are analyzed according to their individual correlation with AGB, and also a multiparameter analysis using the Ordinary Least Squares Regression (OLS) is performed. Results indicate high absolute correlations of AGB with gap fraction and crop height (−0.82 and 0.77 for wet and −0.70 and 0.66 for dry AGB, respectively), whereas intensity needs further calibration or processing before it can be adequately used to estimate AGB (−0.27 and 0.22 for wet and dry AGB, respectively). An important outcome of this study is that the combined utilization of all LiDAR parameters via an OLS analysis results in less accurate AGB estimation than with gap fraction or crop height alone. Moreover, future AGB states in June and July were able to be estimated from May LiDAR parameters with high accuracy, indicating stable spatial patterns in crop characteristics over time. Full article
(This article belongs to the Special Issue UAS in Smart Agriculture)
Show Figures

Figure 1

24 pages, 5384 KiB  
Article
Acoustic SLAM Based on the Direction-of-Arrival and the Direct-to-Reverberant Energy Ratio
by Wenhao Qiu, Gang Wang and Wenjing Zhang
Drones 2023, 7(2), 120; https://doi.org/10.3390/drones7020120 - 9 Feb 2023
Cited by 2 | Viewed by 2218
Abstract
This paper proposes a new method that fuses acoustic measurements in the reverberation field and low-accuracy inertial measurement unit (IMU) motion reports for simultaneous localization and mapping (SLAM). Different from existing studies that only use acoustic data for direction-of-arrival (DoA) estimates, the source’s [...] Read more.
This paper proposes a new method that fuses acoustic measurements in the reverberation field and low-accuracy inertial measurement unit (IMU) motion reports for simultaneous localization and mapping (SLAM). Different from existing studies that only use acoustic data for direction-of-arrival (DoA) estimates, the source’s distance from sensors is calculated with the direct-to-reverberant energy ratio (DRR) and applied to eliminate the nonlinear noise from motion reports. A particle filter is applied to estimate the critical distance, which is key for associating the source’s distance with the DRR. A keyframe method is used to eliminate the deviation of the source position estimation toward the robot. The proposed DoA-DRR acoustic SLAM (D-D SLAM) is designed for three-dimensional motion and is suitable for drones. The method is the first acoustic SLAM algorithm that has been validated on a real-world drone dataset that contains only acoustic data and IMU measurements. Compared with previous methods, D-D SLAM has acceptable performance in locating the drone and building a source map from a real-world drone dataset. The average location accuracy is 0.48 m, while the source position error converges to less than 0.25 m within 2.8 s. These results prove the effectiveness of D-D SLAM in real-world scenes. Full article
Show Figures

Figure 1

22 pages, 2783 KiB  
Article
Attitude Control of a Hypersonic Glide Vehicle Based on Reduced-Order Modeling and NESO-Assisted Backstepping Variable Structure Control
by Wenxin Le, Hanyu Liu, Ruiyuan Zhao and Jian Chen
Drones 2023, 7(2), 119; https://doi.org/10.3390/drones7020119 - 8 Feb 2023
Cited by 3 | Viewed by 2055
Abstract
Aiming at solving the control problem caused by the large-scale change of the Hypersonic Glide Vehicle (HGV) parameters, this paper proposes a design method of backstepping variable structure attitude controller based on Nonlinear Extended State Observer (NESO), with the characteristics of HGV model [...] Read more.
Aiming at solving the control problem caused by the large-scale change of the Hypersonic Glide Vehicle (HGV) parameters, this paper proposes a design method of backstepping variable structure attitude controller based on Nonlinear Extended State Observer (NESO), with the characteristics of HGV model and the idea of uncertainty estimation and compensation associated. Firstly, the design of the second-order NESO is studied. Due to the large number of NESO parameters, a systematic method for determining the second-order NESO parameters is given in this paper, and the stability of the observer is proved completely using the piecewise Lyapunov analysis. Then, the NESO-assisted backstepping variable structure attitude controller employs the reduced-order modeling idea to decompose the whole system design problem into two first-order subsystem design problem, and classifies the nonlinear dynamic changes caused by the large-scale changes of the aircraft parameters into the aggregated uncertain terms of the two subsystems. The simulation results show that the backstepping attitude controller based on NESO can realize the stable and accurate tracking of the flight attitude when the aircraft parameters change in a large range. Full article
Show Figures

Figure 1

19 pages, 3878 KiB  
Systematic Review
A Systematic Literature Review (SLR) on Autonomous Path Planning of Unmanned Aerial Vehicles
by Anees ul Husnain, Norrima Mokhtar, Noraisyah Mohamed Shah, Mahidzal Dahari and Masahiro Iwahashi
Drones 2023, 7(2), 118; https://doi.org/10.3390/drones7020118 - 8 Feb 2023
Cited by 11 | Viewed by 6203
Abstract
UAVs have been contributing substantially to multi-disciplinary research and around 70% of the articles have been published in just about the last five years, with an exponential increase. Primarily, while exploring the literature from the scientific databases for various aspects within the autonomous [...] Read more.
UAVs have been contributing substantially to multi-disciplinary research and around 70% of the articles have been published in just about the last five years, with an exponential increase. Primarily, while exploring the literature from the scientific databases for various aspects within the autonomous UAV path planning, such as type and configuration of UAVs, the complexity of their environments or workspaces, choices of path generating algorithms, nature of solutions and efficacy of the generated paths, necessitates an increased number of search keywords as a prerequisite. However, the addition of more and more keywords might as well curtail some conducive and worthwhile search results in the same pursuit. This article presents a Systematic Literature Review (SLR) for 20 useful parameters, organized into six distinct categories that researchers and industry practitioners usually consider. In this work, Web of Science (WOS) was selected to search the primary studies based on three keywords: “Autonomous” + “Path Planning” + “UAV” and following the exclusion and inclusion criteria defined within the SLR methodology, 90 primary studies were considered. Through literature synthesis, a unique perspective to see through the literature is established in terms of characteristic research sectors for UAVs. Moreover, open research challenges from recent studies and state-of-the-art contributions to address them were highlighted. It was also discovered that the autonomy of UAVs and the extent of their mission complexities go hand-in-hand, and the benchmark to define a fully autonomous UAV is an arbitral goal yet to be achieved. To further this quest, the study cites two key models to measure a drone’s autonomy and offers a novel complexity matrix to measure the extent of a drone’s autonomy. Additionally, since preliminary-level researchers often look for technical means to assess their ideas, the technologies used in academic research are also tabulated with references. Full article
(This article belongs to the Section Drone Design and Development)
Show Figures

Figure 1

18 pages, 41864 KiB  
Article
Special Vehicle Detection from UAV Perspective via YOLO-GNS Based Deep Learning Network
by Zifeng Qiu, Huihui Bai and Taoyi Chen
Drones 2023, 7(2), 117; https://doi.org/10.3390/drones7020117 - 8 Feb 2023
Cited by 32 | Viewed by 4992
Abstract
At this moment, many special vehicles are engaged in illegal activities such as illegal mining, oil and gas theft, the destruction of green spaces, and illegal construction, which have serious negative impacts on the environment and the economy. The illegal activities of these [...] Read more.
At this moment, many special vehicles are engaged in illegal activities such as illegal mining, oil and gas theft, the destruction of green spaces, and illegal construction, which have serious negative impacts on the environment and the economy. The illegal activities of these special vehicles are becoming more and more rampant because of the limited number of inspectors and the high cost required for surveillance. The development of drone remote sensing is playing an important role in allowing efficient and intelligent monitoring of special vehicles. Due to limited onboard computing resources, special vehicle object detection still faces challenges in practical applications. In order to achieve the balance between detection accuracy and computational cost, we propose a novel algorithm named YOLO-GNS for special vehicle detection from the UAV perspective. Firstly, the Single Stage Headless (SSH) context structure is introduced to improve the feature extraction and facilitate the detection of small or obscured objects. Meanwhile, the computational cost of the algorithm is reduced in view of GhostNet by replacing the complex convolution with a linear transform by simple operation. To illustrate the performance of the algorithm, thousands of images are dedicated to sculpting in a variety of scenes and weather, each with a UAV view of special vehicles. Quantitative and comparative experiments have also been performed. Compared to other derivatives, the algorithm shows a 4.4% increase in average detection accuracy and a 1.6 increase in detection frame rate. These improvements are considered to be useful for UAV applications, especially for special vehicle detection in a variety of scenarios. Full article
Show Figures

Figure 1

Previous Issue
Next Issue
Back to TopTop