1. Introduction
Precision agriculture (PA) is the use of large data sources in conjunction with crop and environmental advanced analytical tools to help farmers make better informed decisions and accurately (right rates, right times, and right places) manage their fields, with the goal of achieving both economic and environmental targets [
1,
2]. Recently, there has been growing interest in PA globally as a promising step towards meeting an unprecedented demand to produce more food and energy of higher qualities in a more sustainable manner by optimizing externalities [
3]. PA practices have evolved significantly over recent years, with the global market now estimated to reach
$43.4 billion by 2025 [
4]. PA based on a previous map of any of the variables of interest can be performed by using remote sensing (RS) technology. RS allows growers to collect, visualize, and evaluate crop and soil health conditions at various stages of production in a convenient and cost-effective manner [
5]. It can serve as an early indicator to detect potential problems, and provide opportunities to address these problems in a timely fashion.
In RS, platform type dictates attributes such as deployment time and range, the sensor’s distance from the object of interest, periodicity of image acquisition, image acquisition timing, location and extent of coverage. Unmanned Aerial Vehicles’ (UAVs) capabilities offer the potential to revolutionize traditional RS platforms for real-time crop monitoring, weed detection, tree classification, water stress assessment, disease detection, yield estimation, and various pest and nutrient management strategies. Although, UAVs have not yet made it into the mainstream of PA practices, they are playing an increasingly important role in precision farming, helping agriculture professionals lead the way with sustainable farming practices, while also protecting and increasing profitability [
4]. UAVs provide growers, agronomists, and companies that serve the industry with high-quality images and data. In supporting PA, UAVs can conduct a broad range of agricultural operations including soil health scanning, irrigation schedules planning, seed planting, fertilizers applying, and weather analyzing. UAVs provide distinct advantages over other RS platforms, including:
Rapid data collection with high quality, range, and resolution
Capability to combine 3D canopy height and orthophoto information
Ability to create canopy height models from Structure-From-Motion (SFM) point clouds
Capability to capture multi-angular data (particularly from snapshot cameras)
Capacity to operate multiple sensors at the same time.
A number of review studies on UAVs and their applications in various domains that underline the popularity, importance, and explosion of this topic among researchers in the last decade are shown in
Table 1. These studies projected that crop monitoring for pests, weeds, and diseases will become the most prevalent application of UAVs RS [
6].
UAVs are commonly used for RS in agriculture for scouting crop fields and monitoring livestock [
17]. For example, multispectral camera integrated UAVs, have been used for crop yield assessments, crop height monitoring, crop weed mapping, and biomass monitoring [
18,
19,
20,
21]. Aerial data can be successfully acquired with high spatial and temporal resolution with the UAVs and UAV integrated subsystems [
22]. Some of these UAVs’ subsystems are capable of measuring variety of air pollutants due to the recent developments in sensor technology [
23]. RS is not the only type of application of the UAVs. Aerial spraying of herbicides or pesticides, aerial sensing of sound and identifying changes in land structure for city planning are other types of recently emerged UAV applications [
24,
25]. UAVs were considered as an effective emergency relief vehicle that their use include but not limited to blood delivery, ambulance for cardiac arrest, and disaster relief operations [
26,
27,
28]. UAVs provide distinct advantages such as ability to rapidly and remotely travel to pre-defined locations that are difficult to access and to execute tasks efficiently at relatively lower costs and time. For instance, UAV-assisted aerial images that are taken from waterbodies can help visualize disturbances in water and provide enhanced spatial water quality monitoring data [
29,
30]. Topographic changes in watersheds can be monitored with UAV attached high-resolution cameras and other sensors [
31]. The specific coordinates of contaminations can be acquired from these surveys and can be included in water quality monitoring plan for further sampling. Besides RS, UAVs and special sub-systems can be used for making in situ water quality measurements for pH, dissolved oxygen, electrical conductivity, and temperature from surface waters [
32]. In compliance with the in situ measurements, water sample collection with custom designed water collection devices can be used for enhancing water quality monitoring in larger waterbodies [
33,
34].
Several investigations have been conducted on UAVs’ advantages and disadvantages over other RS platforms [
7,
34,
35]. A concise comparison of technical specifications of the most frequently used RS platforms in Precision Agriculture (PA) is presented in
Table 2. Equipped with proper hardware components, sensors, and the ability to collect high spatial and temporal resolution data for relatively short periods, UAVs could either substitute for or be complementary to many of these platforms [
7,
10,
13,
14,
16]. Compared to traditional RS platforms:
UAVs are more flexible and can overcome shortcomings such as pilot fatigue and fuel limitation.
UAVs are locally accessible and excel at the ability to provide near-real-time imagery of high spatial (e.g., pixels < 3 cm), spectral, and temporal resolutions.
UAVs are considered as fast survey platforms over proximal ground-based systems for non-destructive methods of data collection [
36].
UAVs are cost-effective, easier to operate, flexible to deploy where and when needed, and able to fly below the clouds [
37].
Even though UAVs have advantages over traditional RS technology and can provide high quality orthorectified images, several technical problems and limitations affect its agricultural applications [
7,
9,
38]. There are challenges regarding engine power, automated takeoff and landing, short flight duration, difficulties in maintaining flight altitude, aircraft stability, reliability (sensitivity of communications, mechanical and electrical failure), susceptibility to weather condition, regulations and restrictions regarding flying UAVs of 55 lb. and heavier (500ft bubble and Blanket COA 5-3-2 airspace bubble) [
39], maneuverability in winds and turbulence, platform failures, engine breakdown due to inadequate building materials, and payload capacity [
34,
40,
41,
42].
The potential for UAVs in the improvement of PA is huge. Already the agriculture drone market is predicted to be worth US
$32.4 billion – an indication that the growers, researchers, and industry are beginning to recognize UAVs benefits over more traditional methods, such as ground mapping [
4]. Thus, it is crucial to understand the capabilities and limitations of available UAVs for different agricultural operations. The main motivation to undertake this study is the lack of a comprehensive survey focusing on UAVs’ characteristics and their applications in PA. This review can be treated as a preliminary insight into the choice of UAVs by growers and interested researchers for PA operations.
The objective of this paper is to provide a technical study on the most widely used UAVs and their suitability for PA applications. In this review study, over 100 peer-reviewed and conference studies, research, and relevant websites have been reviewed and reported. For an automatic program script, we searched for several keywords, including Unmanned Aerial Vehicle, UAVs Flight, Aerial, Fixed-Wing, Rotary-Wing, Drone, and Quadcopter. The manual screening was then performed by reading the abstract and the related work’s sections to reject some non-related or outdated papers. Since this review is on crop field monitoring and agricultural spraying, we did not cover animal agriculture or non-agricultural applications. Additionally, we only surveyed references written in the English language. Finally, the benefits and significant challenges of using these platforms in different crop field environments were investigated, and practical solutions to overcome those limitations were also discussed in this paper. We did not restrict our studied references to any time period, but according to Web of Science more than 50% (~3000) of the papers available on UAVs use in agriculture are published after 2016, with almost 90% of the papers published after 2013 [
2], therefore, most of the references cited in this study fall within this period of time and after that.
This paper’s remaining contents are organized as follows:
Section 2 addresses the most frequently used platform designs of UAVs used in PA along with the technical features of each platform. In
Section 3, the most common UAVs’ on-board sensing systems were overviewed.
Section 4 is devoted to the practical challenges of using UAVs in PA. In
Section 5, the advantages and disadvantages of using UAVs in some specific agricultural applications were reported.
Section 5 also discusses the reasons why UAVs still are not recognized as widely used platforms among growers. The insights for future applications and possible future improvements were discussed in the end.
2. Unmanned Aerial Vehicle Platforms
Small UAVs are powered aerial vehicles that weigh less than 25 kg (55 lb.) and can operate autonomously or be operated remotely by human pilots. Considering the sizes, configurations, and characteristics, of UAVs, several classifications of UAVs have been suggested in different studies [
43,
44,
45,
46,
47]. UAVs that weigh 55 pounds or more on take-off, will be required to fly under a different set of regulations and restrictions [
39]. The weight of UAVs will determine what set of regulations they fall within, therefore, UAVs could be classified based on the take-off weight. First category of drones using their weight as a characteristic is Super heavy UAVs that weigh over 2 tons (4409 lb.). They hold sufficiently large amounts of fuel. They fly at high altitudes serving military reconnaissance (e.g., Global Hawk). Next are heavy weight UAVs that weigh between 200 and 2000 kg (440 and 4409 lb.) (e.g., Fire Scout). Medium-weight UAVs weigh 50–200 kg (110–440 lb.). All of these UAVs are capable of holding more fuel and travel long distances with greater endurance. Light-weight UAVs weigh 5–50 kg (11–110 lb.). They are useful in agricultural fields (e.g., RMAX, Yintong, Autocopter). Micro UAVs are those weighing less than 5 kg. They are quick to lift off and fly at relatively lower altitudes (e.g., Raven). These are more common in agricultural fields and are portable as they weigh less than 5 kg (11 lb.) (e.g., Precision Hawk’s Lancaster, eBee, Swinglet, CropCam). Mini UAVs and Nano UAVs are two kinds of micro UAVs that are very small in nature and have all the characteristics of miniature UAVs. The idea behind the Mini and Nano was to reduce the size and weight—and associated costs—of UAVs technology so that it can be carried by one person.
In this study, we focused on the most commonly light-weight UAVs used in agriculture, including mini model fixed-wing airplanes, rotary-winged helicopters, and hybrid Vertical Take-Off and Landing (VTOL) UAVs. Other types of UAVs, e.g., flapping wings, Parafoil-wings and blimps that have not been used in agricultural operations [
45] were not considered for this review.
Figure 1 shows some of the types and models of small UAVs frequently used in PA applications.
Fixed-wing UAVs are hand-launched typically from a launcher ramp and require runways for takeoff and landing areas (
Figure 2). These UAVs can travel several kilometers from the launch point and fly at high cruise altitudes and speeds, cover larger areas, and get a centimeter-level accuracy of ground sample distance. These characteristics make them excellent platforms to obtain fast and detailed information of agricultural field environments. Fixed-wing UAVs are a wise option for heavier/denser payloads. Because of the higher endurance and payload capacity of fixed-wing UAVs, they are ideal platforms for operations such as pesticide spot spraying that require longer flight endurance [
48]. They can be operated fully autonomously and require hardly any piloting skills.
Rotary-wing UAVs can fly in lower altitudes with lower speeds, which results in a sub-centimeter resolution of collected data. However, they cover smaller areas and require a longer flight time over the same area compared to fixed-wing UAVs. The VTOL systems make rotary-wing UAVs independent of a runway and allow a wide range of operational choices in different cropping situations such as steep and uneven terrains. The VTOL and hovering capability make the rotary-wing UAVs a good option for applications that require controlled low-speed flight in confined areas or areas with obstacles such as low altitude flying in orchards. Due to their simple mechanical structures, rotary-wing UAVs are ideal platforms for in-flight testing of the stability, control augmentation systems, and autonomous navigation control strategies. Increasing the number of rotors results in lower crash risk, higher flight stability, and lower vibrations. Rotary-wing UAVs with six or eight rotors (hexacopters and octocopters, respectively) are gaining more attention recently over quadcopters with four rotors due to several advantages such as:
Redundant actions provide safe flying and landing capability, especially in case of a malfunctioning motor without a complex control algorithm.
Higher payload capacity allows mounting of heavier hardware, such as a robotic arm for an aerial manipulation application (e.g., planting weeding, tissue sampling, or a 3D LiDAR sensor for a mapping application).
Holonomic flight capability (move horizontally without tilting motion) allows for more robust and precision flight against wind disturbance.
Rotary-wing UAVs are highly maneuverable yet lack flight efficiency due to short endurance. On the other hand, fixed-wings provide efficient flight due to longer endurance but lack maneuverability. Unlike fixed-wings, rotary-wings require constant downward airflow for hovering and they consume more power, thus reducing endurance.
Modification and customization of the structure of fixed-wings and rotary-wings are common practices to adapt UAVs in unstructured environments of agricultural fields. One such customization was proposed in a classical aircraft methodology for sizing an electric multi-rotor configuration [
49]. This method was useful in considering the first estimations of flight parameters, including takeoff gross weight and empty weight. Another customization was proposed to modify the design and construction to inspect fruit orchards and vineyards [
50]. Under these environments, the UAVs should have limited width and high agility to respond quickly to sudden external disturbances such as gusts of wind to minimize the drift. The hexacopter combines two large lift propellers providing low disk loading and low power consumption, and four small control propellers for high agility. An engine operated fixed-wing UAV was modified by removing some redundant structural material to reduce the mass and using carbon-fiber-composite replacement parts to increase strength [
51]. This modified UAV allowed superior performance in takeoff and landings with longer endurance and area coverage. However, the stability of unmodified UAV was better and required less expertise to fly.
Efforts were made to combine the fixed-wing and rotary types of UAVs into hybrid models to take advantage of their pros and compensate for the disadvantages [
52,
53]. Hybrid UAVs combine the VTOL ability of multi-rotor UAVs and cruise flight of fixed-wing UAVs [
54]. While the ability to VTOL makes these UAVs capable of operating in almost any location, the fixed-wing design provides greater endurance, the ability to cover longer distances, and the option to fly faster. These UAVs are characterized by large control surfaces capable of large deflections and a high thrust-to-weight ratio. Hybrid UAVs are ideal for tasks requiring both endurance and maneuverability. Because of the transition between two modes of rotary-wing and fixed-wing during the flight, aerodynamics of the systems changes dramatically. This could make the controlling of such designs difficult.
Complete comparisons of fixed-wing, rotary-wing, and hybrid UAVs are presented in
Table 3. While the popularity of the fixed-wing UAVs in agricultural RS increases, the rotary-wing UAVs are favored due to their stable flight, larger payload capacity, ability to fly at low altitudes, and rapid deployment. Hybrid UAVs are costly when compared to rotary-wings and fixed-wing. Since hybrid UAVs are still under development stage, they are neither perfect in hovering nor in forwarding flight yet. However, with the arrival of modern autopilots, gyroscopes, accelerometers, and novel designs of hybrid UAVs, including tail sitters and tilt rotors, it is expected that these UAVs will become much more popular options in the near future for PA applications.
In general, the desired characteristics and configurations of UAVs depend on the required application type. To select the most appropriate UAV platform for different applications, compromises must be made among energy consumption, desired image resolution, ease of flying, wind stability, handling flight failures, area covered, and takeoff/landing requirements. Flight characteristics could also be influenced by unforeseeable factors, like wind turbulence and temperature. Careful consideration of proper design combination when selecting a UAV helps better address the above factors, which is crucial for PA applications.
3. RS Systems on Unmanned Aerial Vehicles
Before selecting UAVs’ on-board sensors, it is necessary to know the image resolution and spectral bands required to achieve the desired operational and application outcomes. Image resolution depends on UAVs architecture, camera detector’s resolution, Field of View (FOV) provided by the lens, camera exposure time, light intensity, images overlap, flight altitude, platform motion, ground speed, image pixel size, and flight stability. The effects of some of these factors on image quality are determined in
Table 4. The cameras’ resolution is determined by the number of photo sites on the detector and spatial sampling frequency. Camera exposure time and UAVs ground speed determine the amount of pixel smear. Pixel smear is essentially a reduction in resolution in the direction of travel. Image pixel size is determined by factors like Above Ground Level (AGL), the altitude of UAVs, flight mode, Number of Ground Control Points (GCPs), UAVs architecture, and the type of camera on-board and light intensity (which is controlled by camera shutter and aperture) [
55]. To maintain the UAVs image resolution at a certain altitude, a balance between ground speed and camera exposure time is required. This balance keeps the traveled distance during the exposure time in comparison to the spatial resolution.
The influence of a quadcopter UAV flight parameters, including AGL altitude, flight mode, and number of GCPs, on spatial resolution and spectral discrimination of multispectral orthomosaicks, was investigated [
56]. Cruise flying mode improved the negative impact of low AGL altitude on flight duration while using 5 GCPs (4 GCPs at the corner and 1 GCP in the center of the mapping area) improved the relative spatial resolution in stop mode. However, none of the tested AGL altitudes of 60, 80, or 100 m allowed differentiation between crop and weed plants from a spectral perspective. UAVs stability, particularly in fixed-wings, is also a crucial factor for collecting high-quality images. There are two common ways to ensure this stability:
Use of UAV controls that keep it level even in case of variable winds aloft and gust
Use of gimbaled cameras on UAVs, which maintain the on-nadir angle even when the UAV is not level.
Generally, payloads can be integrated with a UAV depending on their size, weight, and application.
Table 5 summarizes the most commonly used sensors and payloads for various PA operations. RGB (Red-Green_Blue) and multispectral sensors can be considered low-cost systems compared to the hyperspectral, thermal, and LiDAR sensors. Major disadvantages of the hyperspectral sensors are high cost, large dataset size, and complexity of image processing. The thermal camera can be used in conjunction with any other system when thermal imagery is needed. However, these cameras are affected by environmental conditions like humidity. Most off-the-shelf multispectral cameras can provide image resolutions above 4200 pixels by 2800 pixels, and they are better than the resolution of the thermal cameras (640 pixels by 480 pixels) [
57]. Consumer-grade cameras are widely used for RS. In the future, more research will be needed to evaluate these cameras and compare them with more sophisticated multispectral and hyperspectral imaging systems for PA.
4. Challenges with UAVs in Precision Agriculture Applications
The RS data must be accurate and reliable with geometric, atmospheric, and radiometric corrections in order to enable the most optimal UAV RS data acquisition. For instance, crop monitoring and stress detection in the field incorporating vegetation indices, time series analyses, and change detection methods require absolute canopy reflectance calculated after applying radiometric and atmospheric corrections. To generate high-quality surface reflectance data, it is essential to have high-quality on-board sensors and comprehensive testing, calibration, and data processing methods. Calibration methods can be divided into absolute and relative methods. Absolute calibration is performed by converting remotely sensed Digital Numbers (DN) output from a sensor into surface reflectance or reflected radiance. For this purpose, effects caused by atmospheric attenuation, topographic condition, sensor noise, and other factors should be removed. In relative calibration, the detectors’ outputs are normalized to a given average output from all detectors in the band. In other words, removing or normalizing the variation within a scene and normalizing the intensities between images.
In this section, the atmospheric, radiometric, and geometric corrections of UAVs that are based on data as well as the challenges of these corrections were discussed.
4.1. Atmospheric Correction
The sun emits electromagnetic energy (EM) in the direction of Earth. Some of this energy is absorbed and scattered by gases and aerosols in the atmosphere before hitting the Earth’s surface [
58]. Surface reflectance observations using aerial imagery are affected by a variety of interfering processes associated with the propagation of electromagnetic radiation in the atmosphere-surface system [
59]. In clear sky conditions, these processes are gaseous absorption, molecular scattering, aerosol scattering and absorption, and water surface reflection. In cloudy conditions, scattering by cloud droplets makes it very difficult to sense the surface (the cloud signal largely dominates), except when clouds are optically thin or occupy a small fraction of the pixel, i.e., their effect on pixel reflectance is less than 0.2 [
59]. Atmospheric effects influence the quality of the information extracted from aerial image measurements, such as vegetation indices [
60]. Such errors, caused by atmospheric effects, can increase the uncertainty up to 10%, depending on the spectral channel [
61]. Also, most of the signal reaching an imagery sensor from a dark object, such as water stress area, is contributed to by the atmosphere at visible wavelengths and on the assumption that the near-infrared and middle infrared image data are free of atmospheric scattering effects [
62]. Therefore, the pixels from dark targets are indicators of the amount of upwelling path radiance in that band. The atmospheric path radiance adds to the surface radiance of the dark target, giving the target radiance at the sensor [
61]. The influence of the atmosphere and surface must be removed to give access to correct surface reflectance. An atmospheric correction model is required where Vegetation Indices (VIs) are adopted in vegetation monitoring and in dark scenes where features can be masked out with atmospheric scatters like water stress and drought, rain erosion, or overgrazing. Atmospheric correction removes effects of atmosphere, variable solar illumination, sensor viewing geometry, and terrain on reflectance values of images and determines their actual values. Supplying, calibrating, and adjusting for the atmospheric condition at the imaging time are essential atmospheric correction requirements.
In low altitudes between 150–200 m, atmospheric contribution to surface reflectance has been argued to be negligible [
63]. Therefore, atmospheric corrections have been neglected in low altitude RS with UAVs. However, the path radiance of the low-altitude atmosphere misdirects the reflectance of target objects. The reflected light of the ground objects collected by UAVs sensors passes through a very thin atmosphere, which is not thicker than 120 m [
64]. Atmospheric attenuation is composed of atmospheric absorption and atmospheric scattering. Absorptions of visible light caused by nitrogen, oxygen, and carbon dioxide are negligible. Thus, the atmospheric attenuation of visible light is mainly caused by Rayleigh scattering at the low altitude [
64]. Indeed, although Rayleigh scattering dominates at altitudes above ~35 km [
65], it is crucial to consider its effects in low altitudes. It has been confirmed that some applications such as thermal cameras using microbolometer sensors require atmospheric corrections to be performed even at flight altitudes as low as 40 m [
63].
Several methods have been applied (
Table 6) to improve the atmospheric correction models for UAVs imagery. The off-the-shelf atmospheric correction algorithms adopted in satellite-based RS are typically ill-suited for UAVs-based images due to the distinctly different altitudes and radiation transfer modes. Atmospheric correction with these standard atmospheric profiles causes a loss of accuracy. Moreover, the data needed for applying an atmospheric calibration model in these methods are mostly costly and not always available.
4.2. Radiometric Calibration
Radiometric calibration involves determining the functional relationship between incoming radiation and sensor output, such as DN. Accurate radiometric calibration becomes necessary for change detection and interpretation if the images were from different dates or times, locations, or sensors. Radiometric calibration ensures that changes in the data are related to field changes, not variations in the image acquisition process or conditions (e.g., change in light intensity). Most image collections involving hyperspectral cameras (e.g., crop phenotyping, disease detection, and yield monitoring) require accurate radiometric calibrations.
Some potential solutions could reduce the radiometric variation. Light intensity varies over time because of changes in solar elevation, atmospheric transmittance, and clouds. Thus, conducting image collection flights in minimum solar elevation could reduce radiometric variation in collected data. The digital camera exposure settings should be selected carefully based on the overall light intensity, whether manually or automatically. However, none of these solutions can completely remove the effects of the radiometric variation from collected images.
In manned aircraft images, radiometric correction is usually conducted by laying out large tarps with a known set of reflectance values spanning the range of object reflectance in the scene. Then each pixel in the image is corrected according to a linear model. Since UAVs images are mosaicked into large images, and each image covers relatively small areas, it is impractical to include one calibration reference in each image. Although operators set camera parameters for certain average light intensity, the camera’s exposure settings vary within each aerial photograph. Thus, a radiometric calibration model developed for one image will not be ideal for another image.
There are several UAVs-based radiometric calibration methods proposed for PA purposes (
Table 7). The radiometric correction algorithms in commercially available data processing software packages (e.g., AgiSoft PhotoScan and Pix4DMapper) include options for empirical correction, color balancing, irradiance normalization, or sensor-information based calibration. Despite the large number of radiometric correction methods proposed in research studies (
Table 7) or available with commercial software packages, most of these methods are laborious and do not provide quantitative radiometry and acceptable visual quality.
4.3. Geometric Correction
UAVs collected imagery for aerial mapping of crop fields or orchards contains some degree of geometric distortion. These distortions are due to sensor position variations, off-axis projector, screen placement, non-flat screen surface, platform motion, rotation of the Earth on its axis as images are taken, earth curvature, and terrain effects. These factors could be categorized as internal and external factors (
Table 8).
Alternatively, they could be classified as systematic or random distortions. Systematic distortions happen due to the Earth’s rotation and camera angles, and these distortions are predictable. Random distortions occur due to changing terrain and variations in sensor altitude. Since systematic distortions are predictable, correction can be applied systematically, while random distortions are not predictable and more challenging to address.
Geometric correction is required to compensate for geometric distortions and ultimately produce a corrected image with a high geometric integrity level. In a distorted image, the size of target area represented by a pixel may vary across the image, and the (x, y) coordinates of a given pixel may not match the correct geographic location. Geometric calibration is performed to recover intrinsic camera parameters, including focal distance, principal point coordinates, and lens radial distortion, to recreate a realistic representation of the scene.
Geometric correction digitally manipulates images, so their projection precisely matches a specific surface or shape. Geometric correction is achieved by establishing the relationship between the image coordinate system and the geographic coordinate system using sensors’ calibration data, measured data of positions and attitudes, digital elevation model (DEM), ground control points, atmospheric condition, etc. Proposed methods in previous studies (
Table 9) are based on either georeferencing or orthorectification. Georeferencing is the process of aligning geographic data to a known coordinate system and may involve shifting, rotating, scaling, skewing, and in some cases warping, or orthorectified data. Usually, GCPs build a polynomial transformation that shifts the distorted dataset from its existing location to a spatially correct location. Higher transformation orders could correct more complex distortions.
Orthorectification requires more information than georeferencing e.g.,—knowledge of sensor or camera. Orthorectification corrects for sensor tilt and the Earth’s terrain distortions using rational polynomial coefficients (RPCs) and an accurate DEM.
5. Precision Agriculture Applications with UAVs
Crop monitoring can occur during the different growth stages, starting from germination even before plants respond to soil characteristics. The purpose of crop monitoring is to record phenotypic characteristics that may reflect potential problems, and to identify these problems at an earlier stage of development. Later, the crop growth and performance can be evaluated to present proper management decisions. Acquiring high-resolution aerial images can help growers evaluate soil conditions, crop growth status and provide useful information about plant health and crop stress. Such information can help with sustainable crop management and risk management, and play an essential role in global markets, policy, and decision making. In this section, we have reviewed the benefits and challenges of using UAVs in conducting agricultural operations.
5.1. Pesticide and Fertilizer Spraying
The application of pesticides and fertilizers in agricultural areas is of prime importance as they maintain and ensure the quality and quantity of crop yield. However, several challenging issues affect these processes, including:
Uneven spread of chemicals because of broadcasting the pesticides and fertilizers.
Skipping or overlapping some crop areas while spraying
Applying pesticides only on the outer edge of the crop
Climatic condition impacts on spraying or broadcasting (e.g., wind intensity and direction) including spray drift, or spraying a neighboring field
Damage to plants when using ground sprayers or spreaders
Operators exposure to chemicals.
UAVs’ abilities to hover, modulate distance from the ground as the topography and geography vary, create high-resolution field maps, and spray the correct amount of liquid in real time for even coverage provides the opportunity for patch spraying and accurate site-specific management in the PA industry. UAVs could reduce chemical pesticide and fertilizer application by 15–20% by using a low or ultra-low volume of spray [
86] and reduce the amount of chemicals penetrating into groundwater. It is estimated that a UAV based pesticide application could be up to five times faster than traditional machinery [
87]. Low thrust is exerted in UAVs because of their ability to operate significantly close to crops without causing damage. It can remarkably reduce the concern of chemical drift. Spraying pesticides and fertilizers using UAVs also could eliminate the operator exposure to chemicals in manual spraying.
Although UAVs have advantages for spraying pesticides and fertilizers, the effectiveness of operations is still affected by several factors. Droplet deposition level on target crops is a critical index of spray performance and is significantly influenced by aerial nozzles. Unfortunately, droplet deposition is still an essential concern in spraying applications when using UAVs. The effectiveness of spraying using UAVs is also affected by the flight parameters. Variable flight parameters during UAVs operation, affect the average deposition amount of droplets. The rotors’ downward airflow determines the penetrability of the droplets. It could interact with crop canopy and form a conical vortex shape in crops. The size of this vortex directly affects the outcome of the spraying operation. The efficacy of pesticide spraying also depends on temperature during spraying. Because of the flight parameters, farmland size, and the number of stops for spot spraying, it is difficult for UAVs to traverse all the fields in a single flight. Batteries recharging and refilling sprayer tanks might be required multiple times during chemical application. These are mainly time-consuming tasks, and there is a high possibility of temperature change to prepare UAVs for the next flights.
Flight stability and smoothness could also affect the efficiency of UAVs spraying. Spraying the right targets at the right spots is achievable in stable and smooth flights. For this purpose, complicated designs of controllers are required to improve the stability of UAVs flight.
Some Federal Aviation Administration (FAA) regulations are also considered constraints to use UAVs for spraying. Despite the advent of UAVs’ novel uses, the FAA regulations of aerial pesticide application have not yet been updated to accommodate UAVs’ specific benefits and limitations. Basically, FAA Remote Pilot Certificate (Part 107) requires the UAVs sprayer to be registered, and the pilot to have a remote pilot certificate [
39]. However, Part 107 is only for UAVs that weigh on take-off less than 55 pounds and hazardous material could not be carried on the UAVs under this certificate. UAVs sprayer could simply weight more than 25 kg. For UAVs with a payload over 25 kg (55 lbs.), a Section 333 Exemption is required. Obtaining this permission could be costly and time-consuming. It could cost up to
$1500 and take up to four months for the FAA response [
88]. The acceptance rate of these requests has been estimated as only 14% [
89]. Carrying hazardous materials and certain pesticide active ingredients (e.g., allethrin, carbamate, and organophosphorus) with UAVs are not allowed [
90]. In addition to the exemption, an operator needs to obtain an agricultural aircraft operator certificate (Part 137). Agricultural aircraft operation means the operation of an aircraft for the purpose of dispensing any economic poison, dispensing any other substance intended for plant nourishment, soil treatment, propagation of plant life, or pest control, or engaging in dispensing activities directly affecting agriculture, horticulture, or forest preservation, but not including the dispensing of live insects [
39]. These regulations could restrict UAV technologies, especially in the most common aerially applied pesticides like Naled, widely used to control mosquito populations. These limitations could be addressed by FAA waivers and updating of the regulations.
5.2. Vegetation Growth Monitoring for Yield Estimation
Crops do not generally grow evenly across fields, consequently, crop yield can vary significantly from one spot in a field to another. These growth differences may result from biotic (pests) or abiotic (soil, water, etc.) factors. Monitoring of canopy and assessment of crop condition in real-time can aid in devising suitable management strategies to improve yield [
91].
Conventional crop monitoring methods involve tedious crop growth data collection and evaluation of crop yield for previous years/seasons. The latest trend in large farms is to adopt combine harvesters with electronic yield monitors and Global Positioning System (GPS) tagging facility [
92]. In a practical crop field situation, farmers have to carefully select grain flow sensors, volumetric and mass flow detection, ground speed sensor, harvest controls, yield data collection points and yield mapping. Combine harvesters originally only gave final yield value per plot. Current combine harvesters equipped with yield monitors record crop yield at much finer resolution that are suitable for site-specific or precision farming techniques. Field-based accurate crop surveying and crop estimates are usually costly and time-consuming.
Satellite-based crop yield predictions raised possibilities for monitoring and understanding agricultural productivity in many world regions. However, until recently, the use of satellite-based data for yield prediction has been sparse and limited only to large scale monitoring and mapping due to the limited availability of high spatial (>5 m) and temporal (daily) resolution satellite imagery [
93]. For applications at more detailed scales and small fields, limitations are created by the mixed nature of low-resolution pixels such as Landsat [
94]. This severely complicates the analysis, interpretation and validation of data and challenges the reliability of the derived information [
95]. Obtaining spatiotemporal information and crop phenological status during a critical period of the growing season is also very challenging due to high cloud coverage.
Aerial images by UAVs could augment the data obtained using combine harvesters over many years, NDVI, and leaf chlorophyll content, to name a few. For example, the NDVI data and disease/pest spots imaged by UAVs at different stages of crop growth could be compared, along with yield data for several seasons. It would help to prepare maps depicting standard deviation and coefficient of variation. It is possible to mark the highest and lowest yield produced from the same location in the field, for each of the several seasons and crops. Compared to satellite imagery, there is no limitation in flying UAVs periodically over the same field and it is possible to generate yield maps of a field for multiple years. By examining multiple years of yield maps, it is possible to mark management blocks to provide greater authenticity and yield stability [
96]. UAVs’ ability to operate at low altitudes below the clouds also minimizes cloud coverage on images’ quality.
The UAV-based images can be transformed into Digital Surface Models (DSM) or Crop Surface Models at the full canopy to assess crops health, growth rates, and yield forecasts topography [
87]. These models are required in order to estimate biomass accumulation, and plant height. Yield estimation using the combination of these models and spectral data could be developed very fast. These maps can provide great details of variations in vegetative growth and yield potential [
97]. However, the UAVs’ ability to map the crops is not perfect yet, and there are several rooms to improve the ability of UAVs to accurately show yield variations and pin-point causes.
UAV imagery’s main challenge to monitor plant health and yield potential is assessing the high-resolution multi-temporal data. It is essential to know the appropriate vegetation index/indices that is/are best for fractional vegetation cover mapping to the crops’ time/growth stage. In other words, it is crucial to know which vegetation indices estimate crops yield best and find the relationship between observed crop characteristics and crop yield. The required accuracy of crop surface models to calculate plant height should be determined before the flight. Additionally, the best time or growth stage to record data from each crop type for accurate yield prediction should be estimated accurately.
5.3. Vegetation Health Monitoring and Pest Management
Stress symptoms in plants begin to appear in the infrared range several days before their appearance in the visible range [
98]. A combination of both visible and infrared data at different plant growth stages could increase model prediction accuracy. Many farmers use ground-based methods, satellite imagery, and manned aircraft to monitor crop growth and density. Crop consultants or farmers may perform ground-based monitoring during growth seasons [
99]. Ground-based monitoring is tedious, destructive, or not offer best data at a rapid pace [
100]. In these cases, farmers cannot monitor all farm areas, and some parts of the fields are neglected. It may lead to avoidable expenses to address crop problems at a later stage. Additionally, although satellite imagery has actually improved over time in terms of resolution, accuracy and sharpness; it falls short of great details, close-ups and rapid relay of pictures and accessing satellites fitted with multispectral sensors could be costly [
92]. Scheduling manned aerial flights could take time, while diseases and invasive species spread fast through fields [
101].
UAVs’ ability to fly close to crops results in higher resolution images that are less affected by cloud cover and low light conditions than satellite imagery. UAV imaging can produce a map of the entire field down to the millimeter, and there is no need to schedule flights beforehand. UAVs could be equipped with special imaging equipment (NDVI camera, regular cameras, etc.) that use detailed information to indicate plant health in terms of temperature, chlorophyll levels, foreign contaminants, and leaf thickness, which allows farmers to monitor crops as they grow to deal with them fast enough to better manage the plants.
UAV based images used for pest detection should offer:
The detection of a symptom at the onset
The differentiation of different symptoms
The ability to separate from environmental stresses
The estimation of symptoms severity.
In pest management using UAVs, it is crucial to find the most significant spectral channels for symptom detection in different crops. A good result of disease detection using UAVs was obtained when textural and spectral data were combined [
102]. The combination of hyperspectral and thermal sensors also indicated promising results in disease detection in the early stages [
103,
104,
105]. However, the fusion of the data from two sensor types could increase the difficulty of data processing.
The efficiency of some site-specific pest management operations like weed and disease detections based on UAV images highly depends on image spectral, spatial, and temporal (the frequency of flights) resolutions. The flight altitude impact on image pixel size in discriminating between weeds and crop is very important [
106,
107]. At lower altitudes, images have a higher spatial resolution, but area coverage may be smaller. However, the highest accuracy is not always provided by the highest spatial resolution at a low altitude [
108]. It is demonstrated that flight altitude in the range of 10 to 50 m with corresponding image resolution in the range of 3–15 mm pixel
−1 did not influence pest detection in a systematic way significantly [
109]. Regardless of flight parameters, the major challenges in crop and pest discrimination include the need for high spatial and temporal resolution of UAVs imagery and the spectral similarity of pest symptoms and abiotic stresses on crops. This problem deteriorates in early detection when crops with pest symptoms and healthy crops have similar appearance and show analogous spectral patterns. Image collection time and spectral characteristics of field background could also highly affect UAV-based aerial detection of pests [
110,
111,
112].
Using newly developed UAVs, biological pest management can be accomplished by releasing beneficial insects, predators, and parasites over crops [
113]. This method could reduce the environmental impact of pesticide usage, and address a growing labor crunch. UAV-based aerial biocontrol provides more efficient distribution of biocontrol agents than traditional application techniques, could kill pests even when they’re hiding where chemicals can’t reach, and meaningfully reduce the use of chemical pesticides [
113].
Although pest management using UAVs has several advantages over conventional methods, they face several challenges. These include sensor integration, multi-resolution solutions, flight altitude vs. efficiency optimization, image preprocessing, and information extraction [
114]. UAVs are more appropriate for large areas such as golf courses and crop fields, while in small areas such as parks and gardens, ground-based methods are preferred because they are less expensive and more practical [
115]. Although UAV-based pest control requires discrimination of the various pest symptoms from each other and environmental stresses, currently there are no accurate methods to accomplish this. This is an area that new data analytics strategies incorporating machine learning and artificial intelligence have the opportunity to address.
5.4. Irrigation Management and Water stress
Water availability is a top production parameter affecting crop productivity. Soil moisture also has an impact on the extent of fertilizer usage and its efficiency. Reduced available soil water to meet the evapotranspiration demand leads to water stress in crops. Canopy temperature is shown to be a good indicator of plant stress and can provide continuous information on water status, water use and how a plant is functioning metabolically [
116].
Farmers and companies have adopted several different crop monitoring and irrigation methods (e.g., sheet irrigation, furrow irrigation, drip irrigation) to observe real-time crop water status and schedule irrigation. All these methods require frequent observation with proximal sensors, especially when water is distributed on to fields. These proximal sensing techniques are costly, tedious, and time-consuming if field sampling is intense.
Field elevation data are useful in determining drainage patterns and wet/dry spots, which allow for more efficient watering techniques. When using thermal and hyperspectral sensors, UAVs can capture very accurate data pertaining to spatial variability of soils and crops in fields. The inherent variation in soil properties or non-uniform application of irrigation can contribute to spatial variation in crop growth and yield. For example, knowledge of spatial and temporal variations in soil moisture becomes critical for irrigation management. The spatial resolution of data collected for mapping crop water stress must be sufficient to separate plant pixels from soil background and to avoid mixed soil/vegetation pixels. Thermal images can be easily influenced by various factors, including the characteristics of the thermal camera, weather conditions, and different emitted and reflected thermal radiation sources. Thus, several factors should be considered carefully for correct temperature retrieval including, sensor calibration or humidity correction. Therefore, crop water stress estimation using UAVs particularly in large areas, should be conducted carefully and effectively.
UAVs also can monitor the water flow in irrigation channels and distribution of water using center-pivot sprinklers. In fact, UAVs could be of immense utility in monitoring and coordinating movements of sprinklers located in large farms [
92]. Equipped with proper nozzles, UAVs could potentially sprinkle water and nutrients in small target fields/areas. For large farms, a group of UAVs (swarms of UAVs) must conduct the sprinkle [
92] to overcome the effect of drought, when drought is suspected to affect crop, biomass and grain formation severely. However, swarms of UAVs could be cost-effective and require a complex design of path planning and control systems for each UAV. If swarms of UAVs technologies can be made affordable, they could potentially provide very valuable information about when and where to apply precise quantities of water to crop in large farms [
117].
6. Adoption of UAVs in PA
UAVs have been influential in RS, and their contribution to PA has captured adequate attention from researchers. However, critical issues raised in different studies regarding adoption of these new technologies in agriculture [
118,
119,
120,
121]. By 2005 only 9% of a survey producer used RS of any kind, while 73% did not plan to use these technologies at all [
122]. However, according to a study recently unveiled by Munich Reinsurance America Inc., (Princeton, NJ, USA) [
123], in 2018, nearly three-fourths of all U.S. farmers are currently using or considering adopting the UAVs technology to assess, monitor and manage their farm. Munich surveyed 269 farmers for input on how farmers are using or viewing UAVs. Most of the farmers surveyed have concerns related to UAV usage (76 percent). Privacy issues, at 23 percent, was the most common concern held among farmers, followed by cyber security concerns with data captured via UAV (20 percent) and then the possibility of injury or damage from the UAV (17 percent) [
123]. Of those who currently use the technology, 49% contract with an outside company to operate their drones and 51% handle drone usage on their own. 83% of these farmers, use UAVs on their farms either daily or once a week or more. UAVs are used for or considered to be used for crop monitoring (73%), soil and field analysis (46%), and health assessment of [crops and livestock] (43%) [
123].
RS with UAVs is not widely adopted by farmers. Despite the incorporation of new technologies in UAVs, some factors and challenges prevent farmers’ widespread usage. One reason for UAVs’ unpopularity among farmers is that UAVs collect a huge amount of complex data from various sensors. Big data analytics tools and cloud computing are required to extract information from the collected data. Data analysis and interpretation usually depend on using software packages with different levels of complexity and cost. Data analysis software that are used in this scope must be purchased if they are not open sources. These software packages must be installed and configured by users and require maintenance, advanced coding, or advanced data training. Thus, utilizing UAVs for non-expert users requires investment in time and money, and learning new skills with complex tools. Moreover, although UAVs technologies do not require a trained human pilot, a private pilot license is still required for commercial flight operations. Agricultural producers also require clear information on economic benefit of precision agricultural technologies before adopting them. Other technical factors influencing the adoption of these technologies are:
Socioeconomic characteristics (e.g., farm size, farming experience, education, age, and access to the information)
Physical attributes of the farm (e.g., variability of soil types, productivity)
Location of the farm (ex, broadband connectivity)
Initial financial investment
Interest in learning new skills and the learning curve
Compatibility of new technologies with the current practice
Potential benefits (reducing production costs, increasing yields, protecting the environment, providing massive amounts of information to help manage farms)
Complexity of the technology and ease of use
Complexity of data interpretation and decision making
Data transfer speed
Data privacy
Safety.
We suggested solutions to some of the above-mentioned challenges, as presented in
Table 10. These solutions require complicated advanced designs, and extensive laboratory and field verification experiments to address the respective challenges. In short, research, development and validation are essential steps in addressing these challenges.
Because of the many challenges discussed in this paper, UAVs are not universally adopted by farmers, especially in small farms. Additional efforts are required to make these technologies more user friendly and available for all types of end-users covering different interests for a precise crop management. Further research is required to design and implement special types of cameras and sensors on-board UAVs for remote crop and soil monitoring, and other agricultural applications in real-time scenarios. The goal should be a fully automated pipeline, including flight preparation (optimal flight height and pattern, sensor setup, etc.), flight execution (calibration of sensors, ground control measurements, and flight execution itself), and data processing with interpretation.