The objective of this study was to determine environmental conditions that are optimal and suboptimal for detecting surface schools of forage fish in RPAS imagery. The analysis was conducted based on RPAS imagery acquired over a model fish school with dark and silver lures of different sizes, positioned at different depths, and considering natural environmental conditions in the spring/summer coastal waters of BC, Canada. Clear skies, low winds, glassy seas, moderate sun angles, and low turbidity, generally allowed for the highest visibility for all the lures (
Table 8). However, specific conditions, including wind speed, wave height, sun altitude, and turbidity impacted the visibility of the silver lures (lures B, C, D) the most, while the dark lures visibility (lure A) was most impacted by cloud cover (
Figure 3 and
Figure 4;
Table 7 and
Table 8). Furthermore, as expected, the dark lure was less visible than the silver lures, smaller lures were less visible than larger lures, and visibility decreased with lure depth. Targeting the optimal conditions in
Table 8 should minimize availability bias in RPAS forage fish surveys caused by poor conditions making forage fish schools unavailable for detection.
4.1. Environmental Conditions
Among the identified conditions, wind speed and wave height (highly correlated to each other) had the largest impact in silver lure visibility with thresholds of <5 km/h and 0 cm (i.e., glassy), respectively, as optimal for RPAS data acquisition. At glassy seas conditions, target distortions are minimized as there is less light refraction (
Figure 5A–C,E) compared to higher wind and wave conditions (
Figure 5D,F). Additionally, the interaction of waves with sunlight may cause sun glint (
Figure 5F) and cloud glare (
Figure 5C,D) [
33,
53]. The strong contribution to the PCA (
Figure 4) and the moderate to strong negative correlation with lures B, C, and D at 1.5 m and 2.0 m (
Table 7) show the importance of these two variables to the silver lure visibility. These conditions were the most important for silver lures located at 1.5 and 2.0 m where the visibility was higher when there were low winds and glassy seas (
Table 7, 0.24 > ρ
s > −0.55). These lures were often visible at these depths (
Table 5) but had the lowest visibility in the only clusters that had elevated sea surface/wind conditions (Clusters 1 and 2 in
Table 6 and
Figure 3), illustrating that rough conditions are particularly important to avoid in order to ensure visualization of these lures at these deeper depths. Lastly, Cluster 4 had winds up to 5.5 km/h but did not have elevated wave heights or reduced lure visibility, suggesting that winds up to 5.5 km/h may not cause surface waves that impact lure visibility (
Table 6). Even though we were only able to sample wind speeds up to 11.1 km/h and wave heights up to 10 cm (
Table 4), it is still clear that the rough sea surface conditions provided suboptimal conditions for detecting the lures.
Most RPAS studies recommend a larger range of wind speeds and wave heights usually with a maximum threshold of 8–11 km/h and 0.5 m wave height. However, these studies usually target marine megafauna or benthic habitat which are much larger than forage fish [
21,
22,
23,
32]. The most conservative findings from [
22] justify the relatively low thresholds of glassy seas and 5 km/h, as the authors found that winds between 5 and 8 km/h may produce wind ripples. Note the distortions of the silver lures in
Figure 5D due to the wind ripples compared to the undistorted shape of the lures in panel C with calm winds and glassy seas (and otherwise similar conditions).
Sun altitude was the second most important environmental variable for silver lures (lure B, C, D) visibility. The sun angle altitude was negatively correlated with visibility of lures B, C, and D at 1.5 and 2.0 m depth (
Table 7, −0.39 > ρ
s > −0.19), meaning that the higher the sun altitude (i.e., close to nadir), the lower the ability to identify silver lures. The optimal range for sun altitudes between 20° and 40° balances the need for adequate solar irradiance to illuminate forage fish targets and avoid sun glint on the surface. Solar altitude is important, as a minimum amount of solar irradiance is required to adequately illuminate targets for visual identification [
22,
31,
43] associated with the light attenuation properties of the water constituents, the characteristics of the target (e.g., color, size, depth in the water column), and the contrast between the target and the background [
33]. Higher solar altitudes will deliver more solar irradiance. However, at these angles sun glint may happen preventing optimal visualization of subsurface features [
33]. These suboptimal sun glint conditions are a result of sun light interacting with ripples and waves to cause an effect called “sun glitter” (
Figure 5F) [
5,
19,
33]. Sun glitter is known to cause errors in classification of subsurface features [
30] and should be avoided in RPAS forage fish surveys as it is a source of false-positive detection errors.
Considering the sun glitter constraint, the minimum recommended sun altitude of 20° reflects the negative correlation between sun altitude and lures B, C, and D, the high visibility of lures B, C, and D in clusters that had low minimum sun altitudes, and results in the literature. Firstly, lures B, C and D visibility was negatively correlated with sun altitude at 1.5 and 2.0 m depth (
Table 7). Secondly, there was no reduced lure B, C, or D visibility in clusters with low altitudes of 8° and 10° (Cluster 3, 4, and 5 in
Table 6 and
Figure 3). Lastly, minimum solar altitudes seen in the literature are generally in a range of 25–30°. However, some research suggested that lower altitudes may provide adequate illumination [
22,
28,
31,
32]. Authors from [
28] found that the minimum 30° angle recommended for piloted aerial benthic habitat surveys from [
32] offered more than sufficient light to illuminate benthic eelgrass vegetation. Additionally, [
22] detected eelgrass with high confidence down to the lowest sun altitude sampled of 6.5°. They thought that low altitude RPAS flights may have lower minimum sun angle requirements because the sensor is closer to the target than to the pilot in higher altitude piloted aircraft surveys [
22]. The results from [
33] that found a significant decline in solar irradiance below 20–25° supported the minimum 20° threshold.
The maximum recommended solar altitude of 40° is based on the reduced visibility of lures B, C, and D in the clusters with the highest sun angles (Clusters 1 and 2 in
Figure 3) and the consistent negative correlation between sun altitude and silver lure visibility at 1.5 m and 2.0 m depth (
Table 7). Given the glassy sea surface that is recommended for forage fish surveys (
Table 8), the threshold of 40° should avoid sun glint for cameras with the common 94° field of view and a nadir sensor angle [
32,
33]. Sun glint was never observed on the water’s surface directly above the model fish school (i.e., blocked the model fish school from imagery viewer) during glassy sea surface conditions. However, sun glint was observed near at the edge of imagery frames recorded in glassy seas conditions with sun altitudes above 43°. While there was no sun glint directly blocked visualization of the model fish school in any video sample (
Figure 5E), glint was observed at the edges of the imagery with glassy conditions at angles above 43°. Upper thresholds found in the literature were either 40° or 45° for the same rationale of avoiding sun glint [
4,
22,
28,
30,
31,
32].
Secchi depth was shown to be somewhat important to lures A, C, and D seen in the weak positive correlations at 1.0, 1.5, and 2.0 m depths (
Table 7) and the reduced visibility of lures B, C, and D at 2.0 m in the clusters with the shallowest secchi depths (Clusters 1 and 2 in
Figure 3 and
Table 6). The negative relationships between secchi depth and lure visibility (
Table 7, 0.19 > ρ
s > 0.28) make sense as deeper secchi depths suggest less turbid waters and increased ability to detect subsurface targets. Secchi depth likely did not show stronger relationships with lure visibility because the shallowest secchi depth recorded was at least 2.4 m deeper than the model fish school and the samples did not capture a wide range of secchi depth conditions (
Table 4).
Secchi depth acts as a proxy for turbidity, which controls light attenuation in the water column and results in less light available to illuminate deeper targets and can be a large contributor to availability errors in aerial marine surveys [
24,
25,
53,
54,
55]. Light is absorbed and scattered by particulate matter in the water column, causing a gradual decrease in available light and a gradient of diminishing visibility [
33,
56]. As such, it is difficult to identify a meaningful secchi depth threshold for the practical application of RPAS to survey forage fish as forage fish schools encountered in surveys will likely be at different depths than tested in this experiment. However, our results suggest that a secchi depth no less than 5 m should maximize lure visibility up to 2 m depth.
Lastly, cloud cover had the largest impact on the visibility of lure A. This importance was shown by strong contribution of cloud cover and lure A visibility in the 1.0 m PCA (
Figure 4) and the strong negative correlation to lure A at 1.0 m and 1.5 m depths (
Table 7; −0.65 > ρ
s > −0.54). Additionally, the cluster analysis had the highest visibility of dark lure counts in the only cluster with clear conditions (Cluster 3 in
Figure 3 and
Table 6). Clear skies maximize solar irradiance available to illuminate subsurface targets and minimize the negative effects that specular cloud reflectance can have on the surface [
21,
28,
30,
33,
53]. This is well illustrated by the difference in lure A visibility in panels B and C in
Figure 5. Panel C has overcast conditions and lure A is difficult to see at 0.5 m, where as panel B has similar conditions with the exception of clear skies, and lure A is difficult to detect at 1.5 m. The results from the cluster analysis, PCA, and correlation agreed with the recommended clear sky condition from the literature for marine aerial imagery surveys.
4.2. Lure Color, Size and Depth
The dark lure was less visible than the silver lures, and visibility decreased with size within the three silver lures, and visibility decreased with depth (
Table 5). Lure A was less visible than lures B, C and D (
Table 5) likely because lure A had lower contrast with the standardized dark water column background. Contrast between the target and the background in aerial imagery is an important factor impacting the detectability of targets [
23,
29,
30,
32,
57,
58]. Contrast in imagery is a function of the light available to illuminate the targets at a given depth and the visual appearance of target and the background [
29,
33]. However, the type of background habitats encountered in RPAS forage fish surveys of shallow nearshore habitats will provide varying degrees of contrast for each detection type. For example, Shiner Perch (represented by the dark lure) detected in our RPAS forage fish survey imagery was very obvious over light sand bottom types due to the high contrast (
Figure 6). In this research, these conditions are not considered given that the background was always a deep water column.
Lure size had a negative relationship with visibility within the three silver lures (lures B, C, and D;
Table 5). This is likely an impact of the reduced ground sampling distance (GSD) and the reduced visual ability to detect the small targets depth. The ability to detect targets in imagery is highly dependent on the GSD (i.e., distance between two pixels’ centers measured on the ground) [
21]. Additionally, it was more difficult to visually identify the smaller targets at deeper depths as the edges of the smallest lure were the first to blur into the background and this was likely due to environmental factors affecting surface texture that would alter the shape of the lures (
Figure 5) and variables that would limit contrast (turbidity, sun altitude, cloud cover). The effect of contrast and size is obvious from the difference between the minimum secchi depth and the maximum lure depth. Lure B (largest silver lure) disappeared at 1.5 m and 2 m in some conditions while the secchi depth was always visible to at least 4.4 m (2.4 m deeper than the lures;
Figure 5). Lastly, lure visibility decreased with lure depth (
Table 5). This is due to diminishing light levels available at deeper depths to illuminate targets for correct identification as previously discussed.
4.3. Practical Application and Future Directions
False negative detections caused by poor conditions are difficult to model or factor into data, so targeting environmental conditions for RPAS forage fish surveys that will minimize these errors is very important for accurate forage fish quantification [
24,
26,
59,
60]. The suboptimal conditions (
Table 8) should be avoided, and if they cannot, they need to be recorded during field imagery acquisition so potential sources of error in the type of forage fish schools can be better understood [
32].
Some of the environmental conditions such as sun angle and tides can be easily predicted and therefore planned around. However, others cannot, thus requiring user flexibility and local knowledge to optimize survey potential for forage fish. For example, turbidity is not always predictable. However, usually it is greater after stormy events, on rising tides, and during phytoplankton blooms, and during periods of significant freshwater input in coastal areas [
21,
29,
32]. Local knowledge of seasonal changes in water clarity should be used to plan surveys [
32]. Cloud cover and wind can somewhat be predicted with short term (e.g., 3–5 days) local marine and weather predictions [
32]. Field days in Barkley Sound for example were planned to avoided July and August as these months are known to have foggy mornings and a high probability of a phytoplankton bloom (Personal Communication, Jennifer Yakimishyn, June 2020). Field days also targeted mornings which are known to be less windy and ultimately less wavy in coastal areas in summer. Planning forage fish surveys requires logistical flexibility so that conditions can be evaluated on each planned field day and adapted or rescheduled if needed [
32].
In addition to environmental conditions, planning of RPAS surveys should also consider the seasonal timing of forage fish use of nearshore areas and their depth in the water column based on specific species life histories. In this study we found that visibility is positively related to fish size and negatively related to their depth. As such, RPAS surveys should be used during months when forage fish are largest and most visible to the RPAS near the sea surface. For example, RPAS surveys targeting Sand Lance should occur in late summer and early fall when the young-of-the-year are larger than during the spring and they spend more time foraging in large schools in the upper water column before they burry in subtidal sand for winter [
36,
61]. An important consideration is evaluation of detection of false negatives caused by poor conditions. These are difficult to model or factor into our dataset, so targeting environmental conditions for RPAS forage fish surveys that will minimize these errors is very important for accurate forage fish quantification [
24,
59,
60].
The differences between the lures used in this experiment and forage fish encountered in RPAS surveys should be considered in the practical application of these results. The factors that will add complexity to detecting forage fish in RPAS imagery will likely include the unknown locations of forage fish schools to imagery analyst and the effect of moving targets. Forage fish schools in RPAS imagery will likely be harder to detect than the model fish school because the imagery analyst will not know where the forage fish schools are, in contrast with the model fish school and fish lures used in this experiment. Additionally, forage fish are moving targets in contrast with the stationary lures used here. Movement will likely aid in their visual detection as movement should help differentiate forage fish from stationary benthic background features in imagery. This rationale is based on the recommendations for video imagery to capture movement in the literature [
1,
23,
43] and the 2020 test surveys where forage fish movement captured in RPAS video imagery was necessary to detect many fish schools, particularly those identified with fish flash detections.
Lastly, applying and testing the recommendations for optimal conditions on RPAS forage fish surveys may help develop correction factors for false negative errors in order to make forage fish population estimates from RPAS surveys. There is a growing body of literature that aims to understand availability and perceptions errors with a goal to make population estimates from aerial surveys by estimating correction factors [
23,
24,
25,
26,
62]. In this study, optimal conditions are recommended to minimize the availability error for forage fish caused by poor conditions of cloud cover, sun altitude, wind speed, wave height, and turbidity. However, understanding additional variables that will influence availability and perception errors and be present in RPAS forage fish surveys is needed before correction factors can be made to make forage fish population estimates from RPAS surveys. Such variables will likely include vertical distribution of forage fish in the water column, school size, background type (and contrast as previously discussed), and fish behaviour [
23,
24,
25,
26,
62].