Next Article in Journal
Identifying Potentially Climatic Suitability Areas for Arma custos (Hemiptera: Pentatomidae) in China under Climate Change
Next Article in Special Issue
Liquid Baits with Oenococcus oeni Increase Captures of Drosophila suzukii
Previous Article in Journal
Incidence of Diaphorina citri Carrying Candidatus Liberibacter asiaticus in Brazil’s Citrus Belt
Previous Article in Special Issue
Kairomone and Camera Trapping New Zealand Flower Thrips, Thrips obscuratus
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Bounds on Absolute Gypsy Moth (Lymantria dispar dispar) (Lepidoptera: Erebidae) Population Density as Derived from Counts in Single Milk Carton Traps

by
Ksenia S. Onufrieva
1,*,†,
Alexey V. Onufriev
2,3,4,†,
Andrea D. Hickman
1 and
James R. Miller
5
1
Department of Entomology, Virginia Tech, Blacksburg, VA 24061, USA
2
Department of Computer Science, Virginia Tech, Blacksburg, VA 24061, USA
3
Department of Physics, Virginia Tech, Blacksburg, VA 24061, USA
4
Center for High End Computer Systems, Virginia Tech, Blacksburg, VA 24061, USA
5
Department of Entomology, Michigan State University, East Lansing, MI 48824, USA
*
Author to whom correspondence should be addressed.
Contributed equally.
Insects 2020, 11(10), 673; https://doi.org/10.3390/insects11100673
Submission received: 15 September 2020 / Revised: 25 September 2020 / Accepted: 28 September 2020 / Published: 3 October 2020
(This article belongs to the Special Issue Behavioral Manipulation for Pest Control)

Abstract

:

Simple Summary

Gypsy moth is one of the most devastating forest pests in the Eastern USA. In this paper, we derive a simple formula to interpret catches in monitoring moth traps deployed by management programs.

Abstract

Estimates of absolute pest population density are critical to pest management programs but have been difficult to obtain from capture numbers in pheromone-baited monitoring traps. In this paper, we establish a novel predictive relationship for a probability (spTfer(r)) of catching a male located at a distance r from the trap with a plume reach D. s p T f e r r = s p T f e r 0 1 + r D 2 ,   r R m a x 0 ,   r > R m a x , where spTfer(0) is the probability of catching an insect located next to the trap and Rmax is the maximum dispersal distance for the insect during the trapping period. The maximum dispersal distance for gypsy moth is known to be 1600 m. The probability of catching a gypsy moth male located next to a United States Department of Agriculture (USDA) milk carton pheromone-baited trap is 0.37, the overall probability of catching a male from the entire trapping area (Tfer) of ~800 ha is 0.0008, and plume reach of this trap is D = 26 ± 3 m. The equation for spTfer(r) is used to derive statistical upper and lower bounds (95% confidence interval) on the population density for the given value of a single trap catch. This combination of trap parameters appears to produce an effective trap: even a catch of 1 male provides meaningful lower and upper bounds on absolute population density. Applications in the management programs are discussed, and a look-up table is provided to translate the catches in USDA milk carton pheromone-baited traps to absolute population bounds, which can help design better management strategies.

1. Introduction

European gypsy moth (Lymantria dispar dispar (L.), Lepidoptera: Erebidae) is one of the most devastating forest pests in the Eastern United States. It was introduced to Medford, MA, USA in 1869 and since then has been continuously expanding its range. Gypsy moth larvae are extreme folivores feeding on leaves of over 300 different trees and shrubs [1,2]. Gypsy moth is primarily considered a forest pest; however, during outbreaks it can pose a threat to various fruit and nut crops, lead to reductions in residential property values as a result of defoliation, damage public greenspaces, and cause allergic reaction in humans [3,4,5]. Gypsy moth management efforts include outbreak suppression, slowing its spread in the transition zone, and eradication of populations that arrive outside of the invaded range. All of these management programs rely on traps baited with synthetic gypsy moth sex pheromone (+)-disparlure to detect gypsy moth populations, estimate population density, and evaluate success of applied treatments [6]. Trapping counts are favored over other measures of gypsy moth density such as egg mass and pupal counts because they are by far the least costly to obtain and were shown to be well correlated with egg mass and pupal counts [7,8,9].
Population density assessment is a critical part of any pest management program. Traps are utilized to detect and delimit small isolated insect populations and to estimate abundance and periods of activity [10,11,12,13,14,15,16,17,18]. Extensive research has been conducted over the years to establish the range of trap attraction, evaluate trap efficiency, estimate effective sampling area and catch probability, with the ultimate goal of interpreting trap catches and relating them to the actual population density [19,20,21,22,23,24,25]. Recent research by Bau and Cardé [26] demonstrated a high probability of false-negative trap catches when the density of an insect population is low and concluded that trap efficiency had a profound effect on detectability. Translating catch numbers from monitoring traps into estimates of absolute density has proven challenging for any insect [11,15,27]. The availability of statistically reliable estimates of the absolute density is critical for assessing efficacy of existing pest management programs and making improvements.
Recent explorations using computer simulations have provided substantial insight into the mechanics and meaning of a catch number in a pheromone-baited monitoring trap targeting insects foraging by random walks [28]. This approach treats insects much like diffusing molecules and a trap like a heat sensor recording particle hits from multiple distances [29]. This approach has been successful in translating catch numbers into estimates of absolute density for codling moth (Cydia pomonella, Lepidoptera: Tortricidae) in apple orchards [30], spotted wing drosophila (Drosophila suzukii, Diptera: Drosophilidae) [31], and brown marmorated stink bug (Halyomorpha halys, Hemiptera: Pentatomidae) [32].
In the research detailed below, we began the study by applying the existing framework developed by [28], which defines key parameters of the trap-insect system, such as plume reach and probability of catch. This analysis sets the stage for deriving and experimentally validating a simple mathematical relationship between the catch probability and distance to the trap, spTfer(r). The novel relationship turns out to be instrumental in deriving mathematically rigorous statistical bounds of absolute population density for gypsy moth, which was the ultimate goal of this work.

2. Materials and Methods

The study was conducted in Appomattox-Buckingham State Forest, VA, USA, in summers of 2015, 2016, 2019, and 2020. The forest is planar and experiences shifting rather than a dominant wind direction. Laboratory-reared gypsy moth males were obtained as pupae from the USDA Animal and Plant Health Inspection Service, Pest Survey Detection and Exclusion Laboratory, OTIS Air National Guard Base, Buzzards Bay, MA, USA. Pupae were kept in laminated paper cups covered with mesh screening. Solvent red 26 dye (Royce International, Paterson, NJ, USA) was added to the larval diet at the rearing facility; it transferred into adults so as to allow clean differentiation between released and wild male moths. We released males by hand counting out the exact number of males at each release point.
Male moths were captured in standard USDA milk carton pheromone traps baited with 500 μg of (+)-disparlure in twine dispensers (Scentry Biologicals, Inc., Billings, MT, USA) and hung on tree trunks at a height of 1.5 m. Traps were checked at least 3 days after a release to ensure converged trap catches, meaning that the value did not increase with increased trapping time [33].

2.1. Experimental Design

Previous studies aimed at quantifying average proportion of target insects caught across the full sampling area of a trap have favored a single-trap, multiple-release design (Figure 1A). Here we used a single-release, multiple-trap design (Figure 1B). The rationale was that sample size for catch at each distance would be raised given that the number of insects available to us for release was limited. A requirement of this new approach was that traps must be spaced at a distance where they do not compete significantly. The minimal permissible distance for avoiding significant competition between milk carton traps of gypsy moth males was previously documented at about 40 m [34]. Both plot designs accommodated shifting wind directions.
Experiments were conducted in 2015, 2016, 2019, and 2020. In each year, we placed traps at various distances from the release point along the cardinal directions as shown in Figure 1B. Releases ranged from 50 to 500 males per release point at each time of release (Table 1). We used 3- to 7-day intervals between male moth releases to allow males adequate time to find traps [33].
In years 2015 and 2016, we established one plot and moved traps around the single release point to achieve specific distances; the number of releases at each distance ranged from 2 to 9 (Table 1). In 2019, we established three plots; in each plot, we moved traps to achieve specific distances and made three releases at each distance. The distance between plots was ≥2000 m to prevent interference. In 2019 and 2020, we deployed a total of six USDA milk carton pheromone-baited traps and released males next to a trap to estimate trap catch at 0 m. We made 20 releases for a total of 190 gypsy moth males; releases ranged from 3–20 males/release. Multiple plot locations allowed for averaging of local variations of the relevant conditions.
In 2019, we estimated average plume reach of a single USDA milk carton pheromone-baited trap using the indirect approach of Miller et al. [28]. We established three 100 × 100 m plots each separated by ≥2000 m to prevent interference. Fifty male moths at a time were released at 15, 30, 45, 60, and 75 m in each of the four cardinal directions (200 per distance) from a single trap (Figure 1A). Male moths released at each distance bore a unique fluorescent dye (DayGlo®, Cleveland, OH, USA) visible under black light [35]. Releases were made once or twice a week to minimize catch overlap; traps were checked and emptied at the time of release. A total of 9 releases/distance/plot occurred over 7 weeks and data collection ceased 3 days after the final release.
The fraction of males caught per trap collected from experimental design Figure 1B requires an additional conversion to be compared directly with the same fraction based on the trap set up shown in Figure 1A. Specifically, to interpret the results from Figure 1B, we assume that fractions of males caught by each of the four traps are uncorrelated, that is the fraction caught by each trap is independent of whether the three other traps are present. In this case, (fraction of males caught per trap) = ¼ × (total of males released)/(total of males caught). In practice, we assume no correlation between the traps if the distance between the traps is much larger than the plume reach D. For gypsy moth, this assumption is only approximate for the smallest release distances of r = 25 and 50 m, but for consistency, we nevertheless use (fraction of males caught per trap) = ¼ × (total of males released)/(total of males caught) for all of the data points resulting from Figure 1B set up.

2.2. Estimating Plume Reach and Catch Probability using Existing Methods

The existing approach of Miller et al. [28] assumes that: (1) insects displace by correlated random walks before they contact a pheromone plume, and as such they will quickly become randomly distributed even though their starting populations may have been clumped; (2) capture probability falls with distance by some starting probability of capture at the trap; (3) catch contribution from an annulus of area away from a trap is given by catch probability from that given distance multiplied by the number of insects inhabiting that annulus area; (4) overall catch probability (Tfer) for a trap’s sampling area can be calculated from a catch probability profile across distance that is measured in release-capture experiments; (5) the maximum for trapping (sampling) radius is given by the distance at which no catch is recorded when a goodly number of insects have been released therefrom; and (6) an estimate of insects per trapping area is given by dividing catch number by overall catch probability so as to generate an estimate of absolute density. Average plume reach was estimated from the slope of a plot of distance of release vs. the inverse of average proportion caught per distance (MAG plot; Figure 2). Previous studies [28] found plume reach to be 20%–30% of trap diameter value (L), where:
L =   2 π M A G   p l o t   s l o p e
To estimate the sampling area of the trap, we used the maximum trapping radius, which is the farthest distance yielding a capture [28,30].
To estimate catch probability, we used the procedure developed by Miller et al. [28] and calculated annuli for each release distance, catch probability for each annulus and the product of annulus and a corresponding catch probability (Table 2). The overall catch probability across the sampling area (Tfer) is calculated as mean of annulus area × catch probability per given annulus divided by mean annulus area, and can be used to estimate the absolute number of insects per trapping area as catch per one trap divided by the overall catch probability (Tfer).

2.3. The Novel Model and Its Derivation

2.3.1. Preliminaries and Definitions

Our goal was to propose a simple and mechanistically sensible equation for the probability (spTfer(r)) with which a pheromone-baited trap captures a single male released distance r away from the trap. By catch we mean converged catch, which in the current type of experiment means we seek the lim t s p T f e r r , which we still call spTfer(r) for notational simplicity.
A key characteristic of the trap-male system is the so-called trap average plume reach, D, operationally defined as the maximum distance from the pheromone source (the trap) at which the male still shows some physiological response (the average plume reach is assumed isotropic, corresponding to the experimental design where it is determined from multiple uncorrelated measurements leading to any directionality averaging out). In reality, the response function is obviously not an infinitely sharp “yes” or “no” step function p0 = θ(r), but, rather, a smooth probability function p0 equal to 1 at r = 0, sharply decreasing at r = D, and zero at infinity (Figure 3). We assume that the insect release occurs at time t = 0, and the trap is left in place for a sufficiently long interval (48 h) for the male to be able to reach the trap—the converged catch—if released from any point up to r = Rmax away from the trap. Here Rmax = 1600 m is the longest “catch distance” experimentally recorded [20]; we assume that the probability for a male to cover a distance longer than Rmax over its lifespan is zero.

2.3.2. Constructing the Model

Our overall approach is to explore limiting cases of small and large r, and then interpolate between them with a simple formula.
(1)
In the limiting case of r = 0, the male is released right next to the trap. The insect is clearly well within the plume reach, and it becomes trapped with a constant probability spTfer0, which can be measured experimentally for the given trap type.
(2)
For small, but non-zero r << D, the plume reach is nearly as strong as at r = 0, and so the over-all catch probability should not be too much smaller than spTfer(0). In this range, we expect the shape of spTfer(r) function to resemble p0 (r) of Figure 3. As the distance to the trap becomes comparable to the plume reach, r ~ D, spTfer(r) begins to decrease appreciably.
(3)
The most interesting and complex regime corresponds to large distances between the release point and the trap, r >> D, but still smaller than Rmax. We consider the male trajectory to be essentially 2-dimensional in this case, confined to a relatively narrow (compared to r) zone between the ground and the tree line. There are three distinct outcomes of a male trajectory at these distances (Figure 4). First, the male trajectory can enter the plume circle around the trap, and so the male becomes trapped with the probability spTfer(0). Second, the male can travel outside of the circle of radius r around the release point; we assume that for large r, its likelihood of coming back and eventually getting trapped is negligible. If these were the only two possibilities, the proportion of males trapped would be ~( D r ), which is the ratio of the total outward insect flux 2πr to the flux through the plume reach circle 2πD. Here, flux = (number of males) × (circle perimeter). However, at large values of r, that is, at large times elapsed from the release, the males begin to die or stop the search for various reasons, that is the insect flux through the “outer” circle r is not conserved, but instead decreases with time, and, hence with the distance from the release point. As the simplest approximation, we assume that male flux falls of as 1/r. The net result is that the proportion of males trapped decreases with distance as ~ ( D r ) 2 for large r (the extra “D” makes sure that the expression is dimensionless). Thus, far away from the release point, the probability of the male trapped is s p T f e r 0 ( D r ) 2 .
(4)
Finally, for r > Rmax, spTfer(r) = 0, which means males simply do not travel that far.
Based on the above, we propose Equation (2) for spTfer(r); one can verify that it satisfies all four of the limiting cases described above.
s p T f e r r = s p T f e r 0 1 + r D 2 ,   r R m a x 0 ,   r > R m a x
Note that when r = D exactly, that is the male is released right at the edge of the plume reach, spTfer(D) = 1 2 spTfer(0). This is because there is a 1/2 probability that, being right at the edge of the plume reach, the male flies in and, once inside the plume reach, gets trapped with the probability spTfer(0). The male can also fly in the opposite direction and escape the trap with probability 1/2. This behavior of spTfer(r) in Equation (2) is consistent with the meaning of plume reach (Figure 3).
Estimating the plume reach (D) from experimental data
Assuming ( D r ) 2 >> 1, Equation (2) reduces to a pure power law decay:
spT fer r = spT fer 0 r D 2 ,   r R max 0 ,   r > R max
Since Equation (2) is derived based on the long-range asymptotic considerations, a fit to the long-range part of the data is a better way of estimating D as compared to a fit to all of the data point (to be presented in Results for validation of the model across the entire range of distances).
From our estimate of D based on the MAG plot [28], the condition ( D r ) 2 >> 1 should be satisfied for r ≥ 80 m.
We used a log-log plot (Figure 5) to find the value of plume reach D:
ln ( s p T f e r r ) =   2 ln r + ln ( D 2 × s p T f e r 0 )
We then used JMP 11 Pro [36] to fit Equation (3) to the experimental data points ≥80 m (Figure 5), which yielded D = 25.6 ± 3 m, where the error margin is estimated from the uncertainty of the fit line.

2.3.3. Estimating the Absolute Insect Density from Individual Trap Catch Data

Here, we address the following question: given a specific number of males M caught by the pheromone trap over the typical observation time, what is the most probable male population density ρ m p ¯ in the surrounding area? Further, what are the lower and upper bounds for this value, within specified confidence interval p? A single male distance r away from the trap contributes spTfer(r) to the total number of males caught by the trap. Thus, assuming that a 2D male population density ρ(x,y), the total number of males caught is given by the integral over the area of interest [28]:
M ¯ = s p T f e r r ρ x , y d x d y = 2 π 0 R m a x s p T f e r r ρ r r d r
where we have taken the area to be bounded by the maximum possible male flight distance Rmax—it is natural to assume that no male can reach the trap from outside of the circle of radius Rmax over the trapping period. Note that the case of a single male at position r0 can formally be represented by the delta function density ρ(x,y) = δ(rr0) substituting it into Equation (4) yields M ¯ = spTfer(r0), as it should. As a side note, Equation (4) implies a certain limitation on the asymptotic behavior of spTfer(r) for D r << 1, as the integral has to converge at the upper limit, which in turn implies that if spTfer(r)~ ( D r ) b for large r, then b cannot be less than 2.
To proceed with the derivation of bounds on the male density, assume that ρ(r) does not have any systematic variation over the collection area, in which case we can replace ρ(r) with its average:
ρ r = c o n s t = ρ ¯
With this, we apply Equation (2) to obtain:
M ¯ = 2 π ρ ¯ s p T f e r 0 0 R m a x r d r 1 + r D 2 = π ρ ¯ s p T f e r 0 D 2 l n 1 + R m a x D 2
and
ρ ¯ = M ¯ s p T f e r 0 × 1 π D 2 l n 1 + R m a x D 2
To relate the average ρ ¯ in the above equation to actual integer number of males caught M, we need to make an assumption about the kind of statistical distribution that is appropriate for M. We argue that the Poisson distribution (with the expected value M ¯ ) is most appropriate: it implies that the density of males does not change significantly over the trapping period due to the action of the trap, which is a reasonable assumption for a single trap in a large open area. Using the desired confidence interval p, the lower (min) and upper (max) bounds on the average male catch M ¯ [37]:
1 2   χ 2   α 2 ; 2 M   M ¯   1 2   χ 2   1 α 2 ; 2 M + 2
where α = 1 − p, and χ2(q,n) is the quantile function (corresponding to a lower tail area q) of the chi-squared distribution with n degrees of freedom. Introducing, for notational simplicity:
μ = 1 s p T f e r 0 × 1 π D 2 l n 1 + R m a x D 2
We arrive at the desired lower and upper bounds on the average density ρ ¯
μ 2   χ 2   α 2 ; 2 M   ρ ¯   μ 2   χ 2   1 α 2 ; 2 M + 2
For M males caught, the expected value (average) of the Poisson distribution that maximizes the probability is M itself; therefore, with M males caught, the most probable (average) male density in the collection area is:
ρ m p ¯ = M s p T f e r 0 × 1 π D 2 l n 1 + R m a x D 2 = µ M
To convert the male density to number of males per ha, and assuming D and Rmax are given in meters, μ in Equations (9) and (10) needs to be multiplied by 10,000.

3. Results

3.1. Estimating Plume Reach and Catch Probability Using Existing Methods

To estimate plume reach of a USDA milk carton pheromone-baited trap, we released a total of 8600 adult males and captured 1289 (15%). Capture rates ranged from 2% to 45%. We estimated plume reach to be in the range of 19–28 m.
Since, in previous studies, 1 male was caught 1600 m away from the release point [20], we used the maximum trapping radius of 1600 m (Figure 6), which yields a trapping area of ~804 ha. The overall catch probability (Tfer) as calculated by the methods of Miller et al. [28] was 0.0025.

3.2. Validation of the New Model

Our main result is Equation (2), see Section 2.3, which relates proportion of males caught in a pheromone-baited trap (spTfer) to distance (r) from the trap and plume reach (D). The equation predicts steep, power law-like decline of trap catches with increasing distance from the trap (Figure 7). The model gives the probability (spTfer (r)) of catching a single male located at a distance r from the trap with a plume reach (D). Here, spTfer(0) is the probability of catching a male located in the immediate vicinity of the trap (r = 0). This value is determined experimentally as described in Section 2.1 and is equal 0.37. Rmax is the distance from the trap, beyond which trap catch is always 0. In the case of gypsy moth, Rmax = 1600 m [20]. The only fitted parameter of Equation (2) is plume reach D which was obtained as described in the Methods. The fitting was performed for large values of r, yielding the plume reach D = 25.6 ± 3 m, therefore, Equation (2) for gypsy moth is:
s p T f e r r = 0.37 1 + r 25.6 2 ,   r 1600   m e t e r s 0 ,   r > 1600   m e t e r s
Within the model, the overall catch probability across the sampling area (Tfer) can be calculated as M ¯ using Equation (6), where one assumes ρ ¯ = 1 π R m a x 2 , which is the average density of 1 male over the entire trapping area:
M ¯ = s p T f e r 0 D R m a x 2 l n 1 + R m a x D 2
The corresponding M ¯ =   T f e r = 0.0008 .
The model is verified on all of the data points available to us (Figure 7), including small values of r < 80 m, not used to obtain the plume reach value. The correlation is R = 0.9 over the entire data set. It is noteworthy that even though the model was derived using asymptotic considerations for r >> D, it still agrees well with experimental values when r is small.

3.3. Model Application: Estimate of the Average Gypsy Moth Density from the Catch Data

We have applied the gypsy moth-specific model (Equation (11)) to estimate lower and upper bounds of moth density based on moth counts in USDA milk carton pheromone-baited traps (Figure 8, Table 3). We stress that these counts correspond to converged catches (≥3 days). The details of the experimental design are presented in Section 2.1.

4. Discussion

The new predictive relationship established between proportion of males caught in a pheromone-baited trap (spTfer), distance (r) from the trap, and plume reach (D) yields a plume reach of 25.6 ± 3 m; the proposed equation provides a straightforward way to estimate absolute density from the trap catch. The corresponding estimate of plume reach is remarkably close to the estimate obtained using the methodology developed by Miller et al. [28]; both agree with observations made by other researchers. Elkinton and Cardé [34] observed interactions between traps spaced 40 m apart, indicating that plume reach of a milk carton pheromone-baited trap is ≥20 m. Another study reported wing fanning of a much smaller proportion of gypsy moth males at 40 m from the pheromone source [38].
The estimates of the overall catch probability (Tfer) obtained using the existing method [28] and the proposed model are 0.0025 and 0.0008, respectively. We explain the 3-fold difference as follows. First, the existing method converts the integral of Equation (4) into a partial Reimann sum, coarse-grained by the use of discrete annuli (see Methods), while the new method directly integrates over the smooth curve, Equation (6), representing Tfer(r) as a function of r. Within the existing method based on discrete equidistant annuli (in our case d = 50 m apart), the annuli that do not contain experimental data points are skipped in the calculation. In the case of our gypsy moth data, the skipped annuli are mostly the annuli corresponding to large distances from the trap, where spTfer(r) × (annulus area) ~ 2Pi (D/r)2 × r × d is low, and further decreases with r. Thus, the contributions to Tfer from low spTfer(r) × (annulus area) values are underrepresented in the final tally, leading to the Tfer being overestimated compared to the integral over the entire region from r = 0 to r = Rmax, Equation (6). By skipping a number of annuli corresponding to large r values, the existing method effectively uses lower Rmax: clearly, the probability to catch one male from a smaller area is larger (see also Equation (12)). The above logic explains the overestimation of Tfer compared to the value obtained by directly integrating the model in Equation (6). Note that for an insect, for which fine-grained data points for spTfer(r) are available [32] for the entire span of r values from near 0 to Rmax, no consistent overestimation of Tfer using the existing approach [28] is expected.
To assess possible influence of the discretization interval (d = 50 m used here) on the estimate of Tfer, we calculated Tfer using the partial Reimann sum approximating Equation (6) in two ways: first, taking Tfer(r) value (Equation (2)) at the left side of each discretization interval (annulus), then taking it to be on the right side of it. We used the same set of annuli as previously. The resulting difference in the estimated Tfer is 3-fold, from 0.00373 to 0.00147, indicating that the discretization into 50-m annuli—limited in practice by the extremely laborious process of obtaining experimental data points at each r—may still be too coarse for a converged estimate of Tfer for gypsy moth using the existing method based on coarse-graining the integral. Since the characteristic decay length of spTfer(r) is the plume reach D (Equation (2)), we suggest that a highly converged estimate relying on a discrete sum to approximate the true integral should use a discretization interval of much less than D, e.g., d = 10 m for gypsy moth. However, obtaining high quality relevant experimental data for gypsy moth, for a set of, say, 160 distance points, d = 10 m apart from 0 to Rmax = 1600 m would be extremely difficult in practice: the 18 existing data points reported here took the team four seasons to collect. This is yet another strong motivation for the need for a single equation for spTfer(r) valid for all values of r, such as Equation (6). Note that the value of Tfer obtained within the proposed model represents the best fit over the entire set of experimental points, thus the outliers, especially at low distances (r) from the trap (Table 2), have much less influence on the final value of Tfer.
However, despite being different, both values of Tfer—the one obtained with the discrete annuli summation and the one based on Equation (12)—agree with previous findings in that in most insects the overall catch probability is very low, <0.02, which can hinder detection of low-density populations as well as lead to underestimation of the detected population’s density [29]. We emphasize that a very low value for Tfer most likely results from a highly vagile insect target rather than a poorly performing trapping system [29].
Bau and Cardé [26] used simulation models of odor dispersal and plume acquisition to predict the probability of detection of low-density gypsy moth populations. Their results indicated that at 30 males/km2 (=0.3/ha), a probability of false negative was high and that trap efficiency had a profound effect on detectability. Our results agree with this conclusion. We found that a catch of 0 can result from non-zero density of up to six gypsy moth males/ha (Table 3). Nevertheless, the USDA milk carton pheromone-baited trap appears to be sensitive enough to provide meaningful lower and upper bounds on absolute population density from a catch of 1 male/trap. These bounds can be used in management programs. Note that the model gives no prediction of the gypsy moth population location, only the population density in the given area; therefore, further delimitations are needed to determine exact location and extent of the population [39,40]. This is especially important in the uninfested areas, where gypsy moth populations are sparse [33]. Currently, the National Gypsy Moth Slow the Spread Program utilizes previously optimized 2-km and 3-km grids of USDA milk carton pheromone-baited traps for detecting isolated colonies [39,41,42] and 1000-m to 500-m grid for delimiting populations for treatment planning or evaluation of a previously applied treatment [6,39,43,44]. Our results indicate that these fairly coarse grids are sufficient for detection and delimitation due to plume reach and sensitivity of a milk carton trap.
Understanding the relationship between trap catches and absolute density is especially important at very low catches. Management programs rely on pheromone-baited traps to make decisions on the necessity and type of treatment application. Depending on the goal and available resources, ability to calculate the absolute density would allow for adjusting the response to be more or less conservative. However, estimated bounds cannot be directly applied to season-long trap catches because the population density changes in time according to Gaussian distribution [45]. Instead, season-long population density can be used to first estimate abundance during peak flight [45]. Then, the absolute population density during peak flight can be estimated using Equation (11). This would enable a determination of the most appropriate method of control based on the location of the population and the goal of the control program. For example, if the goal is eradication, absolute maximum population density can be used to assign a more aggressive treatment option.

5. Conclusions

One of the key outcomes of this work is a simple mathematical relationship between the probability of trap catch and the distance between an insect and a trap. The relationship derived applies to converged catch, which means that the trapping time is long enough that longer exposure does not lead to greater catch. This relationship can be used to conduct further analyses to improve and optimize monitoring in management programs; for example, one can estimate a probability of a localized infestation for the given trap catch data obtained using regular monitoring grid. Such analysis might lead to a more economical grid size than currently used. Moreover, the simplicity of the obtained relationship hints at the possibility that it may be general and applicable to other insect species. We plan to test this conjecture in a future study.

Author Contributions

K.S.O., J.R.M., and A.D.H. designed the experiments for the study; K.S.O. and A.D.H. collected data; K.S.O., A.V.O., and J.R.M. analyzed data and interpreted results; A.V.O. constructed the model; K.S.O., A.V.O., and J.R.M. prepared the manuscript. All authors discussed the project and edited the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the USDA Forest Service, Forest Health Protection (15-CA-11420004-088). Mention of a proprietary product does not constitute an endorsement or a recommendation for its use by USDA. Funding to cover publication fees was provided by Virginia Tech Open Access Subvention Fund.

Acknowledgments

We thank Hannah Nadel, Christine McCallum, and Susan Lane (USDA APHIS PPQ) for supplying gypsy moth pupae; Laura Chamberlin, Katlin Mooneyham, Mike Womack, and Tomas Zaebst (VDOF) for providing forest access, help, and support; Gypsy Moth Slow the Spread Technical Committee for helpful discussions; Department of Entomology at Virginia Tech for providing facilities.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liebhold, A.M.; Gottschalk, K.W.; Muzika, R.-M.; Montgomery, M.E.; Young, R. Suitability of North American Tree Species to the Gypsy Moth: A Summary of Field and Laboratory Tests; NE-211; US Department of Agriculture, Forest Service, Northeastern Forest Experiment Station: Madison, WI, USA, 1995.
  2. Gray, D.R. The gypsy moth life stage model: Landscape-wide estimates of gypsy moth establishment using a multi-generational phenology model. Ecol. Model. 2004, 176, 155–171. [Google Scholar] [CrossRef]
  3. Miller, J.C.; Hanson, P.E.; Dowell, R.V. Potential of gypsy moth as a pest of fruit and nut crops. Calif. Agric. 1987, 41, 10–12. [Google Scholar]
  4. Bigsby, K.M.; Ambrose, M.J.; Tobin, P.C.; Sills, E.O. The cost of gypsy moth sex in the city. Urban For. Urban Green. 2014, 13, 459–468. [Google Scholar] [CrossRef]
  5. Wirtz, R. Allergic and toxic reactions to non-stinging arthropods. Annu. Rev. Entomol. 1984, 29, 47–69. [Google Scholar] [CrossRef]
  6. Tobin, P.C.; Blackburn, L.M. Slow the Spread: A National Program to Manage the Gypsy Moth; General Technical Report NRS-6; USDA Forest Service: Newtown Square, PA, USA, 2007.
  7. Thorpe, K.W.; Ridgway, R.L.; Leonhardt, B.A. Relationship between Gypsy-Moth (Lepidoptera, Lymantriidae) Pheromone Trap Catch and Population-Density—Comparison of Traps Baited with 1 and 500 Mu-G (+)-Disparlure Lures. J. Econ. Entomol. 1993, 86, 86–92. [Google Scholar] [CrossRef]
  8. Carter, M.R.; Ravlin, F.W.; Mcmanus, M.L. Estimating Gypsy-Moth (Lepidoptera, Lymantriidae) egg mass density using male moths captured in pheromone-baited, milk-carton traps. Environ. Entomol. 1994, 23, 556–561. [Google Scholar] [CrossRef]
  9. Brown, M.W.; Rosenberger, J.L.; Cameron, E.A. Development and Evaluation of a Sampling Scheme for the Gypsy-Moth Egg Parasitoid Ooencyrtus-Kuvanae (Hymenoptera, Encyrtidae). Can. Entomol. 1981, 113, 575–584. [Google Scholar] [CrossRef]
  10. Abell, K.; Poland, T.M.; Cossé, A.; Bauer, L.S. Trapping techniques for emerald ash borer and its introduced parasitoids. In Biology and Control of Emerald Ash Borer; Van Driesche, R.G., Reardon, R.C., Eds.; FHTET-2014-09; U.S. Department of Agriculture, Forest Service, Forest Health Technology Enterprise Team: Morgantown, WV, USA, 2015; pp. 113–127. [Google Scholar]
  11. Elkinton, J.S.; Cardé, R.T. The Use of Pheromone Traps to Monitor the Distribution and Population Trends of the Gypsy Moth. In Management of Insect Pests with Semiochemicals; Mitchell, E.D., Ed.; Plenum: New York, NY, USA, 1981; pp. 41–55. [Google Scholar]
  12. Liebhold, A.M.; Tobin, P.C. Population ecology of insect invasions and their management. Ann. Rev. Entomol. 2008, 53, 387–408. [Google Scholar] [CrossRef] [Green Version]
  13. Sharov, A.A.; Liebhold, A.M.; Ravlin, F.W. Prediction of gypsy moth (Lepidoptera: Lymantriidae) mating success from pheromone trap counts. Environ. Entomol. 1995, 24, 1239–1244. [Google Scholar] [CrossRef]
  14. Tobin, P.C.; Klein, K.T.; Leonard, D.S. Gypsy moth (Lepidoptera: Lymantriidae) flight behavior and phenology based on field-deployed automated pheromone-baited traps. Environ. Entomol. 2009, 38, 1555–1562. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Byers, J.; Anderbrant, O.; Löqvist, J. Effective attraction radius. J. Chem. Ecol. 1989, 15, 749–765. [Google Scholar] [CrossRef] [PubMed]
  16. Byers, J. Active Space of Pheromone Plume and its Relationship to Effective Attraction Radius in Applied Models. J. Chem. Ecol. 2008, 34, 1134–1145. [Google Scholar] [CrossRef] [PubMed]
  17. Byers, J.A. Estimating insect flight densities from attractive trap catches and flight height distributions. J. Chem. Ecol. 2012, 38, 592–601. [Google Scholar] [CrossRef] [PubMed]
  18. Wall, C.; Perry, J. Range of action of moth sex-attractant sources. Entomol. Exp. Appl. 1987, 44, 5–14. [Google Scholar] [CrossRef]
  19. Elkinton, J.S.; Childs, R.D. Efficiency of two gypsy moth (Lepidoptera: Lymantriidae) pheromone-baited traps. Environ. Entomol. 1983, 12, 1519–1525. [Google Scholar] [CrossRef]
  20. Elkinton, J.S.; Cardé, R.T. Distribution, dispersal, and apparent survival of male gypsy moths as determined by capture in pheromone-baited traps. Environ. Entomol. 1980, 9, 729. [Google Scholar] [CrossRef]
  21. Dufourd, C.; Weldon, C.; Anguelov, R.; Dumont, Y. Parameter identification in population models for insects using trap data. BioMath 2013, 2, 1312061. [Google Scholar] [CrossRef] [Green Version]
  22. Riedl, H.; Croft, B.A. A study of pheromone trap catches in relation to codling moth (Lepidoptera: Olethreutidae) damage. Can. Entomol. 1974, 106, 525–537. [Google Scholar] [CrossRef]
  23. Barclay, H.; Hendrichs, J. Modeling trapping of fruit flies for detection, suppression, or eradication. In Trapping and the Detection, Control, and Regulation of Tephritid Fruit Flies; Shelly, T., Epsky, N., Jang, E.B., Reyes-Flores, J., Vargas, R., Eds.; Springer: Dordrecht, The Netherlands, 2014; pp. 379–420. [Google Scholar]
  24. Gage, S.H.; Wirth, T.M.; Simmons, G.A. Predicting Regional gypsy-moth (Lymantriidae) population trends in an expanding population using pheromone trap catch and spatial-analysis. Environ. Entomol. 1990, 19, 370–377. [Google Scholar] [CrossRef]
  25. Taylor, R.A.J.; Mcmanus, M.L.; Pitts, C.W. The absolute eficiency of gypsy moth, Lymantria dispar (Lepidoptera, Lymantriidae), milk carton pheromone traps. Bull. Entomol. Res. 1991, 81, 111–118. [Google Scholar] [CrossRef]
  26. Bau, J.; Cardé, R.T. Simulation modeling to interpret the captures of moths in pheromone-baited traps used for surveillance of invasive species: The gypsy moth as a model case. J. Chem. Ecol. 2016, 42, 877–887. [Google Scholar] [CrossRef] [PubMed]
  27. Östrand, F.; Anderbrant, O. From where are insects recruited? A new model to interpret catches of attractive traps. Agric. For. Entomol. 2003, 5, 163–171. [Google Scholar] [CrossRef]
  28. Miller, J.R.; Adams, C.G.; Weston, P.A.; Schenker, J.H. Trapping of Small Organisms Moving Randomly: Principles and Applications to Pest Monitoring and Management; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
  29. Miller, J.R. Sharpening the precision of pest management decisions: Assessing variability inherent in catch number and absolute density estimates derived from pheromone-baited traps monitoring insects moving randomly. J. Econ. Entomol. 2020. [Google Scholar] [CrossRef] [PubMed]
  30. Adams, C.G.; Schenker, J.H.; McGhee, P.S.; Gut, L.J.; Brunner, J.F.; Miller, J.R. Maximizing information yield from pheromone-baited monitoring traps: Estimating plume reach, trapping radius, and absolute density of Cydia pomonella (Lepidoptera: Tortricidae) in Michigan Apple. J. Econ. Entomol. 2017, 110, 305–318. [Google Scholar] [CrossRef] [PubMed]
  31. Kirkpatrick, D.M.; Gut, L.J.; Miller, J.R. Estimating monitoring trap plume reach and trapping area for Drosophila suzukii (Diptera: Drosophilidae) in Michigan tart cherry. J. Econ. Entomol. 2018, 111, 1285–1289. [Google Scholar] [CrossRef]
  32. Kirkpatrick, D.M.; Acebes-Doria, A.L.; Rice, K.B.; Short, B.D.; Adams, C.G.; Gut, L.J.; Leskey, T.C. Estimating monitoring trap plume reach and trapping area for nymphal and adult Halyomorpha halys (Hemiptera: Pentatomidae) in crop and non-crop habitats. Environ. Entomol. 2019, 48, 1104–1112. [Google Scholar] [CrossRef] [Green Version]
  33. Robinet, C.; Lance, D.R.; Thorpe, K.W.; Onufrieva, K.S.; Tobin, P.C.; Liebhold, A.M. Dispersion in time and space affect mating success and Allee effects in invading gypsy moth populations. J. Anim. Ecol. 2008, 77, 966–973. [Google Scholar] [CrossRef]
  34. Elkinton, J.S.; Carde, R.T. Effects of Intertrap Distance and Wind Direction on the Interaction of Gypsy-Moth (Lepidoptera, Lymantriidae) Pheromone-Baited Traps. Environ. Entomol. 1988, 17, 764–769. [Google Scholar] [CrossRef]
  35. Tcheslavskaia, K.S.; Thorpe, K.W.; Brewster, C.C.; Sharov, A.A.; Leonard, D.S.; Reardon, R.C.; Mastro, V.C.; Sellers, P.; Roberts, E.A. Optimization of pheromone dosage for gypsy moth mating disruption. Entomol. Exp. Appl. 2005, 115, 355–361. [Google Scholar] [CrossRef]
  36. SAS Institute Inc. JMP®, 1989–2020; SAS Institute Inc.: Cary, NC, USA, 2020. [Google Scholar]
  37. Zar, J.H. Biostatistical Analysis; Prentice Hall: Upper Saddle River, NJ, USA, 1999. [Google Scholar]
  38. Elkinton, J.; Cardé, R.; Mason, C. Evaluation of time-average dispersion models for estimating pheromone concentration in a deciduous forest. J. Chem. Ecol. 1984, 10, 1081–1108. [Google Scholar] [CrossRef]
  39. Roberts, E.A.; Ziegler, A.H. Gypsy moth population monitoring and data collection. In Slow the Spread: A National Program to Manage the Gypsy Moth; Tobin, P., Blackbum, L.M., Eds.; USDA Forest Service Northern Research Station: Newtown Square, PA, USA, 2007. [Google Scholar]
  40. Sharov, A.A.; Liebhold, A.M.; Roberts, E.A. Spread of gypsy moth (Lepidoptera: Lymantriidae) in the central Appalachians: Comparison of population boundaries obtained from male moth capture, egg mass counts, and defoliation records. Environ. Entomol. 1996, 25, 783–792. [Google Scholar] [CrossRef]
  41. Tobin, P.C.; Sharov, A.A.; Liebhold, A.A.; Leonard, D.S.; Roberts, E.A.; Learn, M.R. Management of the gypsy moth through a decision algorithm under the STS project. Am. Entomol. 2004, 50, 200–209. [Google Scholar] [CrossRef]
  42. Sharov, A.A.; Liebhold, A.M.; Roberts, E.A. Spatial variation among counts of gypsy moths (Lepidoptera: Lymantriidae) in pheromone-baited traps at expanding population fronts. Environ. Entomol. 1996, 25, 1312–1320. [Google Scholar] [CrossRef]
  43. Sharov, A.A.; Leonard, D.; Liebhold, A.M.; Roberts, E.A.; Dickerson, W. “Slow the Spread”: A national program to contain the gypsy moth. J. For. 2002, 100, 30–35. [Google Scholar]
  44. Sharov, A.A.; Leonard, D.; Liebhold, A.M.; Clemens, N.S. Evaluation of preventive treatments in low-density gypsy moth populations using pheromone traps. J. Econ. Entomol. 2002, 95, 1205–1215. [Google Scholar] [CrossRef]
  45. Onufrieva, K.S.; Onufriev, A.V. Linear relationship between peak and season-long abundances in insects. PLoS ONE 2018, 13, e0193110. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Experimental plot layout for (A) Male moth release point, plume reach study and (B) Pheromone-baited trap, absolute density study.
Figure 1. Experimental plot layout for (A) Male moth release point, plume reach study and (B) Pheromone-baited trap, absolute density study.
Insects 11 00673 g001
Figure 2. Inverse of proportion of gypsy moth males caught in pheromone-baited traps released at various distances from traps (r) (MAG plot transformation [28]). The proportion was calculated as an average over nine catches for each distance.
Figure 2. Inverse of proportion of gypsy moth males caught in pheromone-baited traps released at various distances from traps (r) (MAG plot transformation [28]). The proportion was calculated as an average over nine catches for each distance.
Insects 11 00673 g002
Figure 3. Probability p0 of the male response to a pheromone trap distance r away. D is the plume reach.
Figure 3. Probability p0 of the male response to a pheromone trap distance r away. D is the plume reach.
Insects 11 00673 g003
Figure 4. Outflux of insects through an imaginary circular boundary of radius r >> D surrounding the release point (black circle in the middle). Not every released male (indicated by five arrows at the center) reaches the boundary (solid black arrow)—some trajectories terminate (dotted arrows and crosses) inside the circle, while some trajectories continue outside the circle (grey arrows). Of those that do reach the boundary at r (solid black arrow), the fraction caught by the trap is the fraction of the total insect flux through the circle of radius D (plume reach).
Figure 4. Outflux of insects through an imaginary circular boundary of radius r >> D surrounding the release point (black circle in the middle). Not every released male (indicated by five arrows at the center) reaches the boundary (solid black arrow)—some trajectories terminate (dotted arrows and crosses) inside the circle, while some trajectories continue outside the circle (grey arrows). Of those that do reach the boundary at r (solid black arrow), the fraction caught by the trap is the fraction of the total insect flux through the circle of radius D (plume reach).
Insects 11 00673 g004
Figure 5. Log-log plot of proportion males caught in pheromone-baited traps located at various distances (r) from male moth release points. Black line is the least square fit to the experimental data points.
Figure 5. Log-log plot of proportion males caught in pheromone-baited traps located at various distances (r) from male moth release points. Black line is the least square fit to the experimental data points.
Insects 11 00673 g005
Figure 6. Proportion of released gypsy moth caught times annulus (spTfer × A) at various distances from traps (r) (Miller plot transformation, [28]).
Figure 6. Proportion of released gypsy moth caught times annulus (spTfer × A) at various distances from traps (r) (Miller plot transformation, [28]).
Insects 11 00673 g006
Figure 7. Experimental validation of the new model. Dots: experimental proportion of males caught in pheromone-baited traps placed at various distances from the release point (±SEM). Error bar is not shown when smaller than the symbol size. Solid line: the model described by Equation (2).
Figure 7. Experimental validation of the new model. Dots: experimental proportion of males caught in pheromone-baited traps placed at various distances from the release point (±SEM). Error bar is not shown when smaller than the symbol size. Solid line: the model described by Equation (2).
Insects 11 00673 g007
Figure 8. Estimate, based on the new model, of absolute gypsy moth male density from catch in United States Department of Agriculture milk carton pheromone-baited traps. Grey area indicates the range between lower and upper bounds with 95% probability, black line in the middle indicates the most probable density ρ m p ¯ for each specific trap catch.
Figure 8. Estimate, based on the new model, of absolute gypsy moth male density from catch in United States Department of Agriculture milk carton pheromone-baited traps. Grey area indicates the range between lower and upper bounds with 95% probability, black line in the middle indicates the most probable density ρ m p ¯ for each specific trap catch.
Insects 11 00673 g008
Table 1. Releases of male gypsy moths at various distances from pheromone-baited traps in plots with single-release, multiple-trap design (Figure 1B).
Table 1. Releases of male gypsy moths at various distances from pheromone-baited traps in plots with single-release, multiple-trap design (Figure 1B).
YearDistance (m)Number of Males ReleasedNumber of Releases
2015252009
502003
802003
1002003
2502005
5002005
10002005
2016252008
1002006
1502002
1802002
2002008
2502003
3002003
2019300509
6001009
9002009
12003009
15005009
Table 2. Catch probability at various distances from male gypsy moth release point. Catch probability is calculated based on the data reported here using existing methods [28].
Table 2. Catch probability at various distances from male gypsy moth release point. Catch probability is calculated based on the data reported here using existing methods [28].
Release Distance [r] (m)Annulus Area
[A] (m2)
Catch Probability for Each Annulus [spTfer(A)]Annulus Area × Catch Probability [spTfer(A) × A]
000.370
5078540.241858
10023,5620.163855
15039,2700.166283
20054,9780.01676
25070,6860.004295
30086,3940.000872
500149,2260.034477
600180,6420.003582
900274,8890.0041222
1000306,3050.002511
1200369,1370.0072461
1500463,3850.014548
Table 3. Estimates of lower and upper bounds, and the most probable absolute gypsy moth male density ρ m p ¯ (males/ha) corresponding to catches in United States Department of Agriculture milk carton pheromone-baited traps.
Table 3. Estimates of lower and upper bounds, and the most probable absolute gypsy moth male density ρ m p ¯ (males/ha) corresponding to catches in United States Department of Agriculture milk carton pheromone-baited traps.
CatchLower BoundUpper BoundMost Probable Density
005.80
10.048.81.6
20.3811.53.2
30.9813.94.8
41.716.36.4
52.618.57.9
63.520.79.5
74.522.911.1
85.52512.7
96.527.114.3
107.629.215.9
118.731.217.5
129.833.319
131135.320.6
1412.237.322.2
1513.339.323.8
1614.541.225.4
1715.743.227
1816.945.228.6
1918.247.130.2
2019.44931.7
2120.65133.3
2221.952.935
2323.154.836.5
2424.456.738.1
2525.758.839.7
262760.441.3
2728.262.442.9
2829.564.244.4
2930.866.146
3032.16847.6
3133.469.849.2
3234.771.750.8
3336.173.652.4
3437.475.454
3538.777.355.6
364079.157.1
3741.48158.7
3842.782.860.3
394484.661.9
4045.486.563.5
4146.788.365.1
424890.166.7
4349.491.968.3
4450.793.869.8
4552.195.671.4
4653.597.473
4754.899.274.6
4856.210176.2
4957.5102.877.8
5058.9104.679.4

Share and Cite

MDPI and ACS Style

Onufrieva, K.S.; Onufriev, A.V.; Hickman, A.D.; Miller, J.R. Bounds on Absolute Gypsy Moth (Lymantria dispar dispar) (Lepidoptera: Erebidae) Population Density as Derived from Counts in Single Milk Carton Traps. Insects 2020, 11, 673. https://doi.org/10.3390/insects11100673

AMA Style

Onufrieva KS, Onufriev AV, Hickman AD, Miller JR. Bounds on Absolute Gypsy Moth (Lymantria dispar dispar) (Lepidoptera: Erebidae) Population Density as Derived from Counts in Single Milk Carton Traps. Insects. 2020; 11(10):673. https://doi.org/10.3390/insects11100673

Chicago/Turabian Style

Onufrieva, Ksenia S., Alexey V. Onufriev, Andrea D. Hickman, and James R. Miller. 2020. "Bounds on Absolute Gypsy Moth (Lymantria dispar dispar) (Lepidoptera: Erebidae) Population Density as Derived from Counts in Single Milk Carton Traps" Insects 11, no. 10: 673. https://doi.org/10.3390/insects11100673

APA Style

Onufrieva, K. S., Onufriev, A. V., Hickman, A. D., & Miller, J. R. (2020). Bounds on Absolute Gypsy Moth (Lymantria dispar dispar) (Lepidoptera: Erebidae) Population Density as Derived from Counts in Single Milk Carton Traps. Insects, 11(10), 673. https://doi.org/10.3390/insects11100673

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop