Next Article in Journal
Analysis of Unusual Sulfated Constituents and Anti-infective Properties of Two Indonesian Mangroves, Lumnitzera littorea and Lumnitzera racemosa (Combretaceae)
Next Article in Special Issue
Emerging Contaminants in Seafront Zones. Environmental Impact and Analytical Approaches
Previous Article in Journal
Development and Validation of an Analytical Method for Deacetylasperulosidic Acid, Asperulosidic Acid, Scopolin, Asperuloside and Scopoletin in Fermented Morinda citrifolia L. (Noni)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Occurrence of Selected Known or Suspected Endocrine-Disrupting Pesticides in Portuguese Surface Waters Using SPME-GC-IT/MS

by
José Vera
1,
Virgínia Cruz Fernandes
1,*,
Luísa Correia-Sá
1,
Catarina Mansilha
2,3,
Cristina Delerue-Matos
1 and
Valentina F. Domingues
1
1
REQUIMTE/LAQV, Instituto Superior de Engenharia do Porto, Instituto Politécnico do Porto, Rua Dr. António Bernardino de Almeida 431, 4200-072 Porto, Portugal
2
REQUIMTE/LAQV, University of Porto, Porto, Praça Gomes Teixeira, Apartado 55142, 4051-401 Porto, Portugal
3
Instituto Nacional de Saúde Doutor Ricardo Jorge, R. Alexandre Herculano 321, 4000-055 Porto, Portugal
*
Author to whom correspondence should be addressed.
Separations 2021, 8(6), 81; https://doi.org/10.3390/separations8060081
Submission received: 21 April 2021 / Revised: 31 May 2021 / Accepted: 1 June 2021 / Published: 7 June 2021
(This article belongs to the Special Issue Analytical Methods for the Determination of Emerging Contaminants)

Abstract

:
A multiresidue analytical methodology based on a solid-phase microextraction (SPME), followed by gas chromatography-ion trap mass spectrometry (GC–IT/MS), has been developed for trace analysis of 20 known or suspected endocrine-disrupting pesticides. The SPME conditions are optimized considering several key parameters to obtain the maximum sensitivity. After the optimization, the method validation is performed, and the limits of detection (ranged from 2–150 ng/L) and the coefficient of determination (above 0.990) of studied compounds are determined for all the analytes. A robust sampling of twenty sampling points of surface water samples from the north and center of Portugal is performed, and the validated methodology is applied. In total, 20 compounds from four chemical families (13 organochlorine, 1 organophosphorus, 2 dicarboximide, and 4 pyrethroids) are studied, and the pesticides most frequently detected are eight organochlorine pesticides (α-, β-HCHs, lindane, HCB, o,p′-DDT, p,p′-DDE, p,p′-DDD, α-endosulfan), cypermethrin, and vinclozolin.

1. Introduction

The term endocrine-disruptors have been generally used to call compounds with characteristics in common, namely, with the capability to mimic the actions of hormones interfering with the behavior of endocrine systems in various living species [1]. The endocrine-disruptors compounds (EDCs) can be different chemical groups, such as pesticides, pharmaceuticals, and personal care products, polybrominated diphenyl ethers, among others [2]. Most of these are released to the environment by anthropogenic activities and may coexist and accumulate in crops and human bodies through food chains, posing risks to human health and the ecosystem [3,4]. Endocrine-disrupting pesticides (EDPs) are the largest group of EDCs. Despite all the benefits related to pesticide application (e.g., control of pests and diseases), they still can contaminate different environmental compartments being the aquatic environment the most vulnerable because of massive global use and its consequent degradation products [5,6]. The industry introduced several synthetic pesticides, such as organochlorine pesticides (OCs) (1940s), organophosphorus (OPs) (1960s), carbamates (1970s), and pyrethroids (PYR) (1980s). OCs, many of them classified as EDPs, were banned or restricted after the 1970s in most countries of the world, but continuously detected until today, due to their characteristics, such as high lipophilicity, bioaccumulation, high persistence, and potential of long-range transport [7]. The other chemical families of pesticides (e.g., OPs, carbamates, and PYR) are placed on the market as alternatives to OCs, and they are described as being less persistent, but more acutely toxic to control insect pests [8,9]. Studies have reported that chronic low-level exposure to OPs in the uterus and childhood are associated with poorer cognitive and behavioral problems [10]. PYR are also reported as lipophilic compounds, accumulate in sediments, bioaccumulated in biota [11], and neurotoxic [12,13]. In fact, national and international governments established programs and legislation to assess chemical safety regarding their potential to interact with the endocrine system of humans and wildlife, and considerable efforts have been made regarding ECPs control levels in waters. European Union (EU) collected data about EDPs, and priority lists are defined [14]. In terms of water analysis, maximum allowable concentration-Environmental Quality Standards (MAC-EQS) based on the directive 2013/39/EU [15], and the drinking water 98/83/EC [16] directive are strictly consulted and discussed. Due to the low levels of pesticides in the environment, ranging from ppb to ppt, and the complexity of the environmental matrices, the preconcentration of the samples before the analysis is usually required. One of the analytical techniques reported for isolation and preconcentration of pesticides from water samples is solid-phase microextraction (SPME) [17,18,19]. It is based on the sorption of analytes directly from the sample in one-step extraction and preconcentration of analytes [18,20]. The SPME has demonstrated its simplicity, usefulness, selectivity, and efficiency in the analysis of a broad range of compounds in several matrixes without requiring sample pretreatment [21].
Filho et al. [22] reported a multiclass residues analysis by GC-MS after SPME in twenty-six water samples from Brazil. Recently SPME was tested successfully for sixteen water samples from the North of Lebanon and the results obtained indicate a potential risk of environmental contamination and the need to perform seasonal monitoring [23].
Contamination, due to multiclass pesticides, has been reported in different countries, indeed recently, e.g., in surface water samples [24], and sediments [25]. In Portugal, several studies about the presence of these priority pesticides, resulting from the different sources, were reported in food [26,27], soils [28], sediments [29,30,31,32], marine samples [33], rivers waters [34,35,36,37,38], and Small Public Water Supply Systems [39]. Despite the resulting contamination from the last decades, there are only a few studies on the quantification and monitoring of known and suspected EDPs in Portuguese surface water samples.
The present study aimed to: (i) Select sampling sites focus on areas considered susceptible to be contaminated, namely, with intense urbanization, agricultural and industrial sites; (ii) develop an SPME coupled with GC–IT/MS for analyzing known and suspected EDPs in surface waters; (iii) apply the methodology in twenty surface water samples located in the north and center of Portugal; (iv) assess the river samples quality for twenty pesticides (OCs, OPs, dicarboximide, and PYR).

2. Materials and Methods

2.1. Reagents, Solvents, and Materials

The pesticide characteristics (e.g., chemistry groups, company supplier, chemical structure, and molar mass) are presented in Table S1 (Supplementary Material). Methanol was supplied by Sigma Aldrich (Steinheim, Germany), and n-hexane was purchased from Merck (Darmstadt, Germany). Both solvents with purity over 99%. Glacial acetic acid was obtained from Carlo Erba (Val de Reuil, France), and sodium hydroxide p.a. grade was purchased from Pronolab (Saint Paul, MN, USA). Individual stock solutions of each standard (α-, β-HCHs, lindane, HCB, o,p’-DDT, p,p’-DDE, p,p’-DDD, aldrin, dieldrin, endrin, α-and β-endosulfan, methoxychlor, bifenthrin, cypermethrin, deltamethrin, diazinon, fenvalerate, iprodione, and vinclozolin) were prepared in n-hexane in the 100 µg/L concentration and stored at −18 °C. The work standard mixture containing the twenty pesticides was prepared by dilution in n-hexane of the stock solutions up to a concentration of 5 µg/L.
Ultrapure water (resistivity of 18.2 MΩ.cm) was produced using a Simplicity 185 system (Millipore, Molsheim, France). All weight measurements were done on an analytical balance, Metter Toledo (Columbus, OH, USA), and the pH adjustment was measured in a GLP 22 pH meter supplied by Crison (Barcelona, Spain).

2.2. Site Selection and Sampling

Twenty spot samples from ten rivers (Douro, Cávado, Lima, Minho, Sousa, Tâmega, Leça, Cabrum, Caima, and Ave), one lagoon (Ria de Aveiro), and one stream (Moscoso) located in the north and center of Portugal were collected from 20 different sampling points. A global position system (GPS) was used to locate the sampling points (Figure 1). Samples were collected in precleaned amber glass bottles (250 mL), previously rinsed several times with the surface water, acidified with glacial acetic acid (1%, v/v) immediately after collection, and stored at 4 °C. Samples were processed in 24 h. The samples were collected during the spring (April) and summer (June) seasons.

2.3. Description of the Surface Water Samples (Rivers, Lagoon, and Stream)

The Douro is one of the longest rivers in the Iberian Peninsula, sharing its 930 km with Spain and Portugal [40]. The Douro River samples were representative of an urban area. Sousa, Cabrum, and Tâmega Rivers are tributaries of Douro River. The Leça River has its estuary near the port of Leixões. Chemical and bacteriological quality data led to classify the Leça River water quality as “bad” or “very bad” [41]. The Leça River is from the urban and industrial areas. The Minho River extends over 300 km in a southwest direction in the northwest corner of the Iberian Peninsula. Its terminal 70 km constitutes the natural border between Portugal and Spain, including the main estuarine axis of approximately 40 km (upstream limit of springtides) [42,43]. The Lima River estuary is an urban-industrialized estuary; the input of agricultural runoff impacts this system and urban and industrial sewage, which discharges nutrients and other substances that are transported from domestic, industrial, and agricultural areas into the estuarine area [44]. The Cávado River is in north Portugal. It runs 135 km from Gouveia to its mouth next to the city of Esposende. The Ave River basin is in a very populated region of the country. River water is intensively used for agricultural and industrial purposes, namely, textile industries [45]. Ria de Aveiro coastal lagoon is an estuarine system on the northwest coast of Portugal [46]. It is a shallow system that occupies an area of 43 km2 at low tide. The Moscoso Stream and Caima River are tributaries from Ria de Aveiro estuarine zone. The Caima River drains a catchment area of about 196 km2, in the north-center region of Portugal [47]. These samples were from the urban, agricultural, and industrial areas.

2.4. Extraction Procedure

2.4.1. Conditioning and Cleaning Procedure

The SPME (100 µm Polydimethylsiloxane (PDMS) fiber) procedure was performed with a manual fiber holder assembly supplied by Supelco (Darmstadt, Germany). A magnetic stirring and heater unit (AGIMATIC-N, Mundilab) was used during the SPME procedure. According to factory recommendations, the PDMS fiber used in the present study was conditioned at 250 °C in a current of helium for one hour in the GC-MS injector (Supelco ®). Routinely, the conditioning was achieved by exposing the fibers to the injector port at 260 °C for 30 min before use. Fiber blanks were performed to ensure that no interferences from the fibers were present in GC chromatograms. After thermic desorption of the analytes in the GC, the fiber remained in the injector for several minutes for further cleaning at a high temperature. The liner in GC-MS was also replaced and cleaned every week to prevent the accumulation of analytes, and thus, unwanted peaks in the chromatograms.

2.4.2. Sample Enrichment

Standard water samples were prepared by spiking ultrapure water with a mixture of pesticides (5000 ng/L of the twenty pesticides) to validate the SPME step. Atrazine D-5 was used as an internal standard at 5000 ng/L. The comparison between studies with ultrapure water and a surface water sample (residue-free) was conducted to evaluate the SPME efficiency.

2.4.3. Optimization of the SPME Process

Before the sample’s analysis, the optimization of the SPME process was carried out. Variables affecting the process of adsorption to the fiber and the extraction, namely, ionic strength (0, 0.05, 0.1 and 0.2% of NaCl), desorption temperature (250, 260 and 270 °C), organic solvent (0, 2.5, 5.0 and 7.5% methanol), extraction time (15, 30, 45 and 60 min) and extraction temperature (20 °C, 38 °C and 60 °C) were evaluated.

2.5. Gas Chromatography

Gas chromatograph-ion trap mass spectrometer (Thermo Trace-Ultra GC from Thermo Fisher Scientific (Waltham, MA, USA)) equipped with a fused-silica capillary column ZB-XLB (30 m × 0.25 mm ID, 0.25 µm film thickness, Phenomenex) was used for the separation of the study pesticides, using helium 99.99% as carrier gas at a 1.3 mL/min flow rate. Injector mode was split/spitless injector in the split mode (split/ratio 10) at 260 °C during the chromatographic run. The oven temperature was as followed: Initial oven temperature was held at 60 °C for 1 min, programmed with a gradient of 20 °C/min up to 200 °C where it stays for 1 min and then an increase of 5 °C/min up to 245 °C where it stays for 32 min. The mass detector conditions were: Transfer line temperature 250 °C, ion source temperature 250 °C, and ionization mode electron impact at 70 eV. The retention times were determined in the full scan mode and validation study in the selected ion monitoring (SIM) mode. In SIM mode, the main ions (Q1, Q2, and Q3) were selected for each analyte (Table 1). A matrix-matched calibration curve (using a residue-free surface water sample) was performed using nine concentration levels (10, 50, 100, 500, 1000, 1500, 2000, 2500, and 3000 ng/L). The addition of the IS, atrazine D-5, was performed at 1000 ng/L. The limits of detection (LOD) and quantification (LOQ) of the method were evaluated considering a signal-to-noise ratio of 3 and 10, respectively. Each concentration was measured twice. Precision was evaluated by calculating the relative standard deviation (RSD) from 3 replicates.

3. Results and Discussion

3.1. Optimization of the SPME Procedure

3.1.1. Ionic Strength Adjustments

The effect of the amount of salt influenced the extraction efficiency of some analytes present in water samples. All the chemical families presented a good performance without the use of NaCl (Figure 2A). A few compounds (HCH isomers and diazinon) showed higher areas with the addition of 0.2% NaCl. This may be related to the increase in the ionic strength of the matrix and consequently decreases the solubility of these compounds in water. However, the results showed that the salt aggregate does not help in most of the studied compounds.

3.1.2. Desorption Temperature

Figure 2B showed the best results for the complete desorption of most pesticides with the desorption temperature at 260 °C. Bifenthrin and iprodione presented complete desorption with a temperature of 250 °C.

3.1.3. Organic Solvent

The effect of organic solvent was evaluated, and the addition of 2.5% methanol improved the extraction efficiency of the target compounds. The effect of this parameter is well demonstrated in Figure 2C.

3.1.4. Extraction Temperature and Time

In terms of extraction time, the results showed that as the time increased up to 45 min, the extraction efficiency improved. However, for longer times (60 min), the performance of the methodology decreased (Figure 2D,E). The results obtained for the extraction temperature study showed similar behavior to the extraction time. As the temperature was increased, better areas were obtained. Only the dicarboximide pesticides had an opposite behavior at 60 °C.
The best conditions were selected, and the extractions were performed in glass vials by immersing the SPME fiber (PDMS) in 10 mL of water sample with 2.5% methanol, pH 3.5, and placed in the stir plate (700 rpm) for 45 min at 60 °C. Finally, the desorption temperature selected was 260 °C.

3.2. Method Validation

After the optimization of the methodology, the validation study was performed. The proposed method measured different families of pesticides (OCs, PYR, OPs, and dicarboximide). Also, the methodology showed good performance, and the analytical parameters obtained at optimized conditions were calculated and presented in Table 2. Good linear regressions (R2 ≥ 0.9904 in all cases) were obtained over the tested analytical range. The method achieved LODs and LOQs between 0.2–150 ng/L and 0.6–450 ng/L, respectively. The precision was evaluated, and the relative standard deviation (RSD) was lower than 15% is acceptable for all the studied analytes. The validation parameters obtained are in the same order as those reported for other authors applying SPME [19].

3.3. Monitoring of 20 Known or Suspected Endocrine-Disrupting Pesticides in Portuguese Surface Water Samples

The national and international authorities and the scientific community have shown interest and concern on the topic of water pollution and its adverse implications for humans and the ecosystem.
The literature has recently reported the presence of several priority pesticides, most of them classified as EDPs in aquatic environments [24,34,35,36,38,48,49]. Table 3 summarizes the results obtained in the present study with 20 surface water samples in terms of frequency of detection, minimum, maximum, and mean values detected. As the values obtained are different in terms of range, the graphs below show the data distribution by samples and each compound. All the data, including the value below LOQ (estimated by the analytical value), were counted for the data analysis.
Regarding the 20 spot surface water samples, only the diazinon and iprodione were not detected in the analyzed samples. The α- and β-endosulfan were the most detected EDPs (75%), and the methoxychlor (5%) and deltamethrin (5%) were the least detected. Although the samples were collected in different seasons, no significant differences were observed. Even so, pyrethroids were more detected in the summer samples.

3.3.1. Organochlorine Pesticides in Surface Water Samples

Several decades after the OCs were banned, they are frequently detected in different environmental samples, due to their persistence and bioaccumulation. These compounds are in continuous movement between the different environmental compartments, such as water, soil, sediments, air, and/or bioconcentrate, in the living organisms [50]. Figure 3 shows a plot with the concentrations detected of each OCs by sample. The values.
The highest individual mean value was found for HCHs isomers in the Douro River (Mean ∑HCH = 2150 ng/L) and Cávado River (Mean ∑HCH = 350 ng/L). Indeed, the cumulative values were always above the maximum allowable concentration-Environmental Quality Standards (MAC-EQS) established by the Directive 98/83/EC and 2013/39/EU [15,16]. HCHs isomers were also detected in the Minho and Sousa Rivers, but below the quantification limit (<LOQ). The organochlorine compound, HCB, presented concentrations 18.2-fold above the MAC-EQS (50 ng/L) in the Cávado River (760 ng/L) and Sousa River (910 ng/L) (Figure 3). The presence of HCB in other samples was quantified below the MAC-EQS (Rivers: Douro (20 μg/L), Minho (10 μg/L), Tâmega (10 ng/L), Leça (20 and 2 ng/L), Caima (20 ng/L); Lagoon: Ria Aveiro (10 ng/L)). Endrin was detected above the average annual amounts allowed for surface waters (AA-EQS = Σ 0.05), in three rivers (Douro (430 ng/L), Leça (271 ng/L), and Caima (132 ng/L), and one lagoon (ria Aveiro (342 ng/L)) samples. The other cyclodiene pesticide, aldrin, was detected below the AA-EQS in the three rivers (Sousa (32 ng/L), Cabrum (10 ng/L), Ave (22 ng/L)), and one stream (Moscoso (12 ng/L). The same behavior was observed with DDT isomers (∑ p, p′-DDT + p, p′-DDE + p, p′-DDD) pesticides analyzed in this work. The sum of the concentration in rivers (Douro (∑ = 130 ng/L), Cávado (∑ = 53 ng/L), Lima (∑ = 50 ng/L), Minho (∑ = 54 ng/L), Sousa (∑ = 62 ng/L), and Tâmega (∑ = 90 ng/L)) achieved amounts above the AA-EQS (∑= 0.025 μg/L). The endosulfan isomers studied were (α, β), and the MAC-EQS = 0.01 was considered for endosulfan. All rivers, except the Lima River, showed the presence of endosulfan isomers. Finally, methoxychlor was observed at a concentration of 33 ng/L in the Tâmega River. In general, the rivers with the greatest OCs contamination were the Douro, Cávado, and the Sousa Rivers, as shown in Figure 3. Values above MAC-EQS were found in the seven river samples. Figure 4 presents the chromatogram obtained from the Douro and Cávado Rivers samples, demonstrating the confirmation by GC-MS of the presence of OCs.
Comparing present data with Cruzeiro et al., [37] in Portuguese surface water samples, the 4,4′-DDT and 4,4′-DDD were detected in 100% of samples analyzed (N = 20), while in the present work, it was 40%. Indeed, the values obtained were above the restrictive European legislation (98/83/EC and 2013/39/EU). The same compound, 4,4’-DDT was quantified in another Portuguese study in concentrations 21.5 fold above the maximum (10 ng/L) level acceptable for inland and surface waters [38]. Although these authors reported HCB levels below its method quantification limit, the opposite occurred in the present work, where these values exceeded the LOQ. In 2017, 4,4′-DDT and HCB were also detected in the Douro River estuary, in 8 and 19 samples, respectively, over 2013739/EU levels [35]. Some studies reported pollution by these OCs in other samples in Portugal, such as, sediments samples from the Douro River [30,49,51] fruits [26], soil [28,52], and human samples [53]. This study contributes to the continuous evaluation of these compounds and emphasizes the relevance of continuous monitoring studies. Even though the usage of OCs was banned in Portugal, the recorded levels can be a consequence of their persistence or their misuse or illegal use. However, with this work, we can say that its incidence seems to be decreasing, at least for DDT.

3.3.2. Pyrethroids and Dicarboximide Pesticides in Portuguese Surface Water Samples

In this study, two PYR (cypermethrin and fenvalerate) and one dicarboximide pesticides (vinclozolin) were detected. Figure 5 shows a plot with the mean concentration in ng/L reported by the sample. Cypermethrin was the most frequently detected, and the Cávado, Cabrum, and Minho Rivers presented higher values. Nevertheless, all the surface water samples showed concentration values above the admissible amounts MAC-EQS. Fenvalerate was detected only in two samples (Cávado and Lima Rivers) at levels of 290 and 100 ng/L, respectively.
Regarding other studies conducted in Portugal [38], our levels of cypermethrin were slightly lower (350 ng/L) in terms of environmental levels, compared with a concentration of 453 ng/L obtained in Ria Formosa lagoon in summer samples. The authors discussed the evidence that the higher concentration presented in samples from the summer period is related to the application of pesticides. In a study conducted in 2017 in the Douro River samples [35], nine samples (in a total of 24 sampling sites) presented concentrations over the limits established by EU, and an average concentration for cypermethrin of 35.9 ng/L. This study has already shown lower values than those detected in samples from the Douro River (230 ng/L) in the present study. The vinclozolin and iprodione were evaluated in the current work, but only vinclozolin was detected.
Although there is no legislation for this pesticide in surface waters, it was quantified in nine samples: The Douro River (41 ng/L, the Minho River (30 ng/L), the Tâmega River (33 ng/L), Ria Aveiro (32 μg/L), the Cabrum river (51 ng/L), the Moscoso Stream (25 ng/L), the Caima River (64 ng/L), and the Ave River (26 ng/L)). The vinclozolin is a fungicide frequently used to control diseases in vineyards [54]. The vineyards in the north region of Portugal are in the hills on the banks of the rivers. The use of this pesticide in agriculture systems may be one of the reasons for the frequent detection.

4. Conclusions

The proposed analytical method, SPME-GC-IT/MS, was firstly optimized for the simultaneous determination of 20 priority pesticides. In terms of analytical validation, the methodology showed good performance and fulfilled the requirements according to European analytical standards to determine the target compounds in water samples. We can conclude that this work stood out for the diversity of sampling sites in Portugal, despite being spot samples. In addition, the surface water samples from several sampling sites from the north end center of Portugal presented known and potential EDPs, with many of them above the established MAC-EQS. The following pesticides were detected in order of decreasing frequency of detection: α- and β-endosulfan (75%) > cypermethrin (55%)> HCB, aldrin, dieldrin, endrin, and vinclozolin (45%) > p,p′-DDE + o,p′-DDT + p,p′-DDD (40%) > HCH isomers (30%), > fenvalerate (10%) > methoxychlor and deltamethrin (5%).
The persistence of OCs was again proven, as well as the presence of other pesticides. Despite the legislation established for these samples, this work also concluded that it is still insufficient when the presence of other non-legislated compounds was confirmed.
This study reinforces the data regarding the presence of priority pesticides in the environment and concluded that detected levels are still alarming. The monitoring and control of pesticides in rivers are an important issue that should continue to be explored in many areas and countries, and although the SPME performs well, more automated extraction methods should be explored to decrease the time and the cost of the monitoring analysis.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/separations8060081/s1, Table S1: List of endocrine-disruptor compounds and their chemistry groups, company supplier, chemical structure, chemical formula, and molar mass.

Author Contributions

All of the authors contributed significantly to the research. Conceptualization, J.V., V.C.F., V.F.D. and C.D.-M.; Formal Analysis, J.V., V.F.D. and V.C.F.; Methodology, J.V., L.C.-S., V.C.F., C.M. and V.F.D.; Investigation, J.V., L.C.-S., V.C.F. and V.F.D.; Resources C.M., C.D.-M. and V.F.D.; Writing—Original Draft Preparation, V.C.F. and J.V.; Writing—Review & Editing, V.C.F., V.F.D. and C.D.-M.; Visualization, V.C.F., V.F.D. and C.D.-M.; Supervision, V.F.D. and C.D.-M.; Funding Acquisition, C.D.-M. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by UID/QUI/50006/2019, UIDB/50006/2020 and UIDP/50006/2020 by the Fundação para a Ciência e a Tecnologia (FCT)/Ministério da Ciência, Tecnologia e Ensino Superior (MCTES) through national funds. Virgínia Cruz Fernandes thanks FCT (Fundação para a Ciência e Tecnologia) and ESF (European Social Fund) through POCH (Programa Operacional Capital Humano) for her PostDoc grant ref. SFRH/BPD/109153/2015. José Vera thanks Erasmus Mundus Program for the Ph.D. grant.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lauretta, R.; Sansone, A.; Sansone, M.; Romanelli, F.; Appetecchia, M. Endocrine Disrupting Chemicals: Effects on Endocrine Glands. Front. Endocrinol. 2019, 10, 178. [Google Scholar] [CrossRef] [Green Version]
  2. Kassotis, C.D.; Vandenberg, L.N.; Demeneix, B.A.; Porta, M.; Slama, R.; Trasande, L. Endocrine-disrupting chemicals: Economic, regulatory, and policy implications. Lancet Diabetes Endocrinol. 2020, 8, 719–730. [Google Scholar] [CrossRef]
  3. Özkara, A.; Akyil, D.; Konuk, M. Pesticides, Environmental Pollution, and Health; InTech: London, UK, 2016. [Google Scholar]
  4. Kabir, E.R.; Rahman, M.S.; Rahman, I. A review on endocrine disruptors and their possible impacts on human health. Environ. Toxicol. Pharmacol. 2015, 40, 241–258. [Google Scholar] [CrossRef] [PubMed]
  5. Pereira, L.C.; de Souza, A.O.; Bernardes, M.F.F.; Pazin, M.; Tasso, M.J.; Pereira, P.H.; Dorta, D.J. A perspective on the potential risks of emerging contaminants to human and environmental health. Environ. Sci. Pollut. Res. 2015, 22, 13800–13823. [Google Scholar] [CrossRef] [PubMed]
  6. Kasonga, T.K.; Coetzee, M.A.A.; Kamika, I.; Ngole-Jeme, V.M.; Benteke Momba, M.N. Endocrine-disruptive chemicals as contaminants of emerging concern in wastewater and surface water: A review. J. Environ. Manag. 2021, 277, 111485. [Google Scholar] [CrossRef] [PubMed]
  7. Jayaraj, R.; Megha, P.; Sreedev, P. Review Article. Organochlorine pesticides, their toxic effects on living organisms and their fate in the environment. Interdiscip. Toxicol. 2016, 9, 90–100. [Google Scholar] [CrossRef] [Green Version]
  8. Chrustek, A.; Hołyńska-Iwan, I.; Dziembowska, I.; Bogusiewicz, J.; Wróblewski, M.; Cwynar, A.; Olszewska-Słonina, D. Current Research on the Safety of Pyrethroids Used as Insecticides. Medicina 2018, 54, 61. [Google Scholar] [CrossRef] [Green Version]
  9. Lushchak, V.I.; Matviishyn, T.M.; Husak, V.V.; Storey, J.M.; Storey, K.B. Pesticide toxicity: A mechanistic approach. EXCLI J. 2018, 17, 1101–1136. [Google Scholar] [CrossRef]
  10. Sagiv, S.K.; Bruno, J.L.; Baker, J.M.; Palzes, V.; Kogut, K.; Rauch, S.; Gunier, R.; Mora, A.M.; Reiss, A.L.; Eskenazi, B. Prenatal exposure to organophosphate pesticides and functional neuroimaging in adolescents living in proximity to pesticide application. Proc. Natl. Acad. Sci. USA 2019, 116, 18347. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Brander, S.M.; Gabler, M.K.; Fowler, N.L.; Connon, R.E.; Schlenk, D. Pyrethroid pesticides as endocrine disruptors: Molecular mechanisms in vertebrates with a focus on fishes. Environ. Sci. Technol. 2016, 50, 8977–8992. [Google Scholar] [CrossRef] [PubMed]
  12. Nasuti, C.; Carloni, M.; Fedeli, D.; Gabbianelli, R.; Di Stefano, A.; Serafina, C.L.; Silva, I.; Domingues, V.; Ciccocioppo, R. Effects of early life permethrin exposure on spatial working memory and on monoamine levels in different brain areas of pre-senescent rats. Toxicology 2013, 303, 162–168. [Google Scholar] [CrossRef] [Green Version]
  13. Yang, C.; Lim, W.; Song, G. Mediation of oxidative stress toxicity induced by pyrethroid pesticides in fish. Comp. Biochem. Physiol. Part. C Toxicol. Pharmacol. 2020, 234, 108758. [Google Scholar] [CrossRef]
  14. Hecker, M.; Hollert, H. Endocrine Disruptor Screening: Regulatory Perspectives and Needs. Environ. Sci. Eur. 2011, 23, 15. [Google Scholar] [CrossRef] [Green Version]
  15. European Union. Directive 2013/39/EU of the European Parliament and of the Council. Off. J. Eur. Union 2013, 1–17. [Google Scholar]
  16. European Union. Council Directive 98/83/EC of 3 November 1998 on the quality of water intended for human consumption. Off. J. 1998, 32–54. [Google Scholar]
  17. Ouyang, G.; Pawliszyn, J. SPME in environmental analysis. Anal. Bioanal. Chem. 2006, 386, 1059–1073. [Google Scholar] [CrossRef] [PubMed]
  18. Albaseer, S.S.; Nageswara Rao, R.; Swamy, Y.V.; Mukkanti, K. An overview of sample preparation and extraction of synthetic pyrethroids from water, sediment and soil. J. Chromatogr. A 2010, 1217, 5537–5554. [Google Scholar] [CrossRef] [PubMed]
  19. Merkle, S.; Kleeberg, K.; Fritsche, J. Recent Developments and Applications of Solid Phase Microextraction (SPME) in Food and Environmental Analysis—A Review. Chromatography 2015, 2, 293–381. [Google Scholar] [CrossRef] [Green Version]
  20. Locatelli, M.; Sciascia, F.; Cifelli, R.; Malatesta, L.; Bruni, P.; Croce, F. Analytical methods for the endocrine disruptor compounds determination in environmental water samples. J. Chromatogr. A 2016, 1434, 1–18. [Google Scholar] [CrossRef]
  21. Alam, M.N.; Pawliszyn, J. Effect of Binding Components in Complex Sample Matrices on Recovery in Direct Immersion Solid-Phase Microextraction: Friends or Foe? Anal. Chem. 2018, 90, 2430–2433. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Filho, A.M.; dos Santos, F.N.; Pereira, P.A.d.P. Development, validation and application of a method based on DI-SPME and GC–MS for determination of pesticides of different chemical groups in surface and groundwater samples. Microchem. J. 2010, 96, 139–145. [Google Scholar] [CrossRef]
  23. Jabali, Y.; Millet, M.; El-Hoz, M. Optimization of a DI-SPME-GC–MS/MS method for multi-residue analysis of pesticides in waters. Microchem. J. 2019, 147, 83–92. [Google Scholar] [CrossRef]
  24. Olisah, C.; Adeniji, A.O.; Okoh, O.O.; Okoh, A.I. Occurrence and risk evaluation of organochlorine contaminants in surface water along the course of Swartkops and Sundays River Estuaries, Eastern Cape Province, South Africa. Environ. Geochem. Health 2019, 41, 2777–2801. [Google Scholar] [CrossRef] [PubMed]
  25. Hashmi, T.A.; Qureshi, R.; Tipre, D.; Menon, S. Investigation of pesticide residues in water, sediments and fish samples from Tapi River, India as a case study and its forensic significance. Environ. Forensics 2020, 21, 1–10. [Google Scholar] [CrossRef]
  26. Fernandes, V.C.; Domingues, V.F.; Mateus, N.; Delerue-Matos, C. Organochlorine Pesticide Residues in Strawberries from Integrated Pest Management and Organic Farming. J. Agric. Food Chem. 2011, 59, 7582–7591. [Google Scholar] [CrossRef] [Green Version]
  27. Álvarez-Muñoz, D.; Rodríguez-Mozaz, S.; Jacobs, S.; Serra-Compte, A.; Cáceres, N.; Sioen, I.; Verbeke, W.; Barbosa, V.; Ferrari, F.; Fernández-Tejedor, M.; et al. Pharmaceuticals and endocrine disruptors in raw and cooked seafood from European market: Concentrations and human exposure levels. Environ. Int. 2018, 119, 570–581. [Google Scholar] [CrossRef]
  28. Correia-Sá, L.; Fernandes, V.C.; Carvalho, M.; Calhau, C.; Domingues, V.F.; Delerue-Matos, C. Optimization of QuEChERS method for the analysis of organochlorine pesticides in soils with diverse organic matter. J. Sep. Sci. 2012, 35, 1521–1530. [Google Scholar] [CrossRef] [PubMed]
  29. Rodrigues, C.; Bio, A.; Guimarães, L.; Fernandes, V.C.; Delerue-Matos, C.; Vieira, N. Assessing the ecological status of fluvial ecosystems employing a macroinvertebrate multi-taxon and multi-biomarker approach. Environ. Monit. Assess. 2019, 191, 503. [Google Scholar] [CrossRef]
  30. Carvalho, P.N.; Rodrigues, P.N.R.; Basto, M.C.P.; Vasconcelos, M.T.S.D. Organochlorine pesticides levels in Portuguese coastal areas. Chemosphere 2009, 75, 595–600. [Google Scholar] [CrossRef]
  31. Rodrigues, E.T.; Alpendurada, M.F.; Guimarães, A.; Avó, R.; Ferreira, B.; Pardal, M.A. The environmental condition of an estuarine ecosystem disturbed by pesticides. Environ. Sci. Pollut. Res. 2019, 26, 24075–24087. [Google Scholar] [CrossRef]
  32. Pinto, M.I.; Burrows, H.D.; Sontag, G.; Vale, C.; Noronha, J.P. Priority pesticides in sediments of European coastal lagoons: A review. Mar. Pollut. Bull. 2016, 112, 6–16. [Google Scholar] [CrossRef]
  33. Álvarez-Muñoz, D.; Rodríguez-Mozaz, S.; Maulvault, A.L.; Tediosi, A.; Fernández-Tejedor, M.; van den Heuvel, F.; Kotterman, M.; Marques, A.; Barceló, D. Occurrence of pharmaceuticals and endocrine disrupting compounds in macroalgaes, bivalves, and fish from coastal areas in Europe. Environ. Res. 2015, 143, 56–64. [Google Scholar] [CrossRef]
  34. Silva, E.; Daam, M.A.; Cerejeira, M.J. Aquatic risk assessment of priority and other river basin specific pesticides in surface waters of Mediterranean river basins. Chemosphere 2015, 135, 394–402. [Google Scholar] [CrossRef]
  35. Cruzeiro, C.; Amaral, S.; Rocha, E.; Rocha, M.J. Determination of 54 pesticides in waters of the Iberian Douro River estuary and risk assessment of environmentally relevant mixtures using theoretical approaches and Artemia salina and Daphnia magna bioassays. Ecotoxicol. Environ. Saf. 2017, 145, 126–134. [Google Scholar] [CrossRef]
  36. Sousa, J.C.G.; Ribeiro, A.R.; Barbosa, M.O.; Ribeiro, C.; Tiritan, M.E.; Pereira, M.F.R.; Silva, A.M.T. Monitoring of the 17 EU Watch List contaminants of emerging concern in the Ave and the Sousa Rivers. Sci. Total Environ. 2019, 649, 1083–1095. [Google Scholar] [CrossRef] [PubMed]
  37. Cruzeiro, C.; Pardal, M.; Rocha, E.; Rocha, M.J. Occurrence and seasonal loads of pesticides in surface water and suspended particulate matter from a wetland of worldwide interest—The Ria Formosa Lagoon, Portugal. Environ. Monit. Assess. 2015, 187, 669. [Google Scholar] [CrossRef]
  38. Cruzeiro, C.; Rocha, E.; Pardal, M.Â.; Rocha, M.J. Uncovering seasonal patterns of 56 pesticides in surface coastal waters of the Ria Formosa lagoon (Portugal), using a GC-MS method. Int. J. Environ. Anal. Chem. 2015, 95, 1370–1384. [Google Scholar] [CrossRef]
  39. Mansilha, C.; Melo, A.; Ferreira, I.M.P.L.V.O.; Pinho, O.; Domingues, V.; Pinho, C.; Gameiro, P. Groundwater from Infiltration Galleries Used for Small Public Water Supply Systems: Contamination with Pesticides and Endocrine Disruptors. Bull. Environ. Contam. Toxicol. 2011, 87, 312–318. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Vieira, M.E.C.; Bordalo, A.A. The Douro estuary (Portugal): A mesotidal salt wedge. Oceanol. Acta 2000, 23, 585–594. [Google Scholar] [CrossRef] [Green Version]
  41. Gomes, A.I.; Pires, J.C.M.; Figueiredo, S.A.; Boaventura, R.A.R. Optimization of River Water Quality Surveys by Multivariate Analysis of Physicochemical, Bacteriological and Ecotoxicological Data. Water Resour. Manag. 2014, 28, 1345–1361. [Google Scholar] [CrossRef] [Green Version]
  42. Costa-Dias, S.; Freitas, V.; Sousa, R.; Antunes, C. Factors influencing epibenthic assemblages in the Minho Estuary (NW Iberian Peninsula). Mar. Pollut. Bull. 2010, 61, 240–246. [Google Scholar] [CrossRef] [PubMed]
  43. Santos, S.; Vilar, V.J.P.; Alves, P.; Boaventura, R.A.R.; Botelho, C. Water quality in Minho/Miño River (Portugal/Spain). Environ. Monit. Assess. 2013, 185, 3269–3281. [Google Scholar] [CrossRef] [PubMed]
  44. Almeida, C.M.R.; Mucha, A.P.; Teresa Vasconcelos, M. Role of different salt marsh plants on metal retention in an urban estuary (Lima estuary, NW Portugal). Estuar. Coast. Shelf Sci. 2011, 91, 243–249. [Google Scholar] [CrossRef]
  45. Alves, C.M.; Boaventura, R.R.A.R.; Soares, H.M.V.M. Evaluation of heavy metals pollution loadings in the sediments of the Ave river basin (Portugal). Soil Sediment. Contam. 2009, 18, 603–618. [Google Scholar] [CrossRef]
  46. Pato, P.; Lopes, C.; Válega, M.; Lillebø, A.I.; Dias, J.M.; Pereira, E.; Duarte, A.C. Mercury fluxes between an impacted coastal lagoon and the Atlantic Ocean. Estuar. Coast. Shelf Sci. 2008, 76, 787–796. [Google Scholar] [CrossRef]
  47. Nunes, M.L.; Ferreira Da Silva, E.; de Almeida, S.F.P. Assessment of water quality in the Caima and Mau River basins (Portugal) using geochemical and biological Indices. Water Air Soil Pollut. 2003, 149, 227–250. [Google Scholar] [CrossRef]
  48. Cruzeiro, C.; Rocha, E.; Pardal, M.Â.; Rocha, M.J. Environmental assessment of pesticides in the Mondego River Estuary (Portugal). Mar. Pollut. Bull. 2016, 103, 240–246. [Google Scholar] [CrossRef]
  49. Waszak, I.; Dabrowska, H.; Komar-Szymczak, K. Comparison of common persistent organic pollutants (POPs) in flounder (Platichthys flesus) from the Vistula (Poland) and Douro (Portugal) River estuaries. Mar. Pollut. Bull. 2014, 81, 225–233. [Google Scholar] [CrossRef]
  50. Yang, D.; Qi, S.; Zhang, J.; Wu, C.; Xing, X. Organochlorine pesticides in soil, water and sediment along the Jinjiang River mainstream to Quanzhou Bay, southeast China. Ecotoxicol. Environ. Saf. 2013, 89, 59–65. [Google Scholar] [CrossRef] [PubMed]
  51. Villaverde, J.; Hildebrandt, A.; Martínez, E.; Lacorte, S.; Morillo, E.; Maqueda, C.; Viana, P.; Barceló, D. Priority pesticides and their degradation products in river sediments from Portugal. Sci. Total Environ. 2008, 390, 507–513. [Google Scholar] [CrossRef]
  52. Fernandes, V.C.; Lehotay, S.J.; Geis-Asteggiante, L.; Kwon, H.; Mol, H.G.; van der Kamp, H.; Mateus, N.; Domingues, V.F.; Delerue-Matos, C. Analysis of pesticide residues in strawberries and soils by GC-MS/MS, LC-MS/MS and two-dimensional GC-time-of-flight MS comparing organic and integrated pest management farming. Food Addit. Contam. Part A Chem. Anal. Control. Expo. Risk Assess. 2014, 31, 262–270. [Google Scholar] [CrossRef] [Green Version]
  53. Pestana, D.; Fernandes, V.; Faria, G.; Sa, C.; Meireles, M.; Monteiro, R.; Domingues, V.; Calhau, C. Persistent organic pollutant (POPs) levels in human visceral and subcutaneous adipose tissue on an obese Portuguese population-Metabolic improvement after bariatric surgery versus POPs burden. Toxicol. Lett. 2011, 205, S75–S76. [Google Scholar] [CrossRef]
  54. Martins, J.; Esteves, C.; Limpo-Faria, A.; Barros, P.; Ribeiro, N.; Simões, T.; Correia, M.; Delerue-Matos, C. Analysis of six fungicides and one acaricide in still and fortified wines using solid-phase microextraction-gas chromatography/tandem mass spectrometry. Food Chem. 2012, 132, 630–636. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Schematic localization of the twenty sampling points of the surface water samples collected.
Figure 1. Schematic localization of the twenty sampling points of the surface water samples collected.
Separations 08 00081 g001
Figure 2. Plot of the areas from each pesticide with: (A) The addiction of NaCl at 0.00%, 0.05%, 0.10%, and 0.20%; (B) desorption temperature at 250 °C, 260 °C, and 270 °C; (C) the use of organic solvent (MEOH) at 0%, 2.5%, 5.0% and 7.5%; (D) extraction time of 15 min, 30 min, 45 min, and 60 min; (E) extraction temperature of 20 °C, 40 °C and 60 °C.
Figure 2. Plot of the areas from each pesticide with: (A) The addiction of NaCl at 0.00%, 0.05%, 0.10%, and 0.20%; (B) desorption temperature at 250 °C, 260 °C, and 270 °C; (C) the use of organic solvent (MEOH) at 0%, 2.5%, 5.0% and 7.5%; (D) extraction time of 15 min, 30 min, 45 min, and 60 min; (E) extraction temperature of 20 °C, 40 °C and 60 °C.
Separations 08 00081 g002aSeparations 08 00081 g002b
Figure 3. Concentration in ng/L of OCs detected in the 20 surface water samples.
Figure 3. Concentration in ng/L of OCs detected in the 20 surface water samples.
Separations 08 00081 g003
Figure 4. GC-MS chromatograms were obtained in SIM mode and the MS spectrum confirming the detection of HCB and α-endosulfan in the Cávado and Douro Rivers, respectively.
Figure 4. GC-MS chromatograms were obtained in SIM mode and the MS spectrum confirming the detection of HCB and α-endosulfan in the Cávado and Douro Rivers, respectively.
Separations 08 00081 g004
Figure 5. Pyrethroids and dicarboximide pesticides were detected in the 20 surface water samples.
Figure 5. Pyrethroids and dicarboximide pesticides were detected in the 20 surface water samples.
Separations 08 00081 g005
Table 1. GC-IT/MS parameters for each study pesticide.
Table 1. GC-IT/MS parameters for each study pesticide.
Compounds *Time Retention
(min)
SIM Ions (Q1, Q2 and Q3)
(m/z)
GC Segment (min)
α-HCH9.66181, 219, 1098.50–9.90
HCB9.82284, 142, 2498.50–9.90
diazinon10.04179, 199, 3049.90–10.20
β-HCH10.36181, 219, 10910.20–11.20
lindane11.04181, 219, 10910.20–11.20
vinclozolin11.38212, 124, 18711.20–11.85
aldrin12.47263, 293, 6611.85–13.00
α-endosulfan14.89241, 195, 20914.10–15.00
p,p′-DDE15.54246, 176, 31815.00–16.00
dieldrin15.6879, 263, 27715.00–16.00
endrin16.35244, 263, 31716.00–17.00
o,p′-DDT16.74235, 165, 8116.00–17.00
p,p′-DDD17.21235, 165, 19917.00–18.00
β-endosulfan17.30195, 335, 33917.00–18.00
bifenthrin19.51165, 166, 14118.00–24.00
methoxychlor20.19227, 152, 16518.00–24.00
iprodione20.32187, 24418.00–24.00
cypermethrin31.72, 31.98, 32.44163, 181, 9124.00–35.00
fenvalerate38.59, 40.63125, 167, 41935.00–43.00
deltamethrin46.62181, 25343.00–50.00
* pesticides in the table organized by their retention time.
Table 2. Coefficient of determination, LOD, and LOQ, of 20 standard pesticides obtained by GC-MS method.
Table 2. Coefficient of determination, LOD, and LOQ, of 20 standard pesticides obtained by GC-MS method.
GroupsPesticidesCoefficient of DeterminationLOD ng/LLOQ ng/L
Organochlorinesα-HCH0.991225.075.0
β-HCH0.999160.0180.0
Lindane0.999175.0225.0
HCB0.99782.57.5
aldrin0.99832.47.2
dieldrin0.99760.72.1
endrin0.997812.036.0
p,p′-DDE0.99570.30.9
o,p′-DDT0.99041.85.4
p,p′-DDD0.99355.315.9
α-endosulfan0.99915.917.7
β-endosulfan0.99773.09.0
metoxyclhor0.99231.64.8
Pyrethroidsbifenthrin0.99257.021.0
cypermethrin0.997630.0900.0
fenvalerate0.99173.39.9
deltamethrin0.9939150.0450.0
Organophosphorusdiazinon0.99903.19.3
DicarboximideIprodione0.999027.391.0
vinclozolin0.99940.20.6
Table 3. A summary of the results obtained in the 20 samples.
Table 3. A summary of the results obtained in the 20 samples.
GroupCompoundsFrequency (%)Min ng/LMax ng/LMean ng/L
OrganochlorinesΣ(α-HCH + β-HCH + lindane)30<LOQ1800460
HCB45<LOQ912201
Σ(aldrin + dieldrin + endrin)4510430142
Σ(p,p′-DDE + o,p′-DDT + p,p′-DDD)40<LOQ7063
Σ(α-endosulfan + β-endosulfan)75<LOQ3011
methoxychlor5nd3131
Pyrethroidsbifenthrin10nd<LOQ-
cypermethrin55<LOQ351261
fenvalerate1010294150
deltamethrin5nd<LOQ-
Dicarboximidevinclozolin45206243
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Vera, J.; Fernandes, V.C.; Correia-Sá, L.; Mansilha, C.; Delerue-Matos, C.; Domingues, V.F. Occurrence of Selected Known or Suspected Endocrine-Disrupting Pesticides in Portuguese Surface Waters Using SPME-GC-IT/MS. Separations 2021, 8, 81. https://doi.org/10.3390/separations8060081

AMA Style

Vera J, Fernandes VC, Correia-Sá L, Mansilha C, Delerue-Matos C, Domingues VF. Occurrence of Selected Known or Suspected Endocrine-Disrupting Pesticides in Portuguese Surface Waters Using SPME-GC-IT/MS. Separations. 2021; 8(6):81. https://doi.org/10.3390/separations8060081

Chicago/Turabian Style

Vera, José, Virgínia Cruz Fernandes, Luísa Correia-Sá, Catarina Mansilha, Cristina Delerue-Matos, and Valentina F. Domingues. 2021. "Occurrence of Selected Known or Suspected Endocrine-Disrupting Pesticides in Portuguese Surface Waters Using SPME-GC-IT/MS" Separations 8, no. 6: 81. https://doi.org/10.3390/separations8060081

APA Style

Vera, J., Fernandes, V. C., Correia-Sá, L., Mansilha, C., Delerue-Matos, C., & Domingues, V. F. (2021). Occurrence of Selected Known or Suspected Endocrine-Disrupting Pesticides in Portuguese Surface Waters Using SPME-GC-IT/MS. Separations, 8(6), 81. https://doi.org/10.3390/separations8060081

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop