Next Article in Journal
Habitat Selection and Home Range of Reeves’ Turtle (Mauremys reevesii) in Qichun County, Hubei Province, China
Previous Article in Journal
Modeling Co-Infection by Streptococcus suis and Haemophilus parasuis Reveals Influences on Biofilm Formation and Host Response
Previous Article in Special Issue
Residue Depletion of Imidocarb in Bovine Tissues by UPLC-MS/MS
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Application of a Physiologically Based Pharmacokinetic Model for Diclazuril in Broiler Chickens

College of Animal Science and Technology, Henan University of Science and Technology, Luoyang 471023, China
*
Author to whom correspondence should be addressed.
Animals 2023, 13(9), 1512; https://doi.org/10.3390/ani13091512
Submission received: 26 March 2023 / Revised: 25 April 2023 / Accepted: 27 April 2023 / Published: 29 April 2023
(This article belongs to the Special Issue Protozoosis in Animals: Antiprotozoal Drugs and Pharmacokinetics)

Abstract

:

Simple Summary

Coccidiosis is a devastating poultry disease with significant economic implications. The prevention and control of coccidiosis currently rely on the administration of anticoccidial drugs through feed or water. One of the commonly used drugs is diclazuril, which was approved in broilers for their whole life. Additionally, its prolonged use can lead to residue accumulation in edible tissues. As a result, we developed and validated a physiologically based pharmacokinetic (PBPK) model for diclazuril to predict its residues in broilers. We identified and analyzed the key parameters associated with diclazuril concentrations in the muscle through Monte Carlo analysis. Our findings suggested that a withdrawal period of 0 days was suitable for both recommended dosing regimens. This model can be expanded to other coccidiostats and poultry species as a critical resource.

Abstract

Withdrawal periods for diclazuril in broilers have traditionally been determined through regression analysis. However, over the last two decades, the physiologically based pharmacokinetic (PBPK) model has gained prominence as a predictive tool for veterinary drug residues, which offers an alternative method for establishing appropriate withdrawal periods for veterinary drugs. In this current study, a flow-limited PBPK model was developed to predict diclazuril concentrations in broilers following long-duration administration via medicated feed and water. This model consists of nine compartments, including arterial and venous plasma, lung, muscle, skin + fat, kidney, liver, intestine contents, and the rest of the body compartment. Physiological parameters such as tissue weights (Vcxx) and blood flow (Qcxx) were gathered from published studies, and tissue/plasma partition coefficients (Pxx) were calculated through the area method or parameter optimization. Published diclazuril concentrations were compared to the predicted values, indicating the accuracy and validity of the model. The sensitivity analysis showed that parameters associated with cardiac output, drug absorption, and elimination significantly affected diclazuril concentrations in the muscle. Finally, a Monte Carlo analysis, consisting of 1000 iterations, was conducted to calculate the withdrawal period. Based on the Chinese MRL values, we calculated a withdrawal period of 0 days for both recommended dosing regimens (through mediated water and feed at concentrations of 0.5–1 mg/L and 1 mg/kg, respectively). However, based on the European MRLs, longer periods were determined for the mediated feed dosing route. Our model provides a foundation for scaling other coccidiostats and poultry species.

1. Introduction

Coccidiosis is a common and serious poultry disease caused by the genus Eimeria which affects the intestinal tract of birds [1]. Chickens affected by this disease typically exhibit symptoms such as diarrhea and listlessness. These symptoms are further compounded by malabsorption, which can result in reduced feed conversion efficiency and significant economic losses for the poultry industry worldwide [2]. Currently, the prevention and control of coccidiosis mainly depend on the addition of anticoccidial drugs in feed and water [1].
Diclazuril is an anticoccidial drug with high effectiveness used in major poultry species such as broilers, pullets, and turkeys, as well as in minor edible bird species [3]. Its action mechanism remains unclear, but diclazuril effectively hinders the asexual and sexual growth of coccidia by impeding the excretion of oocysts, which ultimately halts the lifecycle of these parasites. In China, the available preparations of diclazuril are solution and premix, which are recommended for use in chickens through drinking water (0.5–1 mg/L) and mixed into feed (1 mg/kg), respectively [4]. This drug is approved for use in broilers throughout the growing cycle. However, it is not intended for use in laying hens.
The application of diclazuril throughout the whole growing cycle may cause potentially harmful drug residues in chicken. In rodents, the toxicological effects of diclazuril were mainly observed in the central nervous system [5]. Vomiting and defecation were also observed in dogs [5]. Although no similar toxicological reports exist for humans, the potential risks of residue ingestion make it imperative to closely monitor diclazuril levels in broilers. In China, the maximum residue limits (MRLs) of diclazuril in broiler products differ across various tissue types, which are 500, 1000, 2000, and 3000 μg/kg in muscle, skin + fat, kidney, and liver [6]. However, lower MRL values were labeled in Europe with the corresponding values at 500, 500, 1000, and 1500 μg/kg, respectively [7]. To ensure food safety, the Chinese broiler industry has implemented a 5-day withdrawal period for both diclazuril premix (1 mg/kg) and solution (0.5–1 mg/L) that are mixed with the feed and dissolved in water, respectively.
In recent years, physiologically based pharmacokinetic (PBPK) models have emerged as a reliable tool for forecasting veterinary drug residues in animal-derived foods such as meat [8,9,10], milk [11,12,13], and eggs [14,15,16]. Compared to traditional post-slaughter monitoring methods, PBPK models are predictive and work based on mass-balance equations that are defined by physiological mechanisms [8]. Previous PBPK models in chickens were mostly developed for antibacterial drugs [10,17], with only one model available for the more widely used coccidiostats (monensin) [18]. Unfortunately, there is no available model for diclazuril, making it imperative to establish a PBPK model to forecast diclazuril residues in broilers. Given that the disposition characteristics of various compounds differ significantly, this study seeks to develop a PBPK model to aid in predicting diclazuril levels in broilers and to further calculate the withdrawal periods of diclazuril.

2. Materials and Methods

2.1. Concentrations versus Time Data

We obtained diclazuril concentrations in plasma and tissue from published reports [1,19,20,21,22], using tables directly or figures extracted with GetData Graph Digitizer (version 2.26; http://getdata-graph-digitizer.com; accessed on 10 March 2023). See Table 1 for key details on selected studies.

2.2. Model Structure

The current PBPK model (Figure 1), which consists of nine compartments, including arterial plasma, venous plasma, lung, muscle, skin + fat, kidney, liver, intestine contents, and the rest of the body compartment, was adapted from a previous broiler model [10]. Four of the compartments serve as target tissues (muscle, skin + fat, kidney, and liver), three are the connective ones (blood and lung), one is the site of diclazuril exposure (intestinal contents), and one is a virtual mixing compartment. Consistent with the previous broiler model, diclazuril was assumed to be flow-limited.
Diclazuril is commonly administered to chickens through medicated water and feed. To model how the drug is absorbed, we developed an intestine compartment (Figure 1). To simplify this current model, neither crop nor the absorption time lag was included in it. Additionally, we assumed that diclazuril entered the gut directly and the intestine tissue lacked blood flow, which acted solely as the site of drug exposure and absorption. In previous studies [1,19,20,22], chickens were provided with medicated feed or water ad libitum. As chickens commonly cease consuming food and water in the dark, the previously reported light regimes were utilized to simulate drug exposure. To further simplify this model, we assumed that chickens consumed 1.1 kg of feed and 0.5 L of water per day, evenly distributed during light hours. Additionally, after dosing, diclazuril was assumed to be immediately available in the intestinal tract for absorption at a rate constant (Ka; h−1). The bioavailability of diclazuril is not known, although it has been noted that absorption is limited [23]. Therefore, we utilized this current model to accurately calculate its bioavailability as the ratio of total absorption to total dosage. More details can be found in the model code provided in the Supplementary Materials. Any unabsorbed diclazuril was eliminated through feces at a rate of Kgut (h−1). Furthermore, hepatic elimination was simulated using the parameter of Clhe (L/h/kg).
Diclazuril, upon absorption, was transported through the bloodstream to various tissues. Mass-balance differential equations were employed to describe the diclazuril change rate in each compartment (Table 2), as described previously [10,17]. Studies have shown that in different species—including chickens—diclazuril is primarily eliminated through fecal excretion, with little excretion in urine [23]. Furthermore, metabolites accounted for less than 6% of the total dose in various species [23]. Therefore, it can be inferred that diclazuril is primarily eliminated with feces, followed by hepatic metabolism. Additionally, the parameters of Kgut and Clhe were used to simulate the elimination of diclazuril (Figure 1). More details about the differential equations describing diclazuril absorption, distribution, and elimination can be found in Table 2.
It was assumed that all diclazuril was immediately available in the intestinal tract after dosing, and from there, diclazuril was absorbed with the rate constant of Ka (h−1). The unabsorbed diclazuril was eliminated with feces at the rate of Kgut (h−1). The t is for time (h). Clhe is the hepatic clearance (L/h/kg) of diclazuril. Qtot is cardiac output (L/h), which is equal to the plasma flow through the lung.

2.3. Model Parameterization

The physiological and anatomical parameters in broilers were derived from a literature review [24]. Tissue weight and blood flow (Table 3) were denoted as Vcxx and Qcxx, respectively, and were expressed as a percentage of total body weight (BW) and cardiac output (CO). Due to the absence of growth data on various chicken breeds, we assumed that the body weight of broilers remained consistent throughout the treatment and simulation period. Partition coefficients (Pxxs; Table 3) for diclazuril in non-eliminating tissues were calculated using the area method [25] based on previously reported tissue and plasma concentrations [20]. Hematocrit, abbreviated as pcv, was utilized to correlate blood and plasma volume, which was assumed to be 32 ± 2.76% [24] (more details can be found in the model code provided in the Supplementary Materials).
Diclazuril was deemed not to enter blood cells to simplify the present simulation, and the amount of diclazuril was assumed to be equal in both blood and plasma. Because the average BWs of chicken varied among previously published studies (Table 1), the present model was adjusted according to those specific BWs. According to the previous study [24], the value of CO was 9.88 L/h/kg BW and was converted to L/h via the following equation: Qtot = CO × BW. Due to the lack of concentration-time data for diclazuril in the lung and rest compartment, the area method could not be used for calculating the values of Plu and Pre. Hence, optimization using the plasma and tissue concentration data [1,19,21] helped determine the Pxx values in the lung, liver (eliminating tissue), and the rest compartment.
Apart from the optimized Pxxs mentioned above, we had difficulty obtaining values for the other three parameters, including Ka, Kgut, and Clhe. Thus, we used the published diclazuril concentrations (Table 1) to optimize them. We performed all parameter optimizations in acslxtreme software, using the Nelder–Mead maximum likelihood algorithm [26].
The current model was developed using acslxtreme software (version 3.0.2.1; Aegis Technologies Group, Inc., Huntsville, Alaska). All simulations, optimizations, validations, sensitivity analyses, and Monte Carlo analyses were also performed using this software. Further details can be found below.

2.4. Model Validation

To validate the model, we visually compared the predicted concentrations in plasma and tissues with previously published observations without using any actual observations during the parameter optimization process. We also performed linear regression analysis and calculated the correlation coefficient. Additionally, we calculated the mean absolute percentage error (MAPE) using the following equation to evaluate the validity of the current PBPK model: M A P E % = 1 N i = 1 N C o i C p i C o i × 100 % , where N stands for the number of observations, and Coi and Cpi represent the observed and predicted diclazuril concentrations, respectively [27]. The evaluation criteria for MAPE are as follows: acceptable prediction (MAPE < 50%), good prediction (10% < MAPE < 20%), and excellent prediction (MAPE < 10%).

2.5. Sensitivity Analysis

According to our previous reports [8,27], a local sensitivity analysis was performed to determine which parameters had the most influence on the diclazuril concentrations in muscle, and the normalized sensitivity coefficient (NSC) values were calculated for each parameter [27]. A parameter was considered significant during postexposure if its NSC exceeded an absolute value of 0.25 [28]. To simultaneously perform the sensitivity analysis for all parameters used in both routes, single exposure through mediated feed (0.5 mg/kg) and water (0.5 mg/L) was simulated simultaneously, and both exposures lasted 12 h.

2.6. Monte Carlo analysis and Withdrawal Interval Estimation

Following the sensitivity analysis, influential parameters were subjected to Monte Carlo analysis to generate a virtual population of broilers (n = 1000) [26,29]. Central tendency and spread were determined using a previous report [24] or parameter optimization, as detailed in the above model parameterization. As suggested by previous research [10], normal distribution was assumed for these parameters, and distribution information is shown in Table 4.
Monte Carlo analysis was performed using acslxtreme software to generate one thousand iterations (n = 1000). Each simulation randomly generated parameter values with mean, standard deviation (SD), lower bound (mean − SD), and upper bound (mean + SD), which were integrated into our model to predict diclazuril concentrations. We used 2 recommended levels of diclazuril addition: medicated feed containing 1 mg/kg diclazuril and water containing 1 mg/L diclazuril, for 4 different dosing durations (5, 10, 15, and 20 consecutive days) for each route of administration. Additionally, two specific dosing regimens were simulated for validation studies [20,22]. Additionally, the published light regimes (Table 1) were used for drug exposure in each simulation.
Predicted diclazuril concentrations were generated after each run, creating 1000 virtual individuals. Withdrawal intervals were calculated to ensure that the predicted concentrations remained below both Chinse and European MRL values. Additionally, both recommended methods [26,30] were used to calculate withdrawal periods so that diclazuril concentrations in the 95th percentile of the population (n = 1000) were below MRL values.

3. Results

3.1. Model Parameters

In Table 3, we present the physiological and anatomical parameters used in our model, which were derived from a prior review [24]. To obtain the partition coefficient for diclazuril, we utilized the area method or parameter optimization. The final values of partition coefficients were as follows: 0.0955 for skin + fat, 0.1299 for muscle, 0.5603 for lung, 0.6813 for kidney, 0.9613 for liver, and 1.2965 for the rest compartment (Table 3). In addition, we determined the values for parameters related to absorption and elimination through optimization, and they are listed below: Ka = 0.1234 h−1; Kgut = 0.3838 h−1; Clhe = 0.00344 L/h/kg.
The absolute bioavailability of diclazuril is unknown. To calculate it, we determined the ratio of the absorbed amount to the total administered dose. As the models with both routes had the same Ka and Kgut, the absolute bioavailability after dosing through both feed and water was calculated as 24.32%.

3.2. Model Validation

To validate the model, predicted and previously published diclazuril concentrations were visually compared (Figure 2 and Figure 3). The figures demonstrate accurate predictions, with most of the predicted concentrations closely matching reported values at the corresponding time points. Linear regression analysis was also performed (Table 5). It was shown that the present model was generally acceptable because most of the determination coefficients were higher than 0.75 (Table 5), which indicated generally acceptable results with determination coefficients higher than 0.75—a criterion previously established [13]. To validate the model, MAPEs were also calculated, and values ranged from 2.94% to 16.97%, confirming excellent and good predictions for all simulations [27].

3.3. Sensitivity Analysis

Figure 4 revealed the most significant parameters affecting diclazuril concentrations in muscle as determined via local sensitivity analysis. The parameter Qclu had the largest impact, aligning with the flow-limited model assumption. Additionally, absorption and elimination parameters were found to be influential, with Clhe being the most impactful, followed by Kgut and Ka. Concerning Pxxs parameters, only Pmu and Pre had any noteworthy effect on muscle concentrations. Like Qcxxs (Qcmu) and Vcxxs (Vcmu, Vcsk, and Vcbl), these parameters remained influential throughout the simulation with |NSC| > 0.25. However, certain parameters like BW, Qcmu, Ka, and Kgut had constant NCS values for the whole simulation period or some specific periods, indicating consistent influence. These findings suggest that certain parameters have inconsistent impacts, while others have consistent impacts, though all of them are considered sensitive. This study found that only Clhe had a significant impact on diclazuril concentrations in muscle, while other liver parameters did not. The results for non-sensitive parameters are shown in Figure S1.

3.4. Monte Carlo Analysis and Withdrawal Interval Estimation

We used Monte Carlo analysis to predict diclazuril concentrations after two recommended treatment routes at four durations (Figures S2–S9). Our results showed steady-state drug concentration in all tissues after 15 days of continuous feeding or drinking (Figures S5 and S9). All predictions in 1000 virtual individuals were below the corresponding Chines MRL values (Figures S2–S9). Consequently, based on the Chinese MRLs, we recommend a withdrawal period of 0 days for both dosing regimens. For the European MRL values, we arrived at the same recommendation of a 0-day withdrawal period following four different dosing durations through mediated water. However, a longer withdrawal period was calculated for the mediated feed administration route. Specifically, after 5, 10, 15, and 20 days of continuous feeding, the withdrawal periods were calculated as 0.63, 1.41, 1.63, and 1.65 days, respectively.
We also simulated two dose regimens from previous studies [20,22] (see Figures S10 and S11). Additionally, the results indicated that a mediated concentration of 3 mg/L in water resulted in higher residues in the kidney and liver that exceeded both MRL values (see Figure S11). Accordingly, we calculated withdrawal periods for this regimen [20]. The current results, based on both Chinese and European MRL values, differ from the previous linear regression result (3 days). The current withdrawal periods are shorter (1 day) and longer (4 days).

4. Discussion

This study introduces the first PBPK model for diclazuril in broilers. While another team of researchers previously developed a similar model for the anticoccidial drug monensin [18], our model includes compartments for the lung, kidney, and skin (expressed as skin + fat). Furthermore, we opted for a single virtual rest compartment rather than the two richly and poorly perfused compartments used in the earlier model. In contrast to the previous model, which relied exclusively on liver pathways (metabolism and biliary excretion), our updated model includes hepatic metabolism and intestinal excretion due to the diverse dispositions of the compounds studied. Despite their differences, both models adhered to the blood-flow limited assumption and were created using acslxtreme software. They were validated through external data sets and underwent sensitivity analysis.
The PXX values of diclazuril were determined through the area method [25] or parameter optimization in various tissues. Results in skin + fat, muscle, lung, kidney, liver, and other compartments were 0.0955, 0.1299, 0.5603, 0.6813, 0.9613, and 1.2965, respectively (refer to Table 3). Conversely, the previous PBPK model showed that monensin had PXX values of 0.51, 0.83, and 3.39 in muscle, liver, and fat, respectively [18]. These findings shed light on the selective tissue distribution of both anticoccidial drug drugs, emphasizing that diclazuril exhibits lower fat affinity compared to monensin.
We obtained the values of absorption and elimination parameters through optimization, which yielded final values of 0.1234 h−1, 0.3838 h−1, and 0.00344 L/h/kg for Ka, Kgut, and Clhe. These results indicate that diclazuril has a slow absorption rate but a fast excretion rate, mostly through feces. This finding is consistent with previous research [23]. Based on the current model, it appears that there may be limited absorption for diclazuril when dosing through both mediated feed and water, with a calculated absolute bioavailability of 24.32%. However, when dosed through feed, the bioavailability of monensin appears to be much lower (3.9%) [18] than diclazuril. It is recommended to conduct further in vivo experiments to verify the absolute bioavailability of diclazuril and monensin.
In the previous model for monensin [18], the crop compartment was incorporated, and a lag time was simulated. Initially, we tried to do the same in the current model, but we discovered that it had poor predictive ability. Moreover, the lag time varied considerably among individuals. Therefore, we excluded the crop compartment and lag time in the final model, which might have also contributed to an artifact of slow absorption for diclazuril. However, in a previous study [1], gavage administration of a single dose to broilers resulted in peak concentrations at 29.1 to 34.3 h, which also demonstrated slow absorption of diclazuril.
The validation results showed that our model could accurately predict diclazuril concentrations in various tissues after administration through feed or water. As shown in Figure 2 and Figure 3, excellent coverage was achieved for all tissues and plasma. The linear regression analysis and MAPE results have also proved good or excellent predictions in all samples.
In this study, a local sensitivity analysis was conducted to identify the influential parameters affecting diclazuril concentrations in muscles. The results indicated that the Qclu parameter was the most influential, in line with the flow-limited model assumption. Other parameters related to absorption and elimination were also found to be significant. Notably, Ka and Kgut only impacted the exposure phase (<24 h), while Clhe was influential during the entire simulation period. Interestingly, the muscle-related parameters (Vcmu, Pmu, and Qcmu) exhibited varying degrees of influence; Vcmu had the most impact, followed by Pmu and Qcmu. After approximately 110 h, Vcmu had a negative effect, but the underlying cause is unknown. Therefore, an in vivo pharmacokinetic study is recommended to explore potential explanations. Throughout the simulation, the BW parameter remained fixed, which aligns with the fixed body weight assumption.
The fixed body weight was one imperfection of the present model. Fortunately, the ages of broilers used in the model were all close to the market age [24], and their body weights were deemed relatively consistent. To simulate lifetime exposure, longer exposure durations were employed. Nonetheless, diclazuril reached a steady state after 15 days of continuous feeding or drinking (Figures S2–S9), suggesting exposure of up to 20 days would suffice. Future studies could develop a lifetime PBPK model [31] for diclazuril in young chicks while incorporating variable body weight.
We utilized a Monte Carlo analysis to predict diclazuril concentrations in a large population (n = 1000) and account for interindividual variability. These predictions were then compared to both Chinese and European MRL values in different tissues. For both recommended dosing regimens, the predictions in all 1000 virtual individuals were lower compared with the Chinese MRL values, including the liver (a tissue with commonly high residues). As a result, the withdrawal period for diclazuril should be 0 days based on the Chinese MRL values. However, based on the European MRL values, longer periods were determined for the mediated feed dosing route. Based on the Monte Carlo analysis, a higher concentration of diclazuril in water (3 mg/L) [20] was also simulated. The results demonstrated that a withdrawal period of 1 day and 4 days was sufficient to ensure diclazuril concentrations in the 95th percentile remained below the Chinese and European MRL values, respectively. All these results suggested that the CCVP’s guidance value (5 days) [4] has minimal risk.

5. Conclusions

Our research successfully developed and validated a PBPK model for diclazuril residues in broilers. The model accurately predicted diclazuril concentrations after continuous administration through medicated feed and water for different durations. We determined the influential parameters on muscle concentrations and conducted further Monte Carlo analysis. As a result, based on the Chinese MRL values, we calculated a withdrawal period of 0 days for both recommended dosing regimens. However, based on the European MRLs, longer periods were determined for the mediated feed dosing route. This model can serve as a foundation for scaling other coccidiostats and poultry species. The current results proved that this PBPK model can serve as an alternative to determine the withdrawal period for diclazuril in broilers. However, further studies on pharmacokinetics and depletion in younger chicks are essential to validate and apply this model.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ani13091512/s1, PBPK model code written in acsl language in acslXtreme software; M-type code file used to calculate WT based on the MRL; Figure S1: Sensitivity analysis results for those non-influential parameters on diclazuril concentrations in muscle; Figure S2: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 5 consecutive days of administering medicated feed containing 1 mg/kg of diclazuril. In muscle, China and Europe shared the same MRL value (500 μg/kg), which was represented by a red line. In the other three tissues, the red line is the Chinese value, and the blue line is the European value (same below); Figure S3: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 10 consecutive days of administering medicated feed containing 1 mg/kg of diclazuril; Figure S4: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 15 consecutive days of administering medicated feed containing 1 mg/kg of diclazuril; Figure S5: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 20 consecutive days of administering medicated feed containing 1 mg/kg of diclazuril; Figure S6: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 5 consecutive days of administering medicated water containing 1 mg/kg of diclazuril; Figure S7: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 10 consecutive days of administering medicated water containing 1 mg/kg of diclazuril; Figure S8: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 15 consecutive days of administering medicated water containing 1 mg/kg of diclazuril; Figure S9: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 20 consecutive days of administering medicated water containing 1 mg/kg of diclazuril; Figure S10: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 10 consecutive days of administering medicated feed containing 730 μg/kg of diclazuril; Figure S11: Prediction of the diclazuril concentrations (curves) and comparisons with the corresponding MRL (horizontal line) in plasma (a), lung (b), skin + fat (c), kidney (d), muscle (e), and liver (f) after 9 consecutive days of administering medicated water containing 3 mg/kg of diclazuril

Author Contributions

F.Y. (Fan Yang) contributed to this study’s conception and design. Data collection, data curation, and data analysis were performed by F.Y. (Fang Yang), M.Z., Y.-G.J., J.-C.C., M.-H.D., and Y.L. The first draft of the manuscript was written by F.Y. (Fang Yang) and M.Z., and all authors commented on previous versions of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Natural Science Foundation of Henan Province (212300410037) and the Foundation for the University Young Key Teacher Program of Henan Province (2021GGJS044).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the study findings are available upon request and after authorization by the authors.

Acknowledgments

The authors would like to express their gratitude to the group of Zhoumeng Lin at the University of Florida for conducting a thorough systematic review (DOI: 10.1111/jvp.12931) and providing physiological and anatomical parameters.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, M.; Qiu, J.; Shu, X.; Tang, X.; Sha, X.; Wu, L.; Fan, J.; Zeng, D.; He, R.; Zhang, W.; et al. Pharmacokinetics, activity, and residue elimination of R- and S-diclazuril in broiler chickens. J. Agric. Food Chem. 2020, 68, 8987–8995. [Google Scholar] [CrossRef] [PubMed]
  2. Del Cacho, E.; Gallego, M.; Lillehoj, H.S.; Quilez, J.; Lillehoj, E.P.; Sanchez-Acedo, C. Induction of protective immunity against experimental Eimeria tenella infection using serum exosomes. Vet. Parasitol. 2016, 224, 1–6. [Google Scholar] [CrossRef] [PubMed]
  3. Elokil, A.A.; Abouelezz, K.F.M.; Ahmad, H.I.; Pan, Y.; Li, S. Investigation of the impacts of antibiotic exposure on the diversity of the gut microbiota in chicks. Animals 2020, 10, 896. [Google Scholar] [CrossRef]
  4. CCVP (Commission of Chinese Veterinary Pharmacopoeia). The People’s Republic of China Veterinary Pharmacopoeia, 2020th ed.; China Agriculture Press: Beijing, China, 2021; Volume 1, pp. 94–96. [Google Scholar]
  5. WHO (World Health Organization). Toxicological Evaluation of Certain Veterinary Drug Residues in Food: Diclazuril (WHO Food Additives Series 41). Available online: https://inchem.org/documents/jecfa/jecmono/v041je08.htm (accessed on 20 March 2023).
  6. MARA (Ministry of Agriculture and Rural Affairs of the People’s Republic of China). National Food Safety Standard-Maximum Residue Limits for Veterinary Drugs in Animal-Derived Food. Available online: http://www.cfda.com.cn/newsdetail.aspx?id=107566 (accessed on 20 March 2023).
  7. EMA (European Medicines Agency). European Public MRL Assessment Report (EPMAR) Diclazuril (Extension to Poultry). Available online: https://www.ema.europa.eu/en/documents/mrl-report/diclazuril-extension-poultry-european-public-maximum-residue-limit-assessment-report-epmar-cvmp_en.pdf (accessed on 20 March 2023).
  8. Yang, F.; Liu, D.; Yang, C.; Song, Z.W.; Shao, H.T.; Zhang, M.; Zhang, C.S.; Zhang, Z.D.; Yang, F. Development and application of a physiologically based pharmacokinetic model for orbifloxacin in crucian carp (Carassius auratus). J. Vet. Pharmacol. Ther. 2022, 45, 311–319. [Google Scholar] [CrossRef]
  9. Yang, F.; Yang, F.; Wang, D.; Zhang, C.S.; Wang, H.; Song, Z.W.; Shao, H.T.; Zhang, M.; Yu, M.L.; Zheng, Y. Development and application of a water temperature related physiologically based pharmacokinetic model for enrofloxacin and its metabolite ciprofloxacin in rainbow trout. Front. Vet. Sci. 2020, 7, 608348. [Google Scholar] [CrossRef]
  10. Yang, F.; Yang, Y.R.; Wang, L.; Huang, X.H.; Qiao, G.; Zeng, Z.L. Estimating marbofloxacin withdrawal time in broiler chickens using a population physiologically based pharmacokinetics model. J. Vet. Pharmacol. Ther. 2014, 37, 579–588. [Google Scholar] [CrossRef]
  11. Tardiveau, J.; LeRoux-Pullen, L.; Gehring, R.; Touchais, G.; Chotard-Soutif, M.P.; Mirfendereski, H.; Paraud, C.; Jacobs, M.; Magnier, R.; Laurentie, M.; et al. A physiologically based pharmacokinetic (PBPK) model exploring the blood-milk barrier in lactating species—A case study with oxytetracycline administered to dairy cows and goats. Food Chem. Toxicol. 2022, 161, 112848. [Google Scholar] [CrossRef]
  12. Woodward, A.P.; Morin, D.; Whittem, T. Population physiologically based modeling of pirlimycin milk concentrations in dairy cows. J. Dairy Sci. 2020, 103, 10639–10650. [Google Scholar] [CrossRef]
  13. Li, M.; Gehring, R.; Riviere, J.E.; Lin, Z. Probabilistic physiologically based pharmacokinetic model for penicillin G in milk from dairy cows following intramammary or intramuscular administrations. Toxicol. Sci. 2018, 164, 85–100. [Google Scholar] [CrossRef]
  14. Baier, V.; Paini, A.; Schaller, S.; Scanes, C.G.; Bone, A.J.; Ebeling, M.; Preuss, T.G.; Witt, J.; Heckmann, D. A generic avian physiologically-based kinetic (PBK) model and its application in three bird species. Environ. Int. 2022, 169, 107547. [Google Scholar] [CrossRef]
  15. MacLachlan, D.J. Physiologically based pharmacokinetic (PBPK) model for residues of lipophilic pesticides in poultry. Food Addit. Contam. Part A 2010, 27, 302–314. [Google Scholar] [CrossRef] [PubMed]
  16. Van Eijkeren, J.C.; Zeilmaker, M.J.; Kan, C.A.; Traag, W.A.; Hoogenboom, L.A. A toxicokinetic model for the carry-over of dioxins and PCBs from feed and soil to eggs. Food Addit. Contam. 2006, 23, 509–517. [Google Scholar] [CrossRef]
  17. Yang, F.; Sun, N.; Liu, Y.M.; Zeng, Z.L. Estimating danofloxacin withdrawal time in broiler chickens based on physiologically based pharmacokinetics modeling. J. Vet. Pharmacol. Ther. 2015, 38, 174–182. [Google Scholar] [CrossRef]
  18. Henri, J.; Carrez, R.; Méda, B.; Laurentie, M.; Sanders, P. A physiologically based pharmacokinetic model for chickens exposed to feed supplemented with monensin during their lifetime. J. Vet. Pharmacol. Ther. 2017, 40, 370–382. [Google Scholar] [CrossRef]
  19. Zhang, M.; Qiu, J.; Li, X.; Zhang, W.; Fan, J.; Zhou, H.; He, L. Determination of residual enantiomers of diclazuril in chicken edible tissues by high performance liquid chromatography. J. Chromatogr. B Anal. Technol. Biomed. Life Sci. 2019, 1118–1119, 203–209. [Google Scholar] [CrossRef]
  20. Wen, L.; Fang, B. Residues of diclazuril in chicken tissues. Poult. Rais. Poult. Dis. Control 2007, 26, 12–14. (In Chinese) [Google Scholar]
  21. De Mil, T.; Devreese, M.; Maes, A.; De Saeger, S.; De Backer, P.; Croubels, S. Influence of mycotoxin binders on the oral bioavailability of tylosin, doxycycline, diclazuril, and salinomycin in fed broiler chickens. Poult. Sci. 2017, 96, 2137–2144. [Google Scholar] [CrossRef] [PubMed]
  22. Mortier, L.; Daeseleire, E.; Huyghebaert, G.; Grijspeerdt, K.; Van Peteghem, C. Detection of residues of the coccidiostat diclazuril in poultry tissues by liquid chromatography-tandem mass spectrometry after withdrawal of medicated feed. J. Agric. Food Chem. 2005, 53, 905–911. [Google Scholar] [CrossRef]
  23. WHO (World Health Organization). Antiprotozoal Agent Diclazuril. Available online: https://inchem.org/documents/jecfa/jecmono/v36je07.htm (accessed on 20 March 2023).
  24. Wang, Y.S.; Li, M.; Tell, L.A.; Baynes, R.E.; Davis, J.L.; Vickroy, T.W.; Riviere, J.E.; Lin, Z. Physiological parameter values for physiologically based pharmacokinetic models in food-producing animals. Part II: Chicken and turkey. J. Vet. Pharmacol. Ther. 2020, 44, 423–455. [Google Scholar] [CrossRef]
  25. Gallo, J.M.; Lam, F.C.; Perrier, D.G. Area method for the estimation of partition coefficients for physiological pharmacokinetic models. J. Pharmacokinet. Biopharm. 1987, 15, 271–280. [Google Scholar] [CrossRef] [PubMed]
  26. Yang, F.; Lin, Z.; Riviere, J.E.; Baynes, R.E. Development and application of a population physiologically based pharmacokinetic model for florfenicol and its metabolite florfenicol amine in cattle. Food Chem. Toxicol. 2019, 126, 285–294. [Google Scholar] [CrossRef] [PubMed]
  27. Yang, F.; Yang, F.; Shi, W.; Si, H.; Kong, T.; Wang, G.; Zhang, J. Development of a multiroute physiologically based pharmacokinetic model for orbifloxacin in rabbits. J. Vet. Pharmacol. Ther. 2018, 41, 622–631. [Google Scholar] [CrossRef] [PubMed]
  28. Leavens, T.L.; Tell, L.A.; Clothier, K.A.; Griffith, R.W.; Baynes, R.E.; Riviere, J.E. Development of a physiologically based pharmacokinetic model to predict tulathromycin distribution in goats. J. Vet. Pharmacol. Ther. 2012, 35, 121–131. [Google Scholar] [CrossRef] [PubMed]
  29. Viel, A.; Nouichi, A.; Le Van Suu, M.; Rolland, J.G.; Sanders, P.; Laurentie, M.; Manceau, J.; Henri, J. PBPK Model To Predict Marbofloxacin Distribution in Edible Tissues and Intestinal Exposure in Pigs. J. Agric. Food Chem. 2023, 71, 4358–4370. [Google Scholar] [CrossRef]
  30. EMA (European Medicines Agency). Guideline on Determination of Withdrawal Periods for Edible Tissues. Available online: https://www.ema.europa.eu/en/documents/scientific-guideline/adopted-guideline-determination-withdrawal-periods-edible-tissues-revision-2_en.pdf (accessed on 25 April 2023).
  31. Zeng, D.; Lin, Z.; Zeng, Z.; Fang, B.; Li, M.; Cheng, Y.H.; Sun, Y. Assessing Global Human Exposure to T-2 Toxin via Poultry Meat Consumption Using a Lifetime Physiologically Based Pharmacokinetic Model. J. Agric. Food Chem. 2019, 67, 1563–1571. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic diagram of the physiologically based pharmacokinetic model for diclazuril in broiler chickens after oral administration. Qxx (L/h) is plasma flow through some tissue. Subscript xx is the name of tissue, and lu, mu, sf, li, ki, and re were abbreviations for lung, muscle, skin + fat, liver, kidney, and the rest of the body compartment, respectively. Based on previous studies [1,19,20,22], diclazuril was orally given to chickens through medicated feed or water. It was assumed that all diclazuril was immediately available in the intestinal tract after dosing, and from there, diclazuril was absorbed with the rate constant of Ka (h−1). The unabsorbed diclazuril was eliminated with feces at the rate of Kgut (h−1). In addition to intestinal elimination, the parameter of Clhe (L/h/kg) was used to simulate the hepatic elimination of diclazuril.
Figure 1. Schematic diagram of the physiologically based pharmacokinetic model for diclazuril in broiler chickens after oral administration. Qxx (L/h) is plasma flow through some tissue. Subscript xx is the name of tissue, and lu, mu, sf, li, ki, and re were abbreviations for lung, muscle, skin + fat, liver, kidney, and the rest of the body compartment, respectively. Based on previous studies [1,19,20,22], diclazuril was orally given to chickens through medicated feed or water. It was assumed that all diclazuril was immediately available in the intestinal tract after dosing, and from there, diclazuril was absorbed with the rate constant of Ka (h−1). The unabsorbed diclazuril was eliminated with feces at the rate of Kgut (h−1). In addition to intestinal elimination, the parameter of Clhe (L/h/kg) was used to simulate the hepatic elimination of diclazuril.
Animals 13 01512 g001
Figure 2. Comparisons between predicted (curves) and published (points; [22]) diclazuril concentrations (μg/kg) in tissues after 10 consecutive days of administering medicated feed containing 730 μg/kg of diclazuril.
Figure 2. Comparisons between predicted (curves) and published (points; [22]) diclazuril concentrations (μg/kg) in tissues after 10 consecutive days of administering medicated feed containing 730 μg/kg of diclazuril.
Animals 13 01512 g002
Figure 3. Comparisons between predicted (curves) and published (points; [22]) diclazuril concentrations (μg/kg or μg/L) in tissues and plasma after 9 consecutive days of administering medicated water containing 3 mg/kg of diclazuril.
Figure 3. Comparisons between predicted (curves) and published (points; [22]) diclazuril concentrations (μg/kg or μg/L) in tissues and plasma after 9 consecutive days of administering medicated water containing 3 mg/kg of diclazuril.
Animals 13 01512 g003
Figure 4. Sensitivity analysis results for those influential parameters on diclazuril concentrations in muscle.
Figure 4. Sensitivity analysis results for those influential parameters on diclazuril concentrations in muscle.
Animals 13 01512 g004
Table 1. Pharmacokinetic studies used in model optimization and validation.
Table 1. Pharmacokinetic studies used in model optimization and validation.
Ref. #Purpose 1Routes and DoseLight Regime (Light/Dark) 2BW (kg)Age (Days)BreedsMatrix 3
[1,19] 4OptimizationSingle oral dose at 1 mg/kg BW by gavage 512/121.5250Lingnan Yellow ChickenPL
Ate medicated feed at 1 mg/kg for 7 consecutive daysMU, SF, LI, KI
[20]ValidationDrunk medicated water at 3 mg/L for 9 consecutive days12/121.3430Lingnan Yellow ChickenPL, SF, MU, LI, KI
[22]ValidationAte medicated feed at 730 μg/kg for 10 consecutive days21/31.521Ross 308MU 6, LI
[21]OptimizationSingle oral dose at 80 μg/kg BW by gavage18/61.2315Ross 308PL
1 This current model utilized five sets of concentration-time data. Three sets were used for parameter optimizations, while two were used for validation purposes. 2 Light regime was related to the duration of daily exposure in multiple-dose treatments because chickens stop drinking or eating in the dark. 3 The abbreviations for matrix: PL: plasma; MU: muscle; LI: liver; KI: kidney;. 4 In these studies, both enantiomeric forms (R- and S-) of diclazuril were quantified. We use their sum for parameter optimization. 5 The current PBPK model was developed by CSL encoding and implemented using acslX software (version 3.0.2.1). Additional information on the code can be found in the Supplementary Materials. To simulate multiple sustained exposures to diclazuril, we utilized the PULSE function. However, this model could also reflect a single gavage by modifying the model with a last exposure day (Dstop) of 1 day and exposure time (tlen) of 0.001 h. Therefore, the diclazuril concentrations in plasma after one single dose by gavage were also used to optimize the model parameters. 6 These data sets in muscle (MU) included the breast and thigh.
Table 2. Differential equations describing the change rate of diclazuril amount (μg) or concentrations (μg/kg or μg/L) in each compartment.
Table 2. Differential equations describing the change rate of diclazuril amount (μg) or concentrations (μg/kg or μg/L) in each compartment.
Compartment Differential Equation
Intestinal contents d A i c d t = d o s e t l e n K a × A i c K g u t × A i c
Muscle V m u × d C m u d t = Q m u × C a p C m u P m u
Skin + fat V s f × d C s f d t = Q s f × C a p C s f P s f
Kidney V k i × d C k i d t = Q k i × C a p C k i P k i
Liver V l i × d C l i d t = K a × A i c + Q l i × C a p C l i P l i C l h e × C l i P l i
Lung V l u × d C l u d t = Q t o t × C v p C l u P l u
Rest V r e × d C r e d t = Q r e × C a p C r e P r e
Arterial plasma V a p × d C a p d t = Q t o t × C l u P l u C a p
Venous plasma V v p × d C v p d t = Q r e × C r e P r e + Q l i × C l i P l i + Q k i × C k i P k i + Q s f × C s f P s f + Q m u × C m u P m u Q t o t × C v p
Axx and Cxx are the amount (μg) and concentration (μg/kg or μg/L) of diclazuril in each compartment, respectively. Vxx and Qxx are the volume (L) and plasma flow (L/h) through a tissue, respectively, whereas Pxx is the partition coefficient (unitless) for diclazuril in a tissue. Subscript xx is the name of a compartment, and ic, mu, sf, ki, li, lu, ap, vp, and re are abbreviations for intestinal contents, muscle, skin + fat, kidney, liver, lung, arterial plasma, venous plasma, and the rest of the body compartment, respectively. In this present model, diclazuril was given to chickens through medicated feed or water. The parameter of dose represents the dose of diclazuril (μg), which was calculated by multiplying the daily feed or water intake by the diclazuril concentration in the feed or water. Additionally, each chicken had free access to medicated feed and water. It is well known that chickens stop drinking and eating in the dark. Therefore, the parameter of tlen was used to simulate the diclazuril exposure time (hour) per day.
Table 3. Parameters of tissue weights, plasma flows, and tissue/plasma partition coefficients used in the current physiologically based pharmacokinetic model.
Table 3. Parameters of tissue weights, plasma flows, and tissue/plasma partition coefficients used in the current physiologically based pharmacokinetic model.
CompartmentTissue Weight 1 (Vcxx, Fraction of BW)Blood Flow 2 (Qcxx, Fraction of Cardiac Output)Partition Coefficient for Diclazuril 3 (Pxx)
Muscle0.57120.07640.1299
Skin + fat0.26780.25050.0955
Kidney0.00640.20120.6813
Liver0.02140.2526 40.9613 5
Lung0.00711 60.5603 5
Arterial plasma0.0322NANA
Venous plasma0.0161NANA
Rest0.0778 70.2193 81.2965 5
1 The current PBPK model and all simulations were adjusted based on the chicken’s body weights (BWs). The weights of different tissues were expressed as the fractions of BW. Due to the absence of growth data on various chicken breeds, we assumed that the body weight of broilers remained consistent throughout the treatment and simulation period. 2 The cardiac output (CO) was derived from a review [24], whose final value was 9.88 L/h/kg BW. Additionally, all plasma flows through different tissues were expressed as fractions of CO [24]. 3 The partition coefficients for diclazuril in different tissues were calculated based on the area method [25] through the previously reported diclazuril concentrations [1,19,21]. 4 This value is the sum of the hepatic artery plus portal vein flows. 5 The partition coefficients for diclazuril in the liver, lung, and rest compartment were optimized through the previously reported diclazuril concentrations [1,19,21]. 6 The plasma flow through the lung is equal to the cardiac output (Qtot); therefore, this value is equal to 1. 7 This value was calculated as 1 − (0.5712 + 0.2678 + 0.0064 + 0.0214 + 0.0071 + 0.0322 + 0.0161). 8 This value was calculated as 1 − (0.0764 + 0.2505 + 0.2012 + 0.2526).
Table 4. The distribution information of those parameters subjected to Monte Carlo analysis.
Table 4. The distribution information of those parameters subjected to Monte Carlo analysis.
ParametersUnitAverage ValueSDMinMaxSource
CO 1L/h/kg9.882.077.8111.95[24]
BW 2kg1.50.151.351.65[22]
ClheL/h/kg0.003440.000020.003420.00346Optimization
Ka1/h0.12340.00070.12270.1241Optimization
Kgut1/h0.38380.00180.3820.3856Optimization
Pmu 2unitless0.12990.01290.1170.1428Area method
Preunitless1.29650.00641.29011.3029Optimization
Vcmu%57.1214.7342.3971.85[24]
Vcsk%13.382.8210.5616.2[24]
Vcbl%4.830.983.855.81[24]
Vcfa%13.42.0111.3915.41[24]
Qcmu%7.641.146.58.78[24]
1 It should be noted that the influential one was Qclu (Figure S1), but because it had a fixed value (100% of cardiac output), its SD value was not available. So, we used the parameter of CO (cardiac output) here [24]. 2 Since we did not have access to actual SD values for the variables BW and Pmu, we approximated them as 10% of their respective mean values.
Table 5. Results of MAPE and the linear regression analysis between the predicted and observed diclazuril concentrations in plasma and tissues.
Table 5. Results of MAPE and the linear regression analysis between the predicted and observed diclazuril concentrations in plasma and tissues.
ReferenceTissuesLinear Regression EquationThe Determination Coefficient (R2)MAPE (%)
[22]MuscleCP = 0.8005CO + 2.31090.920116.97
LiverCP = 1.0471CO − 6.04750.98398.19
[20]MuscleCP = 0.9748CO + 10.2290.98018.03
LiverCP = 0.9793CO + 10.8870.99682.94
PlasmaCP = 1.0283CO + 33.4090.955115.79
KidneyCP = 1.119CO − 36.7080.97229.74
Skin + fatCP = 0.8643CO + 14.1270.981614.00
CO and CP represent the observed and predicted diclazuril concentrations, respectively, in different tissues.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yang, F.; Zhang, M.; Jin, Y.-G.; Chen, J.-C.; Duan, M.-H.; Liu, Y.; Li, Z.-E.; Li, X.-P.; Yang, F. Development and Application of a Physiologically Based Pharmacokinetic Model for Diclazuril in Broiler Chickens. Animals 2023, 13, 1512. https://doi.org/10.3390/ani13091512

AMA Style

Yang F, Zhang M, Jin Y-G, Chen J-C, Duan M-H, Liu Y, Li Z-E, Li X-P, Yang F. Development and Application of a Physiologically Based Pharmacokinetic Model for Diclazuril in Broiler Chickens. Animals. 2023; 13(9):1512. https://doi.org/10.3390/ani13091512

Chicago/Turabian Style

Yang, Fang, Mei Zhang, Yang-Guang Jin, Jun-Cheng Chen, Ming-Hui Duan, Yue Liu, Ze-En Li, Xing-Ping Li, and Fan Yang. 2023. "Development and Application of a Physiologically Based Pharmacokinetic Model for Diclazuril in Broiler Chickens" Animals 13, no. 9: 1512. https://doi.org/10.3390/ani13091512

APA Style

Yang, F., Zhang, M., Jin, Y. -G., Chen, J. -C., Duan, M. -H., Liu, Y., Li, Z. -E., Li, X. -P., & Yang, F. (2023). Development and Application of a Physiologically Based Pharmacokinetic Model for Diclazuril in Broiler Chickens. Animals, 13(9), 1512. https://doi.org/10.3390/ani13091512

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop