Next Article in Journal
Factors Affecting Hesitancy to mRNA and Viral Vector COVID-19 Vaccines among College Students in Italy
Next Article in Special Issue
The Rise and Fall of a Local SARS-CoV-2 Variant with the Spike Protein Mutation L452R
Previous Article in Journal
Immunoinformatics Approach to Design Multi-Epitope- Subunit Vaccine against Bovine Ephemeral Fever Disease
Previous Article in Special Issue
Prevalence and Factors of the Performed or Scheduled COVID-19 Vaccination in a Chinese Adult General Population in Hong Kong
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adverse Effects on Work and Daily Life Interference among Healthcare Workers after the First and Second ChAdOx1 and BNT162b2 COVID-19 Vaccine Doses

1
Department of Occupational and Environmental Medicine, Yeungnam University Hospital, Daegu 42415, Korea
2
Department of Preventive Medicine and Public Health, College of Medicine, Yeungnam University, Daegu 42415, Korea
3
Department of Occupational and Environmental Medicine, Korea University Medical Center Ansan Hospital, Ansan 15355, Korea
*
Author to whom correspondence should be addressed.
Vaccines 2021, 9(8), 926; https://doi.org/10.3390/vaccines9080926
Submission received: 1 July 2021 / Revised: 13 August 2021 / Accepted: 16 August 2021 / Published: 19 August 2021
(This article belongs to the Special Issue The COVID Vaccine)

Abstract

:
In this study, we assessed the adverse effects and the work and daily life interference associated with each dose of the ChAdOx1 and BNT162b2 COVID-19 vaccines. Questionnaires were distributed to workers after they received both doses; only those who worked the day after receiving the vaccine were included in the analysis. Overall, 368 ChAdOx1-vaccinated and 27 BNT162b2-vaccinated participants were included. Among the ChAdOx1-vaccinated participants, the incidence of adverse effects was significantly lower after the second dose than after the first dose. Among the BNT162b2-vaccinated participants, however, no differences in adverse effects or work and daily life interference were found between the doses. After the first and second dose, the numeric scale score (0–10) for interference with work was 3.9 ± 2.9 and 1.6 ± 1.9 for the ChAdOx1 and 3.2 ± 2.5 and 3.6 ± 3.0 for the BNT162b2 vaccine, respectively. A similar trend was observed for interference with daily life. Factors associated with work and daily life interference in the multivariate model were age, vaccine dose (first or second), and the interaction term of vaccine type and dose. These results could be used to inform the general population of the adverse effects associated with these vaccinations.

1. Introduction

As of 15 June 2021, over 15 million COVID-19 vaccination doses have been administered in the Republic of Korea [1], which represents approximately 30% of the population. With the increase in vaccination rates, many cases of adverse effects have been reported, including those that are common and less severe [2,3] and those that are more rare, but critical [4,5]. The reported rates of adverse effects have been inconsistent [6,7] because of differences in age, ethnicity, and underlying diseases. Therefore, research on these issues are ongoing.
A few previous studies conducted in the Republic of Korea have focused on the rate of local and systemic adverse effects [2,8]. However, the widely used system for reporting these rates is based on a binary answer (yes or no) for each adverse effect, making it difficult to know the degree of severity and their impact on work and daily life [9]. We therefore utilized a numeric scale (0–10) to determine the severity of the adverse effects and the extent to which they interfered with work and daily life. This numeric scale is widely used to assess the influence of a group of certain types of diseases on daily life [10,11,12] and can be understood intuitively.
For the general population, providing detailed information on adverse effects is essential for communicating the risks associated with these vaccinations [13]; however, the data currently available are insufficient. Detailed information regarding adverse effects, their severity, and their impact on individuals’ work and daily lives are required to educate the general population and encourage them to participate in vaccination. Therefore, we identified the adverse effects associated with the ChAdOx1 and BNT162b2 COVID-19 vaccinations and their effects on work performance and daily life.

2. Materials and Methods

2.1. Study Design and Participants

Hospital workers at a university hospital in Daegu, Republic of Korea, received their first dose of ChAdOx1 COVID-19 vaccine between 5 March 2021, and 26 March 2021, and the second dose 12 weeks later. The first and second doses of the BNT162b2 COVID-19 vaccine were administered in March, four weeks apart, to those who were working in the designated COVID-19 ward. The doses and methods of administration were determined according to the manufacturers’ instructions. An internet-based survey using NAVER Form (NAVER Corp., Bundang, Korea) was sent via mobile text messaging three times (from 2 June to 18 June) after the second vaccination dose was received. Since our main objective was to determine the association between the vaccination and interference with work and daily life, only subjects who worked the day after vaccination were included, and surveys with missing values among the variables of interest were excluded.

2.2. Survey

We collected information on sex, age group, vaccine type (i.e., BNT162b2 or ChAdOx1), previous illnesses, job class (medical staff or other), shift work, alcohol consumption, smoking status, regular exercise, and adverse effects after vaccination. Subjects were instructed to check ‘yes’ on the smoking and alcohol consumption questions if they had smoked or consumed alcohol at least once between March and May 2021 for the survey conducted after the first dose, and at least once between the first and second dose for the survey conducted after the second dose. For the exercise questionnaire, subjects were instructed to check ‘yes’ if they exercised for >150 min/week between March and May 2021 for the survey conducted of the first dose, and at least once between the first and second dose for the survey of the second dose. Furthermore, the intake of antipyretics, intravenous treatment with antipyretics or fluid, interference with work, interference with daily life, and medications after the first and second vaccination doses were determined using a structured questionnaire. A total of 10 adverse effects were included in the survey: fever, chills, localized pain, myalgia, headache, nausea, vomiting, urticaria, dyspnea, and chest pain. If the subject experienced symptoms other than those included in the questionnaire, they were instructed to write the symptoms under “other symptoms.” The subjective degree of severity for each adverse effect was collected using an 11-point (0–10) numeric scale, with 0 indicating no symptoms and 10 indicating the most severe symptoms. Information on work and daily life interference was also collected using an 11-point (0–10) numeric scale, with a score of 10 indicating no work or daily activities could be performed, and a score of 0 indicating no adverse effects. Information on work productivity was collected using an 11-point (0–10) numeric scale, with 10 indicating a usual level of work performance. The questionnaires were collected anonymously.

2.3. Statistical Analyses

Baseline characteristics, adverse effects, and response to adverse effects were described for each vaccine and vaccination dose (first and second). Adverse effects after the first and second doses were compared using a generalized linear mixed model. A logit link for categorical variables and a linear mixed model for continuous variables were used since repeated measures were considered for the participants. The adverse effects associated with the ChAdOx1 and BNT162b2 vaccines were compared for each dose (first and second) using the Fisher’s exact test for categorical variables and independent t-test for continuous variables.
The level of interference with daily life and work was determined, and the median score for each variable was classified into the “low” (0–4) or “high” (5–10) group. The p-value was calculated for continuous variables. A generalized linear mixed model was used to calculate the odds ratios (ORs) and p-values.
Each precipitating factor that could have affected daily life and work interference was analyzed using a generalized mixed model (logit link) in the univariate analysis, which considered repeated measures for the participants according to the first and second vaccination doses. ORs for each factor were calculated separately. A multivariate analysis with a generalized linear mixed model (logit link) was then performed, which included independent variables that may have been associated with the independent variables (p < 0.25), using a generalized mixed model (logit link). The Wald method was used to calculate the 95% confidence intervals (CIs) of the generalized linear mixed models. SPSS 20.00 (IBM, NY, USA) was used for the Fisher’s exact test and independent t-test analyses. R project version 4.1.0 (package “lme4”) was used for the generalized linear mixed model.

3. Results

3.1. General Characteristics of the Participants According to Vaccine Type and Dose

There were 1670 and 140 workers who received the ChAdOx1 and BNT162b2 COVID-19 vaccines, respectively. A total of 542 individuals responded to the questionnaire. Subjects who did not agree to participate in the study (n = 20), those who had missing values (n = 9), and those who did not work on the day after both doses (n = 118) were excluded. Since a primary objective of this study was to assess the association between the vaccine and interference with work, those who did not work on the day after receiving the vaccine for both doses were excluded from the analysis. Finally, a total of 395 workers were included, and 644 vaccination cases were observed (first and second doses separately). Therefore, subjects were included in the analysis only once, and their two doses were assessed separately. For the ChAdOx1 vaccine, a total of 299 cases were included after the first dose and 304 after the second dose, and for the BNT162b2 vaccine, 19 cases were included after the first dose and 22 after the second dose. The general characteristics of the participants who received the first and second vaccinations are shown in Table 1. Except for the proportions of those who performed shift work, there were no significant differences in the general characteristics between each vaccine dose and type. There were no previously confirmed cases of COVID-19 among the vaccinated participants in the center, and no critical adverse events, such as death, thrombosis, or myocarditis, were reported at the center.

3.2. Vaccine Adverse Effects and Impact on Daily Life and Work

Table 2 shows the characteristics of the adverse effects experienced by the participants and their responses according to vaccine dose and type. For the ChAdOx1 vaccine, all rates of symptoms, except urticaria, were higher for the first dose than for the second dose. There was also a significant difference in the proportion of subjects who used analgesics or received fluid and injection treatments. The differences in the numeric scale scores for interference with work and daily life and for work performance were also statistically significant. In contrast, among the BNT162b2-vaccinated participants, the rates of symptoms were similar between the first and second doses. There were also no significant differences between the first doses of the ChAdOx1 and BNT162b2 vaccines in terms of adverse effects or interference with daily life or work. The rates of fever, chills, and myalgia were significantly higher after the second dose of the BNT162b2 vaccine than after the second dose of the ChAdOx1 vaccine. The subjective symptoms reported by more than one participant were dizziness (n = 4), sore throat (n = 2), and numbness in the vaccinated arm (n = 2) in the ChAdOx1 vaccination group. Others reported nasal stuffiness, sleepiness, feeling dazed, voice changes, cold feet, and shortness of menstruation cycle.
The numeric scale scores for the effects of vaccination on daily life and work were also significantly higher in the BNT162b2 vaccination group than in the ChAdOx1 vaccination group. The numeric scale for work performance was also significantly lower after the second dose in the BNT162b2-vaccinated participants than in the ChAdOx1-vaccinated participants. Most respondents presented symptoms within 24 h of vaccination. The duration of adverse effects varied among individuals, with approximately 50% of the participants responding that they were affected for more than 24 h.

3.3. Associations between Adverse Effects after Vaccination and Work and Daily Life Inteference

Table 3 shows the adverse effects after the ChAdOx1 vaccination, which was the most common vaccination received by our subjects, according to the degree of interference with work and daily life.
For the ChAdOx1 vaccination, those who experienced high levels of interference with daily life (5–10 points) had high rates for all adverse effects except urticaria. Similarly, those who experienced high levels of interference with work (5–10 points) reported all side effects (except urticaria) more frequently, with the three most common adverse effects being local pain (83.2%), myalgia (78.3%), and fever (73.3%). In those who experienced high levels of interference with daily life, the three most common adverse effects were local pain (84.4%), myalgia (77.7%), and fever (70.9%). Myalgia, fever, chills, and local pain were the four most common adverse effects among both the high interference with work and high interference with daily life groups, among those who received the BNT162b2 vaccination. However, due to the relatively small sample size and small proportions of adverse effects among those who received the BNT162b2 vaccination, we did not calculate p-values. The results are presented in Supplementary Table S1.

3.4. Precipitating Factors Associated with Daily Life and Work Interference

Table 4 shows the results of the statistical analysis between precipitating factors and daily life and work interference. Vaccine type, dose (first or second), age, sex, shift work, job class (medical staff/other), alcohol consumption, smoking status, and regular exercise (>150 min/week) were selected as precipitating characteristics that could potentially be associated with interference in daily life and work. The second dose, age, shift work, and job class were associated with work interference in the univariate analysis. The second dose (OR = 0.09, p < 0.0001), age (OR = 0.22, p < 0.01 for 50–59 years, OR = 0.06, p < 0.01 for >60 years, compared with 20–29 years), and the interaction term “vaccine type (BNT162b2) * second dose” (OR = 20.29, p < 0.05) were significantly associated with work interference after vaccination in the multivariate analysis. The second dose and age >40 years were associated with lower work interference. Vaccine dose, age, shift work, job class, and sex were associated with daily life interference in the univariate analysis. In the multivariate analysis, age, vaccine type, vaccine dose (first or second), interaction term of vaccine type and dose, shift work, and job class were selected as independent variables. The results showed that age (OR = 0.25, p < 0.01 for 50–59 years, OR = 0.03, p < 0.01 for ≥ 60 years, compared with 20–29 years), second dose (OR = 0.11, p < 0.0001), and the interaction term “vaccine type (BNT162b2) * second dose” (OR = 20.70, p < 0.05) were significantly associated with work interference after vaccination. Age >40 years and second dose were associated with lower scores for interference with daily life. The interaction term of vaccine type and dose showed significantly higher ORs in both analyses, indicating that a different pattern was demonstrated in the first and second doses according to the vaccine type.

4. Discussion

In this study, a survey was conducted, which focused on the adverse effects and interference with daily life and work experienced by workers at our institution the day after receiving the first and second doses of the ChAdOx1 and BNT162b2 vaccinations. The adverse effects after vaccination for each vaccine type and dose, degree of interference with life or work, and associated factors were analyzed.
Different patterns of adverse effects, according to the vaccine type and dose, were observed in our study. After the first ChAdOx1 vaccination dose, an interference with work and daily life, indicated by an average score of 3.9/10 and 4.2/10 was noted, respectively, while after the second dose, the average interference scores were 1.7 and 1.6, respectively. Multiple regression analysis showed that work and daily life interference was low in the ChAdOx1 vaccination group after the second dose. In this study, fewer adverse effects were reported after the second ChAdOx1 vaccination dose, and its effects on daily life and work were minimal. Regarding the BNT162b2 vaccine, there were no significant differences between the first and second doses in terms of interference with work or daily life. The second BNT162b2 vaccination dose showed comparable or more adverse effects than the first dose. A study in Italy also reported that there were no significant differences in the adverse effect rates after the first and second doses of the BNT162b2 vaccine [14]. Different patterns between the first and second doses according to the type of vaccine were also significant for work and daily life interference in the multivariate analysis. This is shown by the statistically significant and positive interaction term of the type of vaccine (BNT162b2) and dose (second) (work interference, OR = 20.29; daily life interference, OR = 20.27), while the second dose alone had a negative effect size (OR = 0.09) [15]. Overall, this study found that adverse effects were mild after the second dose of the ChAdOx1 vaccine, and that different expression patterns were evident according to dose and vaccine.
Although determining the incidence of each side effect of the vaccine was not a main objective of our study, it is interesting to compare these results with those of previous studies from other countries. In this study, the incidences of fever, myalgia, and headache were 58.2, 60.2, and 45.2% after the first dose of the ChAdOx1 vaccine and 18.1, 20.7, and 22.4% after the second dose, respectively. The incidences of fever, myalgia, and headache were 31.6, 31.6, and 26.3% after the first dose of the BNT162b2 vaccine and 50.0, 45.5, and 36.4% after the second dose, respectively. Although it is difficult to directly compare our results to those of previous studies due to different study designs, the rate of adverse effects reported in the Republic of Korea was relatively high. Bae et al. [2] reported that 93.3% of ChAdOx1-vaccinated subjects and 80.1% of BNT162b2-vaccinated subjects experienced more than one adverse effect after the first dose. Among the common symptoms, fever occurred in 51.3%, headache in 69.5%, and muscle ache in 79.9% after ChAdOx1 vaccination. Studies from the same centers in the Republic of Korea reported that 89.1% experienced adverse effects after the second dose of the BNT162b2 vaccine. For frequent adverse effects, the incidence rate was 32.1% for fever, 69.1% for muscle ache, and 48.7% for headache [16]. Kim et al. [8] found that 90.9 and 52.5% of ChAdOx1- and BNT162b2-vaccinated subjects, respectively, experienced adverse effects after the first dose. Fever was present in 36.1%, headache in 47.4%, and myalgia in 60.5% after ChAdOx1 first dose. After the BNT162b2 vaccine, the adverse effect rates were relatively low, with fever reported in 5%, myalgia in 11.2%, and headache in 7.5%. In a study conducted in Nepal, after receiving the first dose of the ChAdOx1 vaccine, symptoms appeared in 91.6% of subjects, with fever reported in about 30%, headache in about 30%, and myalgia in about 25% (only presented using a bar graph) [17]. Abu-Hammad et al. [18] reported the adverse effect rates after the COVID-19 vaccinations in Jordan, and the incidences of fever, myalgia, and headache were 73.7, 21.3, and 27.7%, respectively, after the first dose of the ChAdOx1 vaccine, while the incidences after the second dose were much lower, at 1.7, 0.6, and 1.1%, respectively, which were comparable to the results of our study. In a study from Saudi Arabia, after the ChAdOx1 vaccine, 31.3% reported headaches and 27.5% reported myalgia and joint pain [19]. A study from India reported that 12.5% experienced fever, 11.2% experienced muscle aches, and 17.4% experienced headaches in the first three days of receiving the first dose of the ChAdOx1 vaccine [20]. In a German study, the incidence of headaches and feverishness and chills after the first dose of ChAdOx1 was approximately 50% each (presented using a bar graph) [21]. The incidence of adverse effects among US healthcare workers was 21.99, 45.70, and 45.48% for fever, myalgia, and headaches, respectively [22]. According to a British study on the adverse effects associated with vaccinations, after the first dose of ChAdOx1, the incidences of fever, myalgia, and headache were 8.2, 7.0, and 22.8%, respectively, which appear to be relatively low. For the first dose of the BNT162b2 vaccine, the incidences of fever, myalgia, and headache were 1.5, 2.3, and 7.8%, respectively. For the second dose of the BNT162b2 vaccine, a slightly higher proportion reported fevers, myalgia, and headaches (3.8, 5.0, 13.2%, respectively) [3]. The incidence of adverse effects in an Italian study was 7.5 and 17.9% for fever and 23.1 and 32.3% for myalgia after the first and second doses of the BNT162b2 vaccine, respectively [14]. The subjects of the cited studies were not specifically skewed or biased in terms of age or other characteristics. Differences in ethnicity, immune status, and living environment, however, did appear to have affected the adverse effects. Although the mechanism is completely different, race and ethnicity are known to affect vaccine immunity and adverse effects to other vaccines, such as HPV and the smallpox vaccine [23,24]. Additionally, these inconsistencies might be due to the expression of symptoms associated with different cultures or languages. Nevertheless, the public may be confused by the differences in these results, which depend on the research design and subjects studied. While receiving clear information about vaccines is associated more with vaccine acceptance than directly citing the results of research from other countries [25], it is necessary to organize the data from each community for risk communication. Thus, we suggest that each country create vaccination-related guidelines or principles based on their own evidence.
According to the results reported by the ChAdOx1 vaccine manufacturer, fewer side effects have been found in older age groups [6]. Moreover, in a previous study from the Republic of Korea, the rate of adverse effects was low in older adults [8]. The differences by age were also shown in antibody production rates and COVID-19 protection rates [26,27]. There also appears to be a difference in immune reactions according to age. In this study, the rate of adverse effects was found to be greater in the younger age group, which is in line with previous studies. However, the degree of or sensitivity to symptoms may differ according to age [28]. Therefore, the lower rate of expression of each adverse effect may not reflect the discomfort experienced by older adults. The influence that the vaccines had on work and daily life was also reported to be higher in the younger age group. An important finding of this study was that interference with daily life and work tends to decrease with age.
Our study also had some limitations. Information on the adverse effects experienced and their severity was requested after the second dose of vaccination was completed using a self-administered survey questionnaire. Although this method can reduce loss to follow-up, recall bias may have been significant. With recall bias, subjects usually overestimate symptoms within the first two weeks, and the response is relatively stable thereafter [29]. Only the second dose of the ChAdOx1 vaccine was administered within two weeks of receiving the questionnaire since the first vaccination was 12 weeks before the survey and the second vaccination dose of BNT162b2 was administered four weeks after the first dose. Adverse effects after the second dose of the ChAdOx1 vaccine showed an incidence of adverse effects and a degree of interference with daily life and work that was rather low compared to those after the first dose of the ChAdOx1 vaccine and both doses of BNT162b2. Although recall bias may have impacted the effect size, the direction of the results was not likely affected. Notoriety bias was another limitation of this study. We distributed the survey to almost all vaccine recipients; however, those who had few adverse effects may not have participated in the study. Likewise, the more serious the adverse effects experienced, the more the tendency may have been to complete the survey. A third limitation of this study was the relatively small study population. To compensate for this, a mixed effects model was used to increase the statistical power by assessing each vaccination dose separately for each participant. However, rare adverse effects, such as thromboembolism, could not be assessed due to the small sample size. There could have been other confounders, as the proportion of respondents was skewed toward women and medical staff. Multivariate modeling in the analysis of precipitating factors and work/daily life interference were performed to overcome this limitation. In the Republic of Korea, there are relatively few individuals who have been administered other vaccines, such as JNJ-78436735 and mRNA-1273; therefore, we could not analyze the adverse effects of vaccines other than ChAdOx1 and BNT162b2.
Currently, there is an excess of information on vaccinations and their side effects from various sources, much of which is incorrect and inaccurate. Accurate information specific to each country and region is scarce. Given that the dissemination of inaccurate information negatively affects vaccine acceptance [30], providing clear information based on local data is important and may increase vaccine acceptance. In this study, adverse effects and precipitating factors were identified and the associations between the vaccine and interference with daily life and work were evaluated.

5. Conclusions

In this study, adverse effects and interference with work and daily life after the ChAdOx1 and BNT162b2 COVID-19 vaccinations were analyzed. After the first and second doses of the vaccines, the mean numeric scale score for interference with work was 3.9 and 1.9 for the ChAdOx1 vaccine and 3.2 and 3.6 for the BNT162b2 vaccine, respectively. The degree of work interference caused by the first dose of the ChAdOx1 vaccine and both doses of the BNT162b2 vaccine was comparable, but it was lower than that after the second dose of the ChAdOx1 vaccine. Interference with daily life showed a similar trend. The factors associated with a lower rate of interference with work and daily life after vaccination were older age (50–59 years, ≥60 years) and second dose. Different patterns of interference with work and daily life were observed according to the dose (first or second) and the vaccine (ChAdOx1 or BNT162b2). The method used to report these results was intended to be easier for the public to understand intuitively, compared with studies that report the incidence of each side effect. Thus, these findings can be effective for risk communication and education regarding vaccinations.

Supplementary Materials

The following are available online at www.mdpi.com/article/10.3390/vaccines9080926/s1, Table S1: The association between severity of work and daily life interference and expression of each adverse effect after BNT162b2 vaccination.

Author Contributions

Conceptualization, C.P. and J.S.; Methodology, K.B.; Software, M.K.; Validation, C.P., S.J., and J.S.; Formal analysis, K.B.; Investigation, C.P.; Data curation, K.B.; Writing—original draft preparation, K.B.; Writing—review and editing, C.P.; Visualization, K.B.; Supervision, C.P.; Project administration, C.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the guidelines of the Declaration of Helsinki and was approved by the Institutional Review Board of the Yeungnam University Hospital (YUMC 2021-04-007-001) on 24 May 2021.

Informed Consent Statement

The survey included an explanation of the research purpose, and informed consent was obtained from all participants involved in this study.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author. The data are not publicly available due to restricted consent.

Conflicts of Interest

The authors have no conflict of interest to declare. The corresponding authors had full access to all the data and were responsible for the decision to submit this manuscript for publication.

References

  1. Korea Disease Control and Prevention Agency. Updates on COVID-19 in Republic of Korea (as of 15 June). Available online: http://kdca.go.kr (accessed on 16 June 2021).
  2. Bae, S.; Lee, Y.W.; Lim, S.Y.; Lee, J.-H.; Lim, J.S.; Lee, S.; Park, S.; Kim, S.-K.; Lim, Y.-J.; Kim, E.O.; et al. Adverse Reactions Following the First Dose of ChAdOx1 nCoV-19 Vaccine and BNT162b2 Vaccine for Healthcare Workers in South Korea. J. Korean Med. Sci. 2021, 36, e115. [Google Scholar] [CrossRef] [PubMed]
  3. Menni, C.; Klaser, K.; May, A.; Polidori, L.; Capdevila, J.; Louca, P.; Sudre, C.H.; Nguyen, L.H.; Drew, D.A.; Merino, J.; et al. Vaccine side-effects and SARS-CoV-2 infection after vaccination in users of the COVID Symptom Study app in the UK: A prospective observational study. Lancet Infect. Dis. 2021. [Google Scholar] [CrossRef]
  4. Long, B.; Bridwell, R.; Gottlieb, M. Thrombosis with thrombocytopenia syndrome associated with COVID-19 vaccines. Am. J. Emerg. Med. 2021, 49, 58–61. [Google Scholar] [CrossRef] [PubMed]
  5. Simpson, C.R.; Shi, T.; Vasileiou, E.; Katikireddi, S.V.; Kerr, S.; Moore, E.; McCowan, C.; Agrawal, U.; Shah, S.A.; Ritchie, L.D.; et al. First-dose ChAdOx1 and BNT162b2 COVID-19 vaccines and thrombocytopenic, thromboembolic and hemorrhagic events in Scotland. Nat. Med. 2021. [Google Scholar] [CrossRef]
  6. Ramasamy, M.N.; Minassian, A.M.; Ewer, K.J.; Flaxman, A.L.; Folegatti, P.M.; Owens, D.R.; Voysey, M.; Aley, P.K.; Angus, B.; Babbage, G.; et al. Safety and immunogenicity of ChAdOx1 nCoV-19 vaccine administered in a prime-boost regimen in young and old adults (COV002): A single-blind, randomised, controlled, phase 2/3 trial. Lancet 2020, 396, 1979–1993. [Google Scholar] [CrossRef]
  7. Voysey, M.; Clemens, S.A.C.; Madhi, S.A.; Weckx, L.Y.; Folegatti, P.M.; Aley, P.K.; Angus, B.; Baillie, V.L.; Barnabas, S.L.; Bhorat, Q.E.; et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: An interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet 2021, 397, 99–111. [Google Scholar] [CrossRef]
  8. Kim, S.-H.; Wi, Y.M.; Yun, S.Y.; Ryu, J.S.; Shin, J.M.; Lee, E.H.; Seo, K.H.; Lee, S.H.; Peck, K.R. Adverse Events in Healthcare Workers after the First Dose of ChAdOx1 nCoV-19 or BNT162b2 mRNA COVID-19 Vaccination: A Single Center Experience. J. Korean Med. Sci. 2021, 36, e107. [Google Scholar] [CrossRef]
  9. MacKrill, K.; Webster, R.; Rubin, G.J.; Witthöft, M.; Silvester, C.; Emad, Y.; Petrie, K.J. When symptoms become side effects: Development of the side effect attribution scale (SEAS). J. Psychosom. Res. 2021, 141, 110340. [Google Scholar] [CrossRef]
  10. Chae, J.; Mascarenhas, D.; Yu, D.T.; Kirsteins, A.; Elovic, E.P.; Flanagan, S.R.; Harvey, R.L.; Zorowitz, R.D.; Fang, Z.-P. Poststroke Shoulder Pain: Its Relationship to Motor Impairment, Activity Limitation, and Quality of Life. Arch. Phys. Med. Rehabil. 2007, 88, 298–301. [Google Scholar] [CrossRef]
  11. Jonsson Sjögren, J.; Kvist, T.; Eliasson, A.; Pigg, M.; EndoReCo. The frequency and characteristics of pain and discomfort associated with root filled teeth: A practice-based study. Int. Endod. J. 2019, 52, 1264–1273. [Google Scholar] [CrossRef]
  12. Oldenmenger, W.H.; de Raaf, P.J.; de Klerk, C.; van der Rijt, C.C.D. Cut Points on 0–10 Numeric Rating Scales for Symptoms Included in the Edmonton Symptom Assessment Scale in Cancer Patients: A Systematic Review. J. Pain Symptom Manag. 2013, 45, 1083–1093. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Dittmann, S. Vaccine safety: Risk communication—A global perspective. Vaccine 2001, 19, 2446–2456. [Google Scholar] [CrossRef]
  14. Modenese, A.; Paduano, S.; Bargellini, A.; Bellucci, R.; Marchetti, S.; Bruno, F.; Grazioli, P.; Vivoli, R.; Gobba, F. Neutralizing Anti-SARS-CoV-2 Antibody Titer and Reported Adverse Effects, in a Sample of Italian Nursing Home Personnel after Two Doses of the BNT162b2 Vaccine Administered Four Weeks Apart. Vaccines 2021, 9, 652. [Google Scholar] [CrossRef] [PubMed]
  15. Loftus, G.R. On interpretation of interactions. Mem. Cognit. 1978, 6, 312–319. [Google Scholar] [CrossRef] [Green Version]
  16. Lee, Y.W.; Lim, S.Y.; Lee, J.-H.; Lim, J.S.; Kim, M.; Kwon, S.; Joo, J.; Kwak, S.H.; Kim, E.O.; Jung, J.; et al. Adverse Reactions of the Second Dose of the BNT162b2 mRNA COVID-19 Vaccine in Healthcare Workers in Korea. J. Korean Med. Sci. 2021, 36, e153. [Google Scholar] [CrossRef]
  17. Shrestha, S.; Devbhandari, R.P.; Shrestha, A.; Aryal, S.; Rajbhandari, P.; Shakya, B.; Pandey, P.; Shrestha, R.K.; Gupta, M.; Regmi, A. Adverse events following the first dose of ChAdOx1 nCoV-19 (COVISHIELD) vaccine in the first phase of vaccine roll out in Nepal. J. Patan Acad. Health Sci. 2021, 8, 9–17. [Google Scholar] [CrossRef]
  18. Abu-Hammad, O.; Alduraidi, H.; Abu-Hammad, S.; Alnazzawi, A.; Babkair, H.; Abu-Hammad, A.; Nourwali, I.; Qasem, F.; Dar-Odeh, N. Side Effects Reported by Jordanian Healthcare Workers Who Received COVID-19 Vaccines. Vaccines 2021, 9, 577. [Google Scholar] [CrossRef] [PubMed]
  19. AlBahrani, S.; AlBarraK, A.; Alghamdi, O.A.; Hakami, F.H.; Al Abaadi, A.K.; Alkhrashi, S.A.; Alghamdi, M.Y.; Almershad, M.M.; Alenazi, M.M.; ElGezery, M.H. Safety and Reactogenicity of the ChAdOx1 (AZD1222) COVID-19 vaccine in Vaccinee in Saudi Arabia. J. Glob. Infect. Dis. 2021. [Google Scholar] [CrossRef]
  20. Kamal, D.; Thakur, V.; Nath, N.; Malhotra, T.; Gupta, A.; Batlish, R. Adverse events following ChAdOx1 nCoV-19 Vaccine (COVISHIELD) amongst health care workers: A prospective observational study. Med. J. Armed Forces India 2021, 77, S283–S288. [Google Scholar] [CrossRef]
  21. Hillus, D.; Schwarz, T.; Tober-Lau, P.; Hastor, H.; Thibeault, C.; Kasper, S.; Helbig, E.T.; Lippert, L.J.; Tscheak, P.; Schmidt, M.L. Safety, reactogenicity, and immunogenicity of homologous and heterologous prime-boost immunisation with ChAdOx1-nCoV19 and BNT162b2: A cohort study. Medrxiv 2021. [Google Scholar] [CrossRef]
  22. Kadali, R.A.; Janagama, R.; Peruru, S.; Malayala, S.V. Side effects of BNT162b2 mRNA COVID-19 vaccine: A randomized, cross-sectional study with detailed self-reported symptoms from healthcare workers. J. Glob. Infect. Dis. 2021, 106, 376–381. [Google Scholar]
  23. Huang, J.; Du, J.; Duan, R.; Zhang, X.; Tao, C.; Chen, Y. Characterization of the differential adverse event rates by race/ethnicity groups for HPV vaccine by integrating data from different sources. Front. Pharmacol. 2018, 9, 539. [Google Scholar] [CrossRef] [PubMed]
  24. Haralambieva, I.H.; Ovsyannikova, I.G.; Kennedy, R.B.; Larrabee, B.R.; Pankratz, V.S.; Poland, G.A. Race and sex-based differences in cytokine immune responses to smallpox vaccine in healthy individuals. Hum. Immunol. 2013, 74, 1263–1266. [Google Scholar] [CrossRef] [Green Version]
  25. Habersaat, K.B.; Jackson, C. Understanding vaccine acceptance and demand—and ways to increase them. Bundesgesundheitsblatt-Gesundh.-Gesundh. 2020, 63, 32–39. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Eyre, D.W.; Lumley, S.F.; Wei, J.; Cox, S.; James, T.; Justice, A.; Jesuthasan, G.; O’Donnell, D.; Howarth, A.; Hatch, S.B.; et al. Quantitative SARS-CoV-2 anti-spike responses to Pfizer-BioNTech and Oxford-AstraZeneca vaccines by previous infection status. Clin. Microbiol. Infect. 2021. [Google Scholar] [CrossRef] [PubMed]
  27. Knoll, M.D.; Wonodi, C. Oxford–AstraZeneca COVID-19 vaccine efficacy. Lancet 2021, 397, 72–74. [Google Scholar] [CrossRef]
  28. Leventhal, E.A.; Prohaska, T.R. Age, symptom interpretation, and health behavior. J. Am. Geriatr. Soc. 1986, 34, 185–191. [Google Scholar]
  29. Broderick, J.E.; Schwartz, J.E.; Vikingstad, G.; Pribbernow, M.; Grossman, S.; Stone, A.A. The accuracy of pain and fatigue items across different reporting periods. Pain 2008, 139, 146–157. [Google Scholar] [CrossRef]
  30. Walker, A.N.; Zhang, T.; Peng, X.-Q.; Ge, J.-J.; Gu, H.; You, H. Vaccine Acceptance and Its Influencing Factors: An Online Cross-Sectional Study among International College Students Studying in China. Vaccines 2021, 9, 585. [Google Scholar] [CrossRef]
Table 1. General characteristics of the study participants by vaccine type and dose.
Table 1. General characteristics of the study participants by vaccine type and dose.
ChAdOx1 (n = 368)BNT162b2 (n = 27)
First Dose (a)Second Dose (b)p-Value
(a vs. b)
First Dose (c)Second Dose (d)p-Value
(c vs. d)
p-Value (a vs. c)p-Value (b vs. d)
(n = 299)(n = 304) (n = 19)(n = 22)
Age (years)
20–2996 (32.1%)87 (28.6%)Reference11 (57.9%)10 (45.5%)Reference0.130.09
30–3956 (18.7%)56 (18.4%)0.68 4 (21.1%)7 (31.8%)0.39
40–4954 (18.1%)66 (21.7%)0.21 1 (5.3%)3 (13.6%)0.33
50–5981 (27.1%)83 (27.3%)0.57 3 (15.8%)2 (9.1%)0.76
≥6012 (4.0%)12 (3.9%)0.82 0 (0.0%)0 (0.0%)-
Sex
Male80 (26.8%)80 (26.3%)0.90 2 (10.5%)2 (9.1%)0.870.170.07
Female219 (73.2%)224 (73.7%) 17 (89.5%)20 (90.9%)
Previous illness
No243 (81.3%)244 (80.3%)0.7516 (84.2%)21 (95.5%)0.251.00 0.09
Yes56 (18.7%)60 (19.7%) 3 (15.8%)1 (4.5%)
Alcohol consumption
No132 (44.1%)136 (44.7%)0.889 (47.4%)11 (50.0%)0.870.780.63
Yes167 (55.9%)168 (55.3%) 10 (52.6%)11 (50.0%)
Smoking
No275 (92.0%)281 (92.4%)0.8317 (89.5%)21 (95.5%)0.480.701.00
Yes24 (8.0%)23 (7.6%) 2 (10.5%)1 (4.5%)
Exercise (>150 min/week)
No183 (61.2%)186 (61.2%)1.0012 (63.2%)15 (68.2%)0.740.870.51
Yes116 (38.8%)118 (38.8%) 7 (36.8%)7 (31.8%)
Job class 0.72
Other104 (34.8%)110 (36.2%) 2 (10.5%)4 (18.2%)0.49<0.050.09
Medical staff195 (65.2%)194 (63.8%) 17 (89.5%)18 (81.8%)
Shift work 0.22
No123 (41.1%)140 (46.1%) 3 (15.8%)4 (18.2%)0.84<0.05<0.05
Yes176 (58.9%)164 (53.9%) 16 (84.2%)18 (81.8%)
Participants who worked the day after receiving each vaccination dose were included separately for each dose. Some participants were included only for the first or second dose. A generalized linear mixed model was used to calculate the p-values of the repeated measures. An independent t-test was used to calculate the p-values of continuous variables for independent participants. Fisher’s exact test was used to calculate the p-values of categorical variables with <5 expected values in at least one category. Otherwise, the chi-square test was used to calculate the p-values. Previous illnesses include cardiovascular disease, endocrine disease, allergic diseases, and anemia. Nurses and doctors were classified as “medical staff.” Paramedics, office workers, facility workers, and other supportive workers in the hospital were classified as “other”.
Table 2. Adverse effects after the first and second doses of the ChAdOx1 and BNT162b2 vaccinations.
Table 2. Adverse effects after the first and second doses of the ChAdOx1 and BNT162b2 vaccinations.
ChAdOx1 (n = 368)BNT162b2 (n = 27)
First Dose (a)Second Dose (b)p-Value
(a vs. b)
First Dose (c)Second Dose (d)p-Value
(c vs. d)
p-Value (a vs. c)p-Value (b vs. d)
(n = 299)(n = 304) (n = 19)(n = 22)
Fever
No125 (41.8%)249 (81.9%)<0.000113 (68.4%)11 (50.0%)0.240.23<0.001
Yes174 (58.2%)55 (18.1%) 6 (31.6%)11 (50.0%)
Chills
No137 (45.8%)264 (86.8%)<0.000112 (63.2%)13 (59.1%)0.790.14<0.01
Yes162 (54.2%)40 (13.2%) 7 (36.8%)9 (40.9%)
Local pain
No94 (31.4%)130 (42.8%)<0.016 (31.6%)7 (31.8%)0.990.990.32
Yes205 (68.6%)174 (57.2%) 13 (68.4%)15 (68.2%)
Myalgia
No119 (39.8%)241 (79.3%)<0.000113 (68.4%)12 (54.5%)0.37<0.05<0.05
Yes180 (60.2%)63 (20.7%) 6 (31.6%)10 (45.5%)
Headache <0.0001
No164 (54.8%)236 (77.6%) 14 (73.7%)14 (63.6%)0.490.110.13
Yes135 (45.2%)68 (22.4%) 5 (26.3%)8 (36.4%)
Nausea <0.0001
No247 (82.6%)292 (96.1%) 18 (94.7%)20 (90.9%)0.640.220.24
Yes52 (17.4%)12 (3.9%) 1 (5.3%)2 (9.1%)
Vomiting <0.01
No284 (95.0%)301 (99.0%) 18 (94.7%)22 (100.0%)1.001.001.00
Yes15 (5.0%)3 (1.0%) 1 (5.3%)0 (0.0%)
Urticaria 0.41
No295 (98.7%)302 (99.3%) 19 (100.0%)22 (100.0%)-1.001.00
Yes4 (1.3%)2 (0.7%) 0 (0.0%)0 (0.0%)
Dyspnea <0.05
No289 (96.7%)303 (99.7%) 18 (94.7%)22 (100.0%)1.000.501.00
Yes10 (3.3%)1 (0.3%) 1 (5.3%)0 (0.0%)
Chest pain <0.05
No288 (96.3%)301 (99.0%) 19 (100.0%)22 (100.0%)-1.001.00
Yes11 (3.7%)3 (1.0%) 0 (0.0%)0 (0.0%)
Intake of PO antipyretics
No106 (35.5%)158 (52.0%)0.0013 (68.4%)9 (40.9%)0.08<0.010.38
Yes193 (64.5%)146 (48.0%) 6 (31.6%)13 (59.1%)
IV injection or fluid treatment 0.00
No271 (90.6%)301 (99.0%) 18 (94.7%)21 (95.5%)0.921.000.25
Yes28 (9.4%)3 (1.0%) 1 (5.3%)1 (4.5%)
Latency period for overall adverse effects (h)
Non-respondents34 (11.4%)71 (23.4%) 4 (21.1%)4 (18.2%) 0.60 0.72
<637 (12.4%)98 (32.2%) 6 (31.6%)8 (36.4%)
6–11151 (50.5%)88 (28.9%) 7 (36.8%)7 (31.8%)
12–2361 (20.4%)28 (9.2%) 2 (10.5%)3 (13.6%)
≥24 16 (5.4%)19 (6.2%) 0 (0.0%)0 (0.0%)
Duration of overall adverse effects (h) 0.24 0.15
Non-respondents32 (10.7%)74 (24.3%) 5 (26.3%)4 (18.2%)
<634 (11.4%)70 (23.0%) 1 (5.3%)1 (4.5%)
6–1144 (14.7%)26 (8.6%) 1 (5.3%)2 (9.1%)
12–2344 (14.7%)37 (12.2%) 3 (15.8%)3 (13.6%)
≥24145 (48.5%)97 (31.9%) 9 (47.4%)12 (54.5%)
Interference with work3.9 ± 2.91.6 ± 1.9<0.00013.2 ± 2.53.6 ± 3.00.570.30<0.0001
Interference with daily life4.2 ± 3.11.7 ± 2.1<0.00013.5 ± 2.83.7 ± 3.10.780.34<0.0001
Work performance5.9 ± 2.87.0 ± 3.2<0.00015.4 ± 2.94.8 ± 2.90.530.45<0.01
A generalized linear mixed model was used to calculate the p-values of the repeated measures. An independent t-test was used to calculate the p-values for continuous variables. The Fisher’s exact test was used to calculate the p-values of categorical variables with <5 expected values in at least one category. Otherwise, the chi-square test was used to calculate the p-values. Abbreviations: PO, per os (oral administration); IV, intravenous.
Table 3. Association between severity of interference with work and daily life and presence of each adverse effect after ChAdOx1 vaccination.
Table 3. Association between severity of interference with work and daily life and presence of each adverse effect after ChAdOx1 vaccination.
Interference with WorkInterference with Daily Life
TotalLow (0–4)High (5–10) Low (0–4)High (5–10)
(n = 603)(n = 442)(n = 161)p-value(n = 449)(n = 195)p-value
Fever229 (38.0%)111 (25.1%)118 (73.3%)<0.0001102 (24.1%)127 (70.9%)<0.0001
Chills202 (33.5%)90 (20.4%)112 (69.6%)<0.000182 (19.3%)120 (67.0%)<0.0001
Local pain379 (62.9%)245 (55.4%)134 (83.2%)<0.0001228 (53.8%)151 (84.4%)<0.0001
Myalgia243 (40.3%)117 (26.5%)126 (78.3%)<0.0001104 (24.5%)139 (77.7%)<0.0001
Headache 203 (33.7%)102 (23.1%)101(62.7%)<0.000191 (21.5%)112 (62.6%)<0.0001
Nausea64 (10.6%)25 (5.7%)39 (24.2%)<0.000121 (5.0%)43 (24.0%)<0.0001
Vomiting18 (3.0%)2 (0.5%)16 (9.9%)<0.00013 (0.7%)15 (8.4%)<0.0001
Urticaria6 (1.0%)5 (1.1%)1 (0.6%)0.675 (1.2%)1 (0.6%)0.54
Dyspnea11 (1.8%)2 (0.5%)9 (5.6%)<0.00011 (0.2%)10 (5.6%)<0.0001
Chest pain14 (2.3%)3 (0.7%)11 (6.8%)<0.00013 (0.7%)11 (6.1%)<0.0001
Degree of total adverse effects 3.5 ± 2.82.3 ± 2.16.6 ± 1.7<0.00012.2 ± 2.16.3 ± 1.9<0.0001
p-values were calculated using a generalized linear mixed model, with the dependency of the repeated measures of the participants considered as a random effect. The degree of total adverse effects was assessed using a 0–10 numeric scale. Abbreviations: CI, confidence interval.
Table 4. Univariate and multivariate analyses of the precipitating factors associated with interference with work and daily life after vaccination.
Table 4. Univariate and multivariate analyses of the precipitating factors associated with interference with work and daily life after vaccination.
Interference with WorkInterference with Daily Life
Univariate AnalysisMultivariate AnalysisUnivariate AnalysisMultivariate Analysis
OR (95% CI)p-ValueOR (95% CI)p-ValueOR (95% CI)p-ValueOR (95% CI)p-Value
Vaccine
ChAdOx1Reference Reference Reference Reference
BNT162b21.57 (0.69–3.60)0.28 0.26 (0.06–1.16)0.08 1.49 (0.68–3.25)0.320.25 (0.06–1.09)0.07
Dose
FirstReference Reference Reference Reference
Second0.09 (0.04–0.17)<0.00010.06 (0.03–0.13)<0.00010.11 (0.06–0.20)<0.00010.08 (0.04–0.16)<0.0001
Vaccine (BNT162b2) *
dose (second)
- 20.29
(3.13–130.32)
<0.05- 20.70
(3.32–129.02)
<0.05
Age (years)
20–29Reference Reference Reference Reference
30–390.85
(0.50–1.46)
0.571.01 (0.44–2.34)0.980.77
(0.45–1.31)
0.330.76 (0.34–1.68)0.50
40–490.38
(0.21–0.70)
<0.050.38 (0.15–0.98)0.450.46
(0.26–0.81)
<0.010.43 (0.18–1.02)0.06
50–590.25
(0.14–0.46)
<0.00010.22 (0.08–0.60)<0.010.32
(0.19–0.57)
<0.00010.25 (0.10–0.62)<0.01
≥600.06
(0.01–0.47)
<0.010.03 (0.00–0.43)<0.010.05
(0.01–0.43)
<0.010.03 (0.00–0.38)<0.01
Sex
MaleReference Reference Reference Reference
Female1.63
(0.97–2.72)
0.060.84 (0.37–1.93)0.691.72
(1.05–2.77)
<0.051.15 (0.53–2.48)0.72
Shift work
NoReference Reference Reference Reference
Yes2.34
(1.48–3.74)
<0.0011.79
(0.88–3.60)
0.111.57
(1.03–2.39)
<0.050.94 (0.50–1.79)0.86
Job class
OtherReference Reference Reference Reference
Medical staff2.39
(1.46–3.94)
<0.0011.75
(0.79–3.90)
0.112.10
(1.32–3.29)
<0.011.54 (0.74–3.16)0.25
Alcohol consumption
NoReference - Reference -
Yes0.80
(0.52–1.23)
0.31- 1.02
(0.68–1.54)
0.93-
Current smoker
NoReference - Reference -
Yes1.17
(0.53–2.61)
0.69- 1.09
(1.32–3.29)
0.81-
Exercise (>150 min/week)
NoReference - Reference -
Yes0.74
(0.47–1.16)
0.19- 1.00
(0.66–1.52)
0.99-
p-values and ORs were calculated using a generalized linear mixed model (logit link). For the dependent variable, “low” and “high” interference was defined as 0–4 and 5–10 for each questionnaire, respectively, divided by the median value 4. The OR was calculated as the odds of “high” interference over “low” interference. Abbreviations: OR, odds ratio; CI, confidence interval.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Park, C.; Sakong, J.; Jo, S.; Kim, M.; Baek, K. Adverse Effects on Work and Daily Life Interference among Healthcare Workers after the First and Second ChAdOx1 and BNT162b2 COVID-19 Vaccine Doses. Vaccines 2021, 9, 926. https://doi.org/10.3390/vaccines9080926

AMA Style

Park C, Sakong J, Jo S, Kim M, Baek K. Adverse Effects on Work and Daily Life Interference among Healthcare Workers after the First and Second ChAdOx1 and BNT162b2 COVID-19 Vaccine Doses. Vaccines. 2021; 9(8):926. https://doi.org/10.3390/vaccines9080926

Chicago/Turabian Style

Park, Chulyong, Joon Sakong, Seongmin Jo, Minkeun Kim, and Kiook Baek. 2021. "Adverse Effects on Work and Daily Life Interference among Healthcare Workers after the First and Second ChAdOx1 and BNT162b2 COVID-19 Vaccine Doses" Vaccines 9, no. 8: 926. https://doi.org/10.3390/vaccines9080926

APA Style

Park, C., Sakong, J., Jo, S., Kim, M., & Baek, K. (2021). Adverse Effects on Work and Daily Life Interference among Healthcare Workers after the First and Second ChAdOx1 and BNT162b2 COVID-19 Vaccine Doses. Vaccines, 9(8), 926. https://doi.org/10.3390/vaccines9080926

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop