Next Article in Journal
Hesitancy of Arab Healthcare Workers towards COVID-19 Vaccination: A Large-Scale Multinational Study
Next Article in Special Issue
A Comparison of the Level of Acceptance and Hesitancy towards the Influenza Vaccine and the Forthcoming COVID-19 Vaccine in the Medical Community
Previous Article in Journal
Shooting from the ‘Scrip: Scope of Practice Laws and Access to Immunizations in the Pharmacy Setting
Previous Article in Special Issue
Acceptance of COVID-19 Vaccination among Front-Line Health Care Workers: A Nationwide Survey of Emergency Medical Services Personnel from Germany
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Intention to Receive the COVID-19 Vaccine in China: Insights from Protection Motivation Theory

1
School of Business Administration, Jiangsu Vocational Institute of Commerce, Nanjing 211168, China
2
Dong Fureng Economic and Social Development School, Wuhan University, Beijing 100010, China
3
Center for Health Economics and Management at School of Economics and Management, Wuhan University, Wuhan 430072, China
4
Australian National Institute of Management and Commerce, Eveleigh, Sydney, NSW 2015, Australia
5
Research Institute for International Strategies, Guangdong University of Foreign Studies, Guangzhou 510420, China
6
School of Economics and School of Management, Tianjin Normal University, Tianjin 300074, China
7
Newcastle Business School, University of Newcastle, Newcastle, NSW 2308, Australia
8
School of Management, University of Liverpool, Chatham Building, Chatham Street, Liverpool L697ZH, UK
9
School of Political Science and Public Administration, Institute of Governance, Shandong University, Qingdao 266237, China
10
School of Health Policy & Management, Nanjing Medical University, Nanjing 211166, China
11
Center for Global Health, Nanjing Medical University, Nanjing 211166, China
*
Author to whom correspondence should be addressed.
Vaccines 2021, 9(5), 445; https://doi.org/10.3390/vaccines9050445
Submission received: 27 March 2021 / Revised: 27 April 2021 / Accepted: 29 April 2021 / Published: 2 May 2021
(This article belongs to the Special Issue SARS-CoV-2 (COVID-19) Vaccination and Compliance/Hesitancy)

Abstract

:
(1) Background: More coronavirus disease 2019 (COVID-19) vaccines are gradually being developed and marketed. Improving the vaccination intention will be the key to increasing the vaccination rate in the future; (2) Methods: A self-designed questionnaire was used to collect data on COVID-19 vaccination intentions, protection motivation and control variables. Pearson Chi-square test and multivariate ordered logistic regression models were specified to analyze the determinants of intention to receive COVID-19 vaccine; (3) Results: Although the vaccine was free, 17.75% of the 2377 respondents did not want, or were hesitant, to receive the COVID-19 vaccine. Respondents’ cognition of vaccine safety, external reward and response efficacy were positively related to COVID-19 vaccination intention, while age, income and response cost were negatively related to the intention to receive the COVID-19 vaccine. Professionals and people without medical insurance had the lowest intention to vaccinate; (4) Conclusions: The older aged, people without health insurance, those with higher incomes and professionals should be treated as the key intervention targets. Strengthening publicity and education about the safety and efficacy of COVID-19 vaccines, training vaccinated people and community leaders as propagandists for the vaccine, and improving the accessibility to the COVID-19 vaccine are recommended to improve COVID-19 vaccination intention.

1. Introduction

Corona Virus Disease 2019 (COVID-19) may be one of the most serious infectious diseases in human history, with over 119.2 million infected cases, and over 3 million deaths reported by World Health Organization as of 15 April 2021 [1]. COVID-19 vaccination programs covering the entire population will be the main way that countries control and prevent COVID-19. Vaccine hesitancy presents the major challenge for national vaccination campaigns, but the intention to COVID-19 vaccinate is poorly understood. High vaccine hesitancy rates, ranging from 14% to 30% have been variously reported in the United States of America [2], France [3], Japan [4], Canada [5] and the United Kingdom [6,7]. Even among healthcare professionals (HCP), the hesitancy rate for COVID-19 vaccinate has been reported at 24% in France, with only 64.4% HCP in Greece and 34.9% in the Republic of Cyprus intending to vaccinate [8,9]. Utilizing protection motivation theory (PMT), this paper analyzes the intention to COVID-19 vaccinate in China. PMT provides a widely used analytical framework to identify the determinants of vaccination behavior and vaccination willingness [10,11,12,13,14,15,16,17,18,19,20,21]. By providing a comprehensive theoretical framework on vaccination intentions, the paper not only reveals the factors determining the intention to vaccinate in China, but also informs policy makers on how to structure effective COVID-19 information campaigns to maximize the vaccine take-up.
Developed by Rogers in 1975 [22], protection motivation theory (PMT) argues that individuals are motivated to react in a self-protected way to perceived health threats. As shown in Figure 1, based on information, such as the environmental context and individual characteristics, the protection motivation decision involves two appraisal processes: threat appraisal and coping appraisal [22]. Threat appraisal depends on the individuals’ cognition of the threat, including the severity of the threat, one’s vulnerability, internal rewards and external rewards. Severity refers to people’s cognition of the magnitude of the harm caused by health hazards, such as COVID-19; vulnerability refers to individual’s perception of the possibility of suffering harm when they exposed to the health threat, such as the possibility of catching COVID-19; internal rewards refers to individual’s self-satisfaction after taking an action to protect from the health threat; external rewards refers to cost–benefit factors external to the individual, such as family, friends and the wider society of taking harm reduction through, for example, the COVID-19 vaccination [22]. The coping appraisal process evaluates an individual’s ability to cope with and avert the threatened health danger through self-efficacy, response efficacy and response cost [23]. Self-efficacy is the belief that one is, or is not, capable of harm reduction action, such as taking the COVID-19 vaccine [24]; response efficacy refers to one’s belief that taking a harm reduction action, such as COVID-19 vaccination, will be effective in health harm reduction; response cost are the barriers to taking protective behavior, measured by vaccine costs, vaccination knowledge and side-effect concerns.
PMT has been shown to be a powerful framework for behavior interpretation, intervention and prediction research on health harm reduction in China, the United States, Thailand, New Zealand, and Australia [10,11,12,13,14]. It has also been widely used to analyze the determinants of vaccination behavior and vaccination willingness [15,16,17]. For example, analyzing hepatitis B virus (HBV) vaccination behavior and willingness of Chinese migrant workers, Liu et al. found that vulnerability and response efficacy were significant determinants of HBV vaccination behavior, and vulnerability and self-efficacy were significant determinants of HBV vaccination willingness [18]. Among migrant workers in Tianjin, Liu et al. found that severity and self-efficacy were positively, and response cost negatively, related to HBV vaccination intention [19]. Ling et al. (2019) analyzed the intention to receive the seasonal influenza vaccine among 547 residents in the United States, and found that severity, susceptibility, the maladaptive response reward, self-efficacy, and response efficacy were unique determinants of vaccination intention, and the PMT factors explained 62% of the variance in intention to vaccinate [20]. A study in Switzerland showed that response efficacy was directly related to parents’ intention to adhere to measles, mumps and rubella (MMR) vaccination recommendations among parents of middle school students aged 13–15 [21]. Ling et al. used the PMT to predict the intention to receive the seasonal influenza vaccine, and found that severity of and susceptibility to influenza, the perceived benefits of not vaccinating, the self-efficacy to vaccinate, and the response efficacy were significant predictors of intention and the PMT variables accounted for 62% of the variance [20].
There has been a small number of COVID-19 PMT studies, including 734 healthcare workers in Iran [25], 649 Filipinos answering an online questionnaire [26], and 3145 students from 43 universities in China [27]. The online survey of Chinese students found that the perceived severity of COVID-19 was positively associated with motivation to have COVID-19 vaccination and receiving COVID-19 information from medical personnel was associated with greater self-efficacy, response efficacy, and knowledge, whereas receiving information concerning COVID-19 vaccination from coworkers/colleagues was associated with less response efficacy and knowledge. Although PMT has been proved to be a robust analytical framework to predict the vaccination intention and its determinants, there has been no nationwide study using PMT to analyze the determinant of residents’ intention to receive the COVID-19 vaccine in China. Covering all occupations, rural–urban and geographic regions, age, sex, income, education level and specifying a full PMT model, this paper analyzes factors determining the intention to vaccinate in China.

2. Materials and Methods

2.1. Sampling Method

Based on previous related research [18], a questionnaire was designed to collect information on COVID-19 vaccination intentions, PMT factors and control variables, such as age, sex, occupation and health. Nine provinces were selected randomly from China’s 27 provinces, with equal numbers from the eastern, central and western region and equal numbers of low, medium and high GDP based on based on each province’s 2019 GDP. Three cities were selected randomly from each province according to their 2019 GDP rank. All investigators were recruited from local colleges or universities and they received standardized training before commencing the investigation. Snowball sampling was applied with 100 participants interviewed face-to-face (or through online video for respondents required to home quarantine) in each city. The investigators were asked to choose respondents with equal numbers of males and females and urban and rural residents in a 3:2 ratio to reflect the national urban–rural distribution. The survey was conducted during the first two weeks of June 2020. All respondents were informed about the survey purpose and signed the informed consent form before the interview. A total of 2700 adults aged over 18 years old were interviewed. After deleting invalid cases with missing data, the final sample of 2377 respondents represented an 88.04% response rate.

2.2. Measurement of Intention to Receive COVID-19 Vaccine

The Chinese government has made the COVID-19 vaccine free, with high risk individuals receiving the vaccine first [28]. As of April 2021, over 190 million Chinese have received the same COVID-19 vaccine, with only 0.002% serious adverse reactions reported in Hong Kong and similar rates in mainland China [29]. The intention to receive the COVID-19 vaccine was measured by a one-item question: “Would you like to receive the COVID-19 vaccine if the vaccine is free?” with three answers, “No” (0), “it depends” (1) and “Yes” (2) representing the COVID-19 vaccination intention from low to high commitment.

2.3. Measurement of PMT Factors

Table 1 shows the one-item question to measure each PMT factor, with respondents replying on a three-point scale: “disagree” (0), “neutral” (1) and “agree” (2).

2.4. Measurement of Control Variables

The control variables included sex, age groups, average monthly income groups, education level, occupation, medical insurance, urban or rural residence, self-rated health level, east–west–central region, and respondents’ awareness of COVID-19 vaccine efficacy, safety and infection risk. Occupations were categorized into professionals (including physicians, teachers and civil servants), farmers, migrant workers, self-employed, unemployed, students, the retired and other. Self-rated health level was classified into, “bad”, “medium” and “good”, based on the question: “How is your health status compared to your peers?” A single-choice question was used to measure respondents’ awareness of vaccine safety, “Do you believe COVID-19 vaccine is safe?”, and coded “don’t agree—low safety”, “neutral attitude—medium safety” and “agree—high safety”.

2.5. Statistical Analyses

The database was built by using software EpiData 3.1 (The EpiData Association, Denmark), with all data double-entered and checked for consistency, and STATA 12.0 (StataCorp., College Station, Texas TX, USA) used for statistical analysis. Pearson chi-square test was used to compare the differences in COVID-19 vaccination intentions among subgroups and multivariate ordered logistic regression models, and the odds ratio (OR), were used to assess the associations between each independent variable and the COVID-19 vaccination intention. The underlying hypothesis of the study is that the control variables and PMT factors had significant influence (p < 0.05) on participants’ COVID-19 vaccination intention.

3. Results

3.1. Statistical Description of Respondents’ Characteristics and PMT Factors

Table 2 displays the characteristics of 2377 participants. The median age was 35 years old; broadly equal number of males (48.55%) and females (51.45%); the ratio of urban (61.51%) and rural (38.49%) respondents close to the Chinese national urban–rural 3:2 ratio. The median monthly income was RMB 5000, with the percentage in each income group broadly equal. Roughly two-thirds (61.93%) of respondents had a below high school education level; 29.9% were professionals, 26.88% students, 12.16% migrant workers; 96.93% of participants reported their self-rated health as “medium or good”; only 3.7% had no medical insurance; the distribution across eastern (31.47%) central (28.86%) and western (39.67%) regions were roughly equal. Most participants believed the COVID-19 vaccine was safe at a medium or high level (82.41%) and overwhelmingly agreed that COVID-19 was a serious disease (91.67%). A quarter of respondents believed that they, their relatives and friends could be infected by COVID-19; 46.87% believed that they would not be restricted in their travel by COVID-19 after receiving the vaccine; 63.4% believed their relatives and friends would receive COVID-19 vaccine. Most respondents believed that they had the ability to receive the COVID-19 vaccine (77.96%) and that the COVID-19 vaccine would be effective against COVID-19 (86.62%). Only 14.51% believed going to receive the COVID-19 vaccine would waste time and delay their work. As shown in Figure 2, 82.25% intended to receive the COVID-19 vaccine, but 14.05% were hesitant to vaccinate and 3.7% did not want to get vaccinated.

3.2. Results of Pearson Chi-Square Test

Table 2 illustrates the intention to receive COVID-19 vaccine by subgroups. The percentage of people who did not want the COVID-19 vaccine was highest in the over 58 years old group (7.2%) and lowest in the 18–27 years old group (2.3%) (p = 0.001). The COVID-19 vaccination intention rate decreased with rising income, with the lowest vaccination intention in the highest income group (78.97%) (p = 0.004). Respondents with the lowest education level (lower than high school education) had a significantly higher intention (83.42%) to receive the COVID-19 vaccine than respondents who had a high school and above education (80.33%, p = 0.021). Among all occupations, professionals had the lowest intention (78.95%) and farmers had the highest intention (88.85%) to COVID-19 vaccinate (p = 0.001). The respondents who had medical insurance (82.66%) had a higher intention of vaccinating than the noninsured respondents (71.59%, p = 0.015). Respondents from the central region (83.53%) had the highest intention to revive the COVID-19 vaccine, followed by the western area (82.61%) and then the more affluent eastern area (80.61%, p = 0.034). The vaccination intention increased significantly with participants’ increased awareness of vaccine safety (p < 0.001).
There were significant differences across all PMT subgroups (p < 0.05). The percentage of respondents who did not want to receive COVID-19 vaccine decreased with an increased level of severity, internal reward, external reward, self-efficacy and response efficacy, but increased with increased response cost level (p < 0.001). Those participants who agreed that they and people around them might get COVID-19 in the future had the highest intention to receive the COVID-19 vaccine (84.33%), followed by the disagree group (82.57%) and neutral group (79.85%) (p = 0.013).

3.3. Results of Multivariate Ordered Logistic Regressions

Table 3 shows the results of multivariate ordered logistic regression models, specified to analyze the relationship between intention to receive the COVID-19 vaccine and the independent variables. The independent variables in Model 1 comprised only the control variables, while Model 2 specified both the PMT factors and the control variables. The value of log likelihood and pseudo R2 in Model 2 (Log likelihood = −1116.2274, Pseudo R2 = 0.1592) were lager than that in Model 1 (Log likelihood = −1203.4388, Pseudo R2 = 0.0935), so Model 2, with the PMT factors, performed better at explaining the intention to receive the COVID-19 vaccine.
Among the control variables, sex, education level, urban–rural residence, self-rated health and region had no influence on respondents’ intention to receive the COVID-19 vaccine (p > 0.05). Respondents in all age groups, except those 28–37 age years old, had a higher intention to receive COVID-19 vaccine than the 18–27 age group, and the intention to vaccinate decreased as age increased (OR = 0.637 (age 38–47), OR = 0.594 (age 48–57), OR = 0.471 (age 58+), p < 0.05). Respondents in the low income group had a higher intention to vaccinate than the high income group (OR = 1.705, p = 0.002); farmers had a higher intention to receive the COVID-19 vaccine than professionals (OR = 2.134, p = 0.005); those without medical insurance had a lower COVID-19 vaccination intention than the insured (OR = 0.584, p = 0.049). The intention to vaccinate was higher by respondents who perceived the COVID-19 vaccine had high safety than respondents who perceived the vaccine had a low safety (OR = 0.546, p < 0.001).
Among the PMT variables in Model 2, severity, vulnerability, internal reward and self-efficacy had no influence on respondents’ intention to receive the COVID-19 vaccine (p > 0.05). There was a significant association between intention to receive the COVID-19 vaccine and external reward, response efficacy and response cost (p < 0.05). The respondents who agree with the external reward description were more likely to receive the COVID-19 vaccine than respondents who disagree (OR = 4.519, p < 0.001). The vaccination intention increased as response efficacy increased (neutral: OR = 3.105, p = 0.041; agree: OR = 5.768, p = 0.001), but deceased as response cost increased (neutral: OR = 0.749, p = 0.047; agree: OR = 0.5, p < 0.001).

4. Discussion

Based on protection motivation theory, the intention to receive the COVID-19 vaccine and its influencing factors were analyzed. The outcomes can guide COVID-19 vaccine uptake and shape vaccination policy. The COVID-19 vaccination intention rate was 82.25%, but 17.75% of respondents did not want, or hesitated, to receive the free COVID-19 vaccine. The vaccination intention rate was higher than that reported in Hong Kong (from 34.8% to 44.2%) and in an online survey in China (54.6%) [30,31]. Lower COVID-19 vaccination rates also were reported in other Asian countries with 65.7% of participants indicating a willingness to be vaccinated against COVID-19 in Japan [4], 53.1% in Kuwait [32], 78.3% in Indonesia [33] and 64.7% in Saudi Arabia [34]. A multi-country survey in Europe showed on average 73.9% respondents from Germany, the United Kingdom, Denmark, the Netherlands, France, Portugal and Italy were willing to receive the COVID-19 vaccine. In North America, over half of Canadians were very likely (57.5%) to get a COVID-19 vaccine when it becomes available and 19.0% reported that they were somewhat likely to get vaccinated [5]. A online survey in the United States showed that 69% of participants intent to get vaccinated against COVID-19 [35]. In South America, 90.6% of participants indicated they were willing to pay for a COVID-19 vaccine in Chile [36], and a survey in Ecuador showed that at least 97% of individuals were willing to accept a COVID-19 vaccine, and at least 85% were willing to pay for that vaccine [37]. In Australia, 85.8% of respondents would get the COVID-19 vaccine [38], but in the Congo only 27.7% of health care workers said that they would accept a COVID-19 vaccine [39].
Age, income, occupation, medical insurance, vaccine safety, external reward, response efficacy and response cost were significant influencing factors of the intention to receive the COVID-19 vaccine. Sex, education level, urban–rural residence, self-rated health, region, severity, vulnerability, internal reward and self-efficacy were not significant factors in the intention to vaccinate.
For the agree to vaccinate group, the most important determinants to vaccinate was PMT response efficacy (OR = 5.768), followed by vaccine safety (OR = 5.546 for the high safety level group) and external reward (OR = 4.519 for the agree group). These results were consistent with previous studies which found respondents’ perception of the potential risk and harm of the COVID-19 vaccine decreased the intention to get vaccinated [32,35], while the perceived effectiveness of the vaccine increased vaccination intention [30,40,41,42]. Previous research on HBV [43], MMR [21] and seasonal influenza [20] vaccination intentions also found that response efficacy was a unique determinant of vaccination intention. To increase the vaccination rate, a publicity and education campaign about the safety and efficacy of COVID-19 vaccines would strength public trust in COVID-19 vaccines, increasing vaccination intentions [44,45,46]. Since urban–rural residence and region had no influence on respondents’ vaccination intention, education campaigns should be national. News, even negative news, about COVID-19 vaccines should be reported accurately, not exaggerated or sensationalized. External reward indicated that respondents’ intention to receive the COVID-19 vaccine was influenced by the viewpoint of family members, relatives and friends. We recommend using respected members of the community, such as community leaders or professionals, as well as vaccinated people, as propagandists for vaccinations to influence the population to vaccinate. Response cost indicated that the increased cost of vaccination, such as lost work time and travel time, decreased the intention to get COVID-19 vaccinated. This finding was similar to previous studies of HBV vaccination intention, which found that response cost was negatively related to intention to receive the HBV vaccine [19]. We recommended that improving the accessibility to the COVID-19 vaccinate to increase the population’s vaccination intention, such as increasing the number of vaccination sites to reduce commuting time.
Even though the COVID-19 vaccine was free, the intention to COVID-19 vaccinate for respondents without medical insurance was only half those with medical insurance. Other COVID-19 research also found that vaccine acceptance was higher among the U.S. private or public health insured than those without health insurance [35]. The effect of age, income and occupation on intention to COVID-19 vaccinate was different from other studies. We found that the intention to COVID-19 vaccinate decreased with age, except for the 28–37 years old age group. In contrast, Japanese and U.S. studies found that the older age respondents had a higher intention to COVID-19 vaccinate than younger people [4,47]. In part, this can be explained by the evidence that the likelihood of COVID-19 infection and mortality from COVID-19 increased with age [48], so measures need to be implemented to increase the COVID-19 vaccination intention of the older aged. Our model showed that professionals had the lowest intention to COVID-19 vaccinate, while farmers had the highest vaccination intention. Additionally, different from other studies [33,37,49] was that respondents with lower income had a higher intention to receive COVID-19 vaccine than respondents in the high income group. The different effect of income and occupation on COVID-19 vaccination intention might reflect that the COVID-19 vaccination was free. Respondents with lower socioeconomic status are more sensitive to vaccination cost, so are more willing to vaccinate. We recommend that the older aged, people without health insurance, those with higher incomes and professionals should be the key intervention targets to improve vaccination intentions.

Strengths and Limitations

The strengths of this study are as follows. First, we used PMT, which provides a robust, well-tested and full model to explain the cognitive mediation process of behavioral change in terms of threat and coping appraisal. In a nationwide study, our PMT model analyzed the determinants of intention to receive the COVID-19 vaccine with all seven PMT factors included. Second, COVID-19 vaccination intentions were analyzed under China’s free vaccine context. Third, the data were collected from the eastern, central and western regions as well as rural and urban areas. Lastly, respondents were interviewed face-to-face or through online video, which enhanced data accuracy compared to online questionnaire surveys.
There are two major limitations. First, only one question was set to evaluate respondents’ intention to receive the COVID-19 vaccine and each PMT factor. A more complex measurement method for PMT factors should be developed in further studies. Second, future studies should collect larger datasets.

5. Conclusions

Our PMT model found that 18% of respondents did not want, or were hesitated to get, the free COVID-19 vaccination. There were significant correlations between key control variables (age, income, occupation, medical insurance, and vaccine safety), PMT factors (external reward, response efficacy and response cost) and respondents’ intention to COVID-19 vaccinate. Perception of the vaccine’s safety, external reward and response efficacy were positively related to COVID-19 vaccination intention, while age, income and response cost were negatively related to the intention to receive the COVID-19 vaccine. Professionals had the lowest COVID-19 vaccination intention among all occupations, and people without medical insurance had a lower intention to vaccinate than those with medical insurance. When the COVID-19 vaccine is free, strengthening publicity and education about the safety and efficacy of COVID-19 vaccines, for example using vaccinated respected leaders as propagandists, and improving the accessibility to COVID-19 vaccination centers are recommended actions to improve COVID-19 vaccination intentions. The older aged, people without health insurance, those with higher incomes and professionals should be the key intervention targets.

Author Contributions

Conceptualization, R.L. and L.L. and J.W.; methodology, R.L. and L.L.; software, R.L. and L.L.; validation, S.N. and J.W. and R.L.; formal analysis, R.L. and L.L.; investigation, R.L. and A.L.; resources, J.W. and A.L. and R.L.; data curation, R.L. and L.L.; writing—original draft preparation, R.L. and L.L.; writing—review and editing, S.N. and E.M. and J.W.; supervision, J.W.; project administration, J.W. and A.L. and R.L.; funding acquisition, R.L. and A.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Natural Science Foundation of China, grant number 71904089; China Postdoctoral Science Foundation, grant number 2019M662392; Qingdao Postdoctoral Foundation.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Nanjing Medical University (protocol code Nanjing Medical University Ethical Audit (2020) Number 565 and 16 June 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to multi-cooperation with Wuhan University, Shandong University and Nanjing Medical University. The corresponding author will facilitate a discussion with these three universities for data access on a reasonable request.

Acknowledgments

The authors thank reviewers for their constructive comments and thank all interviewers from the nine sample provinces for their contribution to the survey.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Coronavirus Disease (COVID-2019) Situation Reports. Available online: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports (accessed on 20 March 2021).
  2. The Associated Press and NORC Expectations for a COVID-19 Vaccine. Available online: https://apnorc.org/projects/expectations-for-a-covid-19-vaccine/ (accessed on 19 April 2021).
  3. COCONEL Group. A future vaccination campaign against COVID-19 at risk of vaccine hesitancy and politicisation. Lancet Infect. Dis. 2020, 20, 769–770. [Google Scholar] [CrossRef]
  4. Yoda, T.; Katsuyama, H. Willingness to Receive COVID-19 Vaccination in Japan. Vaccines 2021, 9, 48. [Google Scholar] [CrossRef] [PubMed]
  5. Frank, K.; Arim, R.G. Canadians’ Willingness to Get a COVID-19 Vaccine: Group Differences and Reasons for Vaccine Hesitancy. 2020. Available online: https://www150.statcan.gc.ca/n1/pub/45-28-0001/2020001/article/00073-eng.htm (accessed on 26 March 2021).
  6. Sherman, S.M.; Smith, L.E.; Sim, J.; Amlôt, R.; Cutts, M.; Dasch, H.; Rubin, G.J.; Sevdalis, N. COVID-19 vaccination intention in the UK: Results from the COVID-19 Vaccination Acceptability Study (CoVAccS), a nationally representative cross-sectional survey. Hum. Vaccines Immunother. 2020. [Google Scholar] [CrossRef]
  7. Paul, E.; Steptoe, A.; Fancourt, D. Attitudes towards vaccines and intention to vaccinate against COVID-19: Implications for public health communications. Lancet Reg. Health. Eur. 2021, 1, 100012. [Google Scholar] [CrossRef]
  8. Raftopoulos, V.; Iordanou, S.; Katsapi, A.; Dedoukou, X.; Maltezou, H.C. A comparative online survey on the intention to get COVID-19 vaccine between Greek and Cypriot healthcare personnel: Is the country a predictor? Hum. Vaccines Immunother. 2021. [Google Scholar] [CrossRef] [PubMed]
  9. Gagneux-Brunon, A.; Detoc, M.; Bruel, S.; Tardy, B.; Rozaire, O.; Frappe, P.; Botelho-Nevers, E. Intention to get vaccinations against COVID-19 in French healthcare workers during the first pandemic wave: A cross sectional survey. J. Hosp. Infect. 2020, 108, 168–173. [Google Scholar] [CrossRef]
  10. Bassett, S.F.; Prapavessis, H. A test of an adherence-enhancing adjunct to physiotherapy steeped in the protection motivation theory. Physiother. Theory Pract. 2011, 27, 360–372. [Google Scholar] [CrossRef] [PubMed]
  11. Boer, H.; Emons, P.A.A. Accurate and inaccurate HIV transmission beliefs, stigmatizing and HIV protection motivation in northern Thailand. AIDS Care 2004, 16, 167–176. [Google Scholar] [CrossRef]
  12. Fisher, A.; Bonner, C.; Biankin, A.V.; Juraskova, I. Factors influencing intention to undergo whole genome screening in future healthcare: A single-blind parallel-group randomised trial. Prev. Med. Int. J. Devoted Pract. Theory 2012, 55, 514–520. [Google Scholar] [CrossRef]
  13. Prestwich, A.; Ayres, K.; Lawton, R. Crossing two types of implementation intentions with a protection motivation intervention for the reduction of saturated fat intake: A randomized trial. Soc. Sci. Med. 2008, 67, 1550–1558. [Google Scholar] [CrossRef] [Green Version]
  14. Yan, Y.; Jacques-Tiura, A.J.; Chen, X.; Xie, N.; Chen, J.; Yang, N.; Gong, J.; MacDonell, K.K. Application of the Protection Motivation Theory in predicting cigarette smoking among adolescents in China. Addict. Behav. 2014, 39, 181–188. [Google Scholar] [CrossRef] [Green Version]
  15. Bodenheimer, H.C.J.; Fulton, J.P.; Kramer, P.D. Acceptance of hepatitis B vaccine among hospital workers. Am. J. Public Health 1986, 76, 252–255. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Rosenthal, S.L.; Kottenhahn, R.K.; Biro, F.M.; Succop, P.A. Hepatitis B vaccine acceptance among adolescents and their parents. J. Adolesc. Health 1995, 17, 248–254. [Google Scholar] [CrossRef]
  17. Zimet, G.D.; Blythe, M.J.; Fortenberry, J.D. Vaccine characteristics and acceptability of HIV immunization among adolescents. Int. J. STD AIDS 2000, 11, 143–149. [Google Scholar] [CrossRef] [PubMed]
  18. van der Veen, Y.J.; van Empelen, P.; Looman, C.W.; Richardus, J.H. Social-cognitive and socio-cultural predictors of hepatitis B virus-screening in Turkish migrants, the Netherlands. J. Immigr. Minor. Health 2014, 16, 811–821. [Google Scholar] [CrossRef] [PubMed]
  19. Liu, C.; Nicholas, S.; Wang, J. The association between protection motivation and hepatitis b vaccination intention among migrant workers in Tianjin, China: A cross-sectional study. BMC Public Health 2020, 20, 1219. [Google Scholar] [CrossRef] [PubMed]
  20. Ling, M.; Kothe, E.J.; Mullan, B.A. Predicting intention to receive a seasonal influenza vaccination using Protection Motivation Theory. Soc. Sci. Med. 2019, 233, 87–92. [Google Scholar] [CrossRef] [Green Version]
  21. Camerini, A.-L.; Diviani, N.; Fadda, M.; Schulz, P.J. Using protection motivation theory to predict intention to adhere to official MMR vaccination recommendations in Switzerland. SSM Popul. Health 2019, 7, 100321. [Google Scholar] [CrossRef]
  22. Rogers, R.W. A Protection Motivation Theory of Fear Appeals and Attitude Change1. J. Psychol. 1975, 91, 93–114. [Google Scholar] [CrossRef]
  23. Floyd, D.L.; Prentice-dunn, S.; Rogers, R.W. A Meta-Analysis of Research on Protection Motivation Theory. J. Appl. Soc. Psychol. 2000, 30, 407. [Google Scholar] [CrossRef]
  24. Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychol. Rev. 1977, 84, 191–215. [Google Scholar] [CrossRef] [PubMed]
  25. Barati, M.; Bashirian, S.; Jenabi, E.; Khazaei, S.; Karimi-Shahanjarini, A.; Zareian, S.; Rezapur-Shahkolai, F.; Moeini, B. Factors Associated with Preventive Behaviours of COVID-19 among Hospital Staff in Iran in 2020: An Application of the Protection Motivation Theory. J. Hosp. Infect. 2020, 105, 430–433. [Google Scholar] [CrossRef]
  26. Prasetyo, Y.T.; Castillo, A.M.; Salonga, L.J.; Sia, J.A.; Seneta, J.A. Factors Affecting Perceived Effectiveness of COVID-19 Prevention Measures among Filipino during Enhanced Community Quarantine in Luzon, Philippines: Integrating Protection Motivation Theory and Extended Theory of Planned Behavior. Int. J. Infect. Dis. 2020, 99, 312–323. [Google Scholar] [CrossRef] [PubMed]
  27. Wang, P.-W.; Ahorsu, D.K.; Lin, C.-Y.; Chen, I.-H.; Yen, C.-F.; Kuo, Y.-J.; Griffith, M.D.; Pakpour, A.H. Motivation to Have COVID-19 Vaccination Explained Using an Extended Protection Motivation Theory among University Students in China: The Role of Information Sources. Vaccines 2021, 9, 380. [Google Scholar] [CrossRef] [PubMed]
  28. COVID-19 Vaccination Free to Chinese Residents: Official. Available online: http://www.ecns.cn/news/2021-01-09/detail-ihafqmaz1834647.shtml (accessed on 5 February 2021).
  29. The COVID-19 Vaccination Situation Report. Available online: http://www.nhc.gov.cn/xcs/yqfkdt/202104/6f2444d14dce4ccda1a53554feaa153a.shtml (accessed on 19 April 2021).
  30. Lin, Y.; Hu, Z.; Zhao, Q.; Alias, H.; Danaee, M.; Wong, L.P. Understanding COVID-19 vaccine demand and hesitancy: A nationwide online survey in China. PLoS Negl. Trop. Dis. 2020, 14, e0008961. [Google Scholar] [CrossRef]
  31. Wang, K.; Wong, E.L.-Y.; Ho, K.-F.; Cheung, A.W.-L.; Yau, P.S.-Y.; Dong, D.; Wong, S.Y.-S.; Yeoh, E.-K. Change of Willingness to Accept COVID-19 Vaccine and Reasons of Vaccine Hesitancy of Working People at Different Waves of Local Epidemic in Hong Kong, China: Repeated Cross-Sectional Surveys. Vaccines 2021, 9, 62. [Google Scholar] [CrossRef] [PubMed]
  32. Alqudeimat, Y.; Alenezi, D.; AlHajri, B.; Alfouzan, H.; Almokhaizeem, Z.; Altamimi, S.; Almansouri, W.; Alzalzalah, S.; Ziyab, A. Acceptance of a COVID-19 Vaccine and its Related Determinants among the General Adult Population in Kuwait. Med. Princ. Pract. Int. J. Kuwait Univ. Health Sci. Cent. 2021. [Google Scholar] [CrossRef]
  33. Harapan, H.; Wagner, A.L.; Yufika, A.; Winardi, W.; Anwar, S.; Gan, A.K.; Setiawan, A.M.; Rajamoorthy, Y.; Sofyan, H.; Vo, T.Q.; et al. Willingness-to-pay for a COVID-19 vaccine and its associated determinants in Indonesia. Hum. Vaccines Immunother. 2020, 16, 3074–3080. [Google Scholar] [CrossRef]
  34. Mohammed, A.-M.; Kumar, P.B. Determinants of COVID-19 Vaccine Acceptance in Saudi Arabia: A Web-Based National Survey. J. Multidiscip. Healthc. 2020, 13, 1657–1663. [Google Scholar] [CrossRef]
  35. Reiter, P.L.; Pennell, M.L.; Katz, M.L. Acceptability of a COVID-19 vaccine among adults in the United States: How many people would get vaccinated? Vaccine 2020, 38, 6500–6507. [Google Scholar] [CrossRef]
  36. Willingness to pay for a COVID-19 vaccine high in Chile. Pharm. Outcomes News 2020, 858, 35. [CrossRef] [PubMed]
  37. Sarasty, O.; Carpio, C.E.; Hudson, D.; Guerrero-Ochoa, P.A.; Borja, I. The demand for a COVID-19 vaccine in Ecuador. Vaccine 2020, 38, 8090–8098. [Google Scholar] [CrossRef] [PubMed]
  38. Dodd, R.H.; Cvejic, E.; Bonner, C.; Pickles, K.; McCaffery, K.J. Willingness to vaccinate against COVID-19 in Australia. Lancet Infect. Dis. 2020. [Google Scholar] [CrossRef]
  39. Nzaji, M.K.; Ngombe, L.K.; Mwamba, G.N.; Ndala, D.B.B.; Miema, J.M.; Lungoyo, C.L.; Mwimba, B.L.; Bene, A.C.M.; Musenga, E.M. Acceptability of Vaccination Against COVID-19 Among Healthcare Workers in the Democratic Republic of the Congo. Pragmatic Obs. Res. 2020, 11, 103–109. [Google Scholar] [CrossRef] [PubMed]
  40. Leng, A.; Maitland, E.; Wang, S.; Nicholas, S.; Liu, R.; Wang, J. Individual preferences for COVID-19 vaccination in China. Vaccine 2021, 39, 247–254. [Google Scholar] [CrossRef]
  41. Dong, D.; Xu, R.H.; Wong, E.L.-Y.; Hung, C.-T.; Feng, D.; Feng, Z.; Yeoh, E.-K.; Wong, S.Y.-S. Public preference for COVID-19 vaccines in China: A discrete choice experiment. Health Expect. Int. J. Public Particip. Health Care Health Policy 2020. [Google Scholar] [CrossRef]
  42. Guidry, J.P.D.; Laestadius, L.I.; Vraga, E.K.; Miller, C.A.; Perrin, P.B.; Burton, C.W.; Ryan, M.; Fuemmeler, B.F.; Carlyle, K.E. Willingness to get the COVID-19 Vaccine with and without Emergency Use Authorization. Am. J. Infect. Control. 2020, 49, 137–142. [Google Scholar] [CrossRef]
  43. Liu, R.; Li, Y.; Wangen, K.R. Analysis of hepatitis B vaccination behavior and vaccination willingness among migrant workers from rural China based on protection motivation theory. Hum. Vaccines Immunother. 2016, 12, 1155–1163. [Google Scholar] [CrossRef] [Green Version]
  44. Jiang, S. Don’t rush to deploy COVID-19 vaccines and drugs without sufficient safety guarantees. Nature 2020. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Miyachi, T.; Takita, M.; Senoo, Y.; Yamamoto, K. Lower trust in national government links to no history of vaccination. Lancet 2020, 395, 31–32. [Google Scholar] [CrossRef] [Green Version]
  46. Liu, Z.; Yang, J.Z. In the Wake of Scandals: How Media Use and Social Trust Influence Risk Perception and Vaccination Intention among Chinese Parents. Health Commun. 2020, 1–12. [Google Scholar] [CrossRef] [PubMed]
  47. Malik, A.A.; McFadden, S.M.; Elharake, J.; Omer, S.B. Determinants of COVID-19 vaccine acceptance in the US. EClinicalMedicine 2020, 26, 100495. [Google Scholar] [CrossRef] [PubMed]
  48. Verity, R.; Okell, L.C.; Dorigatti, I.; Winskill, P.; Whittaker, C.; Imai, N.; Cuomo-Dannenburg, G.; Thompson, H.; Walker, P.G.T.; Fu, H.; et al. Estimates of the severity of coronavirus disease 2019: A model-based analysis. Lancet Infect. Dis. 2020, 20, 669–677. [Google Scholar] [CrossRef]
  49. Wong, L.P.; Alias, H.; Wong, P.F.; Lee, H.Y.; AbuBakar, S. The use of the health belief model to assess predictors of intent to receive the COVID-19 vaccine and willingness to pay. Hum. Vaccines Immunother. 2020, 16, 2204–2214. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Protection motivation theory.
Figure 1. Protection motivation theory.
Vaccines 09 00445 g001
Figure 2. Overall percentage of intention to receive COVID-19 vaccine (number, percentage).
Figure 2. Overall percentage of intention to receive COVID-19 vaccine (number, percentage).
Vaccines 09 00445 g002
Table 1. Measurement of PMT factors.
Table 1. Measurement of PMT factors.
FactorsDescriptionAssignment
SeverityCOVID-19 is a serious disease.Disagree = 0; Neutral = 1; Agree = 2
VulnerabilityMy relatives, friends and I face the risk of COVID-19 infection.Disagree = 0; Neutral = 1; Agree = 2
Internal rewardAfter I received the COVID-19 vaccine, I will no longer be restricted in my travel.Disagree = 0; Neutral = 1; Agree = 2
External rewardMy relatives, friends and people around me all want to get vaccinated against COVID-19.Disagree = 0; Neutral = 1; Agree = 2
Self-efficacyI believe I will have the ability to get the COVID-19 vaccine in the future.Disagree = 0; Neutral = 1; Agree = 2
Response efficacyThe COVID-19 vaccine is effective against COVID-19.Disagree = 0; Neutral = 1; Agree = 2
Response costGoing to get the COVID-19 vaccine would waste my time or delay my work.Disagree = 0; Neutral = 1; Agree = 2
Table 2. PMT factors and control variables.
Table 2. PMT factors and control variables.
VariablesTotalNoIt DependsYesχ2p
N%N%N%N%
PMT
factors
SeverityDisagree461.94613.0448.703678.2628.303<0.001
Neutral1526.3963.953825.0010871.05
Agree217991.67763.4929213.40181183.11
VulnerabilityDisagree110746.57504.5214312.9291482.5712.6920.013
Neutral67028.19182.6911717.4653579.85
Agree60025.24203.337412.3350684.33
Internal rewardsDisagree48920.57224.507415.1339380.3739.773<0.001
Neutral77432.56334.2615019.3859176.36
Agree111446.87332.961109.8797187.16
External rewardsDisagree1415.93149.933625.539164.54209.583<0.001
Neutral72930.67466.3118725.6549668.04
Agree150763.40281.861117.37136890.78
Self-efficacyDisagree873.6678.051314.946777.0166.452<0.001
Neutral43718.38265.9510724.4930469.57
Agree185377.96552.9721411.55158485.48
Response efficacyDisagree170.72635.29423.53741.18245.711<0.001
Neutral30112.66289.3011136.8816253.82
Agree205986.62542.6221910.64178686.74
Response costDisagree150063.10523.4716611.07128285.4740.708<0.001
Neutral53222.38203.7611721.9939574.25
Agree34514.51164.645114.7827880.58
Control
variables
SexMale115448.55453.9015613.5295382.580.7200.698
Female122351.45433.5217814.55100281.93
Age18–2791538.49212.3013915.1975582.5125.1160.001
28–3734014.30123.533710.8829185.59
38–4746019.35214.577716.7436278.70
48–5742617.92173.996014.0834981.92
>582369.93177.20218.9019883.90
IncomeHigh81334.20334.0613816.9764278.9715.3550.004
Medium79633.49293.6411614.5765181.78
Low76832.31263.398010.4266286.20
Education levelBelow high school147261.93594.0118512.57122883.427.6840.021
High school and above90538.07293.2014916.4672780.33
OccupationProfessional70829.79294.1012016.9555978.9535.5730.001
Farmer27811.7093.24227.9124788.85
Migrant worker28912.1682.774214.5323982.70
Self-employed2219.30125.432913.1218081.45
Unemployed1034.3387.7765.838986.41
Student63926.88142.1910015.6552582.16
Retired863.6244.65910.477384.88
Other532.2347.55611.324381.13
Medical insuranceYes228996.30813.5431613.81189282.668.3920.015
No883.7077.951820.456371.59
ResidenceUrban146261.51563.8320914.30119781.870.3940.821
Rural91538.49323.5012513.6675882.84
Self-rated healthBad733.0734.111013.706082.191.1710.883
Medium56423.73244.267413.1246682.62
Good174073.20613.5125014.37142982.13
RegionEastern74831.47233.0712216.3160380.6110.3980.034
Central68628.86344.967911.5257383.53
Western94339.67313.2913314.1077982.61
Vaccine safetyLow401.681127.50820.002152.50279.622<0.001
Medium37815.90369.5212833.8621456.61
High195982.41412.0919810.11172087.80
Table 3. Multiple ordered logistic regression models.
Table 3. Multiple ordered logistic regression models.
VariablesModel 1Model 2
βS.E.pOR (95%CI)βS.E.pOR (95%CI)
PMT
factors
SeverityDisagree (Reference group)
Neutral 0.6810.450.1301.976 (0.819, 4.767)
Agree 0.6740.400.0901.962 (0.900, 4.276)
VulnerabilityDisagree (Reference group)
Neutral 0.1610.150.2691.175 (0.883, 1.565)
Agree −0.0730.150.6370.930 (0.686, 1.259)
Internal rewardsDisagree (Reference group)
Neutral 0.1710.170.3001.186 (0.859, 1.640)
Agree 0.0060.170.9731.006 (0.725, 1.394)
External rewardsDisagree (Reference group)
Neutral 0.1920.210.3641.211 (0.801, 1.831)
Agree 1.5080.22<0.0014.519 (2.914, 7.009)
Self-efficacyDisagree (Reference group)
Neutral −0.3090.320.3300.734 (0.394, 1.367)
Agree −0.0080.300.9790.992 (0.547, 1.798)
Response efficacyDisagree (Reference group)
Neutral 1.1330.550.0413.105 (1.048, 9.197)
Agree 1.7520.550.0015.768 (1.956, 17.010)
Reaction costDisagree (Reference group)
Neutral −0.2880.150.0470.749 (0.564, 0.996)
Agree −0.6940.18<0.0010.500 (0.354, 0.705)
Control
variables
SexMale(Reference group)(Reference group)
Female−0.1020.110.3750.903 (0.721, 1.131)−0.1350.120.2630.874 (0.690, 1.106)
Age18-27(Reference group)(Reference group)
28-370.1160.230.6211.123 (0.709, 1.779)0.1330.240.5851.142 (0.709, 1.840)
38-47−0.3670.210.0830.692 (0.457, 1.049)−0.4510.220.0400.637 (0.414, 0.979)
48-57−0.3970.220.0760.672 (0.434, 1.042)−0.5210.230.0240.594 (0.377, 0.934)
58-−0.7860.290.0060.456 (0.260, 0.797)−0.7530.300.0120.471 (0.263, 0.845)
IncomeHigh(Reference group)(Reference group)
Medium0.1920.140.1691.212 (0.921, 1.594)0.2520.150.0851.286 (0.966, 1.712)
Low0.4340.160.0081.544 (1.121, 2.126)0.5330.170.0021.705 (1.218, 2.386)
Education levelBelow high school(Reference group)(Reference group)
High school and above−0.2020.140.1510.817 (0.620, 1.076)−0.2030.150.1650.816 (0.612, 1.088)
OccupationProfessional(Reference group)(Reference group)
Farmer0.7060.260.0072.026 (1.212, 3.386)0.7580.270.0052.134 (1.258, 3.622)
Migrant worker0.0990.210.6321.104 (0.736, 1.655)0.1940.220.3761.214 (0.791, 1.863)
Self-employed0.0250.220.9071.026 (0.671, 1.569)0.1210.230.5941.129 (0.723, 1.760)
Unemployed0.6210.350.0761.860 (0.938, 3.691)0.6520.360.0721.919 (0.944, 3.899)
Student−0.0910.210.6670.913 (0.603, 1.382)−0.0410.220.8500.960 (0.625, 1.473)
Retired0.5540.360.1261.740 (0.856, 3.538)0.6510.380.0841.917 (0.917, 4.008)
Other−0.0410.390.9160.960 (0.448, 2.055)0.1320.410.7461.141 (0.514, 2.534)
Medical insuranceYes(Reference group)(Reference group)
No−0.6620.260.0110.516 (0.311, 0.857)−0.5380.270.0490.584 (0.341, 0.998)
ResidenceUrban(Reference group)(Reference group)
Rural−0.0960.130.4510.909 (0.709, 1.165)−0.1510.130.2530.860 (0.664, 1.114)
Self-rated healthBad(Reference group)(Reference group)
Medium0.3270.350.3561.387 (0.692, 2.781)0.6660.360.0661.947 (0.958, 3.957)
Good0.2810.350.4181.325 (0.671, 2.617)0.5070.350.1521.66 (0.830, 3.322)
RegionEastern(Reference group)(Reference group)
Central0.0830.150.5871.086 (0.806, 1.463)0.0920.160.5631.096 (0.804, 1.494)
Western−0.0390.140.7790.962 (0.731, 1.265)−0.0250.150.8670.976 (0.732, 1.300)
Vaccine safetyLow(Reference group)(Reference group)
Medium0.6890.340.0431.992 (1.023, 3.878)0.6950.370.0632.004 (0.962, 4.173)
High2.4000.33<0.00111.023 (5.731, 21.201)1.7130.37<0.0015.546 (2.688, 11.442)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, L.; Wang, J.; Nicholas, S.; Maitland, E.; Leng, A.; Liu, R. The Intention to Receive the COVID-19 Vaccine in China: Insights from Protection Motivation Theory. Vaccines 2021, 9, 445. https://doi.org/10.3390/vaccines9050445

AMA Style

Li L, Wang J, Nicholas S, Maitland E, Leng A, Liu R. The Intention to Receive the COVID-19 Vaccine in China: Insights from Protection Motivation Theory. Vaccines. 2021; 9(5):445. https://doi.org/10.3390/vaccines9050445

Chicago/Turabian Style

Li, Lu, Jian Wang, Stephen Nicholas, Elizabeth Maitland, Anli Leng, and Rugang Liu. 2021. "The Intention to Receive the COVID-19 Vaccine in China: Insights from Protection Motivation Theory" Vaccines 9, no. 5: 445. https://doi.org/10.3390/vaccines9050445

APA Style

Li, L., Wang, J., Nicholas, S., Maitland, E., Leng, A., & Liu, R. (2021). The Intention to Receive the COVID-19 Vaccine in China: Insights from Protection Motivation Theory. Vaccines, 9(5), 445. https://doi.org/10.3390/vaccines9050445

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop