Next Article in Journal
Therapeutic In Situ Cancer Vaccine Using Pulsed Stereotactic Body Radiotherapy—A Translational Model
Next Article in Special Issue
The Fear of SARS-CoV-2 Infection versus the Perception of COVID-19 Vaccination amongst Older Adults in Urban Areas (CoV-VAC-PL Study): A Polish Community-Based Study
Previous Article in Journal
Antibody Response Following the Intranasal Administration of SARS-CoV-2 Spike Protein-CpG Oligonucleotide Vaccine
Previous Article in Special Issue
Cultural Tightness-Looseness: How Was It Related to Vaccination Behavior among University Students in Japan, the United States, and India?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Assessment of a Six-Item Index to Gauge Motivation to Receive COVID-19 Vaccination

1
Department of Social and Behavior Change, FHI 360, Washington, DC 20009, USA
2
Department of Behavioral, Epidemiological and Clinical Sciences, FHI 360, Durham, NC 27701, USA
3
Independent Research Consultant, Abidjan 00225, Côte d’Ivoire
4
Department of Social Sciences and Humanities, University of Jean Lorougnon Guédé of Daloa, Sassandra-Marahoué District, Daloa 150, Côte d’Ivoire
5
Independent Research Consultant, Kinshasa 00243, Democratic Republic of the Congo
6
Behavior Design Lab, Stanford University, Stanford, CA 94305, USA
7
Department of Reproductive, Maternal, Newborn and Child Health, FHI 360, Durham, NC 27701, USA
*
Author to whom correspondence should be addressed.
Vaccines 2024, 12(1), 6; https://doi.org/10.3390/vaccines12010006
Submission received: 3 November 2023 / Revised: 12 December 2023 / Accepted: 16 December 2023 / Published: 20 December 2023

Abstract

:
This study examined the factors influencing vaccine uptake using the Fogg Behavioral Model (FBM) and validated a multi-dimensional index for measuring a key construct in the FBM, motivation, using Confirmatory Factor Analysis (CFA) and Cronbach’s alpha. The research was conducted in Yopougon Est, Côte d’Ivoire, and Kinshasa, Democratic Republic of Congo. We aimed to develop a motivation index for COVID-19 vaccination uptake informed by the FBM. The motivation index was developed and refined using interviews and cognitive testing, and then used in baseline and endline surveys to measure the motivation to uptake COVID-19 vaccination among 2173 respondents. The index was simplified to six items validated using Confirmatory Factor Analysis (CFA) and demonstrated strong internal reliability with Cronbach’s alphas of 0.89 for the baseline and 0.77 for the endline. The study’s findings indicate that this motivation index is a valid tool for measuring motivation to receive COVID-19 vaccination, with potential applications in other vaccination campaigns. However, further testing in diverse settings is needed to enhance generalizability, including in rural areas. This research provides valuable insights for designing effective behavior change interventions to increase COVID-19 vaccination rates.

1. Introduction

By September 2023, over 5 billion people around the world had completed a primary series of a COVID-19 vaccine [1], and mathematical modeling has estimated that in the first year alone, nearly 20 million COVID-19-related deaths were averted [2]. Despite their demonstrable benefit, COVID-19 vaccine hesitancy increased in many regions as vaccine access improved [3,4,5]. Individual determinants associated with COVID-19 vaccine hesitancy have included the low perceived effectiveness and safety of vaccines, low perceived risk and severity of COVID-19, fear of vaccine side effects, and lack of trust in the institutions promoting vaccination [6,7,8,9,10,11,12,13,14,15,16].
Understanding and addressing the individual determinants of COVID-19 vaccination hesitancy is the essential work of behavior change interventions. To be effective, these interventions should identify and address the most significant determinants of COVID-19 vaccine hesitancy in each context. Access to timely, quality data and evidence is required for this purpose. Behavioral and social science theories and models have proven to be useful tools guiding research to identify the determinants of a behavior [17,18]. However, the accurate measurement of the constructs in these theories and models can be difficult due to their complexity and often requires validated items or indices, which can be time- and resource-intensive to develop [19].
As part of a project to increase COVID-19 vaccination rates in Yopougon Est, Abidjan, Côte d’Ivoire, and Kinshasa, Democratic Republic of Congo, we conducted research to generate evidence to design and evaluate demand creation activities [20]. Our research tools were informed by the Fogg Behavioral Model (FBM), a theoretical framework that explores the factors influencing human behavior and provides insights into designing persuasive technologies [21]. Rooted in the intersection of motivation, ability, and triggers, the model posits that behavior occurs when these three elements converge at a specific moment. Motivation reflects an individual’s desire to perform a behavior, ability denotes their capacity to do so, and triggers serve as prompts for action. The FBM has found widespread application in areas such as user experience design, health interventions, and technology development [22,23,24,25,26]. Its simplicity and emphasis on identifying optimal conditions for behavior change make it a valuable tool for designing interventions that effectively influence and facilitate the desired behaviors. The model’s adaptability and applicability across various domains underscore its significance in understanding and shaping human behavior in diverse contexts.
A validated index to measure the ability constructs of the FBM has been available since 2021 and used in COVID-19 vaccination research [20,27,28], but to our knowledge, no validated index existed to measure the motivation constructs of the FBM. The aim of our study was to develop and validate an index to measure individuals’ motivation to receive COVID-19 vaccination as characterized by the FBM.

2. Methods

2.1. Study Design and Data Collection

The motivation index described in this paper was developed as part of baseline and endline studies to inform and evaluate demand creation campaigns to increase the uptake of COVID-19 vaccination among adults living in Yopougon Est, Abidjan, Côte d’Ivoire, and Kinshasa, Democratic Republic of Congo (DRC). At the time of our research, Pfizer-BioNTech, Oxford-AstraZeneca, Sinopharm BIBP, and Janssen (J&J) were available in Yopougon Est and Janssen (J&J), Pfizer-BioNTech, and Moderna in Kinshasa. The baseline study in Yopougon Est used mixed methods, comprising key informant interviews and a quantitative survey; the baseline study in Kinshasa comprised only a quantitative survey. The endline evaluation in both locations comprised only a quantitative survey.
For key informant interviews in Yopougon Est, purposive samples were recruited from among unvaccinated and vaccinated individuals. Unvaccinated participants were identified at two community congregation points, where trained interviewers engaged with individuals who appeared to be above 18 years of age. Following age confirmation, the interviewer explained the study’s purpose and verified that the subject resided in Yopougon Est and had never received a COVID-19 vaccine. Subjects meeting these eligibility criteria were subsequently invited to participate in an interview, with their verbal consent being obtained. Similarly, vaccinated participants were identified at the post-vaccination rest area of a mass COVID-19 vaccination site, where trained interviewers engaged with individuals who appeared to be above 18 years of age. Following age confirmation, the interviewer explained the study’s purpose and verified that the subject resided in Yopougon Est. Those residing in Yopougon Est who confirmed receiving at least one dose of a COVID-19 vaccine were subsequently invited to participate in an interview, with their verbal consent being obtained.
The trained interviewers used short guides to explore the factors influencing an individual’s motivation and ability to be vaccinated and to identify interventions that might support individuals to overcome perceived barriers to COVID-19 vaccination. A total of 21 unvaccinated women and 17 unvaccinated men in the community and 10 vaccinated women and 15 vaccinated men at the mass vaccination site were interviewed in January and February 2022.
For both baseline and endline surveys, a convenience sample was recruited from among individuals entering data collection sites co-located within Internet cafés near high pedestrian trafficked areas in Yopougon Est and Kinshasa. Participants were aged 18 and above and resided in either Yopougon Est or Kinshasa. Recruitment quotas based on neighborhood, age, and gender were used to align our sample to the demographic breakdown of the commune, and we carefully timed our intercepts and selected research sites where COVID-19 vaccination demand creation campaigns were actively underway. Trained recruiters approached potential respondents entering the Internet cafés and if the individual agreed to participate, they were invited to approach a computer terminal where they would complete the survey. A structured questionnaire was used to measure vaccination status, sociodemographic characteristics, and levels of motivation and ability according to the FBM among eligible respondents. The questionnaire was the same for both baseline and endline surveys except for the addition of campaign-specific exposure questions to the endline survey.
In total, data were collected from 2173 respondents across baseline and endline surveys. Baseline survey data were collected in September 2022 in Yopougon Est, and October 2022 in Kinshasa. Endline survey data were collected in July 2023 in both Yopougon Est and Kinshasa. These studies were determined exempt by FHI 360’s Protection of Human Subjects Committee and approved by the Ivorian Ministry of Health’s National Research Ethics Committee and the University of Kinshasa, School of Public Health Ethics Committee.

2.2. Motivation Index Development

The motivation index was informed by the FBM, which characterizes motivation as three sets of opposing constructs—acceptance/rejection, hope/fear, and pleasure/pain [14]. Applying the FBM, we coded and analyzed responses from the key informant interviews conducted in Yopougon Est. The results of this analysis were used to develop 12 items that were aligned with each FBM motivation construct. We then assessed the items through cognitive interviews with 27 people in Yopougon Est. We assessed item comprehension, confidence in response, the level of respondent discomfort, and the accuracy in measurement by asking respondents to restate the item in their own words and comparing their response to the motivation construct of interest. The resulting 12-item index is presented in Table 1. Responses were recorded using a five-point Likert-type scale of: 1 = strongly disagree; 2 = disagree; 3 = neither agree nor disagree; 4 = agree; and 5 = strongly agree.

2.3. Data Analysis

We used Confirmatory Factor Analysis (CFA) in conjunction with Cronbach’s alpha to validate the motivation index based on the FBM. CFA is a form of Structural Equation Modeling (SEM) used to establish the relationship between measured variables, frequently called manifest variables, and non-measured, latent factors that serve as theoretical concepts [29,30,31]. For this study, the manifest (measured) variables are the items from the questionnaire, and the latent (non-measured) factors are the FBM motivation constructs, such as acceptance, hope, and pleasure, in addition to motivation. CFA is particularly useful in behavioral research where theoretical constructs, such as motivation, cannot be measured directly but are important to understand to inform behavior change interventions and activities [32]. In this case, we entered the FBM motivation constructs—acceptance, rejection, hope, fear, pleasure, and pain—as separate latent factors. This decision was based on the qualitative cognitive interviews used to develop our index items, as explained earlier. We conducted our analysis of baseline and endline data independently and report our results for each timepoint in the following section.
As shown in Figure 1, we constructed a second order factor model as our expected model or null hypothesis. Motivation served as the second order, latent (non-measured) factor. Acceptance, rejection, hope, fear, pleasure, and pain served as the first order, latent factors underlying motivation. Subsequently, each item from the questionnaire was influenced by one of the respective corresponding first order factors (see Figure 1). The observed data are tested against the proposed model, and fit statistics are generated to inform whether the observed data fit the model or not. Factor loadings are calculated to quantify the strength of the relationship(s) between a latent variable and the underlying items.
We also note here that Cronbach’s alpha is often used as a standard measure of internal consistency or inter-item reliability to determine whether items fit or “hang”, well together [33]. An alpha level of ≥0.70 is deemed acceptable for items and served as the threshold for this analysis. While Cronbach’s alpha is useful for determining reliability among items, it cannot be used to determine which latent factors contribute to or inform the items. CFA bridges this analytic gap by providing empirical evidence to show how items are tied together by a theoretical structure of latent factors and their respective manifest variables. All analyses were performed using R/R Studio versions 4.2.2/2023.06.2+561 [34].

3. Results

Table 2 shows the key characteristics of the baseline and endline survey samples that were analyzed to assess the motivation index. In total, 1161 of the respondents resided in Yopougon Est, Abidjan, and 1012 in Kinshasa, DRC. Over 40% of the respondents from both samples were under the age of 30 years. An almost perfect split between female and male participants was achieved in the baseline sample (49.87% and 50.13%, respectively), but slightly more male (55%) than female participants (45%) were surveyed in the endline sample. Both samples were highly educated with over 38% of participants reporting tertiary education. Over 55% of participants in the baseline sample and over 65% in the endline sample were employed, either part-time, full-time, or self-employed, or reported owning a business. A minority were single (15.99% of baseline participants and 17.37% of endline participants), and the vast majority (81.34% of baseline participants and 79.79% of endline participants) were Christian. In addition, 39% in the baseline sample and 59.72% in the endline sample reported having received at least one dose of a COVID-19 vaccine.

Assessment of Motivation Index

CFA fit statistics were calculated for the baseline and endline and were found to be suboptimal for the expected model when fit against the data. Consequently, items and first order factors were trimmed to improve fit indices. Hope, rejection, pain, and their corresponding items resulted in a poor fit to the data, so we removed them from the analysis and re-fit the model without these items. This step produced a model that included all significant pathways and acceptable fit statistics, with an RMSEA of 0.074/0.040; and TLI/CFI of 0.975/0.989 and 0.990/0.996, baseline/endline, respectively (presented in Figure 2 and Table 2). Therefore, through CFA, we confirm the trimmed model as a valid arrangement when analyzing motivation using the FBM.
In our final model, Acceptance, Fear, and Pleasure and their items were retained. Factor loadings (non-standardized and standardized) and fit indices for the trimmed model are summarized in Table 3 and Table 4, respectively. As factor loadings increase, the strength of the relationship increases with an ideal magnitude of at least 1.00.
Cronbach’s alphas were generated for items retained in the six-item model to assess internal reliability and were 0.89 and 0.77 for the baseline and endline, respectively (see Table 3).

4. Discussion

Validated items and indices are indispensable in behavioral research for ensuring the accuracy, reliability, and construct validity of measurements. The use of validated measures facilitates comparability across studies, enhances the credibility of research, and promotes sound measurement principles. By minimizing measurement error and providing a common ground for comparison, validated indices contribute to the overall quality and trustworthiness of behavioral research findings. Furthermore, in practical applications, such as formative research, validated indices play a crucial role in making informed decisions and guiding effective interventions.
In the context of the behavioral research used to inform demand creation campaigns, inquiring directly about an individual’s motivation to adopt a behavior proves insufficient. It is imperative to discern the specific constructs that underlie motivation to determine if any require particular emphasis. Thus, we used results from key informant interviews to develop a 12-item index to measure motivation as characterized by the FBM. Each item in the index was refined by applying results from cognitive interviews, which evaluated respondent understanding, confidence, discomfort, and measurement accuracy. We then used the index in the cross-sectional baseline and endline surveys conducted in Yopougon Est, Côte d’Ivoire, and Kinshasa, DRC to inform demand creation campaigns for COVID-19 vaccination.
Using data from the cross-sectional surveys, we refined our index by using the results of a Confirmatory Factor Analysis (CFA) in conjunction with Cronbach’s alpha. Initially, CFA fit statistics for both the baseline and endline data indicated a suboptimal fit with the expected model. Consequently, we adjusted by removing hope, rejection, pain, and their associated items from the model, and negatively affected the model fit. After this refinement, the model exhibited significant pathways and satisfactory fit statistics.
The final model retained Acceptance, Fear, and Pleasure, along with their corresponding six items, as shown in Table 5. Cronbach’s alphas calculated for the retained items confirmed their internal reliability across baseline and endline surveys, suggesting that the final six-item index is reliable over time and in different populations. In a separate analysis of the data, the study team examined the association between motivation and vaccination status using logistic regression [35]. In these analyses, we find that motivation, as measured by our six-item index, is significantly associated with vaccination status in the expected direction.
Of note, our final six-item index includes items aligned with only three of the six contributory constructs that underlie motivation in the FBM. However, since the FBM characterizes motivation as a set of three opposing constructs—acceptance/rejection, hope/fear, and pleasure/pain—it might be argued that our index, which includes one side of each set of three constructs, is sufficient to measure all constructs. For example, disagreement with the acceptance item, “My family wants me to get vaccinated against COVID-19”, would indicate higher anticipated rejection. Similarly, disagreement with the pleasure item, “I would feel more at ease everyday if I were vaccinated against COVID-19”, would indicate higher anticipated pain.
Our results indicate that our index is a valid and reliable tool for measuring motivation, which can be used to inform campaigns to motivate COVID-19 vaccination uptake. Moreover, its utilization of only six items to measure motivation renders it a user-friendly tool with the potential to expedite data collection at a reduced cost. Although initially developed within the context of a demand creation campaign for COVID-19 vaccination, this index may be adaptable for understanding the motivation related to the adoption of other vaccines, particularly among adults, such as those for the influenza virus, the respiratory syncytial virus (RSV), and human papillomavirus (HPV).

Limitations

We recognize that the sampling approaches employed in this study are non-representative, and thus limit the generalizability of our findings. Our approach was constrained by the time and resources available. Nevertheless, we took measures to address this limitation by incorporating quotas that align with critical demographic indicators, carefully timing our intercepts, and selecting research sites where COVID-19 vaccination demand creation campaigns were actively underway. These efforts served to enhance the applicability of our results within the programmatic context. Our sample size was determined as the maximum sample allowable within budgetary constraints. We do note that for inferential statistics, our sample size is well above the acceptable minimum of 300. In addition to this, we also note that in the case of our confirmatory factor analysis, we are within the accepted limits of a sample size that achieves a ratio of greater than 10 respondents for each estimated parameter or degrees of freedom [36]. It is also important to acknowledge that our study was conducted in large urban centers. We did not collect any data on populations residing in rural areas. We recommend testing our promising six-item index in rural areas and other settings seeking to increase COVID-19 vaccination rates.

5. Conclusions

Our findings provide a validation of a six-item index to measure motivation in the FBM and programs that use this framework. Our findings are from data collected across two urban populations spanning West and Central African countries, contributing a cross-cultural application of our findings. While further validation is needed in additional contexts—regions outside of West and Central Africa and rural contexts—our index provides researchers and program evaluators with a tested and simple approach to measuring motivation in the context of vaccination programs and emerging infectious disease.

Author Contributions

Conceptualization, B.P., K.T., G.T. and S.A.; methodology, G.T., S.N., A.M. and H.M.B.; validation, G.T. and A.M.; formal analysis, S.N. and A.M.; investigation, A.Y.K., M.M., M.L.O. and D.G.; software, S.N.; data curation, S.N.; writing—original draft preparation, B.P. and G.T.; writing—review and editing, K.T., S.N., A.Y.K., M.L.O., D.G., S.A., A.M. and H.M.B.; visualization, S.N.; supervision, K.T.; project administration, A.Y.K. and M.M.; funding acquisition, B.P. All authors have read and agreed to the published version of the manuscript.

Funding

This activity and related research was funded by the Bill and Melinda Gates Foundation (INV-037398).

Institutional Review Board Statement

This study was considered exempt by FHI 360’s Protection of Human Subjects Committee (1902840; 10 August 2022) and subsequently approved by the Ivorian Ministry of Health’s National Research Ethics Committee (February 2022) and University of Kinshasa, School of Public Health Ethics Committee (September 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

De-identified aggregate data are available upon request.

Acknowledgments

The authors wish to acknowledge Kasi Insight, who designed the data collection strategy and managed data collection activities.

Conflicts of Interest

The authors declare no conflicts of interest. The funder participated in the review of initial survey instruments and in the decision to publish results.

References

  1. World Health Organization. WHO Coronavirus (COVID-19) Dashboard. Available online: https://covid19.who.int/?mapFilter=vaccinations (accessed on 27 September 2023).
  2. Watson, O.J.; Barnsley, G.; Toor, J.; Hogan, A.B.; Winskill, P.; Ghani, A.C. Global impact of the first year of COVID-19 vaccination: A mathematical modelling study. Lancet Infect. Dis. 2022, 22, 1293–1302. [Google Scholar] [CrossRef] [PubMed]
  3. Sato, R. Vaccine hesitancy against COVID-19 vaccine over time in Nigeria. Vaccine 2023, 41, 2749–2753. [Google Scholar] [CrossRef] [PubMed]
  4. Fridman, A.; Gershon, R.; Gneezy, A. COVID-19 and vaccine hesitancy: A longitudinal study. PLoS ONE 2021, 16, e0250123. [Google Scholar] [CrossRef] [PubMed]
  5. Parthasarathi, A.; Puvvada, R.K.; Basappa, S.; Krishna, M.T.; Mahesh, P.A. Global intention of the general public to undergo COVID-19 vaccination: Time trends and risk factors for vaccine refusal, a Systematic Review and Meta-analysis. Wellcome Open Res. 2022, 7, 17. [Google Scholar] [CrossRef]
  6. Roy, D.N.; Biswas, M.; Islam, E.; Azam, S. Potential factors influencing COVID-19 vaccine acceptance and hesitancy: A systematic review. PLoS ONE 2022, 17, e0265496. [Google Scholar] [CrossRef] [PubMed]
  7. Faye, S.L.B.; Krumkamp, R.; Doumbia, S.; Tounkara, M.; Strauss, R.; Ouedraogo, H.G.; Sagna, T.; Barry, A.M.; Mbawah, A.K.; Doumbia, C.O.; et al. Factors influencing hesitancy towards adult and child COVID-19 vaccines in rural and urban West Africa: A cross-sectional study. BMJ Open 2022, 12, e059138. [Google Scholar] [CrossRef] [PubMed]
  8. Gerretsen, P.; Kim, J.; Caravaggio, F.; Quilty, L.; Sanches, M.; Wells, S.; Brown, E.E.; Agic, B.; Pollock, B.G.; Graff-Guerrero, A. Individual determinants of COVID-19 vaccine hesitancy. PLoS ONE 2021, 16, e0258462. [Google Scholar] [CrossRef] [PubMed]
  9. Ackah, B.B.B.; Woo, M.; Stallwood, L.; Fazal, Z.A.; Okpani, A.; Ukah, U.V.; Adu, P.A. COVID-19 vaccine hesitancy in Africa: A scoping review. Glob. Health Res. Policy 2022, 7, 21. [Google Scholar] [CrossRef]
  10. Zewude, B.; Habtegiorgis, T. Willingness to Take COVID-19 Vaccine Among People Most at Risk of Exposure in Southern Ethiopia. Pragmatic Obs. Res. 2021, 12, 37–47. [Google Scholar] [CrossRef]
  11. Mohammed, R.; Nguse, T.M.; Habte, B.M.; Fentie, A.M.; Gebretekle, G.B. COVID-19 vaccine hesitancy among Ethiopian healthcare workers. PLoS ONE 2021, 16, e0261125. [Google Scholar] [CrossRef]
  12. Iliyasu, Z.; Umar, A.A.; Abdullahi, H.M.; Kwaku, A.A.; Amole, T.G.; Tsiga-Ahmed, F.I.; Garba, R.M.; Salihu, H.M.; Aliyu, M.H. “They have produced a vaccine, but we doubt if COVID-19 exists”: Correlates of COVID-19 vaccine acceptability among adults in Kano, Nigeria. Hum. Vaccines Immunother. 2021, 17, 4057–4064. [Google Scholar] [CrossRef] [PubMed]
  13. Adebisi, Y.A.; Alaran, A.J.; Bolarinwa, O.A.; Akande-Sholabi, W.; Iii, D.E.L.-P. When it is available, will we take it? Social media users’ perception of hypothetical COVID-19 vaccine in Nigeria. Pan Afr. Med. J. 2021, 38, 230. [Google Scholar] [CrossRef] [PubMed]
  14. Carcelen, A.C.; Prosperi, C.; Mutembo, S.; Chongwe, G.; Mwansa, F.D.; Ndubani, P.; Simulundu, E.; Chilumba, I.; Musukwa, G.; Thuma, P.; et al. COVID-19 vaccine hesitancy in Zambia: A glimpse at the possible challenges ahead for COVID-19 vaccination rollout in sub-Saharan Africa. Hum. Vaccines Immunother. 2021, 18, 1–6. [Google Scholar] [CrossRef]
  15. Wang, Y.; Liu, Y. Multilevel determinants of COVID-19 vaccination hesitancy in the United States: A rapid systematic review. Prev. Med. Rep. 2021, 25, 101673. [Google Scholar] [CrossRef] [PubMed]
  16. Eze, U.A.; Ndoh, K.I.; Ibisola, B.A.; Onwuliri, C.D.; Osiyemi, A.; Ude, N.; Chime, A.; Ogbor, E.O.; Alao, A.O.; Abdullahi, A. Determinants for Acceptance of COVID-19 Vaccine in Nigeria. Cureus 2021, 13, e19801. [Google Scholar] [CrossRef]
  17. Glanz, K.; Rimer, B.K.; Lewis, F.M. Theory, Research, and Practice in Health Behavior and Health Education. In Health Behavior and Health Education: Theory, Research, and Practice, 3rd ed.; Glanz, K., Rimer, B.K., Lewis, F.M., Eds.; Jossey-Bass: San Francisco, CA, USA, 2008; pp. 22–39. [Google Scholar]
  18. Painter, J.E.; Borba, C.P.C.; Hynes, M.; Mays, D.; Glanz, K. The Use of Theory in Health Behavior Research from 2000 to 2005: A Systematic Review. Ann. Behav. Med. 2008, 35, 358–362. [Google Scholar] [CrossRef] [PubMed]
  19. Boateng, G.O.; Neilands, T.B.; Frongillo, E.A.; Melgar-Quiñonez, H.R.; Young, S.L. Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Front. Public Health 2018, 6, 149. [Google Scholar] [CrossRef]
  20. Pedersen, B.; Thanel, K.; Kouakou, A.Y.; Zo, J.R.; Ouattara, M.L.; Gbeke, D.; Thompson, G.; Agha, S. Identifying Drivers of COVID-19 Vaccine Uptake among Residents of Yopougon Est, Abidjan, Côte d’Ivoire. Vaccines 2022, 10, 2101. [Google Scholar] [CrossRef]
  21. Fogg, B. A behavior model for persuasive design. In Proceedings of the 4th International Conference on Persuasive Technology, Claremont, CA, USA, 26–29 April 2009; Volume 350, pp. 1–7. [Google Scholar] [CrossRef]
  22. Yuasa, T.; Harada, F.; Shimakawa, H. Proposal to Improve Exercise Using the Fogg Behavior Model. In Proceedings of the 2022 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), Gold Coast, Australia, 18–20 December 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 1–4. [Google Scholar] [CrossRef]
  23. Zhou, Y.; Qin, Q.; Tang, B.; Tian, W. A Study on the Fogg Behavior Model in Designing Educational Apps for Children. In Proceedings of the International Conference on Human-Computer Interaction, Copenhagen, Denmark, 23–28 July 2023; pp. 249–261. [Google Scholar] [CrossRef]
  24. Akmal, M.; Niwanputri, G.S. Spoonful: Mobile Application for Reducing Household Food Waste using Fogg Behavior Model (FBM). In Proceedings of the 2021 International Conference on Data and Software Engineering (ICoDSE), Bandung, Indonesia, 3–4 November 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1–6. [Google Scholar] [CrossRef]
  25. Meekers, D.; Onuoha, C.; Olutola, O. Applying the Fogg Behavior Model to improve contraceptive social marketing during the COVID-19 lockdown in Nigeria: A case study. Gates Open Res. 2020, 4, 141. [Google Scholar] [CrossRef]
  26. Katirayi, L.; Tchendjou, P.; Tchounga, B.; Mbunka, M.; Wicks, M.; Conserve, D.F. Changing attitudes towards HIV testing and treatment among three generations of men in Cameroon: A qualitative analysis using the Fogg Behavior Model. BMC Public Health 2023, 23, 501. [Google Scholar] [CrossRef]
  27. Evans, W.D.; Bingenheimer, J.B.; Long, M.; Ndiaye, K.; Donati, D.; Rao, N.M.; Akaba, S.; Hoglin, B. Development and Evaluation of an Index to Measure the Ability to Get Vaccinated for COVID-19. Vaccines 2023, 11, 342. [Google Scholar] [CrossRef]
  28. Agha, S.; Chine, A.; Lalika, M.; Pandey, S.; Seth, A.; Wiyeh, A.; Seng, A.; Rao, N.; Badshah, A. Drivers of COVID-19 Vaccine Uptake amongst Healthcare Workers (HCWs) in Nigeria. Vaccines 2021, 9, 1162. [Google Scholar] [CrossRef]
  29. McArdle, J.J. Current Directions in Structural Factor Analysis. Curr. Dir. Psychol. Sci. 1996, 5, 11–18. [Google Scholar] [CrossRef]
  30. Bollen, K.A. Structural Equations with Latent Variables; Wiley: Hoboken, NJ, USA, 1989. [Google Scholar] [CrossRef]
  31. Gamst, G.; Meyers, L.S.; Burke, H.M.; Guarino, A.J. Scale Development and Validation. In Public Health Research Methods; Guest, G., Namey, E.E., Eds.; SAGE: Thousand Oaks, CA, USA, 2014; pp. 379–409. [Google Scholar]
  32. Levine, T.R. Confirmatory Factor Analysis and Scale Validation in Communication Research. Commun. Res. Rep. 2005, 22, 335–338. [Google Scholar] [CrossRef]
  33. Cronbach, L.J. Coefficient alpha and internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef]
  34. R: The R Project for Statistical Computing. Available online: https://www.r-project.org/ (accessed on 26 September 2023).
  35. Thompson, G.; Yao Kouakou, A.; Nicholes, S.; Ouattara, M.L.; Dorgeles, G.; Mujinga, M.; Thanel, K.; Martinez, A.; Agha, S.; Pedersen, B. Quantitative Model of Factors that Drive COVID-19 Vaccination Uptake: Testing the Fogg Behavioral Model Motivation, Ability and Prompt Constructs and Their Interaction. 2023. Unpublished manuscript, last modified 29 September 2023. Microsoft Word file.
  36. Byrne, B.M. Structural Equation Modeling with AMOS; Routledge: London, UK, 2016. [Google Scholar] [CrossRef]
Figure 1. Path diagram of expected second order factor model for motivation.
Figure 1. Path diagram of expected second order factor model for motivation.
Vaccines 12 00006 g001
Figure 2. Path diagram of confirmed second order factor model for motivation.
Figure 2. Path diagram of confirmed second order factor model for motivation.
Vaccines 12 00006 g002
Table 1. Motivation index used in baseline and endline surveys.
Table 1. Motivation index used in baseline and endline surveys.
Items
Acceptance
1. My family wants me to get vaccinated against COVID-19.
2. Getting vaccinated against COVID-19 would make me feel more accepted by the people around me.
Rejection
3. My family would be angry with me if I got vaccinated against COVID-19.
4. Most of the people I know would think poorly of me if I were to get a COVID-19 vaccine.
Hope
5. Getting vaccinated against COVID-19 would protect me from getting sick.
6. Getting vaccinated against COVID-19 would allow me to keep my job.
Fear
7. I worry about getting ill from COVID-19.
8. I worry about COVID-19 infecting someone in my family.
Pleasure
9. I would feel more at ease everyday if I were vaccinated against COVID-19.
10. It would make me feel good knowing that I am protecting my family by getting vaccinated against COVID-19.
Pain
11. I worry that the COVID-19 vaccine will make me sick.
12. I worry that the needlestick for the COVID-19 vaccine will be painful.
Table 2. Key characteristics of the samples.
Table 2. Key characteristics of the samples.
Variablenbaseline%nendline%ntotal
Location
Yopougon Est, Abidjan, CI60154.53%56052.79%1161
Kinshasa, DRC51245.47%50047.21%1012
Age
18–24 years26623.90%21320.09%479
25–29 years22320.04%21320.09%436
30–34 years17515.72%14013.21%315
35–39 years13912.49%14713.87%286
40–44 years13011.68%13712.92%267
45–54 years15714.11%12511.79%282
55+ years211.89%858.02%106
Sex
Female55549.87%47745.00%1032
Male55850.13%58355.00%1141
Education
No formal education554.94%635.95%118
Secondary, no diploma948.45%605.67%154
Secondary15013.48%16215.30%312
Technical training17916.08%18117.09%360
Professional qualification211.89%363.40%57
Current student, e.g., university827.37%918.59%173
Tertiary43138.72%41238.90%843
Skip/Do not know1019.07%545.10%155
Employment
Unemployed887.91%767.18%164
Student15914.29%14914.07%308
Retired191.71%312.93%50
Stay-at-home parent534.76%454.25%98
Business owner534.76%635.95%116
Independent/self-employed16915.18%20619.45%375
Part-time11810.60%16515.58%283
Full-time27524.71%26324.83%538
Skip/Do not know17916.08%615.76%240
Marital Status
Single17815.99%18417.37%362
Boyfriend/girlfriend29226.24%28326.72%575
Partnered25222.64%22521.25%477
Married25122.55%30428.71%555
Skip/Do not know14012.58%635.95%203
Religious Affiliation
Catholic30427.31%28126.53%585
Evangelical23120.75%20619.45%437
Methodist12110.87%12211.52%243
Protestant17515.72%14413.60%319
Christian (Other)756.74%928.69%167
Muslim15313.75%13712.94%290
Traditional African Religion332.96%292.74%62
Other121.08%171.61%29
Skip/Do not know90.81%312.93%40
Vaccination Status
Not vaccinated67961.00%42740.28%1106
Vaccinated43439.00%63359.72%1067
Table 3. Non-standardized and standardized loadings for a second order CFA for motivation, with Acceptance, Fear, and Pleasure as first order factors.
Table 3. Non-standardized and standardized loadings for a second order CFA for motivation, with Acceptance, Fear, and Pleasure as first order factors.
Second Order CFA for MotivationBaselineEndline
λ 1Stdλ 1Std
First Order Loadings
FactorsItems
Acceptance1. My family wants me to get vaccinated against COVID-19.1.000.841.000.82
2. Getting vaccinated against COVID-19 would make me feel more accepted by the people around me.0.840.720.860.72
Fear7. I worry about getting ill from COVID-19.1.000.831.000.71
8. I worry about COVID-19 infecting someone in my family.1.690.871.180.86
Pleasure9. I would feel more at ease everyday if I were vaccinated against COVID-19.1.000.831.000.84
10. It would make me feel good knowing that I am protecting my family by getting vaccinated against COVID-19.1.050.871.010.87
Second Order Loadings
MotivationAcceptance1.000.861.000.47
Fear1.060.890.520.31
Pleasure1.180.993.231.50
1 Loadings were significant down to α = 0.001.
Table 4. Cronbach’s alpha and fit statistics for a second order CFA for motivation.
Table 4. Cronbach’s alpha and fit statistics for a second order CFA for motivation.
TimepointCronbach’s AlphaCLITLIRMSEASRMSχ2dfp 1
Baseline0.890.9900.9750.0740.01842.8236***
Endline0.770.9960.9890.0400.01116.1266*
1 Significance codes: *** < 0.001, * < 0.05.
Table 5. Final motivation index.
Table 5. Final motivation index.
Items
Acceptance
1. My family wants me to get vaccinated against COVID-19.
2. Getting vaccinated against COVID-19 would make me feel more accepted by the people around me.
Fear
3. I worry about getting ill from COVID-19.
4. I worry about COVID-19 infecting someone in my family.
Pleasure
5. I would feel more at ease everyday if I were vaccinated against COVID-19.
6. It would make me feel good knowing that I am protecting my family by getting vaccinated against COVID-19.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Pedersen, B.; Thompson, G.; Kouakou, A.Y.; Mujinga, M.; Nicholes, S.; Martinez, A.; Agha, S.; Thanel, K.; Ouattara, M.L.; Gbeke, D.; et al. Development and Assessment of a Six-Item Index to Gauge Motivation to Receive COVID-19 Vaccination. Vaccines 2024, 12, 6. https://doi.org/10.3390/vaccines12010006

AMA Style

Pedersen B, Thompson G, Kouakou AY, Mujinga M, Nicholes S, Martinez A, Agha S, Thanel K, Ouattara ML, Gbeke D, et al. Development and Assessment of a Six-Item Index to Gauge Motivation to Receive COVID-19 Vaccination. Vaccines. 2024; 12(1):6. https://doi.org/10.3390/vaccines12010006

Chicago/Turabian Style

Pedersen, Brian, Gretchen Thompson, Albert Yao Kouakou, Marie Mujinga, Samuel Nicholes, Andres Martinez, Sohail Agha, Katherine Thanel, Mariame Louise Ouattara, Dorgeles Gbeke, and et al. 2024. "Development and Assessment of a Six-Item Index to Gauge Motivation to Receive COVID-19 Vaccination" Vaccines 12, no. 1: 6. https://doi.org/10.3390/vaccines12010006

APA Style

Pedersen, B., Thompson, G., Kouakou, A. Y., Mujinga, M., Nicholes, S., Martinez, A., Agha, S., Thanel, K., Ouattara, M. L., Gbeke, D., & Burke, H. M. (2024). Development and Assessment of a Six-Item Index to Gauge Motivation to Receive COVID-19 Vaccination. Vaccines, 12(1), 6. https://doi.org/10.3390/vaccines12010006

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop