Next Article in Journal
A Population-Based Cohort Study of the Association between Visual Loss and Risk of Suicide and Mental Illness in Taiwan
Next Article in Special Issue
The Effects of Arginine-Based Supplements on Fatigue Levels following COVID-19 Infection: A Prospective Study in Romania
Previous Article in Journal
An Exploratory Study of ICU Pediatric Nurses’ Feelings and Coping Strategies after Experiencing Children Death
Previous Article in Special Issue
Depression and Anxiety Symptoms “Among the Waves” of the COVID-19 Pandemic in Obsessive Compulsive Disorder and Adjustment Disorder Patients
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS): New Scale Development and Validation

1
Community and Psychiatric/Mental Health Nursing Department, Nursing College, King Khalid University, Khamis Mushait 39746, Saudi Arabia
2
Medical Surgical Nursing Department, Nursing College, King Khalid University, Khamis Mushait 39746, Saudi Arabia
3
Public Health Department, College of Applied Medical Sciences, King Khalid University, Khamis Mushait 62529, Saudi Arabia
4
Basic Nursing Care Department, Nursing College, King Khalid University, Khamis Mushait 39746, Saudi Arabia
*
Author to whom correspondence should be addressed.
Healthcare 2023, 11(10), 1461; https://doi.org/10.3390/healthcare11101461
Submission received: 12 April 2023 / Revised: 15 May 2023 / Accepted: 16 May 2023 / Published: 18 May 2023

Abstract

:
Background: The advent of COVID-19 and its impacts have prompted fear and stigma among people all across the world. Because of stigma, there was often a delay in diagnosis and treatment, which resulted in a poor prognosis. As a result, a reliable scale is required to measure the level of fear and stigma of COVID-19 reinfection. Aim: To develop and validate a scale for determining the level of fear and stigma of COVID-19 reinfection. Methods: A cross-sectional study including 200 nursing-college students who had previously tested positive for COVID-19 was conducted. The scale’s reliability was evaluated by external and internal consistency methods. Construct, convergent, and discriminant validity were evaluated using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Results: The scale’s mean score was 24.85 ± 11.35, and no floor or ceiling effects were detected. The scale items’ reliability, measured by Cronbach’s alpha coefficient if an item was deleted, ranged from 0.76 to 0.95, with a total score value of 0.86. The range of convergent validity coefficients was between 0.37 and 0.64. Pearson’s correlation coefficients for test–retest validity ranged from 0.71 to 0.93, with a total score of 0.82. The coefficient of split-half correlation was 0.87, while the coefficient of reliability was 0.93. According to the factor analysis, two components had latent roots larger than 1. The rotated component matrix of the two factors revealed that all items had R values over 0.30, indicating that none of them should be excluded. In addition, CFA results revealed that χ2 = 3524, df = 1283, χ2/df ratio = 2.74, p < 0.001, GFI = 0.86, CFI = 0.92, AGFI = 0.88, and RMSEA = 0.05. The scale’s convergent and discriminant validity was confirmed. Conclusions: The 14-item, two-dimensional Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19 RS) was demonstrated to have reliable psychometric properties.

1. Introduction

In December of 2019, Wuhan, China, was the location where the first instances of a novel coronavirus disease known as COVID-19 were recorded. In March of 2020, it was determined that the disease had reached pandemic proportions. As of September 2020, the World Health Organization (WHO) had received reports of 209,201,939 confirmed cases of COVID-19 around the world, including 4,390,467 fatalities. The virus has a high rate of transmission from one person to another [1]. Individuals understandably started to worry about COVID-19 when the infection rate was so high and the fatality rate was also relatively high. According to some reports, people are afraid to come into contact with other individuals since they might have COVID-19 [2].
Over a thousand distinct clades and sub-clades of the virus have been discovered so far, as time goes on and efforts to catalog them persist. There may be a genetic shift in the virus as a result of natural selection favoring strains that are better able to evade the immunological responses that are triggered by primary infections [3]. In this hypothetical but conceivable scenario, reinfection unquestionably becomes a reality that cannot be avoided. Cases of reinfection further show that herd immunity against COVID-19 cannot develop with mere immunity originating from spontaneous infections alone [4]. Addressing the individual’s fears about reinfection, educating people about its likelihood and prevention techniques, and requesting ongoing monitoring regardless of the pandemic’s peaks and valleys are a few of the ways to ensure their compliance. Individuals should be made aware of the benefits of supporting testing and surveillance, maintaining strong social-distancing measures, mask compliance, and early immunization [5].
Existing pre-pandemic psychiatric problems or emotional discomfort may be exacerbated by the fear of infection, leading to acute anxiety [6]. According to the findings of studies, one of the symptoms of post-traumatic stress disorder is an excessive fear of COVID-19 [7,8]. Fear is one aspect that distinguishes infectious disease from other types of conditions due to its unique nature [9]. In most cases, fear serves a useful purpose and is associated with fundamental biological processes that help individuals prepare for survival. These processes enable them to react to potential dangers by taking protective action, such as escaping, isolating themselves, or distancing themselves [10]. Fear of COVID-19 also prompts individuals to remain on high alert in order to protect both themselves and the people they care about, which can result in feelings of social isolation, fear, and panic in certain individuals [11].
Stigma associated with COVID-19 refers to an unfavorable attitude towards those who are infected with the virus or have intimate contact with people who have the virus [12]. Recent research found that those who had recently been released from quarantine, people who were infected or suspected of having COVID-19, and people who had recently returned from overseas all experienced some form of stigmatization, in which they were socially excluded, humiliated, and stereotyped [13].
A study compared the levels of stigma experienced by COVID-19 survivors and healthy controls in China. The survivors reported higher levels of general stigma, which resulted in social isolation and feelings of shame [14]. In a further study conducted in Vietnam, it was discovered that 34% of healthcare professionals felt stigmatized, and as a result, they avoided relationships with neighbors and those living in the neighborhood. In addition, 10% of healthcare workers felt blameworthy by friends and family [15]. Furthermore, reports of health risks and psychological issues, such as depression and suicide, were recorded [16,17].
Due to the fact that people who are stigmatized are less likely to reveal their health status [13], they consequently avoid activities that include getting help from a professional [18] and taking the COVID-19 test [18]. The stigma associated with COVID-19 may potentially undermine attempts designed to contain and stop the pandemic from spreading. This is due to the fact that stigmatized individuals are less inclined to reveal their health status.
During times of pandemics, it is recommended that the mental health of students in colleges be monitored [19,20]. On the other hand, there is a paucity of research on the psychological effects that COVID-19 has on undergraduate students, particularly nursing students [20]. Individuals may experience fear as a result of pandemics and epidemics.
Nursing students in Saudi Arabia have a concern of contracting the COVID-19 virus at a rate of 79.3% [21]. In addition, many Turkish nursing students reported feeling fearful about contracting COVID-19 [22]. Fear of COVID-19 has been found to be moderate to high among nursing students in various studies [22,23,24,25]. According to research by Beisland, et al. [26], the COVID-19 fear levels of nursing students are significantly greater than those of the general population. According to national and international studies, the fear of COVID-19 is pervasive among nursing students. It was discovered that fear of COVID-19 increases students’ propensity to opt out of study [23]. In order to minimize adjustment issues, depression, irritability, anxiety, and anger, it is crucial to detect this fear as early as possible [27].
Therefore, it is essential to assess the levels of fear experienced by nursing students in order for them to develop effective coping mechanisms for dealing with these feelings [20,28,29]. It is not easy to deal with the stigma that was created as a result of the COVID-19 outbreak. Stigma brings up issues that are extremely complicated and affect people’s mental health. Because it might persist for a long period without being addressed by effective and efficient social initiatives, the stigma of COVID-19 is a problem that will have a significant impact on social life [30]. As a result, it is necessary to address this concern among nursing students.
When compared to the pre-pandemic baseline, reports of psychosocial distress among adolescents rose during the COVID-19 pandemic [31]. Nevertheless, the potential of the individual’s psychosocial components has not been completely examined. To achieve the broad goal of creating a society free from the psychosocial burden of COVID-19, the study of the fear and stigma of COVID-19 reinfection is essential for maintaining the community’s mental stability in the face of a pandemic. It is possible that the lack of a suitable psychometric scale is the reason why the current treatment for COVID-19 pays such little attention to the fear and stigma of COVID-19 reinfection. This is the only scale that we are aware of that measures fear and stigma among individuals who have a history of COVID-19 infection. The purpose of this research was to develop and validate a scale for determining the level of fear and stigma of COVID-19 reinfection.

2. Methodology

2.1. Design and Setting of the Study

The study was cross-sectional. The fact that this method of research has the potential to yield findings on a large number of participants in a relatively short length of time was a major aspect that played a role in the decision to carry out a cross-sectional study as the method of research in this study. The research was conducted among students at a nursing college in Saudi Arabia.

2.2. Population and Sample

Nursing-college students who were previously COVID-19-positive were included in the study sample. Until recently, the majority of sample size recommendations were based on simple concepts derived from the professional experience of experts. Some of the most frequently mentioned suggestions include absolute numbers. Gorsuch [32] and Kline [33] recommended a minimum sample size of 100 individuals. Comrey and Lee [34] established the following sample size adequacy scale: 50 (extremely poor), 100 (poor), 200 (medium), 300 (good), 500 (very good), and more than 1000 (excellent).
Moreover, the researchers in the current study used Epi-Info (Epidemiological Information Package) version 7.2.5.0 to determine the sample size based on the following information: There were 600 students in the college of nursing. In an earlier study, 79.3% of nursing students in Saudi Arabia stated they had a fear of COVID-19 infection [21]. So, with a 95% confidence interval, 178 cases were thought to be the required number for the sample. The a-priori Sample Size Calculator [35] also confirmed the sample size with a significance level of 0.05, an effect size of 0.25, statistical power of 0.85, and two latent variables. As a result, the minimum sample size for this study was determined to be 156 participants. To account for the low response rate, the researchers recruited additional participants. Additional participants equal to 20–30% of the predicted total are usually necessary [36]. That is why the current study’s researchers assumed that 200 participants would be sufficient for the sample size.
Participants needed to meet the following criteria in order to be considered for the study: (1) undergraduate nursing students who could read, understand, and communicate; (2) the students needed to have sufficient time; (3) the students needed to give their informed consent in order to participate willingly in the study; and (4) the students had to have previously been positive COVID-19, as shown in the Tawakkalna application, which is intended to deliver a wide variety of integrated services to the Saudi Arabian population in order to raise the country’s standard of living. There were pillars that made up the Kingdom of Saudi Arabia’s e-health response to COVID-19. The five mobile phone applications that made up those  pillars were Mawid, Tabaud, Sehha, Tetamman, and Tawakkalna. Only one of these applications—namely, the Tawakkalna App—was required to be used by the population of the Kingdom of Saudi Arabia. This mandate applied only to the Tawakkalna App [37]. Finally, students with pre-existing mental health disorders were not permitted to take part in the research study.

2.3. Development of the Scale

There was a multi-step process that had to be completed before the Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS) could be developed, including item generation and psychometric properties [38]. First, a comprehensive review of the relevant literature was performed with the intention of assessing each general component of the fear and stigma scales. There were thirty different items found that could be used to assess the fear and stigma of COVID-19 reinfection. These methods of assessing fear and stigma are applicable to a wide range of populations and conditions. The pool contained all of the pertinent and potentially useful items that had been combined.
After removing the items that contained material or expressions that were the same as those found in other items, the evaluation proceeded with the remaining 25 items. Secondly, an expert panel consisting of a psychotherapist, a health counselor, a psychiatrist, a general physician, and a psychiatric/mental health nurse examined all 25 items. Based on the recommendations made by the expert panel, 10 items were removed from the scale. Third, the 15 items that were kept were given to a separate group of experts so that they could evaluate them. Following the review of the second expert panel, one more item was scratched off the list and removed from consideration. On a scale from zero to three points, the following responses were given for each item: not at all applicable to me (0), applicable to me to some extent (1), applicable to me to a substantial degree (2), and applicable to me frequently (3). The total item scores from the FSoCOVID-19RS were summed to reflect the individual’s fear and stigma of COVID-19 reinfection level, and the resulting scores varied proportionally from 0 to 42, with a score of 0 indicating the absence of fear and stigma of COVID-19 reinfection and a score of 42 indicating the highest level of fear and stigma associated with COVID-19 reinfection.

2.4. Pilot Test

The purpose of the pilot study was to collect data on the first psychometric properties of the scale and to provide a platform for conducting a simulation of the research work. The expectations were that both of these goals would be accomplished. The pilot study consisted of ten percent of the total sample size, or twenty participants; however, these individuals were not included in the main study population.

2.5. Statistical Analysis

The researcher used a method called double-entry data entry to ensure that there were no mistakes made throughout the transcription process. The Statistical Package for the Social Sciences, version 25.0 (SPSS), was chosen [39]. After observing the floor and ceiling effects, it was decided that items with usual responses should not be included in the study if those responses were detected. This decision was made after the floor and ceiling effects were observed. Typical replies are those in which the majority of the responses are clustered at either the lowest possible scale score or the highest possible scale score. The responsiveness of the scale is negatively impacted as a result of this factor. To analyze construct validity, the convergent validity of the scale was employed. This was done to determine whether or not there was a correlation between items and the overall score [40]. The reliability of the scale was determined statistically with the Cronbach’s alpha method. Estimates of the coefficients were established, and the results obtained were considered satisfactory if they were greater than 0.70 [41]. In addition to this, the split-half reliability coefficient was applied in order to analyze the scale’s internal consistency. Each of the strategies that was described ought to have appropriate correlation coefficients that were greater than 0.30 [42]. Test–retest validity was applied in order to determine the extent to which the scale exhibited external consistency. In this particular research study, the participants were asked to do the survey not once but twice, with a two-week break in between each try; the researchers then compared the responses they gave on the first and second attempts to look for any associations [43].
It was determined through the utilization of the Kaiser–Meyer–Olkin test of sampling adequacy that the sample size was adequate. When evaluating the size of the sample, it is important to look for results that are greater than 0.50. It is considered statistically significant if the p value is less than 0.05, and the Bartlett test of sphericity was used to determine whether or not there was a statistically significant correlation between the items [44]. Utilizing exploratory factor analysis (EFA) allowed for the elimination of any poor items that were present on the scale. The extraction of the component factor was used in order to determine whether or not there were any factors that had a latent root that was larger than the one that was supposed to be used. In order to determine whether or not each factor contained a sufficient number of items, an extraction method based on principal component analysis and a rotation method based on Varimax with Kaiser normalization were utilized. It was determined that an item was powerful if its saturation was greater than 0.30 [21]. The two-factor structure that was taken from EFA was evaluated using confirmatory factor analysis (CFA) with the maximum likelihood estimation method in order to determine whether or not it possessed construct validity. Convergent and discriminant validity were assessed by EFA and CFA, including the average variance extracted (AVE) and the composite reliability (CR) of the scale.

3. Results

The study involved 200 students who had been identified previously as having COVID-19 and whose status had been verified in the Tawakkalna application. Students’ ages ranged from 18 to 26 years, with a mean age of 21.73 (SD: 11). One hundred and fifteen of the students (57.5%) were female, 26 (13.68%) had been diagnosed with a chronic illness, and 21 (11.05%) had a history of mental illness in their families. As can be seen in Table 1, the vast majority of the participants were single (73.68%), and 32.63% of the participants were in their third year.
When forms with typical replies (responses that were positioned at the lowest or maximum scale score), as shown in Table 2, were eliminated, the total number of participants decreased to 190. The scale score for these answers was either the lowest or the highest. These responses can be found in either the lowest or maximum possible scale score. On the Fear and Stigma of COVID-19 Reinfection Scale, calculations were done to calculate the mean (24.85), median (28), and standard deviations of the scores (11.35), as well as the minimums (0) and maximums (42) of those values. High levels of fear and stigma of COVID-19 reinfection were displayed as the participant’s total score increased. It was determined that the floor and ceiling effects were not present in the dimensions; more specifically, there were no responses that were higher than 15% found at the top or bottom of the scale; this indicates that the responsiveness of the scale was improved.
In order to test and evaluate reliability, the Cronbach’s alpha coefficient was applied. Table 3 presents the coefficients that would be obtained if the item in scale were removed, in addition to the overall alpha value of the scale dimensions. In the process of determining how removing each item would affect the overall alpha coefficient of the scale dimensions, the researchers found that the variances ranged from 0.76 (having COVID-19 again threatens my family’s reputation) to 0.95 (when I watch the news and read stories about the possibility of COVID-19 reinfection, I become scared) and 0.86 for the overall score variances ranged from 0.76 (having COVID-19 again threatens my family’s reputation) to 0.95 (when I watch the news and read stories about the possibility of COVID-19 reinfection, I become scared) and 0.86 for the overall score. Cronbach’s alpha was adequate because every one of the items’ scores was greater than 0.70, indicating that all of the items’ alpha ratings were acceptable.
In terms of the split-half reliability coefficient of the scale, the correlation coefficient was 0.87 and the reliability coefficient was 0.93; both of these correlation coefficients are regarded as satisfactory in terms of the internal consistency of the scale.
For the purpose of determining whether or not the scale possessed construct validity, convergent validity was examined. The different components of the scale and the overall score on the scale were analyzed using Pearson’s correlation coefficients so that researchers could better understand the relationship between the two. The convergent validity coefficients are illustrated in Table 4, which can be found below. The values ranged between 0.37 (I believe it is vital to conceal from others the fact that I have been reinfected) and 0.64 (When I watch the news and read stories about the possibility of a COVID-19 reinfection, I become scared). All of the items that were evaluated had correlation coefficients that were higher than 0.30, which is the level at which results are regarded as satisfactory. Correlation values above 0.25 between items were considered quite high by Bernstein [45].
To determine the extent to which the scale possessed external consistency, test–retest validity was utilized. The data were analyzed using Pearson’s correlation coefficients, and the comparison of the participants’ responses from the first time with those from the second time was done. The findings are summarized in Table 4. The range of the value was from 0.71 (when I think of COVID-19 reinfection, I get a bad feeling) to 0.93 (I have recurrent nightmares in which I recall my previous COVID-19 infection), with an overall score for the whole being 0.82. Each of the items that was analyzed had correlation coefficients of more than 0.30, which is the minimum value that may be regarded as acceptable. Kirk and Miller (1986) state that the scale’s validity is assessed by looking at the degree to which individual item scores correlate with the overall score. Each item’s score on a construct is compared to the construct’s total score using the Pearson correlation.
The Kaiser–Meyer–Olkin measure of sampling adequacy was utilized to determine that the sample size was adequate, and it was found to be 0.92. Additionally, the result of 0.97 for Bartlett’s test of sphericity and a p value of less than 0.001 imply a highly statistically significant link between the items. The results of the extraction of the component factor using the component principal on commonality transactions for the variable are displayed in Table 5. It was discovered that two factors had latent roots that were greater than 1, and these factors are shown below. The percentage of each factor’s variance that could be interpreted in terms of the total variance was determined. The first factor had a possible root value of 9.720 and accounted for 72.22% of the total variation. On the other hand, the potential root of the second factor was equal to 1.14, and it was responsible for explaining 80.25% of the total variance. Table 5 displays the findings of a rotated component matrix applied to the two factors, which revealed that the first factor explained 72.22% of the variance and included questions 3, 4, 6, 7, 9, 12, and 14, while the second factor explained 80.25% of the variance and included questions 1, 2, 5, 8, 10, 11, and 13. Because the correlation coefficients of each question were greater than 0.30, it was not necessary to eliminate any of the items from consideration.

3.1. Confirmatory Factor Analysis (CFA)

CFA [46] was utilized in order to examine the scale’s two-factor structure. The findings showed that a two-factor structure was the most appropriate framework for the 14-item scale. The path diagram illustrating the CFA of standardized regression for the 14 items on the Fear and Stigma of COVID-19 Reinfection (FSoCOVID-19RS) can be found in Figure 1. The factor loadings (standardized regression) for the latent variables (circles) and each of the observed variables (rectangles) are shown in the route diagram. Additionally, the amount of variance (R2) that the latent variables account for in the observed variables is shown. Schermelleh-Engel, et al. [47] suggested thresholds for an acceptable fit, which were used as criteria to evaluate how well the model fit the data. The following are the criteria that were employed: (a) the critical ratio (CR) of the factor loadings should be greater than 1.96, (b) the index of relative chi-square (χ2/df) should be less than 5, (c) the comparative fit index (CFI) and the normed fit index (NFI) should both be more than 0.85, (d) the goodness of fit index (GFI) and the adjusted goodness of fit index (AGFI) should both be more than 0.85, and (e) the standardized root mean square residual (RMR) and the root mean square error of approximation (RMSEA) should both be less than 0.08. In this analysis, all of the factor loadings were found to be between 0.68 and 0.86, and the correlation coefficient was determined to be greater than 1.96, suggesting that the results were statistically significant.
The fit indices for the 14-item FSOCOVID-19RS were as follows: χ2 = 3524, df = 1283, χ2/df ratio = 2.74, p < 0.001, GFI = 0.86, CFI = 0.92, AGFI = 0.88, and RMSEA = 0.05. RMSEA stands for root mean squared error. The great majority of the findings indicated that the model had a good enough fit. Following that, modification indices were investigated to determine the parameters that indicated cross-loadings and misspecifications. Nonetheless, no changes were made because no significant improvement in fit indexes was identified. The model was accepted in its existing form, despite its complexity.

3.2. FSoCOVID-19RS Scale Convergent and Discriminant Validity

The degree to which items for a particular construct share a high proportion of the variance is what is meant by the term “convergent validity”, whereas the degree to which a construct is actually unique from other constructs is what is meant by the term “discriminant validity” [48]. Composite reliability (CR), average variance extracted (AVE) (which represents the average percent of variation explained among the items in the same construct), maximum shared variance (MSV), and average shared variance (ASV) are some of the measures that can be used to establish convergent and discriminant validity. Convergent validity was determined by comparing each construct’s AVE to its association with the other constructs; convergent validity was proven when AVE was greater than 0.50 [48]. MSV and ASV should be below AVE for all constructs to show discriminant validity [48]. AVE scores for all dimensions on the FSoCOVID-19RS scale were over 0.50 and greater than correlations with other items, demonstrating the scale’s convergent validity. MSV and ASV were found to be lower than the AVE for all scale constructs, demonstrating the discriminant validity of the FSoCOVID-19RS scale (see Table 6).

4. Discussion

Examining the psychometric features and developing a scale for determining the level of fear and stigma of reinfection with COVID-19 among nursing-college students who were previously infected with COVID-19 was the purpose of this study. The scale is innovative and will be useful for future research, be applicable in various cultures, and help in reducing the detrimental effects of stigma and fear of reinfection.
The scoring system was simplified so that it is straightforward, clear, and easy to use. Because of its four-point style, the Likert scale made it possible for respondents to provide a wide variety of responses. It addresses the fear that is associated with reinfection, which is represented by items 3, 4, 6, 7, 9, 12, and 14, and it also addresses the stigma that is associated with reinfection, which is represented by items 1, 2, 5, 8, 10, 11, and 13.
There were no floor or ceiling effects, and there was extremely good reliability (Cronbach alpha range of 0.76–0.95 and 0.86 for the total score) and strong convergent validity (R range of 0.37–0.64); therefore, the scale is regarded as a very good instrument for measuring fear and stigma of reinfection with COVID-19. There was also strong internal consistency (split half correlation R was 0.87 and reliability R was 0.93) and strong external consistency (test–retest R ranged from 0.71 to 0.93 and 0.82 for the total score). The fact that all of the items on the scale had R values more than 0.30, which indicates that there is no requirement to eliminate any of them, is a strength of the scale. In addition, the findings of the CFA showed that a two-factor structure was the most appropriate framework for the 14-item scale.
Because the pandemic has had such a pervasive influence on the mental health of the general population, there has been a growing demand for measures that can evaluate the various facets of fear associated with COVID-19 [49]. Studies have identified various domains of fear related to COVID-19 infection, such as fear of oneself or their family becoming infected; fear of economic losses and unemployment; fear of, or avoidance behaviors towards, gaining knowledge about the pandemic; and fear of deciding whether to visit parents or not or whether to seek information on death rates [50,51]. It is possible that people’s reactions to control guidelines that are necessary as preventative measures to help with the overall outcome of disease transmission in the community will also be influenced by this fear [52]. Fear of contracting the COVID-19 virus has caused a great number of people to give up participating in social activities [53]. Because of the pandemic’s direct or indirect consequences, younger people, such as college students or adolescents, were particularly susceptible to issues related to their mental health during the pandemic. Students who are fearful of contracting COVID-19, who are pessimistic about their chances of getting it, or who have family or friends who have been infected are more likely to develop anxiety or depression [54]. Because of the severity, mortality, and susceptibility of the diseases, college students may experience an increase in their level of fear, which may have an impact on their mental health as well as their ability to learn well [55,56].
A person who is stigmatized is more likely to be the target of harassment, bullying, discrimination, and the breaking of social links and relationships. In addition to this, there have been reports of health risks and psychological issues, such as depression and suicide [16,17]. A study was conducted on households that had at least one confirmed case of COVID-19. The researchers found that these families were reluctant to disclose their COVID-19 status to others and to meet others after they had been quarantined and isolated because they feared being stigmatized. They even refrained from addressing their concerns and misgivings regarding COVID-19 with members of their families [57]. Some people who survived COVID-19 said that they were even avoided by their neighbors and coworkers [58].

4.1. Limitations

The current study did have certain limitations. First, despite the fact that fear and stigma are personal experiences and that there are limitations when attempting to evaluate them objectively, the nature of the self-report cannot rule out the possibility that respondents’ answers were influenced by social desirability factors. This is because fear and stigma are personal experiences. Second, there were no reverse-coded items included in the scale. Finally, the present study’s findings are less generalizable due to the use of a convenience sample of students from a nursing college.

4.2. Implications

The COVID-19 pandemic has been significant in bringing attention to the various factors that influence psychosocial health. The current study focused how to measure the fear and stigma of reinfection with COVID-19 among individuals who have previously been infected with the virus. During times of pandemic, it is crucial to keep an eye on the psychosocial health of the population since it has become increasingly clear that fear and stigma might be among the most significant factors that contribute to a decline in mental and psychosocial health. The implications of the current study relate to the conduct of additional psychometric testing as well as the use of the tool in studies testing the efficiency of educational programs on the level of stigma and fear of reinfection.

5. Conclusions

The Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS) is a 14-item two-dimensional scale that was shown to have reliable psychometric features. It is the first scale of its kind to measure both fear and stigma associated with reinfection with COVID-19 among previously infected individuals. It has the ability to promote the advancement of operational research and the development of ways to eliminate the stigma associated with COVID-19 as well as the fear of reinfection. It just has to be translated into the appropriate language for that particular culture. Further research on the elements that contribute to stigma and fear in society is strongly encouraged.

Author Contributions

Conceptualization, Z.F.A.; methodology, M.H.A.; software, M.H.A.; validation, M.H.A.; investigation, Y.Z. and R.S.; data curation, Y.Z. and R.S.; writing—original draft, Z.F.A.; writing—review and editing, E.A.; visualization, E.A.; supervision, M.M.A.; project administration, Z.F.A.; funding acquisition, Z.F.A. All authors have read and agreed to the published version of the manuscript.

Funding

The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University for funding this work through the Small group Research Project under grant number RGP1/320/44.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the King Khalid University’s ethical committee (ECM#2023-906).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The authors will provide this work’s datasets upon reasonable request.

Acknowledgments

The authors would like to express their gratitude to King Khalid University, Saudi Arabia for providing administrative and technical support.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Organization, W.H. Coronavirus Disease (COVID-19): Weekly Epidemiological, Update 1; World Health Organization: Geneva, Switzerland, 2020. [Google Scholar]
  2. Lin, C.-Y. Social reaction toward the 2019 novel coronavirus (COVID-19). Soc. Health Behav. 2020, 3, 1–2. [Google Scholar] [CrossRef]
  3. Yahav, D.; Yelin, D.; Eckerle, I.; Eberhardt, C.S.; Wang, J.; Cao, B.; Kaiser, L. Definitions for coronavirus disease 2019 reinfection, relapse and PCR re-positivity. Clin. Microbiol. Infect. 2021, 27, 315–318. [Google Scholar] [CrossRef] [PubMed]
  4. Iwasaki, A. What reinfections mean for COVID-19. Lancet Infect. Dis. 2021, 21, 3–5. [Google Scholar] [CrossRef] [PubMed]
  5. Chaudhury, S.; Ali, T. Fear of COVID-19 Reinfection. Acta Sci. Neurol. 2021, 4, 1–2. [Google Scholar]
  6. Colizzi, M.; Bortoletto, R.; Silvestri, M.; Mondini, F.; Puttini, E.; Cainelli, C.; Gaudino, R.; Ruggeri, M.; Zoccante, L. Medically unexplained symptoms in the times of COVID-19 pandemic: A case-report. Brain Behav. Immun. Health 2020, 5, 100073. [Google Scholar] [CrossRef]
  7. Sun, L.; Sun, Z.; Wu, L.; Zhu, Z.; Zhang, F.; Shang, Z.; Jia, Y.; Gu, J.; Zhou, Y.; Wang, Y. Prevalence and risk factors of acute posttraumatic stress symptoms during the COVID-19 outbreak in Wuhan, China. MedRxiv 2020, 10, 6.20032425. [Google Scholar]
  8. Xu, Z.; Shi, L.; Wang, Y.; Zhang, J.; Huang, L.; Zhang, C.; Liu, S.; Zhao, P.; Liu, H.; Zhu, L. Pathological findings of COVID-19 associated with acute respiratory distress syndrome. Lancet Respir. Med. 2020, 8, 420–422. [Google Scholar] [CrossRef]
  9. Pappas, G.; Kiriaze, I.; Giannakis, P.; Falagas, M. Psychosocial consequences of infectious diseases. Clin. Microbiol. Infect. 2009, 15, 743–747. [Google Scholar] [CrossRef]
  10. Reeve, J. Motivación y Emoción, 5th ed.; Mac Graw-Hil: Mexico City, Mexico, 2010. [Google Scholar]
  11. Yip, P.S.; Chau, P.H. Physical distancing and emotional closeness amidst COVID-19. Crisis 2020, 41, 153–155. [Google Scholar] [CrossRef]
  12. Bhanot, D.; Singh, T.; Verma, S.K.; Sharad, S. Stigma and discrimination during COVID-19 pandemic. Front. Public Health 2021, 8, 577018. [Google Scholar] [CrossRef]
  13. Adom, D.; Mensah, J.A.; Osei, M. The psychological distress and mental health disorders from COVID-19 stigmatization in Ghana. Soc. Sci. Humanit. Open 2021, 4, 100186. [Google Scholar] [CrossRef] [PubMed]
  14. Yuan, Y.; Zhao, Y.-J.; Zhang, Q.-E.; Zhang, L.; Cheung, T.; Jackson, T.; Jiang, G.-Q.; Xiang, Y.-T. COVID-19-related stigma and its sociodemographic correlates: A comparative study. Glob. Health 2021, 17, 54. [Google Scholar] [CrossRef] [PubMed]
  15. Do Duy, C.; Nong, V.M.; Van, A.N.; Thu, T.D.; Do Thu, N.; Quang, T.N. COVID-19-related stigma and its association with mental health of health-care workers after quarantine in Vietnam. Psychiatry Clin. Neurosci. 2020, 74, 566. [Google Scholar] [CrossRef]
  16. Mahmud, A.; Islam, M.R. Social stigma as a barrier to COVID-19 responses to community well-being in Bangladesh. Int. J. Community Well-Being 2021, 4, 315–321. [Google Scholar] [CrossRef] [PubMed]
  17. Pan, S.W.; Shen, G.C.; Liu, C.; Hsi, J.H. Coronavirus stigmatization and psychological distress among Asians in the United States. Ethn. Health 2021, 26, 110–125. [Google Scholar] [CrossRef]
  18. Turner-Musa, J.; Ajayi, O.; Kemp, L. Examining social determinants of health, stigma, and COVID-19 disparities. Healthcare 2020, 8, 168. [Google Scholar] [CrossRef]
  19. Zhai, Y.; Du, X. Mental health care for international Chinese students affected by the COVID-19 outbreak. Lancet Psychiatry 2020, 7, e22. [Google Scholar] [CrossRef]
  20. Cao, W.; Fang, Z.; Hou, G.; Han, M.; Xu, X.; Dong, J.; Zheng, J. The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Res. 2020, 287, 112934. [Google Scholar] [CrossRef]
  21. Albikawi, Z.F. Fear Related to COVID-19, Mental Health Issues, and Predictors of Insomnia among Female Nursing College Students during the Pandemic. Healthcare 2023, 11, 174. [Google Scholar] [CrossRef]
  22. Alici, N.K.; Copur, E.O. Anxiety and fear of COVID-19 among nursing students during the COVID-19 pandemic: A descriptive correlation study. Perspect. Psychiatr. Care 2022, 58, 141–148. [Google Scholar] [CrossRef]
  23. De Los Santos, J.A.A.; Labrague, L.J.; Falguera, C.C. Fear of COVID-19, poor quality of sleep, irritability, and intention to quit school among nursing students: A cross-sectional study. Perspect. Psychiatr. Care 2021, 58, 71–78. [Google Scholar] [CrossRef] [PubMed]
  24. Martínez-Lorca, M.; Martínez-Lorca, A.; Criado-Álvarez, J.J.; Armesilla, M.D.C.; Latorre, J.M. The fear of COVID-19 scale: Validation in spanish university students. Psychiatry Res. 2020, 293, 113350. [Google Scholar] [CrossRef] [PubMed]
  25. Yazici, H.G.n.; Ökten, Ç. Nursing students’ clinical practices during the COVID-19 pandemic: Fear of COVID-19 and anxiety levels. Nurs. Forum 2022, 57, 298–304. [Google Scholar] [CrossRef] [PubMed]
  26. Beisland, E.G.; Gjeilo, K.H.; Andersen, J.R.; Bratås, O.; Bø, B.; Haraldstad, K.; Hjelmeland, I.H.H.; Iversen, M.M.; Løyland, B.; Norekvål, T.M. Quality of life and fear of COVID-19 in 2600 baccalaureate nursing students at five universities: A cross-sectional study. Health Qual. Life Outcomes 2021, 19, 198. [Google Scholar] [CrossRef] [PubMed]
  27. Çürük, G.N.; Özgül, E.; Karadağ, S. The effect of COVID-19 on fear, anxiety, and sleep in nursing students. Ir. J. Med. Sci. 2023, 1–7. [Google Scholar] [CrossRef]
  28. Holmes, E.A.; O’Connor, R.C.; Perry, V.H.; Tracey, I.; Wessely, S.; Arseneault, L.; Ballard, C.; Christensen, H.; Silver, R.C.; Everall, I. Multidisciplinary research priorities for the COVID-19 pandemic: A call for action for mental health science. Lancet Psychiatry 2020, 7, 547–560. [Google Scholar] [CrossRef]
  29. Rajkumar, R.P. COVID-19 and mental health: A review of the existing literature. Asian J. Psychiatry 2020, 52, 102066. [Google Scholar] [CrossRef]
  30. Sulistiadi, W.; Slamet, S.R.; Harmani, N. Handling of public stigma on COVID-19 in Indonesian society. Kesmas J. Kesehat. Masy. Nas. (Natl. Public Health J.) 2020, 1, 70–76. [Google Scholar] [CrossRef]
  31. Taquet, M.; Quoidbach, J.; Fried, E.I.; Goodwin, G.M. Mood homeostasis before and during the coronavirus disease 2019 (COVID-19) lockdown among students in the Netherlands. JAMA Psychiatry 2021, 78, 110–112. [Google Scholar] [CrossRef]
  32. Gorsuch, R.L. Factor Analysis: Classic Edition; Routledge: London, UK, 2014. [Google Scholar]
  33. Kline, P. An Easy Guide to Factor Analysis; Routledge: London, UK, 2014. [Google Scholar]
  34. Comrey, A.L.; Lee, H.B. A First Course in Factor Analysis; Psychology Press: London, UK, 2013. [Google Scholar]
  35. Soper, D. A-Priori Sample Size Calculator for Structural Equation Models. 2021. Available online: https://www.danielsoper.com/statcalc/calculator.aspx?id=89 (accessed on 11 April 2023).
  36. Bujang, M.A. A step-by-step process on sample size determination for medical research. Malays. J. Med. Sci. MJMS 2021, 28, 15. [Google Scholar] [CrossRef] [PubMed]
  37. Bisanzio, D.; Reithinger, R.; Almudarra, S.; Alsukait, R.F.; Dong, D.; Zhang, Y.; El-Saharty, S.; Almossawi, H.; Herbst, C.H.; Alqunaibet, A. Making use of an App (Tawakkalna) to track and reduce COVID transmission in KSA. medRxiv 2022. [Google Scholar] [CrossRef]
  38. Streiner, D.L.; Norman, G.R.; Cairney, J. Health Measurement Scales: A Practical Guide to Their Development and Use; Oxford University Press: New York, NY, USA, 2015. [Google Scholar]
  39. SPSS Inc.; IBM Corp. Released, Statistics for Windows, version 25.0; IBM Corp.: Armonk, NY, USA, 2017. [Google Scholar]
  40. Fayers, P.; Machin, D. Assessment, analysis and interpretation. In Quality of Life; John Wiley & Sons: Hoboken, NJ, USA, 2007. [Google Scholar]
  41. Taber, K.S. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res. Sci. Educ. 2018, 48, 1273–1296. [Google Scholar] [CrossRef]
  42. Terwee, C.B.; Bot, S.D.; de Boer, M.R.; van der Windt, D.A.; Knol, D.L.; Dekker, J.; Bouter, L.M.; de Vet, H.C. Quality criteria were proposed for measurement properties of health status questionnaires. J. Clin. Epidemiol. 2007, 60, 34–42. [Google Scholar] [CrossRef] [PubMed]
  43. Woods, S.P.; Scott, J.C.; Sires, D.A.; Grant, I.; Heaton, R.K.; Tröster, A.I.; Group, H.N.R.C. Action (verb) fluency: Test–retest reliability, normative standards, and construct validity. J. Int. Neuropsychol. Soc. 2005, 11, 408–415. [Google Scholar] [CrossRef] [PubMed]
  44. Coakes, S.J.; Steed, L. SPSS: Analysis without Anguish Using SPSS Version 14.0 for Windows; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2009. [Google Scholar]
  45. Bernstein, J.N.I. Psychometric Theory, 3rd ed.; McGraw-Hill: New York, NY, USA, 1994. [Google Scholar]
  46. Brown, T.A. Confirmatory Factor Analysis for Applied Research; Guilford Publications: New York, NY, USA, 2015. [Google Scholar]
  47. Schermelleh-Engel, K.; Moosbrugger, H.; Müller, H. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. Online 2003, 8, 23–74. [Google Scholar]
  48. Boateng, G.O.; Neilands, T.B.; Frongillo, E.A.; Melgar-Quiñonez, H.R.; Young, S.L. Best practices for developing and validating scales for health, social, and behavioral research: A primer. Front. Public Health 2018, 6, 149. [Google Scholar] [CrossRef]
  49. Wang, C.; Pan, R.; Wan, X.; Tan, Y.; Xu, L.; Ho, C.S.; Ho, R.C. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int. J. Environ. Res. Public Health 2020, 17, 1729. [Google Scholar] [CrossRef]
  50. Taylor, S.; Landry, C.A.; Paluszek, M.M.; Fergus, T.A.; McKay, D.; Asmundson, G.J. COVID stress syndrome: Concept, structure, and correlates. Depress. Anxiety 2020, 37, 706–714. [Google Scholar] [CrossRef]
  51. Schimmenti, A.; Billieux, J.; Starcevic, V. The four horsemen of fear: An integrated model of understanding fear experiences during the COVID-19 pandemic. Clin. Neuropsychiatry 2020, 17, 41. [Google Scholar]
  52. Doshi, D.; Karunakar, P.; Sukhabogi, J.R.; Prasanna, J.S.; Mahajan, S.V. Assessing coronavirus fear in Indian population using the fear of COVID-19 scale. Int. J. Ment. Health Addict. 2021, 19, 2383–2391. [Google Scholar] [CrossRef]
  53. Nicomedes, C.J.C.; Avila, R.M.A. An analysis on the panic during COVID-19 pandemic through an online form. J. Affect. Disord. 2020, 276, 14–22. [Google Scholar] [CrossRef] [PubMed]
  54. Ren, Z.; Xin, Y.; Ge, J.; Zhao, Z.; Liu, D.; Ho, R.C.; Ho, C.S. Psychological impact of COVID-19 on college students after school reopening: A cross-sectional study based on machine learning. Front. Psychol. 2021, 12, 641806. [Google Scholar] [CrossRef]
  55. Khan, A.H.; Sultana, M.S.; Hossain, S.; Hasan, M.T.; Ahmed, H.U.; Sikder, M.T. The impact of COVID-19 pandemic on mental health & wellbeing among home-quarantined Bangladeshi students: A cross-sectional pilot study. J. Affect. Disord. 2020, 277, 121–128. [Google Scholar] [PubMed]
  56. Zhang, H. Early lessons from the frontline of the 2019-nCoV outbreak. Lancet 2020, 395, 687. [Google Scholar] [CrossRef]
  57. Lohiniva, A.-L.; Dub, T.; Hagberg, L.; Nohynek, H. Learning about COVID-19-related stigma, quarantine and isolation experiences in Finland. PLoS ONE 2021, 16, e0247962. [Google Scholar] [CrossRef] [PubMed]
  58. Bu, N. The 80 Thousand COVID-19 Survivers Are Undergoing Discriminaton. 2020. Available online: http://k.sina.com.cn/article_1690367810_64c0f74201900py8d.html?from=mood (accessed on 11 April 2023).
Figure 1. Path diagram illustrating the CFA and regression standardization for FSoCOVID-19RS (N = 190).
Figure 1. Path diagram illustrating the CFA and regression standardization for FSoCOVID-19RS (N = 190).
Healthcare 11 01461 g001
Table 1. Sociodemographic details of the group under study (N = 200).
Table 1. Sociodemographic details of the group under study (N = 200).
VariableNumberPercentage
Age (years)
18–2215075.00
≥235025.00
Gender
Male7537.50
Female11557.50
Marital status
Married5026.32
Single14073.68
Educational Level
1st year4021.05
2nd year5629.47
3rd year6232.63
4th year2211.58
Internship105.27
Chronic disease diagnosis
Yes2613.68
No16486.32
Mental illness in the family
Yes2111.05
No16988.95
Table 2. Mean, median, range, and ceiling and floor effects.
Table 2. Mean, median, range, and ceiling and floor effects.
Total Mean (SD)MedianMinimumMaximum
Number of participants = 19024.85(11.35)28042
No.%
Floor effect (responses receiving the lowest rating)73.5%
Ceiling effect (responses receiving the highest rating)31.5%
Standard deviation (SD).
Table 3. The dimensions’ items and total alpha.
Table 3. The dimensions’ items and total alpha.
No.ItemsThe Alpha Coefficient
1.I am concerned that my family and colleagues will avoid me due to my reinfection.0.87
2.Because I feared that someone would know that I had been reinfected with COVID-19, I avoided medical care.0.86
3.I am afraid that if I get COVID-19 again, I will pass away unexpectedly.0.88
4.Being re-infected with COVID-19 is what terrifies me the most.0.82
5.I believe it is vital to conceal from others the fact that I have been reinfected.0.78
6.I have recurrent nightmares in which I recall my previous COVID-19 infection.0.93
7.When I think of COVID-19 reinfection, I get a bad feeling.0.80
8.I worry that my COVID-19 reinfection may cause me to lose my job.0.92
9.When I worry about getting COVID-19 again, my heart beats fast.0.83
10.The reinfection with COVID-19 makes me feel inferior to others.0.90
11.Having COVID-19 again threatens my family’s reputation.0.76
12.It is uncomfortable for me to consider reinfection with COVID-19.0.82
13.If I am re-infected with COVID-19, I will feel embarrassed and ashamed.0.86
14.When I watch the news and read stories about the possibility of a COVID-19 reinfection, I become scared.0.95
Total0.86
Table 4. Pearson correlation coefficients of the first- and second-time participant answers with the overall score for each item.
Table 4. Pearson correlation coefficients of the first- and second-time participant answers with the overall score for each item.
No.ItemsR1pR2p
1.I am concerned that my family and colleagues will avoid me due to my reinfection.0.46<0.001 **0.85<0.001 **
2.Because I feared that someone would know that I had been reinfected with COVID-19, I avoided medical care.0.56<0.001 **0.88<0.001 **
3.I am afraid that if I get COVID-19 again, I will pass away unexpectedly.0.420.003 **0.80<0.001 **
4.Being re-infected with the COVID-19 is what terrifies me the most.0.44<0.001 *0.84<0.001 **
5.I believe it is vital to conceal from others the fact that I have been reinfected.0.370.004 *0.76<0.001 **
6.I have recurrent nightmares in which I recall my previous COVID-19 infection.0.50<0.001 **0.93<0.001 **
7.When I think of COVID-19, I get a bad feeling.0.380.01 *0.71<0.001 **
8.I worry that my COVID-19 reinfection may cause me to lose my job.0.62<0.001 **0.87<0.001 **
9.When I worry about getting COVID-19 again, my heart beats fast.0.54<0.001 **0.76<0.001 **
10.The reinfection with COVID-19 makes me feel inferior to others.0.48<0.001 **0.78<0.001 **
11.Having COVID-19 again threatens my family’s reputation.0.46<0.001 **0.74<0.001 **
12.It is uncomfortable for me to consider reinfection with COVID-19.0.48<0.001 **0.82<0.001 **
13.If I am re-infected with COVID-19, I will feel embarrassed and ashamed.0.51<0.001 **0.89<0.001 **
14.When I watch the news and read stories about the possibility of a COVID-19 reinfection, I become scared.0.64<0.001 **0.90<0.001 **
Total 0.82<0.001 **
R1: Pearson’s correlation of each item of the scale with total score. R2: Pearson’s correlation between the first- and second-time student answers. * Significant (p value < 0.05). ** Significant (p < 0.001).
Table 5. Rotated factor analysis of FSoCOVID-19RS (N = 190).
Table 5. Rotated factor analysis of FSoCOVID-19RS (N = 190).
No.FSOCOVID-19RS ItemsFactor 1Factor 2
1.I am concerned that my family and colleagues will avoid me due to my reinfection.0.3980.786
2.Because I feared that someone would know that I had been reinfected with COVID-19, I avoided medical care.0.5360.662
3.I am afraid that if I get COVID-19 again, I will pass away unexpectedly.0.6440.523
4.Being re-infected with the COVID-19 is what terrifies me the most.0.7950.351
5.I believe it is vital to conceal from others the fact that I have been reinfected.0.4460.612
6.I have recurrent nightmares in which I recall my previous COVID-19 infection.0.5910.531
7.When I think of COVID-19, I get a bad feeling.0.8170.362
8.I worry that my COVID-19 reinfection may cause me to lose my job.0.3120.792
9.When I worry about getting COVID-19 again, my heart beats fast.0.7480.267
10.The reinfectionof COVID-19 makes me feel inferior to others.0.2400.792
11.Having COVID-19 again threatens my family’s reputation.0.4530.567
12.It is uncomfortable for me to consider reinfection with COVID-19.0.8560.318
13.If I am re-infected with COVID-19, I will feel embarrassed and ashamed.0.2480.825
14.When I watch the news and read stories about the possibility of a COVID-19 reinfection, I become scared.0.8070.312
Total of eigenvalues9.7201.140
Variance (%)72.220%9.045
Cumulative (%)72.220%80.250%
Method of extraction: principal component analysis and method of rotation: Varimax with Kaiser normalization.
Table 6. Convergent and discriminant validity of the FSoCOVID-19RS scale.
Table 6. Convergent and discriminant validity of the FSoCOVID-19RS scale.
FSoCOVID-19RS SubscaleCRAVEMSVASV12
Fear of reinfection0.8200.5370.1670.097* 0.733
Stigma of reinfection0.8350.5490.2070.106** 0.226* 0.741
* Square root of AVE values. ** p < 0.001 (two-tailed).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Albikawi, Z.F.; Abuadas, M.H.; Alalyani, M.M.; Zahrani, Y.; Aqel, E.; Safi, R. Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS): New Scale Development and Validation. Healthcare 2023, 11, 1461. https://doi.org/10.3390/healthcare11101461

AMA Style

Albikawi ZF, Abuadas MH, Alalyani MM, Zahrani Y, Aqel E, Safi R. Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS): New Scale Development and Validation. Healthcare. 2023; 11(10):1461. https://doi.org/10.3390/healthcare11101461

Chicago/Turabian Style

Albikawi, Zainab Fatehi, Mohammad Hamdi Abuadas, Mesheil M. Alalyani, Yousef Zahrani, Emad Aqel, and Raid Safi. 2023. "Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS): New Scale Development and Validation" Healthcare 11, no. 10: 1461. https://doi.org/10.3390/healthcare11101461

APA Style

Albikawi, Z. F., Abuadas, M. H., Alalyani, M. M., Zahrani, Y., Aqel, E., & Safi, R. (2023). Fear and Stigma of COVID-19 Reinfection Scale (FSoCOVID-19RS): New Scale Development and Validation. Healthcare, 11(10), 1461. https://doi.org/10.3390/healthcare11101461

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop