Next Article in Journal
Simulation and Improvement of Patients’ Workflow in Heart Clinics during COVID-19 Pandemic Using Timed Coloured Petri Nets
Next Article in Special Issue
The Early Impact of the Covid-19 Emergency on Mental Health Workers: A Survey in Lombardy, Italy
Previous Article in Journal
Effect of a Simulated Match on Lower Limb Neuromuscular Performance in Youth Footballers—A Two Year Longitudinal Study
Previous Article in Special Issue
A 2-Month Follow-Up Study of Psychological Distress among Italian People during the COVID-19 Lockdown
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Psychological Consequences of COVID-19 and Lockdown in the Spanish Population: An Exploratory Sequential Design

by
María Dolores Hidalgo
1,
Nekane Balluerka
2,
Arantxa Gorostiaga
2,*,
José Pedro Espada
3,
Miguel Ángel Santed
4,
José Luis Padilla
5 and
Juana Gómez-Benito
6,7
1
Department of Basic Psychology and Methodology, Faculty of Psychology, University of Murcia, 30100 Murcia, Spain
2
Department of Clinical and Health Psychology, and Research Methods, Faculty of Psychology, University of the Basque Country UPV/EHU, 20018 Donostia, Spain
3
Department of Health Psychology, Faculty of Social Health Sciences, Miguel Hernández University, 03202 Elche, Spain
4
Department of Personality Psychology, Psychological Assessment and Treatment, Faculty of Psychology, National Distance Education University (UNED), 28040 Madrid, Spain
5
Department of Methodology for Behavioural Science, Faculty of Psychology, University of Granada, 18071 Granada, Spain
6
Department of Social Psychology and Quantitative Psychology, Faculty of Psychology, University of Barcelona, 08035 Barcelona, Spain
7
Group on Measurement Invariance and Analysis of Change (GEIMAC), Institute of Neuroscience, University of Barcelona, 08035 Barcelona, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(22), 8578; https://doi.org/10.3390/ijerph17228578
Submission received: 12 October 2020 / Revised: 13 November 2020 / Accepted: 17 November 2020 / Published: 19 November 2020
(This article belongs to the Special Issue Mental Health in the Time of COVID-19)

Abstract

:
The objectives of this study were to analyze the psychological impact of the COVID-19 pandemic and the lockdown in the Spanish population and to identify what population profiles were most affected. The study used a sequential exploratory design. In the qualitative phase, 40 participants were recruited based on theoretically relevant criteria and the saturation of the information provided by the interviews. In the quantitative phase, a large representative sample was applied. The universe considered was the adult population of Spain. A total of 6789 surveys were conducted. Both the analysis of the narratives of the interviews and the responses to the panel survey showed relevant changes in attitudes and mood swings compared to the period prior to lockdown. These changes include dysphoric moods (i.e., experiences of distress such as sadness/depression, anxiety, rage, feeling of unreality, worry, etc.) and also some euphoric moods (i.e., feelings of well-being, happiness, etc.). A higher number of women were affected than men and a greater increase was observed in younger people. The findings of the study may serve as a basis for detecting needs and providing psychological support, as the symptoms detected as the most common are key for the processes of screening at-risk individuals.

1. Introduction

The crisis resulting from the COVID-19 epidemic has caused extraordinary changes in the population worldwide. Stressful events that pose a threat to survival have significant psychological repercussions. The emotional impact of the fear of contagion and the fear of the illness and/or death of loved ones has been added to the stress resulting from the social distancing and lockdown measures for containing the pandemic. In general, the quarantines due to the pandemic have been associated with acute stress and adaptation stress, symptoms of posttraumatic stress, posttraumatic stress, fear, sadness, nervousness, guilt, confusion, and anger [1]. During lockdown, relational functioning among family, community, and peers is inhibited or interrupted, which can increase vulnerability to adverse reactions from a psychological point of view. Similarly, the incidence of posttraumatic stress disorder (PTSD) after the SARS pandemic in Canada was found to be similar to that of natural disasters and terrorism [2,3].
However, the worldwide lockdown experienced in the first half of 2020 was unprecedented, and has affected millions of inhabitants around the world. We must know what the psychological consequences of COVID-19 and the lockdown are to understand how people have coped with quarantine and what the long-term psychological effects of this situation may be, in order to have a chance to prevent them. Studies conducted in various countries and geographic regions have evidenced the psychological and mental health impact of lockdown [4,5,6,7,8]. These studies have observed an increase in symptoms of depression, anxiety, stress, fear, problems sleeping, and PTSD, although it may not be possible to generalize their results to the population due to the sample size involved or the sample selection procedure used (incidental or snowball recruitment). Several authors have indicated the importance of rigorously analyzing the psychological effects of the COVID-19 pandemic on the population [9,10]. In this sense, cross-sectional population studies such as Qiu et al. [11], Xin et al. [12], and Zhang et al. [13] in China, Lauri Korajlija and Jokic-Begic [14] in Croatia, Alonzi et al. [15] in Canada, Gualano et al. [16] in Italy, and Fitzpatrick et al. [17] in the United States have confirmed the effects of lockdown and COVID-19 on psychological distress.
Spain is one of the countries with the highest rates of people affected and deceased in relation to its number of inhabitants. The mandatory at-home lockdown for the entire Spanish population led to significant habit changes that affect individual well-being [18]. Although some studies with Spanish samples have been published (i.e., [19,20]), studies are needed at the population level, that would be representative enough to delving deeper into the factors related to the psychological impact of COVID-19 and generalizing the findings to the population.
The urgent need for representative data on the psychological effects of COVID-19, as well as the complexity of identifying and evaluating the resulting psychological consequences, is a methodological challenge that requires a complex approach. This study seeks to respond to these challenges through a mixed method study that combines qualitative and quantitative methodology. Mixed methodology has received growing attention in recent decades, as it demonstrates the benefits of combining qualitative and quantitative methods to approach complex phenomena [21,22]. Furthermore, as stated in the review by Brooks et al. [1] of studies on the psychological impact of quarantine, three [23,24,25] of the 24 analyzed studies used a mixed methods design, although all those studies collected data retrospectively and used a cross-sectional survey method in the first phase, later applying a qualitative method (focus groups, semi structured interview, etc.), limiting the scope of the results.
The primary objective of this study was to analyze the psychological impact of the COVID-19 pandemic and of lockdown and its relationship to sociodemographic variables. In addition to learning what the most common symptoms were, we wanted to discover in which population profiles each of the discovered impacts occurred most often.
In order to contribute to filling the detected gaps, this study used a mixed method research design for the first time in this context, using a sequential exploratory design that involved the use of both in-depth interviews and a survey questionnaire, which offers a more comprehensive multimethod view than a design based exclusively on questionnaires. The two methodologies were used sequentially. The experiences of the psychological and emotional consequences of COVID-19 were explored through in-depth interviews conducted during lockdown, and in the second phase of the research, the information obtained from the interviews was used both to identify the profiles for the population study and to develop the questionnaire that was applied by surveying a large representative sample, examining the psychological impact of the epidemic in the last phase of lockdown in the Spanish population.

2. Materials and Methods

Figure 1 illustrates how the different phases of the exploratory sequential design were carried out. In terms of the method, we used 2 approaches for integration: “connecting” and “building” [26]. The analysis of in-depth interviews helped to identify the demographic profile of the future participants in the survey study, thus “connecting” the qualitative and quantitative study through the sampling design. At the same time, the subject areas and subjects identified in the analysis of the interviews were used to propose the dimensions and indicators of the questionnaire used in the survey study.

2.1. Qualitative Phase

2.1.1. Participants

In total, 40 people were recruited. These participants were chosen considering relevant sociodemographic and substantive characteristics. In addition to considering gender (21 women and 19 men) and age (12 individuals between age 18 and 35, 18 between 35 and 55, and 10 over 55), the individuals resided in different geographic regions, had different work situations (10 temporarily unemployed people, 8 people working remotely), family and living situations, and relationship to COVID-19 (22 people not affected by COVID-19 nor those around them, 8 with people around them diagnosed with the illness). Interviews were conducted until saturation was reached. In this study, saturation was defined as the point when information collected during interviews reveals no additional themes.
The interviewees were chosen from 167 people who accepted; there were only 6 refusals because of the discomfort that talking about COVID-19 could cause the person. The individuals contacted were informed of the study objective and characteristics; they were also given the confidentiality guarantees established in the European General Data Protection Regulation (EU 2016/679), and informed of the approval of the study by the Ethics Committee on Research with Human Beings of the University of the Basque Country (Ethical number M10_2020_076).

2.1.2. Interview Protocol

To develop the protocol, we reviewed the scientific literature on the effects of COVID-19, instruments for evaluating the psychological consequences of the pandemic, and we had the experience of the research team on psychological impact in traumatic situations.

2.1.3. Data Collection and Analysis

The interviews were conducted by 4 interviewers with degrees/doctorates in psychology with experience in conducting in-depth interviews. The interviews were conducted by phone in the second week of April 2020, and were recorded with the consent of the interviewees. The interviewers were trained on the interview protocol, probing techniques and how to manage cases in which the interviewee was referred for psychological care due to showing indicators of clinically significant distress. The duration of the interviews ranged from 25 to 97 min, with an average duration of 53 min.
The research team carried out the analysis of the interviews, guided by the principles of grounded theory [27]. Without using a detailed theoretical outline, the team created a code system to organize and manage the interview conversation. The recordings of the interviews were processed using an Excel sheet in which the code system had been recorded. The analysis was done in 3 phases to progressively break down the data following the comparative method [27]. The analysis paid particular attention to the examination of the interpretative patterns identified through subgroups of people defined by their profiles or experiences of the psychological consequences of COVID-19 and of lockdown. A process consisting of various rounds of review was completed on the first analyses conducted by each analyst on the team to resolve disagreements in processing the information. Any discrepancies were resolved by consensus.

2.2. Quantitative Phase

2.2.1. Setting

The survey data collection occurred between 22 and 26 April 2020. During this period, the state of emergency initially declared by Royal Decree 463/2020 (14 March) was extended. In terms of the pandemic in Spain at this time, out of a population of 47,329,981 inhabitants, there was a reported total of 202,990 cases of COVID-19 confirmed by PCR, 22,524 deaths, 92,355 recoveries and positive antibody test results in 16,774 individuals, being the European country with the highest number of confirmed cases (Update no. 85. coronavirus disease (COVID-19)).

2.2.2. Participants

The context considered in the survey study was the adult population (18 years or over) of Spain. For sampling, the key sociodemographic variables of the population were considered as quotas (gender, socioeconomic level, and age), supported by the results of the qualitative study. From the initial sampling, 6789 surveys were ultimately conducted, of which 52.2% were women. Distribution by age was 26.55% for the age range from 18 to 34, 52.1% for the age range from 35 to 60, and 21.4% for the age range over 60. Further, the distribution of participants for the variable socioeconomic level was 36.9% low, 39.8% medium, and 23.4% high. Sampling error was 1.86 with respect to the expanded sample—in other words, the adult population of Spain (34,506,804 people).

2.2.3. Data Collection

The method used to collect information was online surveys, using Netquest Panel Online, composed of the Spanish population over 14 years of age. The maintenance of the panel is as indicated in the ISO 26,362 standard. Of the 16,205 invitations extended, 10,059 were accepted, representing a rate of 62%. Of the 10,059 participants, the following were excluded: 271 due to various quality filters, 42 for follow-up care, 45 because the quota for the autonomous community had already been met, 2297 because they accessed to the survey after the deadline and 615 due to being incomplete.
The online questionnaire was developed based on the thematic areas identified in the narratives of the in-depth interviews, the international scientific literature review on the psychological effects of COVID-19, and the review of instruments for evaluating the psychological effects of COVID-19. The general survey question was: During lockdown, compared to your life before lockdown, how much do you think you have changed with regard to the following aspects? The following response scale was used: 1 = Has decreased a lot; 2 = Has decreased a little; 3 = Has stayed the same; 4 = Has increased a little; 5 = Has increased a lot. The online questionnaire included several quality controls to prevent automated responses and acquiescence response bias. Item quality controls were stablished, thus when a small number of people had responded (5% of the sample), item statements were reviewed. The average response time for the survey was 14.1 min (SD = 6.8) and the average time per page was 0.37 min (SD = 0.18).

2.2.4. Data Analysis

Percentages of change and Chi-square statistical tests for contingency tables were calculated for each of the psychological variables by gender, age, and socioeconomic level.

3. Results

The results are presented by merging the findings of the in-depth interviews with the results of the survey study. The report on the results is structured by three sociodemographic variables: gender, age, and socioeconomic level, to make it more useful for reaching conclusions on the psychological effects of COVID-19 in Spain.
Based on the analysis of the discourses with interviewed individuals, we identified changes in their attitude and mood swings compared to their life prior to lockdown as well as changes during lockdown. These changes mainly include dysphoric moods (i.e., experiences of distress such as sadness/depression, anxiety, anger, feeling of unreality, worry, etc.) and also some euphoric moods (i.e., feelings of well-being, happiness, etc.).
This general pattern of findings in the interviews converges with the primary results obtained in the survey study. Table 1 presents the primary themes that emerged from the analysis of the interviews, as well as their correspondence with the survey study results.

3.1. Psychological Changes by Gender

The in-depth interviews already pointed out gender differences in the experience of psychological changes as a consequence of COVID-19. For example, some emotional changes seem to be associated with the role of being a mother. One interviewee reported that everything has changed for her, both in chores and in strains: the children’s homework, more cleaning, stress, feeling overwhelmed, psychological exhaustion, uncertainty...
“This is hard and here at home there have been days when one of my children has been truly down, despairing, and the tears start to fall.”
(IN19_H_33)
Another interviewee reports:
“I’m more nervous, everything is mounting up, the children, the house, that my husband is out there. I’m scared.”
(IN23_M_42)
Table 2 shows survey estimates per gender group for each of the psychological variables. Due to the high sample size, all Chi-square statistical tests were significant (p < 0.001). Thus, psychological variables with greater percentage differences between females and males are discussed. Women, in a higher percentage than men, reported a greater increase in indicators of psychological distress, difficulty concentrating, feelings of depression, feelings of guilt, mood swings, problems sleeping, levels of irritation, panic attacks, tendency to not want to think, feelings of unreality, and physical symptoms without a clear relationship to the illness. Furthermore, a higher percentage of women than men indicated that their fear of losing loved ones had greatly increased and that their feelings of confidence, peace and vitality/energy had decreased.

3.2. Psychological Changes by Age

All Chi-square statistical tests were significant (p < 0.001). Psychological variables with greater percentage differences by age are discussed. Table 3 shows differences in younger people, compared to the other age groups, regarding a greater increase in general distress, difficulty concentrating, uncertainty, panic attacks, tendency not to think, feelings of depression, feelings of guilt, thoughts of self-harm, feelings of loneliness, irritation or anger, mood swings, problems with sexual intercourse, problems sleeping, and psychosomatic symptoms. Participants in this age group also reported a greater decrease in their ability to make decisions, in their feelings of peace and calm, and in their feelings of vitality.
The narratives of the youngest participants evidenced adverse effects of overwhelm and distress, for example:
“I feel overwhelmed.”
(IN01_M_22)
“Our exams have been suspended, they are going to be delayed and they haven’t told us when they will be and it feels uncertain since you don’t really know what is going to happen.”
(IN18_F_30)
In contrast, people over age 60 presented a greater increase in concern for suffering from or contracting a serious disease, compared to other age groups. The narratives of this age group evidence this also:
“I was very afraid; my children lost their father in November and I don’t think they are ready to lose their mother.”
(IN35_F_60)
Furthermore, in this same age group, there was a greater increase in willingness to help other people than in other groups. This is also reflected in the interviews:
“The best... also the solidarity that everyone has demonstrated. Thinking about others and being more human in general, in our life, that remains and will remain, for those of us who have lived through this experience, it will remain...”
(IN36_M_62)

3.3. Psychological Changes by Socioeconomic Level

Although all Chi-square statistical tests were significant (p < 0.001), as shown in Table 4, the patterns of percentages of change in the psychological variables analyzed were similar regardless of the socioeconomic level of the participants in the survey study. However, survey respondents in the highest socioeconomic levels indicated a higher percentage of a slight or high increase in willingness to help others than those in the lower levels. In contrast, a greater percentage of people from medium and low socioeconomic levels indicated an increase in feeling depressed, pessimistic, or hopeless, panic attacks, thoughts of self-harm, as well as a greater reduction in feelings of vitality and energy than people from the highest socioeconomic level. The differences indicated were not large.
In interviews with people who had financial problems, some of these dysphoric feelings were mentioned:
“I am struggling a little at night, I wake up and I get a little panicked because I can’t see an easy solution to this.”
(IN17_F_52)
“The work situation comes to mind, the uncertainty, when will it resume, whether it’s going to be the same...”
(IN26_M_35)
In contrast, some of the people who expressed that they had not been financially affected expressed worry for other people who had it worse and their willingness to help:
“I’m worried that people will suffer.”
(IN20_F_56)
“The volunteer work I do is delivering food: we go to the location they have, there are shopping trolleys, we fill them with purchases, people come and get the food.”
(IN40_M_21).

4. Discussion

The primary objective of this study was to analyze the psychological impact of the COVID-19 pandemic and of lockdown in the Spanish population and to identify what population profiles were most affected. For this purpose, we used a mixed research methodology for the first time in this context to obtain a more comprehensive view, combining the advantages of qualitative and quantitative methodologies, where the data collection was done while the population was in lockdown. Both the analysis of the narratives of the interviews and the responses to the panel survey showed relevant changes in attitudes and mood swings compared to the period prior to lockdown. Changes in sleep were one of the indicators of well-being that were most impacted, which is in line with the observations from studies with other populations [6,28].
With regard to population profiles, a higher number of women were affected than men. Most women reported having experienced mood swings, compared to a much lower rate in men. Feelings of depression were also more frequent in women. Furthermore, women more frequently reported having feelings of guilt compared to men. This pattern was also observed in specific cognitive symptoms, such as difficulty concentrating, more present in women, with twice as many participants experiencing a decline. This tendency was maintained in other symptoms related to other mood symptoms, noting that women had higher levels of irritability. In the area of activation and anxiety, close to double the rate of anxiety attacks was observed in women than men. These data are consistent with the analysis of the in-depth interviews, where the narratives were in line with this. Some emotional changes seem to be associated with the role of being a mother. As in previous studies in the Spanish population [20], women have suffered a greater degree of negative psychological impact. A similar pattern was observed in the international population [6,16,29]. The reason could be related to the different way in which gender roles affect men and women, including in the context of the pandemic, which routinely involves greater responsibility as family caregivers. Therefore, the interruption of schooling may have further increased their level of stress [30].
In terms of age, a greater increase was observed in younger people in general distress, difficulty concentrating, levels of uncertainty, anxiety attacks, feelings of depression, feelings of guilt, loneliness, irritation or anger, mood swings, problems with sexual intercourse, problems sleeping, and psychosomatic symptoms. Young people also reported a greater decrease in their ability to make decisions, in their feelings of peace and calm and in their feelings of vitality, in keeping with other Spanish studies [18]. The reason for this difference may be due to the different levels of demands and personal resources. Although it is true that the financial impact due to job loss more directly affects adults, the temporary measures may have also helped to reduce uncertainty about the future. However, the changes in academic activity in the youngest participants (e.g., online schooling), seem to have affected their emotional stability to a greater degree. Another possible explanation is related to personal coping resources, which are less developed in the juvenile population, therefore making subjects feel less confident in facing this crisis [31]. The content of worries varies by ages, noting that people over age 60 presented a greater increase in worry about suffering from or contracting a serious disease compared to other age groups. Older age has been identified in previous studies as a factor for vulnerability to negative impact in traumatic situations [32]. In the sample from this study, the age range of older individuals was sufficiently represented, therefore these data complement the recommendations to explore the negative impact of COVID-19 in the elderly population [18].
With regard to the degree of psychological impact based on socioeconomic level, similarly to other studies with Spanish participants [20], we found that people with higher incomes tended to show less psychological impact than those from a lower socioeconomic level. Despite this, the changes in the psychological variables analyzed were similar regardless of the socioeconomic level of the participants in the survey study. In the higher socioeconomic levels, a tendency was observed towards the willingness to help others, irritation and anger, mood swings, and general psychological distress. People with medium and low socioeconomic levels demonstrated a greater degree of increase in feelings of depression, anxiety attacks and suicidal ideation. They also showed a greater reduction in feelings of vitality and energy compared to people with a higher socioeconomic level. The role of socioeconomic level as a protective factor was confirmed in studies such as Cao et al. [4], who observed that living in urban areas and having financial stability acted as protective factors against generalized anxiety in the Chinese population.
This study has limitations that should be pointed out; primarily in the design, which, given its cross-sectional nature, does not allow for establishing causal or predictive relationships based on the data found. In addition, the data collection procedure was based on subjective self-reported measures based on subjects’ assessment of their own condition. The data were collected during the final phase of at-home lockdown; therefore, the results provide data relative to that moment in time. One possible limitation with respect to interview analysis was that a double coding in order to establish intercoder reliability was not conducted. However, a process consisting of several rounds of review of the preliminary analysis conducted by each team member was carried out, where disagreements were resolved by consensus. Despite this, this study provides solid, novel points as it is the first study using a mixed qualitative and quantitative methodology, which allows for people’s experiences to be transferred to the panel survey. Furthermore, the data come from a large sample collected with international quality criteria to be representative of the Spanish population. The findings of the study may serve as a basis for detecting needs and providing psychological support, since the symptoms detected as the most common are key for the processes of screening at-risk individuals.

5. Conclusions

The study provides solid, novel points as it is the first study using a mixed qualitative and quantitative methodology, which allows for people’s experiences to be transferred to the panel survey. Furthermore, the data come from a large sample created with international quality criteria to be representative of the Spanish population.
Both the analysis of the narratives of the interviews and the responses to the panel survey showed relevant changes in attitudes and mood swings compared to the period prior to lockdown. These changes include dysphoric moods and also some euphoric moods. A higher number of women were affected than men and a greater increase of dysphoric moods was observed in younger people.
The findings of the study may serve as a basis for detecting needs and providing psychological support, as the symptoms detected as the most common are key for the processes of screening at-risk individuals.

Author Contributions

Conceptualization, M.D.H., J.G.-B., N.B., A.G., J.P.E., M.Á.S. and J.L.P.; methodology, M.D.H., J.G.-B., N.B., A.G. and J.L.P.; data curation, M.D.H., J.G.-B. and A.G.; formal analysis, M.D.H., A.G. and J.L.P.; project administration, N.B., and A.G.; supervision, J.G.-B.; writing—original draft preparation, M.D.H.; writing—review and editing, J.G.-B., N.B., A.G., J.P.E., M.Á.S. and J.L.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank the Spanish Ministry of Universities for the support provided to conduct this research. However, the final manuscript is solely the authors’ responsibility.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Brooks, S.K.; Webster, R.K.; Smith, L.E.; Woodland, L.; Wessely, S.; Greenberg, N.; Rubin, G.J. The psychological impact of quarantine and how to reduce it: Rapid review of the evidence. Lancet 2020, 395, 912–920. [Google Scholar] [CrossRef] [Green Version]
  2. Hawryluck, L.; Gold, W.L.; Robinson, S.; Pogorski, S.; Galea, S.; Styra, R. SARS control and psychological effects of quarantine, Toronto, Canada. Emerg. Infect. Dis. 2004, 10, 1206–1212. [Google Scholar] [CrossRef] [PubMed]
  3. Sprang, G.; Silman, M. Posttraumatic stress disorder in parents and youth after health-related disasters. Disaster Med. Public Health Prep. 2013, 7, 105–110. [Google Scholar] [CrossRef] [PubMed]
  4. Cao, W.; Fang, Z.; Hou, G.; Han, M.; Xu, X.; Dong, J.; Zheng, J. The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Res. 2020, 287, 112934. [Google Scholar] [CrossRef] [PubMed]
  5. Liang, L.; Ren, H.; Cao, R.; Hu, Y.; Qin, Z.; Li, C.; Mei, S. The effect of COVID-19 on youth mental health. Psychiatry Q. 2020, 91, 841–852. [Google Scholar] [CrossRef]
  6. Liu, N.; Zhang, F.; Wei, C.; Jia, Y.; Shang, Z.; Sun, L.; Wu, L.; Sun, Z.; Zhou, Y.; Wang, Y.; et al. Prevalence and predictors of PTSS during COVID-19 outbreak in China hardest-hit areas: Gender differences matter. Psychiatry Res. 2020, 287, 112921. [Google Scholar] [CrossRef]
  7. Wang, C.; Pan, R.; Wan, X.; Tan, Y.; Xu, L.; Ho, C.S.; Ho, R.C. Immediate psychological responses and associated factors during the initial stage of the 2019 Coronavirus disease (COVID-19) epidemic among the general population in China. Int. J. Environ. Res. Public Health 2020, 17, 1729. [Google Scholar] [CrossRef] [Green Version]
  8. Zhao, Y.; An, Y.; Tan, X.; Li, X. Mental health and its influencing factors among self-isolating ordinary citizens during the beginning epidemic of COVID-19. J. Loss Trauma 2020, 25. [Google Scholar] [CrossRef]
  9. Carvalho, P.M.M.; Moreira, M.M.; de Oliveira, M.N.A.; Landim, J.M.M.; Neto, M.L.R. The psychiatric impact of the novel coronavirus outbreak. Psychiatry Res. 2020, 286, 112902. [Google Scholar] [CrossRef]
  10. Espada, J.P.; Orgilés, M.; Piqueras, J.A.; Morales, A. Las buenas prácticas en la atención psicológica infanto-juvenil ante el COVID-19 [Good practices in child and adolescent psychological care in the face of COVID-19]. Clin. Salud 2020, 31, 109–113. [Google Scholar] [CrossRef]
  11. Qiu, J.; Shen, B.; Zhao, M.; Wang, Z.; Xie, B.; Xu, Y. A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: Implications and policy recommendations. Gen. Psychiatry 2020, 33, e100213. [Google Scholar] [CrossRef] [Green Version]
  12. Xin, M.; Luo, S.; She, R.; Yu, Y.; Li, L.; Wang, S.; Ma, L.; Tao, F.; Zhang, J.; Zhao, J.; et al. Negative cognitive and psychological correlates of mandatory quarantine during the initial COVID-19 outbreak in China. Am. Psychol. 2020, 75, 607–617. [Google Scholar] [CrossRef]
  13. Zhang, S.X.; Wang, Y.; Rauch, A.; Wei, F. Unprecedented disruption of lives and work: Health, distress and life satisfaction of working adults in China one month into the COVID-19 outbreak. Psychiatry Res. 2020, 288, 112958. [Google Scholar] [CrossRef]
  14. Lauri Korajlija, A.; Jokic-Begic, N. COVID-19: Concerns and behaviours in Croatia. Br. J. Health Psychol. 2020. [Google Scholar] [CrossRef]
  15. Alonzi, S.; La Torre, A.; Silverstein, M.W. The psychological impact of preexisting mental and physical health conditions during the COVID-19 pandemic. Psychol. Trauma 2020, 12, S236–S238. [Google Scholar] [CrossRef]
  16. Gualano, M.R.; Lo Moro, G.; Voglino, G.; Bert, F.; Siliquini, R. Effects of Covid-19 on mental health and sleep disturbances in Italy. Int. J. Environ. Res. Public Health 2020, 17, 4779. [Google Scholar] [CrossRef]
  17. Fitzpatrick, K.M.; Harris, C.; Drawve, G. Fear of COVID-19 and the mental health consequences in America. Psychol. Trauma 2020, 12, S17–S21. [Google Scholar] [CrossRef]
  18. Rodríguez-Rey, R.; Garrido-Hernansaiz, H.; Collado, S. Psychological impact and associated factors during the initial stage of the Coronavirus (COVID-19) pandemic among the general population in Spain. Front. Psychol. 2020, 11, 1540. [Google Scholar] [CrossRef]
  19. Romero, E.; López-Romero, L.; Domínguez-Álvarez, B.; Villar, P.; Gómez-Fraguela, J.A. Testing the effects of COVID-19 confinement in Spanish children: The role of parents’ distress, emotional problems and specific parenting. Int. J. Environ. Res. Public Health 2020. [Google Scholar] [CrossRef]
  20. Sandín, B.; Valiente, R.M.; García-Escalera, J.; Chorot, P. Psychological impact of the COVID-19 pandemic: Negative and positive effects in Spanish people during the mandatory national quarantine. Rev. Psicopatol. Psicol. Clin. 2020, 25, 1–22. [Google Scholar] [CrossRef]
  21. Creswell, J.W. A Concise Introduction to Mixed Methods Research; SAGE: Thousand Oaks, CA, USA, 2015. [Google Scholar]
  22. Guetterman, T.C.; Fetters, M.D.; Creswell, J.W. Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Ann. Fam. Med. 2015, 13, 554–561. [Google Scholar] [CrossRef]
  23. Caleo, G.; Duncombe, J.; Jephcott, F.; Lokuge, K.; Mills, C.; Looijen, E.; Theoharaki, F.; Kremer, R.; Kleijer, K.; Squire, J.; et al. The factors affecting household transmission dynamics and community compliance with Ebola control measures: A mixed-methods study in a rural village in Sierra Leone. BMC Public Health 2018, 18, 248. [Google Scholar] [CrossRef]
  24. DiGiovanni, C.; Conley, J.; Chiu, D.; Zaborski, J. Factors influencing compliance with quarantine in Toronto during the 2003 SARS outbreak. Biosecur. Bioterror. 2004, 2, 265–272. [Google Scholar] [CrossRef]
  25. Lee, S.; Chan, L.Y.Y.; Chau, A.M.Y.; Kwok, K.P.S.; Kleinman, A. The experience of SARS-related stigma at Amoy Gardens. Soc. Sci. Med. 2005, 61, 2038–2046. [Google Scholar] [CrossRef]
  26. Fetters, M.D.; Curry, L.A.; Creswell, J.W. Achieving integration in mixed methods designs-principles and practices. Health Serv. Res. 2013, 48, 2134–2156. [Google Scholar] [CrossRef] [Green Version]
  27. Glaser, B. Basics of Grounded Theory Analysis; Sociology Press: Mill Valley, CA, USA, 1992. [Google Scholar]
  28. Roy, D.; Tripathy, S.; Kar, S.K.; Sharma, N.; Verma, S.K.; Kaushal, V. Study of knowledge, attitude, anxiety & perceived mental healthcare need in Indian population during COVID-19 pandemic. Asian J. Psychiatry 2020, 51, 102083. [Google Scholar] [CrossRef]
  29. Smith, L.; Jacob, L.; Yakkundi, A.; McDermott, D.; Armstrong, N.C.; Barnett, Y.; López-Sánchez, G.F.; Martin, S.; Butler, L.; Tully, M.A. Correlates of symptoms of anxiety and depression and mental wellbeing associated with COVID-19: A cross-sectional study of UK-based respondents. Psychiatry Res. 2020, 291, 113138. [Google Scholar] [CrossRef]
  30. Wenham, C.; Smith, J.; Morgan, R. COVID-19: The gendered impacts of the outbreak. Lancet 2020, 395, 846–848. [Google Scholar] [CrossRef] [Green Version]
  31. Ngo, E.B. When disasters and age collide: Reviewing vulnerability of the elderly. Nat. Hazards Rev. 2001, 2, 80–89. [Google Scholar] [CrossRef]
  32. Jia, Z.; Tian, W.; Liu, W.; Cao, Y.; Yan, J.; Shun, Z. Are the elderly more vulnerable to psychological impact of natural disaster? A population-based survey of adult survivors of the 2008 Sichuan earthquake. BMC Public Health 2010, 10, 172. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Virtual display of exploratory sequential design.
Figure 1. Virtual display of exploratory sequential design.
Ijerph 17 08578 g001
Table 1. Themes, survey questions and survey estimates.
Table 1. Themes, survey questions and survey estimates.
ThemeIn-Person InterviewsSurvey Question aSurvey
Uncertainty“I am lucky that I don’t have family members or friends that have been or are affected. That would change everything, if my mother or my daughters were in the hospital it would be different: more uncertainty, sadness, panic.” (IN11_M_43)UncertaintyIn 77.5% of survey respondents, increased slightly (37.8%) or greatly (39.7%)
Symptoms on the depression spectrum“The emotion of sadness, of apathy, of saying you don’t even feel like showering or anything... why should I get dressed or comb my hair, they’re things we have to do to keep up a routine, but as the days go it gradually stops.” (IN26_M_25)
“This is hard and here at home there have been days when one of my children has been truly down, despairing, and the tears start to fall.” (IN19_M_33)
Feelings of depression, pessimism, or hopelessnessIn 43.2% of survey respondents, increased slightly (33.4%) or greatly (9.8%)
Symptoms of anxiety, or reactions of anxiety, and feelings of loneliness“Work gives me anxiety and being at home I can’t manage it and it’s with me all day. Once I get started it’s OK... when I finish working, I’m exhausted. My anxiety is worse, it was bad before, the anxiety, but now I feel very alone.” (IN02_F_35)
“…, but now at home, with the anxiety... I can’t stop myself from snacking on a handful of crisps or chocolate.” (IN02_F_35)
Panic and anxiety attacks
Feelings of loneliness
In 35.1% of survey respondents, panic increased slightly (27.1%) or greatly (8%)
In 34.6% of survey respondents, feelings of loneliness increased slightly (24.9%) or greatly (9.7%)
Overwhelm/psychological distress“I am starting to feel psychologically exhausted” (IN06_ M_41)
“These are very difficult times. I am losing a lot of people; 4 family members and people close to me. You try to go out, take it in and they phone you and someone else... It’s very difficult. You cry and ask for psychological help.” (IN05_F_44)
“Psychologically it’s going to affect us all, not being in contact with anyone, talking face to face, connecting, …” (IN21_M_24)
In 45.7% of survey respondents, increased slightly (36.2%) or greatly (9.5%)
Worry about suffering from a serious disease“...I haven’t left my house again, I had a thing in my lung and it scares me, I don’t go out, my husband comes, he comes with the shopping and we clean everything” (IN6_F_41).
“…, I’m also scared of something happening to me” (IN35_F_60)
Worry about suffering from or contracting an illness (COVID-19 or other)In 67.9% of survey respondents, worry about illness increased slightly (39.4%) or greatly (28.5%)
Irritation or anger“At the beginning you fight the system a little, you are kind of against everything, and then you start to realize that it’s a very serious matter, that it’s not about you anymore, it’s about everyone else, that you have to stop and keep calm. And you also are seeing the news and you go from rebellion to alarm, fear, not knowing, the uncertainty, the nervousness...” (IN28_F_47)Irritation or angerIn 47.4% of survey respondents, increased slightly (37.6%) or greatly (9.8%)
Fear of the death of loved ones“Now it’s my mother who is in hospital and I’m afraid of how it’s going to progress. I am worried, I lost my father a week ago and I’m afraid of losing her, it’s distressing.” (IN25_M_41)
“I was very afraid; my children lost their father in November and I don’t think they are ready to lose their mother.” (IN35_F_60)
Fear of losing loved ones75.5% of survey respondents increased slightly (40.4%) or greatly (35.1%)
Vitality-Energy“In the mornings I don’t have energy and it’s hard to start working. Then during the day, since I’m distracted, I don’t think about things and at night when everyone goes to sleep, I feel like I get a little worse again, I think more about the situation we’re in, I’ve been a roller coaster. These days I’ve been telling my friends and family members that I love them a lot.” (IN01_M_22)Feelings of vitality and energyIn 48.6% of survey respondents, these feelings decreased slightly (37.6%) or greatly (11%)
Disconnecting“We are quite the homebodies, unconsciously because we are working and living in the same space, in the end, the work problems are there all the time, you don’t disconnect. Nervousness or anxiety is more due to work, that I can’t disconnect, more than due to being at home. Before I could discharge more energy and now I can’t.” (IN02_F_35)
“When I was studying I could go out and disconnect, but now I can’t.” (IN26_M_35)
Ease of disconnecting from worriesIn 34.3% of survey respondents, capacity to disconnect decreased slightly (24.5%) or greatly (9.8%)
Perception of control, being positive, relaxation“When I found out I was working, and when I got home it hit me. I thought, ‘what do I do?’ The first days are hard due to your work, not continuing, worrying, and then you say, ‘I have to overcome this and try to be positive,’ for everyone around you, as well.” (IN28_F_47)Feelings of confidence and optimism
Feelings of peace, calm, relaxation
In 43.5% of survey respondents, feelings of optimism decreased slightly (35%) or greatly (8.5%). These feelings increased in 14.3% of survey respondents.
In 43.9% of survey respondents, feelings of relaxation decreased slightly (33.1%) or greatly (10.8%). These feelings increased in 12.3% of survey respondents.
Problems and/or changes in sleep“I have had to take sleeping pills” (IN14_F_55)Problems sleepingIn 52.8% of survey respondents, this problem increased slightly (32.7%) or greatly (20.1%)
Suicidal thoughts
Suicidal ideation
“A thousand things go through your mind, I think everything is over, nothing will be the same again; sometimes I think I don’t want to go on in this life, but then I think, no, I can’t talk that way, I have my daughters, my husband and my parents.” (IN05_F_44)Thoughts of self-harmIn 4.5% of survey respondents, this type of ideation increased slightly (3.5%) or greatly (1%)
Unreality“The first days it felt unreal, something is happening that has never happened and it just doesn’t seem normal” (IN18_F_30)Feelings of unreality, that things are not realIn 42.7% of survey respondents, these feelings increased slightly (31.0%) or greatly (11.7%)
Concentration“Because I’m not studying anything this month, I can’t concentrate, I’m sure my exam will be postponed until next year, I don’t know.” (IN6_F_41)
“it’s hard to concentrate at home” (IN40_M_21)
Difficulty concentratingIn 41.2% of survey respondents, difficulty focusing increased slightly (29.1%) or greatly (12.1%)
Not thinking“So it’s better to stop thinking about it and live day to day” (IN23_F_42)
“...I try not to watch the news, not to think about it, to be at peace with the children.” (IN6_F_41)
Tendency to not want to think and to not talk about problemsIn 31.9% of survey respondents, increased slightly (24%) or greatly (7.9%)
Guilt“You go out and it feels like you’re committing a crime, that’s what makes me the most angry, even going to get bread or tobacco you feel bad. The TV chips away at your morale.” (IN4_M_62)Feelings of guiltIn 13.8% of survey respondents, guilt feelings increased slightly (11.1%) or greatly (2.7%)
Prosocial behavior“Next week we’re going to start helping at an organization.” (IN18_F_30)
“The volunteer work I do is delivering food: we go to the location they have, there are shopping trolleys, we fill them with purchases, people come and get the food.” Also, sometimes I take shopping to my grandmother.” (IN40_M_21)
Willingness to help others (donations to NGOs, family members, etc.)In 36.2% of survey respondents, prosocial behavior increased slightly (25.9%) or greatly (10.3%)
Somatic symptoms“I’m getting a muscle spasm.” (IN38_F_29)
“It’s hard for me to breathe, I sigh, I’m close to tears, I’m terrified to start the day…” (IN2_F_35)
Physical symptoms without a clear relationship to a medical condition In 31.4% of survey respondents, somatic symptoms increased slightly (24.3%) or greatly (7.1%)
Mood swings“I have days where I’m desperate to go out and times when I’m just down.”
(IN25_M_41)
Mood swingsIn 44.7% of survey respondents, increased slightly (34.2%) or greatly (10.5%).
Coping with problems“Friends, family members, who are going to sort of solve the problems you might come to have.” (IN11_M_43)
“Above all I have needed information, I’ve had to pay a lot of attention.” (IN9_F_50)
Ability to make decisions and solve problemsIn 14.1% of survey respondents, capacity to solve problems decreased slightly or greatly. In 17.9% of survey respondents, it increased slightly or greatly.
a General Survey question: During lockdown, compared to your life before lockdown, how much do you think you have changed with regard to the following aspects?
Table 2. Percentages of psychological changes during lockdown by gender.
Table 2. Percentages of psychological changes during lockdown by gender.
Psychological VariablesGender12345
General psychological distressFemale1.73.642.739.712.1
Male2.33.354.832.66.8
Difficulty concentratingFemale3.17.842.530.416.1
Male1.87.854.727.87.8
Ease of disconnecting from worriesFemale12.625.038.817.06.4
Male6.924.047.917.04.2
UncertaintyFemale0.91.217.135.245.4
Male1.21.722.640.533.8
Panic attacksFemale3.22.449.633.211.3
Male3.43.267.920.64.6
Worry about suffering from or contracting a serious diseaseFemale1.91.228.138.230.2
Male1.52.828.040.726.7
Tendency to not want to think and to not talk about problemsFemale2.05.154.827.39.8
Male2.06.564.720.66.0
Feelings of depression, pessimism, or hopelessnessFemale2.83.643.237.811.9
Male2.94.056.328.97.6
Feelings of guiltFemale3.53.674.812.94.1
Male3.44.481.59.11.3
Thoughts of self-harmFemale9.82.279.23.41.3
Male8.83.081.83.70.7
Fear of losing loved onesFemale0.50.818.638.940.5
Male0.80.626.942.029.5
Feelings of lonelinessFemale4.25.651.627.011.3
Male3.25.160.922.78.0
Irritation or angerFemale2.13.741.640.312.1
Male2.15.150.734.87.3
Mood swingsFemale1.53.243.338.513.5
Male1.44.956.629.87.3
Feelings of unreality, that things are not realFemale2.21.247.132.615.4
Male2.22.458.029.37.9
Problems with sexual intercourseFemale5.26.365.710.97.9
Male3.77.067.613.27.0
Problems sleepingFemale1.74.234.833.525.8
Male1.55.047.331.914.2
Ability to make decisions and solve problemsFemale2.912.865.213.35.7
Male2.110.470.812.14.6
Feelings of confidence and optimismFemale10.537.138.111.32.8
Male6.432.846.211.62.9
Feelings of peace, calm, relaxationFemale14.136.133.212.34.2
Male7.530.145.711.55.2
Feelings of vitality and energyFemale14.240.032.810.62.4
Male7.835.245.28.82.9
Willingness to help othersFemale2.52.953.527.312.0
Male3.53.759.324.28.4
Physical symptoms without a clear relationship to a medical conditionFemale2.62.856.828.19.1
Male1.93.169.420.45.0
Note: 1 = Has decreased a lot; 2 = Has decreased a little; 3 = Has stayed the same; 4 = Has increased a little; 5 = Has increased a lot.
Table 3. Percentages of psychological changes during lockdown by age.
Table 3. Percentages of psychological changes during lockdown by age.
Psychological VariablesAge12345
General psychological distress18–341.13.641.341.612.3
35–602.23.348.137.48.9
>602.83.959.026.57.5
Difficulty concentrating18–342.86.037.234.219.7
35–602.69.147.230.610.4
>601.76.765.819.16.6
Ability to disconnect from concerns18–3413.427.936.416.45.8
35–609.224.742.517.85.7
>606.719.753.715.93.9
Uncertainty18–340.71.018.535.044.6
35–600.91.517.938.940.6
>601.72.026.338.531.4
Panic attacks18–341.83.652.430.511.4
35–603.52.359.227.57.2
>604.53.264.721.65.6
Worry about suffering from or contracting a serious disease18–342.63.332.439.622.1
35–601.41.828.337.630.3
>601.40.821.843.931.9
Tendency to not want to think and to not talk about problems18–341.56.553.926.810.7
35–601.75.361.024.57.0
>603.56.163.519.36.8
Feelings of depression, pessimism, or hopelessness18–341.63.544.636.713.1
35–602.93.849.533.99.4
>604.24.056.528.26.8
Feelings of guilt18–342.14.175.113.54.7
35–603.43.677.812.12.4
>605.15.082.85.41.0
Thoughts of self-harm18–347.41.682.53.22.0
35–6010.12.879.23.90.8
>609.73.481.03.20.4
Fear of losing loved ones18–340.40.924.941.232.2
35–600.60.722.239.237.1
>601.10.521.342.634.1
Feelings of loneliness18–342.75.749.129.912.5
35–604.85.458.122.59.0
>602.05.060.124.77.9
Irritation or anger18–341.34.035.944.414.3
35–602.44.346.238.78.3
>602.54.858.326.27.7
Mood swings18–341.02.740.139.816.3
35–601.24.549.036.09.3
>602.54.564.022.86.0
Feelings of unreality, that things are not real18–341.71.752.129.713.2
35–602.41.451.233.510.7
>602.12.956.026.212.4
Problems with sexual intercourse18–345.16.560.414.910.1
35–604.66.966.412.67.6
>603.36.375.06.93.9
Problems sleeping18–341.64.832.631.129.9
35–601.64.540.734.119.0
>601.84.452.031.310.5
Ability to make decisions and solve problems18–343.416.659.313.47.2
35–602.310.468.613.94.7
>602.38.377.08.73.9
Feelings of confidence and optimism18–349.034.340.713.22.7
35–608.336.341.211.42.7
>608.332.745.99.53.4
Feelings of peace, calm, relaxation18–3413.035.233.413.44.9
35–6011.433.739.111.14.6
>606.729.347.512.04.6
Feelings of vitality and energy18–3415.438.431.312.32.4
35–6010.440.537.78.92.5
>607.229.751.48.43.2
Willingness to help others18–342.93.153.628.510.7
35–603.43.758.823.49.2
>602.02.553.828.312.4
Physical symptoms without a clear relationship to a medical condition18–342.02.358.728.48.4
35–602.23.561.825.07.0
>602.72.571.317.45.7
Note: 1 = Has decreased a lot; 2 = Has decreased a little; 3 = Has stayed the same; 4 = Has increased a little; 5 = Has increased a lot.
Table 4. Percentages of psychological changes during lockdown by socioeconomic level (SEL).
Table 4. Percentages of psychological changes during lockdown by socioeconomic level (SEL).
Psychological VariablesSEL12345
General psychological distressHigh1.83.849.535.69.3
Medium2.23.348.136.79.4
Low1.93.447.936.410.0
Difficulty concentratingHigh2.66.746.432.312.0
Medium2.38.250.627.011.9
Low2.59.048.427.512.6
Ability to disconnect from concernsHigh11.325.040.718.54.4
Medium9.325.442.916.95.5
Low8.121.848.514.66.6
UncertaintyHigh1.11.218.937.041.7
Medium0.61.619.640.038.1
Low1.61.722.035.039.1
Panic attacksHigh3.22.961.523.98.3
Medium3.22.657.129.97.0
Low3.43.156.027.69.3
Worry about suffering from or contracting a serious disease High1.52.529.139.427.4
Medium1.81.526.839.629.9
Low2.12.028.239.327.7
Tendency to not want to think and to not talk about problems High2.36.358.624.57.8
Medium1.65.660.823.87.4
Low2.35.359.523.49.2
Feelings of depression, pessimism, or hopelessnessHigh2.62.952.732.19.4
Medium3.34.147.735.88.8
Low2.64.847.831.612.4
Feelings of guiltHigh2.85.276.812.22.8
Medium3.93.579.39.92.6
Low3.82.778.511.32.8
Thoughts of self-harmHigh8.82.883.12.40.9
Medium9.22.379.94.40.9
Low10.42.876.64.11.6
Fear of losing loved onesHigh0.30.323.542.433.3
Medium0.90.821.140.236.6
Low0.71.224.237.236.0
Feelings of lonelinessHigh3.96.657.523.68.4
Medium3.84.756.326.18.7
Low3.14.353.425.013.9
Irritation or angerHigh2.23.842.940.310.6
Medium1.95.048.036.78.4
Low2.44.148.234.310.8
Mood swingsHigh1.52.749.135.910.8
Medium1.25.049.734.29.9
Low1.64.751.331.310.9
Feelings of unreality, that things are not realHigh2.01.550.832.012.6
Medium2.31.953.530.411.1
Low2.42.153.530.111.1
Problems with sexual intercourseHigh4.77.264.713.77.3
Medium3.77.168.111.47.6
Low5.45.067.69.87.5
Problems sleepingHigh1.64.539.933.920.1
Medium1.75.040.733.219.4
Low1.54.043.329.721.5
Ability to make decisions and solve problemsHigh2.612.366.312.36.4
Medium2.111.269.612.54.5
Low3.211.167.813.64.1
Feelings of confidence and optimismHigh8.935.440.412.72.4
Medium7.136.543.910.02.6
Low10.331.741.711.94.2
Feelings of peace, calm, relaxationHigh10.633.039.211.95.3
Medium11.233.739.311.93.8
Low10.632.539.612.05.2
Feelings of vitality and energyHigh12.235.538.711.12.4
Medium10.339.539.67.63.0
Low10.538.237.910.82.3
Willingness to help othersHigh2.33.153.928.411.6
Medium2.63.357.525.59.7
Low4.73.658.721.58.9
Physical symptoms without a clear relationship to a medical conditionHigh1.74.064.023.46.7
Medium2.82.262.525.07.0
Low2.32.662.124.68.0
Note: 1 = Has decreased a lot; 2 = Has decreased a little; 3 = Has stayed the same; 4 = Has increased a little; 5 = Has increased a lot.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hidalgo, M.D.; Balluerka, N.; Gorostiaga, A.; Espada, J.P.; Santed, M.Á.; Padilla, J.L.; Gómez-Benito, J. The Psychological Consequences of COVID-19 and Lockdown in the Spanish Population: An Exploratory Sequential Design. Int. J. Environ. Res. Public Health 2020, 17, 8578. https://doi.org/10.3390/ijerph17228578

AMA Style

Hidalgo MD, Balluerka N, Gorostiaga A, Espada JP, Santed MÁ, Padilla JL, Gómez-Benito J. The Psychological Consequences of COVID-19 and Lockdown in the Spanish Population: An Exploratory Sequential Design. International Journal of Environmental Research and Public Health. 2020; 17(22):8578. https://doi.org/10.3390/ijerph17228578

Chicago/Turabian Style

Hidalgo, María Dolores, Nekane Balluerka, Arantxa Gorostiaga, José Pedro Espada, Miguel Ángel Santed, José Luis Padilla, and Juana Gómez-Benito. 2020. "The Psychological Consequences of COVID-19 and Lockdown in the Spanish Population: An Exploratory Sequential Design" International Journal of Environmental Research and Public Health 17, no. 22: 8578. https://doi.org/10.3390/ijerph17228578

APA Style

Hidalgo, M. D., Balluerka, N., Gorostiaga, A., Espada, J. P., Santed, M. Á., Padilla, J. L., & Gómez-Benito, J. (2020). The Psychological Consequences of COVID-19 and Lockdown in the Spanish Population: An Exploratory Sequential Design. International Journal of Environmental Research and Public Health, 17(22), 8578. https://doi.org/10.3390/ijerph17228578

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop