Next Article in Journal
Pre-Operative Oral Health-Related Quality of Life in Patients Attending Surgical Removal of Mandibular Third Molar Teeth
Next Article in Special Issue
Burnout Prevalence and Its Associated Factors among Malaysian Healthcare Workers during COVID-19 Pandemic: An Embedded Mixed-Method Study
Previous Article in Journal
Age-Friendly Health Care: A Systematic Review
Previous Article in Special Issue
COVID-19 in China: Responses, Challenges and Implications for the Health System
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Nurses’ Workplace Conditions Impacting Their Mental Health during COVID-19: A Cross-Sectional Survey Study

School of Nursing, The University of British Columbia, Vancouver, BC V6T 1Z4, Canada
*
Author to whom correspondence should be addressed.
Healthcare 2021, 9(1), 84; https://doi.org/10.3390/healthcare9010084
Submission received: 7 December 2020 / Revised: 13 January 2021 / Accepted: 13 January 2021 / Published: 16 January 2021
(This article belongs to the Special Issue COVID-19 Pandemic: Challenges Facing the Health System)

Abstract

:
Among health workers, nurses are at the greatest risk of COVID-19 exposure and mortality due to their workplace conditions, including shortages of personal protective equipment (PPE), insufficient staffing, and inadequate safety precautions. The purpose of this study was to examine the impact of COVID-19 workplace conditions on nurses’ mental health outcomes. A cross-sectional correlational design was used. An electronic survey was emailed to nurses in one Canadian province between June and July of 2020. A total of 3676 responses were included in this study. We found concerning prevalence rates for post-traumatic stress disorder (47%), anxiety (38%), depression (41%), and high emotional exhaustion (60%). Negative ratings of workplace relations, organizational support, organizational preparedness, workplace safety, and access to supplies and resources were associated with higher scores on all of the adverse mental health outcomes included in this study. Better workplace policies and practices are urgently required to prevent and mitigate nurses’ suboptimal work conditions, given their concerning mental health self-reports during the COVID-19 pandemic.

1. Introduction

Among health workers, nurses are at highest risk of COVID-19 exposure and mortality due to work environment conditions, including personal protective equipment (PPE) shortages, insufficient staffing, and inadequate safety training and preparation [1,2]. Early research suggests that nurses are a high-risk population for adverse mental health outcomes during the COVID-19 pandemic [3,4]. To our knowledge, this is the first Canadian study to examine the impact of COVID-19 workplace conditions on nurses’ mental health outcomes. The purpose of this study was to explore the association between nurses’ workplace conditions during COVID-19 and their mental health in a sample from one Canadian province. Evidence from this study will inform mental health promotion policies and interventions during a time when nurses are a rapidly dwindling health human resource [5,6].

1.1. Literature Review

Mental health is “a state of well-being in which an individual realizes his or her own abilities, can cope with the normal stresses of life, can work productively and is able to make a contribution to his or her community” [7]. In nursing research, mental health is often measured by the absence of mental health disorders, including post-traumatic stress disorder (PTSD), anxiety, depression, and burnout. PTSD can develop after a traumatic event and is characterized by hypervigilance and impaired concentration, including workplace avoidance behaviors and the presence of nightmares and flashbacks of the traumatic event [8]. Depression is associated with persistent feelings of sadness, hopelessness, and loss of interest [9]. Anxiety is described as persistent excessive and unnecessary worry about events or activities [10]. Burnout is characterized by high levels of emotional exhaustion (EE), depersonalization (DP), and reduced personal accomplishment (PA) [11]. In nursing research, EE is often used as the most important indicator of burnout [12,13].
The mental health status of the nursing workforce has been a chronic concern predating COVID-19. As early as 2005, a national survey of the work and health of Canadian nurses found one in six nurses reported that mental health problems interfered with their ability to work, and 10% of the sample met the criteria for depression [14]. Other studies found high prevalence rates of PTSD and burnout among Slovenian nurses [15]. A recent pre-COVID study in British Columbia, Canada, found that one-third of the sample of 5500 nurses met the criteria for anxiety and depression, and half the sample met the criteria for high EE and PTSD [16]. Given emerging global pandemic evidence of nurses’ worsening mental health and work environment concerns [2,3,4,17], we conducted a survey of nurses in one Canadian province to explore the association between their mental health and workplace conditions during the COVID-19 pandemic.

1.2. Theoretical Framework

Previous research demonstrates that workplace conditions are one of the most important predictors of nurse outcomes, including their mental health and wellbeing [18,19,20,21]. In particular, a 2018 meta-analysis of 17 studies using data from 2677 hospitals in 22 countries found that poor nursing work environments were associated with poor patient and nurse outcomes, including burnout [21]. Other researchers linked unhealthy nursing work environments to poor mental health, specifically anxiety, insomnia, and psychotropic medication use [12,22].
This study was informed by an adapted version of the nursing worklife model [20]. This model has been widely used to study relationships between five key domains in nurses’ work environments (i.e., staffing and resources, collegial workplace relations, leadership support, policy impact, and a nursing foundation of care) and patient and nurse outcomes [20,23,24]. For this study, we used three of the original domains (i.e., staffing and resource adequacy, workplace relations, and leadership/organizational support), and we adapted two domains for the COVID-19 context. Our adapted domains measured ensuring workplace safety and organizational preparedness. These adaptations reflect COVID-19 work environment safety issues and pandemic management planning [25,26].

2. Materials and Methods

2.1. Data Collection and Sample

All members (~48,000) of the provincial nurses’ union were invited to complete an electronic survey. An email invitation with the survey link was distributed by the union to its nurse members, and participation was encouraged through social media advertisement, email reminders, and a raffle draw for ten $100 prepaid Visa cards. Participants were fully informed of the confidentiality of their responses and the voluntary nature of survey participation. They were also informed that survey completion and submission would indicate informed consent. The data collection interval was from June 2020 to July 2020. A total of 4523 survey responses was received yielding a response rate of about 10%. For this study, we included only actively working nurses (n = 3676). Ethics approval was granted by the University Behavioral Research Ethics Board (H20-01861).

2.2. Measures

2.2.1. Outcome Variables

Post-traumatic stress disorder was measured using a validated scale, the Posttraumatic Stress Symptoms-14 (PTSS-14) instrument [8]. The PTSS-14 is comprised of 14 items that reflect symptoms as described by the Diagnostic and Statistical Manual of Mental Disorders IV (DSM-IV) criteria for PTSD, such as feelings of guilt or nightmares about duty in the primary workplace. Respondents’ feelings over the last two weeks were rated on a 7-point Likert-type scale ranging from 1 (never) to 7 (always). Sum scores were tallied from each participant’s responses, with prior research establishing a cutoff score of 45 as an indicator of PTSD. An exploratory factor analysis (EFA) with varimax rotation demonstrated a unidimensional factor structure (forced) explaining 55% of the variance among the study sample (factor loadings: 0.60–0.80, α = 0.94).
Anxiety was assessed using the validated Generalized Anxiety Disorder-7 (GAD-7) instrument, which includes seven items describing symptoms of generalized anxiety disorder as outlined by the DSM-IV diagnostic criteria [10]. Respondents were asked to rate the frequency of the feelings described over the last two weeks along a 4-point Likert-type scale ranging from 0 (not at all) to 3 (nearly every day). Examples of items include trouble relaxing, not being able to stop or control worrying, and becoming easily annoyed or irritable. Spitzer and colleagues found a cutoff sum score of 10 or greater to identify anxiety with the greatest sensitivity (89%) and specificity (82%) [10]. In this study, the measure demonstrated a unidimensional factor structure explaining 71% of the variance using EFA with varimax rotation (factor loadings: 0.76–0.90, α = 0.93).
Depression was measured using the Patient Health Questionnaire-9 (PHQ-9) [9]. The PHQ-9 consists of nine items reflecting feelings, meeting the DSM-IV diagnostic criteria for depression, such as depressive mood, poor appetite, and insomnia. Respondents rated how often they experienced these symptoms over the past two weeks, along a 4-point Likert-type scale ranging from 0 (not at all) to 3 (nearly every day). Kroenke et al. found a cutoff sum score of 10 or greater to capture major depression with the greatest sensitivity (88%) and specificity (88%) [9]. An EFA with varimax rotation showed a unidimensional factor structure explaining 56% of the variance among the study sample (factor loadings: 0.53–0.83, α = 0.90).
Finally, EE was measured using items from the EE subscale of the Maslach Burnout Inventory–Human Services Survey (MBI-HSS). Items from the subscale include statements such as “I feel emotionally drained from my work” and “I feel like I’m at the end of my rope”, with respondents rating the frequency of the described feeling along a 7-point Likert-type scale ranging from 0 (never) to 6 (every day) [27]. The sum scores for the EE subscale were categorized by cutoff scores into the following categories: 0–16 = low, 17–26 = moderate, ≥27 = high EE [27]. An EFA with varimax rotation showed a unidimensional factor structure explaining 63% of the variance among the study sample (factor loadings: 0.66–0.88, α = 0.93).

2.2.2. Key Predictors

Nurses’ workplace conditions during COVID-19 were captured using a series of 23 questions spanning the five domains of workplace safety (8 items, e.g., concern about exposure to COVID-19 at work), access to resources and supplies (5 items, e.g., adequate access to PPE), organizational preparedness (4 items, e.g., confidence in organizational handling of the pandemic), organizational support (3 items, e.g., support from the organization), and workplace relations (3 items, e.g., change in relations with nursing colleagues) during the pandemic. The complete list of items per domain and their response scales can be found in Figure 1, along with their response options and coding. Questions for the two adapted domains, workplace safety and organizational preparedness, were from a recent survey conducted by the Institute of Work and Health [28]. Questions for other domains were adapted from the Nursing Work Index [20,21]. All questions were content validated with the provincial nurses’ union subject matter experts. Given the exploratory nature of this study, individual items from each domain were used as a predictor in our regression models and their Likert-type scales were treated as numerical predictors.

2.2.3. Control Variables

Demographics were measured using a series of researcher-developed questions based on our previous research with nurses. We included questions on nurses (e.g., nursing experience, designation, role) and workplace characteristics (e.g., workplace geography, sector). Nurse designation included college-educated licensed practical nurse (LPN), baccalaureate-educated registered psychiatric nurse (RPN), and baccalaureate-educated registered nurse (RN). Response data were recoded from existing categories as binaries for all control variables except experience: workplace geography (0 = rural, 1 = urban/suburban), nursing designation (0 = LPN, 1 = RN/RPN/Dual), nursing role (0 = leader/educator, 1 = direct care provider), and sector (0 = community/long-term care, 1 = acute care).

2.3. Analysis

Key methods of data analysis included descriptive statistics and multiple linear regression using the Statistical Package for Social Sciences 27 (SPSS Inc., Chicago, IL, USA). To save power and create parsimonious models for all outcome variables, we started our regression analyses with four exploratory models including all workplace condition predictors. Predictors that were non-significant across all models were removed. Our final regression models included five control variables followed by 14 predictors in blocks of workplace safety (5 predictors), resources and supplies (2 predictors), organizational preparedness (3 predictors), organizational support (1 predictor), and workplace relations (3 predictors). Missing data were handled through listwise deletion in all models. Regression assumptions of linearity, independence, normality, equality of variance, and multicollinearity were examined through various model diagnostics and found to be satisfactory.

3. Results

A summary of response data for the demographic variables is shown in Table 1. The sample of actively working nurses in this study (n = 3676) consisted primarily of RNs/RPNs (80%) and LPNs (19%). The majority of the sample reported their nursing role as direct care provider (86%) and their geographic area as urban or suburban (84%). More than half indicated their nursing sector as acute care (63%). The mean for nursing experience was approximately 12 years (SD = 7.2), with 24% reporting 5 years of experience or less, while 28% reporting 21 years or more.
Table 2 shows descriptive statistics such as means and standard deviations for the COVID-19 workplace condition items. Overall, there were concerns related to most aspects of nurses’ workplace conditions during COVID-19. With respect to workplace safety, most importantly, 86% of the sample identified being somewhat to extremely concerned about brining COVID-19 home ( x ¯   = 3.90, SD = 1.14) and 80% about their own workplace exposure to COVID-19 ( x ¯ = 3.47, SD = 1.12). With respect to resources and supplies, 52% reported inadequate nurse staffing ( x ¯ = 3.48, SD = 1.60); 49% indicated some level of disagreement about access to high-quality PPE ( x ¯ = 3.59, SD = 1.50) and 42% about access to sufficient PPE in their workplace ( x ¯ = 3.30, SD = 1.54). With respect to organizational preparedness, 41% rated the transparency of organizational decisions related to COVID-19 as poor or failing ( x ¯ = 3.29, SD = 1.02); and 27% reported daily or multiple times a day changes to COVID-19 related protocols and policies ( x ¯ = 5.47, SD = 3.29). With respect to organizational support, 24% were told to work despite possible or confirmed exposure to the virus ( x ¯ = 0.24, SD = 0.43); and 18% felt they did not receive any organizational support ( x ¯ = 2.64, SD = 1.03) during COVID-19. Finally, with respect to workplace relations, 23%, 24%, and 31% reported worsening relations, respectively, with the rest of the allied health team ( x ¯ = 3.11, SD = 0.70), nursing colleagues ( x ¯ = 3.05, SD = 0.79), and management ( x ¯ = 3.25, SD = 0.80).
Table 3 shows response proportions and descriptive statistics for the measures used as mental health outcome indicators. Almost one-half of the sample (47%) met the diagnostic cutoff of 45 indicative of potential PTSD. Approximately two-fifths of the nurses (38%) met the criteria for anxiety and roughly the same proportion (41%) for major depression. Nearly two-thirds of nurses (60%) met the criteria for high EE.

Regression Analysis Results

As regression analyses were conducted for each of the four outcomes, four final models were created, and the results are tabulated in Table 4. A number of predictors were removed during our modelling process due to their low predictive ability across all outcomes. Confidence in ability to assess PPE requirements, confidence in ability to assess risk, and experience of submitting workers’ compensation were removed from the workplace safety block. The variables for PPE quality, COVID-19 related training, and N95 mask fitting were removed from the resources and supplies block. Ratings of confidence in manager’s pandemic handling was removed from the organizational preparedness block, while the binary variables for experiencing “told to work despite exposure” and “told to work despite symptoms” were removed from the organizational support block.
All four final models regressing control variables and workplace condition predictors on the sum scores of four mental health measures were significant. Regression results are shown in Table 4. Adjusted R2 values indicate that the proportions of explained variance ranged from 19.0% (depression model) to 25.7% (PTSD and EE models). For all models, across all statistically significant predictors, more unfavorable perceptions of workplace conditions during COVID-19 were associated with greater scores on unfavorable mental health outcomes.
All variables within the workplace safety, resources and supplies, organizational support, and workplace relations blocks were statistically significant predictors of PTSD, while only the “frequency of COVID-19-related policy changes” from the organizational preparedness block was significantly related to PTSD scores. Affirmative responses on the dichotomous variable of “experiencing COVID-19 symptoms” predicted a 4.12 point increase (95% CI = 2.87–5.37, p < 0.001) in PTSD scores; other variables held constant. To illustrate the relation between Likert-type predictors and the outcome measure, a 1 point increase (indicating worsening) on the 6-point scale for “relationships with the rest of allied” was associated with a 2.44 point increase in PTSD scores (95% CI = 1.49–3.39, p < 0.001) after accounting for the other model variables.
With the exception of “frequency of direct contact” from the workplace safety block, “PPE access adequacy” from the resources and supplies block, “confidence in organizational handling of the pandemic” and “transparency of organizational decisions” from the organizational preparedness block, all other indicators of COVID-19 workplace conditions were significantly related to anxiety scores.
With the exception of “frequency of direct contact” and “concern about contracting COVID-19” from the workplace safety block, “confidence in organizational handling” and “transparency of pandemic related organizational decisions” from the organizational preparedness block, and “relationships with manager” from the workplace relations block, all other indicators of workplace conditions during COVID-19 were related to nurse depression scores.
Finally, while all indicators of organizational preparedness, organizational support, and workplace relations were positively related to EE scores, only “frequency of direct contact” and “experiencing COVID-19 symptoms” from the workplace safety block and “nurse staffing adequacy” from the resources and supplies block were significantly related to EE scores.

4. Discussion

The quality of nurses’ work environments during COVID-19 was operationalized using a series of questions on a variety of scales representing five domains shown in Figure 1. Regardless of the scale, nurses’ evaluations of different aspects of their workplace were classified into positive or negative perceptions or ratings. We found that nurses with negative ratings of most workplace safety indicators were more likely to suffer from PTSD, anxiety, and depression but not EE. Negative ratings of organizational support and workplace relations were associated with all of the adverse mental health outcomes included in this study. Nurses with negative ratings of organizational preparedness were more likely to report EE; and those experiencing staffing inadequacies were more likely to report all four of the adverse mental health outcomes. Finally, nurses working in environments with insufficient access to PPE were more likely to report PTSD and depression.
For this study, negative ratings on workplace safety indicators, such as fear of spreading COVID-19 from work to loved ones at home, were evidence of unsafe work environments. We found significant associations between nurses’ perceptions of unsafe workplaces and their self-reports of PTSD, anxiety, and depression. These findings are similar to pre-COVID-19 evidence where unsafe workplaces with frequent workplace violence negatively impacted nurses’ mental health and wellbeing [12,29,30,31]. A scoping review of 10 COVID-19 studies similarly found unsafe workplaces, characterized as inadequate infection control practices and policies, were associated with the development of mental health problems among nurses [4]. Other researchers specifically identified working in high-risk COVID-19 wards, fear of COVID-19 exposure, more frequent workplace exposure to the virus, and negative ratings of working safety while caring for COVID-19 patients as predictors of nurse anxiety and depression [32,33].
Surprisingly, workplace safety was unrelated to EE for the most part. This finding may be attributed to EE being the most important consequence of heavy workloads: EE may not be significantly influenced by workplace safety factors [34,35]. Pre-COVID 19 studies have linked heavy workload indicators to EE [36,37,38]. In this study, we also found that indicators of heavy workload—namely, staffing inadequacies, poor workplace relations (e.g., teamwork), and organizational support—were associated with higher levels of nurse EE.
In addition to workplace safety, access to sufficient resources and supplies in the workplace was negatively related to adverse mental health outcomes for the most part. This finding is consistent with pre-COVID 19 evidence linking inadequate nurse staffing to poor nurse and patient outcomes [13,18,36,37,38,39]. Most nursing research during COVID-19 has focused on the relationship between PPE adequacy and nurses’ mental health. These studies found that inadequate access to PPEs had negative implications for the mental health of healthcare workers, including nurses [40,41,42]. It is possible that staffing and PPE adequacy are equally important predictors of nurses’ mental health because of their influence on workplace safety. Although we found a non-significant relationship between adequate PPE and anxiety, it is possible this suggests that PPE adequacy does not contribute to nurse anxiety over and above the effect of other workplace predictors, such as staffing and workplace safety indicators. This is not to say insufficient access to PPE is not an anxiety provoking experience, but rather other constraints in nurses’ work environments such as limited workplace safety and inadequate staffing are more anxiety provoking for nurses.
In addition to resources and supplies, negative ratings of organizational support and workplace relations were associated with nurses’ experiences of PTSD, anxiety, and depression. Consistent with emerging COVID-19 evidence [32,33,43,44], this finding is attributed to the buffering effect of support—from the organization or the healthcare team—on work-related stress [45,46,47]. Nurses often rely on their team members and the support they receive from their organization to cope with workplace stressors [47]. Future research should more closely explore the mechanism by which various sources of support impact nurses’ mental health and wellbeing during a crisis.
Among organizational preparedness indicators, only frequent changes in COVID-19 policies and protocols were related to high PTSD, anxiety, and depression scores. It is possible that frequent changes in policies and protocols required nurses to quickly respond to and constantly adapt to the shifting landscape of COVID-19, a stress-provoking experience, especially in the context of a highly contagious infectious disease. Pre-COVID-19 evidence has linked feelings of stress with rapid and continuous changes in the workplace. This source of stress, known as “change fatigue”, is associated with adverse nurse outcomes, including EE [48,49,50,51].
Of note is that some COVID-19 workplace indicators were not important to nurse mental health in this study. Key examples include access to COVID-19 training, high-quality PPE, and N95 mask fitting. These non-significant findings could be attributed to the uncertain and limited understanding of COVID-19 pathophysiology and mode of transmission [52]. For example, after many months of controversy, the Public Health Agency of Canada only recently updated its COVID-19 guidelines on risk of airborne transmission of the virus requiring high-quality PPE, such as fitted N95 masks [53]. Future research should further explore with nurses why these indicators did not matter to them. These findings are worrisome given emerging pandemic evidence that suggests targeted COVID-19 training improves nurses’ mental health [33,54].
Even though the COVID-19 pandemic cannot be eliminated until a reliable vaccine is in place, nurses’ workplace conditions associated with adverse mental health outcomes can be purposefully and systematically addressed. Suboptimal work conditions pre-COVID-19 have been documented in the literature [13,19,55]. Nurse staffing inadequacies have been a particular concern with respect to impact on nurses, patients, and organizational outcomes [13,18,36,37,38,39,56]. Our study highlights how persistent staffing inadequacies may compound risk of adverse mental health outcomes for nurses. During the pandemic, as workplace stressors increase, we urge researchers, policy makers, and health employers to evaluate and optimize the conditions of nurses’ work environments as a strategy to prevent and mitigate adverse nurse mental health outcomes.

Limitations

This is the first province-wide study in Canada to explore the impact of nurses’ workplace conditions during COVID-19 on the mental health of nearly 3700 nurses. Despite this strength, the low response rate raises concerns around sampling bias and generalizability. A comparison of our sample with the provincial nursing workforce based on Canadian Institute of Health Information showed our sample was closely representative of the provincial nursing population with respect to age, gender, professional designation, and employment status [57]. However, the generalizability of the findings to other samples and contexts may be limited. We also caution readers from establishing any cause-and-effect conclusions due to the cross-sectional nature of the study. Specifically, the stressor (the COVID-19 pandemic) occurred before an initial assessment of workplace conditions, meaning it cannot be concluded with certainty that the pandemic was the cause of the poor workplace conditions. It must also be considered that increased levels of nurse PTSD, anxiety, depression, and EE might worsen ratings of pre-existing issues with workplace conditions.

5. Conclusions

The findings of this study were consistent with a plethora of research evidence over the last two decades that repeatedly showed nurses’ workplace conditions are important to their experiences and their ability to deliver effective patient care. This study examined important aspects of nurses’ work environments unique to the context of COVID-19 and their impact on nurse PTSD, anxiety, depression, and EE. Some workplace conditions were more important than others. Workplace safety, access to resources and supplies, organizational support, and workplace relations most significantly influenced nurse mental health. The bottom line is nurses’ mental health can be improved through modifying the conditions of their work environments. Better practices and policies specifically addressing the above-listed workplace conditions are urgently needed to protect the health and safety of the nursing workforce, particularly during the time of COVID-19 crisis.

Author Contributions

Conceptualization, F.H.; methodology, F.H. and M.M.; software, A.M. and F.H.; validation, F.H.; formal analysis, A.M. and F.H.; investigation, F.H., A.M., S.S. and M.M.; writing—original draft preparation, F.H., S.S. and A.M.; writing—review and editing, M.M., F.H., A.M. and S.S.; supervision, F.H.; project administration, F.H.; funding acquisition, F.H. and M.M. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by BC Nurses’ Union.

Institutional Review Board Statement

Ethics approval was obtained from the University Behavioural Research Ethics Board (approval number: H20-01861).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Patient consent was waived as it was not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical and privacy restrictions.

Acknowledgments

We would like to thank the nurses who participated in this survey study and also BC Nurses Union for their financial support of the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Jackson, D.; Anders, R.; Padula, W.V.; Daly, J.; Davidson, P.M. Vulnerability of nurse and physicians with COVID-19: Monitoring and surveillance needed. J. Clin. Nurs. 2020. [Google Scholar] [CrossRef]
  2. Gómez-Ochoa, S.A.; Franco, O.H.; Rojas, L.Z.; Romero Guevara, S.L.; Echeverría, L.E.; Glisic, M.; Muka, T. COVID-19 in Healthcare Workers: A Systematic Review and Meta-Analysis of Prevalence, Risk Factors, Clinical Characteristics, and Outcomes. Am. J. Epidemiol. 2020. [Google Scholar] [CrossRef]
  3. Pappa, S.; Ntella, V.; Giannakas, T.; Giannakoulis, V.G.; Papoutsi, E.; Katsaounou, P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain Behav. Immun. 2020, 88, 901–907. [Google Scholar] [CrossRef] [PubMed]
  4. Shaukat, N.; Ali, D.M.; Razzak, J. Physical and mental health impacts of COVID-19 on healthcare workers: A scoping review. Int. J. Emerg. Med. 2020, 13, 40. [Google Scholar] [CrossRef] [PubMed]
  5. Murphy, G.T.; Birch, S.; MacKenzie, A.; Alder, R.; Lethbridge, L.; Little, L. Eliminating the Shortage of Registered Nurses in Canada: An Exercise in Applied Needs-based Planning. Health Policy 2012, 105, 192–202. [Google Scholar] [CrossRef]
  6. World Health Organization Nursing and Midwifery: Key Facts. Available online: https://www.who.int/news-room/fact-sheets/detail/nursing-and-midwifery. (accessed on 1 November 2020).
  7. World Health Organization Mental Health: Strengthening Our Response. Available online: https://www.who.int/news-room/fact-sheets/detail/mental-health-strengthening-our-response (accessed on 30 May 2020).
  8. Twigg, E.; Humphris, G.; Jones, C.; Bramwell, R.; Griffiths, R.D. Use of a Screening Questionnaire for Post-traumatic Stress Disorder (PTSD) on a Sample of UK ICU Patients. Acta Anaesthesiol. Scand. 2008, 52, 202–208. [Google Scholar] [CrossRef]
  9. Kroenke, K.; Spitzer, R.L.; Williams, J.B.W. The PHQ-9: Validity of a Brief Depression Severity Measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef]
  10. Spitzer, R.L.; Kroenke, K.; Williams, J.B.W.; Löwe, B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [Green Version]
  11. Leiter, M.P.; Maslach, C. Latent Burnout Profiles: A New Approach to Understanding the Burnout Experience. Burn. Res. 2016, 3, 89–100. [Google Scholar] [CrossRef] [Green Version]
  12. Havaei, F.; Astivia, O.L.O.; MacPhee, M. The impact of workplace violence on medical-surgical nurses’ health outcome: A moderated mediation model of work environment conditions and burnout using secondary data. Int. J. Nurs. Stud. 2020, 109, 103666. [Google Scholar] [CrossRef]
  13. MacPhee, M.; Dahinten, V.; Havaei, F. The Impact of Heavy Perceived Nurse Workloads on Patient and Nurse Outcomes. Admin. Sci. 2017, 7, 7. [Google Scholar] [CrossRef] [Green Version]
  14. Shields, M.; Wilkins, K. Findings from the 2005 National Survey of the Work and Health of Nurses: Statistics Canada; Statistics Canada: Ottawa, ON, Canada, 2006; ISBN 0-662-44485-X.
  15. Kvas, A.; Seljak, J. Unreported workplace violence in nursing. Int. Nurs. Rev. 2014, 61, 344–351. [Google Scholar] [CrossRef] [PubMed]
  16. Havaei, F.; MacPhee, M.; McLeod, C.B.; Ma, A.; Gear, A.; Sorensen, C. A Provincial Study of Nurses’ Psychological Health and Safety in British Columbia, Canada: Final Report. UBC cIRcle 2020. [Google Scholar] [CrossRef]
  17. Shi, L.; Lu, Z.-A.; Que, J.-Y.; Huang, X.-L.; Liu, L.; Ran, M.-S.; Gong, Y.-M.; Yuan, K.; Yan, W.; Sun, Y.-K.; et al. Prevalence of and Risk Factors Associated with Mental Health Symptoms Among the General Population in China During the Coronavirus Disease 2019 Pandemic. JAMA Netw. Open 2020, 3, e2014053. [Google Scholar] [CrossRef] [PubMed]
  18. Aiken, L.H.; Clarke, S.P.; Sloane, D.M.; Sochalski, J.A.; Busse, R.; Clarke, H.; Giovannetti, P.; Hunt, J.; Rafferty, A.M.; Shamian, J. Nurses’ reports on hospital care in five countries. Health Aff. 2001, 20, 43–53. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Havaei, F.; Dahinten, V.S.; MacPhee, M. Effect of Nursing Care Delivery Models on Registered Nurse Outcomes. SAGE Open Nurs. 2019, 5. [Google Scholar] [CrossRef] [Green Version]
  20. Leiter, M.P.; Laschinger, H.K.S. Relationships of work and practice environment to professional burnout: Testing a causal model. Nurs. Res. 2006, 55, 137–146. [Google Scholar] [CrossRef]
  21. Lake, E.T.; Sanders, J.; Duan, R.; Riman, K.A.; Schoenauer, K.M.; Chen, Y. A Meta-Analysis of the Associations Between the Nurse Work Environment in Hospitals and 4 Sets of Outcomes. Med. Care 2019, 57, 353–361. [Google Scholar] [CrossRef]
  22. Havaei, F.; MacPhee, M. Effect of Workplace Violence and Psychological Stress Responses on Medical-Surgical Nurses’ Medication Intake. Can. J. Nurs. Res. 2020. [Google Scholar] [CrossRef]
  23. Laschinger, H.K.S.; Leiter, M.P. The impact of nursing work environments on patient safety outcomes: The mediating role of burnout/engagement. J. Nurs. Adm. 2006, 36, 259–267. [Google Scholar] [CrossRef]
  24. Laschinger, H.K.S. Effect of empowerment on professional practice environments, work satisfaction, and patient care quality: Further testing the Nursing Worklife Model. J. Nurs. Care Qual. 2008, 23, 322–330. [Google Scholar] [CrossRef] [PubMed]
  25. Jacobsen, K.H. Will COVID-19 generate global preparedness? Lancet 2020, 395, 1013–1014. [Google Scholar] [CrossRef]
  26. Villa, S.; Lombardi, A.; Mangioni, D.; Bozzi, G.; Bandera, A.; Gori, A.; Raviglione, M.C. The COVID-19 pandemic preparedness or lack thereof: From China to Italy. Glob. Health Med. 2020, 2, 73–77. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Maslach, C.; Jackson, S.; Leiter, M. Burnout Inventory Manual; Consulting Psychologists Press: Palo Alto, CA, USA, 1996. [Google Scholar]
  28. Oudyk, J.; Smith, P. Preliminary Results for the Pandemic Healthcare Workers’ Survey; Occupational Health Clinics for Ontario Workers: Hamilton, ON, Canada, 2020. [Google Scholar]
  29. Zhao, S.; Xie, F.; Wang, J.; Shi, Y.; Zhang, S.; Han, X.; Sun, Z.; Shi, L.; Li, Z.; Mu, H.; et al. Prevalence of Workplace Violence Against Chinese Nurses and Its Association with Mental Health: A Cross-sectional Survey. Arch. Psychiatr. Nurs. 2018, 32, 242–247. [Google Scholar] [CrossRef]
  30. Zhang, S.-E.; Liu, W.; Wang, J.; Shi, Y.; Xie, F.; Cang, S.; Sun, T.; Fan, L. Impact of workplace violence and compassionate behaviour in hospitals on stress, sleep quality and subjective health status among Chinese nurses: A cross-sectional survey. BMJ Open 2018, 8, e019373. [Google Scholar] [CrossRef] [Green Version]
  31. Lanctôt, N.; Guay, S. The aftermath of workplace violence among healthcare workers: A systematic literature review of the consequences. Aggress. Violent Behav. 2014, 19, 492–501. [Google Scholar] [CrossRef]
  32. Zheng, R.; Zhou, Y.; Fu, Y.; Xiang, Q.; Cheng, F.; Chen, H.; Xu, H.; Fu, L.; Wu, X.; Feng, M.; et al. Prevalence and associated factors of depression and anxiety among nurses during the outbreak of COVID-19 in China: A cross-sectional study. Int. J. Nurs. Stud. 2020, 114, 103809. [Google Scholar] [CrossRef]
  33. Hu, D.; Kong, Y.; Li, W.; Han, Q.; Zhang, X.; Zhu, L.X.; Wan, S.W.; Liu, Z.; Shen, Q.; Yang, J.; et al. Frontline nurses’ burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: A large-scale cross-sectional study. Lancet 2020, 24, 100424. [Google Scholar] [CrossRef]
  34. Maslach, C.; Leiter, M.P. Understanding the burnout experience: Recent research and its implications for psychiatry. World Psychiatry 2016, 15, 103–111. [Google Scholar] [CrossRef] [Green Version]
  35. Mind Garden A Message from the Maslach Burnout Inventory Authors. Available online: https://www.mindgarden.com/blog/post/44-a-message-from-the-maslach-burnout-inventory-authors (accessed on 27 June 2020).
  36. Aiken, L.H.; Sermeus, W.; den Heede, K.V.; Sloane, D.M.; Busse, R.; McKee, M.; Bruyneel, L.; Rafferty, A.M.; Griffiths, P.; Moreno-Casbas, M.T.; et al. Patient safety, satisfaction, and quality of hospital care: Cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ 2012, 344. [Google Scholar] [CrossRef] [Green Version]
  37. Aiken, L.H.; Sloane, D.M.; Bruyneel, L.; Van den Heede, K.; Sermeus, W. RN4CAST Consortium Nurses’ reports of working conditions and hospital quality of care in 12 countries in Europe. Int. J. Nurs. Stud. 2013, 50, 143–153. [Google Scholar] [CrossRef] [PubMed]
  38. Aiken, L.H.; Sloane, D.M.; Cimiotti, J.P.; Clarke, S.P.; Flynn, L.; Seago, J.A.; Spetz, J.; Smith, H.L. Implications of the California Nurse Staffing Mandate for Other States. Health Serv. Res. 2010, 45, 904–921. [Google Scholar] [CrossRef] [PubMed]
  39. Shin, S.; Park, J.-H.; Bae, S.-H. Nurse staffing and nurse outcomes: A systematic review and meta-analysis. Nurs. Outlook 2018, 66, 273–282. [Google Scholar] [CrossRef] [PubMed]
  40. Zhang, S.X.; Liu, J.; Afshar Jahanshahi, A.; Nawaser, K.; Yousefi, A.; Li, J.; Sun, S. At the height of the storm: Healthcare staff’s health conditions and job satisfaction and their associated predictors during the epidemic peak of COVID-19. Brain Behav. Immun. 2020, 87, 144–146. [Google Scholar] [CrossRef] [PubMed]
  41. Arnetz, J.E.; Goetz, C.M.; Sudan, S.; Arble, E.; Janisse, J.; Arnetz, B.B. Personal Protective Equipment and Mental Health Symptoms Among Nurses During the COVID-19 Pandemic. J. Occup. Environ. Med. 2020, 61, 892–897. [Google Scholar] [CrossRef]
  42. Smith, P.M.; Oudyk, J.; Potter, G.; Mustard, C. The Association between the Perceived Adequacy of Workplace Infection Control Procedures and Personal Protective Equipment with Mental Health Symptoms: A Cross-sectional Survey of Canadian Health-care Workers during the COVID-19 Pandemic. Can. J. Psychiatry 2020. [Google Scholar] [CrossRef]
  43. Labrague, L.J.; Santos, J.A.A.D. COVID-19 anxiety among front-line nurses: Predictive role of organisational support, personal resilience and social support. J. Nurs. Manag. 2020, 28, 1653–1661. [Google Scholar] [CrossRef]
  44. Fernandez, R.; Lord, H.; Halcomb, E.; Moxham, L.; Middleton, R.; Alananzeh, I.; Ellwood, L. Implications for COVID-19: A systematic review of nurses’ experiences of working in acute care hospital settings during a respiratory pandemic. Int. J. Nurs. Stud. 2020, 111, 103637. [Google Scholar] [CrossRef]
  45. Bradley, J.R.; Cartwright, S. Social Support, Job Stress, Health, and Job Satisfaction Among Nurses in the United Kingdom. Int. J. Stress Manag. 2002, 9, 163–182. [Google Scholar] [CrossRef]
  46. Miner, K.N.; Settles, I.H.; Pratt-Hyatt, J.S.; Brady, C.C. Experiencing incivility in organizations: The buffering effects of emotional and organizational support. J. Appl. Soc. Psychol. 2012, 42, 340–372. [Google Scholar] [CrossRef]
  47. Brunetto, Y.; Xerri, M.; Shriberg, A.; Farr-Wharton, R.; Shacklock, K.; Newman, S.; Dienger, J. The impact of workplace relationships on engagement, well-being, commitment and turnover for nurses in Australia and the USA. J. Adv. Nurs. 2013, 69, 2786–2799. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. McMillan, K.; Perron, A. Change fatigue in nurses: A qualitative study. J. Adv. Nurs. 2020, 76, 2627–2636. [Google Scholar] [CrossRef] [PubMed]
  49. Brown, R.; Wey, H.; Foland, K. The Relationship Among Change Fatigue, Resilience, and Job Satisfaction of Hospital Staff Nurses. J. Nurs. Sch. 2018, 50, 306–313. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. McMillan, K.; Perron, A. Nurses amidst change: The concept of change fatigue offers an alternative perspective on organizational change. Policy Polit. Nurs. Pract. 2013, 14, 26–32. [Google Scholar] [CrossRef] [PubMed]
  51. Ead, H. Change Fatigue in Health Care Professionals--An Issue of Workload or Human Factors Engineering? J. Perianesth Nurs. 2015, 30, 504–515. [Google Scholar] [CrossRef] [PubMed]
  52. Parasher, A. COVID-19: Current understanding of its pathophysiology, clinical presentation and treatment. Postgrad. Med. J. 2020. [Google Scholar] [CrossRef]
  53. Government of Canada COVID-19: Main Modes of Transmission. Available online: https://www.canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection/health-professionals/main-modes-transmission.html (accessed on 12 December 2020).
  54. Chen, Q.; Liang, M.; Li, Y.; Guo, J.; Fei, D.; Wang, L.; He, L.; Sheng, C.; Cai, Y.; Li, X.; et al. Mental health care for medical staff in China during the COVID-19 outbreak. Lancet Psychiatry 2020, 7, e15–e16. [Google Scholar] [CrossRef]
  55. Havaei, F.; MacPhee, M.; Dahinten, V.S. The effect of nursing care delivery models on quality and safety outcomes of care: A cross-sectional survey study of medical-surgical nurses. J. Adv. Nurs. 2019, 75, 2144–2155. [Google Scholar] [CrossRef]
  56. Lasater, K.B.; Aiken, L.H.; Sloane, D.M.; French, R.; Martin, B.; Reneau, K.; Alexander, M.; McHugh, M.D. Chronic hospital nurse understaffing meets COVID-19: An observational study. BMJ Qual. Saf. 2020. [Google Scholar] [CrossRef]
  57. Canadian Institute of Health Information. Nursing in Canada, 2019: A Lense on Supply and Workforce; CIHI: Ottawa, ON, Canada, 2019. [Google Scholar]
Figure 1. Workplace conditions questions and their response scales for each domain. PPE = personal protective equipment.
Figure 1. Workplace conditions questions and their response scales for each domain. PPE = personal protective equipment.
Healthcare 09 00084 g001aHealthcare 09 00084 g001b
Table 1. Descriptive statistics on nurse characteristics and workplace characteristics.
Table 1. Descriptive statistics on nurse characteristics and workplace characteristics.
Mean (SD)n%
Nurse Characteristics
Role
Direct care provider-316186
Nurse leader-39310.7
Educator-1223.3
Total 3676
Designation 1
RN-273574.4
RPN-2005.4
Dually registered (RN/RPN) -150.4
LPN-71419.4
Total 3664
Years of nursing experience12 (7.2)--
Workplace CharacteristicsMean (SD)n%
Sector
Acute care-231963.2
Community care-87023.7
Long-term care-48313.2
Total 3672
Geographic area
Urban-232463.6
Suburban-72719.9
Rural-60516.5
Total 3656
1 Nurse designations: college-educated licensed practical nurse (LPN), baccalaureate-educated registered psychiatric nurse (RPN), and baccalaureate-educated registered nurse (RN).
Table 2. Descriptive statistics for key workplace condition predictors.
Table 2. Descriptive statistics for key workplace condition predictors.
Workplace ConditionsnMeanSDRange 1
Key predictors
Workplace safety
Frequency of direct contact with COVID patients 135872.911.971–7
Concern for contracting COVID 235973.471.121–5
Concern for bringing COVID home 235973.901.141–5
Likelihood of refusing unsafe work if denied appropriate PPE 335631.990.921–4
Confidence in ability to assess PPE requirements 435762.551.201–6
Confidence in ability to assess risk 435742.481.071–6
Experienced COVID-19 symptoms 535770.310.460–1
Submitted workers’ compensation 535490.020.120–1
Resources and supplies
Nurse staffing adequacy 635973.481.601–6
PPE adequacy 735743.301.541–6
PPE quality 735693.591.501–6
Training 835262.330.991–5
N95 mask fitting 935753.271.541–7
Organizational preparedness
Confidence in organizational handling of the pandemic 435273.491.341–6
Confidence in manager’s handling of the pandemic 435223.481.461–6
Frequency of COVID-19 related policy changes 1035275.471.681–8
Transparency of pandemic-related organizational decisions 1135223.291.021–5
Organizational support
Told to work despite exposure 535710.240.430–1
Told to work despite symptoms 535560.310.230–1
Organizational support 1235232.641.031–5
Workplace relations
Relationships with nursing colleagues 1335243.050.791–5
Relationships with manager 1335263.250.801–5
Relationships with the rest of allied health 1335233.110.701–5
Note: 1 (3 = “once a month”); 2 (3 = “somewhat concerned”, 4 = “very concerned”); 3 (2 = “likely”); 4 (2 = “confident” 3 = “somewhat confident”, 4 = “slightly confident”); 5 (0 = “no”, 1 = “yes”); 6 (3 = “slightly adequate”, 4= “slightly inadequate”); 7 (3 = “somewhat agree”, 4 = “somewhat disagree”); 8 (2 = “somewhat adequate”); 9 (3 = “within the last year”); 10 (5 = “once a week”); 11 (3 = “fair”); 12 (3 = “slightly supported”); 13 (3 = “stayed the same”). The complete response options and coding schemes for all items can be found in Figure 1.
Table 3. Descriptive statistics for mental health outcomes and proportions for cutoff categories.
Table 3. Descriptive statistics for mental health outcomes and proportions for cutoff categories.
Outcome VariablesFrequencyPercentMeanSDRange
Post-traumatic stress disorder (PTSD) (PTSS-14)
Under cutoff (14–44)194452.9
Met cutoff, PTSD (45–98)173247.1
Total3369 46.6819.3714–98
Anxiety (GAD-7)
Under cutoff (0–9)211462.4
Met cutoff, anxiety (10–21)127337.6
Total3387 8.535.800–21
Depression (PHQ-9)
Under cutoff (0–9)197258.6
Met cutoff, major depression (10–27)139141.4
Total3363 8.996.230–27
Emotional Exhaustion (EE) (MBI-HSS)
Low EE (0–16)60218.4
Moderate EE (17–26)69221.2
High EE (27–54)197560.4
Total3269 30.0513.230–54
Table 4. Final linear regression models regressing PTSD, anxiety, depression, and EE measure sum scores on demographic control and workplace condition variables.
Table 4. Final linear regression models regressing PTSD, anxiety, depression, and EE measure sum scores on demographic control and workplace condition variables.
PTSD (PTSS-14)Anxiety (GAD-7)Depression (PHQ-9)Emotional Exhaustion (MBI-HSS)
VariablesB95% CIpB95% CIpB95% CIpB95% CIp
(Constant)−9.50−14.35–−4.650.00−6.46−7.94–−4.980.00−5.43−7.06–−3.790.00−1.92−5.27–1.430.26
CONTROL VARIABLES
Role (Direct care provider)−1.23−2.96–0.490.16−0.61−1.14–−0.090.02−0.55−1.13–0.030.06−3.29−4.48–−2.100.00
Sector (Acute care)1.04−0.26–2.340.12−0.04−0.44–0.360.84−0.19−0.63–0.250.390.42−0.48–1.320.36
Geographic area (Urban/suburban)0.94−0.62–2.490.24−0.07−0.54–0.410.790.00−0.53–0.520.99−0.20−1.27–0.870.71
Designation (RN/RPN)0.55−0.96–2.070.470.520.06–0.980.030.04−0.47–0.550.871.470.42–2.520.01
Experience (Years of experience)−0.08−0.17–0.000.06−0.06−0.09–−0.040.00−0.04−0.06–−0.010.01−0.09−0.15–−0.030.00
KEY PREDICTORS
Workplace safety
Frequency of direct contact0.620.30–0.940.000.090.00–0.190.060.10−0.01–0.210.070.380.16–0.600.00
Concern for contracting COVID1.270.48–2.060.000.370.13–0.610.000.16−0.11–0.420.240.47−0.07–1.010.09
Concern for bringing COVID home1.170.40–1.950.000.440.21–0.680.000.300.04–0.560.020.29−0.24–0.820.29
Refusing unsafe work if denied appropriate PPE1.560.91–2.210.000.440.25–0.640.000.500.29–0.720.000.37−0.08–0.820.11
Experienced COVID-19 symptoms4.122.87–5.370.001.240.86–1.630.001.531.11–1.950.001.810.94–2.670.00
Resources and supplies
Nurse staffing adequacy1.030.62–1.440.000.320.20–0.440.000.320.19–0.460.001.411.13–1.690.00
PPE access adequacy0.770.31–1.230.000.08−0.06–0.220.270.160.00–0.310.050.25−0.07–0.570.12
Organizational preparedness
Confidence in organizational handling of the pandemic0.630.03–1.290.060.17−0.03–0.370.090.11−0.12–0.330.350.770.32–1.230.00
Frequency of COVID-19 related policy changes 1.300.94–1.660.000.430.32–0.540.000.460.34–0.590.000.900.65–1.150.00
Transparency of pandemic-related organizational decisions0.67−0.14–1.490.100.11−0.13–0.360.370.18−0.09–0.450.200.680.12–1.240.02
Organizational support
Organizational support 1.971.13–2.800.000.600.35–0.860.000.710.43–0.990.001.480.90–2.060.00
Workplace relations
Relationships with nursing colleagues2.121.28–2.960.000.730.47–0.990.000.740.46–1.030.001.030.45–1.610.00
Relationships with manager1.340.44–2.230.000.350.08–0.620.010.15−0.15–0.450.330.870.25–1.490.01
Relationships with the rest of allied health2.441.49–3.390.000.560.27–0.850.000.710.39–1.030.001.310.66–1.970.00
Final model F-statistic, explained variance (Adjusted R2), model p59.98 (19, 3229)25.7%0.0051.40 (19, 3245)22.7%0.0040.92 (19, 3223)19.0%0.0058.51 (19, 3136)25.7%0.00
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Havaei, F.; Ma, A.; Staempfli, S.; MacPhee, M. Nurses’ Workplace Conditions Impacting Their Mental Health during COVID-19: A Cross-Sectional Survey Study. Healthcare 2021, 9, 84. https://doi.org/10.3390/healthcare9010084

AMA Style

Havaei F, Ma A, Staempfli S, MacPhee M. Nurses’ Workplace Conditions Impacting Their Mental Health during COVID-19: A Cross-Sectional Survey Study. Healthcare. 2021; 9(1):84. https://doi.org/10.3390/healthcare9010084

Chicago/Turabian Style

Havaei, Farinaz, Andy Ma, Sabina Staempfli, and Maura MacPhee. 2021. "Nurses’ Workplace Conditions Impacting Their Mental Health during COVID-19: A Cross-Sectional Survey Study" Healthcare 9, no. 1: 84. https://doi.org/10.3390/healthcare9010084

APA Style

Havaei, F., Ma, A., Staempfli, S., & MacPhee, M. (2021). Nurses’ Workplace Conditions Impacting Their Mental Health during COVID-19: A Cross-Sectional Survey Study. Healthcare, 9(1), 84. https://doi.org/10.3390/healthcare9010084

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop