Resilience in Teachers: Validation of the Spanish Version of the CD-RISC10© Scale in Early Childhood, Primary and Special Education Teachers
Abstract
:1. Introduction
2. Materials and Methods
2.1. Participants
2.2. Instruments
2.2.1. Contextual Data
2.2.2. Connor–Davidson Resilience Scale (CD-RISC 10©)
2.2.3. Teacher as Resilient Professional (C-DPR)
2.3. Procedure
2.4. Data Analysis
3. Results
3.1. Confirmatory Factor Analysis
3.2. Reliability
3.3. Convergent Validity
3.4. Descriptive Statistics
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Masten, A.S. Resilience in developing systems: Progress and promise as the fourth wave rises. Dev. Psychopathol. 2007, 19, 921–930. [Google Scholar] [CrossRef]
- Uriarte, J.D. Resiliencia y envejecimiento. Eur. J. Investig. Health Psychol. Educ. 2014, 4, 67–77. [Google Scholar] [CrossRef]
- Piña, J.A. Un análisis crítico del concepto de resiliencia en psicología. An. De Psicol. 2015, 31, 751–758. [Google Scholar] [CrossRef]
- Suárez-Ojeda, E.; Melillo, A. Resiliencia. Descubriendo Las Propias Fuerzas; Paidós: Buenos Aires, Argentina, 2001. [Google Scholar]
- Bravo, A.H.; López, P.J. Resiliencia familiar: Una revisión sobre artículos publicados en español. Revista IIPSI 2015, 18, 151–170. [Google Scholar] [CrossRef]
- Luthar, S.S.; Cicchetti, D.; Becker, B. The construct of resilience. A critical evaluation and guidelines for future work. Child Dev. 2000, 71, 543–562. [Google Scholar] [CrossRef]
- Rutter, M. Genes and Behavior: Nature–Nurture Interplay Explained; Blackwell Publishing Ltd.: Oxford, UK, 2006. [Google Scholar]
- Ungar, M. The social ecology of resilience: Addressing contextual and cultural ambiguity of a nascent construct. Am. J. Orthopsychiatry 2011, 81, 1–17. [Google Scholar] [CrossRef]
- McEwen, B.S.; Gray, J.; Nasca, C. Recognizing resilience: Learning from the effects of stress on the brain. Neurobiol. Stress. 2015, 1, 1–11. [Google Scholar] [CrossRef]
- Wolin, S.J.; Wolin, S. The Resilient Self: How Survivors of Troubled Families Arise above Adversity; Villard Books: New York, NY, USA, 1993. [Google Scholar]
- González, S.; Gaxiola, J.C.; Valenzuela, E.; Rivera, M. Social support and resilience: Predictors of psychological well-being on adolescents with stressful life event. Int. J. Psychol. 2016, 51, 1053–1054. [Google Scholar] [CrossRef]
- Morelato, S.G. Evaluación de factores de resiliencia en niños argentinos en condiciones de vulnerabilidad familiar. Univ. Psychologica. 2014, 13, 1473–1488. [Google Scholar] [CrossRef]
- Kostoulas, A.; Lämmerer, A. Resilience in language teaching: Adaptive and maladaptive outcomes in pre-service teachers. In The Emotional Rollercoaster of Language Teaching; Gkonou, C., Dewaele, J.M., King, J., Eds.; Multilingual Matters: Bristol, UK, 2020; pp. 89–110. [Google Scholar]
- Li, Q.; Gu, Q.; He, W. Resilience of Chinese teachers: Why perceived work conditions and relational trust matter. Meas. Interdiscip. Res. Perspect. 2019, 17, 143–159. [Google Scholar] [CrossRef]
- Fan, L.; Ma, F.; Liu, Y.; Liu, T.; Guo, L.; Wang, L. Risk factors and resilience strategies: Voices from Chinese novice foreign language teachers. Front. Educ. 2021, 5, 565722. [Google Scholar] [CrossRef]
- Leroux, M. Exploring Canadian early career teachers’ resilience from an evolutionary perspective. In Resilience in Education: Concepts, Contexts and Connections; Wosnitza, M., Peixoto, F., Beltman, S., Mansfield, C.F., Eds.; Springer: Cham, Germany, 2018; pp. 107–129. [Google Scholar]
- Liu, H.; Chu, W. Exploring EFL teacher resilience in the Chinese context. System 2022, 105, 102752. [Google Scholar] [CrossRef]
- Huang, J. Sustainability of professional development: A longitudinal case study of an early career ESL teacher’s agency and identity. Sustainability 2021, 13, 9025. [Google Scholar] [CrossRef]
- Uriarte, J.D. Construir la resiliencia en la escuela. Rev. De Psicodidactica. 2006, 11, 7–23. [Google Scholar]
- Moll, I.; Bagur, S.; Rosselló, M.R. Resilience: Conceptualization and Keys to Its Promotion in Educational Centers. Children. 2022, 9, 1183. [Google Scholar] [CrossRef]
- UNESCO. Declaración de Incheon. Educación 2030: Hacia Una Educación Inclusiva, Equitativa Y de Calidad Y Aprendizaje a Lo Largo de la Vida Para Todos; UNESCO: París, France, 2015. [Google Scholar]
- Spekman, N.J.; Goldberg, R.J.; Herman, K.L. An exploration of risk and resilience in the lives of individuals with learning disabilities. Learn. Disabil. Res. Pract. 1993, 8, 11–18. [Google Scholar]
- Bender, W.N.; Rosenkrans, C.B.; Crane, M.K. Stress, depression, and suicide among students with learning disabilities: Assessing the risk. Learn. Disabil. Q. 1999, 22, 143–156. [Google Scholar] [CrossRef]
- Gibbs, S.; Miller, A. Teachers’ resilience and well-being: A role for educational psychology. Teach. Teach. 2014, 20, 609–621. [Google Scholar] [CrossRef]
- Pianta, R.C.; Walsh, D.J. Applying the construct of resilience in schools: Cautions from a developmental systems perspective. Educ. Psychol. Rev. 1998, 27, 407–417. [Google Scholar] [CrossRef]
- Richardson, P.; Watt, H. Factors influencing teaching choice: Why do future teachers choose the career? In International Handbook of Teacher Education; Loughran, J., Hamilton, M., Eds.; Springer: Singapore, 2016; pp. 275–304. [Google Scholar]
- Skaalvik, E.; Skaalvik, S. Motivated for teaching? Associations with school goal structure, teacher self-efficacy, job satisfaction and emotional exhaustion. Teach. Teach. Educ. 2017, 67, 152–160. [Google Scholar] [CrossRef]
- Castro, A.J.; Kelly, J.; Shih, M. Resilience strategies for new teachers in high-needs areas. Teach. Teach. Educ. 2010, 26, 622–629. [Google Scholar] [CrossRef]
- Clarà, M. Teacher resilience and meaning transformation: How teachers reappraise situations of adversity. Teach. Teach. Educ. 2017, 63, 82–91. [Google Scholar] [CrossRef]
- Forján, R.; Morelatto, G. Estudio comparativo de factores de resiliencia en docentes de contextos socialmente vulnerables. Psicogente 2018, 21, 277–296. [Google Scholar] [CrossRef]
- Uriarte, J.D.; Pegalajar, M.; de León, J.M.; Galindo, H. Las relaciones entre las actitudes hacia la educación inclusiva, la autoeficacia y la resiliencia docentes. IJODAEP 2019, 2, 13–22. [Google Scholar] [CrossRef]
- Sammons, P.; Day, C.; Kington, A.; Gu, Q.; Stobart, G.; Smees, R. Exploring variations in teachers’ work, lives and their effects on pupils: Key findings and implications from a longitudinal mixed-method study. Br. Educ. Res. J. 2007, 33, 681–701. [Google Scholar] [CrossRef]
- Lozada, R.; Martínez, L.; Acle, G. Escala de Comportamientos Resilientes para Profesores y profesoras. In Resiliencia en Educación Especial. Una Experiencia en la Escuela Regular; Acle, G.C., Ed.; Gedisa Editorial: Barcelona, Spain, 2013; pp. 137–162. [Google Scholar]
- Keane, K.; Evans, R.R. The Potential for Teacher-Student Relationships and the Whole School, Whole Community, Whole Child Model to Mitigate Adverse Childhood Experiences. J. Sch. Heal. 2022, 92, 504–513. [Google Scholar] [CrossRef]
- Cyrulnik, B. La Resiliencia O la Capacidad Humana de Superar Pérdidas, Crisis, Adversidades O Traumas; Institut Français: Madrid, Spain, 2009. [Google Scholar]
- Mateu, R.; Flores, R. Formación docente, hacia el profesional resiliente. In Resiliencia en la Educación Superior: El Cambio de Mirada Para Transformar Escenarios de Vulnerabilidad Escolar; Benítez, L., Martínez, R.d.C., Eds.; Newton: Mexico City, Mexico, 2018; pp. 74–89. [Google Scholar]
- Gardner, R.; Stephens-Pisecco, T. Empowering educators to foster student resilience. Clear. House A J. Educ. Strat. Issues Ideas. 2019, 92, 125–134. [Google Scholar] [CrossRef]
- Gaxiola, J.; González, S. Apoyo percibido, resiliencia, metas y aprendizaje autorregulado en bachilleres. Redie 2019, 21, 1–10. [Google Scholar] [CrossRef]
- Peer, J.W.; Hillman, S.B.; Van-Hoet, E. The effects of stress on the lives of emerging adult college students: An exploratory analysis. Adultspan J. 2015, 14, 90–99. [Google Scholar] [CrossRef]
- Greenfield, S. Mind Change: How Digital Technologies Are Leaving Their Mark on Our Brains; Random House Incorporated: New York, NY, USA, 2015. [Google Scholar]
- Klassen, R.M.; Durksen, T.L.; Al Hashmi, W.; Kim, L.E.; Longden, K.; Metsäpelto, R.L.; Poikkeus, A.-M.; Györi, J.G. National context and teacher characteristics: Exploring the critical non-cognitive attributes of novice teachers in four countries. Teach. Teach. Educ. 2018, 72, 64–74. [Google Scholar] [CrossRef]
- Doney, P.A. Fostering resilience: A necessary skill for teacher retention. J. Sci. Teach. Educ. 2013, 24, 645–664. [Google Scholar] [CrossRef]
- Xie, F.; Derakhshan, A. A conceptual review of positive teacher interpersonal communication behaviors in the instructional context. Front. Psychol. 2021, 12, 2623. [Google Scholar] [CrossRef]
- Gu, Q. (Re)conceptualising teacher resilience: A social-ecological approach to understanding teachers’ professional worlds. In Resilience in Education: Concepts, Contexts and Connections; Wosnitza, M., Peixoto, F., Beltman, S., Mansfield, C.F., Eds.; Springer: Cham, Switzerland, 2018; pp. 13–33. [Google Scholar]
- Wosnitza, M.; Peixoto, F. Resilience in education: Emerging trends in recent research. In Resilience in Education: Concepts, Contexts and Connections; Wosnitza, M., Peixoto, F., Beltman, S., Mansfield, C.F., Eds.; Springer: Cham, Switzerland, 2018; pp. 335–340. [Google Scholar]
- Ergün, A.L.P.; Dewaele, J.M. Do well-being and resilience predict the foreign language teaching enjoyment of teachers of Italian? System 2021, 99, 102506. [Google Scholar] [CrossRef]
- Papazis, F.; Avramidis, E.; Bacopoulou, F. Greek teachers’ resilience levels during the COVID-19 pandemic lockdown and its association with attitudes towards emergency remote teaching and perceived stress. Psychol. Sch. 2022, 10, 22709. [Google Scholar] [CrossRef] [PubMed]
- Sharifian, M.S.; Hoot, J.L.; Shibly, O.; Reyhanian, A. Trauma, Burnout, and Resilience of Syrian Primary Teachers Working in a War Zone. J. Res. Child. Educ. 2022. [Google Scholar] [CrossRef]
- Deutscherova, B. Resilience of beginning and advanced teachers in managing various changes in their profesión. J. Lang. Cult. Educ. 2021, 9, 77–83. [Google Scholar] [CrossRef]
- Stavraki, C.; Karagianni, E. Exploring Greek EFL Teachers’ Resilience. J. Psychol. Lang. Learn. 2020, 2, 142–179. [Google Scholar] [CrossRef]
- Guerra, J. Construcción, validez y confiabilidad de la Escala de Resiliencia Docente. Propósitos y Representaciones. 2013, 1, 59–86. [Google Scholar] [CrossRef]
- Peixoto, F.; Silva, J.; Pipa, J.; Wosnitza, M.; Mansfield, C. The Multidimensional Teachers’ Resilience Scale: Validation for Portuguese Teachers. J. Psychoeduc. Assess. 2020, 38, 402–408. [Google Scholar] [CrossRef]
- Jew, C.L. Development and Validation of a Measure of Resiliency. Unpublished Ph.D. Thesis, University of Denver: Denver, CO, USA, 1991. [Google Scholar]
- Bartone, P. Test-retest reliability of the dispositional resilience scale-15, a brief hardiness scale. Psychol. Rep. 2007, 101, 943–944. [Google Scholar] [CrossRef]
- Saavedra, E.; Villalta, M. Escala de Resiliencia SV-RES. Para Jóvenes Y Adultos; Segunda Edición: Autores, Santiago, 2008. [Google Scholar]
- Campbell-Sills, L.; Stein, M.B. Psychometric analysis and refinement of the Connor-Davidson resilience scale (CD-RISC): Validation of a 10-item measure of resilience. J. Trauma. Stress. 2007, 20, 1019–1028. [Google Scholar] [CrossRef] [PubMed]
- Hébert, M.; Parent, N.; Simard, C.; Laverdière, A. Validation of the French Canadian Version of the Brief Connor-Davidson Resilience Scale (CD-RISC 10). Can. J. Behav. Sci. 2018, 50, 9–16. [Google Scholar] [CrossRef]
- Levey, E.J.; Rondon, M.B.; Sanchez, S.; Williams, M.A.; Gelaye, B. Psychometric properties of the Spanish version of the 10-item Connor Davidson Resilience Scale (CD-RISC) among adolescent mothers in Peru. J. Child Adolesc. Trauma 2021, 14, 29–40. [Google Scholar] [CrossRef]
- Nartova-Bochaver, S.; Korneev, A.; Bochaver, K. Validation of the 10-Item Connor-Davidson Resilience Scale: The Case of Russian Youth. Front. Psychiatry 2021, 12, 611026. [Google Scholar] [CrossRef]
- Hwang, Y.I.J.; Arnold, S.; Trollor, J.; Uljarević, M. Factor structure and psychometric properties of the brief Connor-Davidson Resilience Scale for adults on the autism spectrum. Autism 2020, 24, 1572–1577. [Google Scholar] [CrossRef]
- Pretorius, T.B.; Padmanabhanunni, A. Validation of the Connor-Davidson Resilience Scale-10 in South Africa: Item Response Theory and Classical Test Theory. Psychol. Res. Behav. Manag. 2022, 15, 1235–1245. [Google Scholar] [CrossRef]
- Fernández, M.M.; Meseguer, M.; Soler, M.I. Propiedades psicométricas de la versión española de la escala de resiliencia de 10 ítems de Connor-Davidson (CD-RISC 10) en una muestra de desempleados. Suma Psicol. 2018, 15, 1–9. [Google Scholar] [CrossRef]
- Alarcón, R.; Cerezo, M.V.; Hevilla, S.; Blanca, M.J. Psychometric properties of the Connor-Davidson Resilience Scale in women with breast cancer. Int. J. Clin. Heal. Psychol. 2019, 20, 1–9. [Google Scholar] [CrossRef]
- Blanco, V.; Guisande, M.A.; Sánchez, M.T.; Otero, P.; Vázquez, F.L. Spanish validation of the 10-item Connor–Davidson Resilience Scale (CD-RISC 10) with non-professional caregivers. Aging Ment. Heal. 2019, 23, 183–188. [Google Scholar] [CrossRef]
- Aloba, O.; Olabisi, O.; Aloba, T. The 10-Item Connor–Davidson Resilience Scale: Factorial Structure, Reliability, Validity, and Correlates Among Student Nurses in Southwestern Nigeria. J. Am. Psychiatr. Nurses Assoc. 2016, 22, 43–51. [Google Scholar] [CrossRef]
- Connor, K.M.; Davidson, J.R.T. Development of a new resilience scale: The Connor–Davidson Resilience Scale (CDRISC). Depress. Anxiety 2003, 18, 76–82. [Google Scholar] [CrossRef] [PubMed]
- Mateu, R. Promoción de la Resiliencia en Contextos Escolares. Diseño, Implementación Y Evaluación de Un Programa de Intervención. Ph.D. Thesis, Universitat Jaume I, Castellón, Spain, 2013. [Google Scholar]
- Bentler, P.M. EQS 6 Structural Equations Program. Manual; Multivariate Software: Encino, CA, USA, 2008. [Google Scholar]
- Kenny, D.A. Measuring Model. Fit. Available online: http://www.davidakenny.net/cm/fit.htm (accessed on 26 May 2022).
- Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 136–162. [Google Scholar]
- Satorra, A. Robustness issues in structural equation modeling: A reviewof recent developments. Qual. Quant. 1990, 24, 367–386. [Google Scholar] [CrossRef]
- Satorra, A.; Bentler, P.M. Scaling Corrections for Chi-Square Statistics in Covariance Structure Analysis. Proceedings of the Business and Economic Statistics Section; American Statistical Association: Alexandria, VA, USA, 1988; pp. 308–313. [Google Scholar]
- McDonald, R.P. Test. Theory: A Unified Treatment; Lawrence Erlbaum Associates, Inc.: Mahwah, NJ, USA, 1999. [Google Scholar]
- Cronbach, L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef]
- McKay, L.; Barton, G. Exploring how arts-based reflection can support teachers’ resilience and well-being. Teach. Teach. Educ. 2018, 75, 356–365. [Google Scholar] [CrossRef]
n = 290 | % | ||
---|---|---|---|
Sex | Men | 64 | 22.06% |
Women | 226 | 77.93% | |
Type of school | Private school | 15 | 5.17% |
Concerted school | 52 | 17.93% | |
Public school | 223 | 76.89% | |
Educational stage | Early childhood education (3–6 years) | 72 | 24.82% |
Primary education (6–12 years) | 191 | 65.86% | |
Special education | 20 | 6.89% | |
Teaching experience | 1–5 years | 73 | 25.17% |
5–15 years | 97 | 33.44% | |
More than 15 years | 120 | 41.37% |
Models | χ2 | χ2S-B | df | CFI | NNFI | RMSEA |
---|---|---|---|---|---|---|
M1 | 549.21 | 45.67 | 33 | 0.97 | 0.98 | 0.036 [0.001, 0.060] |
M2 | 206.469 | 39.19 | 35 | 0.70 | 0.66 | 0.130 [0.113, 0.148] |
Items | M | DT | Asymmetry | Kurtosis | Corrected Correlation | α if Deleted |
---|---|---|---|---|---|---|
1. I am able to adapt to change | 3.28 | 0.57 | −0.12 | −0.53 | 0.46 | 0.866 |
2. I can deal with whatever comes | 3.10 | 0.66 | −0.26 | −0.25 | 0.56 | 0.862 |
3. I try to see the humorous side of problems | 2.77 | 0.74 | 0.08 | −0.60 | 0.37 | 0.868 |
4. Coping with stress can strengthen me | 3.09 | 0.67 | −0.17 | −0.52 | 0.51 | 0.867 |
5. I tend to bounce back after illness or hardship | 2.89 | 0.58 | −0.08 | 0.11 | 0.44 | 0.862 |
6. I can achieve goals despite obstacles | 2.98 | 0.71 | −0.31 | −0.10 | 0.40 | 0.863 |
7. I can stay focused under pressure | 2.48 | 0.70 | 0.02 | −0.22 | 0.48 | 0.863 |
8. I am not easily discouraged by failure | 2.53 | 0.77 | −0.02 | 0.10 | 0.44 | 0.866 |
9. I think of myself as astrong person | 2.76 | 0.71 | −0.15 | 0.18 | 0.61 | 0.861 |
10. I can handle unpleasant feelings | 2.83 | 0.72 | −0.22 | 0.16 | 0.49 | 0.863 |
Items | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
---|---|---|---|---|---|---|---|---|---|---|
1 | ||||||||||
2 | 0.47 ** | |||||||||
3 | 0.29 ** | 0.21 ** | ||||||||
4 | 0.33 ** | 0.40 ** | 0.22 ** | |||||||
5 | 0.22 ** | 0.24 ** | 0.27 ** | 0.30 ** | ||||||
6 | 0.16 ** | 0.26 ** | 0.20 ** | 0.22 ** | 0.28 ** | |||||
7 | 0.23 ** | 0.38 ** | 0.19 ** | 0.24 ** | 0.35 ** | 0.29 ** | ||||
8 | 0.24 ** | 0.26 ** | 0.27 ** | 0.26 ** | 0.21 ** | 0.21 ** | 0.26 ** | |||
9 | 0.32 ** | 0.15 ** | 0.23 ** | 0.45 ** | 0.27 ** | 0.32 ** | 0.40 ** | 0.42 ** | ||
10 | 0.28 ** | 0.40 ** | 0.20 ** | 0.38 ** | 0.28 ** | 0.22 ** | 0.27 ** | 0.27 ** | 0.38 ** |
CD-RISC-10 | Factor 1: Beliefs | Factor 2: Knowledge | Factor 3: Resources | Total C-DPR | |
---|---|---|---|---|---|
CD-RISC-10 | |||||
Factor 1: beliefs | 0.564 ** | ||||
Factor 2: knowledge | 0.790 ** | 0.389 ** | |||
Factor 3: resources | 0.809 ** | 0.415 ** | 0.556 ** | ||
Total C-DPR | 0.866 ** | 0.460 ** | 0.602 ** | 0.825 ** |
n = 290 | M | SD | ||
---|---|---|---|---|
Sex | Men | 64 | 29.03 | 3.89 |
Women | 226 | 28.47 | 4.08 | |
Type of school | Private school | 15 | 29.21 | 3.68 |
Concerted school | 52 | 28.96 | 4.07 | |
Public school | 223 | 28.63 | 4.39 | |
Educational stage | Early childhood education (3–6 years) | 72 | 28.39 | 3.87 |
Primary education (6–12 years) | 191 | 29.24 | 3.56 | |
Special education | 20 | 27.50 | 4.70 | |
Teaching experience | 1–5 years | 73 | 28.57 | 4.45 |
5–15 years | 97 | 28.63 | 3.48 | |
More than 15 years | 120 | 29.07 | 3.95 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Flores-Buils, R.; Caballer-Miedes, A.; Mateu-Pérez, R. Resilience in Teachers: Validation of the Spanish Version of the CD-RISC10© Scale in Early Childhood, Primary and Special Education Teachers. Int. J. Environ. Res. Public Health 2022, 19, 11020. https://doi.org/10.3390/ijerph191711020
Flores-Buils R, Caballer-Miedes A, Mateu-Pérez R. Resilience in Teachers: Validation of the Spanish Version of the CD-RISC10© Scale in Early Childhood, Primary and Special Education Teachers. International Journal of Environmental Research and Public Health. 2022; 19(17):11020. https://doi.org/10.3390/ijerph191711020
Chicago/Turabian StyleFlores-Buils, Raquel, Antonio Caballer-Miedes, and Rosa Mateu-Pérez. 2022. "Resilience in Teachers: Validation of the Spanish Version of the CD-RISC10© Scale in Early Childhood, Primary and Special Education Teachers" International Journal of Environmental Research and Public Health 19, no. 17: 11020. https://doi.org/10.3390/ijerph191711020
APA StyleFlores-Buils, R., Caballer-Miedes, A., & Mateu-Pérez, R. (2022). Resilience in Teachers: Validation of the Spanish Version of the CD-RISC10© Scale in Early Childhood, Primary and Special Education Teachers. International Journal of Environmental Research and Public Health, 19(17), 11020. https://doi.org/10.3390/ijerph191711020