Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians
Abstract
:1. Introduction
2. Methods
2.1. Participants and Procedures
2.2. Measures
2.3. Data Analyses
3. Results
4. Discussion
Limitations
5. Conclusions
Declarations
Supplementary Materials
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- WHO World Mental Health Survey Consortium. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA 2004, 291, 2581–2590. [Google Scholar] [CrossRef] [PubMed]
- Radloff, L.S. The CES-D Scale: A self-report depression scale for research in the general population. Appl. Psychol. Meas. 1977, 1, 385–401. [Google Scholar] [CrossRef]
- Kim, G.; DeCoster, J.; Huang, C.; Chiriboga, D.A. Race/ethnicity and the factor structure of the Center for Epidemiologic Studies Depression Scale: A meta-analysis. Cult. Divers. Ethnic Minor. Psychol. 2011, 17, 381–396. [Google Scholar] [CrossRef] [PubMed]
- van Noorden, R.; Maher, B.; Nuzzo, R. The top 100 papers: Nature explores the most-cited research of all time. Nature 2014, 514, 550–553. [Google Scholar] [CrossRef] [Green Version]
- Little, T.D. Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivar. Behav. Res. 1997, 32, 53–76. [Google Scholar] [CrossRef]
- Edwards, M.C.; Cheavens, J.S.; Heiy, J.E.; Cukrowicz, K.C. A reexamination of the factor structure of the Center for Epidemiologic Studies Depression Scale: Is a one-factor model plausible? Psychol. Assess. 2010, 22, 711–715. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Alexandrowicz, R.W.; Jahn, R.; Wancata, J. Assessing the dimensionality of the CES-D using multi-dimensional multi-level Rasch models. PLoS ONE 2018, 13, e0197908. [Google Scholar] [CrossRef]
- Gomez, R.; McLaren, S. The Center for Epidemiological Studies Depression Scale: Measurement and structural invariance across ratings of older adult men and women. Pers. Individ. Dif. 2015, 75, 130–134. [Google Scholar] [CrossRef]
- Gomez, R.; McLaren, S. The Center for Epidemiologic Studies Depression Scale: Invariance across heterosexual men, heterosexual women, gay men, and lesbians. Psychol. Assess. 2017, 29, 361–371. [Google Scholar] [CrossRef]
- Perreira, K.M.; Deeeb-Sossa, N.; Harris, K.M.; Bokeen, K. What are we measuring? An evaluation of the CES-D across race/ethnicity and immigrant generation. Soc. Forces 2005, 83, 1567–1602. [Google Scholar] [CrossRef]
- Armenta, B.E.; Hartshorn, K.J.S.; Whitbeck, L.B.; Crawford, D.M.; Hoyt, D.R. A longitudinal examination of the measurement properties and predictive utility of the Center for Epidemiologic Studies Depression Scale among North American Indigenous adolescents. Psychol. Assess. 2014, 26, 1347–1355. [Google Scholar] [CrossRef] [Green Version]
- Nguyen, H.T.; Kitner-Triolo, M.; Evans, M.K.; Zonderman, A.B. Factorial invariance of the CES-D in low socioeconomic status African Americans compared with a nationally representative sample. Psychiatry Res. 2004, 126, 177–187. [Google Scholar] [CrossRef]
- Mackinnon, A.; McCallum, J.; Andrews, G.; Anderson, I. The Center for Epidemiological Studies Depression Scale in older community samples in Indonesia, North Korea, Myanmar, Sri Lanka, and Thailand. J. Gerontol. Psychol. Sci. 1998, 53, 343–352. [Google Scholar] [CrossRef] [Green Version]
- Zhang, B.; Fokkema, M.; Cuijpers, P.; Juan, L.; Smits, N.; Beekman, A. Measurement invariance of the Center for Epidemiological Studies Depression scale (CES-D) among Chinese and Dutch elderly. BMC Med. Res. Methodol. 2011, 11, 74–83. [Google Scholar] [CrossRef] [Green Version]
- Zhang, Y.Y.; Ting, R.Z.W.; Lam, M.H.B.; Lam, S.; Yeung, R.; Nan, H.; Ozaki, R.; Luk, A.O.Y.; Kong, A.P.S.; Wing, Y.; et al. Measuring depression with CES-D in Chinese patients with type 2 diabetes: The validity and its comparison to PHQ-9. BMC Psychiatry 2015, 15, 198. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chin, W.Y.; Choi, E.P.H.; Chan, K.T.Y.; Wong, C.K.H. The psychometric properties of the Center for Epidemiologic Studies Depression Scale in Chinese primary care patients: Factor structure, construct validity, reliability, sensitivity and responsiveness. PLoS ONE 2015, 10, e0135131. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chokkanathan, S.; Mohanty, J. Factor structure of the CES-D scale among older adults in Chennai, India. Aging Ment. Health 2013, 17, 517–525. [Google Scholar] [CrossRef]
- Edman, J.L.; Danko, G.P.; Andrade, N.; McArdle, J.J.; Foster, J.; Glipa, J. Factor structure of the CES-D (Center for Epidemiologic Studies Depression Scale) among Filipino-American adolescents. Soc. Psychiatry Psychiatr. Epidemiol. 1999, 34, 211–215. [Google Scholar] [CrossRef]
- Russell, S.T.; Crockett, L.J.; Shen, Y.; Lee, S. Cross-ethnic invariance of self-esteem and depression measures for Chinese, Filipino, and European American adolescents. J. Youth Adolesc. 2008, 37, 50–61. [Google Scholar] [CrossRef]
- Yang, W.; Garrido, L.E.; Meng-Cheng, W.; Xiong, G.; Zhang, J.X.; Wang, C. Factor structure and criterion validity across the full scale and ten short forms of the CES-D among Chinese adolescents. Psychol. Assess. 2018, 30, 1186–1198. [Google Scholar] [CrossRef] [PubMed]
- Ji, L.; Nisbett, R.E.; Zhang, Z. Is it culture or is it language? Examination of language effects in cross-cultural research on categorization. J. Pers. Soc. Psychol. 2004, 87, 57–65. [Google Scholar] [CrossRef] [Green Version]
- Guarnaccia, P.J.; Angel, R.; Worobey, J.L. The factor structure of the CES-D in the Hispanic health and nutrition examination survey: The influences of ethnicity, gender and language. Soc. Sci. Med. 1989, 29, 85–94. [Google Scholar] [CrossRef]
- Simon, G.E.; VonKorff, M.; Piccinelli, M.; Fullerton, C.; Ormel, J. An international study of the relation between somatic symptoms and depression. N. Engl. J. Med. 1999, 341, 1329–1335. [Google Scholar] [CrossRef] [PubMed]
- Chentsova-Dutton, Y.E.; Ryder, A.G.; Tsai, J. Understanding depression across cultural contexts. In Handbook of Depression, 3rd ed.; Gotlib, H., Hammen, C., Eds.; Guilford Press: New York, NY, USA, 2014; pp. 337–354. [Google Scholar]
- Ma-Kellams, C. Cross-cultural differences in somatic awareness and interoceptive accuracy: A review of the literature and directions for future research. Front. Psychol. 2014, 5, 1379. [Google Scholar] [CrossRef] [Green Version]
- Triandis, H.C. Individualism and Collectivism; Westview Press: Boulder, CO, USA, 1995. [Google Scholar]
- Ryder, A.G.; Yang, J.; Zhu, X.; Yao, S.; Yi, J.; Heine, S.J.; Bagby, R.M. The cultural shaping of depression: Somatic symptoms in China, psychological symptoms in North America? J. Abnorm. Psychol. 2008, 117, 300–313. [Google Scholar] [CrossRef] [PubMed]
- Dere, J.; Sun, S.; Zhao, Y.; Persson, T.J.; Zhu, X.; Yao, S.; Bagby, M.R.; Ryder, A.G. Beyond “somatization” and “psychologization”: Symptom-level variation in depressed Han Chinese and Euro-Canadian outpatients. Front. Psychol. 2013, 4, 377. [Google Scholar] [CrossRef] [Green Version]
- Kato, T. Relationship between coping with interpersonal stressors and depressive symptoms in the United States, Australia, and China: A focus on reassessing coping. PLoS ONE 2014, 9, e109644. [Google Scholar] [CrossRef] [Green Version]
- Kato, T. Testing of the coping flexibility hypothesis based on the dual-process theory: Relationships between coping flexibility and depressive symptoms. Psychiatry Res. 2015, 230, 137–142. [Google Scholar] [CrossRef]
- Kato, T. Psychological inflexibility and depressive symptoms among Asian English speakers: A study on Indian, Philippine, and Singaporean samples. Psychiatry Res. 2016, 238, 1–7. [Google Scholar] [CrossRef]
- Herman, S.; Archambeau, O.G.; Deliramich, A.N.; Kim, B.S.K.; Chiu, P.H.; Frueh, B.C. Depressive symptoms and mental health treatment in an ethnoracially diverse college student sample. J. Am. Coll. Health 2011, 59, 715–720. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chong, S.A.; Subramaniam, M.; Chan, Y.H.; Chua, H.C.; Liow, P.H.; Pek, E.; Stahl, D.; Verma, S.; Sum, C.F. Depressive symptoms and diabetes mellitus in an Asian multiracial population. Asian J. Psychiatr. 2009, 2, 66–70. [Google Scholar] [CrossRef] [PubMed]
- Stahl, D.; Sum, C.F.; Lum, S.S.; Liow, P.H.; Chan, Y.H.; Verma, S.; Chua, H.C.; Chong, S.A. Screening for depressive symptoms: Validation of the center for epidemiologic studies depression scale (CES-D) in a multiethnic group of patients with diabetes in Singapore. Diabetes Care 2008, 31, 1118–1119. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Cuijpers, P.; Bolujit, P.; van Straten, A. Screening of depression in adolescents through the Internet: Sensitivity and specificity of two screening questionnaires. Eur. Child Adolesc. Psychiatry 2008, 17, 32–38. [Google Scholar] [CrossRef] [PubMed]
- Leykin, Y.; Torres, L.D.; Aguilera, A.; Muñoz, R.F. Factor structure of the CES-D in a sample of Spanish- and English-speaking smokers on the internet. Psychiatry Res. 2011, 185, 269–274. [Google Scholar] [CrossRef] [Green Version]
- Tanaka, J.S. Multifaceted conceptions of fit in structural equation models. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 10–39. [Google Scholar]
- Chen, F.F. Sensitivity of goodness of fit indices to lack of measurement invariance. Struct. Equ. Model. 2007, 14, 464–504. [Google Scholar] [CrossRef]
- Rosay, A.B.; Gottfredson, D.C.; Armstrong, T.A.; Harmon, M.A. Invariance of measures of prevention program effectiveness: A replication. J. Quant. Criminol. 2000, 16, 341–367. [Google Scholar] [CrossRef]
- Steenkamp, J.E.M.; Baumgartner, H. Assessing measurement invariance in cross-national consumer research. J. Consum. Res. 1998, 25, 78–90. [Google Scholar] [CrossRef] [Green Version]
- Leu, J.; Wang, J.; Koo, K. Are positive emotions just as “positive” across cultures? Emotion 2011, 11, 994–999. [Google Scholar] [CrossRef]
- Patel, V.; Pereira, J.; Mann, A.H. Somatic and psychological models of common mental disorder in primary care in India. Psychol. Med. 1998, 28, 135–143. [Google Scholar] [CrossRef]
- Kongsved, S.M.; Basnov, M.; Holm-Christensen, K.; Hjollund, N.H. Response rate and completeness of questionnaires: A randomized study of Internet versus paper- and-pencil versions. J. Med. Internet Res. 2007, 9, e25. [Google Scholar] [CrossRef]
- Putnick, D.L.; Bornstein, M.H. Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Dev. Rev. 2016, 41, 71–90. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- World Health Organization. The World Health Report 2001: Mental Health: New Understanding, New Hope; World Health Organization: Geneva, Switzerland, 2001. [Google Scholar]
Characteristic | American | Australian | Indian | Filipino | Singaporean |
---|---|---|---|---|---|
N | 393 | 425 | 223 | 286 | 279 |
Mean age | 47.2 | 47.4 | 39.4 | 36.0 | 36.1 |
SD | 15.3 | 14.4 | 11.1 | 11.5 | 10.5 |
Women (%) | 51.1 | 53.9 | 50.2 | 50.3 | 49.5 |
Married (%) | 54.5 | 53.9 | 70.4 | 46.2 | 45.5 |
Never married (%) | 26.5 | 30.6 | 28.4 | 50.7 | 52.3 |
Divorced/separated/widowed (%) | 19.1 | 15.5 | 1.3 | 3.1 | 2.2 |
Ethnic group (%) | White (100) | White (100) | Punjabi (17.0) Tamil (14.8) Gujarati (14.3) Bengali (13.5) Marathi (13.5) Telugu (12.6) Kannada (8.5) Malayali (5.8) | Filipino (98.3) Half Filipino (1.7) | Chinese (95.0) Malay (5.0) |
Item | American | Australian | Indian | Filipino | Singaporean | |
---|---|---|---|---|---|---|
n | 393 | 425 | 223 | 286 | 279 | |
Somatic Complaints | ||||||
1 | Bothered | 0.64 | 0.63 | 0.98 | 0.75 | 0.71 |
2 | Appetite | 0.58 | 0.50 | 0.91 | 0.51 | 0.57 |
5 | Mind | 0.81 | 0.74 | 1.08 | 0.94 | 0.79 |
7 | Effort | 0.91 | 0.84 | 1.32 | 1.34 | 1.20 |
11 | Sleep | 1.02 | 1.10 | 1.01 | 0.82 | 0.86 |
13 | Talk | 0.76 | 0.75 | 1.23 | 0.98 | 0.89 |
20 | Get going | 0.75 | 0.79 | 0.91 | 0.64 | 0.76 |
Total | 5.47 | 5.34 | 7.44 | 5.98 | 5.79 | |
SD | 4.52 | 4.50 | 4.69 | 4.32 | 4.58 | |
α | 0.83 | 0.84 | 0.81 | 0.81 | 0.85 | |
Depressed Affect | ||||||
3 | Blues | 0.78 | 0.66 | 1.02 | 0.76 | 0.73 |
6 | Depressed | 0.83 | 0.68 | 1.03 | 0.85 | 0.80 |
9 | Failure | 0.66 | 0.48 | 0.93 | 0.70 | 0.78 |
10 | Fearful | 0.65 | 0.43 | 1.00 | 0.80 | 0.75 |
14 | Lonely | 0.79 | 0.64 | 1.03 | 0.88 | 0.87 |
17 | Cry | 0.47 | 0.35 | 0.84 | 0.63 | 0.53 |
18 | Sad | 0.78 | 0.61 | 0.96 | 0.92 | 0.77 |
Total | 4.97 | 3.86 | 6.80 | 5.53 | 5.25 | |
SD | 5.28 | 4.70 | 5.24 | 5.02 | 5.17 | |
α | 0.91 | 0.90 | 0.88 | 0.92 | 0.91 | |
(Low) Positive Affect | ||||||
4 | Good | 1.28 | 1.30 | 1.50 | 1.65 | 1.68 |
8 | Hopeful | 1.41 | 1.48 | 1.26 | 1.12 | 1.65 |
12 | Happy | 1.22 | 1.18 | 1.16 | 1.09 | 1.47 |
16 | Enjoy | 1.22 | 1.18 | 1.16 | 0.95 | 1.56 |
Total | 5.13 | 5.15 | 5.08 | 4.82 | 6.37 | |
SD | 3.60 | 3.63 | 3.05 | 2.86 | 3.21 | |
α | 0.83 | 0.85 | 0.70 | 0.68 | 0.80 | |
Interpersonal Problems | ||||||
15 | Unfriendly | 0.57 | 0.37 | 0.89 | 0.59 | 0.66 |
19 | Dislike | 0.58 | 0.49 | 0.83 | 0.72 | 0.67 |
Total | 1.15 | 0.86 | 1.72 | 1.31 | 1.33 | |
SD | 1.52 | 1.29 | 1.73 | 1.59 | 1.53 | |
α | 0.71 | 0.63 | 0.72 | 0.76 | 0.77 | |
CES-D Total Score | ||||||
Mean | 16.72 | 15.20 | 21.04 | 17.65 | 18.73 | |
SD | 12.55 | 11.72 | 11.08 | 10.78 | 11.40 | |
α | 0.93 | 0.92 | 0.88 | 0.90 | 0.91 |
Model | χ2 | df | ECVI | 90% CI | CFI | SRMR | RMSEA |
---|---|---|---|---|---|---|---|
White American (n = 394) | |||||||
One-factor | 894.04 | 170 | 2.59 | 2.36–2.84 | 0.83 | 0.079 | 0.104 |
Two-factor | 497.76 | 169 | 1.48 | 1.32–1.66 | 0.92 | 0.051 | 0.070 |
Three-factor | 474.02 | 167 | 1.43 | 1.27–1.60 | 0.93 | 0.049 | 0.068 |
Four-factor | 414.15 | 164 | 1.39 | 1.25–1.56 | 0.94 | 0.043 | 0.062 |
White Australian (n = 425) | |||||||
One-factor | 1031.89 | 170 | 2.72 | 2.49–2.96 | 0.81 | 0.082 | 0.109 |
Two-factor | 485.44 | 169 | 1.34 | 1.19–1.50 | 0.93 | 0.045 | 0.066 |
Three-factor | 470.88 | 167 | 1.31 | 1.17–1.48 | 0.93 | 0.044 | 0.066 |
Four-factor | 416.79 | 164 | 1.29 | 1.16–1.45 | 0.94 | 0.042 | 0.060 |
Indian (n = 223) | |||||||
One-factor | 571.29 | 170 | 3.11 | 2.80–3.46 | 0.80 | 0.092 | 0.103 |
Two-factor | 394.81 | 169 | 2.15 | 1.90–2.43 | 0.89 | 0.079 | 0.078 |
Three-factor | 393.34 | 167 | 2.16 | 1.92–2.44 | 0.89 | 0.079 | 0.078 |
Four-factor | 379.63 | 164 | 2.31 | 2.07–2.58 | 0.90 | 0.077 | 0.077 |
Filipino (n = 286) | |||||||
One-factor | 701.00 | 170 | 2.88 | 2.61–3.18 | 0.81 | 0.083 | 0.105 |
Two-factor | 505.69 | 169 | 2.20 | 1.98–2.45 | 0.88 | 0.080 | 0.084 |
Three-factor | 483.59 | 167 | 2.14 | 1.92–2.38 | 0.89 | 0.080 | 0.082 |
Four-factor | 456.62 | 164 | 2.07 | 1.86–2.30 | 0.90 | 0.078 | 0.079 |
Singaporean (n = 279) | |||||||
One-factor | 833.55 | 170 | 3.43 | 3.12–3.77 | 0.79 | 0.102 | 0.118 |
Two-factor | 498.01 | 169 | 2.23 | 2.00–2.49 | 0.90 | 0.071 | 0.084 |
Three-factor | 475.27 | 167 | 2.16 | 1.94–2.41 | 0.90 | 0.069 | 0.080 |
Four-factor | 465.90 | 164 | 2.15 | 1.93–2.40 | 0.91 | 0.068 | 0.080 |
Model | χ2 | df | CFI | SRMR | RMSEA | Δχ2 | Δdf | Δχ2/Δdf | ΔCFI | ΔSRMR | ΔRMSEA |
---|---|---|---|---|---|---|---|---|---|---|---|
Configural invariance | 2133.45 | 820 | 0.920 | 0.039 | 0.032 | ||||||
Metric invariance | 2350.56 | 884 | 0.911 | 0.046 | 0.032 | 217.10 | 64 | 3.39 | 0.009 | 0.007 | 0.001 |
Scalar invariance | 2851.04 | 964 | 0.885 | 0.046 | 0.035 | 717.59 | 144 | 4.98 | 0.035 | 0.007 | 0.003 |
Partial scalar invariance | 2405.99 | 896 | 0.910 | 0.048 | 0.032 | 272.54 | 76 | 3.59 | 0.010 | 0.009 | 0.001 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kato, T. Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians. Int. J. Environ. Res. Public Health 2021, 18, 5298. https://doi.org/10.3390/ijerph18105298
Kato T. Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians. International Journal of Environmental Research and Public Health. 2021; 18(10):5298. https://doi.org/10.3390/ijerph18105298
Chicago/Turabian StyleKato, Tsukasa. 2021. "Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians" International Journal of Environmental Research and Public Health 18, no. 10: 5298. https://doi.org/10.3390/ijerph18105298
APA StyleKato, T. (2021). Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians. International Journal of Environmental Research and Public Health, 18(10), 5298. https://doi.org/10.3390/ijerph18105298