Next Article in Journal / Special Issue
The Mediating Role of School and Sibling Bullying in the Relationship between Subjective Well-Being and Mental Health Symptoms
Previous Article in Journal
Parental Attitudes and Beliefs toward Attention Deficit Hyperactivity Disorder in Prince Sultan Military Medical City, Riyadh City
Previous Article in Special Issue
US Nurses’ Challenges with Personal Protective Equipment during COVID-19: Interview Findings from the Frontline Workforce
 
 
Please note that, as of 22 March 2024, Psych has been renamed to Psychology International and is now published here.
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Psychometric Properties of the Short Form-36 (SF-36) in Parents of Children with Mental Illness

School of Public Health Sciences, University of Waterloo, Waterloo, ON N2L 3G1, Canada
*
Author to whom correspondence should be addressed.
Psych 2022, 4(2), 247-257; https://doi.org/10.3390/psych4020021
Submission received: 24 March 2022 / Revised: 6 May 2022 / Accepted: 10 May 2022 / Published: 12 May 2022
(This article belongs to the Special Issue Prominent Papers in Psych  2021–2023!)

Abstract

:
Given the stressful experiences of parenting children with mental illness, researchers and health professionals must ensure that the health-related quality of life of these vulnerable parents is measured with sufficient validity and reliability. This study examined the psychometric properties of the SF-36 in parents of children with mental illness. The data come from 99 parents whose children were currently receiving mental health services. The correlated two-factor structure of the SF-36 was replicated. Internal consistencies were robust (α > 0.80) for all but three subscales (General Health, Vitality, Mental Health). Inter-subscale and component correlations were strong. Correlations with parental psychopathology ranged from r = −0.32 to −0.60 for the physical component and r = −0.39 to −0.75 for the mental component. Parents with clinically relevant psychopathology had significantly worse SF-36 scores. SF-36 scores were inversely associated with the number of child diagnoses. The SF-36 showed evidence of validity and reliability as a measure of health-related quality of life in parents of children with mental illness and may be used as a potential outcome in the evaluation of family-centered approaches to care within child psychiatry. Given the relatively small sample size of this study, research should continue to examine its psychometric properties in more diverse samples of caregivers.

1. Introduction

Parents whose children have a mental illness report compromised health-related quality of life (HRQL) and more caregiver strain or psychological stress [1,2]. Because epidemiological studies show that 20% of children have a mental illness [3,4], there is a large proportion of parents with, or at risk for, poor HRQL. Meta-analytic evidence suggests that parents of children with mental illness have significantly worse HRQL compared to parents of healthy children and population norms [1]. Notably, this effect was moderated by child age—parents of older children with mental illness had worse HRQL compared to parents of younger children with mental illness. Understanding the contextual effects that contribute to compromised HRQL is important, because parents of children with mental illness take leading roles in caregiving, seeking and obtaining professional health services, and supporting the overall functioning of the family [5,6]. There are negative consequences for children with mental illness and families when the HRQL of their parents is compromised [7,8]. Addressing key questions of whether, why, and how parents are affected by caring for a child with mental illness can help direct resources and treatment programming using family-centered care frameworks within child and adolescent psychiatry.
However, given the unique, and often stressful, experiences of parenting children with mental illness, researchers and health professionals must ensure that the HRQL of these vulnerable parents is measured with sufficient validity and reliability. Such methodological work is needed so that meaningful comparisons can be made between this population of parents and parents of healthy children or parents of children with other chronic illnesses, as well as population norms to determine the extent to which child mental illness impacts parent HRQL.
The Short Form-36 (SF-36) is one of the most commonly used measures of adult HRQL [9] and has a strong track record of use among parents of children with mental illness [1]. However, no studies have assessed its psychometric properties in this population. Its pervasiveness in health research stems from the comprehensiveness of its development to conceptualize health as a multidimensional construct and to measure the range of health states, including well-being and individual perceptions of health. The SF-36 includes 36 items that measure eight health-related concepts or subscales: Physical Functioning (ability to perform physical activities), Role-physical (problems with activities as a result of physical health), Bodily Pain (level of pain/limitations), General Health (perception of overall health), Vitality (feelings of energy and fatigue), Social Functioning (ability to perform social activities), Mental Health (feelings related to internalizing problems), and Role-emotional (problems with activities as a result of mental/emotional health). These subscales define physical and mental summary component scores that accounted for approximately 80% of the variance in the SF-36 in the samples used in its initial development [10,11,12]. Further, these component scores have proved useful in interpreting HRQL [10,11,12]. Substantial evidence supports this two-factor structure of the SF-36, whereby the eight subscales (manifest variables) load onto the physical and mental summary components (latent variables), as well as indicators of its construct validity and reliability (i.e., internal consistency), in the general population [13,14], and in specific subpopulations of adults including pregnant women [15], those with chronic physical illnesses [16] and their caregivers [17], and the elderly [18].
This study assessed the psychometric properties of the SF-36 in a sample of parents whose children have mental illness. Specifically, our objectives were to replicate the two-factor structure of the SF-36 (eight subscales loading onto the two summary components); examine internal consistency of the SF-36 and inter-subscale correlations; and, investigate construct validity of the SF-36 with self-reported measures of psychopathology (depression, anxiety, parental stress) and child diagnoses of mental illness. It was anticipated that a two-factor (physical and mental) correlated structure would be confirmed and that based on our sample size and number of items in each subscale, internal consistency reliabilities of the SF-36 would be “good” (α ≥ 0.70) [19]. We did not expect to find age or sex differences in SF-36 scores in our sample of parents. Furthermore, it was expected that correlations with measures of psychopathology would be statistically significant and at least small in magnitude (r ≥ 0.20) and larger for the mental versus the physical component score. We hypothesized that significantly lower SF-36 scores would be found in parents with clinically relevant symptoms of depression or anxiety and that parent SF-36 scores would be inversely associated with the number of mental illness diagnoses in their children in a dose–response manner.

2. Materials and Methods

2.1. Sample

This is a secondary data analysis of a previously reported cross-sectional study of children who were currently receiving inpatient or outpatient mental health services at a pediatric hospital in Canada [20]. The inclusion criteria for the study were children who were 4–17 years of age, who spoke and understood English, and had a parent/caregiver with adequate English skills to complete the data collection interview and questionnaires. Children were excluded if their mental state prevented completion of the interview and questionnaires; examples included currently experiencing a psychotic episode or exhibiting violent/aggressive behavior which could put the child or research staff at harm. A total of 100 parents agreed to participate in the study; however, one parent did not complete the study interview. Thus, the sample available for analysis was n = 99.
Research staff worked alongside nurses within the mental health program to identify eligible children. Those interested in participating were referred to research staff who introduced the study to children and sought permission to contact their parents to obtain initial oral consent for participation. Research staff scheduled data collection interviews in a study room at the hospital for inpatients or at our research office for outpatients. Clinic rosters were also used to identify eligible children. These rosters included the contact information for families receiving mental health services who agreed to be contacted about research studies. Telephone contact was made with these parents to confirm eligibility and participation in the study. Interview and questionnaire data were collected electronically using laptops in an effort to minimize missing data.
Children were screened for current mental illness by trained research staff using the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID)—a structured diagnostic interview for children aged < 18 years that is aligned with mental illness according to the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) and the International Statistical Classification of Diseases and Related Health Problems (ICD-10) [21]. Screening was completed for major depressive episode, generalized anxiety disorder, separation anxiety disorder, phobia (generalized or non-generalized), attention-deficit hyperactivity disorder, and oppositional defiant/conduct disorder, which represent the most common mental illnesses affecting children [3]. The MINI-KID has excellent psychometric properties [22,23,24].
Parents provided informed written consent for themselves and all participating children. Children aged 8–15 years provided informed written assent and children 15–17 years provided informed written consent in conjunction with parental consent. Ethical approval was obtained from the Hamilton Integrated Research Ethics Board.

2.2. Measures

The SF-36 measures HRQL in the past four-week period across eight subscales and yields two component scores—physical and mental [9,10,11,12]. The Physical component score comprises the Physical Functioning (10 items), Role-physical (4 items), Bodily Pain (2 items), and General Health (5 items) subscales. The Mental component score comprises the Vitality (4 items), Social Functioning (2 items), Mental Health (5 items), and Role-emotional (3 items) subscales. Each subscale is scored using the Likert method of summated ratings (0–100), with higher scores indicating better HRQL. An additional item (not scored), asks individuals to assess their current health relative to one year prior. Mean scores for each subscale are computed. T scores with a mean of 50 and standard deviation (SD) of 10 are computed for the physical and mental component scores. These T scores are based on the sum of weighted z-transformed subscale scores computed using population norms [25]. Internal consistencies of the SF-36 subscales have been reported to be 0.78–0.93 in the general population [10]. The SF-36 can be viewed at https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form.html (accessed on 18 January 2021).
Symptoms of depression were measured using the Center for Epidemiological Studies Depression scale (CESD) [26]. The scale includes 20 items that assesses depressed affect (7 items), positive affect (4 items), somatic activity (7 items), and interpersonal relations (2 items) during the past seven-day period. A four-point Likert response scale (0–3) is used to measure frequency of symptoms experienced ranging from “rarely or none of the time (less than 1 day)” to “most or all of the time (5–7 days).” Total scores range from 0–60, with higher scores indicating greater symptomatology or impairment. Individuals with CESD scores ≥ 16 are considered to have clinically relevant symptoms of depression [26,27]. The CESD has been validated in parents [28], including parents whose children have a chronic illness [29]. The internal consistency of the CESD in our study was α = 0.86.
Symptoms of anxiety were measured using the State-Trait Anxiety Inventory (STAI), which provides an assessment of how individuals generally feel, as well as their propensity for perceived anxiety [30]. Of the 40 items in the STAI, only the 20 items related to trait anxiety were used in our study. The STAI has been shown to assess both negative (9 items) and positive affect (11 items) [31]. Responses were scored on a four-point Likert scale (1–4) from “Almost never” to “Almost always” and summed. Scores range from 20–80, with higher scores indicating greater levels of anxiety. Individuals with STAI scores ≥ 39 are considered to have clinically relevant symptoms of anxiety [30,32]. The STAI has robust psychometric properties [30] and has been used to measure symptoms of anxiety in parents of children with mental illness [32]. The internal consistency of the STAI in our study was α = 0.72.
Parental stress was measured using the Parental Stress Scale (PSS). The PSS is an 18-item measure that assesses the positive and negative experiences of parenting across the domains of rewards (6 items), satisfaction (3 items), stressors (6 items), and loss of control (3 items) [33]. Response options are based on a five-point Likert scale (1–5) and range from “strongly disagree” to “strongly agree”. After adjusting eight reverse-coded items, scores are summed to provide a total composite score ranging from 18–90. Higher scores indicate more symptoms of parental stress. The PSS has undergone psychometric assessment in various populations, and has a track record of use in parents of children with chronic illnesses [34,35]. The internal consistency of the PSS in our study was α = 0.85.

2.3. Analysis

We used confirmatory factor analysis using maximum likelihood with robust standard errors along with the Huber–White sandwich estimator to account for the non-normality of manifest variables in modelling the SF-36 factor structure [36]. We defined adequate model fit using the following established thresholds: χ2 goodness-of-fit p > 0.05; Comparative Fit Index (CFI) ≥ 0.90; Standardized Root Mean Residual (SRMR) ≤ 0.08; and, Root Mean Square Error of Approximation (RMSEA) ≤ 0.06 [37]. Following previous reports [34,38,39,40], if at least two indices met their respective thresholds, model fit was determined to be adequate. If inadequate fit was found, we reviewed modification indices to identify opportunities to improve the model. On account of the relatively small sample size and aligned with previous research [13,14,15,16,17,18], we modelled the eight SF-36 subscales as manifest variables and conducted Monte Carlo simulations to estimate the statistical power in modelling the two-factor structure of the SF-36 (i.e., the most complex model tested with a sample size to item ratio of 99:10, whereby the 10 items represent the eight subscales loading onto the two summary scores) [41]. We set standardized factor loadings to range from λ = 0.65–0.70 (conservative estimates based on previous reports) and statistical power was estimated to be 1-β = 0.75–0.84.
We estimated correlations among SF-36 subscales and component scores using Pearson coefficients. We also used Pearson coefficients to examine discrepant validity of the SF-36 with parent age and convergent validity with the CESD, STAI, and PSS. To determine if correlations were stronger for the mental component score versus the physical component score, we used the method of variance estimates recovery [42]. Discrepant validity was also tested by comparing SF-36 scores by parent sex (t test). Additional convergent validity was examined by categorizing our sample of parents according to the cut-points on the CESD and STAI for clinically relevant symptoms of depression and anxiety, respectively, and using t tests to compare SF-36 component scores between subgroups. We conducted an analysis of variance to determine if SF-36 component scores were associated with the number of child mental illness diagnoses. All hypothesis tests were two-sided and α = 0.05. Factor analyses were conducted using Mplus 6.11; descriptive statistics, comparative tests, and validation analyses were conducted using SPSS 21.

3. Results

3.1. Sample Characteristics

Parents were, on average, 45.3 (SD 6.7) years of age and the majority were female (n = 84; 85%). Nearly two-thirds (n = 60; 61%) had a partner (i.e., married or common-law) and had completed postsecondary education (n = 65; 66%). Half of parents (n = 49) reported an annual household income of at least CAD 75,000; the median household income according to the 2016 Canadian Census. Immigrants were underrepresented in this sample of parents (n = 13; 13%).
Children had a mean age of 13.9 (3.1; range 8–17) years and 71% (n = 70) were female. Parent physical and mental component scores were not associated with child age or sex. The most common illnesses affecting children were major depression and generalized anxiety (n = 72; 73% each). The remaining diagnoses were: phobia (71%), oppositional defiant (47%), attention-deficit hyperactivity (33%), separation anxiety (32%), and conduct disorder (25%). As typical in child and adolescent psychiatry, comorbidity was prevalent: 15%, 26% and 46% of children had two, three, or four or more mental illnesses. Overall, 38 (38%) of children were recruited from the inpatient setting. While physical component scores were similar between parents of children receiving inpatient vs. outpatient services (40.64 vs. 43.81; p = 0.122), parents of inpatient children had significantly lower mental component scores to those of parents of outpatient children (35.93 vs. 40.21; p = 0.035).
Descriptive statistics for SF-36 subscale and component scores are shown in Table 1. Mean parent scores were lowest for the Role-emotional subscale [37.42 (13.25)] and highest for the Physical Functioning subscale [48.16 (11.36)].

3.2. Factor Structure

We tested three factor structures of the SF-36 and the fit indices for these models are shown in Table 2. Prior to fitting the factor models, baseline models of the physical and mental components were specified to ensure adequate fit. Both components showed adequate fit to the data, though the physical component model had lower (i.e., better) SRMR (0.06 vs. 0.08) and RMSEA (0.26 vs. 0.33) indices. The one-factor model in which all subscales were loaded onto a single HRQL factor fit the data poorly, with none of the fit indices achieving an adequate fit threshold. The two-factor model which did not specify a correlation between the physical and mental component factors also had inadequate fit to the data; again, none of the fit indices achieved an adequate fit threshold. The two-factor model which specified a correlation between the physical and mental component factors showed adequate fit to the data: CFI = 0.94 and SRMR = 0.07. It also demonstrated significantly better fit according to the χ2 difference test against the one-factor (χ2 = 79.1; p ≤ 0.001) and two-factor uncorrelated models (χ2 = 167.1; p ≤ 0.001).

3.3. Internal Consistency

Internal consistency reliabilities of the SF-36 subscales were generally robust (α > 0.80), with the exception of General Health (α = 0.65), Vitality (α = 0.59), and Mental Health (α = 0.64), which were lower that established guidelines indicating good reliability. Internal consistencies of the physical and mental components were very strong (α = 0.91 and α = 0.85, respectively). Relatedly, correlations among subscales of the SF-36 were also robust (Table 3); correlations that were statistically significant (p < 0.01) ranged from a low of r = 0.31 between General Health and Role-emotional to a high of r = 0.65 between Physical Functioning and Bodily Pain. Non-significant correlations were found between Physical Functioning and Vitality (r = 0.06), Role-emotional (r = 0.23), and Mental Health (r = 0.20). The correlation between Bodily Pain and Vitality was also not significant (r = 0.23). The correlation between the physical and mental components was very strong (r = 0.75).

3.4. Construct Validity

The SF-36 demonstrated no significant correlation with parent age for both the physical component (r = −0.08; p = 0.464) and mental component (r = −0.03; p = 0.774) scores. Further, differences between mothers and fathers were not statistically significant—physical: 45.39 (8.62) vs. 42.09 (10.09); t = 1.19; p = 0.237 and mental: 40.08 (9.34) vs. 38.30 (9.98); t = 0.64; p = 0.523.
Convergent validity of the SF-36 was tested by estimating the strength of the correlation between measures of parent psychopathology—symptoms of depression, anxiety, and parental stress—with both the physical and mental component scores (Table 4). Correlations were all statistically significant (p < 0.001) and generally medium-sized in magnitude. While correlations were larger with the mental component score, the differences were not statistically significant compared to the physical component score. Using established thresholds for the CESD and STAI, we dichotomized our sample of parents as having or not having clinically relevant symptoms of depression or anxiety to determine if SF-36 scores would be different between these groups of parents. As shown in Table 5, parents with elevated CESD or STAI scores had significantly lower physical and mental component scores.
We then tested the extent to which SF-36 component scores in parents were associated with the number of mental illness diagnoses in children (Table 6). Both physical and mental component scores decreased significantly with increases in the number of child diagnoses (F = 7.68; p < 0.001 and F = 6.10; p = 0.001, respectively). Post hoc comparisons showed that parents of children with one mental illness had significantly higher SF-36 physical component scores compared to parents of children with three or four mental illnesses (p = 0.015 and p < 0.001, respectively). Parents of children with two diagnoses had significantly lower physical components scores compared to parents of children with four diagnoses (p = 0.026). With regard to the mental component, parents of children with one mental illness had significantly lower scores compared to parents of children with three or four mental illnesses (p = 0.038 and p = 0.001, respectively).

4. Discussion

This study aimed to replicate the factor structure of the SF-36, estimate internal consistency and inter-subscale correlations, and describe its construct validity with measures of parent psychopathology and child mental illness. Evidence from this study supported our hypothesis that the SF-36 has a correlated two-factor structure and corroborates a previous large-scale study investigating the factor structure of the SF-36 [14]. This correlation is intuitive as there is ample evidence supporting the reciprocal link between physical and mental health across the life course [43,44,45,46]. Previous studies have tested the fit of additional models that include a four-factor [47], higher-order factor [15], and bifactor [48] solutions. We did not investigate such models for two reasons. First, our sample size lacked the statistical power to reliably estimate such complex models. Second, the two component scores of the SF-36 are most commonly used in research and clinical practice [49] and that use of an overall HRQL score based on the SF-36 still warrants further validation in large-scale population studies [50].
Reliability was very strong for both the physical and mental components and most of the eight subscales. Internal consistencies were considered “moderate” for the General Health and Mental Health given the number of items for each subscale and our sample size [19]. Vitality was considered “unsatisfactory” as a large proportion of its variance, approximately 40%, was due to measurement error. Thus, in the context of parents whose children have mental illness, this subscale has limited predictive utility and should be used with caution. Our hypothesis regarding the correlations among SF-36 subscale and component scores was partially supported. All correlations were in the expected direction and magnitude. This finding provided further evidence supporting the two-factor structure of the SF-36 in this population of parents.
Discriminant validity of the SF-36 was demonstrated with similar physical and mental component scores across age and sex. Despite evidence of age and sex differences in the SF-36 among population norms [25], our null findings were expected. First, variability in the age of our sample of parents was relatively small. Second, reported age differences in population studies are small and do not necessarily reflect clinically relevant differences in HRQL [25,51]. Third, given the context in which we studied our sample—eligible parents were those who were the primary caregiver for their children—comparisons may better reflect gender role, rather than sex. Previous reports have shown that among parents of children with a chronic illness, strain and psychological distress is similar among primary caregiving fathers and primary caregiving mothers [52].
Convergent validity of the SF-36 was also demonstrated. Findings showed that the mental component of the SF-36 taps into symptoms of internalizing disorders better than generic caregiver strain. While stronger correlations were found for the mental versus physical component score, these differences were not significant and reaffirm the physical-mental health link. Similar findings were seen when comparing parents with versus without clinically relevant symptoms of psychopathology and which has been reported previously [53].
Finally, worse HRQL in parents of children with multiple mental illnesses was supported. This inverse dose–response association was linear in nature and likely reflects the challenges experienced by parents caring for a child with multiple illnesses; a common occurrence in child and adolescent psychiatry [4]. The number of comorbidities can also be a proxy for illness severity. Inverse associations between child illness severity and parent HRQL have been reported in samples of children with physical [54] and mental illnesses [55,56].

4.1. Study Implications

The findings contribute to extending the validity and reliability of the SF-36 and should provide confidence using this measure in parents of children with mental illness. Replication of its factor structure suggests that the HRQL construct is interpreted in this sample of parents in the same manner in which the SF-36 was initially developed. Thus, it can be used to make comparisons across samples and with population norms. The design of the current study did not allow for the examination of test–retest reliability and predictive validity of the SF-36. Given the uniqueness of this parent population, these important psychometric properties should be evaluated in the future studies. Additional work is needed to demonstrate that the SF-36 has clinical utility as a patient-reported outcome assessing change in HRQL. Quantifying its responsiveness to change and calibrating minimally important differences is necessary prior to implementing the SF-36 as a potential outcome in the evaluation of family-centered approaches to care within child and adolescent psychiatry. Further, given the strong correlation between the mental component score and the CESD (and to a lesser extent, the STAI), it appears as though the same underlying construct, internalizing symptoms, is being measured [57]. In conducting future studies, researchers may consider including the SF-36 to measure both HRQL and parent psychopathology in order to reduce respondent burden.

4.2. Limitations

There are notable limitations to this study. First, the relatively small sample size prevented the examination of more complex factor structures that could potentially result in a better fitting model (e.g., bifactor) and underrepresentation of immigrants [58] may limit the generalizability of the findings to this population of parents of children with mental illness. Relatedly, recruitment from a single site may not adequately reflect the broader experience of this population. Second, shared method variance may have resulted in overestimated correlations and associations. Third, the absence of a control group (i.e., parents of children without mental illness) prevented the opportunity to formally test for measurement invariance of the SF-36, further contributing to its validation in this population.

5. Conclusions

The SF-36 appears to be a valid and reliable tool to measure HRQL among parents of children with mental illness. Researchers and health professionals should continue to study its psychometric properties in larger and more diverse samples with multiple informants. Collaboration among researchers and health professionals is needed to extend the clinical utility of the SF-36 within child and adolescent psychiatry.

Author Contributions

Conceptualization and methodology, M.R., S.V.R. and M.A.F.; formal analysis, M.R. and M.A.F.; writing—original draft preparation, M.R.; writing—review and editing, S.V.R. and M.A.F.; supervision, M.A.F.; funding acquisition, M.A.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Hamilton Health Sciences, grant number NIF-14363. Ferro holds the Canada Research Chair in Youth Mental Health and is supported by an Early Researcher Award from the Ministry of Research, Innovation and Science. Reed is the recipient of the Faculty of Applied Health Sciences Graduate Scholarship and Reaume is the recipient of the Queen Elizabeth II Graduate Scholarship in Science & Technology from the Ministry of Colleges and Universities and the Toushan Award for Mental Health Research from the University of Waterloo.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Hamilton Integrated Research Ethics Board (protocol code 15-197 and date of approval 7 April 2015). for studies involving humans.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to restrictions imposed by the institutional review board.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Dey, M.; Castro, R.P.; Haug, S.; Schaub, M.P. Quality of life of parents of mentally-ill children: A systematic review and meta-analysis. Epidemiol. Psychiatr. Sci. 2019, 28, 563–577. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Green, A.L.; Kutash, K.; Ferron, J.; Levin, B.L.; Debate, R.; Baldwin, J. Understanding caregiver strain and related constructs in caregivers of youth with emotional and behavioral disorders. J. Child Fam. Stud. 2020, 29, 761–772. [Google Scholar] [CrossRef]
  3. Georgiades, K.; Duncan, L.; Wang, L.; Comeau, J.; Boyle, M.H. Six-month prevalence of mental disorders and service contacts among children and youth in Ontario: Evidence from the 2014 Ontario Child Health Study. Can. J. Psychiatry 2019, 64, 246–255. [Google Scholar] [CrossRef] [PubMed]
  4. Comeau, J.; Georgiades, K.; Duncan, L.; Wang, L.; Boyle, M.H. Changes in the prevalence of child and youth mental disorders and perceived need for professional help between 1983 and 2014: Evidence from the Ontario Child Health Study. Can. J. Psychiatry 2019, 64, 256–264. [Google Scholar] [CrossRef] [Green Version]
  5. Gopalan, G.; Goldstein, L.; Klingenstein, K.; Sicher, C.; Blake, C.; McKay, M.M. Engaging families into child mental health treatment: Updates and special considerations. J. Can. Acad. Child Adolesc. Psychiatry 2010, 19, 182–196. [Google Scholar]
  6. Souza, A.L.; Guimarães, R.A.; Vilela, D.D.; de Assis, R.M.; Oliveira, L.M.D.C.; Souza, M.R.; Nogueira, D.J.; Barbosa, M.A. Factors associated with the burden of family caregivers of patients with mental disorders: A cross-sectional study. BMC Psychiatry 2017, 17, 353. [Google Scholar] [CrossRef] [Green Version]
  7. Leng, A.; Xu, C.; Nicholas, S.; Nicholas, J.; Wang, J. Quality of life in caregivers of a family member with serious mental illness: Evidence from China. Arch. Psychiatr. Nurs. 2019, 33, 23–29. [Google Scholar] [CrossRef] [Green Version]
  8. Carbonell, A.; Navarro-Pérez, J.J.; Mestre, M.V. Challenges and barriers in mental healthcare systems and their impact on the family: A systematic integrative review. Health Soc. Care Community 2020, 28, 1366–1379. [Google Scholar] [CrossRef] [Green Version]
  9. Ware, J.E., Jr.; Snow, K.K.; Kosinski, M.; Gandek, B. SF-36 Health Survey Manual and Interpretation Guide; New England Medical Center, The Health Institute: Boston, MA, USA, 1993. [Google Scholar]
  10. McHorney, C.A.; Ware, J.E., Jr.; Lu, J.R.; Sherbourne, C.D. The MOS 36-item Short-Form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med. Care 1994, 32, 40–66. [Google Scholar] [CrossRef] [Green Version]
  11. McHorney, C.A.; Ware, J.E., Jr.; Raczek, A.E. The MOS 36-item Short-Form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med. Care 1993, 31, 247–263. [Google Scholar] [CrossRef] [Green Version]
  12. Ware, J.E., Jr.; Sherbourne, C.D. The MOS 36-item Short-Form health survey (SF-36). I. Conceptual framework and item selection. Med. Care 1992, 30, 473–483. [Google Scholar] [PubMed]
  13. Ware, J.E., Jr.; Gandek, B.; Kosinski, M.; Aaronson, N.K.; Apolone, G.; Brazier, J.; Bullinger, M.; Kaasa, S.; Leplège, A.; Prieto, L.; et al. The equivalence of SF-36 summary health scores estimated using standard and country-specific algorithms in 10 countries: Results from the IQOLA Project. International Quality of Life Assessment. J. Clin. Epidemiol. 1998, 51, 1167–1170. [Google Scholar] [CrossRef]
  14. Ware, J.E., Jr.; Kosinski, M.; Gandek, B.; Aaronson, N.K.; Apolone, G.; Bech, P.; Brazier, J.; Bullinger, M.; Kaasa, S.; Leplège, A.; et al. The factor structure of the SF-36 health survey in 10 countries: Results from the IQOLA Project. International Quality of Life Assessment. J. Clin. Epidemiol. 1998, 51, 1159–1165. [Google Scholar] [PubMed]
  15. Jomeen, J.; Martin, C.R. The factor structure of the SF-36 in early pregnancy. J. Psychosom. Res. 2005, 59, 131–138. [Google Scholar] [CrossRef]
  16. Banks, P.; Martin, C.R.; Petty, R.K.H. The factor structure of the SF-36 in adults with progressive neuromuscular disorders. J. Eval. Clin. Pract. 2012, 18, 32–36. [Google Scholar] [CrossRef]
  17. Machnicki, G.; Allegri, R.F.; Ranalli, C.G.; Serrano, C.M.; Dillon, C.; Wyrwich, K.W.; Taragano, F.E. Validity and reliability of the SF-36 administered to caregivers of patients with Alzheimer’s disease: Evidence from a South American sample. Dement. Geriatr. Cogn. Disord. 2009, 28, 206–212. [Google Scholar] [CrossRef]
  18. Lyons, R.A.; Perry, I.M.; Littlepage, B.N.C. Evidence for the validity of the Short-Form-36 questionnaire (SF-36) in an Elderly Population. Age Ageing 1994, 23, 182–184. [Google Scholar] [CrossRef]
  19. Ponterotto, J.G.; Ruckdeschel, D.E. An overview of coefficient alpha and a reliability matrix for estimating adequacy of internal consistency coefficients with psychological research measures. Percept. Mot. Ski. 2007, 105, 997–1014. [Google Scholar] [CrossRef]
  20. Ferro, M.A.; Lipman, E.L.; Van Lieshout, R.J.; Boyle, M.H.; Gorter, J.W.; MacMillan, H.L.; Georgiades, K. Mental-physical multimorbidity in youth: Associations with individual, family, and health service use outcomes. Child Psychiatry Hum. Dev. 2019, 50, 400–410. [Google Scholar] [CrossRef]
  21. Sheehan, D.V.; Sheehan, K.H.; Shytle, R.D.; Janavs, J.; Bannon, Y.; Rogers, J.E.; Milo, K.M.; Stock, S.L.; Wilkinson, B. Reliability and validity of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). J. Clin. Psychiatry 2010, 71, 313–326. [Google Scholar] [CrossRef]
  22. Boyle, M.H.; Duncan, L.; Georgiades, K.; Bennett, K.; Gonzalez, A.; Van Lieshout, R.J.; Szatmari, P.; MacMillan, H.L.; Kata, A.; Ferro, M.A.; et al. Classifying child and adolescent psychiatric disorder by problem checklists and standardized interviews. Int. J. Methods Psychiatr. Res. 2017, 26, e1544. [Google Scholar] [CrossRef] [PubMed]
  23. Duncan, L.; Georgiades, K.; Wang, L.; Van Lieshout, R.J.; MacMillan, H.L.; Ferro, M.A.; Lipman, E.L.; Szatmari, P.; Bennett, K.; Kata, A.; et al. Psychometric evaluation of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Psychol. Assess 2018, 30, 916–928. [Google Scholar] [CrossRef] [PubMed]
  24. McDonald, E.; Whitney, S.; Horricks, L.; Lipman, E.L.; Ferro, M.A. Parent-child agreement on the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). J. Can. Acad. Child Adolesc. Psychiatry 2021, 30, 264–272. [Google Scholar] [PubMed]
  25. Hopman, W.M.; Towheed, T.; Anastassiades, T.; Tenenhouse, A.; Poliquin, S.; Berger, C.; Joseph, L.; Brown, J.P.; Murray, T.M.; Adachi, J.D.; et al. Canadian normative data for the SF-36 health survey. Canadian Multicentre Osteoporosis Study Research Group. CMAJ 2000, 163, 265–271. [Google Scholar]
  26. Radloff, L.S. The CES-D scale: A self-report depression scale for research in the general population. Appl. Psychol. Meas. 1977, 1, 385–401. [Google Scholar] [CrossRef]
  27. Ferro, M.A.; Speechley, K.N. Examining clinically relevant levels of depressive symptoms in mothers following a diagnosis of epilepsy in their children: A prospective analysis. Soc. Psychiatry Psychiatr. Epidemiol. 2012, 47, 1419–1428. [Google Scholar] [CrossRef]
  28. Shafer, A.B. Meta-analysis of the factor structures of four depression questionnaires: Beck, CES-D, Hamilton, and Zung. J. Clin. Psychol. 2006, 62, 123–146. [Google Scholar] [CrossRef]
  29. Ferro, M.A.; Speechley, K.N. Factor structure and longitudinal invariance of the Center for Epidemiological Studies Depression Scale (CES-D) in adult women: Application in a population-based sample of mothers of children with epilepsy. Arch. Womens Ment. Health 2013, 16, 159–166. [Google Scholar] [CrossRef]
  30. Spielberger, C.D. State-Trait Anxiety Inventory for Adults; Mind Garden Inc.: Menlo Park, CA, USA, 1983. [Google Scholar]
  31. Balsamo, M.; Romanelli, R.; Innamorati, M.; Ciccarese, G.; Carlucci, L.; Saggino, A. The State-Trait Anxiety Inventory: Shadows and lights on its construct validity. J. Psychopathol. Behav. Assess. 2013, 35, 475–486. [Google Scholar] [CrossRef]
  32. Oltean, I.I.; Ferro, M.A. Agreement of child and parent-proxy reported health-related quality of life in children with mental disorder. Qual. Life Res. 2019, 28, 703–712. [Google Scholar] [CrossRef]
  33. Berry, J.O.; Jones, W.H. The Parental Stress Scale: Initial psychometric evidence. J. Soc. Pers. Relation. 1995, 12, 463–472. [Google Scholar] [CrossRef]
  34. Zelman, J.J.; Ferro, M.A. Psychometric properties of the Parental Stress Scale in families of children with chronic physical conditions. Fam Relat. 2018, 67, 240–252. [Google Scholar] [CrossRef]
  35. Ferro, M.A.; Lipman, E.L.; Van Lieshout, R.J.; Gorter, J.W.; Shanahan, L.; Boyle, M.; Georgiades, K.; Timmons, B. Multimorbidity in children and youth across the life-course (MY LIFE): Protocol of a Canadian prospective study. BMJ Open 2019, 9, e034544. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Li, C.H. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav. Res. Methods 2016, 48, 936–949. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Brown, T.A. Methodology in the social sciences. In Confirmatory Factor Analysis for Applied Research, 2nd ed.; Little., T.D., Ed.; The Guilford Press: New York, NY, USA, 2015. [Google Scholar]
  38. Ferro, M.A.; Boyle, M.H. Longitudinal invariance of measurement and structure of global self-concept: A population-based study examining trajectories among adolescents with and without chronic illness. J. Pediatr. Psychol. 2013, 38, 425–437. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Ferro, M.A.; Landgraf, J.M.; Speechley, K.N. Factor structure of the Child Health Questionnaire Parent Form-50 and predictors of health-related quality of life in children with epilepsy. Qual. Life Res. 2013, 22, 2201–2211. [Google Scholar] [CrossRef]
  40. Dol, M.; McDonald, E.; Ferro, M.A. Psychometric properties of the CESD, STAI-T, and PSS among parents of children with mental illness. J. Fam. Stud. 2020. [Google Scholar] [CrossRef]
  41. Wolf, E.J.; Harrington, K.M.; Clark, S.L.; Miller, M.W. Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educ. Psychol. Meas. 2013, 73, 913–934. [Google Scholar] [CrossRef]
  42. Zou, G.Y.; Donner, A. Construction of confidence limits about effect measures: A general approach. Stat. Med. 2008, 27, 1693–1702. [Google Scholar] [CrossRef]
  43. Barnett, K.; Mercer, S.W.; Norbury, M.; Watt, G.; Wyke, S.; Guthrie, B. Epidemiology of multimorbidity and implications for health care, research, and medical education: A cross-sectional study. Lancet 2012, 380, 37–43. [Google Scholar] [CrossRef] [Green Version]
  44. Coste, J.; Valderas, J.M.; Carcaillon-Bentata, L. The epidemiology of multimorbidity in France: Variations by gender, age and socioeconomic factors, and implications for surveillance and prevention. PLoS ONE 2022, 17, e0265842. [Google Scholar] [CrossRef] [PubMed]
  45. Hanlon, P.; Jani, B.D.; Nicholl, B.; Lewsey, J.; McAllister, D.A.; Mair, F.S. Associations between multimorbidity and adverse health outcomes in UK Biobank and the SAIL Databank: A comparison of longitudinal cohort studies. PLoS Med. 2022, 19, e1003931. [Google Scholar] [CrossRef] [PubMed]
  46. Ferro, M.A.; Qureshi, S.; Van Lieshout, R.J.; Lipman, E.L.; Georgiades, K.; Gorter, J.W.; Timmons, B.W.; Shanahan, L. Prevalence and correlates of physical-mental multimorbidity in outpatient children from a pediatric hospital in Canada. Can. J. Psychiatry 2022. [Google Scholar] [CrossRef] [PubMed]
  47. Aguirre, S.I.; Ornelas, M.; Blanco, H.; Jurado-García, P.J.; Benavides, E.V.; Rodríguez-Villalobos, J.M.; Jiménez-Lira, C.; Blanco, J.R. Quality of life in Mexican older adults: Factor structure of the SF-36 questionnaire. Healthcare 2022, 10, 200. [Google Scholar] [CrossRef]
  48. Pass, K.N. Bifactor S-1 structure of the SF-36 quality of life scale in a diabetes sample. In Department of Psychology; Washington State University: Pullman, DC, USA, 2022. [Google Scholar]
  49. Farivar, S.S.; Cunningham, W.E.; Hays, R.D. Correlated physical and mental health summary scores for the SF-36 and SF-12 Health Survey, V.I. Health Qual. Life Outcomes 2007, 5, 54. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Keller, S.D.; Ware, J.E., Jr.; Bentler, P.M.; Aaronson, N.K.; Alonso, J.; Apolone, G.; Bjorner, J.B.; Brazier, J.; Bullinger, M.; Kaasa, S.; et al. Use of structural equation modeling to test the construct validity of the SF-36 health survey in ten countries: Results from the IQOLA Project. International Quality of Life Assessment. J. Clin. Epidemiol. 1998, 51, 1179–1188. [Google Scholar]
  51. Hopman, W.M.; Berger, C.; Joseph, L.; Towheed, T.; Prior, J.C.; Anastassiades, T.; Poliquin, S.; Zhou, W.; Adachi, J.D.; Hanley, D.A.; et al. Health-related quality of life in Canadian adolescents and young adults: Normative data using the SF-36. Can. J. Public Health 2009, 100, 449–452. [Google Scholar] [CrossRef]
  52. Ferro, M.A.; Speechley, K.N. What about dads? An exploratory analysis of depressive symptoms in paternal primary caregivers of children with epilepsy. Epilepsy Behav. 2012, 23, 90–91. [Google Scholar]
  53. Brenes, G.A. Anxiety, depression, and quality of life in primary care patients. Prim. Care Companion J. Clin. Psychiatry 2007, 9, 437–443. [Google Scholar] [CrossRef]
  54. Putterman, E.; Patel, D.P.; Andrade, G.; Harfmann, K.L.; Hogeling, M.; Cheng, C.E.; Goh, C.; Rogers, R.S.; Castelo-Soccio, L. Severity of disease and quality of life in parents of children with alopecia areata, totalis, and universalis: A prospective, cross-sectional study. J. Am. Acad. Dermatol. 2019, 80, 1389–1394. [Google Scholar] [CrossRef]
  55. Lee, P.C.; Lee, T.C.; Chen, V.C.H.; Chen, M.L.; Shih, D.H.; Shao, W.C.; Lee, M.C. Quality of life in mothers of children with oppositional defiant symptoms: A community sample. Ment. Health Fam. Med. 2010, 7, 93–100. [Google Scholar] [PubMed]
  56. Allik, H.; Larsson, J.O.; Smedje, H. Health-related quality of life in parents of school-age children with Asperger syndrome or high-functioning autism. Health Qual. Life Outcomes 2006, 4, 1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. Streiner, D.L.; Norman, G.R.; Cairney, J. Health Measurement Scales: A Practical Guide to Their Development and Use; Oxford University Press: New York, NY, USA, 2008. [Google Scholar]
  58. Statistics Canada. 2016 Census Topic: Immigration and Ethnocultural Diversity. 2017. Available online: https://www12.statcan.gc.ca/census-recensement/2016/rt-td/imm-eng.cfm (accessed on 22 April 2022).
Table 1. Descriptive statistics of the SF-36 subscales and component scores.
Table 1. Descriptive statistics of the SF-36 subscales and component scores.
SubscaleMinimumMaximumMeanSD
Physical functioning7.1057.1048.1611.36
Role-physical25.2755.3942.3112.62
Bodily pain17.1360.6146.6410.55
General health23.4562.9943.599.09
Vitality19.0060.6739.8510.10
Social functioning6.4656.9739.0513.64
Role-emotional23.5055.0537.4213.25
Mental health15.0362.0940.0910.52
Physical component18.4559.3042.599.91
Mental component16.4358.1438.579.86
Table 2. Fit indices for component scores and alternate factor models of the SF-36.
Table 2. Fit indices for component scores and alternate factor models of the SF-36.
Modelχ2 (df)pCFISRMRRMSEA (90% CI)
Physical component score8.87 (2)0.0120.900.060.26 (0.10, 0.45)
Mental component score13.08 (2)0.0010.900.080.33 (0.17, 0.52)
One-factor81.23 (20)<0.0010.830.140.25 (0.19, 0.30)
Two-factor, uncorrelated218.92 (20)<0.0010.460.370.45 (0.39, 0.50)
Two-factor, correlated39.11 (19)0.0040.940.070.16 (0.09, 0.23)
Table 3. Correlation matrix of the SF-36 subscales and component scores.
Table 3. Correlation matrix of the SF-36 subscales and component scores.
SubscaleαRPBPGHVTSFREMHPCSMCS
PF0.920.500.650.420.060.410.230.200.870.41
RP0.87 0.550.380.320.640.530.440.770.62
BP0.88 0.430.230.430.320.420.780.52
GH0.65 0.340.520.310.480.650.59
VT0.59 0.400.460.520.440.69
SF0.80 0.600.620.760.79
RE0.80 0.550.580.80
MH0.64 0.580.87
PCS0.91 0.75
MCS0.85
Data in the first column are internal consistency reliabilities (α). All other data are Pearson correlations (r). All correlations were statistically significant at p < 0.01 with the exception of PF-VT (p = 0.532), PF-RE (p < 0.05), PF-MH (p < 0.05), and BP-VT (p < 0.05).
Table 4. Correlation of the SF-36 component scores with psychopathology.
Table 4. Correlation of the SF-36 component scores with psychopathology.
MeasurePhysical ComponentMental ComponentΔr (95% CI)
Depression, CESD−0.60 (−0.74, −0.43)−0.75 (−0.85, −0.59)−0.15 (−0.35, 0.06)
Anxiety, STAI−0.35 (−0.75, −0.22)−0.53 (−0.96, −0.49)−0.18 (−0.63, 0.22)
Parental stress, PSS−0.32 (−0.39, −0.10)−0.39 (−0.44, −0.15)−0.07 (−0.30, 0.18)
Data are r (95% CI). All correlations were statistically significant at p ≤ 0.001.
Table 5. Associations SF-36 component scores and clinically relevant symptoms of psychopathology.
Table 5. Associations SF-36 component scores and clinically relevant symptoms of psychopathology.
SF-36 ComponentCESD ≥ 16pSTAI ≥ 39p
Yes (n = 69)No (n = 30)Yes (n = 81)No (n = 18)
Physical39.14 (8.92)50.52 (7.22)<0.00134.37 (7.60)48.22 (7.40)<0.001
Mental41.85 (9.76)48.03 (9.33)0.01237.04 (9.43)46.05 (8.90)<0.001
Table 6. Association between SF-36 component scores and number of child diagnoses.
Table 6. Association between SF-36 component scores and number of child diagnoses.
No. Child DiagnosesPhysical Component (SD)Mental Component (SD)
1 (n = 19)48.98 (9.01)45.46 (7.20)
2 (n = 34)43.78 (9.26)38.06 (11.54)
3 (n = 24)39.88 (9.76)37.07 (8.30)
4 (n = 16)35.33 (6.42)32.48 (6.59)
F (p value)7.68 (<0.001)6.10 (0.001)
Post hoc contrasts1 > 3, 4; 2 > 41 > 3, 4
The MINI-KID was not completed for six children and thus are excluded from these analyses. Listed post hoc Scheffé contrasts were significant at p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Reed, M.; Reaume, S.V.; Ferro, M.A. Psychometric Properties of the Short Form-36 (SF-36) in Parents of Children with Mental Illness. Psych 2022, 4, 247-257. https://doi.org/10.3390/psych4020021

AMA Style

Reed M, Reaume SV, Ferro MA. Psychometric Properties of the Short Form-36 (SF-36) in Parents of Children with Mental Illness. Psych. 2022; 4(2):247-257. https://doi.org/10.3390/psych4020021

Chicago/Turabian Style

Reed, Madeline, Shannon V. Reaume, and Mark A. Ferro. 2022. "Psychometric Properties of the Short Form-36 (SF-36) in Parents of Children with Mental Illness" Psych 4, no. 2: 247-257. https://doi.org/10.3390/psych4020021

APA Style

Reed, M., Reaume, S. V., & Ferro, M. A. (2022). Psychometric Properties of the Short Form-36 (SF-36) in Parents of Children with Mental Illness. Psych, 4(2), 247-257. https://doi.org/10.3390/psych4020021

Article Metrics

Back to TopTop