Next Article in Journal
Oral Health Factors Related to Rapid Oral Health Deterioration among Older Adults: A Narrative Review
Next Article in Special Issue
A Biopsychosocial Evaluation of Post-Acute Outcome of Patients with Severe Brain Lesions Recovering from Coma: An Exploratory Study
Previous Article in Journal
Status of Body Contouring Following Metabolic Bariatric Surgery in a Tertiary Hospital of Greece—Still a Long Way to Go
Previous Article in Special Issue
Acute Haemostatic Depletion and Failure in Patients with Traumatic Brain Injury (TBI): Pathophysiological and Clinical Considerations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Longitudinal Internal Validity of the Quality of Life after Brain Injury: Response Shift and Responsiveness

by
Marina Zeldovich
1,†,
Stefanie Hahm
2,†,
Isabelle Mueller
1,3,†,
Ugne Krenz
1,
Fabian Bockhop
1,
Nicole von Steinbuechel
1,* and
the CENTER-TBI Participants and Investigators
1
Institute of Medical Psychology and Medical Sociology, University Medical Center Göttingen, Waldweg 37A, 37073 Göttingen, Germany
2
Department Health & Prevention, Institute of Psychology, University of Greifswald, Robert-Blum-Str. 13, 17489 Greifswald, Germany
3
Department of Psychiatry, Columbia University Medical Center, 622 West 168th Street, New York, NY 10032, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
The full list of CENTER-TBI Participants and Investigators is provided in Supplemental Material (S1).
J. Clin. Med. 2023, 12(9), 3197; https://doi.org/10.3390/jcm12093197
Submission received: 28 March 2023 / Revised: 26 April 2023 / Accepted: 28 April 2023 / Published: 29 April 2023
(This article belongs to the Special Issue Traumatic Brain Injury (TBI): Recent Trends and Future Perspectives)

Abstract

:
The Quality of Life after Brain Injury (QoLIBRI) questionnaire was developed and validated to assess disease-specific health-related quality of life (HRQoL) in individuals after TBI. The present study aims to determine its longitudinal validity by assessing its responsiveness and response shift from 3 to 6 months post-injury. Analyses were based on data from the European longitudinal observational cohort Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury study. A total of 1659 individuals recovering from TBI were included in the analyses. Response shift was assessed using longitudinal measurement invariance testing within the confirmatory factor analyses framework. Responsiveness was analyzed using linear regression models that compared changes in functional recovery as measured by the Glasgow Outcome Scale–Extended (GOSE) with changes in the QoLIBRI scales from 3 to 6 months post-injury. Longitudinal tests of measurement invariance and analyses of discrepancies in practical significance indicated the absence of response shift. Changes in functional recovery status from three to six months were significantly associated with the responsiveness of the QoLIBRI scales over the same time period. The QoLIBRI can be used in longitudinal studies and is responsive to changes in an individual’s functional recovery during the first 6 months after TBI.

Graphical Abstract

1. Introduction

Health-related quality of life (HRQoL) refers to the assessment of an individual’s perceived mental, physical, and social well-being and the overall ability to perform daily life activities [1]. Ideally, HRQoL instruments provide standardized information about the status and extent of limitations in a patient’s subjective experience of a medical condition or its treatment [2], capturing valuable insight into self-perceived health status and recovery patterns [3]. Measures of HRQoL can be generic or disease-specific. While generic measures allow for comparisons between different conditions and the general population, disease-specific instruments are more sensitive to selected health conditions, more precise in assessing their symptoms [4], and allow for a better prognosis, therapy, and rehabilitation recommendation compared with generic HRQoL measures. Due to this gain in nuanced information, disease-specific HRQoL is a recommended outcome that should be assessed in complex, heterogeneous diseases, such as traumatic brain injury (TBI) [3,5].
TBI is a significant cause of death and disability worldwide [6,7,8]. A recent epidemiological study reported almost 1.5 million hospital discharges and over 56,000 deaths due to TBI in Europe within 1 year, with TBI accounting for 37% of all injury-related deaths [9]. Despite the critical impact TBI has on society, public health, patients, and their next of kin, its effect is often insufficiently recognized [10,11]. TBI is considered an essential factor for decreased life expectancy, especially in young people [7,9,12], and is associated with increased morbidity and long-term disabilities in surviving individuals [8,13,14]. It can lead to lifelong limitations in daily activities due to lasting interference with cognitive, emotional, and physical functioning [15,16,17], including the development of post-concussion symptoms [18], impairments in motor functioning [19], and increased prevalence of mental health conditions such as anxiety [20,21,22], depression [21,22,23], or posttraumatic stress disorder [24]. These persistent medical and psychological repercussions often affect the HRQoL of individuals after TBI and their families [25].
The Quality of Life after Brain Injury (QoLIBRI) [26,27] is a TBI-specific patient-reported outcome measure (PROM) validated in more than 20 languages [26,28,29,30]. Its reliability and validity have been previously described in cross-sectional studies ranging from 3 months to 15 years after TBI [27,29,31,32,33,34,35]. The QoLIBRI is able to detect finer nuances between specific patient groups than the SF-36 measuring generic HRQoL [36], which is an important advantage for its use in clinical settings [4,37].
To date, little is known about the longitudinal association of disease-specific HRQoL after TBI. Some studies suggest a somewhat paradoxical increase in HRQoL despite disability [38]. Approaches to explain such a phenomenon include psychological processes such as reappraisal and adaption to the challenge of facing limiting health conditions [39]. These observed changes in perception of HRQoL after an adverse health event can likely be attributed to the adjustment of an individual’s internalized judgment of satisfactory health and HRQoL, usually referred to as a response shift [39,40]. While a response shift in assessing one’s health after a severe illness can be considered a common consequence of successful coping or intervention, it can also influence the psychometric indices of instruments assessing HRQoL [41,42]. Therefore, it is important to assess whether long-term evaluations with HRQoL instruments, like the QoLIBRI, reflect a true change in TBI or are susceptible to a potential response shift.
Response shifts may arise as a result of (1) a change in the responding individual’s internal standards of measurement, such as a recalibration, (2) a change in the values of the individual, such as reprioritization, or (3) a redefinition of the measured construct by the responding individual, such as reconceptualization [43]. The absence of a response shift legitimates comparing instruments’ scores at different time points to evaluate the long-term impact of disease and the efficacy of available treatments. In the case of PROMs such as QoLIBRI, careful assessment of potential response shift is a critical but rarely applied element in establishing the longitudinal validity of the instrument.
Another central characteristic of PROMs is their ability to detect actual change over time, referred to as responsiveness. The exact definition of responsiveness varies in the literature between (1) the ability to detect change in general, (2) measuring clinically meaningful change, and (3) assessing real change in the measured concept [44]. The first definition focuses on assessing the magnitude of a potential treatment effect and creates a lack of information about the instruments’ ability to detect the absence of a treatment effect correctly [44]. The second and third definitions face methodological challenges due to an insufficient classification of the term “clinically important change” and a lack of feasibility to measure the real change in the individuals’ HRQoL due to a scarcity of appropriate instruments. This results in a substantial overlap in measurement procedures. In both cases, researchers usually infer changes in HRQoL from clinical variables, a patient’s perception, or a doctor’s evaluation of change. Therefore, the evaluation of the responsiveness of an instrument varies across the literature, with the significance of change being potentially susceptible to the evaluator’s subjective judgment [44,45].
The present study aims to evaluate the longitudinal internal validity of the QoLIBRI. The assessment is conducted in two steps:
  • Evaluation of response shift from three to six months after TBI using the longitudinal measurement invariance testing approach;
  • Assessment of responsiveness as the ability of the QoLIBRI to detect changes in the patient’s functional recovery status, as measured by the Glasgow Outcome Scale–Extended (GOSE) [46], 3 to 6 months after injury.
Evidence of the absence of response shifts and the presence of responsiveness would suggest that the QoLIBRI can be used for longitudinal assessment of disease-specific HRQoL after TBI.

2. Materials and Methods

The present study utilizes data (core data set 3.0) from the prospective, longitudinal, observational Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury study (CENTER-TBI; EC grant 602150; clinicaltrials.gov NCT02210221) aimed to improve characterization and classification of TBI. Inclusion criteria were a clinical diagnosis of TBI, clinical indication for a CT scan, presentation within 24 h after injury, and informed consent which was obtained according to local and national requirements. To avoid confounding outcome assessments, individuals with severe preexisting neurological disorders were excluded from the study [47]. Overall, N = 4509 (99.9% civilians) eligible patients included in the core study were stratified into 3 strata based on the clinical care pathways: emergency room (ER; discharge after ER admission), ward (admission to a hospital ward), and intensive care unit (ICU; admission to the ICU). Details on core sample characteristics are described elsewhere [48].
The present study focused on individuals after TBI who were at least 16 years old and had a GOSE status of 3 or higher at 3 and 6 months after injury. Responsiveness analyses were conducted with individuals for whom the QoLIBRI total score and 6 scale scores could be calculated at 3 and 6 months after injury (Sample 1: N = 1659). Confirmatory factor analyses and measurement invariance analyses were conducted only with complete QoLIBRI item data at 3 and 6 months post-injury (Sample 2: N = 1390). For more details on study sample attrition, see Figure 1.

2.1. Measures

2.1.1. Sociodemographic Data

Sociodemographic data used in the present study were collected at enrollment and included the age, sex, marital status, educational level, and employment status of the study participants.

2.1.2. Injury-Related Data

The severity of TBI was assessed using the Glasgow Coma Scale (GCS) [49], with values of 13–15 indicating mild, 9–12 moderate, and 3–8 severe TBI. It is often accessed several times within the first 24 h after injury (at the scene of the accident, in the first hospital, if the patient did not arrive directly at the study hospital, at the ER of the study hospital, and by post-stabilization). The GCS score was centrally imputed using IMPACT methodology [50]: The first post-stabilization value was taken and, if absent, the next available value back in time towards values at the accident scene. The GCS score was combined with the presence of intracranial abnormalities (ICA) detected by CT. Individuals were grouped into 4 categories according to the following cut-offs: uncomplicated mild (GCS ≥ 13 without ICA), complicated mild (GCS ≥ 13 with ICA), moderate (9 ≤ GCS ≤ 12), and severe TBI (GCS ≤ 8).
Injury severity was measured with the Injury Severity Score (ISS) [51], identifying three of twelve mostly injured body regions. The ISS is calculated as a sum of squares of the three body regions with the highest score. The maximal score for the ISS is 75. If any of the regions are assigned a score of 6, the ISS is automatically set to 75. Other TBI-related factors included the cause of injury (fall, road traffic accident, violent/other), clinical care pathways (emergency room (ER), admission, intensive care unit (ICU)), and the length of the hospital stay (in days).
Functional recovery status after TBI was rated using the GOSE [46] at three and six months after injury. The GOSE scores range from 1 to 8, covering the following functional recovery status: 1 = death, 2 = vegetative state, 3–4 = severe disability, 5–6 = moderate disability, and 7–8 = good recovery. The GOSE score was computed as a composite score combining information from the interview or, if not available, from the postal questionnaire (GOSE-Q [52] completed either by individuals after TBI or caretakers) or based on interviewer ratings for survivors. Since the GOSE-Q cannot distinguish between a vegetative state (score of 2) and a lower severe disability (score of 3), both categories were collapsed into one. Only patients with values of three and above participated in our study. Based on changes in the recovery status between three and six months post-injury, individuals after TBI were divided into three groups: if recovery status had changed to better, they were assigned to the “improved” group. Those with unchanged recovery status were attributed to the “stable” group, and the remainder to the “worsened” group.
The QoLIBRI [26,27] was used to assess TBI-specific HRQoL. The instrument comprises 37 Likert-type scaled items with five response options (“Not at all”, “Slightly”, “Moderately”, “Quite”, and “Very”) forming six domains (Cognitive, Self, Autonomy & Daily Life, Social Relationships, Emotions, and Physical Problems). The total score can be calculated with more than one-third of the responses and scaled to vary from 0 (worst possible HRQoL) to 100 (best possible HRQoL).

2.2. Statistical Analyses

2.2.1. Sample Characteristics

We tested if patients who responded to the QoLIBRI at 3 and 6 months post-injury assessment differed from other TBI patients within six months after injury concerning age, sex, and injury-related characteristics such as clinical care pathways, TBI, and injury severity. The Welch two-sample t-test was applied for metric variables and Pearson’s chi-squared tests or permutation-based chi-squared tests (n < 5 observations per cell; N = 5000 permutations) for categorical ones. The significance level was set to α = 0.05.

2.2.2. Confirmatory Factor Analysis

An optimal instrument structure at 3- and 6-month assessments was tested via confirmatory factor analysis (CFA) with the robust weighted least squares estimator (WLSMV) using the lavaan-package [53] in R [54]. Model fit was assessed with the scaled chi-square statistics, comparative fit index (CFI), root mean square error of approximation (RMSEA) with a 90-percent confidence interval, and standardized root mean square residual (SRMR). The standard cut-offs for CFI (>0.95), RMSEA (<0.06 for an excellent and 0.05 < RMSEA < 0.10 for a mediocre fit), and SRMR (<0.08) [55,56,57], indicating good model fit, have not been yet validated for the WLSMV estimator. Therefore, we tested four concurrent factorial structures (with 1. one factor, 2. two correlated factors, one factor that underlies positively formulated items and one negatively, 3. six correlated factors corresponding to QoLIBRI scales, 4. six correlated factors, and one common factor of higher order) and compared all fit indices across models. For the scaled chi-square difference test, α-level was set to 0.05.

2.2.3. Response Shift

Response shift of each QoLIBRI scale was determined by testing for measurement invariance across the two time points within the framework of CFA for ordinal variables [58]. The content interpretation was performed based on Oort (2005) [59].
First, we tested a configural model with the same number of latent factors and the same pattern of zero and non-zero loadings across two time points. Failure of the model would indicate that participants reconceptualized their understanding of the HRQoL construct by the follow-up, attributing items to other factors.
Next, a loading model, constraining loadings of the configural model to be equal across time points, was investigated. The scaled chi-square test (α = 0.05) was used for model comparison. A worsened model fit would mean a response shift due to reprioritization: by the follow-up, the importance of some items has changed for the construct estimation.
Then, in the threshold model, we constrained the loading model’s thresholds to be equal across time points. A worsened model fit would mean a response shift due to recalibration (i.e., a change in the interpretation of response options): even if a participant reports the same level of HRQoL, he or she would score differently at the second time point. Invariance on the threshold level would be sufficient to conclude that the observed differences in the score means are due to the differences in the latent factor means [60].
Finally, in the residual model, we additionally constrained residual variances to be equal across time points. In the case of invariance, one can conclude that the responses showed no response shift, and all observed differences in the score means, variances, and covariances came from the corresponding differences in the latent factors.
In all models, latent factors were allowed to freely covary across time points. Residuals were allowed to freely correlate with themselves but not with other residuals across time points. The model specification was based on the marker item approach implying selecting marker variables based on the smallest difference in loadings over time [58]. In case where the loading, threshold, or residual model is non-invariant, Liu et al. (2017) [58] suggest testing if violations of invariance have a practical significance. The estimated parameters of each invariance model can be applied to calculate probabilities of choosing a particular response category under the corresponding model. In the case that, for example, the loading model holds, but the threshold model does not, the practical significance of an invariance violation can be attached through the differences in estimated response probabilities under the loading and threshold model for each item and all time points. Differences not exceeding 5% were considered negligible.

2.2.4. Responsiveness

Responsiveness of an instrument reflects the extent to which changes in the measure relate to corresponding changes in an external reference measure over a defined time course. Regression analyses have proven useful in assessing responsiveness, as the regression coefficient (b) provides an easily interpretable index, and a goodness-of-fit assessment can be employed to check for the plausibility of the model [45]. Therefore, to evaluate the responsiveness of the QoLIBRI, linear regressions were calculated to find associations between the change in the QoLIBRI total and scale scores from three to six months post-injury and the change in the GOSE score from three to six months, using the R-package ‘lme4’ [61]. The GOSE change was included as an ordinal variable using two orthogonal contrasts to detect linear and non-linear (i.e., quadratic) associations with the QoLIBRI scores. Age, sex, marital status, education level, employment status, TBI severity, ISS, cause of injury, clinical care pathways, and length of hospital stay were used as covariates. Multiple imputations with the R-package ‘mice’ [62] was used to handle missing covariate data. The level of significance was set to α = 0.05 for the total score and was Bonferroni-corrected for the scale scores (α = 0.05/6 = 0.008).
The reliability of change scores was evaluated by receiver operating characteristic (ROC) curves with the R-package ’pROC’ [63] containing information on the sensitivity and specificity of the QoLIBRI change scores by discrimination between stable and improved patients. The area under the curve (AUC) was calculated; its values can vary between 0.5 and 1.0, with 1.0 indicating perfect discrimination and 0.5 discrimination not better than by chance [64].
Finally, we compared QoLIBRI total and scale scores between three and six months post-TBI using the Wilcoxon signed rank test for dependent samples to provide an overview of changes in the reported scores. The effect size r was calculated using the ‘wlicox_effsize’ function from the R package ‘rstatix’ [65]. Interpretation of values was based on conventional cut-offs: 0.10 ≤ r < 0.30 (small effect), 0.30 ≤ r < 0.50 (medium effect), and r ≥ 0.50 (large effect) [66]. Visualization was performed using strip plots showing trajectories of changes in HRQoL from three to six months.

3. Results

3.1. Study Participants

A total of 1659 patients (64.9% male) with a mean age of 49.61 years (SD = 19.15) were included in the present study (Sample 1, see Figure 1). The majority (approx. 77%) were either admitted to a hospital ward or an ICU after injury, while the remaining 23% were discharged after visiting the ER. Based on the GCS and information on intracranial abnormalities on the CT scans, 32.9% of the sample were diagnosed with uncomplicated mild TBI (i.e., GCS ≥ 13 and no abnormalities), 30.2% with complicated TBI (i.e., GCS ≥ 13 and visible intracranial abnormalities), 6.8% with moderate, and 14.2% with severe TBI; 6 months after TBI, 13.6% of participants showed a worsened functional state as rated by the GOSE, while for 55.3%, a stable, and for 31.1%, an improved functional status was observed. The patients’ mean ISS score was 18.04 (SD = 14.85). Participants included in the analysis sample differed significantly from those not included in all characteristics except for age. For more details, see Table 1. For the sample characteristics of the reduced sample (Sample 2, see Figure 1) as well as for the comparison between included and excluded individuals, see Appendix A, Table A1.

3.2. Confirmatory Factor Analysis

Table 2 provides the CFA results for 3 and 6 months post-injury, respectively. At both time points, model fit indices remarkably improved by the 6-factor and second-order models with CFIs above 0.949 and RMSEA values under 0.069. The scaled chi-square test identified that the 6-factorial structure fits best the QoLIBRI data at time points 3 (χ2(614) = 4121.54, p < 0.001, CFI = 0.954, RMSEA = 0.064, CI90% [0.062; 0.066]) and 6 months post-injury (χ2(614) = 3775.89, p < 0.001, CFI = 0.963, RMSEA = 0.061, CI90% [0.059; 0.063]). Therefore, this model was used for further analyses.

3.3. Response Shift

Table 3 presents the results from the longitudinal measurement invariance test for the QoLIBRI scales from three to six months after TBI. For each scale, we estimated four invariance models. In all cases, the CFI was high (≥0.971), and the SRMR did not exceed the cut-off of 0.06. Both indices showed minimal variation across invariance models for each scale, suggesting an adequate fit. However, the RMSEA of the scales Self (configural and loading model) and Social Relationships (configural model) was slightly increased (>0.10), indicating a worse model fit.
The scaled chi-square difference test indicated for all scales that adding loading invariance constraints did not significantly worsen the model fit when compared to the configural baseline model. For three of the six scales (Daily Life & Autonomy, Social Relationships, and Physical Problems), the scaled chi-square difference test indicated that the threshold model fit does significantly worsen the data in comparison to the loading invariance model. As the threshold invariance model did not hold up, an analysis of practical significance was conducted for all three scales [58]. Predicted probabilities for each of the scales showed only minimal differences between invariance models cross-sectionally and longitudinally. Analysis of the practical significance of invariance violation identified that the discrepancies in the estimated probabilities to choose a particular response option under concurrent models (e.g., loading and threshold invariance models for the Social Relationships scale) showed absolute differences not exceeding 2% (see Supplemental Material S2, Practical Significance–Discrepancies between Invariance Models). According to Liu and colleagues [58], small discrepancies in the predicted probabilities (<0.05) can be neglected as they only represent relatively few individuals. Therefore, we can assume that violations from threshold invariance for the Daily Life & Autonomy, Social Relationships, and Physical Problems scales were not caused by a response shift from three to six months post injury, and threshold invariance can be assumed.
For the remaining scales (Cognition, Self, and Emotions), the threshold invariance model held up compared to the loading invariance model. Consequently, the residual (unique factor) invariance model was tested. Scaled chi-square difference analysis indicated non-invariant residuals for all three scales. Again, an analysis of the practical significance of the failure of the residual invariance model was conducted. Predicted probabilities for each of the scales showed only minimal differences from three to six months (see Supplemental Material S2, Practical Significance–Discrepancies between Invariance Models). Consequently, their contribution to the latent construct HRQoL assessed by the QoLIBRI remained unchanged between the two measurement occasions, and observed differences in the scores over time can be attributed to true changes in the HRQoL.
The most pronounced changes between three and six months were observed on the Daily Life & Autonomy scale, where the participants became more likely to choose a higher response category. For instance, the predicted probability of choosing the answer “very” to the question “How satisfied are you with your ability to carry out domestic activities?” increased from 0.41 to 0.47 in the loading invariance model. The predicted probability for the question “How satisfied are you with the extent of your independence from others?” changed from 0.36 to 0.42 from 3 to 6 months in the response category “very” in the loading invariance mode. Furthermore, the item “How satisfied are you with your ability to get out and about” showed an increase in the endorsement of the higher response category from 0.46 to 0.52. For details, see Supplemental Material S2, Practical significance (Daily Life & Autonomy). These two questions represent the largest deviations in predicted probabilities for all scales over time, indicating that the scale may be more sensitive to measure change.

3.4. Responsiveness

According to the change in GOSE score between 3 and 6 months after TBI, recovery improved in 31.1% (n = 516) of our sample, 55.3% (n = 918) were classified as stable, and 13.6% (n = 225) had worsened recovery status. Change in the GOSE score, considered as a linear effect, contributed significantly to the change in the QoLIBRI total score, B = 4.129, t(1637) = 6.073, p < 0.001. At the scale level, a significant effect of GOSE change was observed for all scales except the Emotions scale. The proportion of variance in the change of the QoLIBRI score explained by the change in the GOSE scores was 4% for the total score and varied from 1% (Emotions scale) to 6% (Daily Life & Autonomy scale). Results showed no significant influence of the change in the GOSE score, considered as a quadratic effect. For details, see Table 4 and Appendix A, Table A2.
The average scores for the change in the QoLIBRI in relation to the change in the GOSE scores are shown in Figure 2. The most pronounced increase in the QoLIBRI score in relation to the GOSE score was observed in the Daily Life & Autonomy scale, followed by the Physical scale for those with improved functional recovery. For those with a worsened recovery status, the greatest decrease in the QoLIBRI scores was found in the Cognition and Self scales.
Additional ROC analysis showed that based on the QoLIBRI change scores, 60.4% of the individuals after TBI were correctly classified as presenting an improved vs. a not improved (i.e., stable or worsened) recovery status. The cut-off for the QoLIBRI change score, which maximizes sensitivity (55.4%) and specificity (63.9%) by distinguishing between improved and non-improved patients, was 2.5. For details, see Figure 3. The correctness of patients’ classification for scales ranged from 55.1% (Social Relationships) to 62.7% (Daily Life & Autonomy). The results of ROC analyses on the scale level are shown in Appendix A, Figure A1.
We observed a significant difference in the QoLIBRI total score from 3 to 6 months after TBI (V = 518408, p < 0.001, r = 0.12 corresponding to a small effect). The effect was mainly driven by the difference in the Daily Life & Autonomy and Physical Problems scales, both showing significant improvement from 3 to 6 months (p < 0.001). For visualization, see Figure 4 (QoLIBRI total score) and Figure A2 (for the scale scores).

4. Discussion

The present study aimed to assess the longitudinal internal validity of the QoLIBRI measuring TBI-specific HRQoL. This is the first study to assess response shift and responsiveness of the QoLIBRI for individuals between 3 and 6 months post TBI. This time frame is critical for patients as recovery mostly occurs in the first six months. For example, Gardner et al. [67] found that the majority of individuals after TBI achieve good to moderate recovery within the first half year after injury, with 70.9% following a gradual trajectory between the time points. Other studies also suggest that at least moderate recovery is reached within six months across all TBI severity groups [68,69].
However, most research has focused on functional recovery, thus neglecting domains that are additionally relevant to better understanding patients’ needs and facilitating the recuperation process [35]. In this context, especially the administration of PROMs (e.g., HRQoL measurement) can be considered as a comprehensive, economical, and reliable source of information complementary to the GOSE. Assessing both potential response shifts and responsiveness is critical to learning about actual changes over time when using PROMs longitudinally. In the present study, the absence of response shift and the demonstrated responsiveness of the QoLIBRI to the GOSE-assessed recovery status suggest that the instrument is useful for follow-up assessments during at least the first six months after injury. Some further aspects will be discussed in the following paragraphs.

4.1. Response Shift

For three QoLIBRI scales (i.e., Daily Life & Autonomy, Social Relationships, and Physical Problems), the longitudinal loading invariance model was attained, indicating that changes over time in the expected means measured by these QoLIBRI scales are entirely attributable to changes in the common latent factors over time [58]. Thus, the latent construct “HRQoL” estimated by the QoLIBRI remained unchanged between two measurement occasions, and observed differences in the scores over time can be attributed to true changes in the HRQoL. The other three scales (i.e., Cognition, Self, and Emotions) reached threshold invariance, pointing out that the observed differences in the score means are due to the differences in the latent factor means [60].
To better understand the discrepancies in response behavior from three to six months, a sensitivity analysis of the practical significance of the failure of invariance was conducted for all scales. The predicted probabilities revealed minor changes in response categories from three to six months post-TBI, with the largest variations on the Daily Life & Autonomy scale, where participants tended to endorse higher response categories indicating better HRQoL at six months post-TBI compared to three months. This may be explained by the progressive recovery process increasing their satisfaction with the autonomy they have gained during recovery. In our study, items measuring satisfaction with the level of ability to perform domestic activities, the level of independence from others, and the ability to get out and about showed increased endorsement six months after TBI. These findings are supported by previously published research suggesting considerable improvement in daily living activities during the first year post-injury [70].
In addition, discrepancies in the predicted probabilities between the retained and rejected measurement invariance models were calculated for each scale. However, none of the discrepancies between invariance models exceeded the 5% threshold, indicating that these differences can be neglected and the assumption of longitudinal measurement invariance can be retained.
The absence of response shift may also be explained by our study sample characteristics, as most of our patients had experienced a mild TBI. The intensive recovery processes for mild TBI occurs within the first weeks/months after injury [71]. In our sample, almost 60% of the individuals after TBI presented a good recovery at 3 months post-injury, which is comparable to other studies [67,68]. Moreover, patients after moderate and severe TBI who participated in the study might have felt generally better already when entering the study than those who did not take part. Therefore, adaptation and coping processes, which generally cause response shifts [43], might not have been pronounced in the individuals in our study sample.

4.2. Responsiveness

Linear regression modeling indicated that the linear change in the GOSE from three to six months was significantly associated with the change in HRQoL. This is in line with a recent study showing that the QoLIBRI was one of the most sensitive instruments for recovery status at 3 different time points (3, 6, and 12 months after TBI) across different patient groups [35]. Furthermore, some other studies have shown a significant association between unfavorable recovery and reduced (TBI-specific) HRQoL [29,48,72,73,74].
The only exception among the QoLIBRI scales was the change in the Emotions scale, which showed no significant association with the change in recovery status after Bonferroni adjustment for multiple testing. This may be explained by the fact that the GOSE focuses rather on functional (dis)ability, independence, social and leisure activities, and return to normal life after TBI and neglects the emotional status. As emotional well-being is crucial for the healing and recovery process and improvement of HRQoL in individuals after TBI [75], its assessment and, if necessary, treatment are mandatory in individuals after TBI. However, recent rehabilitation studies indicate a lack of services and treatment for post-TBI mental health conditions at all levels of severity [76,77].
Overall, the QoLIBRI and its scales appear to be sensitive to positive and negative changes in the participants’ HRQoL. Additional ROC analysis indicated that a QoLIBRI change score of 2.5 or higher could indicate significantly improved functional status and vice versa. Overall, a QoLIBRI change score of 2.5 correctly identified a significant change in recovery status in 60% of participants.
Finally, since the QoLIBRI can be considered responsive to changes in recovery from TBI and since we can assume that it measures true changes in TBI-specific HRQoL longitudinally (i.e., in a time frame of six months after injury), we can conclude that HRQoL improves significantly between three and six months, especially in terms of autonomy in daily living and physical problems.

4.3. Strengths and Limitations

To our knowledge, this is the first study systematically analyzing response shifts and responsiveness of the QoLIBRI and its scales. The main advantage is the large sample size, which also reflects the epidemiological distribution of the TBI severity in the general TBI population, allowing us to draw reliable conclusions. Some limitations should nevertheless be mentioned. Although advantageous for comparing with the general TBI population, the uneven distribution of TBI severity may pose some problems. The relatively small number of individuals after moderate and severe TBI does not allow for additional investigation of response shifts and responsiveness in these groups. Considering that higher TBI severity may be associated with a more pronounced decrease in TBI-specific HRQoL [78], additional analyses within the severe TBI group would be beneficial to gain more insight into potential changes in their HRQoL over time and the ability of the QoLIBRI to capture them. Furthermore, as participants included in the sample differed significantly from those not included concerning all characteristics except for age, the results should be interpreted with caution. Finally, the proportion of variance explained (4%) in the change in QoLIBRI score by the change in GOSE suggests that other factors not considered in the present study also contribute to changes in HRQoL. Therefore, the results should not be overinterpreted.
Future research using instruments other than QoLIBRI to assess TBI-specific HRQoL (e.g., TBI-QOL [79]) and data from other studies for external validation should be conducted to provide further evidence of the longitudinal validity of the QoLIBRI. Furthermore, the inclusion of additional time points after TBI would be beneficial to gain more insight into the variability of changes in TBI-specific HRQoL. Due to the design of the CENTER-TBI study, individuals after TBI who were admitted to an ER and subsequently discharged were only included in follow-up analyses up to six months after injury. Therefore, we were unable to perform analyses with this substantial group (i.e., 23%) beyond this time frame, which would have introduced sample bias due to the overrepresentation of severe or complex cases [80]. Thus, we decided to limit our analyses to the first six months after TBI. In addition, analyses of responsiveness to other relevant clinical comorbid conditions (e.g., depression, anxiety, post-traumatic stress disorder, post-concussion symptoms) may provide a more complete picture of how changes in TBI-specific HRQoL are related to outcomes other than post-TBI functional recovery. First, studies on the simultaneous consideration of these outcome domains point to their relevant impact on TBI-specific HRQoL [35,74]. Additional evidence of recovery using objective approaches such as CT and/or MRI, which were not available in the present study sample, would be beneficial for a more accurate, externally validated assessment of recovery.

5. Conclusions

Given the long-term impact of TBI on an individual’s life, and the heterogeneous pathways to symptom resolution and its potential negative impact on HRQoL, it is crucial to monitor outcomes such as HRQoL over time and not to rely solely on changes in functional status (i.e., the GOSE). To evaluate developmental trends straightforward, longitudinal validity, including response shift and responsiveness of the instruments, had to be established. Our results indicate the QoLIBRI can detect a true change in the underlying HRQoL construct and is sensitive to detecting changes in functional recovery status. The QoLIBRI, therefore, can be considered a valuable instrument to gain nuanced insight into the longitudinal development of recovery patterns and self-perceived health status in patients affected by TBI.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12093197/s1, File S1: CENTER-TBI Participants and Investigators; File S2: Practical Significance.

Author Contributions

Conceptualization, M.Z., S.H. and I.M.; Data curation, M.Z. and S.H.; Formal analysis, M.Z., S.H. and I.M.; Funding acquisition, N.v.S.; Methodology, M.Z., S.H. and I.M.; Resources, N.v.S.; Software, M.Z., S.H. and I.M.; Supervision, N.v.S.; Visualization, M.Z. and S.H.; Writing—original draft, M.Z., S.H., I.M., U.K. and N.v.S.; Writing—review and editing, M.Z., S.H., I.M., U.K., F.B. and N.v.S. All authors have read and agreed to the published version of the manuscript.

Funding

CENTER-TBI was supported by the European Union 7th Framework programme (EC grant 602150). Additional funding was obtained from the Hannelore Kohl Stiftung (Germany), from OneMind (USA), from Integra LifeSciences Corporation (USA), and from NeuroTrauma Sciences (USA).

Institutional Review Board Statement

The CENTER-TBI study (EC grant 602150) has been conducted in accordance with all relevant laws of the European Union (EU) if directly applicable or of direct effect and all relevant laws of the country where the recruiting sites were located. Informed consent by the patients and/or the legal representative/next of kin was obtained, accordingly to the local legislation, for all patients recruited in the Core Dataset of CENTER-TBI and documented in the electronic case report form (e-CRF). For the full list of sites, ethical committees, and ethical approval details, see the official CENTER-TBI website (https://www.center-tbi.eu/project/ethical-approval, accessed on 4 November 2021).

Informed Consent Statement

Written informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All relevant data are available upon request from CENTER-TBI, and the authors are not legally allowed to share it publicly. The authors confirm that they received no special access privileges to the data. CENTER-TBI is committed to data sharing and, in particular, to responsible further use of the data. Hereto, we have a data sharing statement in place: https://www.center-tbi.eu/data/sharing (accessed on 27 April 2023). The CENTER-TBI Management Committee, in collaboration with the General Assembly, established the Data Sharing policy and Publication and Authorship Guidelines to ensure the correct and appropriate use of the data as the dataset is hugely complex and requires the help of experts from the Data Curation Team or Bio-Statistical Team for correct use. This means that we encourage researchers to contact the CENTER-TBI team for any research plans and the Data Curation Team for any help in the appropriate use of the data, including sharing of scripts. Requests for data access can be submitted online: https://www.center-tbi.eu/data (accessed on 27 April 2023). The complete Manual for data access is also available online: https://www.center-tbi.eu/files/SOP-Manual-DAPR-2402020.pdf (accessed on 27 April 2023).

Acknowledgments

The authors would like to thank all study participants and investigators of the CENTER-TBI study. The authors would also like to thank Anastasia Gorbunova for the very helpful preparatory work she did for this publication.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Appendix A

Table A1. Comparison between individuals included in and excluded from Sample 2.
Table A1. Comparison between individuals included in and excluded from Sample 2.
Sample 1 *
Value/GroupSample 2 **
(n = 1390)
Excluded
(n = 269)
p
AgeM (SD)47.51 (18.13)60.42 (20.61)<0.001
SexMale928 (66.76%)149 (55.39%)<0.001
Female462 (33.24%)120 (44.61%)
Marital statusPartnered757 (54.46%)132 (49.07%)0.128
Single631 (45.40%)136 (50.56%)
Missing2 (0.14%)1 (0.37%)
Education levelAt least secondary/high school463 (33.31%)84 (31.23%)0.004
College/university413 (29.71%)51 (18.96%)
None/primary school165 (11.87%)42 (15.61%)
Post-high school training238 (17.12%) 55 (20.45%)
Missing 111 (7.99%)37 (13.75%)
Employment statusFull-time employed661 (47.55%)57 (21.19%)<0.001
In training132 (9.50%)22 (8.18%)
Part-time employed180 (12.95%)16 (5.95%)
Retired246 (17.70%)143 (53.16%)
Unemployed106 (7.62%)17 (6.32%)
Missing 65 (4.68%)14 (5.20%)
TBI severity (GCS)Uncomplicated mild411 (29.57%)90 (33.46%)0.463
Complicated mild94 (6.76%)19 (7.06%)
Moderate191 (13.74%)45 (16.73%)
Severe464 (33.38%)82 (30.48%)
Missing230 (16.55%)33 (12.27%)
Injury Severity Score (ISS)M (SD)17.93 (15.03)18.59 (13.88)0.077
Functional status change
(Glasgow Outcome Scale–Extended; GOSE)
Improved436 (31.37%)80 (29.74%)0.001
Stable785 (56.47%)133 (49.44%)
Worsened169 (12.16%)56 (20.82%)
Missing 00
Cause of injuryFall572 (41.15%)143 (53.16%)0.001
Road traffic accident595 (42.81%)97 (36.06%)
Violent/other222 (15.97%)29 (10.78%)
Missing 1 (0.07%)0
Clinical care pathwaysER335 (24.10%)48 (17.84%)0.049
Admission536 (38.56%)104 (38.66%)
ICU519 (37.34%)117 (43.49%)
Length of hospital stay (in days) M (SD)10.25 (18.16)12.17 (18.25)0.045
Missing 24 (1.73%)5 (1.86%)
* Sample 1 was used for the responsiveness analyses (N = 1659). ** Sample 2 was used for the CFA and measurement invariance analyses (N = 1390). Note. n = absolute frequencies, p = p-value, M = mean, SD = Standard deviation. Welch’s t-test was used for all continuous variables due to non-normal distribution; χ2-tests and permutation-based χ2-tests (n < 5 observations per cell; N = 5000 permutations) were used for categorical data.
Table A2. Detailed results on regression analyses.
Table A2. Detailed results on regression analyses.
VariableGroupB (SE)btp
Total Score
GOSE (linear)-4.129 (0.680)0.3446.073<0.001
GOSE (ordinal)-0.223 (0.511)0.0190.4360.663
Age-−0.026 (0.027)−0.042−0.9600.337
Sex (Ref: Female)Male−0.093 (0.635)−0.008−0.1470.883
Marital status (Ref: Partnered)Partnered0.191 (0.657)0.0160.2900.772
Education level (Ref: College/university)At least secondary/high school−1.222 (0.806)−0.102−1.5150.132
None/primary school−1.289 (1.035)−0.107−1.2450.214
Post-high school training−2.070 (0.880)−0.172−2.3540.019
Employment status (Ref: Full-time employed)In training−0.043 (1.279)−0.004−0.0340.973
Part-time employed0.323 (1.001)0.0270.3230.747
Retired1.138 (1.044)0.0951.0900.276
Unemployed−0.020 (1.206)−0.002−0.0170.986
TBI Severity (Ref: Uncomplicated mild)Complicated mild0.147 (0.805)0.0120.1830.855
Moderate0.170 (1.404)0.0140.1210.904
Severe0.945 (1.375)0.0790.6870.493
Injury severity score (ISS)-0.042 (0.032)0.0521.3150.189
Cause of injury (Ref: Road traffic accident)Fall0.621 (0.676)0.0520.9200.358
Violence/other0.436 (0.898)0.0360.4850.628
Clinical care pathways (Ref: ER)Admission0.483 (0.870)0.0400.5560.579
ICU0.473 (1.265)0.0390.3740.709
Length of hospital stay -−0.024 (0.021)−0.036−1.1540.249
Cognition *
GOSE (linear)-3.365 (0.904)0.2133.722<0.001
GOSE (ordinal)-−0.758 (0.680)−0.048−1.1140.265
Age-0.025 (0.036)0.0310.7040.482
Sex (Ref: Female)Male−1.030 (0.846)−0.065−1.2180.223
Marital status (Ref: Partnered)Partnered1.244 (0.871)0.0791.4290.153
Education level (Ref: College/university)At least secondary/high school−1.153 (1.114)−0.073−1.0350.304
None/primary school−2.023 (1.337)−0.128−1.5140.131
Post-high school training−1.930 (1.207)−0.122−1.5990.111
Employment status (Ref: Full-time employed)In training0.714 (1.689)0.0450.4230.673
Part-time employed0.757 (1.396)0.0480.5420.589
Retired−0.269 (1.369)−0.017−0.1960.845
Unemployed−0.023 (1.600)−0.001−0.0140.989
TBI Severity (Ref: Uncomplicated mild)Complicated mild0.687 (1.060)0.0430.6480.517
Moderate−0.510 (1.945)−0.032−0.2620.794
Severe2.033 (1.788)0.1291.1370.257
Injury severity score (ISS)-−0.004 (0.042)−0.003−0.0850.932
Cause of injury (Ref: Road traffic accident)Fall−0.634 (0.899)−0.040−0.7050.481
Violence/other-0.763 (1.195)-0.048-0.6390.523
Clinical care pathways (Ref: ER)Admission0.342 (1.159)0.0220.2950.768
ICU1.143 (1.675)0.0720.6820.495
Length of hospital stay -−0.035 (0.028)−0.040−1.2520.211
Self *
GOSE (linear)-4.725 (0.932)0.2895.070<0.001
GOSE (ordinal)-−0.223 (0.701)−0.014−0.3180.750
Age-0.011 (0.037)0.0120.2840.777
Sex (Ref: Female)Male−0.176 (0.871)−0.011−0.2020.840
Marital status (Ref: Partnered)Partnered0.639 (0.900)0.0390.7100.478
Education level (Ref: College/university)At least secondary/high school−0.655 (1.048)−0.040−0.6250.532
None/primary school−0.948 (1.356)−0.058−0.6990.485
Post-high school training−1.908 (1.210)−0.117−1.5770.115
Employment status (Ref: Full-time employed)In training−0.993 (1.715)−0.061−0.5790.563
Part-time employed−0.554 (1.361)−0.034−0.4070.684
Retired−0.015 (1.441)−0.001−0.0100.992
Unemployed0.255 (1.642)0.0160.1550.877
TBI Severity (Ref: Uncomplicated mild)Complicated mild0.107 (1.103)0.0070.0970.923
Moderate0.454 (1.822)0.0280.2490.803
Severe−0.632 (1.884)−0.039−0.3360.738
Injury severity score (ISS)-−0.034 (0.028)−0.038−1.1960.232
Cause of injury (Ref: Road traffic accident)Fall1.240 (0.926)0.0761.3390.181
Violence/other0.560 (1.229)0.0340.4560.649
Clinical care pathways (Ref: ER)Admission0.706 (1.193)0.0430.5910.554
ICU0.777 (1.730)0.0480.4490.653
Length of hospital stay -−0.034 (0.028)−0.038−1.1960.232
Daily Life & Autonomy *
GOSE (linear)-6.384 (0.977)0.3656.536<0.001
GOSE (ordinal)-1.204 (0.735)0.0691.6390.102
Age-−0.072 (0.038) −0.079−1.8750.061
Sex (Ref: Female)Male0.004 (0.916)0.0000.0050.996
Marital status (Ref: Partnered)Partnered−1.174 (0.948)−0.067−1.2390.216
Education level (Ref: College/university)At least secondary/high school−0.796 (1.116)−0.045−0.7130.476
None/primary school0.498 (1.545)0.0280.3230.748
Post-high school training−2.608 (1.275)−0.149−2.0460.041
Employment status (Ref: Full-time employed)In training−1.046 (1.784)−0.060−0.5860.558
Part-time employed0.474 (1.449)0.0270.3270.744
Retired2.578 (1.497)0.1471.7210.086
Unemployed0.768 (1.680)0.0440.4570.648
TBI Severity (Ref: Uncomplicated mild)Complicated mild1.277 (1.223)0.0731.0440.298
Moderate1.369 (2.141)0.0780.6400.524
Severe2.013 (1.952)0.1151.0310.304
Injury severity score (ISS)-0.086 (0.046)0.0731.8780.061
Cause of injury (Ref: Road traffic accident)Fall−0.386 (0.971)−0.022−0.3980.691
Violence/other−0.266 (1.289)−0.015−0.2070.836
Clinical care pathways (Ref: ER)Admission1.713 (1.263)0.0981.3560.175
ICU2.060 (1.846)0.1181.1160.265
Length of hospital stay -−0.024 (0.029)−0.025−0.8320.405
Social Relationships *
GOSE (linear)-2.646 (0.900)0.1682.9420.003
GOSE (ordinal)-0.035 (0.676)0.0020.0510.959
Age-−0.035 (0.036)−0.042−0.9650.335
Sex (Ref: Female)Male0.203 (0.841)0.0130.2420.809
Marital status (Ref: Partnered)Partnered1.192 (0.865)0.0761.3770.169
Education level (Ref: College/university)At least secondary/high school−0.237 (1.056)−0.015−0.2250.822
None/primary school−1.068 (1.418)−0.068−0.7530.453
Post-high school training−2.181 (1.151)−0.139−1.8950.058
Employment status (Ref: Full-time employed)In training0.408 (1.654)0.0260.2470.805
Part-time employed−0.350 (1.295)−0.022−0.2700.787
Retired2.075 (1.410)0.1321.4720.142
Unemployed0.458 (1.568)0.0290.2920.770
TBI Severity (Ref: Uncomplicated mild)Complicated mild−0.912 (1.267)−0.058−0.7200.477
Moderate−0.353 (1.976)−0.022−0.1780.859
Severe0.489 (1.969)0.0310.2480.805
Injury severity score (ISS)-0.055 (0.042)0.0521.3050.192
Cause of injury (Ref: Road traffic accident)Fall0.771 (0.894)0.0490.8620.389
Violence/other1.047 (1.187)0.0670.8830.378
Clinical care pathways (Ref: ER)Admission0.645 (1.185)0.0410.5440.587
ICU−1.019 (1.758)−0.065−0.5800.563
Length of hospital stay -−0.008 (0.027)−0.009−0.2960.767
Emotions *
GOSE (linear)-2.985 (1.177)0.1452.5360.011
GOSE (ordinal)-0.259 (0.886)0.0130.2930.770
Age-−0.038 (0.047)−0.035−0.8030.422
Sex (Ref: Female)Male0.901 (1.101)0.0440.8180.414
Marital status (Ref: Partnered)Partnered0.481 (1.132)0.0230.4250.671
Education level (Ref: College/university)At least secondary/high school−2.149 (1.360)−0.105−1.5800.115
None/primary school−1.548 (1.745)−0.075−0.8870.375
Post-high school training−1.348 (1.493)−0.066−0.9030.367
Employment status (Ref: Full-time employed)In training1.807 (2.222)0.0880.8130.417
Part-time employed−0.334 (1.675)−0.016−0.2000.842
Retired1.127 (1.805)0.0550.6240.532
Unemployed1.514 (2.059)0.0740.7350.462
TBI Severity (Ref: Uncomplicated mild)Complicated mild−0.800 (1.436)−0.039−0.5570.578
Moderate−1.690 (2.412)−0.082−0.7010.484
Severe0.075 (2.172)0.0040.0350.972
Injury severity score (ISS)-0.052 (0.056)0.0380.9280.354
Cause of injury (Ref: Road traffic accident)Fall1.728 (1.173)0.0841.4730.141
Violence/other1.182 (1.560)0.0580.7570.449
Clinical care pathways (Ref: ER)Admission0.237 (1.513)0.0120.1570.875
ICU−0.779 (2.186)−0.038−0.3570.722
Length of hospital stay -−0.019 (0.035)−0.017−0.5320.595
Physical Problems *
GOSE (linear)-3.960 (1.024)0.2193.866<0.001
GOSE (ordinal)-1.207 (0.771)0.0671.5650.118
Age-−0.059 (0.040)−0.063−1.4710.141
Sex (Ref: Female)Male0.095 (0.958)0.0050.0990.921
Marital status (Ref: Partnered)Partnered−1.675 (0.991)−0.093−1.6890.091
Education level (Ref: College/university)At least secondary/high school−2.352 (1.209)−0.130−1.9450.053
None/primary school−3.125 (1.506)−0.173−2.0750.038
Post-high school training−2.365 (1.397)−0.131−1.6920.092
Employment status (Ref: Full-time employed)In training−0.444 (1.869)−0.025−0.2380.812
Part-time employed2.336 (1.551)0.1291.5060.134
Retired1.498 (1.563)0.0830.9580.338
Unemployed−2.687 (1.841)−0.149−1.4590.146
TBI Severity (Ref: Uncomplicated mild)Complicated mild0.059 (1.377)0.0030.0430.966
Moderate1.819 (2.153)0.1010.8450.399
Severe1.909 (1.973)0.1060.9670.334
Injury severity score (ISS)-0.032 (0.048)0.0260.6650.506
Cause of injury (Ref: Road traffic accident)Fall1.692 (1.018)0.0941.6620.097
Violence/other1.249 (1.353)0.0690.9230.356
Clinical care pathways (Ref: ER)Admission−1.375 (1.337)−0.076−1.0280.304
ICU−0.395 (1.942)−0.022−0.2030.839
Length of hospital stay -−0.023 (0.031)−0.023−0.7260.468
Note. B = unstandardized regression coefficient, SE = standard error, b = standardized regression coefficient, t = t-value, p = p-value. Values in bold are significant at 5% (total score) or at 0.8% (scale scores; Bonferroni-adjusted marked with *). ER = emergency room, ICU = intensive care unit.
Figure A1. ROC analysis results for the QoLIBRI scale scores changes in relation to the change in the GOSE score (improved vs. not improved).
Figure A1. ROC analysis results for the QoLIBRI scale scores changes in relation to the change in the GOSE score (improved vs. not improved).
Jcm 12 03197 g0a1
Figure A2. Differences in the QoLIBRI scale scores from three (M3) to six (M6) months after TBI. Note. n.s. = not significant, ** significant at Bonferroni-adjusted significance level of α = 0.05/6 = 0.008, V = Wilcoxon test statistic, r = effect size with the following classification: 0.10 ≤ r < 0.30 (small effect), 0.30 ≤ r < 0.50 (medium effect), and r ≥ 0.50 (large effect), p = p-value.
Figure A2. Differences in the QoLIBRI scale scores from three (M3) to six (M6) months after TBI. Note. n.s. = not significant, ** significant at Bonferroni-adjusted significance level of α = 0.05/6 = 0.008, V = Wilcoxon test statistic, r = effect size with the following classification: 0.10 ≤ r < 0.30 (small effect), 0.30 ≤ r < 0.50 (medium effect), and r ≥ 0.50 (large effect), p = p-value.
Jcm 12 03197 g0a2

References

  1. Hays, R.D.; Morales, L.S. The RAND-36 Measure of Health-Related Quality of Life. Ann. Med. 2001, 33, 350–357. [Google Scholar] [CrossRef] [PubMed]
  2. Cella, D.F.; Bonomi, A.E. Measuring Quality of Life: 1995 Update. Oncol. Williston Park N 1995, 9, 47–60. [Google Scholar]
  3. Maas, A.I.R.; Menon, D.K.; Adelson, P.D.; Andelic, N.; Bell, M.J.; Belli, A.; Bragge, P.; Brazinova, A.; Büki, A.; Chesnut, R.M.; et al. Traumatic Brain Injury: Integrated Approaches to Improve Prevention, Clinical Care, and Research. Lancet Neurol. 2017, 16, 987–1048. [Google Scholar] [CrossRef] [PubMed]
  4. von Steinbuechel, N.; Covic, A.; Polinder, S.; Kohlmann, T.; Cepulyte, U.; Poinstingl, H.; Backhaus, J.; Bakx, W.; Bullinger, M.; Christensen, A.-L.; et al. Assessment of Health-Related Quality of Life after TBI: Comparison of a Disease-Specific (QOLIBRI) with a Generic (SF-36) Instrument. Behav. Neurol. 2016, 2016, 7928014. [Google Scholar] [CrossRef]
  5. von Steinbuechel, N.; Petersen, C.; Bullinger, M.; the QOLIBRI Group. Assessment of Health-Related Quality of Life in Persons after Traumatic Brain Injury—Development of the Qolibri, a Specific Measure. Acta Neurochir. Suppl. 2005, 93, 43–49. [Google Scholar] [CrossRef] [PubMed]
  6. Maas, A.I.R.; Stocchetti, N.; Bullock, R. Moderate and Severe Traumatic Brain Injury in Adults. Lancet Neurol. 2008, 7, 728–741. [Google Scholar] [CrossRef]
  7. Coronado, V.G.; Xu, L.; Basavaraju, S.V.; McGuire, L.C.; Wald, M.M.; Faul, M.D.; Guzman, B.R.; Hemphill, J.D.; Centers for Disease Control and Prevention (CDC). Surveillance for Traumatic Brain Injury-Related Deaths—United States, 1997–2007. Morb. Mortal. Wkly. Rep. Surveill. Summ. 2011, 60, 1–32. [Google Scholar]
  8. Brooks, J.C.; Strauss, D.J.; Shavelle, R.M.; Paculdo, D.R.; Hammond, F.M.; Harrison-Felix, C.L. Long-Term Disability and Survival in Traumatic Brain Injury: Results from the National Institute on Disability and Rehabilitation Research Model Systems. Arch. Phys. Med. Rehabil. 2013, 94, 2203–2209. [Google Scholar] [CrossRef]
  9. Majdan, M.; Plancikova, D.; Brazinova, A.; Rusnak, M.; Nieboer, D.; Feigin, V.; Maas, A. Epidemiology of Traumatic Brain Injuries in Europe: A Cross-Sectional Analysis. Lancet Public Health 2016, 1, e76–e83. [Google Scholar] [CrossRef]
  10. Hyder, A.A.; Wunderlich, C.A.; Puvanachandra, P.; Gururaj, G.; Kobusingye, O.C. The Impact of Traumatic Brain Injuries: A Global Perspective. NeuroRehabilitation 2007, 22, 341–353. [Google Scholar] [CrossRef]
  11. Reilly, P. The Impact of Neurotrauma on Society: An International Perspective. In Progress in Brain Research; Elsevier: Amsterdam, The Netherlands, 2007; Volume 161, pp. 3–9. ISBN 978-0-444-53017-2. [Google Scholar]
  12. Brooks, J.C.; Shavelle, R.M.; Strauss, D.J.; Hammond, F.M.; Harrison-Felix, C.L. Long-Term Survival After Traumatic Brain Injury Part II: Life Expectancy. Arch. Phys. Med. Rehabil. 2015, 96, 1000–1005. [Google Scholar] [CrossRef] [PubMed]
  13. Langlois, J.A.; Rutland-Brown, W.; Wald, M.M. The Epidemiology and Impact of Traumatic Brain Injury: A Brief Overview. J. Head Trauma Rehabil. 2006, 21, 375–378. [Google Scholar] [CrossRef] [PubMed]
  14. Ma, V.Y.; Chan, L.; Carruthers, K.J. Incidence, Prevalence, Costs, and Impact on Disability of Common Conditions Requiring Rehabilitation in the United States: Stroke, Spinal Cord Injury, Traumatic Brain Injury, Multiple Sclerosis, Osteoarthritis, Rheumatoid Arthritis, Limb Loss, and Back Pain. Arch. Phys. Med. Rehabil. 2014, 95, 986–995.e1. [Google Scholar] [CrossRef] [PubMed]
  15. Dawson, D.R.; Schwartz, M.L.; Winocur, G.; Stuss, D.T. Return to Productivity Following Traumatic Brain Injury: Cognitive, Psychological, Physical, Spiritual, and Environmental Correlates. Disabil. Rehabil. 2007, 29, 301–313. [Google Scholar] [CrossRef]
  16. Draper, K.; Ponsford, J.; Schönberger, M. Psychosocial and Emotional Outcomes 10 Years Following Traumatic Brain Injury. J. Head Trauma Rehabil. 2007, 22, 278–287. [Google Scholar] [CrossRef]
  17. Wood, R.L.; Rutterford, N. Psychosocial Adjustment 17 Years after Severe Brain Injury. J. Neurol. Neurosurg. Psychiatry 2006, 77, 71–73. [Google Scholar] [CrossRef]
  18. Polinder, S.; Cnossen, M.C.; Real, R.G.L.; Covic, A.; Gorbunova, A.; Voormolen, D.C.; Master, C.L.; Haagsma, J.A.; Diaz-Arrastia, R.; von Steinbuechel, N. A Multidimensional Approach to Post-Concussion Symptoms in Mild Traumatic Brain Injury. Front. Neurol. 2018, 9, 1113. [Google Scholar] [CrossRef]
  19. Walker, W.C.; Pickett, T.C. Motor Impairment after Severe Traumatic Brain Injury: A Longitudinal Multicenter Study. J. Rehabil. Res. Dev. 2007, 44, 975–982. [Google Scholar] [CrossRef]
  20. Moore, E.L.; Terryberry-Spohr, L.; Hope, D.A. Mild Traumatic Brain Injury and Anxiety Sequelae: A Review of the Literature. Brain Inj. 2006, 20, 117–132. [Google Scholar] [CrossRef]
  21. Teymoori, A.; Real, R.; Gorbunova, A.; Haghish, E.F.; Andelic, N.; Wilson, L.; Asendorf, T.; Menon, D.; von Steinbüchel, N. Measurement Invariance of Assessments of Depression (PHQ-9) and Anxiety (GAD-7) across Sex, Strata and Linguistic Backgrounds in a European-Wide Sample of Patients after Traumatic Brain Injury. J. Affect. Disord. 2020, 262, 278–285. [Google Scholar] [CrossRef]
  22. Wang, B.; Zeldovich, M.; Rauen, K.; Wu, Y.-J.; Covic, A.; Muller, I.; Haagsma, J.A.; Polinder, S.; Menon, D.; Asendorf, T.; et al. Longitudinal Analyses of the Reciprocity of Depression and Anxiety after Traumatic Brain Injury and Its Clinical Implications. J. Clin. Med. 2021, 10, 5597. [Google Scholar] [CrossRef] [PubMed]
  23. Jorge, R.E.; Robinson, R.G.; Moser, D.; Tateno, A.; Crespo-Facorro, B.; Arndt, S. Major Depression Following Traumatic Brain Injury. Arch. Gen. Psychiatry 2004, 61, 42–50. [Google Scholar] [CrossRef] [PubMed]
  24. van der Vlegel, M.; Polinder, S.; Mikolic, A.; Kaplan, R.; von Steinbuechel, N.; Plass, A.; Zeldovich, M.; van Praag, D.; Bockhop, F.; Cunitz, K.; et al. The Association of Post-Concussion and Post-Traumatic Stress Disorder Symptoms with Health-Related Quality of Life, Health Care Use and Return-to-Work after Mild Traumatic Brain Injury. J. Clin. Med. 2021, 10, 2473. [Google Scholar] [CrossRef] [PubMed]
  25. Verhaeghe, S.; Defloor, T.; Grypdonck, M. Stress and Coping among Families of Patients with Traumatic Brain Injury: A Review of the Literature. J. Clin. Nurs. 2005, 14, 1004–1012. [Google Scholar] [CrossRef] [PubMed]
  26. von Steinbuechel, N.; Wilson, L.; Gibbons, H.; Hawthorne, G.; Höfer, S.; Schmidt, S.; Bullinger, M.; Maas, A.; Neugebauer, E.; Powell, J.; et al. Quality of Life after Brain Injury (QOLIBRI): Scale Development and Metric Properties. J. Neurotrauma 2010, 27, 1167–1185. [Google Scholar] [CrossRef]
  27. von Steinbuechel, N.; Wilson, L.; Gibbons, H.; Hawthorne, G.; Höfer, S.; Schmidt, S.; Bullinger, M.; Maas, A.; Neugebauer, E.; Powell, J.; et al. Quality of Life after Brain Injury (QOLIBRI): Scale Validity and Correlates of Quality of Life. J. Neurotrauma 2010, 27, 1157–1165. [Google Scholar] [CrossRef]
  28. von Steinbuechel, N.; Rauen, K.; Krenz, U.; Wu, Y.-J.; Covic, A.; Plass, A.; Cunitz, K.; Mueller, I.; Bockhop, F.; Polinder, S.; et al. Translation and Linguistic Validation of Outcome Instruments for Traumatic Brain Injury Research and Clinical Practice: A Step-by-Step Approach within the Observational CENTER-TBI Study. J. Clin. Med. 2021, 10, 2863. [Google Scholar] [CrossRef]
  29. von Steinbuechel, N.; Rauen, K.; Bockhop, F.; Covic, A.; Krenz, U.; Plass, A.; Cunitz, K.; Polinder, S.; Wilson, L.; Steyerberg, E.; et al. Psychometric Characteristics of the Patient-Reported Outcome Measures Applied in the CENTER-TBI Study. J. Clin. Med. 2021, 10, 2396. [Google Scholar] [CrossRef]
  30. Giustini, M.; Longo, E.; Azicnuda, E.; Silvestro, D.; D’Ippolito, M.; Rigon, J.; Cedri, C.; Bivona, U.; Barba, C.; Formisano, R. Health-Related Quality of Life after Traumatic Brain Injury: Italian Validation of the QOLIBRI. Funct. Neurol. 2014, 29, 167–176. [Google Scholar]
  31. Hawthorne, G.; Kaye, A.H.; Gruen, R.; Houseman, D.; Bauer, I. Traumatic Brain Injury and Quality of Life: Initial Australian Validation of the QOLIBRI. J. Clin. Neurosci. 2011, 18, 197–202. [Google Scholar] [CrossRef]
  32. Siponkoski, S.; Wilson, L.; Steinbüchel, N.; Sarajuuri, J.; Koskinen, S. Quality of Life after Traumatic Brain Injury: Finnish Experience of the QOLIBRI in Residential Rehabilitation. J. Rehabil. Med. 2013, 45, 835–842. [Google Scholar] [CrossRef] [PubMed]
  33. Soberg, H.L.; Roe, C.; Brunborg, C.; von Steinbüchel, N.; Andelic, N. The Norwegian Version of the QOLIBRI—A Study of Metric Properties Based on a 12 Month Follow-up of Persons with Traumatic Brain Injury. Health Qual. Life Outcomes 2017, 15, 14. [Google Scholar] [CrossRef] [PubMed]
  34. Castaño-León, A.M.; Navarro-Main, B.; Gomez, P.A.; Gil, A.; Soler, M.D.; Lagares, A.; Bernabeu, M.; Steinbüchel, N.v.; Real, R.G.L. Quality of Life After Brain Injury: Psychometric Properties of the Spanish Translation of the QoLIBRI. Eval. Health Prof. 2018, 41, 456–473. [Google Scholar] [CrossRef] [PubMed]
  35. von Steinbuechel, N.; Rauen, K.; Covic, A.; Krenz, U.; Bockhop, F.; Mueller, I.; Cunitz, K.; Polinder, S.; Steyerberg, E.W.; Vester, J.; et al. Sensitivity of Outcome Instruments in a Priori Selected Patient Groups after Traumatic Brain Injury: Results from the CENTER-TBI Study. PLoS ONE 2023, 18, e0280796. [Google Scholar] [CrossRef] [PubMed]
  36. Brazier, J.E.; Harper, R.; Jones, N.M.; O’Cathain, A.; Thomas, K.J.; Usherwood, T.; Westlake, L. Validating the SF-36 Health Survey Questionnaire: New Outcome Measure for Primary Care. BMJ 1992, 305, 160–164. [Google Scholar] [CrossRef] [PubMed]
  37. von Steinbüchel, N.; Meeuwsen, M.; Zeldovich, M.; Vester, J.C.; Maas, A.; Koskinen, S.; Covic, A. Differences in Health-Related Quality of Life after Traumatic Brain Injury between Varying Patient Groups: Sensitivity of a Disease-Specific (QOLIBRI) and a Generic (SF-36) Instrument. J. Neurotrauma 2020, 37, 1242–1254. [Google Scholar] [CrossRef] [PubMed]
  38. Albrecht, G.L.; Devlieger, P.J. The Disability Paradox: High Quality of Life against All Odds. Soc. Sci. Med. 1999, 48, 977–988. [Google Scholar] [CrossRef] [PubMed]
  39. Ahmed, S.; Mayo, N.E.; Wood-Dauphinee, S.; Hanley, J.A.; Robin Cohen, S. Response Shift Influenced Estimates of Change in Health-Related Quality of Life Poststroke. J. Clin. Epidemiol. 2004, 57, 561–570. [Google Scholar] [CrossRef]
  40. Ring, L.; Höfer, S.; Heuston, F.; Harris, D.; O’Boyle, C.A. Response Shift Masks the Treatment Impact on Patient Reported Outcomes (PROs): The Example of Individual Quality of Life in Edentulous Patients. Health Qual. Life Outcomes 2005, 3, 55. [Google Scholar] [CrossRef]
  41. Postulart, D.; Adang, E.M.M. Response Shift and Adaptation in Chronically III Patients. Med. Decis. Mak. 2000, 20, 186–193. [Google Scholar] [CrossRef]
  42. Schwartz, C.E.; Sprangers, M.A.G. (Eds.) Adaptation to Changing Health: Response Shift in Quality-of-Life Research, 1st ed.; American Psychological Association: Washington, DC, USA, 2000; ISBN 978-1-55798-710-5. [Google Scholar]
  43. Schwartz, C.E.; Andresen, E.M.; Nosek, M.A.; Krahn, G.L. Response Shift Theory: Important Implications for Measuring Quality of Life in People with Disability. Arch. Phys. Med. Rehabil. 2007, 88, 529–536. [Google Scholar] [CrossRef] [PubMed]
  44. Terwee, C.B.; Dekker, F.W.; Wiersinga, W.M.; Prummel, M.F.; Bossuyt, P.M.M. On Assessing Responsiveness of Health-Related Quality of Life Instruments: Guidelines for Instrument Evaluation. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehabil. 2003, 12, 349–362. [Google Scholar] [CrossRef] [PubMed]
  45. Husted, J.A.; Cook, R.J.; Farewell, V.T.; Gladman, D.D. Methods for Assessing Responsiveness: A Critical Review and Recommendations. J. Clin. Epidemiol. 2000, 53, 459–468. [Google Scholar] [CrossRef] [PubMed]
  46. Wilson, J.T.L.; Pettigrew, L.E.L.; Teasdale, G. Structured Interviews for the Glasgow Outcome Scale and the Extended Glasgow Outcome Scale: Guidelines for Their Use. J. Neurotrauma 1998, 15, 573–585. [Google Scholar] [CrossRef] [PubMed]
  47. Maas, A.I.R.; Menon, D.K.; Steyerberg, E.W.; Citerio, G.; Lecky, F.; Manley, G.T.; Hill, S.; Legrand, V.; Sorgner, A. Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI): A Prospective Longitudinal Observational Study. Neurosurgery 2015, 76, 67–80. [Google Scholar] [CrossRef]
  48. Steyerberg, E.W.; Wiegers, E.; Sewalt, C.; Buki, A.; Citerio, G.; De Keyser, V.; Ercole, A.; Kunzmann, K.; Lanyon, L.; Lecky, F.; et al. Case-Mix, Care Pathways, and Outcomes in Patients with Traumatic Brain Injury in CENTER-TBI: A European Prospective, Multicentre, Longitudinal, Cohort Study. Lancet Neurol. 2019, 18, 923–934. [Google Scholar] [CrossRef]
  49. Teasdale, G.; Jennett, B. Assessment of Coma and Impaired Consciousness. A Practical Scale. Lancet 1974, 2, 81–84. [Google Scholar] [CrossRef]
  50. Marmarou, A.; Lu, J.; Butcher, I.; McHugh, G.S.; Murray, G.D.; Steyerberg, E.W.; Mushkudiani, N.A.; Choi, S.; Maas, A.I.R. Prognostic Value of The Glasgow Coma Scale and Pupil Reactivity in Traumatic Brain Injury Assessed Pre-Hospital and on Enrollment: An IMPACT Analysis. J. Neurotrauma 2007, 24, 270–280. [Google Scholar] [CrossRef]
  51. Baker, S.P.; O’Neill, B.; Haddon, W.; Long, W.B. The Injury Severity Score: A Method for Describing Patients with Multiple Injuries and Evaluating Emergency Care. J. Trauma 1974, 14, 187–196. [Google Scholar] [CrossRef]
  52. Wilson, J.T.L.; Edwards, P.; Fiddes, H.; Stewart, E.; Teasdale, G.M. Reliability of Postal Questionnaires for the Glasgow Outcome Scale. J. Neurotrauma 2002, 19, 999–1005. [Google Scholar] [CrossRef]
  53. Rosseel, Y. Lavaan: An R Package for Structural Equation Modeling. J. Stat. Softw. 2012, 48, 1–36. [Google Scholar] [CrossRef]
  54. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2022; Available online: https://www.R-project.org/ (accessed on 27 April 2023).
  55. Hu, L.; Bentler, P. Evaluating Model Fit. In Structural Equation Modeling; Hoyle, R.H., Ed.; Sage Publications: Thousand Oaks, CA, USA, 1995; pp. 76–99. ISBN 0-8039-5318-6. [Google Scholar]
  56. Brown, T.A. Confirmatory Factor Analysis for Applied Research, 2nd ed.; Methodology in the Social Sciences; The Guilford Press: New York, NY, USA; London, UK, 2015; ISBN 978-1-4625-1779-4. [Google Scholar]
  57. Hu, L.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  58. Liu, Y.; Millsap, R.E.; West, S.G.; Tein, J.-Y.; Tanaka, R.; Grimm, K.J. Testing Measurement Invariance in Longitudinal Data with Ordered-Categorical Measures. Psychol. Methods 2017, 22, 486–506. [Google Scholar] [CrossRef]
  59. Oort, F.J. Using Structural Equation Modeling to Detect Response Shifts and True Change. Qual. Life Res. Int. J. Qual. Life Asp. Treat. Care Rehabil. 2005, 14, 587–598. [Google Scholar] [CrossRef] [PubMed]
  60. Wu, H.; Estabrook, R. Identification of Confirmatory Factor Analysis Models of Different Levels of Invariance for Ordered Categorical Outcomes. Psychometrika 2016, 81, 1014–1045. [Google Scholar] [CrossRef] [PubMed]
  61. Bates, D.; Mächler, M.; Bolker, B.; Walker, S. Fitting Linear Mixed-Effects Models Using Lme4. J. Stat. Softw. 2015, 67, 48. [Google Scholar] [CrossRef]
  62. Van Buuren, S.; Groothuis-Oudshoorn, K. Mice: Multivariate Imputation by Chained Equations in R. J. Stat. Softw. 2011, 45, 1–67. [Google Scholar] [CrossRef]
  63. Robin, X.; Turck, N.; Hainard, A.; Tiberti, N.; Lisacek, F.; Sanchez, J.-C.; Müller, M. PROC: An Open-Source Package for R and S+ to Analyze and Compare ROC Curves. BMC Bioinform. 2011, 12, 77. [Google Scholar] [CrossRef]
  64. van der Windt, D.A.W.M.; van der Heijden, G.J.M.G.; de Winter, A.F.; Koes, B.W.; Deville, W.; Bouter, L.M. The Responsiveness of the Shoulder Disability Questionnaire. Ann. Rheum. Dis. 1998, 57, 82–87. [Google Scholar] [CrossRef]
  65. Kassambara, A. Rstatix: Pipe-Friendly Framework for Basic Statistical Tests. 2022. R Package Version 0.7.2. Available online: https://CRAN.R-project.org/package=rstatix (accessed on 27 April 2023).
  66. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; L. Erlbaum Associates: Hillsdale, NJ, USA, 1988; ISBN 978-0-8058-0283-2. [Google Scholar]
  67. Gardner, R.C.; Cheng, J.; Ferguson, A.R.; Boylan, R.; Boscardin, J.; Zafonte, R.D.; Manley, G.T.; The Citicoline Brain Injury Treatment Trial Investigators; Zafonte, R.D.; Bagiella, E.; et al. Divergent Six Month Functional Recovery Trajectories and Predictors after Traumatic Brain Injury: Novel Insights from the Citicoline Brain Injury Treatment Trial Study. J. Neurotrauma 2019, 36, 2521–2532. [Google Scholar] [CrossRef]
  68. Losoi, H.; Silverberg, N.D.; Wäljas, M.; Turunen, S.; Rosti-Otajärvi, E.; Helminen, M.; Luoto, T.M.; Julkunen, J.; Öhman, J.; Iverson, G.L. Recovery from Mild Traumatic Brain Injury in Previously Healthy Adults. J. Neurotrauma 2016, 33, 766–776. [Google Scholar] [CrossRef] [PubMed]
  69. Vedantam, A.; Robertson, C.S.; Gopinath, S.P. Clinical Characteristics and Temporal Profile of Recovery in Patients with Favorable Outcomes at 6 Months after Severe Traumatic Brain Injury. J. Neurosurg. 2018, 129, 234–240. [Google Scholar] [CrossRef] [PubMed]
  70. McCrea, M.A.; Giacino, J.T.; Barber, J.; Temkin, N.R.; Nelson, L.D.; Levin, H.S.; Dikmen, S.; Stein, M.; Bodien, Y.G.; Boase, K.; et al. Functional Outcomes Over the First Year After Moderate to Severe Traumatic Brain Injury in the Prospective, Longitudinal TRACK-TBI Study. JAMA Neurol. 2021, 78, 982. [Google Scholar] [CrossRef] [PubMed]
  71. Cassidy, J.D.; Boyle, E.; Carroll, L.J. Population-Based, Inception Cohort Study of the Incidence, Course, and Prognosis of Mild Traumatic Brain Injury After Motor Vehicle Collisions. Arch. Phys. Med. Rehabil. 2014, 95, S278–S285. [Google Scholar] [CrossRef] [PubMed]
  72. von Steinbuechel, N.; Real, R.G.L.; Sasse, N.; Wilson, L.; Otto, C.; Mullins, R.; Behr, R.; Deinsberger, W.; Martinez-Olivera, R.; Puschendorf, W.; et al. German Validation of Quality of Life after Brain Injury (QOLIBRI) Assessment and Associated Factors. PLoS ONE 2017, 12, e0176668. [Google Scholar] [CrossRef]
  73. Wilson, L.; Marsden-Loftus, I.; Koskinen, S.; Bakx, W.; Bullinger, M.; Formisano, R.; Maas, A.; Neugebauer, E.; Powell, J.; Sarajuuri, J.; et al. Interpreting Quality of Life after Brain Injury Scores: Cross-Walk with the Short Form-36. J. Neurotrauma 2017, 34, 59–65. [Google Scholar] [CrossRef]
  74. von Steinbuechel, N.; Hahm, S.; Muehlan, H.; Arango-Lasprilla, J.C.; Bockhop, F.; Covic, A.; Schmidt, S.; Steyerberg, E.W.; Maas, A.I.R.; Menon, D.; et al. Impact of Sociodemographic, Premorbid, and Injury-Related Factors on Patient-Reported Outcome Trajectories after Traumatic Brain Injury (TBI). J. Clin. Med. 2023, 12, 2246. [Google Scholar] [CrossRef]
  75. Williams, M.W.; Rapport, L.J.; Millis, S.R.; Hanks, R.A. Psychosocial Outcomes after Traumatic Brain Injury: Life Satisfaction, Community Integration, and Distress. Rehabil. Psychol. 2014, 59, 298–305. [Google Scholar] [CrossRef]
  76. Andelic, N.; Røe, C.; Tenovuo, O.; Azouvi, P.; Dawes, H.; Majdan, M.; Ranta, J.; Howe, E.I.; Wiegers, E.J.A.; Tverdal, C.; et al. Unmet Rehabilitation Needs after Traumatic Brain Injury across Europe: Results from the CENTER-TBI Study. J. Clin. Med. 2021, 10, 1035. [Google Scholar] [CrossRef]
  77. Howe, E.I.; Zeldovich, M.; Andelic, N.; von Steinbuechel, N.; Fure, S.C.R.; Borgen, I.M.H.; Forslund, M.V.; Hellstrøm, T.; Søberg, H.L.; Sveen, U.; et al. Rehabilitation and Outcomes after Complicated vs. Uncomplicated Mild TBI: Results from the CENTER-TBI Study. BMC Health Serv. Res. 2022, 22, 1536. [Google Scholar] [CrossRef]
  78. Born, K.; Amsler, F.; Gross, T. Prospective Evaluation of the Quality of Life after Brain Injury (QOLIBRI) Score: Minor Differences in Patients with Major versus No or Mild Traumatic Brain Injury at One-Year Follow Up. Health Qual. Life Outcomes 2018, 16, 136. [Google Scholar] [CrossRef] [PubMed]
  79. Tulsky, D.S.; Kisala, P.A.; Victorson, D.; Carlozzi, N.; Bushnik, T.; Sherer, M.; Choi, S.W.; Heinemann, A.W.; Chiaravalloti, N.; Sander, A.M.; et al. TBI-QOL: Development and Calibration of Item Banks to Measure Patient Reported Outcomes Following Traumatic Brain Injury. J. Head Trauma Rehabil. 2016, 31, 40–51. [Google Scholar] [CrossRef] [PubMed]
  80. McCullagh, S. Outcome after Mild Traumatic Brain Injury: An Examination of Recruitment Bias. J. Neurol. Neurosurg. Psychiatry 2003, 74, 39–43. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Sample attrition plot. Note. M3 = 3 months after TBI, M6 = 6 months after TBI, GOSE = Glasgow Outcome Scale–Extended.
Figure 1. Sample attrition plot. Note. M3 = 3 months after TBI, M6 = 6 months after TBI, GOSE = Glasgow Outcome Scale–Extended.
Jcm 12 03197 g001
Figure 2. QoLIBRI mean change scores with 95% confidence intervals presented by changes in recovery status (GOSE). Note. M3 = three months after TBI, M6 = six months after TBI.
Figure 2. QoLIBRI mean change scores with 95% confidence intervals presented by changes in recovery status (GOSE). Note. M3 = three months after TBI, M6 = six months after TBI.
Jcm 12 03197 g002
Figure 3. ROC analysis result for the QoLIBRI total score change in relation to the change in the GOSE score (improved vs. not improved).
Figure 3. ROC analysis result for the QoLIBRI total score change in relation to the change in the GOSE score (improved vs. not improved).
Jcm 12 03197 g003
Figure 4. Differences in the QoLIBRI total score from three (M3) to six (M6) months after TBI. Note. ** significant at α = 0.05, V = Wilcoxon test statistic, r = effect size with the following classification: 0.10 ≤ r < 0.30 (small effect), 0.30 ≤ r < 0.50 (medium effect), and r ≥ 0.50 (large effect), p = p-value.
Figure 4. Differences in the QoLIBRI total score from three (M3) to six (M6) months after TBI. Note. ** significant at α = 0.05, V = Wilcoxon test statistic, r = effect size with the following classification: 0.10 ≤ r < 0.30 (small effect), 0.30 ≤ r < 0.50 (medium effect), and r ≥ 0.50 (large effect), p = p-value.
Jcm 12 03197 g004
Table 1. Characteristics of the study sample included and not included in the analysis.
Table 1. Characteristics of the study sample included and not included in the analysis.
Included in the Study Sample
Value/GroupYes (n = 1659)No (n = 2850)p
AgeM (SD)49.61 (19.15)48.59 (22.45)0.219
SexMale1077 (64.92%)1946 (68.28%)0.022
Female582 (35.08%)904 (31.72%)
Marital statusPartnered889 (53.59%)1181 (41.44%)<0.001
Single767 (46.23%)1647 (57.79%)
Missing 3 (0.18%)22 (0.77%)
Education levelAt least secondary/high school547 (32.97%)832 (29.19%)<0.001
College/university464 (27.97%)386 (13.54%)
None/primary school207 (12.48%)434 (15.23%)
Post-high school training293 (17.66%)403 (14.14%)
Missing 148 (8.92%)795 (27.90%)
Employment statusFull-time employed718 (43.28%)867 (30.42%)<0.001
In training154 (9.28%)332 (11.65%)
Part-time employed196 (11.82%)195 (6.84%)
Retired389 (23.45%)723 (25.37%)
Unemployed123 (7.41%)283 (9.93%)
Missing 79 (4.76%)450 (15.79%)
TBI severity
(Glasgow Coma Scale; GCS)
Uncomplicated mild546 (32.91%)729 (25.58%)<0.001
Complicated mild501 (30.20%)563 (19.75%)
Moderate113 (6.81%)276 (9.68%)
Severe236 (14.23%)750 (26.32%)
Missing 263 (15.85%)532 (18.67%)
Injury severity score (ISS)M (SD)18.04 (14.85)22.72 (17.79)<0.001
Functional status change
(Glasgow Outcome Scale–Extended; GOSE)
Improved516 (31.10%)494 (17.33%)<0.001
Stable918 (55.34%)1521 (53.37%)
Worsened225 (13.56%)113 (3.97%)
Missing 0 (0%)722 (25.33%)
Cause of injuryFall715 (43.10%)1309 (45.93%)<0.001
Road traffic accident692 (41.71%))990 (34.74%)
Violent/other251 (15.13%)532 (18.67%)
Missing 1 (0.06%)19 (0.66%)
Clinical care pathwaysER383 (23.09%)465 (16.32%)<0.001
Admission640 (38.58%)883 (30.98%)
ICU636 (38.34%)1502 (52.70%)
Length of hospital stay (in days) M (SD)10.56 (18.18)13.30 (22.60)<0.001
Missing 29 (1.75%)89 (3.12%)
Note. n = absolute frequencies, p = p-value, M = mean, SD = Standard deviation. Welch’s t-test was used for all continuous variables due to non-normal distribution; χ2-tests and permutation-based χ2-tests (n < 5 observations per cell; N = 5000 permutations) were used for categorical data.
Table 2. Results of the confirmatory factor analysis (N = 1390).
Table 2. Results of the confirmatory factor analysis (N = 1390).
Confirmatory Factor Analysisχ2 Difference Test
Modelχ2CFIRMSEA [CI90%]SRMRχ2 (∆df)p
3 months post-injury
One Factor15,281.52 (629)0.8210.130 [0.128; 0.131]0.096--
Two Factor10,939.70 (628)0.8740.109 [0.107; 0.111]0.078460.77 (1)<0.001
Six Factor4121.54 (614)0.9540.064 [0.062; 0.066]0.0411766.03 (14)<0.001
Two Level4532.72 (623)0.9490.067 [0.065; 0.069]0.052251.92 (9)<0.001
6 months post-injury
One Factor14,024.43 (629)0.8420.124 [0.122; 0.126]0.086--
Two Factor10,358.82 (628)0.8850.106 [0.104; 0.107]0.070414.20 (1)<0.001
Six Factor3775.89 (614)0.9630.061 [0.059; 0.063]0.0371854.56 (14)<0.001
Two Level4153.73 (623)0.9580.064 [0.062; 0.066]0.047229.28 (9)<0.001
Note. CFI = comparative fit index (>0.95), RMSEA = root mean square error of approximation (<0.06) with a 90-percent confidence interval, SRMR = standardized root mean square residual (<0.08). Model in bold shows the best fit.
Table 3. Results of the measurement invariance analysis (N = 1390).
Table 3. Results of the measurement invariance analysis (N = 1390).
Measurement Invariance Analysisχ2 Difference Test
Modelχ2 (df) CFIRSMEA [CI90%]SRMRχ2 (∆df)p
Cognition
Configural594.04 (69)0.9880.074 [0.069; 0.080]0.027--
Loading598.08 (75)0.9880.071 [0.066; 0.076]0.0273.34 (6)0.766
Threshold577.46 (95)0.9890.060 [0.056; 0.065]0.02714.50 (20)0.804
Residual545.55 (102)0.9900.056 [0.051; 0.061]0.02827.26 (7)<0.001
Self
Configural1357.32 (69)0.9710.116 [0.111; 0.121]0.039--
Loading1372.96 (75)0.9710.112 [0.106; 0.117]0.0395.63 (6)0.466
Threshold1397.01 (95)0.9720.099 [0.095; 0.104]0.03931.11 (20)0.054
Residual1260.64 (102)0.9800.090 [0.086; 0.095]0.04020.41 (7)0.005
Daily Life & Autonomy
Configural558.81 (69)0.9880.071 [0.066; 0.077]0.027--
Loading565.64 (75)0.9880.069 [0.063; 0.074]0.0276.69 (6)0.350
Threshold592.84 (95)0.9890.061 [0.057; 0.066]0.02733.41 (20)0.030
Residual *------
Social Relationships
Configural718.35 (47)0.9710.101 [0.095; 0.108]0.039--
Loading736.49 (52)0.9710.097 [0.091; 0.104]0.0397.06 (5)0.216
Threshold728.63 (68)0.9720.084 [0.078; 0.089]0.03931.13 (16)0.010
Residual *------
Emotions
Configural196.23 (29)0.9880.064 [0.056; 0.073]0.024--
Loading198.94 (33)0.9880.060 [0.052; 0.068]0.0243.74 (4)0.443
Threshold195.40 (47)0.9890.048 [0.041; 0.055]0.02413.02 (14)0.525
Residual200.39 (52)0.9900.045 [0.039; 0.052]0.02515.10 (5)0.010
Physical Problems
Configural228.77 (29)0.9880.070 [0.062; 0.079]0.035--
Loading228.48 (33)0.9880.065 [0.057; 0.073]0.0343.86 (4)0.426
Threshold259.25 (47)0.9890.057 [0.050; 0.064]0.03530.04 (14)0.008
Residual *------
* Residual invariance for Daily Life & Autonomy, Social Relationships, and Physical problems scales not reported; practical significance examined instead (see Supplemental Material S1). Note. χ2 = chi-square value, df = degrees of freedom, CFI = comparative fit index (>0.95), RMSEA = root mean square error of approximation (<0.06) with a 90-percent confidence interval, SRMR = standardized root mean square residual (<0.08). Values in italic are significant at 5%.
Table 4. Results of regression analyses.
Table 4. Results of regression analyses.
ScalePredictorB (SE)btp
TotalGOSE (linear)4.129 (0.680)0.3446.073<0.001
GOSE (quadratic)0.223 (0.511)0.0190.4360.663
Cognition *GOSE (linear)3.365 (0.904)0.2133.722<0.001
GOSE (quadratic)−0.758 (0.680)−0.048−1.1140.265
Self *GOSE (linear)4.725 (0.932)0.2895.070<0.001
GOSE (quadratic)−0.223 (0.701)−0.014−0.3180.750
Daily Life & Autonomy *GOSE (linear)6.384 (0.977)0.3656.536<0.001
GOSE (quadratic)1.204 (0.735)0.0691.6390.102
Social Relationships *GOSE (linear)2.646 (0.900)0.1682.9420.003
GOSE (quadratic)0.035 (0.676)0.0020.0510.959
Emotions *GOSE (linear)2.985 (1.177)0.1452.5360.011
GOSE (quadratic)0.259 (0.886)0.0130.2930.770
Physical Problems *GOSE (linear)3.960 (1.024)0.2193.866<0.001
GOSE (quadratic)1.207 (0.771)0.0671.5650.118
Note. Results of regression analyses controlling for the following variables: age, sex, marital status, education level, employment status, TBI severity, injury severity (ISS), cause of injury, clinical care pathways, length of hospital stay (for details, see Appendix A-Table A2). B = unstandardized regression coefficient, SE = standard error, b = standardized regression coefficient, t = t-value, p = p-value. Values in bold are significant at 5% (total score) or at 0.8% (scale scores; Bonferroni-adjusted marked with *).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zeldovich, M.; Hahm, S.; Mueller, I.; Krenz, U.; Bockhop, F.; von Steinbuechel, N.; the CENTER-TBI Participants and Investigators. Longitudinal Internal Validity of the Quality of Life after Brain Injury: Response Shift and Responsiveness. J. Clin. Med. 2023, 12, 3197. https://doi.org/10.3390/jcm12093197

AMA Style

Zeldovich M, Hahm S, Mueller I, Krenz U, Bockhop F, von Steinbuechel N, the CENTER-TBI Participants and Investigators. Longitudinal Internal Validity of the Quality of Life after Brain Injury: Response Shift and Responsiveness. Journal of Clinical Medicine. 2023; 12(9):3197. https://doi.org/10.3390/jcm12093197

Chicago/Turabian Style

Zeldovich, Marina, Stefanie Hahm, Isabelle Mueller, Ugne Krenz, Fabian Bockhop, Nicole von Steinbuechel, and the CENTER-TBI Participants and Investigators. 2023. "Longitudinal Internal Validity of the Quality of Life after Brain Injury: Response Shift and Responsiveness" Journal of Clinical Medicine 12, no. 9: 3197. https://doi.org/10.3390/jcm12093197

APA Style

Zeldovich, M., Hahm, S., Mueller, I., Krenz, U., Bockhop, F., von Steinbuechel, N., & the CENTER-TBI Participants and Investigators. (2023). Longitudinal Internal Validity of the Quality of Life after Brain Injury: Response Shift and Responsiveness. Journal of Clinical Medicine, 12(9), 3197. https://doi.org/10.3390/jcm12093197

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop