Next Article in Journal
Regulatory Flexibility of Sustaining Daily Routines and Mental Health in Adaptation to Financial Strain: A Vignette Approach
Next Article in Special Issue
Blended Care in In-Patient Acute Psychiatric Care. The Example of a Group Training for Social Competences in Adults—A Pretest–Posttest Feasibility Study
Previous Article in Journal
Successful Aging Perception in Middle-Aged Korean Men: A Q Methodology Approach
Previous Article in Special Issue
Development, Implementation and First Evaluation of an Online Portal to Promote the Mental Health of University Students (me@JGU)
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 18
Issue 6
10.3390/ijerph18063102
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Pragmatic Quasi-Experimental Controlled Trial Evaluating the Outcomes of Blended CBT Compared to Face-to-Face CBT and Treatment as Usual for Adolescents with Depressive Disorders

by
Sanne P.A. Rasing
1,2,*,
Yvonne A.J. Stikkelbroek
1,2,
Wouter den Hollander
3,
Heleen Riper
4,5,6,
Maja Deković
1,
Maaike H. Nauta
7,8,
Daan H.M. Creemers
2,9,
Marianne C.P. Immink
10,
Mariken Spuij
1,11 and
Denise H.M. Bodden
1,12
1
Clinical Child and Family Studies, Utrecht University, 3508 TC Utrecht, The Netherlands
2
Child and Adolescent Psychiatry, GGZ Oost Brabant, 5427 EM Boekel, The Netherlands
3
Trimbos Institute, 3521 VS Utrecht, The Netherlands
4
Department of Clinical, Neuro- and Developmental Psychology, VU University, 1081 HV Amsterdam, The Netherlands
5
Department of Psychiatry, VU University Medical Centre, 1081 HV Amsterdam, The Netherlands
6
APH Institute for Health and Care Research, VU University Medical Centre, 1081 HV Amsterdam, The Netherlands
7
Department of Clinical Psychology and Experimental Psychopathology, University of Groningen, 9712 CP Groningen, The Netherlands
8
Accare Child and Adolescent Psychiatry, Groningen University Centre, 9712 CP Groningen, The Netherlands
9
Behavioural Science Institute, Radboud University, 6525 XZ Nijmegen, The Netherlands
10
Triversum, GGZ Noord-Holland-Noord, 1817 EZ Alkmaar, The Netherlands
11
TOPP-Zorg, Driebergen-Rijsenburg, 3972 WG Driebergen-Rijsenburg, The Netherlands
12
Child and Youth Psychiatry, Altrecht, 3524 SH Utrecht, The Netherlands
 
add Show full affiliation list
 
remove Hide full affiliation list
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(6), 3102; https://doi.org/10.3390/ijerph18063102
Submission received: 8 January 2021 / Revised: 11 March 2021 / Accepted: 15 March 2021 / Published: 17 March 2021
(This article belongs to the Special Issue Digital Interventions for the Treatment and Prevention of Mental Health Disorders)
Browse Figure
Versions Notes

Abstract

:
Depression is a major problem in youth mental health. Current treatment is on average effective, but adolescents are hesitant to seek help. Blended treatment could lower the barriers to seeking treatment. Evidence on effectiveness is, however, scarce. The present pragmatic quasi-experimental controlled trial aimed to compare the outcomes of blended cognitive behavioral therapy (CBT) to face-to-face CBT and treatment as usual. A total of 129 adolescents with clinical depression (82.2% female), aged 13–22 (M = 16.60, SD = 2.03) received blended CBT, face-to-face CBT or treatment as usual. Clinical diagnosis, depressive symptoms, and secondary outcomes were assessed at baseline, post-intervention, and six-months follow-up. Participants receiving blended CBT were, compared to participants receiving face-to-face CBT and treatment as usual, evenly likely to be in remission from their depressive disorder at post-intervention and at six-month follow-up. Depressive symptoms decreased significantly over time in all three conditions, and changes were not significantly different between conditions. Other secondary outcomes (suicide risk, internalizing and externalizing symptoms, severity of depression, and global functioning) did not differ between treatment conditions at post-intervention and six-month follow-up. Since there was no evidence for favorable outcomes for face-to-face therapies above blended CBT, blended CBT may also be an effective treatment format in clinical practice.

1. Background

Depression has been identified as one of the most prevalent mental health disorders in adolescents and for boys and girls aged 10 to 19 years and is the most important cause of burden and disability [1]. Depressive disorders show a high comorbidity with other mental health disorders [2], have a high risk of recurrence and chronicity [3,4], and are a major risk for suicidal behavior and completed suicide [5]. Furthermore, depression during adolescence is negatively related to social and family functioning [6,7], associated with poor academic and occupational performance [7,8], and related to poor physical and mental health in later life [9,10].
Several meta-analyses have shown that Cognitive Behavioral Therapy (CBT) and Interpersonal Therapy (IPT) are both effective interventions for adolescents with a depressive disorder [11,12,13,14]. There is ample research showing positive effects and both interventions are qualified as first choice treatment for adolescents suffering from depression in several national and international guidelines [15,16]. However, it is also known that effect sizes are on average small to moderate and not all adolescents show improvement and are free of symptoms after receiving treatment [14,17,18]. Importantly, adolescents themselves mentioned lack of time, high costs, lack of available transport, perceived social stigma, and limited treatment resources as the most important reasons for not seeking help [19,20]. Therefore, computerized interventions, such as internet-based CBT, are often mentioned as alternative for face-to-face treatment, because they contribute to increasing dissemination of mental health care by being scalable and can be made widely available [21]. It has low barriers for participation considering that it is free of costs, is flexible, retains anonymity and therefore carries no stigmatization [22,23], but more importantly, it has proven to be effective in reducing depressive symptoms in adolescents [20]. Nevertheless, unguided computerized treatment for depression may not the best strategy for adolescents, since drop-out, increasing symptom severity and suicidal ideation, all common in youth with a depressive disorder, are hard to detect and tackle in unguided computerized treatment in comparison to face-to-face treatment [22]. To prevent drop-out, improve results of online treatment, and monitor possible adverse events, adolescents should be able to connect with mental health professionals [24]. Taken together, merging face-to-face treatment and computerized treatment into an integrated blended treatment would be the optimal combination of elements from both forms of treatment [25,26,27,28].
Blended treatment can be defined as an integrated treatment, containing face-to-face sessions with a mental health professional combined with computerized therapy which patients follow independently [26]. The computerized part of the treatment is delivered through an online, secured, platform, which can be accessed by pc or smart phone. Adolescents independently work through several modules, containing psycho-education and exercises, and therapists deliver feedback and guidance on the platform [25]. The computerized part is combined with face-to-face sessions. According to therapists and patients, the face-to-face sessions are preferably used for getting to know one another, establishing the therapeutic relationship, and preparing to use the computerized part of the program [26,29]. The face-to-face sessions between adolescents and therapists are synchronized in communication, in which blended treatment differs from guided treatment, where contact with therapist is often online (e.g., via chat) or asynchronous. This means that blended treatment contains the benefits of both face-to-face treatment and computerized treatment; it serves the purpose of being flexible in location and intensity and meets the requirements of personal contact, adaptability in content, and safety in monitoring changes in severity, and according to therapists, it increases the engagement of adolescents in the treatment and enhances self-management [26,30].
Although blended treatment has the potential to be used on a large scale in youth mental health care, the evidence of effectiveness is scarce. To our knowledge, only a few studies have examined the effectiveness of blended treatment for adolescents with a depressive disorder. Two randomized controlled trials compared the effects of face-to-face CBT, computerized CBT, and face-to-face CBT and computerized CBT in conjunction (i.e., blended treatment) to a control condition without treatment among students with mild to moderate depressive symptoms [31,32]. These studies revealed that both blended CBT and face-to-face CBT were effective in reducing depressive symptoms and participants in both conditions showed a larger decrease in depressive symptoms compared to participants in the computerized CBT or control condition. In a third randomized controlled trial, blended CBT was compared to treatment as usual in treating adolescents with depressive disorders [33]. Adolescents in both treatment conditions showed significant reductions in depressive symptoms, with no significant differences between conditions. Two randomized controlled trials by Topooco et al. [34,35] showed that an online program including eight weekly chat-sessions resulted in significantly lower depressive symptoms when compared to control conditions comprising active monitoring or non-specific counseling. Although these findings provide a positive perspective on blended CBT, it is unknown whether not seeing patients face-to-face regularly increases the risk of adverse events including suicide risk [36], and whether the presented effects can be translated to adolescents treated in routine care.
The purpose of the present study was to evaluate the outcomes of blended CBT; the design was described in a study protocol [37], and the study compares the outcomes of Doepressie Blended with Doepressie face-to-face (CBT) and with treatment as usual (TAU). Patients in the latter two conditions had already participated in a previous randomized controlled trial (RCT) comparing face-to-face CBT with TAU [38,39]. The main aim was to evaluate and compare the remission rate of depressive disorders between blended CBT and face-to-face CBT and between blended CBT and treatment as usual in adolescents with clinical depression within routine care. Based on previous research in recent years, we hypothesized that the remission rate for depressive disorders was not different from face-to-face CBT, but was higher compared to treatment as usual. The second aim was to explore the differences in outcomes between blended CBT and face-to-face CBT and between blended CBT and treatment as usual on secondary outcomes: depressive symptoms, suicide risk, internalizing and externalizing symptoms, severity of depression, and global functioning.

2. Methods

2.1. Ethics

Both studies were approved by the Medical Research Ethics Committee METC Utrecht, The Netherlands (protocol NL61804.041.17 approved on 10 October 2017 and protocol NL34064.041.10 approved on 14 June 2011) and were registered in the Dutch Trial Register (NTR; Trial IDs: NTR6759 registered on 16 October 2017 and NTR2676 registered on 3 January 2011). All participants, and if under the age of 16 years also their parents, provided written informed consent. Results are described according to the CONSORT 2010 statement [40,41] and SPIRIT guidelines [42].

2.2. Design and Procedure

A pragmatic quasi-experimental controlled design was used. Data, collected between November 2017 and December 2019, from participants receiving blended CBT [37] was compared to data, collected between December 2011 and June 2014, from participants receiving face-to-face CBT or TAU (in a previously conducted RCT) [38,39]. A detailed description of the study design can be found in the published study protocol [37].
Adolescents with a depressive disorder who were referred for treatment in mental health care were informed about the study together with their parents, and they were asked to participate. If the adolescent was 16 years or older, parents would only be approached with the adolescent’s permission. Inclusion criteria were (1) having a clinical diagnosis of a depressive disorder (Major Depressive Disorder (MDD) or Dysthymic disorder), (2) aged 12–21 years, and (3) referred to one of the participating mental health institutions. Exclusion criteria were (1) acute risk of suicide, (2) drug abuse disorder (as primary diagnosis), (3) pervasive developmental disorder (as primary diagnosis), (4) bipolar disorder (as primary diagnosis), (5) day care or admission to the clinical setting, and (6) insufficient knowledge of the Dutch language. Written informed consent was obtained. In both studies, treatment was provided during 15 weeks and could be prolonged to 20 weeks when intermitted by holidays or illness. Assessments were conducted at baseline (T0), during the intervention after five weeks (T1), during the intervention after ten weeks (T2), at post-intervention (T3), and at six months (T4) follow-up. Assessments T0, T3, and T4 are reported in this article. The flow of participants through each phase of the study is shown in Figure 1.

2.3. Sample Size

Based on previous research, the within-subject effect sizes of both blended and face-to-face CBT were estimated to be moderate, i.e., blended CBT d = 0.76 [43] and face-to-face CBT d = 0.53 [14]. To detect a difference in depression diagnoses between the conditions (assuming alpha of 0.05 with a power (1−β) of 0.80, and dropout of 20%), 70 adolescents per condition were required.

2.4. Participants

A total of 129 patients (82.2% female) participated in the study and received either blended CBT (n = 41), face-to-face CBT (n = 44), or treatment as usual (n = 44). The adolescents were aged 13–22 years (M = 16.60, SD = 2.03) when they started treatment. Two participants were 21 when they gave informed consent and turned 22 before treatment started; they remained included. Educational levels were 2.3% lower educational level, 38.4% moderate educational level, and 58.5% higher educational level. Most participants were of Dutch origin (96.4%).

2.5. Treatment Allocation

Adolescents participating in the first study were randomly assigned to either face-to-face CBT or treatment as usual [39]. Adolescents participating in the second study all received blended CBT.

2.6. Interventions

The TAU condition consisted of a range of different treatments. In this study, mental health institutions offered Interpersonal Therapy (IPT), family therapy, parent counseling, anti-depressant medication, mindfulness training, acceptance commitment therapy (ACT), short-term psychodynamic therapy, (nondirective) counseling, creative therapy, and running therapy. For the purpose of this study, CBT was not allowed within the TAU condition. More detailed information is described by Stikkelbroek and colleagues [39].
For the face-to-face CBT condition, the Dutch protocolized CBT program “Doepressie” was used [44], which is based on the evidence-based treatment program Coping with Depression course for Adolescents (CWD-A) [45]. The program consists of 15 weekly sessions of 45 min each and contains the following components: psycho-education, setting realistic goals, self-monitoring, activation, improvement of social and communication skills, relaxation skills, cognitive restructuring, role play, problem solving skills and relapse prevention. Exercises during the session and homework are used to generalize new skills into daily practice.
For the blended CBT intervention, the program Doepressie was adapted into a blended version [46] with an interactive online environment including four modules, covering the same components mentioned above. The online content of the program was combined with a flexible number of face-to-face sessions with a therapist (with a minimum of five and maximum of 15 sessions). Duration of the face-to-face sessions was equal to the face-to-face condition, namely 45 min each. Throughout the treatment phase, adolescents and therapist could communicate by means of a chat functionality within the program, email or phone. Parents received, comparable to the face-to-face Doepressie, two face-to-face sessions consisting of psycho-education, information about CBT and suggestions on how to contribute to the treatment.

2.7. Therapists

Treatment was provided by 60 therapists (91.7% female; 98.1% of Dutch origin) across 16 sites. Therapists were aged 24–63 years (M = 42.38, SD = 10.89) and had 2–40 years (M = 13.54, SD = 9.04) of working experience. Most therapists (95.0%) were licensed psychologists with one or more clinical registrations. Two therapists were in training to become cognitive therapists and one therapist was a psychiatric nurse trained as a cognitive therapist. They each treated between one and six participating adolescents. Therapists in the face-to-face CBT and blended CBT condition received a two-day training in delivering the protocolized treatment by a registered clinical psychologist. Therapists in the treatment as usual condition received instruction not to use CBT. Age and level of experience of therapists were evenly distributed across the treatment conditions.

2.8. Measures

2.8.1. Primary Outcome

The presence of the diagnosis of depression was measured by the Kiddie-Schedule for Affective Disorders and Schizophrenia, present and lifetime version (K-SADS-PL) [47,48], which was conducted by a trained research assistant. This semi-structured diagnostic interview assesses present and life-time diagnoses and their severity and takes the view of adolescents and parents into account. Test-retest reliability is excellent for present and lifetime diagnoses of major depression and interrater agreement is high (93–100%) [47].

2.8.2. Secondary Outcomes

Depressive symptoms were measured using the Dutch version of the self-report measure Child Depression Inventory-2 (CDI-2) [49,50]. The questionnaire contains 28 items, each consisting of three statements rated from 0 to 2.
Suicide risk was assessed with the self-report questionnaire Suicide Risk Taxation (SRT), consisting of six items rated on a three-point scale. The questionnaire is based on the Suicide Ideation Questionnaire-Jr [51] and on the Suicide Severity Rating Scale [52]. The questionnaire assesses frequency of suicidal thoughts, wishes, plans and actions over the past two weeks.
Internalizing and externalizing symptoms were measured using the Youth Self Report scale (YSR) [53,54] rated by adolescents. The questionnaire assesses a wide range of symptoms with 69 items on a three-point scale, of which 31 items are used for the internalizing symptoms subscale and 32 for the externalizing symptoms subscale.
Severity of depression was assessed with the Clinical Global Impression-Severity scale (CGI-S) [55]. The questionnaire assesses the clinical status of the adolescent, rated by the therapist, on a 7-point scale from ‘normal, no depressive symptoms to ‘most severe depressive symptoms’.
Global functioning of the adolescent was assessed with the therapist-rated Children Global Assessment Scale (CGAS) [56,57]. The ratings of the measure are based on a 0–100 point scale providing an overall estimation of current functioning, taking all available information into account. More impairment in global functioning is represented by lower scores.

2.9. Missing Data

An intention-to-treat design was applied and multiple imputation was used to handle the missing data [58] in data measured with questionnaires. The proportions of missing data is presented in Figure 1. Missing data from the clinical interview K-SADS was not imputed. Ten datasets were constructed using the R [59] package Mice [60] (25 iterations) by predictive mean matching. Statistical analyses were performed on each imputed dataset and subsequently pooled using Rubin’s rules [58]. Imputation performance was assessed by comparing the pooled results from analyses performed on the imputed datasets to those performed on the non-imputed data. Sensitivity analyses were conducted to test the robustness of the findings.

2.10. Statistical Analysis

Between-group differences in baseline demographic, clinical diagnoses, and clinical characteristics were analyzed using t-tests and Mann-Whitney tests for continuous variables and chi-square tests for categorical variables. Odds ratios (OR) for drop-out between participants in the blended CBT and face-to-face CBT condition and between the blended CBT and treatment as usual condition were calculated.
Differences in the primary outcome remission between treatment conditions blended CBT and face-to-face CBT and between blended CBT and TAU were analyzed separately for post-intervention and six-month follow-up, with binomial logistic regression models controlling for age and gender.
To examine secondary outcomes, we analyzed between-group differences in depressive symptoms at post-intervention and at six-month follow-up. Due to non-normal distribution, we used Mann-Whitney tests. We calculated between- and within-group effect sizes (Cohen’s d) and their 95% confidence intervals. Next, linear mixed models were constructed using the R package [61] for depressive symptoms, with a random intercept for each participant, while controlling for age and gender. Interaction terms between condition and dummy timepoints (coded binary) were included to test for differences between conditions over time [62]. Mixed models control was used for possible non-independence of the data because of nesting of repeated measurement within individuals, and to deliver unbiased standard errors of the parameter estimates [63]. Additionally, we calculated the participants’ Reliable Change Index (RCI) by dividing the baseline to follow-up difference in depressive symptoms by the standard error of this difference. RCIs larger than −1.96 SDs are qualified as no improvement in symptoms and RCI’s smaller than −1.96 SDs as significant improvement [64]. To test for differences in rates of improvement between groups, binomial logistic regression models controlling for age and gender were fitted with improved RCI as dependent variable.
Next, we analyzed between-group differences in suicide risk, internalizing symptoms, externalizing symptoms, severity of depression and global functioning. Due to non-normal distribution, we used Mann-Whitney tests. Lastly, the same models were fitted as for depressive symptoms as outcome, albeit with suicide risk, internalizing symptoms, externalizing symptoms, severity of depression and global functioning as dependent variable.

3. Results

3.1. Demographics, Clinical Diagnoses and Clinical Characteristics at Baseline

Participants in the blended CBT did not differ significantly from the participants in the face-to-face CBT or treatment as usual (TAU) condition, respectively, on any of the demographic characteristics age (t = 0.41, p = 0.68; t = 0.79, p = 0.43), gender (χ2 (1, n = 85) = 0.42, p = 0.52; χ2 (1, n = 85) = 0.19, p = 0.66), education (χ2 (2, n = 62) = 2.33, p = 0.31; χ2 (2, n = 69) = 1.29, p = 0.52), or ethnicity (χ2 (1, n = 70) = 0.19, p = 0.66; χ2 (1, n = 73) = 0.03, p = 0.86).
The presence of clinical diagnoses did not differ between the blended CBT condition and the face-to-face CBT condition or between the blended CBT condition and the TAU condition, with an exception of the presence of social phobia being significantly lower in the blended CBT condition. An overview of the clinical diagnosis is presented in Table 1.
Further, no differences were found in other clinical characteristics, i.e., depressive symptoms, suicide risk, internalizing symptoms, externalizing symptoms, severity of depression, or global functioning, between participants in the blended CBT and face-to-face CBT or TAU condition. Means and between-group differences are presented in Table 2.

3.2. Drop-Out

In total, 58 participants of the 129 (45.0%) dropped out of treatment during the study. In the blended CBT condition, 15 (36.6%) participants dropped out before the planned duration of 15 to 20 weeks of treatment, seven because they ended treatment (i.e., four due to decreased severity of depression and two due to lack of motivation) and eight because they needed more intensive treatment (i.e., they received additional medication for PTSD or anxiety or were clinically admitted after a suicide attempt). In the face-to-face CBT condition, 24 (54.5%) participants dropped out; ten because they discontinued treatment (i.e., four due to decreased severity of depression and six due to lack of motivation or no confidence in treatment), ten because they received more intensive treatment (i.e., they received additional EMDR, emotion regulation therapy or medication or were admitted after a suicide attempt), and four did not start treatment at all. Participants receiving blended CBT and participants receiving face-to-face CBT were evenly likely to drop out (OR = 0.48, 95% CI (0.20, 1.15)). In the treatment as usual condition, 19 (43.2%) dropped out of treatment, eleven because they ended treatment themselves (i.e., six due to decreased severity of depression and five due to lack of motivation), six because treatment was intensified (i.e., they were transferred to forensic care or were admitted because of increased suicide risk), and two did not start treatment at all. Participants receiving blended CBT and participants receiving treatment as usual did not differ in the likelihood to drop out (OR = 0.76, 95% CI (0.32, 1.81)).

3.3. Adverse Events

During the intervention and follow-up period, overall five serious adverse events occurred. In the blended CBT condition, two participants attempted suicide during the intervention. They were referred for more intensive treatment and dropped out of the study. In the face-to-face CBT condition also, two participants attempted suicide, one during the intervention and one after ending the intervention. They also dropped out of the study and received more intensive treatment. A third participant in the face-to-face CBT condition died by suicide between the six- and 12-month follow-up measurement. In the treatment as usual condition, no serious adverse events occurred. Participants receiving blended CBT and participants receiving face-to-face CBT were evenly likely to experience an adverse event (OR = 0.70, 95% CI (0.11, 4.42)). Odds ratio for adverse between participants receiving blended CBT and participants receiving treatment as usual could not be calculated due to a value of 0 in the TAU condition.

3.4. Treatment Dosage

The treatment dosage specifically for the adolescents who completed their blended treatment consisted of an average of 5.77 (SD = 3.22; range 0–12) sessions. Additionally, they processed 57.6% (range = 0–98.7%) of the online content. In the face-to-face CBT condition, adolescents received 15.06 (SD = 4.05; range 6–27) sessions on average. Adolescents who completed treatment in treatment as usual condition received on average 15.00 (SD = 3.74; range = 4–20) sessions.

3.4.1. Primary Outcome

Remission

Before start of the treatment, all participants (blended CBT n = 37; face-to-face CBT n = 44; treatment as usual n = 40) met the criteria for a depressive disorder (i.e., MDD or Dysthymic Disorder). Data from eight participants on the diagnostic criteria before treatment was missing; however, they were diagnosed with MDD in the diagnostic process.
At post-intervention, 47 of the 77 participants (61.0%) were in remission from a depressive disorder. Participants who received blended CBT (n = 12, 54.5%) were evenly likely to be in remission from the diagnostic criteria of a depressive disorder compared to participants who received face-to-face CBT (n = 17, 68.0%) (OR = 0.59, 95% CI (0.17, 2.02)). Compared to participants receiving TAU (n = 18, 60.0%), participants receiving blended CBT were also evenly likely to be in remission (OR = 0.96, 95% CI (0.31, 3.02)). This indicates no association between remission and treatment condition at post-treatment.
At six-month follow-up, 42 of the 53 participants (79.2%) were in remission. Participants in the blended CBT condition (n = 10, 71.4%), compared to participants in the face-to-face CBT condition (n = 17, 85.0%) (OR = 0.48, 95% CI (0.07, 2.82)) and compared to participants in the TAU condition (n = 15, 78.9%) (OR = 0.91, 95% CI (0.16, 5.11), were evenly likely to be in remission.

3.4.2. Secondary Outcomes

Depressive Symptoms

The levels of depressive symptoms at post-intervention and six-months follow-up did not differ between the blended CBT condition and the face-to-face CBT condition, nor between the blended CBT condition and the TAU condition. Between-group effect sizes between blended CBT and face-to-face CBT and blended CBT and TAU showed no difference in effect (Table 2).
Within-group effect size for blended CBT at post-intervention was moderate (d = 0.81, 95% CI (0.36, 1.26); cf. face-to-face CBT d = 0.86, 95% CI (0.42, 1.30); TAU d = 0.57, 95% CI (0.15, 1.00)). At the six-month follow-up, within-group effect size for blended CBT was large (d = 1.11, 95% CI (0.64, 1.57); cf. face-to-face CBT (d = 0.92, 95% CI (0.48, 1.36); TAU d = 1.14, 95% CI (0.69, 1.59)).

Change in Depressive Symptoms over Time

Findings showed a significant effect of time on depressive symptoms at post-intervention (B = −6.97, SE = 1.49, p < 0.001). The estimated decline in depressive symptoms in the blended CBT at post-intervention condition was not significantly different from the face-to-face CBT condition (B = 2.62, SE = 1.93, p = 0.17). The estimated decline in depressive symptoms in the blended CBT condition was also not significantly different compared to the TAU condition (B = −0.58, SE = 1.92, p = 0.76).
For the six-month follow-up, again time had a significant effect on depressive symptoms (B = −11.4, SE = 1.52, p < 0.001). The estimated depressive symptoms showed no significantly different decrease in the blended CBT condition compared to the decrease in the face-to-face CBT condition (B = 0.38, SE = 1.95, p = 0.85). The estimated decline in depressive symptoms comparing blended CBT to TAU was also not significantly different (B = 1.37, SE = 1.95, p = 0.48).

Reliable Change in Depressive Symptoms

Between baseline and post-intervention, 30.9% of the participants receiving blended CBT showed a reliable change (i.e., clinically relevant decline) in depressive symptoms, compared to 42.5% receiving face-to-face CBT and 20.0% receiving TAU. We found that participants who received blended CBT were evenly likely to show a clinically relevant decline in depressive symptoms compared to participants who received face-to-face CBT (OR =1.71, 95% CI (0.56, 5.16)), meaning no association between reliable change and treatment condition at post-intervention. Compared to participants receiving TAU, participants receiving blended CBT were also evenly likely to show a clinically relevant decline (OR = 0.52, 95% CI (0.16, 1.71)).
Between baseline and the six-month follow-up, 46.8% of the participants in the blended CBT condition showed a clinically relevant decline in depressive symptoms compared to 46.4% in the face-to-face CBT condition (OR = 1.00, 95% CI (0.35, 2.84)) and 40.9% in the TAU condition (OR = 0.74, 95% CI (0.19, 2.89)), evenly likely to show a reliable change in symptoms when controlled for gender and age. This means that no association was found between reliable change and condition at the six-month follow-up. Presented percentages are based on pooled results from ten imputed datasets.

Other Outcomes

Between-group differences for suicide risk, internalizing symptoms, externalizing symptoms, severity of symptoms, and global functioning at post-intervention were not significantly different between blended CBT and face-to-face CBT, nor between blended CBT and TAU, as presented in Table 2. At the six-month follow-up, between-group differences between blended CBT and face-to-face CBT, and between blended CBT and TAU on suicide risk, internalizing symptoms, and externalizing symptoms were not significantly different (Table 2).
Findings showed a significant effect of time on internalizing symptoms, severity of symptoms, and global functioning at post-intervention, and no effect on suicide risk and externalizing symptoms. The estimations showed no significantly different decrease in the blended CBT condition compared to the decrease in the face-to-face CBT condition, nor in the blended CBT condition compared to the TAU condition (Table 3). We found a significant effect of time on suicide risk, internalizing symptoms, and externalizing symptoms at six-month follow-up. The estimations showed no significant differences in decrease between blended CBT and face-to-face CBT, nor between blended CBT and TAU.

Sensitivity Analyses

Completer-only analyses for individual change over time in depressive symptoms, suicide risk, internalizing symptoms, externalizing symptoms, severity of depression, and global functioning showed no differences with the intention-to-treat analyses, with one exception. Completer-only analyses showed that the estimated decline in depressive symptoms at post-intervention was smaller in the blended CBT condition compared to the face-to-face CBT condition (B = 4.79, SE = 2.39, p = 0.045), with a p-value just below the threshold of 0.05.

4. Discussion

In the present study, a pragmatic quasi-experimental controlled trial was conducted to evaluate the outcomes of blended CBT. The main aim was to evaluate and compare the remission rate of depressive disorders between blended CBT and face-to-face CBT and between blended CBT and treatment as usual in adolescents with clinical depression within routine care. The second aim was to explore the differences between blended CBT and face-to-face CBT and between blended CBT and treatment as usual on secondary outcomes depressive symptoms, suicide risk, internalizing and externalizing symptoms, severity of depression, and global functioning.
In total, 71 adolescents of the 129 (55.0%) finished treatment according to their treatment protocol, which means 45.0% dropped out. Adolescents receiving blended CBT did not differ in likelihood to drop out from adolescents receiving face-to-face CBT or treatment as usual. The drop-out rate was high, albeit comparable to other studies on the effectiveness of depression treatments (i.e., 50%) [65]. Nevertheless, drop-out in general is a major problem in mental health care and we need to look for possible ways to increase the number of patients who finish their treatment. Overall, five adolescents experienced a serious adverse event, but again with no difference in likelihood between blended CBT and face-to-face CBT or treatment as usual. Therapists worry that in blended treatment it is too difficult to identify changes in symptom severity and suicidality [66] and, obviously, therapists want certainty about this. Our findings revealed a small number of adverse events, but more importantly, these were not different from treatments consisting of only face-to-face sessions.
Findings showed that 61.0% of the adolescents at post-intervention and 79.2% of the adolescents at the six-month follow-up were in remission from a depressive disorder. In line with our hypotheses, findings showed no difference in likelihood to be in remission between blended CBT and face-to-face CBT. In contrast to our hypotheses, findings also showed no difference in likelihood to be in remission between adolescents who received blended CBT and adolescents who received treatment as usual. All three treatment conditions resulted in a significant decrease in depressive symptoms with a large effect size. No difference was found between blended CBT and face-to-face CBT, nor between blended CBT and treatment as usual in decrease in depressive symptoms, suicide risk, internalizing and externalizing symptoms, severity of depression and global functioning. Summarizing, outcomes of blended were not found to be different from to face-to-face CBT and TAU in treating adolescents with a clinical depression within routine mental health care.
We expected that the remission rate of depressive disorders in blended treatment would be higher compared to treatment as usual, but our findings showed no difference in outcome. Our hypothesis, at the start of the study, was based on scarce research on blended treatment. In recent years, a small, but rising number of studies have examined the effectiveness of blended CBT in treating adolescents with a depressive disorder and presented findings comparable to our results. Kobak et al. [33] showed no difference in decrease of depressive symptoms between adolescents receiving blended CBT or treatment as usual. It is also known that blended CBT was significantly more effective in reducing depressive symptoms in adolescents than minimal attention control conditions [34,35]. Despite our findings not being in line with our hypothesis, they are similar to other recent findings.
We also found, in line with our hypothesis, no difference in likelihood to be in remission between blended CBT and face-to-face CBT. Several explanations can be offered to explain the similar effects of blended CBT to face-to-face CBT and treatment as usual. First, blended CBT and face-to-face CBT have similar treatment techniques, with the modality of delivery being different. Similar results were found by Sethi et al. [31,32] where the decrease in depressive symptoms was equal after receiving blended CBT and standard CBT.
Second, our expectation that treatment as usual would be less effective was based on a meta-analysis by Weisz et al. [11], which showed that evidence-based psychotherapies outperformed treatment as usual. However, based on a few individual studies included in the meta-analysis, the authors also mentioned that the difference in effects between evidence-based therapies and treatment as usual decreased when delivered under clinical practice conditions. It needs to be mentioned that the treatment as usual condition also contained evidence-based treatments such as IPT, anti-depressant medication, and running therapy. This might explain that no difference was found between the outcomes of the blended treatment condition and the treatment as usual condition.
Third, one of the aspects contributing to treatment outcomes is therapeutic alliance [67]. An explorative study on the therapeutic relation in adolescents receiving blended treatment for depression showed that therapist-rated alliance was comparable to alliance in face-to-face treatment in previous research [68]. This implies that the modality of treatment might not impact the therapeutic alliance between therapists and patients and that this factor does not seem to affect blended treatment outcome.

4.1. Strengths and Limitations

An important strength of this study is that we compared effects of three active treatment conditions in treating adolescents with a depressive disorder, as suggested by Cuijpers [69]. In addition, we examined the effectiveness of the interventions in adolescents with clinical depression referred for treatment, meaning that these findings can be generalized to clinical care [70]. We also need to mention some limitations. First, in the current design, adolescents were not randomized between conditions. Studying the outcomes of blended CBT without control condition is not preferred. Therefore, we used historical control conditions, of which it cannot be ruled out that the samples differed in baseline characteristics, such as the participants wanting to be included in the blended treatment and having different expectations of treatment than those participating in the RCT. However, based on our baseline measurement, we found no differences between participants in the conditions. Second, the sample size of the study is rather small. We included 129 participants while 210 were required, based on the estimated power. This might have contributed to the difference in findings from the intention-to-treat analysis and completers-only analysis of the decrease in depressive symptoms at post-intervention. Importantly, because the completers-only analysis showed a just significant difference, and all other completer-only analyses confirmed the findings of the intention-to-treat analyses, we interpret that this specific finding was influenced by the small sample size. Third, the drop-out rate of participants was high, namely 45.0%, although comparable to other studies on the effectiveness of depression treatments (i.e., 50%) [65]. This resulted in a loss of power. Fourth, our sample is a relatively highly educated and ethnically homogeneous sample, which is often the case in study samples [71]. Besides the sample being highly educated and ethnically homogeneous, patients with acute suicidal thoughts and behavior were excluded because of safety issues, resulting a part of the patients referred to clinical care being excluded. Therefore, these findings have a limitation in generalization to adolescents in regular care.

4.2. Clinical Implications

A previous review demonstrated that the use of blended treatment for adolescents with a depressive disorder largely depends on acceptance by therapists as well as by patients [36]. It is likely that this acceptance increases with more insight into the effectiveness and risks of blended CBT. The current study found no difference in outcomes between blended CBT, face-to-face CBT and treatment as usual, and, with this, we contribute to the knowledge on outcomes of blended treatment. Moreover, we could not establish a difference between the number of adolescents who dropped out from treatment. This means that, on average, adolescents will benefit from blended CBT as much as from face-to-face interventions.
Another important unknown is whether blended treatment, i.e., seeing patients face-to-face much less often, increases the risk of adverse events. Therapists worry that it may be too difficult to identify changes in symptom severity and suicidality [66] and, obviously, therapists want certainty about this. Our findings demonstrated a small number of adverse events, but no difference between treatment conditions. This means that the worry of therapists about the safety of their patients is legitimate, but, based on our findings, blended CBT can be a useful addition to effective treatment for adolescents with a depressive disorder, without increasing the risk of an unseen growing symptom severity of suicidal ideation. Nonetheless, it goes without saying that further research is imperative.

4.3. Future Research

This study showed that no difference could be observed between blended CBT, face-to-face CBT and treatment as usual in remission rate and in decrease of depressive symptoms. On average, they are effective in treating adolescents with a depressive disorder. Nonetheless, we also found that not all adolescents showed benefit from the current treatments. An important future step in research is to study which individuals benefits from which intervention; that is, gaining more understanding in the use of prognostic and prescriptive variables or characteristics to determine which treatment works best for whom. The use of predictive information to support treatment selection, i.e., personalizing treatment, might improve the individual effectiveness of therapy.
Further, the absence of knowledge on cost-effectiveness of treatment for adolescents with a depressive disorder is a big gap in the research. It is often suggested that blended treatment could reduce costs compared to face-to-face treatment; however, there are no studies to confirm this yet. A previous study showed that therapists experienced an increase in workload with blended care [66], but it has never been studied in the context of effectiveness and costs.

5. Conclusions

The present study showed no differences in effects between blended CBT, face-to-face CBT and treatment as usual: all three treatment conditions resulted in fewer diagnoses of depressive disorder and showed a significant decrease in depressive symptoms. Further, we recommend that we should look beyond the mean effects of the interventions and study whether certain individuals would profit more from one of the interventions than from the others. The ability to identify patients who can benefit from targeted therapies might increase the response to treatment. These results might lead to lowering the threshold for using blended treatment for adolescents with a depressive disorder and might lead to the next, and much needed, steps in precision psychiatry.

Author Contributions

S.P.A.R. was responsible for the coordination of the data collection, data analysis, reporting the study results, and writing the manuscript. W.d.H. assisted in the execution of data analyses. Y.A.J.S., W.d.H., H.R., M.D., M.H.N., D.H.M.C., M.C.P.I., M.S., and D.H.M.B. read the manuscript and provided suggestions for improvement. Y.A.J.S., H.R., M.D., M.H.N. and D.H.M.B. are grant applicants. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Dutch Organization for Health research and Development ZonMw (grant numbers 70-72900-98-16144 and 80-82435-98-10117). The funding body has no role in the design of the study, data collection, analysis, or interpretation of data, nor in writing the manuscript. The APC was funded by Utrecht University.

Institutional Review Board Statement

Both trials were conducted according to the guidelines of the Declaration of Helsinki (2013) and in accordance with the Dutch Medical Research Involving Human Subjects Act (WMO) and other guidelines, regulations and Acts. Ethical approval was obtained by the Medical Research Ethics Committee METC Utrecht, The Netherlands (protocol NL61804.041.17 approved on 10 October 2017 and protocol NL34064.041.10 approved on 14 June 2011). The trials were registered in the Dutch Trial Register (Trial IDs: NTR6759 registered on 16 October 2017 and NTR2676 registered on 3 January 2011). Written informed consent to participate in the study was obtained from adolescents and from parents.

Informed Consent Statement

Written informed consent to participate in the study was obtained from adolescents and from parents.

Data Availability Statement

The data for the current study is not publicly available due to them containing information that could compromise research participant privacy, but they are available from the corresponding author upon reasonable request.

Acknowledgments

We would like to acknowledge the health professionals of the mental health services Accare, Curium, GGZ Oost Brabant, Herlaarhof, Praktijk Appelboom, Psychologenpraktijk Waalre, TOPP-zorg, and Triversum/GGZ Noord-Holland-Noord. We would also like to thank all adolescents who participated in the study for their cooperation.

Conflicts of Interest

Yvonne Stikkelbroek translated Doepression face-to-face into Dutch and developed the blended version of the intervention, for which she receives no direct payments. The other authors of the current study reported no conflicts of interest.

Abbreviations

ACT: Acceptance Commitment Therapy (ACT); ADHD: Attention Deficit and Hyperactivity Disorder; CBT: Cognitive Behavioral Therapy; CONSORT: Consolidated Standards of Reporting Trials; CDI-2: Child Depression Inventory-2; CGAS: Children Global Assessment Scale; CGI-S: Clinical Global Impression-severity scale; CWD-A: Coping with Depression course for Adolescents; IPT: Interpersonal Therapy; K-SADS-PL: Kiddie-Schedule for Affective Disorders and Schizophrenia, present and lifetime version; MDD: Major Depressive Disorder; NTR: Nederlands (Dutch) Trial Register; OCD: Obsessive Compulsive Disorder; ODD: Oppositional Defiant Disorder; OR: Odds Ratio; PMM: Predictive Mean Matching; PTSD: Post Traumatic Stress Disorder; RCI: Reliable Change Index; RCT: Randomized Controlled Trial; SPIRIT: Standard Protocol Items: Recommendations for Interventional Trials; SRT: Suicide Risk Taxation; TAU: Treatment as usual; YSR: Youth Self Report scale.

References

  1. World Health Organization. Depression and Other Common Mental Disorders: Global Health Estimates; WHO Document Production Services: Geneva, Switzerland, 2017. [Google Scholar]
  2. Ormel, J.; Raven, D.; Van Oort, F.; Hartman, C.A.; Reijneveld, S.A.; Veenstra, R.; Vollebergh, W.A.M.; Buitelaar, J.; Verhulst, F.C.; Oldehinkel, A.J. Mental health in Dutch adolescents: A TRAILS report on prevalence, severity, age of onset, continuity and co-morbidity of DSM disorders. Psychol. Med. 2015, 45, 345–360. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Birmaher, B.; Brent, D.A.; AACAP Work Group on Quality Issues. Practice parameter for the assessment and treatment of children and adolescents with depressive disorders. J. Am. Acad. Child Adolesc. Psychiatry 2007, 46, 1503–1526. [Google Scholar] [CrossRef] [Green Version]
  4. Ryan, N.D. Treatment of depression in children and adolescents. Lancet 2005, 366, 933–940. [Google Scholar] [CrossRef]
  5. Portzky, G.; Van Heeringen, C. Suïcide bij jongeren. Psychol. Gezondh. 2009, 37, 75–89. [Google Scholar] [CrossRef]
  6. Jaycox, L.H.; Stein, B.D.; Paddock, S.; Miles, J.N.V.; Chandra, A.; Meredith, L.S.; Tanielian, T.; Hickey, S.; Burnam, M.A. Impact of teen depression on academic, social, and physical functioning. Pediatrics 2009, 124, e596–e605. [Google Scholar] [CrossRef] [Green Version]
  7. Verboom, C.E.; Sijtsema, J.J.; Verhulst, F.C.; Penninx, B.W.J.H.; Ormel, J. Longitudinal associations between depressive problems, academic performance, and social functioning in adolescent boys and girls. Dev. Psychol. 2014, 50, 247. [Google Scholar] [CrossRef]
  8. Wickrama, K.A.S.; Conger, R.D.; Lorenz, F.O.; Jung, T. Family antecedents and consequences of trajectories of depressive symptoms from adolescence to young adulthood: A life course investigation. J. Health Soc. Behav. 2008, 49, 468–483. [Google Scholar] [CrossRef] [Green Version]
  9. Seeley, J.R.; Stice, E.; Rohde, P. Screening for depression prevention: Identifying adolescent girls at high risk for future depression. J. Abnorm. Psychol. 2009, 118, 161–170. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Ellis, R.E.R.; Seal, M.L.; Simmons, J.G.; Whittle, S.; Schwartz, O.S.; Byrne, M.L.; Allen, N.B. Longitudinal trajectories of depression symptoms in adolescence: Psychosocial risk factors and outcomes. Child Psychiatry Hum. Dev. 2017, 48, 554–571. [Google Scholar] [CrossRef]
  11. Weisz, J.R.; Kuppens, S.; Eckshtain, D.; Ugueto, A.M.; Hawley, K.M.; Jensen-Doss, A. Performance of evidence-based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiat 2013, 70, 750–761. [Google Scholar] [CrossRef] [Green Version]
  12. Weisz, J.R.; McCarty, C.A.; Valeri, S.M. Effects of psychotherapy for depression in children and adolescents: A meta-analysis. Psychol. Bull. 2006, 132, 132. [Google Scholar] [CrossRef] [Green Version]
  13. Cuijpers, P.; Karyotaki, E.; Eckshtain, D.; Ng, M.Y.; Corteselli, K.A.; Noma, H.; Quero, S.; Weisz, J.R. Psychotherapy for depression across different age groups: A systematic review and meta-analysis. JAMA Psychiat 2020, 77, 694–702. [Google Scholar] [CrossRef] [PubMed]
  14. Klein, J.B.; Jacobs, R.H.; Reinecke, M.A. Cognitive-behavioral therapy for adolescent depression: A meta-analytic investigation of changes in effect-size estimates. J. Am. Acad. Child Adolesc. Psychiatry 2007, 46, 1403–1413. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. American Psychological Association; Guideline Development Panel for the Treatment of Depressive Disorders. Clinical Practice Guideline for the Treatment of Depression Across Three Age Cohorts; American Psychological Association: Washington, DC, USA, 2019. [Google Scholar]
  16. Landelijke Stuurgroep Multidisciplinaire Richtlijnontwikkeling in de GGZ. Guidelines for Youth Depression [Richtlijn Voor Depressie Bij Jeugd, Addendum]; Trimbos Institute: Utrecht, The Netherlands, 2009. [Google Scholar]
  17. Watanabe, N.; Hunot, V.; Omori, I.M.; Churchill, R.; Furukawa, T.A. Psychotherapy for depression among children and adolescents: A systematic review. Acta Psychiatr. Scand. 2007, 116, 84–95. [Google Scholar] [CrossRef] [PubMed]
  18. Zhou, X.; Hetrick, S.E.; Cuijpers, P.; Qin, B.; Barth, J.; Whittington, C.J.; Cohen, D.; Del Giovane, C.; Liu, Y.; Michael, K.D. Comparative efficacy and acceptability of psychotherapies for depression in children and adolescents: A systematic review and network meta-analysis. World Psychiatry 2015, 14, 207–222. [Google Scholar] [CrossRef] [Green Version]
  19. Gulliver, A.; Griffiths, K.M.; Christensen, H. Perceived barriers and facilitators to mental health help-seeking in young people: A systematic review. BMC Psychiatry 2010, 10, 113. [Google Scholar] [CrossRef] [Green Version]
  20. Ebert, D.D.; Zarski, A.-C.; Christensen, H.; Stikkelbroek, Y.; Cuijpers, P.; Berking, M.; Riper, H. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: A meta-analysis of randomized controlled outcome trials. PLoS ONE 2015, 10, e0119895. [Google Scholar] [CrossRef] [PubMed]
  21. Titov, N.; Dear, B.F.; Staples, L.G.; Bennett-Levy, J.; Klein, B.; Rapee, R.M.; Shann, C.; Richards, D.; Andersson, G.; Ritterband, L. MindSpot clinic: An accessible, efficient, and effective online treatment service for anxiety and depression. Psychiatr. Serv. 2015, 66, 1043–1050. [Google Scholar] [CrossRef] [PubMed]
  22. Andersson, G.; Titov, N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry 2014, 13, 4–11. [Google Scholar] [CrossRef]
  23. Emmelkamp, P.M.G.; David, D.; Beckers, T.; Muris, P.; Cuijpers, P.; Lutz, W.; Andersson, G.; Araya, R.; Banos Rivera, R.M.; Barkham, M. Advancing psychotherapy and evidence-based psychological interventions. Int. J. Methods Psychiatr. Res. 2014, 23, 58–91. [Google Scholar] [CrossRef]
  24. Wozney, L.; Huguet, A.; Bennett, K.; Radomski, A.D.; Hartling, L.; Dyson, M.; McGrath, P.J.; Newton, A.S. How do eHealth programs for adolescents with depression work? A realist review of persuasive system design components in internet-based psychological therapies. J. Med. Internet Res. 2017, 19, e266. [Google Scholar] [CrossRef] [Green Version]
  25. Erbe, D.; Eichert, H.C.; Riper, H.; Ebert, D.D. Blending face-to-face and internet-based interventions for the treatment of mental disorders in adults: Systematic review. J. Med. Internet Res. 2017, 19, e306. [Google Scholar] [CrossRef] [Green Version]
  26. Van der Vaart, R.; Witting, M.; Riper, H.; Kooistra, L.; Bohlmeijer, E.T.; van Gemert-Pijnen, L.J. Blending online therapy into regular face-to-face therapy for depression: Content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry 2014, 14, 355. [Google Scholar] [CrossRef] [Green Version]
  27. Kooistra, L.C.; Wiersma, J.E.; Ruwaard, J.; van Oppen, P.; Smit, F.; Lokkerbol, J.; Cuijpers, P.; Riper, H. Blended vs. face-to-face cognitive behavioural treatment for major depression in specialized mental health care: Study protocol of a randomized controlled cost-effectiveness trial. BMC Psychiatry 2014, 14, 290. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Mathiasen, K.; Andersen, T.E.; Riper, H.; Kleiboer, A.A.M.; Roessler, K.K. Blended CBT versus face-to-face CBT: A randomised non-inferiority trial. BMC Psychiatry 2016, 16, 432. [Google Scholar] [CrossRef] [Green Version]
  29. Kenter, R.M.F.; Van de Ven, P.M.; Cuijpers, P.; Koole, G.; Niamat, S.; Gerrits, R.S.; Willems, M.; Van Straten, A. Costs and effects of Internet cognitive behavioral treatment blended with face-to-face treatment: Results from a naturalistic study. Internet Interv. 2015, 2, 77–83. [Google Scholar] [CrossRef] [Green Version]
  30. Cerga-Pashoja, A.; Doukani, A.; Gega, L.; Walke, J.; Araya, R. Added value or added burden? A qualitative investigation of blending internet self-help with face-to-face cognitive behaviour therapy for depression. Psychother. Res. 2020, 1–13. [Google Scholar] [CrossRef] [PubMed]
  31. Sethi, S. Treating youth depression and anxiety: A randomised controlled trial examining the efficacy of computerised versus face-to-face cognitive behaviour therapy. Aust. Psychol. 2013, 48, 249–257. [Google Scholar] [CrossRef]
  32. Sethi, S.; Campbell, A.J.; Ellis, L.A. The use of computerized self-help packages to treat adolescent depression and anxiety. J. Technol. Hum. Serv. 2010, 28, 144–160. [Google Scholar] [CrossRef]
  33. Kobak, K.A.; Mundt, J.C.; Kennard, B. Integrating technology into cognitive behavior therapy for adolescent depression: A pilot study. Ann. Gen. Psychiatry 2015, 14, 37. [Google Scholar] [CrossRef] [Green Version]
  34. Topooco, N.; Berg, M.; Johansson, S.; Liljethörn, L.; Radvogin, E.; Vlaescu, G.; Nordgren, L.B.; Zetterqvist, M.; Andersson, G. Chat- and internet-based cognitive-behavioural therapy in treatment of adolescent depression: Randomised controlled trial. BJPsych Open 2018, 4, 199–207. [Google Scholar] [CrossRef] [PubMed]
  35. Topooco, N.; Byléhn, S.; Dahlström Nysäter, E.; Holmlund, J.; Lindegaard, J.; Johansson, S.; Åberg, L.; Bergman Nordgren, L.; Zetterqvist, M.; Andersson, G. Evaluating the Efficacy of Internet-Delivered Cognitive Behavioral Therapy Blended With Synchronous Chat Sessions to Treat Adolescent Depression: Randomized Controlled Trial. J. Med. Internet Res. 2019, 21, e13393. [Google Scholar] [CrossRef] [Green Version]
  36. Rasing, S.P.A. Blended Treatment for Depressive Disorders in Youth: A Narrative Review. Int. J. Cogn. Ther. 2020, 1–12. [Google Scholar] [CrossRef]
  37. Rasing, S.P.A.; Stikkelbroek, Y.A.J.; Riper, H.; Dekovic, M.; Nauta, M.H.; Dirksen, C.D.; Creemers, D.H.M.; Bodden, D.H.M. Effectiveness and Cost-Effectiveness of Blended Cognitive Behavioral Therapy in Clinically Depressed Adolescents: Protocol for a Pragmatic Quasi-Experimental Controlled Trial. JMIR Res. Protocols 2019, 8, e13434. [Google Scholar] [CrossRef] [Green Version]
  38. Stikkelbroek, Y.A.J.; Bodden, D.H.M.; Deković, M.; van Baar, A.L. Effectiveness and cost effectiveness of cognitive behavioral therapy (CBT) in clinically depressed adolescents: Individual CBT versus treatment as usual (TAU). BMC Psychiatry 2013, 13, 314. [Google Scholar] [CrossRef] [Green Version]
  39. Stikkelbroek, Y.; Vink, G.; Nauta, M.H.; Bottelier, M.A.; Vet, L.J.J.; Lont, C.M.; Van Baar, A.L.; Bodden, D.H.M. Effectiveness and moderators of individual cognitive behavioral therapy versus treatment as usual in clinically depressed adolescents: A randomized controlled trial. Sci. Rep. 2020, 10, 1–13. [Google Scholar]
  40. Schulz, K.F.; Altman, D.G.; Moher, D.; Consort Group. CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. Trials 2010, 11, 32. [Google Scholar] [CrossRef] [Green Version]
  41. Moher, D.; Hopewell, S.; Schulz, K.F.; Montori, V.; Gøtzsche, P.C.; Devereaux, P.J.; Elbourne, D.; Egger, M.; Altman, D.G. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. Int. J. Surg. 2012, 10, 28–55. [Google Scholar] [CrossRef] [Green Version]
  42. Chan, A.W.; Tetzlaff, J.M.; Altman, D.G.; Laupacis, A.; Gøtzsche, P.C.; Krleža-Jerić, K.; Hróbjartsson, A.; Mann, H.; Dickersin, K.; Berlin, J.A. SPIRIT 2013 statement: Defining standard protocol items for clinical trials. Ann. Intern. Med. 2013, 158, 200–207. [Google Scholar] [CrossRef] [Green Version]
  43. Andrews, G.; Cuijpers, P.; Craske, M.G.; McEvoy, P.; Titov, N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS ONE 2010, 5, e13196. [Google Scholar] [CrossRef]
  44. Stikkelbroek, Y.A.J.; Bouman, H.; Cuijpers, P. De Doepressiecursus; Doepressie.nl: Dordrecht, The Netherlands, 2005. [Google Scholar]
  45. Clarke, G.N.; Lewinsohn, P.M.; Hops, H. Adolescent Coping with Depression Course; Castalia Publishing: Eugene, OR, USA, 1990. [Google Scholar]
  46. Stikkelbroek, Y.A.J.; Van Dijk, J. D(o)epressie Blended; Jouw Omgeving: Utrecht, The Netherlands, 2013. [Google Scholar]
  47. Kaufman, J.; Birmaher, B.; Brent, D.A.; Rao, U.M.A.; Flynn, C.; Moreci, P.; Williamson, D.; Ryan, N. Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. J. Am. Acad. Child Adolesc. Psychiatry 1997, 36, 980–988. [Google Scholar] [CrossRef]
  48. Reichart, C.G.; Wals, M.; Hillegers, M. Vertaling K-Sads; HC Rümke Groep: Utrecht, The Netherlands, 2000. [Google Scholar]
  49. Bodden, D.; Stikkelbroek, Y.; Braet, C. The Child Depression Inventory 2 (CDI-2); Utrecht University Press: Utrecht, The Netherlands, 2016. [Google Scholar]
  50. Kovacs, M. The Children’s Depression Inventory 2: Manual; Multi-Health Systems, Inc.: North Tonawanda, NY, USA, 2011. [Google Scholar]
  51. Reynolds, W.M. SIQ, Suicidal Ideation Questionnaire: Professional Manual; Psychological Assessment Resources: Odessa, FL, USA, 1988. [Google Scholar]
  52. Posner, K.; Brown, G.K.; Stanley, B.; Brent, D.A.; Yershova, K.V.; Oquendo, M.A.; Currier, G.W.; Melvin, G.A.; Greenhill, L.; Shen, S. The Columbia–Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am. J. Psychiatry 2011, 168, 1266–1277. [Google Scholar] [CrossRef] [Green Version]
  53. Achenbach, T.M. Manual for the Child Behavior Checklist/4-18, YSR, and TRF Profiles; University of Vermont Department of Psychiatry: Burlington, VT, USA, 1991. [Google Scholar]
  54. Verhulst, F.; Ende, J.; Van der Koot, H. Handleiding Voor de CBCL/4–18; Erasmus University Rotterdam: Rotterdam, The Netherlands, 1996. [Google Scholar]
  55. Guy, W. ECDEU Assessment Manual for Psychopharmacology; US Department of Health, Education, and Welfare, Public Health Service, Alcohol, Drug Abuse, and Mental Health Administration, National Institute of Mental Health, Psychopharmacology Research BranchDivision of Extramural Research Programs: Rockville, MD, USA, 1976. [Google Scholar]
  56. Shaffer, D.; Gould, M.S.; Brasic, J.; Ambrosini, P.; Fisher, P.; Bird, H.; Aluwahlia, S. A children’s global assessment scale (CGAS). Arch. Gen. Psychiatry 1983, 40, 1228–1231. [Google Scholar] [CrossRef]
  57. Bunte, T.; Schoemaker, K.; Matthys, W. Children’s Global Assessment Scale (CGAS), Dutch Translation; Utrecht University Press: Utrecht, The Netherlands, 2011. [Google Scholar]
  58. Rubin, D.B. Multiple Imputation for Nonresponse in Surveys; Wiley: New York, NY, USA, 1987. [Google Scholar]
  59. R Core Team. R: A Language and Environment for Statistical Computing. Available online: https://www.R-project.org (accessed on 16 September 2020).
  60. Van Buuren, S.; Groothuis-Oudshoorn, K. Mice: Multivariate imputation by chained equations in R. J. Stat. Softw. 2011, 45, 1–68. [Google Scholar] [CrossRef] [Green Version]
  61. Bates, D.M.; Maechler, M.; Bolker, B.; Walker, S. Fitting Linear Mixed-Effects Models Using lme4. J. Stat. Softw. 2015, 67, 1–48. [Google Scholar] [CrossRef]
  62. Twisk, J.; Bosman, L.; Hoekstra, T.; Rijnhart, J.; Welten, M.; Heymans, M. Different ways to estimate treatment effects in randomised controlled trials. Contemp. Clin. Trials Commun. 2018, 10, 80–85. [Google Scholar]
  63. Brown, H.; Prescott, R. Applied Mixed Models in Medicine; John Wiley & Sons: West Sussex, UK, 2014. [Google Scholar]
  64. Jacobson, N.S.; Truax, P. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. J. Consult. Clin. Psychol. 1991, 59, 12–19. [Google Scholar] [CrossRef] [PubMed]
  65. De Haan, A.M.; Boon, A.E.; De Jong, J.T.V.M.; Hoeve, M.; Vermeiren, R.R.J.M. A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin. Psychol. Rev. 2013, 33, 698–711. [Google Scholar] [CrossRef] [PubMed]
  66. Schuster, R.; Pokorny, R.; Berger, T.; Topooco, N.; Laireiter, A.R. Advantages and disadvantages of online and blended therapy: Attitudes towards both interventions amongst licensed psychotherapists in Austria. J. Med. Internet Res. 2018, 20, e11007. [Google Scholar] [CrossRef]
  67. Wampold, B.E. How important are the common factors in psychotherapy? An update. World Psychiatry 2015, 14, 270–277. [Google Scholar] [CrossRef] [Green Version]
  68. Vernmark, K.; Hesser, H.; Topooco, N.; Berger, T.; Riper, H.; Luuk, L.; Backlund, L.; Carlbring, P.; Andersson, G. Working alliance as a predictor of change in depression during blended cognitive behaviour therapy. Cogn. Behav. Ther. 2019, 48, 285–299. [Google Scholar] [CrossRef] [PubMed]
  69. Cuijpers, P. Four decades of outcome research on psychotherapies for adult depression: An overview of a series of meta-analyses. Can. Psychol./Psychol. Can. 2017, 58, 7. [Google Scholar] [CrossRef] [Green Version]
  70. Weisz, J.R.; Krumholz, L.S.; Santucci, L.; Thomassin, K.; Ng, M.Y. Shrinking the gap between research and practice: Tailoring and testing youth psychotherapies in clinical care contexts. Annu. Rev. Clin. Psychol. 2015, 11, 139–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  71. Bonevski, B.; Randell, M.; Paul, C.; Chapman, K.; Twyman, L.; Bryant, J.; Brozek, I.; Hughes, C. Reaching the hard-to-reach: A systematic review of strategies for improving health and medical research with socially disadvantaged groups. BMC Med. Res. Methodol. 2014, 14, 42. [Google Scholar] [CrossRef] [Green Version]
Ijerph 18 03102 g001 550
Figure 1. Flow diagram of participants.
Figure 1. Flow diagram of participants.
Ijerph 18 03102 g001
Table
Table 1. Diagnostic sample characteristics.
Table 1. Diagnostic sample characteristics.
Blended Cognitive Behavioral Therapy (CBT) (n = 37)Face-to-Face CBT (n = 44)Treatment as usual (TAU) (n = 40)Blended CBT vs. Face-to-Face CBTBlended CBT vs. TAU
n (%)n (%)n (%)χ2pχ2p
Depressive disorder (MDD or Dysthymic disorder)37 (100%)44 (100%)40 (100%)* *
Bipolar disorder000* *
Psychotic disorder02 (4.5%)01.720.19*
Panic disorder1 (2.7%)4 (9.1%)1 (2.5%)1.420.230.0030.96
Social phobia1 (2.7%)13 (29.5%)8 (20.0%)10.130.0015.570.02
Specific phobia1 (2.7%)4 (9.1%)3 (7.5%)1.420.230.900.34
Separation anxiety1 (2.7%)2 (4.5%)2 (5.0%)1.910.660.270.60
Generalized Anxiety Disorder12 (32.4%)14 (31.8%)9 (22.5%)0.0030.950.960.33
Post-Traumatic Stress Disorder (PTSD)1 (2.7%)3 (6.8%)3 (7.5%)0.730.390.900.34
Acute Stress Disorder001 (2.5%)* 0.940.33
Obsessive Compulsive Disorder (OCD)000* *
Anorexia Nervosa01 (2.3%)00.850.36*
Bulimia Nervosa01 (2.3%)00.850.36*
Attention Deficit and Hyperactivity Disorder (ADHD)5 (13.5%)6 (13.6%)5 (12.5%)00.990.020.90
Conduct Disorder000* *
Oppositional Defiant Disorder (ODD)01 (2.3%)1 (2.5%)0.850.360.940.33
Tic disorder1 (2.7%)001.200.271.100.30
Note. * χ2 was not calculated due to constant values. Missing data from the clinical interviews was not imputed.
Table
Table 2. Between-group differences and effect sizes in secondary outcomes.
Table 2. Between-group differences and effect sizes in secondary outcomes.
Blended CBTFace-to-Face CBTTAUBlended CBT vs. Face-to-Face CBTBlended CBT vs. TAU
M (SD)M (SD)M (SD)Upd (95% CI)Upd (95% CI)
Depressive symptoms T025.94 (6.07)26.58 (9.45)24.73 (7.46)746.50.64−0.08 (−0.51, 0.35)707.00.370.18 (−0.25, 0.60)
Depressive symptoms T318.83 (10.85)16.43 (13.79)19.03 (11.88)141.00.100.19 (−0.23, 0.62)187.00.52−0.02 (−0.44, 0.41)
Depressive symptoms T414.36 (13.46)14.19 (16.63)12.61 (13.06)60.50.380.01 (−0.41, 0.44)95.50.890.13 (−0.29, 0.56)
Suicide risk T03.53 (3.21)4.55 (4.13)3.66 (3.40)702.00.40−0.27 (−0.70, 0.15)672.50.94−0.04 (−0.46, 0.39)
Suicide risk T32.93 (4.11)2.52 (4.06)3.01 (4.52)136.50.150.10 (−0.33, 0.53)178.50.57−0.02 (−0.45, 0.41)
Suicide risk T41.50 (4.23)1.73 (4.24)0.90 (2.67)71.00.74−0.05 (−0.48, 0.37)66.50.220.17 (−0.25, 0.60)
Internalizing symptoms T028.20 (9.03)29.31 (9.08)28.60 (9.13)731.00.48−0.12 (−0.55, 0.30)800.50.82−0.04 (−0.47, 0.38)
Internalizing symptoms T322.32 (13.51)20.41 (14.98)22.05 (15.15)161.00.400.13 (−0.29, 0.56)188.50.770.02 (−0.41, 0.44)
Internalizing symptoms T417.86 (19.01)16.03 (14.95)17.60 (15.38)66.00.560.11 (−0.32, 0.53)118.00.580.02 (−0.41, 0.44)
Externalizing symptoms T011.01 (7.17)13.43 (9.85)12.63 (8.09)784.00.19−0.28 (−0.71, 0.15)876.00.33−0.21 (−0.64, 0.21)
Externalizing symptoms T39.87 (12.50)11.55 (10.33)10.55 (11.34)247.00.13−0.15 (−0.57, 0.28)251.50.17−0.06 (−0.48, 0.37)
Externalizing symptoms T47.38 (10.21)7.89 (8.56)8.18 (9.69)101.00.20−0.05 (−0.48, 0.37)135.50.19−0.08 (−0.51, 0.35)
Severity of depression T04.16 (1.02)4.16 (1.01)3.93 (1.36)663.00.340.00 (−0.43, 0.42)686.50.560.19 (−0.24, 0.62)
Severity of depression T32.72 (1.85)2.53 (1.87)2.38 (1.53)310.00.660.10 (−0.33, 0.53)286.00.150.20 (−0.23, 0.63)
Global functioning T050.88 (7.32)49.67 (10.03)49.24 (10.08)740.01.000.14 (−0.29, 0.56)613.00.350.19 (−0.24, 0.61)
Global functioning T360.85 (18.52)62.51 (17.82)64.15 (14.23)337.00.74−0.09 (−0.52, 0.33)381.00.47−0.20 (−0.63, 0.23)
Table
Table 3. Linear mixed model results of interaction terms between condition and time, on suicide risk, internalizing symptoms, externalizing symptoms, severity of depression and global functioning.
Table 3. Linear mixed model results of interaction terms between condition and time, on suicide risk, internalizing symptoms, externalizing symptoms, severity of depression and global functioning.
Blended CBT vs. Face-to-Face CBTBlended CBT vs. TAU
BSEpBSEp
Suicide risk T30.680.660.30−0.010.660.97
Suicide risk T40.050.650.940.690.660.29
Internalizing symptoms T32.072.260.360.442.270.85
Internalizing symptoms T41.982.240.380.392.270.86
Externalizing symptoms T3−0.941.570.55−0.211.560.89
Externalizing symptoms T40.261.560.87−0.351.570.82
Severity of depression T30.190.290.520.320.300.28
Global functioning T3−1.912.600.46−3.692.580.15
Note. All results originate from separate multivariate regression analyses, from which the independent variable of interest is here reported.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rasing, S.P.A.; Stikkelbroek, Y.A.J.; den Hollander, W.; Riper, H.; Deković, M.; Nauta, M.H.; Creemers, D.H.M.; Immink, M.C.P.; Spuij, M.; Bodden, D.H.M. Pragmatic Quasi-Experimental Controlled Trial Evaluating the Outcomes of Blended CBT Compared to Face-to-Face CBT and Treatment as Usual for Adolescents with Depressive Disorders. Int. J. Environ. Res. Public Health 2021, 18, 3102. https://doi.org/10.3390/ijerph18063102

AMA Style

Rasing SPA, Stikkelbroek YAJ, den Hollander W, Riper H, Deković M, Nauta MH, Creemers DHM, Immink MCP, Spuij M, Bodden DHM. Pragmatic Quasi-Experimental Controlled Trial Evaluating the Outcomes of Blended CBT Compared to Face-to-Face CBT and Treatment as Usual for Adolescents with Depressive Disorders. International Journal of Environmental Research and Public Health. 2021; 18(6):3102. https://doi.org/10.3390/ijerph18063102

Chicago/Turabian Style

Rasing, Sanne P.A., Yvonne A.J. Stikkelbroek, Wouter den Hollander, Heleen Riper, Maja Deković, Maaike H. Nauta, Daan H.M. Creemers, Marianne C.P. Immink, Mariken Spuij, and Denise H.M. Bodden. 2021. "Pragmatic Quasi-Experimental Controlled Trial Evaluating the Outcomes of Blended CBT Compared to Face-to-Face CBT and Treatment as Usual for Adolescents with Depressive Disorders" International Journal of Environmental Research and Public Health 18, no. 6: 3102. https://doi.org/10.3390/ijerph18063102

APA Style

Rasing, S. P. A., Stikkelbroek, Y. A. J., den Hollander, W., Riper, H., Deković, M., Nauta, M. H., Creemers, D. H. M., Immink, M. C. P., Spuij, M., & Bodden, D. H. M. (2021). Pragmatic Quasi-Experimental Controlled Trial Evaluating the Outcomes of Blended CBT Compared to Face-to-Face CBT and Treatment as Usual for Adolescents with Depressive Disorders. International Journal of Environmental Research and Public Health, 18(6), 3102. https://doi.org/10.3390/ijerph18063102

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop