Next Article in Journal
Safe, Efficient, and Comfortable Autonomous Driving Based on Cooperative Vehicle Infrastructure System
Next Article in Special Issue
Kurdish Refugee Beliefs about Mental Health and Help-Seeking: A Community-Engaged Research Study in Tennessee
Previous Article in Journal
COVID-19 News Exposure and Vaccinations: A Moderated Mediation of Digital News Literacy Behavior and Vaccine Misperceptions
Previous Article in Special Issue
Driving for Success in Family Reunification—Professionals’ Views on Intervention
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 20
Issue 1
10.3390/ijerph20010892
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Characteristics and Effectiveness of Co-Designed Mental Health Interventions in Primary Care for People Experiencing Homelessness: A Systematic Review

by
Tobias Schiffler
1,
Ali Kapan
1,
Alina Gansterer
1,
Thomas Pass
1,
Lisa Lehner
1,2,
Alejandro Gil-Salmeron
3,*,
Daragh T. McDermott
4 and
Igor Grabovac
1
1
Center for Public Health, Department of Social and Preventive Medicine, Medical University of Vienna, Kinderspitalgasse 15, 1090 Vienna, Austria
2
Department of Science & Technology Studies, Cornell University, 303 Morrill Hall, Ithaca, NY 14853, USA
3
International Foundation for Integrated Care, Wolfson College, Linton Rd., Oxford OX2 6UD, UK
4
NTU Psychology, School of Social Sciences, Nottingham Trent University, Nottingham NG1 4FQ, UK
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(1), 892; https://doi.org/10.3390/ijerph20010892
Submission received: 27 September 2022 / Revised: 27 December 2022 / Accepted: 31 December 2022 / Published: 3 January 2023
(This article belongs to the Special Issue Health and Well-Being in Vulnerable Communities)
Browse Figure
Versions Notes

Abstract

:
People experiencing homelessness (PEH) face a disproportionately high prevalence of adverse mental health outcomes compared with the non-homeless population and are known to utilize primary healthcare services less frequently while seeking help in emergency care facilities. Given that primary health services are more efficient and cost-saving, services with a focus on mental health that are co-designed with the participation of users can tackle this problem. Hence, we aimed to synthesize the current evidence of such interventions to assess and summarize the characteristics and effectiveness of co-designed primary mental healthcare services geared towards adult PEH. Out of a total of 10,428 identified records, four articles were found to be eligible to be included in this review. Our findings show that co-designed interventions positively impacted PEH’s mental health and housing situation or reduced hospital and emergency department admissions and increased primary care utilization. Therefore, co-designed mental health interventions appear a promising way of providing PEH with continued access to primary mental healthcare. However, as co-designed mental health interventions for PEH can improve overall mental health, quality of life, housing, and acute service utilization, more research is needed.

1. Introduction

Homelessness is strongly associated with significant health inequalities, including high levels of mortality and morbidity (e.g., cancer is the second most common cause of death) compared with the non-homeless population [1,2,3]. This association is observed in both directions, meaning homelessness in itself increases the risk of mental health problems with many people experiencing homelessness (PEH) disproportionately facing severe mental illness, cognitive impairment, as well as high rates of homicide and suicide [4,5,6]. International studies report a high prevalence of mental illness, such as depressive and anxiety disorder, among PEH ranging from 25% to 92%, exceeding the prevalence among people not experiencing homelessness [7,8,9]. According to a recently published systematic review by Gutwinski et al. [8] in 2021 surveying the prevalence of mental disorders among PEH in high-income countries, the most common diagnostic categories included alcohol use disorders, at 36.7% (95% CI 27.7 to 46.2) and drug use disorders, at 21.7% (95% CI 13.1 to 31.7), followed by schizophrenia spectrum disorders (12.4% [95% CI 9.5 to 15.7]) and major depression (12.6% [95% CI 8.0 to 18.2]). As this population continues to grow, the mental health of PEH is fast becoming a social and public health problem of great global importance [6].
Despite facing significant health challenges, PEH represent one of the most marginalized populations with their needs for mental healthcare being widely unmet [10]. Primary care provides the first point of contact for many people and also acts as a gatekeeper to other statutory services [11]. Yet, PEH are less likely to seek support and treatment through primary healthcare [2,12]. The reasons for not accessing primary care can be complex and interrelated [6], including economic issues (affordability), social stigma (prior rejection by health or social services), and organizational barriers (institutional schedules, complexity of the care system) [13,14]. In a study led by Farnarier et al. [15], PEH asked to complete a questionnaire listed “visiting a primary care physician” as only fifth on their list of priorities when they become ill. In turn, PEH’s healthcare pathways are characterized by high rates of visits to emergency departments and psychiatric hospitals for acute mental health needs [16,17]. The evidence for this is largely extended, including healthcare systems based and not based on the principle of universal healthcare coverage [6].
As it is an important opportunity to address or resolve health disparities when accessing primary healthcare, the question arises of what type of health intervention and support yields the best results. Although re-designing the current health and care systems to make primary healthcare services more accessible to PEH may result in several benefits, such as better health outcomes and integration into the community [8,18], it may present different challenges. A possible solution to this can be the implementation of co-designed healthcare models. Originating from the field of implementation science, the co-design approach is a specialized concept used in the development of target group-specific and person-centered health and social care models [19,20,21,22,23]. As co-designing methods pursue a holistic approach, including different groups of persons in the developmental process, stakeholders, researchers, and end users are provided the same opportunity to engage in the model-designing process and contribute their thoughts and ideas [24,25].
The unique aspect of this process results in the practicability of a model, as it is precisely adapted to real-life conditions and scenarios. Given such targeted interventions, resources of a financial or a temporal nature are used more cost-effectively and reduce the misalignment between researcher, stakeholder, and user aims [20]. Especially concerning underserved and marginalized groups of persons, the co-design approach is an invaluable tool to provide these individuals with the possibility of co-development and participation in decision-making processes [26,27]. Some findings from a cross-sectional study by Joyce and Limbos [28] and a quasi-experimental study by Stergiopoulos et al. [29] suggest that if collaborative primary healthcare models are not just tailored for PEH but also based in the community (i.e., located directly in homeless shelters or day centers), they may also be more effective in the identification, treatment, compliance, and improvement of mental health outcomes [28,29]. Evidence from supportive housing approaches shows that for people experiencing chronic homelessness and mental illness, housing-first interventions, via assertive community treatment or intensive case management, are more effective in terms of reduction in inpatient psychiatric hospital utilization than standard care provision [30,31]. All these aforementioned reasons support the notion that PEH need multidisciplinary and integrated primary healthcare management regarding somatic, mental, and social issues that aim at tackling barriers they experience [32,33]. Additional evidence supports a need for health interventions including elements of co-design in healthcare delivery design [26]. Traditionally, those affected by issues to be addressed with a given intervention are excluded from designing and decision-making processes, while mechanisms of inclusion and participation are suggested to yield greater long-term success and effectiveness in its implementation [30,31].
Given the global rise in the numbers of PEH and the need for evidence-based, effective interventions, this review aims to address this urgent need by summarizing the current evidence relating to mental health services in primary care for PEH. A preliminary literature search by the authors did not identify a systematic review that addresses experiences across mental health services in PEH with mental illness. In this comprehensive systematic review of data from quantitative studies, the authors aimed to synthesize the current evidence on the characteristics and effectiveness of co-designed mental health interventions in primary care for adult PEH with mental health illness and to compare models where the quality of the evidence permitted this. To provide a greater understanding of such interventions, this review can support policies and intervention strategies tackling mental healthcare in primary care settings for adult PEH.

2. Materials and Methods

This systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist and statement [34]. The protocol of this systematic review was registered in the PROSPERO database (CRD42022354017).

2.1. Search Strategy

Two of the authors searched papers from 1 January 2000 to 21 March 2022 in the electronic databases MEDLINE/PubMed, Scopus, Web of Science, PsycInfo, and CINAHL. In the search, only papers written in English or German were included, matching the authors’ language proficiency. To identify missing papers, bibliographies of all included studies were checked manually for additional references. The following search string was used across all databases: (homeless*) AND ((primary care*) OR (mental healthcare*) OR (collaborative care model*) OR (co-designed intervention*) OR (general pract*)) AND ((mental health*) OR (psych* diagnosis)). Figure 1 shows the entire search process in the form of a flow chart as suggested by PRISMA [35].

2.2. Criteria for Study Selection

This systematic review included cohort studies, intervention studies, case-control studies, cross-sectional studies, clinical trials, and randomized controlled trials (RCTs). Case reports, opinions, editorials, commentaries, letters, conference abstracts, and reviews or systematic reviews were excluded. Studies were included if they reported results from a co-designed intervention in a primary care setting in adult PEH, whereby homelessness was defined according to the categories of the European Typology of Homelessness and Housing Exclusion (ETHOS) [36], and interventions were identified as being co-designed if researchers included PEH and/or stakeholders in their model development collaboratively. However, other relevant interventions aiming at mental health improvements for PEH, such as collaborative care model-based interventions, integrated care interventions, shelter-based care interventions, as well as interventions that involved screening for diagnoses were also included. Additionally, multi-component interventions comprising management of physical health were included if they explicitly addressed mental health outcomes. Interventions can both be delivered by a multidisciplinary team of professionals or a single professional. Interventions with a multi-component approach that are partly delivered by healthcare professionals were also included. Among controlled study designs, we included studies that fulfilled both of our inclusion criteria for comparator or control groups: PEH aged 18 or above. Additionally, sites of implementation were assessed through the comparison of shelter or community-based services and interventions based in primary healthcare centers. Studies were excluded if participants in the study were children and minors or those who do not experience homelessness.

2.3. Types of Outcomes

For the review, we were interested in the relevant characteristics of co-designed interventions and their effectiveness in primary care settings aimed at improving the mental health outcomes of adult PEH. We defined effectiveness as compliance, rate of identified diagnoses, treatment rate, therapy outcomes, and satisfaction with the service. Additionally, we were also interested in implementation strategies known to impact the effectiveness of multidisciplinary collaborative care models aiming at mental health outcomes in PEH, as well as how the utilization of community-based primary care models or collaborative care models impacted mental health outcomes in PEH.

2.4. Data Extraction

While the title screening was performed by all reviewers, two independent reviewers initially reviewed all titles for duplication to ensure no relevant study was erroneously excluded, followed by two independent reviewers reviewing all abstracts. Subsequently, three reviewers independently assessed the full texts of all potentially eligible studies. If necessary, disagreements during the screenings of titles, abstracts, and full texts were resolved by discussion, involving another independent reviewer.
Guided by the data collection form provided by Cochrane Effective Practice and Organisation of Care [37], two independent reviewers (I.G. and T.S.) extracted the following information for all articles: (1) General information; (2) Eligibility; (3) Population and setting; (4) Methods; (5) Participants; (6) Intervention groups; (7) Outcomes; (8) Results; (9) Applicability; and (10) Other information.

2.5. Data Evaluation

The quality of the included studies was assessed by two reviewers using both the Tool to Assess Risk of Bias in Cohort Studies [38] and the Cochrane Risk of Bias Tool [39]. These tools allowed us to appraise the methodological quality of the three categories of studies included in our review, namely randomized controlled trials, non-randomized quasi-experimental studies, and cohort studies. Disagreements were resolved independently by a third reviewer.

3. Results

As represented in Figure 1, our initial search strategy yielded a total of 10,428 publications. After removing 6559 articles due to duplication, publication year, or language, 3869 records were identified as eligible for the subsequent screening. During the title and abstract screening process, a total of 3809 articles were excluded as they did not correspond to the review criteria. Out of 60 records examined in the final full-text screening, four studies fulfilled all inclusion criteria and were included for data extraction. Summarized methodological information on these studies can be found in Table 1.
Overall, most articles were excluded due to the following reasons: the investigated interventions were not set in primary care settings; the articles were not original research; the interventions were not created using a co-design approach; the study populations were not suitable; the studies did not investigate at least one mental health outcome.
Table 2 represents the quality appraisal of the included studies. The overall risk of bias in the randomized [40] and non-randomized [29,41] trials ranged from ‘unclear’ to ‘high risk’, while all articles were classified as ‘low risk’ in terms of the incompleteness of outcome data and selectivity in outcome reporting. In contrast, the cohort study conducted by Stergiopoulos et al. [42] showed ‘low risk’ throughout most domains of the used assessment tool.

3.1. Characteristics of Participants and Settings

Across all included studies, an aggregated number of 795 participants were investigated, while study-specific sample sizes varied from 67 to 363. In terms of gender distribution, three studies [40,41,42] included both male and female participants, and one study [29] focused on men exclusively as the research team collaborated with two shelters that served only men with complex mental health and social needs. Two of the studies were conducted in Toronto, Canada, one in Chicago, USA, and one in San Diego, USA. All of them investigated PEH who were experiencing impaired mental health, either by living with a mental illness [29,40,41] or unmet mental health needs as identified by healthcare providers [42]. Across all studies, the majority of participants living with a mental illness were experiencing anxiety disorders, bipolar affective disorders, major depression, posttraumatic stress disorders, schizophrenia or related psychotic disorders, or substance use disorder.
While Gilmer et al. [41], Stergiopoulos et al. [29], and Stergiopoulos et al. [42] did not focus on particular subgroups of PEH, Corrigan et al. [40] investigated people self-identifying as African American. They were reported as homeless if they did not have permanent housing and lived on the streets or in any other non-permanent or unstable situation, such as in a shelter, single-room occupancy, mission, vehicle, or abandoned building. Stergiopoulos et al. [42] conceived homelessness more narrowly since a person was only reported as being homeless if they were couch surfing, living on the street, or in a crisis or emergency shelter. While Stergiopoulos et al. [29] did not describe their definition of homelessness in detail, Gilmer et al. [41] explicitly focused on chronically homeless individuals. Individuals experiencing chronic homelessness were depicted as having spent several years living in precarious housing situations. The ETHOS category indicated in Table 1 was not reported in any of the studies presented here and was decided upon based on the population description in the individual studies.
Not all studies reported on inclusion and exclusion criteria for participation. While Gilmer et al. [41] did not state any eligibility criteria at all, Corrigan et al. [40] only excluded potential participants if they did not report currently having a mental illness, did not currently meet its definition for homelessness, or were already receiving case management services focusing on physical health at another institution. The two other studies clearly described both inclusion and exclusion criteria, whereby participants who were homeless and 18 years of age or above were included, and those who were a danger to themselves or others or had a history of severe aggression were excluded [29,42].

3.2. Characteristics of Interventions

Each of the included studies examined a different type of co-designed intervention, but they varied in terms of how they approached the co-design process. Corrigan et al. [40] investigated the peer navigator program that was developed by a team embedded in a community-based participatory research project. Based on existing peer navigator guidelines, findings from a previously conducted qualitative study, and team members’ individual experiences with mental and physical health systems, a patient navigator manual comprising several basic principles was created. During a treatment period of 12 months, peer navigators were supposed to approach program participants at least once a week in the form of a personal meeting. Service recipients were in charge of meeting locations and times. During these meetings, peer navigators reviewed the health concerns and worries of their clients and collaboratively established concrete actions to address these problems. For instance, the planned activities focused on homelessness, diet, or criminal justice involvement. Three participants who had experienced homelessness and recovered from severe mental illness served as peer navigators and shared their responsibilities for all assigned participants. The group of people within the peer navigator program was compared with a treatment-as-usual group utilizing a non-co-designed intervention.
During the intervention investigated by Gilmer et al. [41], PEH were provided subsidized permanent housing and team-based services focusing on recovery and rehabilitation. In these full-service partnerships, clients directly received services in their living environment including home, work, and other places they identified as favorable to themselves or where they needed support. Additionally, individuals were able to employ crisis intervention services operating 24/7. Utilizing this collaborative approach, clients were reportedly empowered to achieve their personal goals without this being determined by their respective mental illnesses. For study purposes, participants were contacted one year before engaging in the full-service partnership program while follow-up data collection occurred one year after their entry, resulting in a study period of two years. During this time, clients were not obliged to make use of therapy but had to meet with a treatment team at least once per month. Individuals were recruited from psychiatric hospitals, jails, shelters, emergency departments, county agencies, the street, and other localities or institutions. Community treatment teams were composed of several mental health and other professionals, as well as peer specialists providing their clients with various services such as medication management or substance abuse services. The intervention group was compared with users of unspecified public mental health services.
The integrated multidisciplinary collaborative care model studied by Stergiopoulos et al. [29] aimed at streamlining referrals, interdisciplinarity, increased provider communication, coordinated care, and integrated shelter-based case management. A team composed of shelter staff and (mental) healthcare professionals worked collaboratively within a treatment period of 12 months for each participant. During this period, PEH were interviewed at baseline, half-time, and end of the intervention. This model was compared with a shifted outpatient collaborative care model that aimed at providing PEH with timely mental healthcare, simplified referrals, and improved communication between shelter staff and local psychiatrists. As part of the model, the client’s treatment progress was appraised consistently as cared coordination and case management plans.
Stergiopoulos et al. [42] studied an interdisciplinary intervention providing PEH with case management, primary psychiatric care, peer support, and supplementary community services. The program called “coordinated access to care for the homeless” was a four-to-six-month intervention that included a variety of case management services, such as crisis intervention, community visits, or supportive therapies. Improved accessibility to support for issues surrounding income, health, and social issues was accomplished through collaboration with community health centers, social services, and other community agencies. This intervention used a combination of peer support and low-threshold healthcare. Healthcare professionals cooperated with case managers to create interdisciplinary assessments with PEH that allowed them to offer comprehensive and tailored care plans addressing clients’ needs. Since the study was designed as a cohort study, a comparison group was not needed.

3.3. Impact and Effectiveness of Interventions

As represented in Table 1, the included studies addressed several types of outcomes. Not all these outcomes were primarily focused on mental health. They included mental health (psychiatric disorder, mental health symptoms, and substance use; n = 3) [40,42], quality of life (general and disease-specific; n = 3) [40,41,42], service use (mental health services, general health services, and acute services; n = 3) [29,41,42], recovery (n = 2) [40,41], housing (housing and residential stability; n = 2) [29,42], physical illness (n = 1) [40], mental health services and housing costs on a system-level (n = 1) [41], community functioning (n = 1) [29], change in participant health status (n = 1) [42], and working-alliance construct (n = 1) [42]. These outcomes are described in more detail below, with a focus on the ones related to mental health and service use.

3.3.1. Mental Health

Two studies directly investigated a total of three mental health outcomes, namely psychiatric disorders, mental health symptoms, and substance use. Psychiatric disorder, as measured by Corrigan et al. [40], was defined by the Texas Christian University Health Form (TCU-HF) and the 36-item Short Form of the Medical Outcomes Survey (SF-36). While the TCU-HF is based on a five-point Likert scale representing the sole frequency of 14 general health and ten mental health problems, the SF-36 considers an individual’s experience of health and several subfactors. Both the TCU-HF and the SF-36 demonstrated significant improvement in the psychiatric disorder outcome indicated by self-report indices, twelve months after baseline. Stergiopoulos et al. [42] examined the mental health state of their participants in terms of mental health symptoms as defined by the mental component score of the SF-36 and the 14-item Modified Colorado Symptom Index (CSI), and substance use, defined by a combination of drug and alcohol modules derived from the Addiction Severity Index (ASI), measuring substance use within the past 30 days. Six months after baseline, participants showed significant improvements in all scores, suggesting that interdisciplinary interventions may be promising in terms of improving mental health outcomes.

3.3.2. Quality of Life

While two studies investigated the general quality of life of participants [40,41], one study focused on disease-specific quality of life [42]. The general quality of life was measured with Lehman’s Quality of Life Scale (QLS) by Corrigan et al. [40], whereas Gilmer et al. [41] compared quality of life cross-sectionally among clients receiving services in outpatient programs. Here, participants had to respond to 21 self-developed questions within eight domains. In both studies, participants in the intervention groups showed higher scores in the quality of life outcome. Stergiopoulos et al. [42] defined disease-specific quality of life as the total score of the 20-item Lehman Quality of Life Interview (QoLI-20), an instrument designed specifically for people living with severe mental illness. Analyzing the six-month versus baseline difference yielded a statistically significant improvement within the disease-specific quality of life outcome.

3.3.3. Service Use

Besides outcomes related to mental health, the included studies also examined other variables that were not directly within the scope of our systematic review. Service use as an outcome was investigated in three of the included studies [29,41,42]. Notably, each study examined a different type of service. Gilmer et al. [41] analyzed the one-year standardized utilization of outpatient mental health services after participants had entered their intervention, and compared differences between individuals enrolled in a full-service partnership and those in a control group. They found an association between this program with significant increases in outpatient service use and days spent in housing. In addition, the researchers inquired into system-level costs for mental health services and housing and noted a reduction in inpatient and emergency service costs that compensated for 82% of the overall costs for full-service partnerships. Stergiopoulos et al. [29] did not specifically focus on mental health service utilization, but on health services in general. For that purpose, self-reported data on healthcare utilization were collected using several service use logs. Of interest were hospitalizations and emergency department visits in the six months prior, as well as visits to primary care physicians within the previous 30 days. In both investigated programs, a significant reduction in hospital and emergency services use was observed, while visits to community physicians increased. Stergiopoulos et al. [42] focused on acute service use, with self-reported numbers of hospitalizations and emergency department visits three months before follow-up data collection. Both numbers decreased significantly compared with the respective baseline data.

3.3.4. Summary of Other Outcomes

Two studies also focused on recovery outcomes [40,41]. However, the definition of this outcome differed between those articles. Corrigan et al. [40] understood recovery as a more mental health-oriented variable that was measured using the Short Form of the Recovery Assessment Scale (RAS) including, e.g., willingness to ask for help and not being dominated by symptoms. The overall score of the RAS improved consistently over the course of the study, while participants in the treatment-as-usual group showed no change after 12 months compared with baseline. In turn, Gilmer et al. [41] approached the recovery outcome from the perspective of housing, financial support, and employment. The cohort of participants who received full-service partnerships had spent more days in housing, indicating a positive impact of the intervention. Furthermore, housing was investigated as an outcome in two other studies in terms of residential stability, whereby Stergiopoulos et al. [29] gathered self-reported residential data using residential logs from a database and Stergiopoulos et al. [42] used the Residential Time Line Follow-Back Calendar which captures housing history during the three months before a follow-up visit. Both studies yielded significant improvements in participants’ housing situations.
Physical health was assessed in two studies. Findings of both Corrigan et al. [40] and Stergiopoulos et al. [42] suggest a significant increase in participants’ physical health on the self-reported TCU-HF and the physical component score of the SF-36, respectively. Additional outcomes examined were community functioning in Stergiopoulos et al. [29] and the working-alliance construct described by Stergiopoulos et al. [42]. To assess community functioning, researchers used the self-rated version of the Multnomah Community Ability Scale that focuses on persons living with mental illness and their functioning within the community. Based on their findings, PEH experienced significant improvements in their community functioning. The working-alliance construct outcome was assessed using the Working Alliance Inventory-Participant which is a 12-item self-report instrument that measures the level of agreement between service providers and their clients about therapy goals, tasks, and the therapeutic relationship. Study findings after six months showed a significant and positive association between the inventory scores and the number of hospitalizations and emergency department visits.

4. Discussion

By conducting this systematic review, we sought to synthesize available evidence on co-designed interventions for mental health in primary care settings for people experiencing homelessness (PEH), focusing on program characteristics as well as impact and effectiveness. As far as we know, this is the first systematic review to focus on this specific topic.
The findings of our review revealed that using the co-design approach in terms of mental health promotion for PEH can yield significant benefits for this target population. Participants enrolled in the included studies consistently showed reduced symptoms of mental illness and substance use, indicating an improvement in terms of pre-existing psychiatric disorders. Moreover, other important spheres of life were positively affected, such as improved physical health or more stable living situations. In addition, the number of participants seeking acute healthcare services decreased, which was reflected in a lower frequency of hospitalizations or use of emergency care. Participants self-reported an increase in their quality of life, indicating targeted effectiveness. These positive findings are in line with other research conducted with underserved and marginalized populations, such as young people experiencing psychosis or culturally and linguistically diverse communities, and within the field of mental health service design demonstrating the advantage of the co-design approach for interventions targeting PEH and mental health [21,22,24,25,43].
Co-designed health and care interventions have been proven to be beneficial to PEH, specifically in the context of mental health promotion and care which can be confirmed by the findings of our review [44,45]. Particularly in this disadvantaged population, general health is consistently overshadowed by other serious problems of everyday life, resulting in higher levels of psychological distress leading to poor mental health [46,47]. This mental health vulnerability is further linked to a cascade of other social factors, such as lack of support or the inability to keep appointments, a vicious cycle that further compromises mental health [48]. In light of PEH frequently facing physical and mental health challenges together, this places an additional burden on individuals and further increases their level of vulnerability. Efficient primary care delivery aimed at promoting mental health, therefore, appears especially important [48,49,50], particularly in light of the beneficial effects of primary care on PEH as underscored in this review. By implementing primary healthcare, the development of severe mental health impairments can be counteracted, subsequently resulting in a positive impact on the overall social, health, and economic situation of PEH [50]. Adapting such primary healthcare interventions by implementing a co-design approach has the potential to make these even more effective.

4.1. Limitations

Despite promising findings, this systematic review is subject to some limitations. First, the generalizability of these results is not guaranteed as all included studies were conducted in North America and are therefore bound to a very specific social and healthcare setting. The number of included studies is considerably small, thus the generalizability of the results is not guaranteed. Since the four synthesized articles examined very different types of interventions, no mental health program was evaluated at least twice and independently. A comprehensive evaluation of the interventions, e.g., concerning their applicability in varying settings or with different subgroups of PEH is therefore impossible. The gender distribution in the reviewed studies prioritizes the experiences of male PEH. However, it should be noted that this imbalance might not reflect real-world data on the gender distribution of PEH as limited data regarding the gender-specific prevalence of homelessness exist [51]. Although research within the field of homelessness in European regions suggests a preponderance of male PEH, this gender distribution may be affected by European systems for enumerating homelessness that is undercounting women experiencing homelessness [52]. Women living homeless usually remain undetected for security reasons and because they make more use of private couch surfing arrangements than approaching public services. Additionally, when it comes to research concerning PEH and mental health, both researchers and policymakers may have misconceptions about their association [53].
A further limitation arises from the fact that of the included studies, only one was conducted using a randomized controlled design, which is considered the methodological gold standard within quantitative health research. The quality of quasi-experimental and cohort studies and the designs’ limitations in determining causal inferences received greater attention during risk of bias assessments. In general, a high to medium risk of bias was identified. The diversity of study designs also does not allow direct comparison, and especially complex real-life interventions can benefit from more experimental designs.
Another limitation is the ambiguity among the articles regarding the used definition of the co-design approach [19]. Specifically, none of the papers used the term co-design, which is why some uncertainties arose about study selection. For example, interventions were referred to as collaborative or developed in collaboration with peers but without using the term co-design. This inconsistency regarding the co-design approach led to the exclusion of numerous articles during the selection process and was resolved by constant and extensive discussion among the authors of this paper. We therefore also urge clearer definitions in the literature around the use and utility of the concept of co-design.

4.2. Recommendations

Selected recommendations for future research can be derived from this systematic review. Overall, the co-design approach provides an important tool with which to increase the efficiency and effectiveness of health interventions for PEH. Since mental health among PEH is a complex and challenging issue for health and care providers and decision-makers, more efficient approaches adapted to this population’s actual needs are required.
Results of our study show that to date, co-designed mental health approaches for PEH have hardly been used for the development of such programs even though deficits have long been identified [17,50], resulting in a lack of studies in this context. As co-designed interventions for other marginalized population groups have produced positive results in improved mental health, quality of life, housing, and acute and hospital service utilization [24], this gap is glaring. Moreover, due to the heterogeneity of the included studies, it remains unclear at what point PEH should be approached with co-designed primary mental health interventions for them to be most effective. Further research in this area is urgently needed to adequately provide PEH with the mental healthcare they need and empower them to create targeted interventions sensitive to their lived experiences.

5. Conclusions

In summary, co-designed mental health interventions represent an approach with great promise for benefitting PEH. Co-designing allows individuals who currently are or have been directly affected by homelessness to participate in the development process of a health promotion or prevention program alongside stakeholders and researchers. This approach can mean a considerable increase in quality and cost-effectiveness. In the context of PEH and mental health, co-designed programs have been insufficiently researched, yet the deployment of this approach can bring about sustainable improvement in numerous spheres of PEH’s lives. Given existing gaps in research, many aspects, for instance, regarding the components that such program interventions need for them to be successful, require further exploration to understand their effectiveness in varying settings and for varying subgroups of PEH.

Author Contributions

Conceptualization, T.S.; methodology, T.S. and I.G.; software, T.S.; validation, A.G.-S., D.T.M. and I.G.; data extraction, T.S. and I.G.; investigation, T.S., A.K., A.G. and T.P.; resources, I.G.; data curation, T.S., A.K. and T.P.; writing—original draft preparation, T.S., L.L. and I.G.; writing—review and editing, T.S., A.K., A.G., T.P., L.L., A.G.-S., D.T.M. and I.G.; visualization, T.S., L.L. and I.G.; supervision, I.G.; project administration, I.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this review. Data sharing does not apply to this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Omerov, P.; Craftman, Å.G.; Mattsson, E.; Klarare, A. Homeless persons’ experiences of health- and social care: A systematic integrative review. Health Soc. Care Community 2020, 28, 1–11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Stafford, A.; Wood, L. Tackling Health Disparities for People Who Are Homeless? Start with Social Determinants. Int. J. Environ. Res. Public Health 2017, 14, 1535. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Aldridge, R.W.; Menezes, D.; Lewer, D.; Cornes, M.; Evans, H.; Blackburn, R.M.; Byng, R.; Clark, M.; Denaxas, S.; Fuller, J.; et al. Causes of death among homeless people: A population-based cross-sectional study of linked hospitalisation and mortality data in England. Wellcome Open Res. 2019, 4, 49. [Google Scholar] [CrossRef] [PubMed]
  4. Johnson, G.; Chamberlain, C. Homelessness and Substance Abuse: Which Comes First? Aust. Soc. Work. 2008, 61, 342–356. [Google Scholar] [CrossRef]
  5. Cheung, A.M.; Hwang, S.W. Risk of death among homeless women: A cohort study and review of the literature. CMAJ 2004, 170, 1243–1247. [Google Scholar] [CrossRef] [Green Version]
  6. Fazel, S.; Geddes, J.R.; Kushel, M. The health of homeless people in high-income countries: Descriptive epidemiology, health consequences, and clinical and policy recommendations. Lancet 2014, 384, 1529–1540. [Google Scholar] [CrossRef] [Green Version]
  7. Ayano, G.; Assefa, D.; Haile, K.; Chaka, A.; Solomon, H.; Hagos, P.; Yohannis, Z.; Haile, K.; Bekana, L.; Agidew, M.; et al. Mental, neurologic, and substance use (MNS) disorders among street homeless people in Ethiopia. Ann. Gen. Psychiatry 2017, 16, 40. [Google Scholar] [CrossRef] [Green Version]
  8. Gutwinski, S.; Schreiter, S.; Deutscher, K.; Fazel, S. The prevalence of mental disorders among homeless people in high-income countries: An updated systematic review and meta-regression analysis. PLoS Med. 2021, 18, e1003750. [Google Scholar] [CrossRef]
  9. Hossain, M.M.; Sultana, A.; Tasnim, S.; Fan, Q.; Ma, P.; McKyer, E.L.J.; Purohit, N. Prevalence of mental disorders among people who are homeless: An umbrella review. Int. J. Soc. Psychiatry 2020, 66, 528–541. [Google Scholar] [CrossRef]
  10. Salize, H.J.; Werner, A.; Jacke, C.O. Service provision for mentally disordered homeless people. Curr. Opin. Psychiatry 2013, 26, 355–361. [Google Scholar] [CrossRef]
  11. Bristow, K.; Edwards, S.; Funnel, E.; Fisher, L.; Gask, L.; Dowrick, C.; Chew Graham, C. Help Seeking and Access to Primary Care for People from “Hard-to-Reach” Groups with Common Mental Health Problems. Int. J. Fam. Med. 2011, 2011, 490634. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Milloy, M.-J.; Kerr, T.; Bangsberg, D.R.; Buxton, J.; Parashar, S.; Guillemi, S.; Montaner, J.; Wood, E. Homelessness as a structural barrier to effective antiretroviral therapy among HIV-seropositive illicit drug users in a Canadian setting. AIDS Patient Care STDS 2012, 26, 60–67. [Google Scholar] [CrossRef]
  13. Lasser, K.E.; Himmelstein, D.U.; Woolhandler, S. Access to care, health status, and health disparities in the United States and Canada: Results of a cross-national population-based survey. Am. J. Public Health 2006, 96, 1300–1307. [Google Scholar] [CrossRef] [PubMed]
  14. Lewis, J.H.; Andersen, R.M.; Gelberg, L. Health care for homeless women. J. Gen. Intern. Med. 2003, 18, 921–928. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Farnarier, C.; Fano, M.; Magnani, C.; Jaffré, Y. Projet TREPSAM: Trajectoire de soins des personnes sans abri à Marseille. Rapport de recherche. Available online: https://halshs.archives-ouvertes.fr/halshs-03454716/document (accessed on 16 September 2022).
  16. North, C.S.; Smith, E.M. A systematic study of mental health services utilization by homeless men and women. Soc. Psychiatry Psychiatr. Epidemiol. 1993, 28, 77–83. [Google Scholar] [CrossRef]
  17. Folsom, D.P.; Hawthorne, W.; Lindamer, L.; Gilmer, T.; Bailey, A.; Golshan, S.; Garcia, P.; Unützer, J.; Hough, R.; Jeste, D.V. Prevalence and risk factors for homelessness and utilization of mental health services among 10,340 patients with serious mental illness in a large public mental health system. Am. J. Psychiatry 2005, 162, 370–376. [Google Scholar] [CrossRef]
  18. Rothbard, A.B.; Min, S.-Y.; Kuno, E.; Wong, Y.-L.I. Long-term effectiveness of the ACCESS program in linking community mental health services to homeless persons with serious mental illness. J. Behav. Health Serv. Res. 2004, 31, 441–449. [Google Scholar] [CrossRef]
  19. McGill, B.; Corbett, L.; Grunseit, A.C.; Irving, M.; O’Hara, B.J. Co-Produce, Co-Design, Co-Create, or Co-Construct-Who Does It and How Is It Done in Chronic Disease Prevention? A Scoping Review. Healthcare 2022, 10, 647. [Google Scholar] [CrossRef]
  20. Slattery, P.; Saeri, A.K.; Bragge, P. Research co-design in health: A rapid overview of reviews. Health Res. Policy Syst. 2020, 18, 17. [Google Scholar] [CrossRef] [Green Version]
  21. Tee, S.; Üzar Özçetin, Y.S. Promoting positive perceptions and person centred care toward people with mental health problems using co-design with nursing students. Nurse Educ. Today 2016, 44, 116–120. [Google Scholar] [CrossRef]
  22. Tindall, R.M.; Ferris, M.; Townsend, M.; Boschert, G.; Moylan, S. A first-hand experience of co-design in mental health service design: Opportunities, challenges, and lessons. Int. J. Ment. Health Nurs. 2021, 30, 1693–1702. [Google Scholar] [CrossRef]
  23. O’Reilly, F.; Doyle, J.; Keenan, E. Innovative co-design of integrated services designed to improve access to health care. Int J Integr Care 2017, 17, 480. [Google Scholar] [CrossRef]
  24. O’Brien, J.; Fossey, E.; Palmer, V.J. A scoping review of the use of co-design methods with culturally and linguistically diverse communities to improve or adapt mental health services. Health Soc. Care Community 2021, 29, 1–17. [Google Scholar] [CrossRef]
  25. Donetto, S.; Pierri, P.; Tsianakas, V.; Robert, G. Experience-based Co-design and Healthcare Improvement: Realizing Participatory Design in the Public Sector. Des. J. 2015, 18, 227–248. [Google Scholar] [CrossRef] [Green Version]
  26. Mullins, R.M.; Kelly, B.E.; Chiappalone, P.S.; Lewis, V.J. ‘No-one has listened to anything I’ve got to say before’: Co-design with people who are sleeping rough. Health Expect. 2021, 24, 930–939. [Google Scholar] [CrossRef]
  27. Campagnaro, C.; Di Prima, N.; Ceraolo, S. Co-Design and the Collective Creativity Processes in Care Systems and Places. Soc. Incl. 2021, 9, 130–142. [Google Scholar] [CrossRef]
  28. Joyce, D.P.; Limbos, M. Identification of cognitive impairment and mental illness in elderly homeless men: Before and after access to primary health care. Can. Fam. Physician 2009, 55, 1110–1111.e6. [Google Scholar]
  29. Stergiopoulos, V.; Schuler, A.; Nisenbaum, R.; Deruiter, W.; Guimond, T.; Wasylenki, D.; Hoch, J.S.; Hwang, S.W.; Rouleau, K.; Dewa, C. The effectiveness of an integrated collaborative care model vs. a shifted outpatient collaborative care model on community functioning, residential stability, and health service use among homeless adults with mental illness: A quasi-experimental study. BMC Health Serv. Res. 2015, 15, 348. [Google Scholar] [CrossRef] [Green Version]
  30. Rog, D.J.; Marshall, T.; Dougherty, R.H.; George, P.; Daniels, A.S.; Ghose, S.S.; Delphin-Rittmon, M.E. Permanent supportive housing: Assessing the evidence. Psychiatr. Serv. 2014, 65, 287–294. [Google Scholar] [CrossRef]
  31. Aubry, T.; Goering, P.; Veldhuizen, S.; Adair, C.E.; Bourque, J.; Distasio, J.; Latimer, E.; Stergiopoulos, V.; Somers, J.; Streiner, D.L.; et al. A Multiple-City RCT of Housing First With Assertive Community Treatment for Homeless Canadians with Serious Mental Illness. Psychiatr. Serv. 2016, 67, 275–281. [Google Scholar] [CrossRef]
  32. Jego, M.; Abcaya, J.; Ștefan, D.-E.; Calvet-Montredon, C.; Gentile, S. Improving Health Care Management in Primary Care for Homeless People: A Literature Review. Int. J. Environ. Res. Public Health 2018, 15, 309. [Google Scholar] [CrossRef]
  33. Dickins, K.; Buchholz, S.W.; Ingram, D.; Hamilton, R.J.; Braun, L.T.; Karnik, N.S.; Earle, M. “Now that you’ve got that coverage”: Promoting use of a regular source of primary care among homeless persons. J. Am. Assoc. Nurse Pract. 2019, 33, 158–166. [Google Scholar] [CrossRef]
  34. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement. Open Med. 2009, 3, e123–e130. [Google Scholar]
  35. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
  36. FEANTSA. ETHOS: European Typology of Homelessness and Housing Exclusion. Available online: https://www.feantsa.org/download/ethos2484215748748239888.pdf (accessed on 11 August 2022).
  37. Cochrane Effective Practice and Organisation of Care. Data Collection Form. EPOC Resources for Review Authors. Available online: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/good_practice_data_extraction_form.doc (accessed on 1 July 2022).
  38. Cochrane Methods. Tool to Assess Risk of Bias in Cohort Studies. Available online: http://methods.cochrane.org/sites/methods.cochrane.org.bias/files/uploads/Tool%20to%20Assess%20Risk%20of%20Bias%20in%20Cohort%20Studies.pdf (accessed on 1 July 2022).
  39. Cochrane Training. Chapter 8: Assessing risk of bias in a randomized trial. Available online: https://training.cochrane.org/handbook/current/chapter-08 (accessed on 1 July 2022).
  40. Corrigan, P.W.; Kraus, D.J.; Pickett, S.A.; Schmidt, A.; Stellon, E.; Hantke, E.; Lara, J.L. Using Peer Navigators to Address the Integrated Health Care Needs of Homeless African Americans With Serious Mental Illness. Psychiatr. Serv. 2017, 68, 264–270. [Google Scholar] [CrossRef] [Green Version]
  41. Gilmer, T.P.; Stefancic, A.; Ettner, S.L.; Manning, W.G.; Tsemberis, S. Effect of full-service partnerships on homelessness, use and costs of mental health services, and quality of life among adults with serious mental illness. Arch. Gen. Psychiatry 2010, 67, 645–652. [Google Scholar] [CrossRef] [Green Version]
  42. Stergiopoulos, V.; Gozdzik, A.; Nisenbaum, R.; Durbin, J.; Hwang, S.W.; O’Campo, P.; Tepper, J.; Wasylenki, D. Bridging Hospital and Community Care for Homeless Adults with Mental Health Needs: Outcomes of a Brief Interdisciplinary Intervention. Can. J. Psychiatry 2018, 63, 774–784. [Google Scholar] [CrossRef] [Green Version]
  43. Larkin, M.; Boden, Z.V.R.; Newton, E. On the Brink of Genuinely Collaborative Care: Experience-Based Co-Design in Mental Health. Qual. Health Res. 2015, 25, 1463–1476. [Google Scholar] [CrossRef]
  44. Yoo, D.; Huldtgren, A.; Woelfer, J.P.; Hendry, D.G.; Friedman, B. A value sensitive action-reflection model. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’13: CHI Conference on Human Factors in Computing Systems, Paris, France, 27 April–2 May 2013; Mackay, W.E., Brewster, S., Bødker, S., Eds.; ACM: New York, NY, USA, 2013; pp. 419–428, ISBN 9781450318990. [Google Scholar]
  45. Cumming, J.; Clarke, F.J.; Holland, M.J.G.; Parry, B.J.; Quinton, M.L.; Cooley, S.J. A Feasibility Study of the My Strengths Training for Life™ (MST4Life™) Program for Young People Experiencing Homelessness. Int. J. Environ. Res. Public Health 2022, 19, 3320. [Google Scholar] [CrossRef]
  46. Palma, P.D.; Nordenram, G. The perceptions of homeless people in Stockholm concerning oral health and consequences of dental treatment: A qualitative study. Spec. Care Dentist. 2005, 25, 289–295. [Google Scholar] [CrossRef]
  47. Rae, B.E.; Rees, S. The perceptions of homeless people regarding their healthcare needs and experiences of receiving health care. J. Adv. Nurs. 2015, 71, 2096–2107. [Google Scholar] [CrossRef]
  48. Lippert, A.M.; Lee, B.A. Stress, Coping, and Mental Health Differences among Homeless People. Sociol. Inq. 2015, 85, 343–374. [Google Scholar] [CrossRef]
  49. Gelberg, L.; Andersen, R.M.; Leake, B.D. The Behavioral Model for Vulnerable Populations: Application to medical care use and outcomes for homeless people. Health Serv. Res. 2000, 34, 1273–1302. [Google Scholar] [PubMed]
  50. Benston, E.A. Housing Programs for Homeless Individuals with Mental Illness: Effects on Housing and Mental Health Outcomes. Psychiatr. Serv. 2015, 66, 806–816. [Google Scholar] [CrossRef] [PubMed]
  51. Feldman, B.J.; Craen, A.M.; Enyart, J.; Batchelor, T.; Friel, T.J.; Dusza, S.W.; Greenberg, M.R. Prevalence of Homelessness by Gender in an Emergency Department Population in Pennsylvania. J. Am. Osteopath. Assoc. 2018, 118, 85–91. [Google Scholar] [CrossRef] [Green Version]
  52. Pleace, N. Exclusion by Definition: The Under-representation of Women in European Homelessness Statistics. In Women’s Homelessness in Europe; Mayock, P., Bretherton, J., Eds.; Palgrave Macmillan UK: London, UK, 2016; pp. 105–126. ISBN 978-1-137-54515-2. [Google Scholar]
  53. Smith, C.; Castañeda, E. Sick Enough? Mental Illness and Service Eligibility for Homeless Individuals at the Border. Soc. Sci. 2020, 9, 145. [Google Scholar] [CrossRef]
Ijerph 20 00892 g001 550
Figure 1. Flow chart of literature search.
Figure 1. Flow chart of literature search.
Ijerph 20 00892 g001
Table
Table 1. Methodological information of included studies.
Table 1. Methodological information of included studies.
AuthorsSample SizeStudy DesignDuration of
Participation		ParticipantsETHOS CategorySex
Distribution		Types of InterventionTypes of Outcome MeasuresResults
Corrigan et al. [40]67RCT12 monthsAfrican Americans with serious mental illness who were homeless1.1Male: 41 (61%); Female: 26 (39%)A one-year trial of PNP compared with TAUPhysical illness; psychiatric disorder; recovery; quality of lifeSignificant improvement in self-reported physical and mental health, recovery, and quality of life for those in the PNP program compared with treatment as usual, while both groups improved their domicile and insurance coverage.
Gilmer et al. [41]363Quasi-experimental24 monthsAdult PEH with severe mental illness who were FSP clients and clients receiving public mental health services1.1; 2.1Male: 228 (63%); Female: 135 (37%)Housing First programs that do “whatever it takes” to improve residential stability and mental health outcomesRecovery outcomes; mental health service use; mental health services and housing costs from the perspective of the public mental health system; quality of lifeParticipation in an FSP was associated with substantial increases in outpatient services and days spent in housing. Reductions in costs of inpatient/emergency and justice system services offset 82% of the cost of the FSP.
Stergiopoulos et al. [29]142Quasi-experimental12 monthsMen experiencing homelessness and mental illness1.1; 2.1; 8.1Male: 142 (100%)Shelter-based collaborative mental healthcare models IMCC and SOCCCommunity functioning; residential stability; health service useParticipants experienced significant improvements in community functioning, housing, hospitalizations, emergency department visits, and community-based physician visits in both shelter-based collaborative mental healthcare programs over time. Due to the lack of observable differences, the less resource-intensive SOCC appears more favorable than the IMCC.
Stergiopoulos et al. [42]223Cohort study6 monthsAdult PEH with mental health needs1.1; 2.1; 8.1Male: 173 (78%); Female: 50 (22%)CATCH program, a 4- to 6-month interdisciplinary intervention offering case management, peer support, access to primary psychiatric care, and supplementary community servicesChange in participant health status; mental health symptoms; disease-specific quality of life; substance use; acute service use; housing; working-alliance constructCATCH participants showed significant mental and physical health gain and reductions in mental health symptoms, substance use, and hospital admissions. An association was found between the strength of the participant-case manager working alliance and reduced healthcare use and mental health symptoms.
CATCH: coordinated access to care for the homeless; FSP: full-service partnerships; IMCC: integrated multidisciplinary collaborative care model; PEH: people experiencing homelessness; PNP: peer navigator program; SOCC: shifted outpatient collaborative care model; TAU: treatment as usual.
Table
Table 2. Quality appraisal of included studies.
Table 2. Quality appraisal of included studies.
AuthorsQuality Appraisal ToolDomainRisk of Bias
Corrigan et al. [40]Risk of Bias assessment [37]Random sequence generationUnclear
Allocation concealmentUnclear
Blinding of participants and personnelHigh risk
Blinding of outcome assessmentUnclear
Incomplete outcome dataLow risk
Selective outcome reportingLow risk
Gilmer et al. [41]Risk of Bias assessment [37]Random sequence generationHigh risk
Allocation concealmentHigh risk
Blinding of participants and personnelHigh risk
Blinding of outcome assessmentUnclear
Incomplete outcome dataLow risk
Selective outcome reportingLow risk
Stergiopoulos et al. [29]Risk of Bias assessment [37]Random sequence generationHigh risk
Allocation concealmentHigh risk
Blinding of participants and personnelHigh risk
Blinding of outcome assessmentUnclear
Incomplete outcome dataLow risk
Selective outcome reportingLow risk
Stergiopoulos et al. [42]Tool to Assess Risk of Bias in Cohort Studies [38]Selection of exposed and non-exposed cohorts was drawn from the same populationLow risk
Confidence in the assessment of exposureLow risk
Confidence that the outcome of interest was not present at start of studyLow risk
Matching of exposed and unexposed for all variables that are associated with the outcome of interest or adjustment of statistical analysis for these prognostic variablesLow risk
Confidence in the assessment of the presence or absence of prognostic factorsLow risk
Confidence in the assessment of outcomeHigh risk
Adequacy of follow-up of cohortsHigh risk
Similarity of co-interventions between groupsHigh risk
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Schiffler, T.; Kapan, A.; Gansterer, A.; Pass, T.; Lehner, L.; Gil-Salmeron, A.; McDermott, D.T.; Grabovac, I. Characteristics and Effectiveness of Co-Designed Mental Health Interventions in Primary Care for People Experiencing Homelessness: A Systematic Review. Int. J. Environ. Res. Public Health 2023, 20, 892. https://doi.org/10.3390/ijerph20010892

AMA Style

Schiffler T, Kapan A, Gansterer A, Pass T, Lehner L, Gil-Salmeron A, McDermott DT, Grabovac I. Characteristics and Effectiveness of Co-Designed Mental Health Interventions in Primary Care for People Experiencing Homelessness: A Systematic Review. International Journal of Environmental Research and Public Health. 2023; 20(1):892. https://doi.org/10.3390/ijerph20010892

Chicago/Turabian Style

Schiffler, Tobias, Ali Kapan, Alina Gansterer, Thomas Pass, Lisa Lehner, Alejandro Gil-Salmeron, Daragh T. McDermott, and Igor Grabovac. 2023. "Characteristics and Effectiveness of Co-Designed Mental Health Interventions in Primary Care for People Experiencing Homelessness: A Systematic Review" International Journal of Environmental Research and Public Health 20, no. 1: 892. https://doi.org/10.3390/ijerph20010892

APA Style

Schiffler, T., Kapan, A., Gansterer, A., Pass, T., Lehner, L., Gil-Salmeron, A., McDermott, D. T., & Grabovac, I. (2023). Characteristics and Effectiveness of Co-Designed Mental Health Interventions in Primary Care for People Experiencing Homelessness: A Systematic Review. International Journal of Environmental Research and Public Health, 20(1), 892. https://doi.org/10.3390/ijerph20010892

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop