Next Article in Journal
Pharmacists’ Role in Older Adults’ Medication Regimen Complexity: A Systematic Review
Previous Article in Journal
Occupational Injuries among Latino/a Immigrant Cattle Feedyard Workers in the Central States Region of the United States
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Pre-Intervention Effects of a Community-Based Intervention Targeting Alcohol Use (LEF); The Role of Participatory Research and Publicity

by
Ina M. Koning
1,*,
Vincent G. Van der Rijst
1,
John B. F. De Wit
2 and
Charlotte De Kock
3
1
Youth Studies, Interdisciplinary Social Science, Utrecht University, P.O. Box 80140, 3508 TC Utrecht, The Netherlands
2
Social Policy and Public Health, Interdisciplinary Social Science, Utrecht University, P.O. Box 80140, 3508 TC Utrecht, The Netherlands
3
Institute for Social Drug Research, Faculty of Law and Criminology, Ghent University, B-9000 Ghent, Belgium
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(16), 8823; https://doi.org/10.3390/ijerph18168823
Submission received: 13 July 2021 / Revised: 19 August 2021 / Accepted: 20 August 2021 / Published: 21 August 2021

Abstract

:
This study explores the impact of the ‘pre-intervention effects’ of a community-based intervention. This refers to participatory research processes and parallel publicity in the media on changes in alcohol use and relevant mechanisms (rules and norms about alcohol, accessibility of alcohol in a formal setting) among adolescents before any intervention is implemented. The aim was to investigate the contribution of these processes (i.e., pre-intervention effects) to changes in intervention-targeted factors before any actual intervention was implemented. In a quasi-experimental study, data were collected twice by means of self-report among adolescents living in two municipalities (control and experimental condition). A regression analysis showed negative pre-intervention main effects on adolescents’ perceived accessibility of alcohol in a formal setting. Moreover, among adolescents aged 15 years and older, the normative decline in strictness of rules and norms was less steep in the experimental condition compared to the control condition. Additionally, adolescents aged 14 years and younger in the experimental condition reported more weekly drinking compared to their peers in the control condition. No differential effects across gender were found. To conclude, applying a co-creational approach in the development of an intervention not only contributes to more effective interventions in the end, but the involvement of and discussions in the community when planning the intervention contribute to changes in targeted factors. This implies that public discussions about the development of intervention strategies should be considered as an essential feature of co-creation in community-based interventions.

1. Introduction

Most people have their first experience with alcohol during adolescence. Several studies have shown that in recent years, the number of underage adolescents that drink alcohol has declined on a global scale [1,2], including in The Netherlands [3,4]. For example, among Dutch 12 year olds, the prevalence of lifetime and monthly drinking decreased from 71.1 and 30.9 percent in 2003 to 20.2 and 3.7 percent in 2017, respectively [4]. This decline is most likely the result of increased awareness of the harmful effect of alcohol on adolescent development, as well as the imperative role of parents as targets in prevention efforts [5]. Although alcohol use among adolescents has declined, the mean age for the onset of drinking is still relatively young: adolescents in The Netherlands are on average 13.3 years old when they start drinking alcohol [3]. Moreover, once they start, adolescents drink at high levels: of those who have drunk alcohol in the past month, 71% have been involved in binge drinking (drinking at least five glasses of alcohol during an occasion) [3,4]. Early-onset alcohol use is an important risk factor for many negative consequences, like the development of other substance (ab) use [6], co-morbid mental health problems [7], more aggressive behavior [8], a lower school engagement, and poorer educational outcomes later in life [9]; therefore, prevention of early alcohol use in adolescents is crucial.
The development and implementation of interventions on alcohol use in adolescents are complex, as risk factors are multi-faceted, involving a combination of individual, social and environmental factors [10], with drinking behaviors influenced by factors from different levels, i.e., individual factors, parental and peer influence, and alcohol policies [11]. Moreover, the use of alcohol is often considered a social activity, done together with peers [12,13]. Consequently, several studies showed that interventions are more effective in reducing adolescents’ alcohol initiation and use when they are not only targeting the adolescents themselves [14], but also their parents [15,16], and their entire family [17], or school [18]. Thus, considering that factors at multiple levels are relevant, multi-component interventions are more effective than single-component interventions and can therefore better contribute to reducing adolescents’ alcohol use.
Community-based interventions are designed to address the complex interplay between individual behaviors and broader societal influences by involving the community itself and may be an effective way of reducing alcohol use and related harms. Traditional interventions that mainly focus on components at a community level (i.e., community-level interventions) include interventions such as warning and informing about the negative consequences of alcohol use. However, community-based interventions also aim to involve (part of) the community. They can subsequently influence perceptions about social norms and can add three different types of intervention strategies: regulatory (e.g., strengthening alcohol policy enforcement), physical (e.g., reducing the visibility of alcohol in public), and economic (e.g., making alcoholic beverages more expensive) strategies [19]. Thus, the aim of community-based interventions is not to intervene on an individual level alone but to bring stakeholders like policymakers, educators, and regulators, together to influence this broader environment in which drinking frequently occurs [20].
Ensuring the appropriateness of community-based interventions to the local context requires the participation of local community actors (e.g., councilors, educators, parents, youth) who have intimate knowledge of the local context. Rationales for community participation in intervention development can be roughly split into two potentially complementary models: the utilitarian model and the empowerment model [21]. A utilitarian model of community participation posits that involvement of the community is essential because it will improve the effectiveness and sustainability of the resulting intervention due to it being better in line with the local context and having greater buy-in from local actors who were involved in the development. An empowerment model argues that community participation is an end in itself as it will directly contribute to community empowerment [22,23], which aligns with the vision of health promotion as set out in the Ottawa Charter (World Health Organization; [24]).
Reviews of community-based interventions using participatory and engaged research have identified various program-related outcomes, such as an impact on communities’ health and social outcomes, community-wide behavioral and environmental changes, community empowerment, and reductions in social inequalities [25,26]. For example, once engaged, youth involved in interventions show a decrease in substance use [27]. These outcomes provide evidence to support a utilitarian model of community participation to improve health and social outcomes. These are promising outcomes, but uncoupling the outcomes from the intervention remains a challenge, and so does contributing the participatory research processes and its public discussions to the outcomes. This is largely due to evaluating interventions only at the end of an intervention. Moreover, the evaluation often reduces the definition of the intervention of the program that was delivered to the research participants rather than encompassing the whole process from co-creation to evaluation. In order to evaluate the co-creation process, a baseline assessment should be conducted at the start of this process, followed by another assessment before the actual interventions are implemented, most ideally in an experimental trial. A recent realist review by Jagosh et al. [28] unpacked an array of outcomes that could be directly attributed to the participatory research processes, including capacity building, culturally appropriate research and subsequent adaptation, productive conflict resolution, and systems change. Whilst this review provides a good starting point to unpack the benefits of participatory research more broadly, it leaves the question of how participatory research processes directly improves health and social outcomes unanswered.
A community-based intervention, referred to as LEF (Dutch translation of ‘courage’), applied a co-creational approach to the development of the intervention strategies. This period of development of intervention strategies took about six months and received much attention in the media, e.g., via interviews in (online) local newspapers and discussion in open civic meetings. The studied outcomes (early drinking) as well as the factors contributing to it—particularly the accessibility of alcohol—were a topic of discussion in the media, as well as among members of the community. Due to the fact that the Principal Investigator (first author) of this study is part of the community, she was often (in)directly called upon by inhabitants about these topics of discussion. This led to the question of if the increased discussions and attention towards the drinking behaviors among youth in the development of the intervention may have affected both the outcomes themselves and the mechanisms, without any actual intervention strategy already implemented. We refer to these effects as the ‘pre-intervention’ effects, i.e., the effects of the development of an intervention while using co-creation, on relevant outcomes before intervention strategies are implemented. It is likely that this pre-intervention phase already has an impact on the targeted mechanisms and outcomes of interest.
This study aims to address this gap by focusing on the process of participatory development of a community-based intervention aiming to reduce alcohol use amongst adolescents. The “intervention” for the context of the current study is the participatory research that was undertaken during the development of the community-based intervention LEF. It explores whether “pre-intervention effects” exist, referring to changes in alcohol use and relevant mechanisms amongst adolescents following the participatory research processes and parallel publicity in the media to develop the intervention before the intervention is implemented. These ‘pre-intervention’ effects were examined across gender and age groups as it is known that boys and older adolescents are more likely to drink alcohol [4] and may therefore be less affected. This study will give insight into a potentially relevant phase in intervention research which may form the basis for enabling any change and therefore may impact the level of change in outcomes. The main aim of this study is to test to what extent these pre-intervention effects exist and contribute to change in targeted outcomes.

2. Methods

2.1. Procedure

The LEF program is a community-based intervention in the municipality of Edam-Volendam in The Netherlands that aims to delay the onset of alcohol use and reduce weekly drinking among youth. A quasi-experimental design is used including, two municipalities: one experimental municipality and one control municipality. In February 2018, both public secondary schools within the municipality were willing to participate in the experimental condition, while another public secondary school within the fairly similar municipality of Enkhuizen participated in the control condition. In the experimental municipality as well as the control municipality, there are two schools that could participate. However, one of two schools in the experimental condition did not fully participate as students were not allowed to fill out the questionnaire during regular school hours. Consequently, only one school was selected in the control condition, based on the best match with the school that fully participated in the experimental condition. The risk of spill-over effects is highly unlikely as the control school is situated more than 43 km away. Though the experimental municipality is twice the size of the control municipality (36,000 vs. 18,500 inhabitants respectively), in many other ways, the municipalities are comparable in terms of percentage of 12–18 year old youths (9% vs. 8%), 18+ alcohol users (29% vs. 32%) and 18+ excessive alcohol users (7% in both municipalities).
Data were collected by trained research assistants in classrooms using online questionnaires available on a secured website. Parents received a letter of consent, which informed them about the participation of the school in the program, and they were given the opportunity to refuse participation of their child (1.13% refusal). Data were gathered in May/June 2018 (TN), and again six months later in November/December 2018 (T0) before any actual intervention was implemented. At TN, the aim was to conduct a needs assessment in which an explanatory model was designed (see Figure 1), while T0 functioned as the formal baseline assessment. The study was approved by the Ethics Review Board of the Faculty of Behavioral & Social Sciences at Utrecht University (FETC18-060).

2.2. Intervention: Participatory Development of a Community-Based Intervention

The LEF program is a community-based intervention developed, implemented, and evaluated in a municipality in The Netherlands. The developmental phase of LEF consisted of three steps (see Figure 2).
First, a needs assessment was conducted, including semi-structured interviews with all relevant stakeholders (e.g., local politicians, parents, adolescents, youth, heads of school). In addition to these interviews, self-report questionnaires among the youth were conducted. By collecting local data, the LEF intervention components could be directly matched to the local target group and context to increase the likelihood of effectively changing the desired outcomes [29,30]. Focusing on youth/parent engagement in this phase can also overcome potential obstacles perceived by youth to participate and thereby increase the relevance of and the participation of youth/parents when implementing the intervention [31]. Based on the results of both data sources, the outcomes of the intervention were defined by the researcher and the municipality; delay the onset of drinking among underage adolescents.
Second, this data, alongside (inter)national knowledge about important determinants of the onset of drinking, were used to identify factors that were relevant for early drinking in this specific community [32]. This resulted in an explanatory model (Figure 1) including important and changeable factors within three domains, i.e., (a) parents (e.g., rules about alcohol), (b) youth (e.g., norms about alcohol), and (c) repression (e.g., lower accessibility of alcohol).
Third, by mobilizing a local ‘task force’ (a group that was differently composed every meeting), input from members of the community was gathered (e.g., through discussion meetings per domain) to translate these relevant factors into intervention strategies [19]. In addition to inviting specific stakeholders directly to join the task force, participation in this task force was open to anyone interested. This co-creation approach, together with existing local intervention strategies, theories of behavior change, and other scientific knowledge, was used to develop the first intervention strategies targeting factors in the explanatory model.
Following the needs assessment, the social norms about drinking among adolescents, rule-setting by parents, and accessibility of alcohol, emerged as the most important and changeable mechanisms that can influence the onset of alcohol use of adolescents.

2.3. Sample

All secondary schools and all classes except for the exam classes (classes at the end of their study) participated in the study. A total of 2893 students were asked to participate in the study. Of these, 524 students did not participate due to their parents’ refusal or their absence from school on the day of data collection (individual or whole class due to scheduling problems). In addition, students of the second school were only allowed to fill out the questionnaire outside school hours in their own time; 63 students out of 286 participated. This resulted in a sample eligible for analysis of N = 2146.
Socio-demographic characteristics and variables of interest for each condition and the total sample are presented in Table 1. The total sample had a mean age of 14.67 (SD = 1.33), consisting of 48.1% boys. At baseline, the experimental condition differs significantly from the control condition in terms of more positive norms, less strict rules about alcohol, easier access to alcohol, and more weekly drinking (Table 1). At T0, adolescents in the experimental condition reported significantly easier access to alcohol and more weekly drinking than adolescents in the control condition.

2.4. Loss to Follow-Up

Participants who did not participate in the follow-up (n = 311; 14%) differed from completers in terms of perceived accessibility of alcohol outside home (t = 2.28, p = 0.023), age (t = 3.58, p < 0.00) and level of education (t = 4.20, p < 0.00). That is, adolescents who did not participate in the follow-up reported higher accessibility of alcohol outside the home, were on average somewhat younger, and were more likely to be in a lower level of education.

2.5. Measures

The main outcomes measured were related to the mechanisms of and final envisaged outcome of the LEF program, i.e., norms about youth drinking, rules about alcohol, perceived accessibility of alcohol (home and café), and weekly drinking.
Norms about youth drinking reflect the acceptability of adolescents consuming alcohol in various situations (for example at home, and at a party with friends). Participants were asked to what degree they thought it is acceptable for a person of the same age to drink alcohol in various situations (1 = ‘not acceptable at all’, to 5 = ‘very acceptable’). The instrument is based on a Dutch translation of the ‘Alcohol Use Norms Scale’ [33], which was used in earlier research in the Netherlands [34]. Originally it contained seven items; in this study, we used five items. A mean score was calculated, where a higher score indicated more positive norms about youth drinking. Cronbach’s alpha was 0.92 at both waves.
Rules about alcohol reflect the degree of parental rule-setting regarding alcohol use as experienced by the adolescent [35]. Participants were asked to what extent their parents approve they (would) drink alcohol in various situations (for example, at home with parents present and at a party with friends). Originally it contained ten items; in this study, we used five items, which were scored on a 5-point scale (1 = ‘never’ to 5 = ‘always’). All items were recorded, and a mean score was calculated, where a higher score indicated stricter parental rules about alcohol use. Cronbach’s alphas were 0.94 (TN) and 0.92 (T0).
Perceived accessibility of alcohol reflects the degree of the perceived ease of obtaining alcohol in various situations. Participants were asked how easy they (think they would) get alcohol in various situations on a 5-point scale (1 = ‘very easy’ to 5 = ‘impossible’). Perceived accessibility is divided in formal (at a pub/café) and informal (mean score of three situations: at home from their parents, at a friend’s home, and at the home of relatives; Chronbach’s alphas were 0.78 (TN) and 0.75 (T0)) accessibility of alcohol.
Weekly drinking was measured by using the quantity-frequency measure [36,37]. Frequency was measured by asking the number of days the adolescents usually drink on a weekly basis, while quantity was measured by asking how many glasses of alcohol the adolescents usually drink on a typical day they drink alcohol (9-point Likert scale; 0–6 = I do not drink alcohol to 6 glasses per day, 8 = 7–10 glasses and 9 = 11 glasses or more). The quantity-frequency was computed by calculating the products of the number of days and the number of glasses, where higher scores indicated more weekly drinking.
Age was measured by asking the age of the participant in years. The legal age for buying alcoholic drinks in The Netherlands was set to 18 relatively recently (January 2014.) In the experimental municipality, this change in legal age is enforced to a limited extent. Age 15, one year for the former legal drinking age, is considered by many parents as an appropriate age for their children to start experimenting with alcohol. This is exemplified by the steep increase in the prevalence of drinkers from age 14 onwards [32]. Therefore, age was dichotomized into two categories (0 = 14 years or younger and 1 = 15 years and older).

2.6. Data Analysis

Missing data were estimated in Mplus using the Full Information Maximum Likelihood Estimation with Robust Standard Errors default setting (MLR), allowing information of all the 2164 participants to be used for analysis [38]. Descriptive statistics and correlations were retrieved for the total group, for the experimental condition and control condition separately, and for each measurement occasion. T-tests were conducted to assess differences in all variables of interest between the control and experimental condition at baseline and follow-up. We used a Multiple Regression analysis to test the impact of the pre-intervention process as applied in LEF on the mechanisms and outcomes at T0, i.e., norms about youth drinking, rules about alcohol, accessibility of alcohol (informal and formal), and weekly drinking. The direct effects were examined for the dichotomous intervention variable (0 = control, 1= experimental) at baseline on the dependent variables at the follow-up while controlling for the outcomes variable at baseline, as well as age and gender. Since weekly drinking has a high variance relative to the mean, which indicates overdispersion, a zero-inflated negative binomial model was used [39]. The MLR estimator is robust to the non-normality of the variables norms about youth drinking and rules about alcohol and is, therefore, used in the analysis. In line with Nieminen, Lehtiniemi, Vähäkangas, Huusko, and Rautio [40], we used the standardized βs as effect size indices, whereby β < 0.2 was considered small, 0.2 < β < 0.5 moderate, and β > 0.5 a strong effect. To test moderation by age and gender, the interaction terms between the intervention condition × age (centered) and intervention condition × gender were added to the model separately.

3. Results

3.1. Main Effects

The multiple regression analysis of the experimental condition at TN on the mechanisms at T0 (norms about youth drinking, rules about alcohol, informal and formal accessibility of alcohol) and outcomes (weekly drinking) while controlling for the outcomes at TN show two significant effects (see Table 2). That is, adolescents in the experimental condition are significantly more likely to report a lower ease of access to alcohol in formal settings compared to adolescents in the control condition (β = −0.05, p = 0.04). Moreover, adolescents in the experimental condition are more likely to have a higher average weekly drinking level than adolescents in the control condition (β = 0.28, p < 0.00). No other significant main effects of the intervention condition on mechanisms were found.

3.2. Moderation Effects

The interaction between condition and gender revealed no significant interaction effects. This means that the effect of the LEF pre-intervention on the mechanisms and outcomes do not significantly differ across gender. All but one (formal accessibility on condition*age) interaction of condition with age showed a significant effect on the mechanisms and outcomes. That is, 15+ aged adolescents in the experimental condition are more likely to report less positive norms about youth’ drinking (β = −0.21, p < 0.00) and stricter rules about alcohol (β = 0.16, p < 0.00; Figure 3) compared to 15+ aged adolescents in the control condition. In addition, for older adolescents in the experimental condition, a lower ease of access to alcohol in the home situation was reported compared to adolescents in the control condition (β = 0.16, p < 0.001). Last, the positive main effect of condition on weekly drinking only applies to adolescents aged 14 and younger (β = −0.91, p < 0.00).

4. Discussion

The current study demonstrated that applying a co-creational process and its subsequent discussions in the community (media) in the development of a complex community-based intervention yielded effects on outcomes and mechanisms. That is, the main effects of pre-intervention were found on adolescents’ perceived accessibility of alcohol in a formal setting. Moreover, among adolescents aged 15 years and older, the normative decline in strictness of rules and norms was less steep in the experimental condition compared to the control condition. Moreover, adolescents aged 14 years and younger in the experimental condition reported more weekly drinking compared to their peers in the control condition.
Although it is recognized that adolescence is typically known for its increase in involvement in risk behaviors, such as the use of alcohol [2,3], alongside the development of more positive norms and norms towards these behaviors when it becomes more salient [41], the current study demonstrated that this normative increase in alcohol use and its norms could be altered by applying a co-creation process where the public is involved in the development of an intervention and made visible through publicity in local media. A search in the online repository of a regional newspaper (Noordhollandsdagblad.nl) on the keywords ‘alcohol and (name municipality)’ shows that in the municipality of Edam-Volendam, three times as many newspaper articles were published in the year of the program (14 December 2017–13 December 2018), compared to 1.5 times as many in the control municipality Enkhuizen. This increased media attention was an unintended consequence, emerging from the three steps in intervention development. Most likely, the increased attention in the media and public discussions about alcohol use among youth may have contributed to these changes in norms and alcohol use. As suggested by social norms theories, e.g., [42,43], (perceived) norms are likely to affect behavior. Particularly within this particular community, drinking alcohol among youth is considered the norm, which makes it hard for adolescents to deviate from this norm by not drinking alcohol [44]. In their review on the role of social norms in anti-smoking campaigns, ref. [45] argue that exposure to mass media messages “can directly encourage individuals to question existing norms and adopt new ones and can indirectly reduce social acceptability of smoking through public discussion” (p. 180). In this line, the increased attention in the media and public discussion about the drinking behavior of youth within the community, as was observed in LEF, could have caused 15+ adolescents to evaluate and adjust their norms about alcohol use. When adolescents are convinced that not all of their peers drink alcohol and drinking alcohol at their age is not socially accepted, this may have changed their norms about alcohol. The same principle may also have applied to parents. Social comparison theory [46] states that people evaluate themselves by comparing themselves with others, which implies that parents assess to what extent their parenting is adequate based on what other parents say and do [46]. If parents believe that other parents hold more permissive norms towards alcohol use of their children, they can experience pressure to conform to this perceived norm, and therefore become more lenient in their own parenting [47,48], for example, by setting less strict rules about alcohol. The increased attention in the media and public discussion may have led to more interpersonal communication among parents about their parenting behaviors [49], and through these conservations, they got the opportunity to get more accurate perceptions about the norms regarding these behaviors [50]. When parents, through these conservations, learned that other parents, in fact, are less tolerant about their children’s alcohol use than they thought, they can be strengthened in their own opinions and therefore can be empowered to set stricter rules themselves.
This might also have applied to other parental behaviors like the perceived reduction in the accessibility of alcohol at home. The home can be an important source of alcohol for youth [51], and multiple studies have shown that access to alcohol in the home and obtaining alcohol from parents can be linked to increased alcohol use, heavy episodic drinking, and a higher risk of alcohol-related harm (for a review, see [52]). Although these negative effects are well known, parents still “give their children alcohol to teach them how to drink responsibly and to prevent risky drinking with peers” ([53], p. 2). The increased attention in the media, public discussion, and interpersonal communication with other parents might have caused parents to question and adjust such views, resulting in reducing the accessibility of alcohol for their children in the informal context, i.e., at home.
Not only the accessibility of alcohol at home but also the commercial (formal) accessibility of alcohol is a strong predictor of alcohol use [54]. Despite that, it is well known that a strict alcohol policy can help reduce the youth’ access to alcohol [55]; however, compliance with these alcohol policies in The Netherlands is still low. A study by Van Hoof and Gosselt [56] showed that 100% percent of underaged mystery shoppers succeed in buying alcohol at commercial places. Furthermore, twenty percent of 16 year olds who drink alcohol declared they bought and consumed alcohol within hospitality services (e.g., pub or nightclub) at least once a month [3], which indicates that in The Netherlands, alcohol is easily accessible for underage youth. The compliance to an alcohol policy reflects broader societal drinking norms: communities with more conservative drinking norms may be more likely to enact and enforce comprehensive policies [55]. When it is socially accepted that underage youth drink alcohol, there will be less rigorous enforcement on underage drinking. However, the increased attention and public discussion may have altered this norm and thereby made it easier to enforce the alcohol policy more rigorously. In addition, by increasing awareness and visibility of enforcement activities, youth might be deterred from buying and consuming alcohol in public places [55]. All in all, in the developmental phase of an intervention, where co-creation is applied and public discussions take place, the co-creation process can be considered as a pre-intervention that may alter some mechanisms of change before specific intervention strategies are being implemented.
Interestingly, the impact of the pre-intervention effects differs for younger and older adolescents. That is, the less steep decline in strictness of rules and norms was mostly changed among 15+ year-old adolescents in the intervention condition, an age group most likely to be involved in drinking already [2]. Higher involvement in drinking behavior may make the discussion about this topic more applicable to this group which is, therefore, most likely to contribute to a change in norms and rules about alcohol. The lower applicability of the ongoing discussion about alcohol use among younger adolescents may also explain the impact of the experimental condition on more drinking among younger adolescents; their norms and rules were not changed by the intervention. Moreover, in the process of co-creation, most media attention and discussions among community members were given to the restrictive component of the intervention (accessibility of alcohol). As the restriction of accessibility to alcohol in the formal setting mostly applies to older adolescents (15 years and older), this may have contributed to the higher levels of drinking among particularly the younger group. Furthermore, it is also likely that because the younger group did not feel engaged by discussions around alcohol use and availability, they might have even started to oppose it, as a rebellion against changing norms and their parents is developmentally normative [57]. Additional follow-up studies may provide more insight into how drinking behavior further develops in this group. The finding that the most favorable effects are found among 15+ adolescents underlines the importance of the applicability of messages for the target group.
Participatory research in community-based interventions is a complex process undertaken in a complex system. This study highlighted the concept of emergence within complex interventions, which means that components of the interventions will work together to create new and unexpected outcomes. That is, in the participatory development of LEF, the media attention that was generated following the start of the research was an unexpected outcome that led to a change in the context within which the resulting LEF intervention will be implemented. This media attention contributed to an increase in conversations about alcohol use in the community and likely contributed to a change in norms among the adolescents surveyed. This study, therefore, highlights that intervening in a complex system (i.e., community level interventions) might lead to unintended consequences and different outcomes than expected. This emphasizes the need for evaluation approaches that are timely and appropriate to capture these kinds of outcomes [58,59].

Strengths and Limitations

To our knowledge, this study is the first that revealed the importance of co-creation and publicity (i.e., pre-intervention effects) in community-based interventions to change in outcomes and mechanisms. Though the study has several strengths, such as the quasi-experimental design with longitudinal data, the sample size, and innovativeness of the topic, several limitations should be discussed.
First, though it is highly likely that publicity in the co-creational process contributed to the changes in outcomes, this cannot be concluded for certain. It is possible that including community members in the development of interventions may also influence targeted factors even without public discussions. Future research should disentangle these aspects in the planning process of interventions.
Second, the extent to which the results of this study can be generalized to other contexts (municipalities or countries) is limited [60], and even more so since the municipality of Edam-Volendam is a relatively close community, in which public discussions may be more important to foster change. The context wherein the intervention takes place should be taken into account [61]. However, specifically in a municipality like Edam-Volendam where conservative norms about youth drinking are adhered to, the need for community involvement can be made more visible in such communities.
Third, although loss to follow-up was mostly random due to absence on the day of the study or other activities outside school, it is important to consider differential participation in the interpretation of the current findings.
Fourth, we assumed that the control municipality is similar to the experimental municipality. However, studies investigating community-based interventions use the community as the unity of intervention which increases the likelihood of having a comparison group that is less alike than assumed [60]. Studies including multiple municipalities in each condition and matching municipalities across conditions may be relevant to increase the likelihood of comparing similar groups of municipalities.

5. Conclusions

This study offers preliminary evidence that relevant changes in outcomes and mechanisms can already be achieved by discussing the issue at hand and ways to deal with this with those involved. Previous research has demonstrated that involving the community in the entire process of intervention (from development to implementation and evaluation) more likely results in interventions matching the needs of the population within the community and thereby achieve more effectiveness [25,26,27]. In the current study, we showed that applying a co-creational approach in the development of an intervention not only contributes to more effective interventions in the end but that discussions in the community when planning the intervention contribute to changes in targeted factors at the pre-intervention stage. This implies that public discussions about the development of intervention strategies should be considered as an essential feature of co-creation in community-based interventions. Without limiting a preventive intervention to media-only strategies, future community-based studies should consider media attention to share information about the progress and aims of the to-be-developed intervention and strive for co-creation. This may be even more so for community-based interventions targeting topics where social norms are highly relevant, such as substance use, were influencing the broader environment has a significant impact.

Author Contributions

I.M.K. designed the study, supervised the data collection, analysed and interpreted the data and drafted parts of the manuscript. V.G.V.d.R. organized the data collection, conducted the literature search and drafted parts of the manuscript. C.D.K. and J.B.F.D.W. reviewed and edited the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the municipality Edam-Volendam (The Netherlands).

Institutional Review Board Statement

The study was approved by the Ethics Review Board of the Faculty of Behavioral & Social Sciences at Utrecht University (FETC18-060).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

We would like to acknowledge the municipality of Edam-Volendam for initiating and supporting this study. Moreover, directors and teachers of the included schools are thanked for enabling the collection of data among their students. Furthermore, we acknowledge all members of the community who in one way or another contributed to the LEF intervention.

Conflicts of Interest

All authors report no conflict of interest with respect to this publication.

References

  1. ESPAD. ESPAD Report 2019: Results from the European School Survey Project on Alcohol and Other Drugs; Publications Office of the European Union: Luxembourg, 2020. [Google Scholar]
  2. Inchley, J.; Currie, D.; Budisavljevic, S.; Torsheim, T.; Jåstad, A.; Cosma, A.; Arnarsson, A. (Eds.) Spotlight on Adolescent Health and Well-Being. Findings from the 2017/2018 Health Behaviour in School-Aged Children (HBSC) Survey in Europe and Canada. International Report. Volume 1. Key Findings; WHO Regional Office for Europe: Copenhagen, Denmark, 2020. [Google Scholar]
  3. Rombouts, M.; Van Dorsselaer, S.; Scheffers-van Schayk, T.; Tuithof, M.; Kleinjan, M.; Monshouwer, K. Jeugd en Riskant Gedrag 2019. Kerncijfers uit Het Peilstationsonderzoek Scholieren; Trimbos-instituut: Utrecht, The Netherlands, 2020. [Google Scholar]
  4. Stevens, G.; Van Dorsselaer, S.; Boer, M.; De Roos, S.; Duinhof, E.; Ter Bogt, T.; van den Eijnden, R.J.J.M.; Kuyper, L.; Visser, D.; Vollebergh, W.A.M.; et al. HBSC 2017. Gezondheid en Welzijn van Jongeren in Nederland; Utrecht University: Utrecht, The Netherlands, 2018. [Google Scholar]
  5. De Looze, M.; Raaijmakers, Q.A.W.; Ter Bogt, T.; Bendtsen, P.; Farhat, T.; Ferreira, M.; Godeau, E.; Kuntsche, E.; Molcho, M.; Pförtner, T.-K.; et al. Decreases in adolescent weekly alcohol use in Europe and North America: Evidence from 28 countries from 2002 to 2010. Eur. J. Public Health 2015, 25, 69–72. [Google Scholar] [CrossRef]
  6. Van Laar, M.W.; Cruts, A.N.N.; van Ooyen-Houben, M.M.J.; Meijer, R.F.; Brunt, T. Nationale Drug Monitor Jaarbericht 2009; Trimbos-Instituut: Utrecht, The Netherlands, 2010. [Google Scholar]
  7. Jeanblanc, J. Comorbidity between Psychiatric Diseases and Alcohol Use Disorders: Impact of Adolescent Alcohol Consumption. Curr. Addict. Rep. 2015, 2, 293–301. [Google Scholar] [CrossRef]
  8. Jessor, R. Problem Behavior Theory: A half century of research on adolescent behavior and development. In The Developmental Science of Adolescence: History through Autobiography; Psychology Press: East Sussex, UK, 2014; pp. 239–256. [Google Scholar]
  9. Roebroek, L.; Koning, I.M. The Reciprocal Relation Between Adolescents’ School Engagement and Alcohol Consumption, and the Role of Parental Support. Prev. Sci. 2015, 17, 218–226. [Google Scholar] [CrossRef] [Green Version]
  10. Stockings, E.; Bartlem, K.; Hall, A.; Hodder, R.; Gilligan, C.; Wiggers, J.H.; Sherker, S.; Wolfenden, L. Whole-of-community interventions to reduce population-level harms arising from alcohol and other drug use: A systematic review and meta-analysis. Addiction 2018, 113, 1984–2018. [Google Scholar] [CrossRef]
  11. Bronfenbrenner, U. The Ecology of Human Development: Experiments by Nature and Design; Harvard University Press: Cambridge, MA, USA, 1979. [Google Scholar]
  12. Kuntsche, E.; Knibbe, R.; Gmel, G.; Engels, R. Why do young people drink? A review of drinking motives. Clin. Psychol. Rev. 2005, 25, 841–861. [Google Scholar] [CrossRef]
  13. Stewart, C.; Power, T.G. Identifying patterns of adolescent drinking: A tri-ethnic study. J. Stud. Alcohol 2002, 63, 156–168. [Google Scholar] [CrossRef]
  14. Wold, B.; Mittelmark, M.B. Health-promotion research over three decades: The social-ecological model and challenges in implementation of interventions. Scand. J. Public Health 2018, 46, 20–26. [Google Scholar] [CrossRef] [PubMed]
  15. Koning, I.M.; Vollebergh, W.A.M.; Smit, F.; Verdurmen, J.E.E.; Van den Eijnden, R.J.J.M.; Ter Bogt, T.F.M.; Stattin, H.; Engels, R.C.M.E. Preventing heavy alcohol use in adolescents (PAS): Cluster randomized trial of a parent and student intervention offered separately and simultaneously. Addiction 2009, 104, 1669–1678. [Google Scholar] [CrossRef] [PubMed]
  16. Koning, I.M.; Eijnden, R.J.V.D.; Verdurmen, J.E.; Engels, R.; Vollebergh, W.A. Long-Term Effects of a Parent and Student Intervention on Alcohol Use in Adolescents: A Cluster Randomized Controlled Trial. Am. J. Prev. Med. 2011, 40, 541–547. [Google Scholar] [CrossRef] [PubMed]
  17. Smit, E.; Verdurmen, J.; Monshouwer, K.; Smit, F. Family interventions and their effect on adolescent alcohol use in general populations; a meta-analysis of randomized controlled trials. Drug Alcohol Depend. 2008, 97, 195–206. [Google Scholar] [CrossRef] [PubMed]
  18. Foxcroft, D.R.; Tsertsvadze, A. Universal school-based prevention programs for alcohol misuse in young people. Cochrane Database Syst. Rev. 2011, CD009113. [Google Scholar] [CrossRef] [Green Version]
  19. EMCDDA. Environmental Substance Use Prevention Interventions in Europe. 2018. Available online: https://www.emcdda.europa.eu/publications/technical-reports/environmental-substance-use-prevention-interventions-in-europe_en (accessed on 26 November 2020).
  20. Stockings, E.; Shakeshaft, A.; Farrell, M. Community Approaches for Reducing Alcohol-Related Harms: An Overview of Intervention Strategies, Efficacy, and Considerations for Future Research. Curr. Addict. Rep. 2018, 5, 274–286. [Google Scholar] [CrossRef]
  21. O’Mara-Eves, A.; Brunton, G.; McDaid, D.; Oliver, S.; Kavanagh, J.; Jamal, F.; Matosevic, T.; Hardenberg, A.; Thomas, J. Community engagement to reduce inequalities in health: A systematic review, meta-analysis and economic analysis. Public Health Res. 2013, 1, 1–526. [Google Scholar] [CrossRef] [Green Version]
  22. Gaventa, J.; Cornwall, A. Challenging the Boundaries of the Possible: Participation, Knowledge and Power. IDS Bull. 2006, 37, 122–128. [Google Scholar] [CrossRef] [Green Version]
  23. Minkler, M.; Wallerstein, N. Community-Based Participatory Research for Health: From Process to Outcomes; John Wiley & Sons: San Francisco, CA, USA, 2011. [Google Scholar]
  24. World Health Organization. Ottawa Charter for Health Promotion; World Health Organization: Geneva, Switzerland, 1986. [Google Scholar]
  25. Milton, B.; Attree, P.; French, B.; Povall, S.; Whitehead, M.; Popay, J. The impact of community engagement on health and social outcomes: A systematic review. Community Dev. J. 2011, 47, 316–334. [Google Scholar] [CrossRef] [Green Version]
  26. O’Mara-Eves, A.; Brunton, G.; Oliver, S.; Kavanagh, J.; Jamal, F.; Thomas, J. The effectiveness of community engagement in public health interventions for disadvantaged groups: A meta-analysis. BMC Public Health 2015, 15, 129. [Google Scholar] [CrossRef] [Green Version]
  27. McConnell, M.; Memetovic, J.; Richardson, C. Coping style and substance use intention and behavior patterns in a cohort of BC adolescents. Addict. Behav. 2014, 39, 1394–1397. [Google Scholar] [CrossRef]
  28. Jagosh, J.; Macaulay, A.C.; Pluye, P.; Salsberg, J.; Bush, P.; Henderson, J.; Sirett, E.; Wong, G.; Cargo, M.; Herbert, C.P.; et al. Uncovering the Benefits of Participatory Research: Implications of a Realist Review for Health Research and Practice. Milbank Q. 2012, 90, 311–346. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Fagan, A.A.; Arthur, M.W.; Hanson, K.; Briney, J.S.; Hawkins, J.D. Effects of Communities That Care on the Adoption and Implementation Fidelity of Evidence-Based Prevention Programs in Communities: Results from a Randomized Controlled Trial. Prev. Sci. 2011, 12, 223–234. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Koning, I.M.; De Kock, C.; van der Kreeft, P.; Percy, A.; Sanchez, Z.M.; Burkhart, G. Implementation of the Icelandic Prevention Model: A critical discussion of its worldwide transferability. Drugs Educ. Prev. Policy 2020, 1–12. [Google Scholar] [CrossRef]
  31. Sawyer, S.M.; Afifi, R.A.; Bearinger, L.H.; Blakemore, S.-J.; Dick, B.; Ezeh, A.C.; Patton, G.C. Adolescence: A foundation for future health. Lancet 2012, 379, 1630–1640. [Google Scholar] [CrossRef]
  32. Koning, I.M.; Van der Rijst, V.G. Programma LEF: Het Uitstellen van het Beginnen Met Drinken Onder Minderjarige Jongeren in Edam-Volendam. Rapportage Probleemdefinitie. 2018. Available online: https://www.lef-edvo.nl/wp-content/uploads/2019/03/Bijlage-1-Onderzoeksrapport-programma-LEF.pdf (accessed on 8 February 2021).
  33. Brody, G.H.; Flor, D.L.; Hollett-Wright, N.; McCoy, J.K.; Donovan, J. Parent-child relationships, child temperament profiles and children’s alcohol use norms. J. Stud. Alcohol Suppl. 1999, 45–51. [Google Scholar] [CrossRef]
  34. Van Der Vorst, H.; Engels, R.C.; Meeus, W.; Deković, M. The impact of alcohol-specific rules, parental norms about early drinking and parental alcohol use on adolescents’ drinking behavior. J. Child Psychol. Psychiatry 2006, 47, 1299–1306. [Google Scholar] [CrossRef]
  35. Van Der Vorst, H.; Engels, R.; Meeus, W.; Deković, M.; Van Leeuwe, J. The role of alcohol-specific socialization in adolescents’ drinking behaviour. Addiction 2005, 100, 1464–1476. [Google Scholar] [CrossRef]
  36. Engels, R.C.; Knibbe, R.A. Alcohol use and intimate relationships in adolescence: When love comes to town. Addict. Behav. 2000, 25, 435–439. [Google Scholar] [CrossRef]
  37. Engels, R.; Knibbe, R.A.; Drop, M.J. Why Do Late Adolescents Drink at Home? A Study on Psychological Well-Being, Social Integration and Drinking Context. Addict. Res. 1999, 7, 31–46. [Google Scholar] [CrossRef]
  38. Muthén, L.K.; Muthén, B.O. Mplus User’s Guide, 7th ed.; Muthén & Muthén: Los Angeles, CA, USA, 1998–2015. [Google Scholar]
  39. Long, J.S. Regression Models for Categorical and Limited Dependent Variables. J. Am. Stat. Assoc. 1997, 92, 1655. [Google Scholar] [CrossRef]
  40. Nieminen, P.; Lehtiniemi, H.; Vähäkangas, K.; Huusko, A.; Rautio, A. Standardised regression coefficient as an effect size index in summarising findings in epidemiological studies. Epidemiol. Biostat. Public Health 2013, 10, 1–15. [Google Scholar]
  41. Schulenberg, J.; Maggs, J.L. A developmental perspective on alcohol use and heavy drinking during adolescence and the transition to young adulthood. J. Stud. Alcohol Suppl. 2002, 54–70. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Ajzen, I. The theory of planned behavior. Organ. Behav. Hum. Decis. Process. 1991, 50, 179–211. [Google Scholar] [CrossRef]
  43. Rimal, R.N.; Real, K. How Behaviors are Influenced by Perceived Norms: A test of the theory of normative social behavior. Commun. Res. 2005, 32, 389–414. [Google Scholar] [CrossRef]
  44. Sznitman, S.R.; Kolobov, T.; ter Bogt, T.; Kuntsche, E.; Walsh, S.D.; Boniel-Nissim, M.; Harel-Fisch, Y. Exploring substance use normalization among adolescents: A multilevel study in 35 countries. Soc. Sci. Med. 2013, 97, 143–151. [Google Scholar] [CrossRef]
  45. Dono, J.; Miller, C.; Ettridge, K.; Wilson, C. The role of social norms in the relationship between anti-smoking advertising campaigns and smoking cessation: A scoping review. Health Educ. Res. 2020, 35, 179–194. [Google Scholar] [CrossRef] [PubMed]
  46. Festinger, L. A Theory of Social Comparison Processes. Hum. Relat. 1954, 7, 117–140. [Google Scholar] [CrossRef]
  47. Linkenbach, J.W.; Perkins, H.W.; DeJong, W. Parents’ perceptions of parenting norms: Using the social norms approach to reinforce effective parenting. In The Social Norms Approach to Preventing School and College Age Substance Abuse: A Handbook for Educators, Counselors, and Clinicians; Perkins, H.W., Ed.; Jossey-Bass: San Francisco, CA, USA, 2003; pp. 247–258. [Google Scholar]
  48. Labrie, J.W.; Hummer, J.F.; Lac, A.; Ehret, P.J.; Kenney, S.R. Parents Know Best, But Are They Accurate? Parental Normative Misperceptions and Their Relationship to Students’ Alcohol-Related Outcomes. J. Stud. Alcohol Drugs 2011, 72, 521–529. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Southwell, B.; Yzer, M. The Roles of Interpersonal Communication in Mass Media Campaigns. Ann. Int. Commun. Assoc. 2007, 31, 420–462. [Google Scholar] [CrossRef]
  50. Jeong, M.; Bae, R.E. The Effect of Campaign-Generated Interpersonal Communication on Campaign-Targeted Health Outcomes: A Meta-Analysis. Health Commun. 2017, 33, 988–1003. [Google Scholar] [CrossRef] [PubMed]
  51. Friese, B.; Grube, J.; Moore, R. How Parents of Adolescents Store and Monitor Alcohol in the Home. J. Prim. Prev. 2012, 33, 79–83. [Google Scholar] [CrossRef]
  52. Kaynak, Ö.; Winters, K.C.; Cacciola, J.; Kirby, K.; Arria, A. Providing Alcohol for Underage Youth: What Messages Should We Be Sending Parents? J. Stud. Alcohol Drugs 2014, 75, 590–605. [Google Scholar] [CrossRef] [Green Version]
  53. Sharmin, S.; Kypri, K.; Khanam, M.; Wadolowski, M.; Bruno, R.; Mattick, R.P. Parental Supply of Alcohol in Childhood and Risky Drinking in Adolescence: Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2017, 14, 287. [Google Scholar] [CrossRef] [Green Version]
  54. Van Hoof, J.J.; Van Zanten, E.; Van Der Lely, N. Four Years of Reports of Alcohol-Related Harm to Pediatricians in the Netherlands. J. Child Adolesc. Subst. Abus. 2015, 24, 191–197. [Google Scholar] [CrossRef]
  55. Paschall, M.J.; Grube, J.W.; Thomas, S.; Cannon, C.; Treffers, R. Relationships Between Local Enforcement, Alcohol Availability, Drinking Norms, and Adolescent Alcohol Use in 50 California Cities. J. Stud. Alcohol Drugs 2012, 73, 657–665. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Van Hoof, J.J.; Gosselt, J.F. Underage alcohol sales—It only takes a minute: A new approach to underage alcohol availability. J. Stud. Alcohol Drugs 2013, 74, 423–427. [Google Scholar] [CrossRef] [PubMed]
  57. Moffitt, T.E. Adolescence-limited and life-course-persistent antisocial behavior: A developmental taxonomy. Psychol. Rev. 1993, 100, 674–701. [Google Scholar] [CrossRef]
  58. Minary, L.; Trompette, J.; Kivits, J.; Cambon, L.; Tarquinio, C.; Alla, F. Which design to evaluate complex interventions? Toward a methodological framework through a systematic review. BMC Med. Res. Methodol. 2019, 19, 92. [Google Scholar] [CrossRef] [Green Version]
  59. Pawson, R. The Science of Evaluation: A Realist Manifesto. Sage, 2013. Available online: https://uk.sagepub.com/en-gb/eur/the-science-of-evaluation/book238842 (accessed on 19 March 2021).
  60. Kemm, J. The limitations of ‘evidence-based’ public health. J. Eval. Clin. Pract. Spec. Issue Evid. Based Med. 2006, 12, 319–324. [Google Scholar] [CrossRef]
  61. Sharp, N.D.; Pineros, S.L.; Hsu, C.; Starks, H.; Sales, A. A Qualitative Study to Identify Barriers and Facilitators to Implementation of Pilot Interventions in the Veterans Health Administration (VHA) Northwest Network. Worldviews Evid.-Based Nurs. 2004, 1, 129–139. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Explanatory Model including Important and Changeable Determinants of Behavior for Onset of Alcohol Use among Youth.
Figure 1. Explanatory Model including Important and Changeable Determinants of Behavior for Onset of Alcohol Use among Youth.
Ijerph 18 08823 g001
Figure 2. Three Steps Included in the Developmental Phase of the Community-Based Intervention LEF.
Figure 2. Three Steps Included in the Developmental Phase of the Community-Based Intervention LEF.
Ijerph 18 08823 g002
Figure 3. Visualization of the Interaction between Condition*Age on Rules about Alcohol.
Figure 3. Visualization of the Interaction between Condition*Age on Rules about Alcohol.
Ijerph 18 08823 g003
Table 1. Descriptive Data on all Variables of Interest for the Control and Experimental Condition and Total Sample.
Table 1. Descriptive Data on all Variables of Interest for the Control and Experimental Condition and Total Sample.
Control Condition
(N = 1027)
Experimental Condition
(N = 1137)
Total
(N = 2146)
M (SD)M (SD)M (SD)
TN variables
Age (M,SD)14.57 (1.34)14.75 (1.32) *14.67 (1.33)
Gender (% boys)49.9%46.2%
Norms about alcohol in youth Tn (M,SD)2.00 (1.14)2.22 (1.28) *2.12 (1.19)
Rules about alcohol Tn (M,SD)3.90 (1.29)3.66 (1.41) *3.78 (1.36)
Informal accessibility of alcohol Tn (M,SD)3.20 (1.21)2.97 (1.34) *3.08 (1.29)
Formal accessibility of alcohol Tn (M,SD)3.84 (1.36)3.48 (1.53) *3.65 (1.46)
Weekly drinking Tn (M,SD)1.98 (5.17)3.61 (8.37) *2.86 (7.13)
T0 variables
Norms about alcohol in youth T0 (M,SD)1.93 (1.06)2.04 (1.14)1.99 (1.10)
Rules about alcohol T0 (M,SD)4.05 (1.17)3.93 (1.23)3.99 (1.19)
Informal accessibility of alcohol T0 (M,SD)3.12 (1.13)2.94 (1.25) *3.03 (1.19)
Formal accessibility of alcohol T0 (M,SD)3.78 (1.30)3.48 (1.47) *3.63 (1.39)
Weekly drinking T0 (M,SD)1.42 (4.96)2.14 (4.97) *1.79 (4.97)
* = significantly different from the control condition based on t-tests (Chi-square test for gender).
Table 2. Effects of Intervention Condition on Mechanisms (Norms about Youth, Rules about Alcohol, Accessibility of Alcohol) and Outcome (Weekly Drinking) at Follow-Up.
Table 2. Effects of Intervention Condition on Mechanisms (Norms about Youth, Rules about Alcohol, Accessibility of Alcohol) and Outcome (Weekly Drinking) at Follow-Up.
VariableNorms about Youth Drinking T1Rules about Alcohol T1Informal Accessibility Alcohol T1Formal Accessibility Alcohol T1Weekly Drinking T1
β(SE)p-Valueβ(SE)p-Valueβ(SE)p-Valueβ(SE)p-Valueβ(SE)p-Value
Age0.37(0.04)0.00−0.33(0.03)0.00−0.27(0.03)0.00−0.21(0.00)0.000.68(0.09)0.00
Gender (0 = girls, 1 = boy)−0.05(0.02)0.030.02(0.02)0.23−0.02(0.02)0.460.00(0.99)0.99−0.04(0.08)0.57
Outcome T00.43(0.03)0.000.59(0.03)0.000.39(0.03)0.000.39(0.02)0.000.65(0.10)0.00
Condition (1 = experiment)−0.02(0.02)0.300.02(0.02)0.43−0.03(0.02)0.20−0.05(0.04)0.040.28(0.07)0.00
Bold values denote statistical significance at the p < 0.05 level.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Koning, I.M.; Van der Rijst, V.G.; De Wit, J.B.F.; De Kock, C. Pre-Intervention Effects of a Community-Based Intervention Targeting Alcohol Use (LEF); The Role of Participatory Research and Publicity. Int. J. Environ. Res. Public Health 2021, 18, 8823. https://doi.org/10.3390/ijerph18168823

AMA Style

Koning IM, Van der Rijst VG, De Wit JBF, De Kock C. Pre-Intervention Effects of a Community-Based Intervention Targeting Alcohol Use (LEF); The Role of Participatory Research and Publicity. International Journal of Environmental Research and Public Health. 2021; 18(16):8823. https://doi.org/10.3390/ijerph18168823

Chicago/Turabian Style

Koning, Ina M., Vincent G. Van der Rijst, John B. F. De Wit, and Charlotte De Kock. 2021. "Pre-Intervention Effects of a Community-Based Intervention Targeting Alcohol Use (LEF); The Role of Participatory Research and Publicity" International Journal of Environmental Research and Public Health 18, no. 16: 8823. https://doi.org/10.3390/ijerph18168823

APA Style

Koning, I. M., Van der Rijst, V. G., De Wit, J. B. F., & De Kock, C. (2021). Pre-Intervention Effects of a Community-Based Intervention Targeting Alcohol Use (LEF); The Role of Participatory Research and Publicity. International Journal of Environmental Research and Public Health, 18(16), 8823. https://doi.org/10.3390/ijerph18168823

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop