1. Introduction
Globally an estimated 2.8 billion people rely on solid fuels such as wood, animal dung, crop waste, and charcoal, as well as kerosene for cooking, lighting and heating their homes [
1]. Persistent exposure to household air pollution from solid fuels and kerosene accounted for nearly 2.6 million premature deaths as a result of pneumonia, cardiovascular disease and cancers [
2]. Women and children are disproportionately affected due to greater time spent in or near the kitchen. The use of solid fuels and kerosene on rudimentary inefficient cookstoves also increases pressures on natural resources, contributing to environmental degradation, resource depletion, and climate change through CO
2 and black carbon emissions, as well as other hazardous pollutants. Time spent cooking and the procurement of large amounts of fuel frequently takes the cook, mostly women, away from income generating activities or better education. Furthermore, the fuel costs are often much higher with traditional and inefficient stoves. On the other hand, clean cooking technology has the potential to make a substantial contribution to income and other economic activity [
3]. Clean cooking options include improved biomass stoves, electric stoves, liquefied petroleum gas (LPG), and other cleaner-burning fuels, such as pellets or briquettes.
In the last sixty years, social marketing, behavior change communications (BCC), and related strategies to change behavior have taken a prominent place in addressing global health challenges [
4]. Applying commercial marketing principles to social issues, social marketing and BCC interventions have been successfully used to encourage healthy behaviors including condom use, family planning, and water purification and sanitation [
5]. These strategies have been shown to be widely effective in promoting behavior change across a range of subject matter, populations, and global settings [
6,
7].
Social marketing and BCC strategies have the potential to open up the market for modern cookstoves to the commercial sector over the long term through effective targeting of socially marketed product subsidies, through a process that has been termed the Total Market Approach (TMA) [
8,
9]. Following this approach, the Global Alliance for Clean Cookstoves and the United Nations Foundation have funded four projects to implement BCC campaigns to accelerate clean cooking markets by increasing awareness and adoption of clean cooking solutions, thus reducing health and environmental impacts of solid fuel and kerosene use.
The four projects are located in three countries:
- (1)
Bangladesh:
- (2)
Kenya:
- (3)
Nigeria:
These projects were funded by the United Kingdom Department for International Development (DFID) for a period of two years from June 2016–June 2018.
In order to evaluate outcomes of the four projects, and to assess the conceptual model, the investigators are conducting a quasi-experimental study at three time points across the two-year implementation period. The full evaluation, inclusive of baseline, midline, and endline data, will investigate five main research questions:
- (1)
Are the implemented BCC campaigns effective in prompting people to purchase clean and efficient cookstoves (hereafter called “modern”) and improving proper cookstove usage?
- (2)
How much of the observed changes in behavior can be attributed to the BCC campaigns implemented?
- (3)
Is there a dose-response relationship between higher exposure to cookstove messages and the outcomes of cookstove purchasing and improved proper stove usage?
- (4)
Which aspects of the BCC campaigns were more effective than others? How does this vary by gender, socioeconomic status, and other demographic variables?
- (5)
What are the impacts of the BCC interventions on relative progress towards health, environment, gender, and livelihood goals?
The goals of the current study were to (1) describe the protocol for a cross-site evaluation of four BCC campaigns to promote modern stove purchase and use, and (2) assess the baseline data from these campaigns as a preliminary step to modeling BCC outcomes over time. In the following, we report on the initial evaluation protocol, including methods, measurements, and analysis plans. These components are inclusive of the full study and the midline and endline stages yet to be implemented. Additionally, we report results from the baseline data collection, completed in 2017. Using only the available baseline data, we estimated preliminary logistic regression models to examine associations between three outcomes of interest (1) intention to buy a modern stove, (2) previous ownership of a modern stove, and (3) ownership of more than one stove type (stove stacking)—with measured demographic and other potential explanatory variables, such as attitudes, awareness, and media exposure. While these analyses were conducted purely as a preliminary step to understand the nature of our baseline data, they will provide a framework for future studies once midline and endline data become available.
2. Methods
2.1. Study Design
The underlying evaluation framework is a quasi-experimental design that assumes levels of BCC exposure will vary by campaign, and by medium of exposure. Following previous studies, we assume there will be natural variation in exposure to cookstove campaign messages [
10,
11]. This is due to variable resources and efforts of local BCC implementation partners, expenditures of resources, and consumer access to media sources (e.g., mobile phones, mass media). As a function of higher and lower levels of exposure, we anticipate that cookstove utilization outcomes measured will vary. This variation will enable us to create a measure of campaign exposure, a cookstove-messaging dosage index (CMDI), similar to an approach developed previously by the investigators [
12].
The current study reports on the overall evaluation protocol. We also report on data and preliminary multivariate models that examine associations of cookstove use and related outcomes with prior exposure to cookstove marketing efforts implemented by local sales organizations before the baseline data collection. Future research will calculate a dose-response curve based on measured exposure to cookstove BCC efforts and follow-up survey data [
13].
2.2. Measures
Exposure data: We will use two types of data to measure exposure and develop the CMDI: (1) self-reported exposure to messages along with recall of messages, and program-related terminology (e.g., taglines); and (2) external data from multiple sources to measure potential exposure to cookstove messages at the community, online, and media market level.
The evaluation employs multiple time-point rapid population-based surveys and in-depth interviews in a smaller sub-group in order to assess levels of self-reported exposure and recall of messages from different BCC media. Using baseline data we examined:
The number of previous cookstove message channels due to commercial marketing of stoves (radio, text messages (SMS), community agents etc.) the respondent was exposed to and the frequency of exposure to specific promotion executions;
Unprompted message recall from radio listeners and the effect of changes in message content over time;
The role played by word-of-mouth, e.g., consumer-to-consumer recommendation; and
The respondent’s status on the “consumer journey” (consideration, active evaluation, purchase, use).
To develop reliable estimates of prior commercial cookstove campaign exposure, self-reported campaign awareness data will be compared to objective measures of exposure, such as broadcast reach maps [
14] and community implementation data [
13,
15]. At the midline and endline data collection time points, when BCC campaign data are available, media exposure data will be captured through available mass media monitoring sources in each country, as well as through local program implementation databases, which are provided directly by the BCC implementation partners.
Response data: The main outcomes of interest are changes in knowledge, attitudes, and practices related to household cooking and cookstove purchase and use. To demonstrate causality, the rapid population-based survey conducted at the project’s inception will establish baseline knowledge, perceptions, and practices related to the content of cookstove marketing efforts. Topics include, but will not be limited to, the detrimental impacts of traditional cooking methods, a range of solutions to avoid these detrimental impacts, and pathways to access and correctly use modern cookstoves. Information sources that influence the population at baseline have also been explored.
“Rapid” population-based surveys and in-depth interviews will be used in addition to focus group discussions (FGD). The implementation of a range of evaluation tools will allow for the assessment of the magnitude and frequency of the responses to the BCC campaign as well as for exploring the meaning and understanding of these. Data collection tools are described below. Rapid surveys measured:
Measures of aided and unaided awareness of campaign messages. Recognizing the overlap with exposure measurement, this will be done in conjunction with the self-reported recall of messages.
Scales for subjective and descriptive social norms and related knowledge, attitudes, and beliefs [
16].
Assessments of message receptivity, including perceived credibility and emotional response.
While not reported here due to space constraints, FGDs will also be used among a representative sample of school and community members who participated in the school club demonstrations to assess how community readiness, interpersonal communication, and behaviors were affected by the club demonstrations.
2.3. Data Collection
Population-based Rapid Surveys: The first approach involves population-based rapid surveys at multiple time points during the project, with approximately 800–1000 respondents per survey period per country. The baseline surveys were conducted during the formative research prior to implementation of the BCC, midline and endline or post-intervention surveys will also be conducted.
Respondents were randomly selected within assigned catchment areas to ensure that they had the potential to be exposed to the appropriate BCC campaigns targeting their areas at midline and endline. A screening process narrowed the respondent pool according to pre-defined socio-demographic characteristics to ensure focus on the target population and to control for likely confounding factors.
The aim of the baseline in-person survey was to gain a measure and understanding of several factors:
Socioeconomic and demographic characteristics of the selected population;
Baseline knowledge, attitudes, and practices (KAP) related to cooking appliances and fuels;
Perceived barriers to uptake and use of modern cookstoves;
Exploration of gendered stereotypes and norms that exist in relation to stove purchase and use;
Sources of current modern cookstove related knowledge; and
Level of exposure to selected BCC channels i.e., TV, radio, billboards.
The final draft versions of the survey were piloted in populations with similar demographic characteristics to the targeted population in each country to ensure that they were effective, understandable and culturally appropriate tools. Data were collected in participants’ homes using the electronic data collection platform ODK (
https://opendatakit.org/).
The surveys began with a brief introduction with in-depth sociodemographic data, such as area of residence, age, sex, marital status, education, occupation, housing characteristics, and similar information for the primary income earner. Country-specific socioeconomic status was assessed by housing material for Bangladesh, the Living Standards Measure for Kenya (groupings ranged from 1 to 10), and a summary of household items and materials for Nigeria (scores ranged from 10 to 49).
Stove use and fuel patterns were assessed by the number and types of stoves used for certain tasks, primary stove type, simultaneous use of stoves, and likes and dislikes of different stove types. The amount spent on fuel for the stoves was also explored. Respondents reported on issues surrounding decision making for large household purchases, defined as equal to or greater than KSH3000 (Kenyan shillings) for Kenya, 1800 BDT (Bangladeshi taka) for Bangladesh, or N7000 (Nigerian naira) for Nigeria (These prices were set based on the average cost of the implementation project promoted stoves.) The next section queried respondents on sources of information, specifically frequency and amount of exposure to TV, radio, mobile phone, Internet, and social media, such as What’s App or Facebook.
The final section covered the respondent’s previous exposure to marketing for clean cooking campaigns. This section assessed whether the respondent had seen or heard various local advertisements for clean cooking, and what their awareness, attitudes, and beliefs were surrounding modern stoves. Also, in Kenya and Bangladesh, visual aids of the promoted and other “modern” stoves (i.e., pictures of stoves to be promoted in the subsequent BCC campaigns) were shown to participants in order to test for recognition of previous marketing efforts and define the focus of the questions.
2.4. Midline Data Collection Plans
The midline data collection is the next planned step in the evaluation. The rapid surveys will be repeated for each of the four implementing projects in late 2017–early 2018. These post implementation surveys will also include assessments of exposure to and awareness of the projects BCC campaigns. Households that have purchased one of the promoted stoves and/or fuels since BC project inception will be identified and the motivating factors leading to that purchased explored.
2.5. Endline Data Collection Plans
In addition to the rapid surveys the following data collection methods will be conducted at endline for each implementing project.
In-depth Interviews: Purchasers vs. Non-Purchasers (N = 150 for each BC project). In a second approach, in-depth interviews will be conducted at the late intervention stages. A sub-sample of 150, will be selected from the sample of follow-up rapid survey respondents. These sub-samples will be categorized by those who purchased a new stove since the start of the BCC campaign (N = 75), and a group of controls who did not yet purchase a new stove, matched to stove purchasers based on socio-demographic characteristics (N = 75). These study groups will have more intensive follow-up including comprehensive surveys to collect key data used for exploring determinants and barriers to purchasing a new stove.
Intensive stove use monitoring: Purchasers with small comparison non-purchaser group (N = 80 for each BC project). The third approach to the evaluation will include a random selection of 50 respondents from each of the sub-sample of stove purchasers described above. In addition to the comprehensive surveys, this group of 50 stove purchasers will also have Stove Use Monitors (SUMs) placed on all stoves in their home for 4–5 months, which will enable tracking of actual use of each stove. Another 20 homes without the new stove, but which match the demographic and fuel use profiles of the purchasers, will be monitored with SUMs simultaneously to provide a baseline. Should homes in this baseline sub-group opt to purchase an improved stove during the SUMs monitoring, only the data from the pre-purchase period will be used in the baseline analysis. A sub-sample of the 50 purchaser homes will be randomly selected for cooking event observation and FGD at the end of the monitoring period.
2.6. Study Locations and Timeline
Table 1 below details the study location, populations and timing for each baseline BCC data collection.
2.7. Participant Recruitment
Sample selection was designed to reflect the target audiences of each BCC implementation program, as summarized in
Table 2.
For all locations, the main participant was the family member who organized the cooking/home keeping. The sample was designed to capture participants who also carried out most of the cooking for the household and were involved at least in some part in the decision-making for larger HH (Household) purchases. If the main participant was in no way involved in the decision-making for larger household purchases, the main decision-maker was also interviewed. If the main decision-maker was not available, the household was not eligible. If the main participant had a housekeeper and therefore organizes the cooking and household but does not cook more than three times per week, the housekeeper/maid was interviewed for certain sections of the survey. In Bangladesh the main participant was a married women and the secondary participant her husband.
Interviews were conducted at weekends, evenings, and early mornings (as well as during the day) to ensure the sample included both men and women who work outside the home. Households were selected from the selected areas using a standard approach to avoid any bias or convenience sampling. Screening surveys were used to determine eligibility. Verbal consent was requested from any willing and eligible participants. The study protocol was approved by the MaGil Institutional Research Board (2017 Protocol number BCC-001).
2.8. Statistical Analysis
This baseline analysis explored the association of sociodemographic characteristics, media exposure, and stove awareness and attitudes with respect to three key outcomes: (1) intention to buy a modern stove (or LPG stove in Nigeria), (2) having ever owned a modern stove (or LPG stove in Nigeria) as shown in the survey with visual aids, and (3) number of stove types owned that are in working order. Outcome 1 was defined as planning to buy a modern stove within the next month versus no plans at all, possibly planning to buy one but not within a month, or unsure. Respondents were filtered for analysis if they had been previously exposed to the advertisement of modern cookstoves for Kenya and Bangladesh, or if they did not currently own an LPG stove for Nigeria. Outcome 2 was defined as those who had ever owned a modern stove versus those who had not. Outcome 3 was defined as those who owned two or more stove types versus those who only owned one stove type.
Descriptive analyses summarized frequencies, percentages, means and standard deviations (SD) for outcomes and explanatory variables. All potential explanatory variables were assessed in crude logistic regression with each outcome per country using odds ratios (OR) and 95% confidence intervals (CI). Variables with a crude association of
p ≤ 0.10 with each outcome of interest were included in multivariable analyses. Full models included all potential covariates, and reduced models took out explanatory variables that were significantly associated with each other. Final models were selected based on their relative quality compared to the other model options using the minimum Akaike information criterion (AIC) [
17]. Given the exploratory nature of this analysis, covariates with a
p-value of 0.10 or less are described for their associations with the outcomes in the final models. All statistical analyses were performed in SAS 9.4 (SAS Institute Inc., Cary, NC, USA).
4. Discussion
As noted earlier, the goal of this study was to (1) describe the protocol for a cross-site evaluation of four BCC campaigns to promote modern stove purchase and use, and (2) assess the baseline data from these campaigns as a preliminary step to modeling BCC outcomes over time. Three key outcomes of intentions to purchase, previous modern stove ownership, and ownership of multiple stove types were explored to identify associations with a variety of sociodemographic characteristics, stove and fuel use patterns, and exposure to the media and clean cooking marketing campaigns. We chose to examine these outcomes because they are central to the overall evaluation objectives, and baseline data were able to provide useful information that will inform future follow up analyses. This study provides an initial look into an ongoing program to increase the effective use of social marketing and BCC methodologies in the cookstoves sector, and should be considered as a first step in that long-term research agenda [
18].
With respect to the three key outcomes examined in the descriptive analyses and regression models, we can draw several overall conclusions. First, based on the regression models, radio is an important media platform for information for Kenya as higher levels of reported radio use were associated with each of the outcomes.
Second, in all three countries, not being able to afford LPG or another kind of modern stove is the most frequently reported barrier. While absolute affordability (i.e., in relation to household income) is not a barrier that BCC can overcome, the issue may be more nuanced [
19]. Many individuals in all three countries who report not being able to afford a modern stove, at the same time own other discretionary consumer items, such as mobile phones, motor bikes, TV, and other items. There are clearly trade-offs being made by consumers as they are the targets of commercial and social marketing efforts, and decide what products to buy. BCC efforts need to prioritize cookstove purchases and understand how best to increase the salience and perceived value of cookstoves relative to other consumer options [
20].
There is also relatively low awareness that traditional stoves are bad for one’s health and that of family in each of the three countries. This presents a tremendous opportunity for public education for the BCC campaigns [
21]. While health as a message frame may or may not be the most persuasive [
22], it is important information as part of a larger set of benefits to use in promoting modern cookstoves. In particular, efforts such as the Shamba Chef program, and radio advertising in Nigeria and Kenya, that highlights effects of cookstoves in the home and benefits of switching, may be able to integrate health messages without framing specifically on the topic of health.
Access to the Internet and social media are still relatively low in all three countries. Access is almost certain to grow in coming years, but at present they are not the most readily useable platforms for campaigns among these study populations. At the same time, TV appears to be powerful platform, as evidenced by Shamba Chef in particular, which is currently rated number one for its time slot on Sunday evenings. However, the distribution of TV watching per week varies widely by location, and thus only reaches some target audiences.
Additionally, there are a number of specific barriers by country. For example, in Bangladesh, access to LPG (refill cylinders, available in stores) seems to be a major barrier. In Kenya, not knowing where to buy a modern stove is a barrier. In these two countries, both classified by the World Bank as low income [
23], few have actually ever owned a modern stove before, whereas in Nigeria, a low-middle income country [
23], a higher percentage (16%) have owned such modern stoves.
Furthermore, there is clear evidence from the baseline that attitudes and beliefs towards modern stoves are associated with key outcomes of stove use intentions (Outcome 2) and use behavior (Outcome 3). This suggests that BCC may work to increase cookstove adoption and use through changes in positive attitudes and beliefs toward the product. This hypothesis should be investigated in the follow up midline and endline data collections.
Finally, the role of sociodemographic variables should be explored in future analyses, as they were associated with each of the key outcomes. Gender, socio-economic status, area of residence, and marital status were all associated with one or more outcomes. For example, being female and having higher socio-economic status was associated with a higher probability of “stove stacking” (multi-stove ownership). Such sociodemographic categorizations both provide hypotheses of consumer profiles to examine in future analyses with midline and endline data, as well as opportunities for audience segmentation in future consumer targeting to increase cookstove purchase and use [
24].
This study was a first step in an ongoing evaluation of BCC for cookstove marketing. Future steps in this evaluation include midline assessments and endline assessments of BCC outcomes. As such, this study should be considered in the context of broader efforts to extend the evidence base in BCC.
The study has several limitations. First, the data were collected only at one time point and are cross-sectional in nature. No causality can be inferred from any of the significant statistical associations. As such, results are suggestive and provide potential avenues for investigation at midline and endline follow-ups. Second, we do not currently have qualitative data, which may help to interpret our results in the future and should be examined and compared to the survey results using mixed methods approaches in future studies [
25]. Third, data are based solely on self-report, and in particular such data on exposure to cookstove promotions are subject to selective attention bias [
26], and should be validated as feasible in future studies using independent data [
27]. Validation analyses are planned for the midline and endline cookstove evaluation studies.
Potential future research studies include “heavy-up” (media delivery manipulation) experiments to examine dose-response effects of higher levels of cookstove promotion on the key outcomes examined in the current study [
28]. Also, combinations of social marketing strategies including price subsidies and placement/distribution approaches (e.g., providing more local outlets for cookstoves) should be examined in future BCC evaluations [
29].
5. Conclusions
This study describes the study protocol and provides an initial look at data from an ongoing multi-site evaluation of social marketing and BCC to promote modern cookstove purchase and use. As this sector is critical to improving public health and gender equity, and fighting climate change, in low and middle income countries, the current study provides valuable new information. Social marketing and BCC are new to the sector, and more research needs to be done to optimize the effectiveness of these proven behavior change strategies.
In particular, because BCC is so new to the cookstoves sector, there is a need to identify potential relationships between marketing efforts and purchase and use behaviors, understand the nature of those associations, and design appropriate communication and marketing strategies. Findings presented here provide initial evidence that exposure to promotions may affect cookstove attitudes, beliefs, and potential use. The midline and endline data from this study will help to answer questions about the effects of exposure to promotions over time on cookstove outcomes.