How Does the Gus Schumacher Nutrition Incentive Program Work? A Theory of Change
Abstract
:1. Introduction
2. Materials and Methods
2.1. Literature and Document Reviews
2.2. Human Subjects Protection
2.3. Interviews
2.4. Workshops
2.5. Focus Groups
2.6. TOC Drafting
3. Results
3.1. Evidence and Perspectives from the TOC Development Process
3.1.1. Equity
3.1.2. Activities, Short-Term Outcomes, Pathways, and Assumptions
3.1.3. Long-Term Outcomes
3.1.4. Ultimate Goals
3.1.5. Environmental Context
3.2. Theory of Change
3.2.1. Pathways, Short-Term Outcomes, and Activities
- Participants want FVs and participate in NI projects. Projects develop community-centered and culturally tailored promotion strategies and local partnerships to encourage FV purchases and intake, inform the community about the availability of NIs and how to use them, and distribute NIs. Some projects provide education about nutrition and FV preparation. Projects may address barriers to FV purchasing, such as location of FV food retailers.
- Food retailers are accessible, welcoming, and provide FVs to participants. Projects help food retailers learn more about participants’ needs and the GusNIP program. They support food retailers to develop the infrastructure needed to accept NIs (e.g., procedures and technology for point-of-sale processing of NIs) and offer high quality FVs. They encourage participation by culturally diverse and locally owned and operated food retailer sites that may be the preferred shopping locations of participants and provide culturally tailored and welcoming retail environments (e.g., offer FVs preferred by participants, hire staff who speak the language(s) of the community and use signage in these language(s)). Projects work with food retailers to identify the form of NI (e.g., paper voucher, token, electronic) most appropriate for their retail setting and community. Projects may build food retailer capacity to sell FVs by connecting them to FV suppliers (including local and regional farmers, when feasible) and supporting promotional activities.
- Local farmers supply FVs to some retail food stores and at farm direct sites. Projects facilitate sales of FVs by local and culturally diverse farmers to participating food retailers and acceptance of NIs at farm direct retail sites. Some projects strengthen local FV distribution channels by requiring participating retailers to source produce locally and supporting partnerships between food retailers and local farmers.
3.2.2. Long-Term Outcomes and Ultimate Goals
- Improve community health and economic well-being. The increase in FV purchases [17,50,54] leads to greater FV intake [17,18,19,20,21], which contributes to improved health outcomes [11,22,23]. Food retailers and farmers accrue economic benefits when participants buy FVs and other SNAP eligible items [11,53,55].
- Decrease health and wealth disparities. As participant health improves, health disparities in nutrition-related conditions may decrease. With better health, they and their families are more likely to succeed at school and work, thus increasing their earning potential and narrowing wealth disparities [56,57,58]. NIs supplement participant household income, increasing economic well-being.
3.2.3. Assumptions
3.2.4. Environmental Context
3.2.5. The Future of GusNIP
4. Discussion
4.1. Lessons Learned
4.2. Strengths and Limitations
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
Step | Purpose | Process | Contributors | Timeline |
---|---|---|---|---|
TOC process development | Inform development of an evidenced-based TOC process. | Identified articles, grey literature, and example TOC models through PubMed, Google Scholar and Google searches. Reviewed retrieved materials to identify key process and model components. | Facilitators | July–Aug 2020 |
GusNIP document review | Identify and understand key components of GusNIP including goals, program requirements, and structure. Inform the development of the interview questions, workshop agendas, and the initial TOC. | Reviewed the GusNIP 2021 Request for Applications [14], the 2018 farm bill statute language pertaining to GusNIP [34], and internal GusNIP National Training, Technical Assistance, Evaluation, and Information Center (NTAE) documents including grant reporting documents. | Facilitators | Sept–Oct 2020 |
Key informant partner and practitioner interviews | Introduce TOC concept. Use backwards mapping approach to guide discussions to identify GusNIP ultimate goals, long-term and short-term outcomes, activities, assumptions, environmental context, and ways GusNIP supports and challenges equity. | Conducted virtual key informant interviews with 24 partners and practitioners representing 18 different organizations. | Facilitators NTAE Partners Practitioners | Oct–Nov 2020 |
Key informant participant interviews | Explore what facilitates and hinders nutrition incentive project participation for participants. | Conducted key informant interviews with two participants via telephone. | Facilitators NTAE Participants | Oct 2020 |
Initial TOC development | Compile document review and interview data to identify common themes to inform initial TOC development. Identify differences in perspectives to discuss with NTAE and during workshops. | Identified interview themes around ultimate goals, long-term outcomes, and short-term outcomes in pathways and developed initial TOC diagram. NTAE provided guidance regarding clarity and discrepancies. | Facilitators NTAE | Nov 2020–Jan 2021 |
Workshops | Develop common understanding of TOC among GusNIP partners and nutrition incentive practitioners; introduce the initial TOC; discuss perspectives and differences in opinions; ensure an equity lens contributes to the development of the TOC. | Conducted a series of three virtual workshops using the Zoom platform with 24 partners (agendas available in Supplementary Materials). | Facilitators NTAE Partners Practitioners | Feb 2021 |
Participant focus groups | Understand the participant perspective of how nutrition incentive programs work. Validate and identify gaps in initial TOC. | Conducted three virtual focus groups (2 English, 1 Spanish) with 17 nutrition incentive participants from three geographically diverse program sites using the Zoom platform. | Facilitators Participants | Mar–Apr 2021 |
Literature review | Review current nutrition incentive peer-reviewed and grey literature and apply to GusNIP TOC. | Identified articles from a targeted PubMed and Google Scholar search and from prior nutrition incentive literature reviews. Findings specific to the TOC were extracted. | Facilitators | Nov 2020–Aug 2021 |
Development of final draft TOC | Prepare final TOC diagram and narrative. | Prepared a final draft TOC (including a diagram, narrative, and table of activities) that incorporated learnings from the workshops, interviews, focus groups, evidence review, and input from the NTAE. | Facilitators NTAE | Feb–Sept 2021 |
Partner and practitioner review of final draft TOC | Ensure final draft TOC is clear, understandable, and accurately reflected the evidence, program structure, conversations during interviews and workshops, and partner and practitioner perspectives. | Shared final draft versions of the TOC diagram and narrative with partners and practitioners to inform final refinements for accuracy and clarity. | Partners Practitioners | Oct–Nov 2021 |
Creation of final TOC | Develop final TOC that incorporates partner and practitioner review. | Facilitators and NTAE completed the final TOC using a consensus-based decision-making process. | Facilitators NTAE | Nov–Dec 2021 |
Dissemination of TOC | Distribute final TOC to TOC contributors, GusNIP partners, and other interested in nutrition incentives. | NTAE posted TOC on Nutrition Incentive Hub website. | NTAE | 2022 |
Appendix B
Pathway | Sample Activities |
---|---|
Foundation of GusNIP supports local projects | GusNIP Grantee Organizations:
|
Participants want FV and use nutrition incentives to buy FV | GusNIP Grantee Organizations:
|
Food Retailers participate in nutrition incentive projects | GusNIP Grantee Organizations:
|
Local Farmers provide FVs for nutrition incentive projects | GusNIP Grantee Organizations:
|
References
- Wallace, T.C.; Bailey, R.L.; Blumberg, J.B.; Burton-Freeman, B.; Chen, C.-Y.O.; Crowe-White, K.M.; Drewnowski, A.; Hooshmand, S.; Johnson, E.; Lewis, R.; et al. Fruits, vegetables, and health: A comprehensive narrative, umbrella review of the science and recommendations for enhanced public policy to improve intake. Crit. Rev. Food Sci. Nutr. 2020, 60, 2174–2211. [Google Scholar] [CrossRef] [PubMed]
- Angelino, D.; Godos, J.; Ghelfi, F.; Tieri, M.; Titta, L.; Lafranconi, A.; Marventano, S.; Alonzo, E.; Gambera, A.; Sciacca, S.; et al. Fruit and vegetable consumption and health outcomes: An umbrella review of observational studies. Int. J. Food Sci. Nutr. 2019, 70, 652–667. [Google Scholar] [CrossRef] [PubMed]
- Lee, S.H.; Moore, L.V.; Park, S.; Harris, D.M.; Blanck, H.M. Adults Meeting Fruit and Vegetable Intake Recommendations—United States, 2019. MMWR. Morb. Mortal. Wkly. Rep. 2022, 71, 1–9. [Google Scholar] [CrossRef]
- Darmon, N.; Drewnowski, A. Contribution of food prices and diet cost to socioeconomic disparities in diet quality and health: A systematic review and analysis. Nutr. Rev. 2015, 73, 643–660. [Google Scholar] [CrossRef] [PubMed]
- Gearing, M.; Dixit-Joshi, S.; May, L. Barriers that Constrain the Adequacy of Supplemental Nutrition Assistance Program (SNAP) Allotments: Survey Findings. 2021. Available online: https://www.fns.usda.gov/snap/barriers-constrain-adequacy-snap-allotments (accessed on 8 July 2021).
- Cassady, D.; Jetter, K.M.; Culp, J. Is Price a Barrier to Eating More Fruits and Vegetables for Low-Income Families? J. Am. Diet. Assoc. 2007, 107, 1909–1915. [Google Scholar] [CrossRef] [PubMed]
- U.S. Department of Agriculture; U.S. Department of Health and Human Services. Dietary Guidelines for Americans, 2020–2025, 9th ed.; USDA: Washington, DC, USA, 2020. Available online: https://health.gov/our-work/nutrition-physical-activity/dietary-guidelines (accessed on 17 March 2022).
- Andreyeva, T.; Blumenthal, D.M.; Schwartz, M.B.; Long, M.W.; Brownell, K.D. Availability and Prices Of Foods Across Stores and Neighborhoods: The Case Of New Haven, Connecticut. Health Aff. 2008, 27, 1381–1388. [Google Scholar] [CrossRef] [PubMed]
- U.S. Department of Agriculture National Institute of Food and Agriculture. Gus Schumacher Nutrition Incentive Program. Available online: https://nifa.usda.gov/program/gus-schumacher-nutrition-incentive-grant-program (accessed on 26 July 2021).
- U.S. Department of Agriculture. H.R.2—Agriculture Improvement Act of 2018. House of Representatives—Agriculture. 2018. Available online: https://www.congress.gov/bill/115th-congress/house-bill/2 (accessed on 15 March 2022).
- Parks, C.A.; Stern, K.L.; Fricke, H.E.; Clausen, W.; Fox, T.A.; Yaroch, A.L. Food Insecurity Nutrition Incentive Grant Program: Implications for the 2018 Farm Bill and Future Directions. J. Acad. Nutr. Diet. 2019, 119, 395–399. [Google Scholar] [CrossRef]
- Vericker, T.; Dixit-Joshi, S.; Giesen, L.; Gearing, M.; Manglitz, C.; Baier, K.; Lee, H.; May, L. Evaluation of the implementation of Food Insecurity Nutrition Incentives (FINI): Final Report. 2021. Available online: https://www.fns.usda.gov/snap/evaluation-implementation-food-insecurity-nutrition-incentives-fini-final-report (accessed on 26 April 2022).
- Nutrition Incentive Hub. GusNIP Grantees. Available online: https://www.nutritionincentivehub.org/grantee-projects (accessed on 9 February 2022).
- U.S. Department of Agriculture. Request for Applications: The Gus Schumacher Nutrition Incentive Program. 2021. Available online: https://nifa.usda.gov/sites/default/files/rfa/FY21-GusNIP-Mand-Mod-RFA-508-F.pdf (accessed on 9 March 2022).
- Gretchen Swanson Center for Nutrition. GusNIP Communicating Impact of Federal Food Assistance Program. Available online: https://www.centerfornutrition.org/gusnip (accessed on 15 March 2022).
- Nutrition Incentive Hub. Available online: https://www.nutritionincentivehub.org (accessed on 5 March 2022).
- Engel, K.; Ruder, E.H. Fruit and Vegetable Incentive Programs for Supplemental Nutrition Assistance Program (SNAP) Participants: A Scoping Review of Program Structure. Nutrients 2020, 12, 1676. [Google Scholar] [CrossRef]
- Verghese, A.; Raber, M.; Sharma, S. Interventions targeting diet quality of Supplemental Nutrition Assistance Program (SNAP) participants: A scoping review. Prev. Med. 2019, 119, 77–86. [Google Scholar] [CrossRef]
- Olsho, L.E.W.; Klerman, J.A.; Wilde, P.; Bartlett, S. Financial incentives increase fruit and vegetable intake among Supplemental Nutrition Assistance Program participants: A randomized controlled trial of the USDA Healthy Incentives Pilot. Am. J. Clin. Nutr. 2016, 104, 423–435. [Google Scholar] [CrossRef]
- Harnack, L.; Oakes, J.M.; Elbel, B.; Beatty, T.; Rydell, S.; French, S. Effects of Subsidies and Prohibitions on Nutrition in a Food Benefit Program: A randomized clinical trial. JAMA Intern. Med. 2016, 176, 1610–1618. [Google Scholar] [CrossRef] [PubMed]
- Gans, K.M.; Risica, P.M.; Keita, A.D.; Dionne, L.; Mello, J.; Stowers, K.C.; Papandonatos, G.; Whittaker, S.; Gorham, G. Multilevel approaches to increase fruit and vegetable intake in low-income housing communities: Final results of the ‘Live Well, Viva Bien’ cluster-randomized trial. Int. J. Behav. Nutr. Phys. Act. 2018, 15, 80. [Google Scholar] [CrossRef] [PubMed]
- Choi, S.E.; Seligman, H.; Basu, S. Cost Effectiveness of Subsidizing Fruit and Vegetable Purchases Through the Supplemental Nutrition Assistance Program. Am. J. Prev. Med. 2017, 52, e147–e155. [Google Scholar] [CrossRef] [PubMed]
- Mozaffarian, D.; Liu, J.; Sy, S.; Huang, Y.; Rehm, C.; Lee, Y.; Wilde, P.; Abrahams-Gessel, S.; Jardim, T.D.S.V.; Gaziano, T.; et al. Cost-effectiveness of financial incentives and disincentives for improving food purchases and health through the US Supplemental Nutrition Assistance Program (SNAP): A microsimulation study. PLoS Med. 2018, 15, e1002661. [Google Scholar] [CrossRef]
- Center for Theory of Change. What is Theory of Change? Available online: https://www.theoryofchange.org/what-is-theory-of-change/ (accessed on 5 March 2022).
- Vogel, I. Review of the Use of ‘Theory of Change’ in International Development. 2012. Available online: https://www.betterevaluation.org/en/resources/guide/dfid_review_toc (accessed on 22 November 2021).
- Mayne, J. Theory of Change Analysis: Building Robust Theories of Change. Can. J. Program Eval. 2017, 32, 155–173. [Google Scholar] [CrossRef]
- Harries, E.; Hodgson, L.; Noble, J. Creating Your Theory of Change: NPC’s Practical Guide. 2014. Available online: https://www.thinknpc.org/wp-content/uploads/2018/07/Creating-your-theory-of-change1.pdf (accessed on 28 March 2021).
- HM Treasury. Magenta Book: Central Government Guidance on Evaluation. 2020. Available online: https://www.gov.uk/government/publications/the-magenta-book (accessed on 22 November 2021).
- Taplin, D.H.; Rasic, M. Facilitator’s Source Book: Source Book for Facilitators Leading Theory of Change Development Sessions. 2012. Available online: https://www.betterevaluation.org/en/resources/guide/facilitators_sourcebook_theory_of_change (accessed on 22 October 2020).
- Breuer, E.; Lee, L.; De Silva, M.; Lund, C. Using theory of change to design and evaluate public health interventions: A systematic review. Implement. Sci. 2016, 11, 63. [Google Scholar] [CrossRef]
- Center for Theory of Change. Glossary. Available online: https://www.theoryofchange.org/what-is-theory-of-change/how-does-theory-of-change-work/glossary/ (accessed on 28 January 2022).
- Center for Nonprofit Advancement. What is An Equity Lens? Available online: https://www.nonprofitadvancement.org/files/2020/12/What-is-an-Equity-Lens.pdfs (accessed on 9 March 2022).
- Racial Equity Tools. Available online: https://www.racialequitytools.org/resources/fundamentals/core-concepts/racial-equity (accessed on 9 March 2022).
- Legal Information Institute. 7 U.S. Code 7517—The Gus Scumacher Nutrition Incentive Program, (2018). Cornell Law School. Available online: https://www.law.cornell.edu/uscode/text/7/7517 (accessed on 28 January 2022).
- Healthy Food America. Healthy Food Pricing Incentives: A Systematic Review of Current Evidence. 2019. Available online: https://www.healthyfoodamerica.org/healthy_food_pricing_incentives_a_systematic_review_of_current_evidence (accessed on 28 January 2022).
- Shanks, C.B.; Houghtalking, B.; Nugent, N.; Fricke, H.; Szczepaniak, M.B.; Morgan, R.; Yaroch, A. Research and evaluation of nutrition incentive programs: A scoping review (Protocol). Int. J. Environ. Res. Public Health 2021, 18, 12140. [Google Scholar]
- National Institute of Food and Agriculture; Current Research Information Systems (CRIS); United States Department of Agriculture. Available online: https://portal.nifa.usda.gov/enterprise-search/project_details (accessed on 27 April 2022).
- Zoom Video Communications Inc. Zoom Media Kit. 2022. Available online: https://explore.zoom.us/en/media-kit (accessed on 16 March 2022).
- What is Transcription? How It Works: An Overview of Rev’s Transcription Process. Available online: https://www.rev.com/transcription/how-it-works (accessed on 16 March 2022).
- Vaismoradi, M.; Snelgrove, S. Theme in qualitative content analysis and thematic analysis. Forum Qual. Soc. Res. Soz. 2019, 20. [Google Scholar] [CrossRef]
- Tracy, S.J. Qualitative Quality: Eight “Big-Tent” Criteria for Excellent Qualitative Research. Qual. Inq. 2010, 16, 837–851. [Google Scholar] [CrossRef]
- Cronquist, K. Characteristics of Supplemental Nutrition Assistance Program Households: Fiscal Year 2019. Available online: https://fns-prod.azureedge.net/sites/default/files/resource-files/Characteristics2019.pdf (accessed on 9 March 2022).
- United States Census Bureau. Quick Facts. 2021. Available online: https://www.census.gov/quickfacts/fact/table/US/PST0452 (accessed on 16 March 2022).
- Cohen, A.J.; Oatmen, K.E.; Heisler, M.; Hesterman, O.B.; Murphy, E.C.; Zick, S.M.; Richardson, C.R. Facilitators and Barriers to Supplemental Nutrition Assistance Program Incentive Use: Findings from a Clinic Intervention for Low-Income Patients. Am. J. Prev. Med. 2019, 56, 571–579. [Google Scholar] [CrossRef]
- Dulin, A.; Mealy, R.; Whittaker, S.; Cardel, M.; Wang, J.; Risica, P.M.; Gans, K. Identifying Barriers to and Facilitators of Using a Mobile Fruit and Vegetable Market Intervention Delivered to Low-Income Housing Sites: A Concept Mapping Study. Health Educ. Behav. 2022, 49, 159–168. [Google Scholar] [CrossRef] [PubMed]
- Fergus, L.; Seals, K.; Holston, D. Nutrition Interventions in Low-Income Rural and Urban Retail Environments: A Systematic Review. J. Acad. Nutr. Diet. 2021, 121, 1087–1114. [Google Scholar] [CrossRef] [PubMed]
- Freedman, D.A.; Ngendahimana, D.; Shon, E.-J.; Merritt, K.; Pon, J. Predictors of Supplemental Nutrition Assistance Program Use at Farmers’ Markets with Monetary Incentive Programming. Am. J. Health Promot. 2019, 33, 1039–1048. [Google Scholar] [CrossRef] [PubMed]
- Hecht, A.A.; Misiaszek, C.; Headrick, G.; Brosius, S.; Crone, A.; Surkan, P.J. Manager Perspectives on Implementation of a Farmers’ Market Incentive Program in Maryland. J. Nutr. Educ. Behav. 2019, 51, 926–935. [Google Scholar] [CrossRef] [PubMed]
- Parks, C.A.; Stern, K.L.; Fricke, H.E.; Clausen, W.; Yaroch, A.L. Healthy Food Incentive Programs: Findings from Food Insecurity Nutrition Incentive Programs Across the United States. Health Promot. Pract. 2020, 21, 421–429. [Google Scholar] [CrossRef]
- Vericker, T.; Dixit-Joshi, S.; Taylor, J.; May, L.; Baier, K.; Williams, E.S. Impact of Food Insecurity Nutrition Incentives on Household Fruit and Vegetable Expenditures. J. Nutr. Educ. Behav. 2021, 53, 418–427. [Google Scholar] [CrossRef]
- Wolff, G.; Nelson-Hurwitz, D.; Buchthal, O. Identifying and assessing factors affecting farmers’ markets Electronic Benefit Transfer sales in Hawaií. Public Health Nutr. 2020, 23, 1618–1628. [Google Scholar] [CrossRef]
- Parks, C.; Han, P.; Fricke, H.; Parker, H.; Hesterman, O.; Yaroch, A. Reducing food insecurity and improving fruit and vegetable intake through a nutrition incentive program in Michigan, USA. SSM-Popul. Health 2021, 15, 100898. [Google Scholar] [CrossRef]
- Gus Schumacher Nutrition Incentive Program Training, Technical Assistance, Evaulation, and Information Center (GusNIP NTAE): Impact Findings Year 2. Available online: https://www.nutritionincentivehub.org/media/fjohmr2n/gusnip-ntae-impact-findings-year-2.pdf (accessed on 7 March 2022).
- Berkowitz, S.A.; Curran, N.; Hoeffler, S.; Henderson, R.; Price, A.; Ng, S.W. Association of a Fruit and Vegetable Subsidy Program with Food Purchases by Individuals with Low Income in the US. JAMA Netw. Open 2021, 4, e2120377. [Google Scholar] [CrossRef]
- Thilmany, D.; Bauman, A.; Love, E.; Jablonski, B.B.R. The Economic Contributions of Healthy Food Incentives. 2021. Available online: https://www.spur.org/sites/default/files/2021-02/economic_contributions_incentives_2_2_21.pdf (accessed on 16 March 2022).
- Farmer, J.; Babb, A.; Minard, S.; Veldman, M. Accessing Local Foods: Households Using SNAP Double Bucks and Financial Incentives at a Midwestern Farmers Market. J. Agric. Food Syst. Community Dev. 2019, 8, 153–178. [Google Scholar] [CrossRef]
- Leijten, F.R.; Heuvel, S.G.V.D.; Ybema, J.F.; Van Der Beek, A.J.; Robroek, S.J.; Burdorf, A. The influence of chronic health problems on work ability and productivity at work: A longitudinal study among older employees. Scand. J. Work. Environ. Health 2014, 40, 473–482. [Google Scholar] [CrossRef] [PubMed]
- Van Rijn, R.M.; Robroek, S.; Brouwer, S.; Burdorf, A. Influence of poor health on exit from paid employment: A systematic review. Occup. Environ. Med. 2014, 71, 295–301. [Google Scholar] [CrossRef] [PubMed]
- Baronberg, S.; Dunn, L.; Nonas, C.; Dannefer, R.; Sacks, R. The Impact of New York City’s Health Bucks Program on Electronic Benefit Transfer Spending at Farmers Markets, 2006–2009. Prev. Chronic Dis. 2013, 10, E163. [Google Scholar] [CrossRef] [PubMed]
- Lindsay, S.; Lambert, J.; Penn, T.; Hedges, S.; Ortwine, K.; Mei, A.; Delaney, T.; Wooten, W.J. Monetary Matched Incentives to Encourage the Purchase of Fresh Fruits and Vegetables at Farmers Markets in Underserved Communities. Prev. Chronic Dis. 2013, 10, E188. [Google Scholar] [CrossRef] [PubMed]
- Mann, J.; Miller, S.; O’Hara, J.; Goddeeris, L.; Pirog, R.; Trumbull, E. Healthy Food Incentive Impacts on Direct-to-Consumer Sales: A Michigan Example. J. Agric. Food Syst. Community Dev. 2018, 8, 97–112. [Google Scholar] [CrossRef]
- Oberholtzer, L.; Dimitri, C.; Schumacher, G. Linking Farmers, Healthy Foods, and Underserved Consumers: Exploring the Impact of Nutrition Incentive Programs on Farmers and Farmers’ Markets. J. Agric. Food Syst. Community Dev. 2012, 2, 63–77. [Google Scholar] [CrossRef]
- Young, C.; Aquilante, J.L.; Solomon, S.; Colby, L.; Kawinzi, M.A.; Uy, N.; Mallya, G. Improving Fruit and Vegetable Consumption Among Low-Income Customers at Farmers Markets: Philly Food Bucks, Philadelphia, Pennsylvania, 2011. Prev. Chronic Dis. 2013, 10, E166. [Google Scholar] [CrossRef]
- Bradford, V.A.; Quinn, E.L.; Walkinshaw, L.P.; Rocha, A.; Chan, N.L.; Saelens, B.E.; Johnson, D.B. Fruit and vegetable access programs and consumption in low-income communities. J. Hunger Environ. Nutr. 2019, 14, 780–795. [Google Scholar] [CrossRef]
- Garner, J.A.; Coombs, C.; Savoie-Roskos, M.R.; Durward, C.; Seguin-Fowler, R.A. A Qualitative Evaluation of Double Up Food Bucks Farmers’ Market Incentive Program Access. J. Nutr. Educ. Behav. 2020, 52, 705–712. [Google Scholar] [CrossRef]
- Godrich, S.; Kent, K.; Murray, S.; Auckland, S.; Lo, J.; Blekkenhorst, L.; Penrose, B.; Devine, A. Australian Consumer Perceptions of Regionally Grown Fruits and Vegetables: Importance, Enablers, and Barriers. Int. J. Environ. Res. Public Health 2019, 17, 63. [Google Scholar] [CrossRef]
- U.S. Department of Agriculture Food and Nutrition Service. Special Supplemental Nutrition Program for Women, Infants, and Children (WIC). Available online: https://www.fns.usda.gov/wic (accessed on 7 March 2022).
- U.S. Department of Agriculture, Agricultural Marketing Service. Specialty Crop Block Grant Program. Available online: https://www.ams.usda.gov/services/grants/scbgp (accessed on 7 March 2022).
- U.S. Department of Agriculture Food and Nutrition Service. State Guidance on Coronavirus P-EBT. Available online: https://www.fns.usda.gov/snap/state-guidance-coronavirus-pandemic-ebt-pebt (accessed on 7 March 2022).
- John, S.; Lyerly, R.; Wilde, P.; Cohen, E.D.; Lawson, E.; Nunn, A. The Case for a National SNAP Fruit and Vegetable Incentive Program. Am. J. Public Health 2021, 111, 27–29. [Google Scholar] [CrossRef] [PubMed]
- Glanz, K.; Basil, M.; Maibach, E.; Goldberg, J.; Snyder, D. Why Americans Eat What They Do: Taste, Nutrition, Cost, Convenience, and Weight Control Concerns as Influences on Food Consumption. J. Am. Diet. Assoc. 1998, 98, 1118–1126. [Google Scholar] [CrossRef]
- Baraldi, L.G.; Martinez Steele, E.; Canella, D.S.; Monteiro, C.A. Consumption of Ultra-Processed Foods and Associated Sociodemographic Factors in the USA between 2007 and 2012: Evidence from a Nationally Representative Cross-Sectional Study. BMJ Open 2018, 8, e020574. [Google Scholar] [CrossRef] [PubMed]
- Juul, F.; Parekh, N.; Martinez-Steele, E.; Monteiro, C.A.; Chang, V.W. Ultra-processed food consumption among US adults from 2001 to 2018. Am. J. Clin. Nutr. 2022, 115, 211–221. [Google Scholar] [CrossRef] [PubMed]
- Baker, P.; Machado, P.; Santos, T.; Sievert, K.; Backholer, K.; Hadjikakou, M.; Russell, C.; Huse, O.; Bell, C.; Scrinis, G.; et al. Ultra-processed foods and the nutrition transition: Global, regional and national trends, food systems transformations and political economy drivers. Obes. Rev. 2020, 21, e13126. [Google Scholar] [CrossRef]
- Monteiro, C.A.; Cannon, G.; Moubarac, J.-C.; Levy, R.B.; Louzada, M.L.C.; Jaime, P.C. The UN Decade of Nutrition, the NOVA Food Classification and the Trouble with Ultra-Processing. Public Health Nutr. 2018, 21, 5–17. [Google Scholar] [CrossRef]
- SNAP Data Tables. National Level Annual Summary: Participation and Costs, 1969–2021. Available online: https://www.fns.usda.gov/pd/supplemental-nutrition-assistance-program-snap (accessed on 23 April 2022).
- Nicholson, M.; Fair Food Network, Washington, DC, USA. Personal communication, 2022.
- Rhode Island General Assembly House Bill 7553 An Act Relating to Taxation, February 2022. Available online: https://webserver.rilegislature.gov/BillText22/HouseText22/H7553.pdf (accessed on 27 April 2022).
- Sweetened Beverage Tax Community Advisory Board City of Seattle. 2020 Annual Report: Seattle’s Sweetened Beverage Tax. Available online: https://www.seattle.gov/documents/Departments/SweetenedBeverageTaxCommAdvisoryBoard/FactSheets/2020_SBT_Annual_Report_FINAL_12.13.21.pdf (accessed on 27 April 2022).
- An, R. Nationwide expansion of a financial incentive program on fruit and vegetable purchases among Supplemental Nutrition Assistance Program participants: A cost-effectiveness analysis. Soc. Sci. Med. 2015, 147, 80–88. [Google Scholar] [CrossRef]
- U.S. Bureau of Labor Statistics. Labor Force Statistics from the Current Population Survey. Available online: https://www.bls.gov/cps/cpsaat18.htm (accessed on 27 April 2022).
- Singleton, C.R.; Winata, F.; Roehll, A.M.; Adamu, I.; McLoughlin, G.M. Community-Level Factors Associated with Geographic Access to Food Retailers Offering Nutrition Incentives in Chicago, Illinois. Prev. Chronic Dis. 2022, 19, E07. [Google Scholar] [CrossRef]
- Center for Sciencein the Public Interest. Recommendations for a Healthy Eating SNAP Pilot in Massachusetts. 2020. Available online: https://www.cspinet.org/sites/default/files/MA_Healthy_SNAP_Final_Report.pdf (accessed on 26 April 2022).
- Ramos, C.; Johnson, J.; Sandalow, M. Recommendations for a Healthy Eating SNAP Pilot in North Carolina. Center for Science in the Public Interest. 2021. Available online: https://www.cspinet.org/sites/default/files/NC%20Convening%20Report-%20Final-%20June%202021.pdf (accessed on 26 April 2022).
- Vericker, T.; Dixit-Joshi, S.; Taylor, J.; Giesen, L.; Gearing, M.; Baier, K.; Lee, H.; Trundle, K.; Manglitz, C.; May, L. The Evaluation of Food Insecurity Nutrition Incentives (FINI): Interim Report. 2019. Available online: https://www.fns.usda.gov/snap/evaluation-food-insecurity-nutrition-incentives-interim-report (accessed on 26 April 2022).
- John, S.; Rivera, G.; Cash, S.; Economos, C.; Rimm, E.; Wilde, P. Digital Promotions Campaign Increases SNAP Participation at New England Farmers’ Markets: A Randomized Controlled Trial. Curr. Dev. Nutr. 2021, 5 (Suppl. S2), 141. [Google Scholar] [CrossRef]
- Pew Resesarch Center. Social Media Fact Sheet. Available online: https://www.pewresearch.org/internet/fact-sheet/social-media/ (accessed on 27 April 2022).
- Pew Research Center. Mobile Fact Sheet. Available online: https://www.pewresearch.org/internet/fact-sheet/mobile/ (accessed on 27 April 2022).
- Lam, S.; Dodd, W.; Wyngaarden, S.; Skinner, K.; Papadopoulos, A.; Harper, S.L. How and why are Theory of Change and Realist Evaluation used in food security contexts? A scoping review. Eval. Program Plan. 2021, 89, 102008. [Google Scholar] [CrossRef]
- Levay, A.V.; Chapman, G.E.; Seed, B.; Wittman, H. District-level implementation of British Columbia’s school food and beverage sales policy: A realist evaluation exploring intervention mechanisms in urban and rural contexts. Can. J. Public Health 2018, 110, 21–30. [Google Scholar] [CrossRef] [PubMed]
- Global Agriculture and Food Security Program (GAFSP). Monitoring and Evaluation. Available online: https://www.gafspfund.org/monitoring-and-evaluation (accessed on 27 April 2022).
- Scaling Up Nutrition. Theory of Change. Available online: https://scalingupnutrition.org/progress-impact/monitoring-evaluation-accountability-learning-meal/theory-of-change/ (accessed on 27 April 2022).
- Aid Stream. Theory of Change: Achieving SRHR through Strengthened Health Systems. Available online: https://aidstream.org/files/documents/Annex_1_Theory_of_Change-20160425090450.pdf (accessed on 27 April 2022).
- Maini, R.; Mounier-Jack, S.; Borghi, J. How to and how not to develop a theory of change to evaluate a complex intervention: Reflections on an experience in the Democratic Republic of Congo. BMJ Glob. Health 2018, 3, e000617. [Google Scholar] [CrossRef] [PubMed]
- Mensch, L.; Souza, K. An Introduction to Incorporating Diversity, Equity, and Inclusion into Nutrition Incentive Program Research and Evaluation. 2021. Available online: https://www.nutritionincentivehub.org/media/rliah2qb/mensch_souza_msu-crfs_dei-in-ni-research-and-evaluation_2021-02.pdf (accessed on 9 March 2022).
- Gusto, C.; Diaz, J.M.; Warner, L.A.; Monaghan, P. Advancing ideas for farmers market incentives: Barriers, strategies, and agency perceptions from market managers. J. Agric. Food Syst. Community Dev. 2020, 9, 245–260. [Google Scholar] [CrossRef]
- Hamilton, D.L.; Walkinshaw, L.P.; Quinn, E.L.; Johnson, D.B. Increasing farmers market access among low-income shoppers in Washington state: Understanding the role of peer-to-peer programs. J. Hunger Environ. Nutr. 2020, 15, 80–92. [Google Scholar] [CrossRef]
- Walkinshaw, L.P.; Quinn, E.L.; Rocha, A.; Johnson, D.B. An Evaluation of Washington State SNAP-Ed Farmers’ Market Initiatives and SNAP Participant Behaviors. J. Nutr. Educ. Behav. 2018, 50, 536–546. [Google Scholar] [CrossRef]
- Bowling, A.B.; Moretti, M.; Ringelheim, K.; Tran, A.; Davison, K. Healthy Foods, Healthy Families: Combining incentives and exposure interventions at urban farmers’ markets to improve nutrition among recipients of US federal food assistance. Health Promot. Perspect. 2016, 6, 10–16. [Google Scholar] [CrossRef]
- Wetherill, M.S.; Williams, M.; Gray, K.A. SNAP-Based Incentive Programs at Farmers’ Markets: Adaptation Considerations for Temporary Assistance for Needy Families (TANF) Recipients. J. Nutr. Educ. Behav. 2017, 49, 743–751.e1. [Google Scholar] [CrossRef]
- Gaddis, J.; Coplen, A.; Clark-Barol, M.; Martin, A.; Barrett, C.; Lubowicki, L. Incorporating local foods into low-income families’ home-cooking practices: The critical role of sustained economic subsidies. J. Agric. Food Syst. Community Dev. 2020, 10, 117–132. [Google Scholar] [CrossRef]
Type of Contributor (n) | Role | Interviewees a n = 26 | Workshop Attendees b n = 25 | Focus Group Participants c n = 17 |
---|---|---|---|---|
Gus Schumacher Nutrition Incentive Program (GusNIP) Training, Technical Assistance, Evaluation, and Information Center (NTAE) (4) | Collaborated with facilitators to develop the TOC. Brought partners and practitioners to the TOC process. Contributed deep knowledge about the history of GusNIP, how the program works, and the operation of the NTAE and Nutrition Incentive Hub. | 1 | 4 | 0 |
Partners (20) | Nutrition Incentive Hub partners and additional expert advisors from agriculture, food retail, academic, anti-hunger, and nutrition sectors. Brought expertise in nutrition incentive project impacts and best practices. | 14 | 13 | 0 |
Practitioners (9) | GusNIP and other nutrition incentive project practitioners with experience in project implementation. Brought extensive knowledge about how nutrition incentive projects work. | 9 | 8 | 0 |
Participants (19) | Community members who have utilized nutrition incentives. Brought lived experience of using nutrition incentives. | 2 | 0 | 17 |
Element | Definition |
---|---|
Activities | What a program does on a day-to-day basis to bring about outcomes. Activities are under the program’s control [27,31]. |
Assumptions | External conditions and resources that are needed for program success. Assumptions already exist, are not expected to be problematic, and are not within a program’s control. If the assumptions are not present, the program may not succeed, or unintended consequences may occur [31]. |
Pathways | Evidence- or experience-based logical and sequential connections between activities and shorter-term and longer-term outcomes [26,31]. |
Environmental context | The broader context in which the program operates. Includes community, cultural, structural, legislative, social, economic, environmental, and political forces that may shape the program. The program cannot control the environmental context [28]. |
Long-Term Outcomes | What a program wants to achieve—the purpose of the program [31]. |
Short-Term Outcomes | “A state or condition that must exist” [31] for the program to achieve the long-term outcomes. An outcome represents a change in knowledge, skills, attitudes, and behaviors in people or changes in processes or systems of an organization [27,31]. |
Ultimate Goal(s) | The visionary “big picture” change the program contributes to but is beyond what the program can achieve on its own [31]. |
Theory of Change (TOC) | A living, theoretical model that explains how and why change is expected to happen. A TOC is visually represented in a TOC diagram and described in an accompanying narrative. It is developed through a participatory process that includes multiple and diverse perspectives [26,31]. |
Pathway | Assumptions |
---|---|
Foundation of GusNIP supports local projects |
|
Participants want fruits and vegetables and use nutrition incentives to buy them |
|
Food retailers participate in projects |
|
Local farmers provide fruits and vegetables to projects |
|
Participant Experience | |
---|---|
Challenges | Solutions |
Nutrition incentives (NIs) only reach a small portion of people participating in the Supplemental Nutrition Assistance Program (SNAP). | Expand program funding so everyone who participates in SNAP can receive NIs. |
People with low incomes who are ineligible for SNAP cannot receive NIs. | Expand program eligibility beyond SNAP income eligibility threshold. |
The amount of NIs provided is not adequate for all participants to meet U.S. Dietary Guidelines for Americans fruit and vegetable (FV) recommendations. | Provide a minimum monthly benefit and/or eliminate the participant match needed to earn NIs. |
NIs are limited to FVs and do not address the full dietary needs of all participants. | Allow purchases of other healthy foods with NIs in addition to FVs. |
Some participants cannot access participating food retailers due to transportation challenges and hours of operation. | Identify and recruit retailers that are easy for participants to access. |
Some participants do not feel welcomed at participating food retailers. | Increase participation by culturally diverse retailers and farmers and provide trainings to all retailers on creating welcoming, culturally tailored environments. |
Program design and implementation | |
Challenges | Solutions |
Not all people using SNAP who are eligible to receive NIs know about them. | Engage community to identify and implement effective NI promotion and outreach strategies. |
Food retailers (particularly smaller retailers) lack appropriate technology for issuing and redeeming NIs, including point-of-sale systems and electronic benefits transfer equipment. | Support implementation of effective issuance and redemption processes and technologies that meet food retailer and participant needs (e.g., point of sale technology that decreases burden on food retailer and decreases stigma for participants at point of sale). |
The process for an organization to apply for GusNIP funding is challenging, especially for lower-resourced organizations. | Provide support and technical assistance to new and lower-resourced applicants. |
The administrative burden of program management, including local funds to meet federal grant match requirements, can be challenging, especially for new and lower-resourced projects. | Address funding needs and capacities of organizations (especially minority-led or under-resourced organizations) for project administration, meeting local match requirements, capacity building, and evaluation. |
Local projects may not fully understand or meet the needs of the community served. | Expand community member role in project design and implementation and compensate them for their involvement. |
Interested partners (e.g., food retailer, food security, nutrition, local/regional food system sectors) are siloed. | Foster communication and partnership across interested partners. |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Leng, K.H.; Yaroch, A.L.; Nugent, N.B.; Stotz, S.A.; Krieger, J. How Does the Gus Schumacher Nutrition Incentive Program Work? A Theory of Change. Nutrients 2022, 14, 2018. https://doi.org/10.3390/nu14102018
Leng KH, Yaroch AL, Nugent NB, Stotz SA, Krieger J. How Does the Gus Schumacher Nutrition Incentive Program Work? A Theory of Change. Nutrients. 2022; 14(10):2018. https://doi.org/10.3390/nu14102018
Chicago/Turabian StyleLeng, Kirsten H., Amy L. Yaroch, Nadine Budd Nugent, Sarah A. Stotz, and James Krieger. 2022. "How Does the Gus Schumacher Nutrition Incentive Program Work? A Theory of Change" Nutrients 14, no. 10: 2018. https://doi.org/10.3390/nu14102018
APA StyleLeng, K. H., Yaroch, A. L., Nugent, N. B., Stotz, S. A., & Krieger, J. (2022). How Does the Gus Schumacher Nutrition Incentive Program Work? A Theory of Change. Nutrients, 14(10), 2018. https://doi.org/10.3390/nu14102018