A Practical Framework for Academics to Implement Public Engagement Interventions and Measure Their Impact
Abstract
:1. Introduction
2. Development of the Framework
3. Framework for Public Engagement Interventions
3.1. Planning and Design Phase
Public Engagement Model Canvas
3.2. Implementation Phase
3.3. Immediate Impact Assessment Phase
3.4. Medium- and Long-Term Impact Assessment Phase
3.5. Critical Issues and Limitations
4. Real-World Example: Debunker—A Public Engagement Intervention to Foster Critical Thinking and Scientific Literacy in Italian Youth
4.1. Planning and Design Phase
4.2. Underpinning Research and Main Aim of Debunker
4.3. Public Engagement Model Canvas
4.3.1. Implementation Phase
4.3.2. Immediate Impact Assessment Phase
4.3.3. Medium- and Long-Term Impact Assessment Phase
4.4. Expected Challenges during the Implementation of Debunker
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Bortagaray, I. Bridging university and society in Uruguay: Perceptions and expectations. Sci. Public Policy 2009, 36, 115–119. [Google Scholar] [CrossRef]
- Compagnucci, L.; Spigarelli, F. The Third Mission of the university: A systematic literature review on potentials and constraints. Technol. Forecast Soc. Chang. 2020, 161, 120284. [Google Scholar] [CrossRef]
- Coelho, M.; Menezes, I. University Social Responsibility, Service Learning, and Students’ Personal, Professional, and Civic Education. Front. Psychol. 2021, 12, 617300. [Google Scholar] [CrossRef] [PubMed]
- Kagan, C.; Diamond, J. From Knowledge Transfer to Public Engagement. University-Community Relations in the UK: Engaging Universities. Rethinking University-Community Policy Connections; Palgrave Macmillan: London, UK, 2019. [Google Scholar]
- Molas-Gallart, J.; Salter, A.; Patel, P.; Scott, A.; Duran, X. Measuring Third Stream Activities. Final Report to the Russell Group of Universities. Science and Technology Policy Research (SPRU); University of Sussex: Brighton, UK, 2002. [Google Scholar]
- Utah State University, Extension. The Purpose and Benefit of Land-grant (Extension) Universities. Available online: https://extension.usu.edu/news/purpose-and-benefit-of-land-grant-extension-universities (accessed on 3 October 2022).
- Land-Grant Impacts. We Are Extension. Improving Lives Through Practical, Research—Based Information. Available online: https://landgrantimpacts.org/extension-2/ (accessed on 3 October 2022).
- University of Verona. Diffusioni. L’università Incontra la Città. Available online: https://www.univr.it/en/diffusioni (accessed on 14 September 2022).
- University of Oxford, Torch, The Oxford Research Centre in the Humanities. Podcasting for Public Engagement: An online tutorial. Available online: https://www.torch.ox.ac.uk/article/podcasting-for-public-engagement-an-online-tutorial (accessed on 14 September 2022).
- King’s College London. Public Engagement in the Digital Environment. Available online: https://www.kcl.ac.uk/research/public-engagement-in-the-digital-environment (accessed on 14 September 2022).
- European Commission. European Researchers’ Night 2022–2023. Available online: https://ec.europa.eu/info/funding-tenders/opportunities/portal/screen/opportunities/topic-details/horizon-msca-2022-citizens-01-01;callCode=null;freeTextSearchKeyword=;matchWholeText=true;typeCodes=1,0;statusCodes=31094501,31094502,31094503;programmePeriod=2021%20-%202027;programCcm2Id=43108390;programDivisionCode=43108473;focusAreaCode=null;destination=null;mission=null;geographicalZonesCode=null;programmeDivisionProspect=null;startDateLte=null;startDateGte=null;crossCuttingPriorityCode=null;cpvCode=null;performanceOfDelivery=null;sortQuery=sortStatus;orderBy=asc;onlyTenders=false;topicListKey=topicSearchTablePageState (accessed on 14 September 2022).
- University of Milan. Bookcity alla Statale. Available online: https://bookcity.unimi.it (accessed on 14 September 2022).
- Boston Area Girls STEM Collaborative. Working Together to Increase Girls’ Participation in STEM. Available online: http://www.bostongirlsstem.org (accessed on 14 September 2022).
- Cian, H.; Dou, R.; Castro, S.; Palma-D’souza, E.; Martinez, A. Facilitating marginalized youths’ identification with STEM through everyday science talk. The critical role of parental caregivers. Sci. Educ. 2022, 106, 57–87. [Google Scholar] [CrossRef]
- Stanford University, Cantor Arts Center. Family Programs. Available online: https://museum.stanford.edu/programs/family-programs (accessed on 14 September 2022).
- University of Arkansas. Kids’ University. Available online: https://www.uamont.edu/about/kids-university.html (accessed on 14 September 2022).
- McClain, L.R.; Chiu, Y.C.; Zimmerman, H.T. Place-based learning processes in a family science workshop: Discussion prompts supporting families sensemaking and rural science connections using a community water model. Sci. Educ. 2022, 106, 645–673. [Google Scholar] [CrossRef]
- Busch, I.M.; Rimondini, M. Empowering Patients and Supporting Health Care Providers-New Avenues for High Quality Care and Safety. Int. J. Environ. Res. Public Health 2021, 18, 9438. [Google Scholar] [CrossRef]
- European Health Parliament: Patient Empowerment and Centeredness. Available online: https://www.healthparliament.eu/wp-content/uploads/2017/09/EHP-papers_Patients-empowerment.pdf (accessed on 14 September 2022).
- Náfrádi, L.; Nakamoto, K.; Schulz, P.J. Is patient empowerment the key to promote adherence? A systematic review of the relationship between self- efficacy, health locus of control and medication adherence. PLoS ONE 2017, 12, e0186458. [Google Scholar] [CrossRef] [Green Version]
- Rimondini, M.; Busch, I.M.; Mazzi, M.A.; Donisi, V.; Poli, A.; Bovolenta, E.; Moretti, F. Patient empowerment in risk management: A mixed-method study to explore mental health professionals’ perspective. BMC Health Serv. Res. 2019, 19, 382. [Google Scholar] [CrossRef] [Green Version]
- Busch, I.M.; Saxena, A.; Wu, A.W. Putting the Patient in Patient Safety Investigations: Barriers and Strategies for Involvement. J. Patient Saf. 2021, 17, 358–362. [Google Scholar] [CrossRef]
- Imperial College London. Our Strategy for Engaging with Society. Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/Societal-Engagement-Brochure_WEB2.pdf (accessed on 14 September 2022).
- Loignon, C.; Dupéré, S.; Leblanc, C.; Truchon, K.; Bouchard, A.; Arsenault, J.; Carvalho, J.P.; Boudreault-Fournier, A.; Marcotte, S.A. Equity and inclusivity in research: Co-creation of a digital platform with representatives of marginalized populations to enhance the involvement in research of people with limited literacy skills. Res. Involv. Engagem. 2021, 7, 70. [Google Scholar] [CrossRef]
- Johns Hopkins Center for Health Equity. Community Engagement. Available online: https://www.jhsph.edu/research/centers-and-institutes/johns-hopkins-center-for-health-equity/what-we-do/community-engagement/ (accessed on 14 September 2022).
- Brown, T.; Watt, J. Design Thinking for Social Innovation. Stanford Social Innovation Review. 2010. Available online: https://ssir.org/articles/entry/design_thinking_for_social_innovation# (accessed on 14 September 2022).
- Interaction Design Foundation. Design Thinking. Available online: https://www.interaction-design.org/literature/topics/design-thinking (accessed on 14 September 2022).
- Liedtka, J.; MacLaren, E. How Children’s Health System of Texas is Improving Care with Design Thinking. Harvard Business Review. 7 November 2018. Available online: https://hbr.org/2018/11/how-childrens-health-system-of-texas-is-improving-care-with-design-thinking (accessed on 14 June 2022).
- IDEO Design Thinking. The Field Guide to Human-Centered Design. 2015. Available online: https://www.designkit.org/resources/1 (accessed on 14 September 2022).
- Koos Service Design. The Difference between Design Thinking and Service Design. Available online: https://www.koosservicedesign.com/blog/difference-between-design-thinking-service-design/ (accessed on 14 September 2022).
- Designing Buildings, The Construction Wiki. Needs Analysis for Construction Projects. Available online: https://www.designingbuildings.co.uk/wiki/Needs_analysis_for_construction_projects (accessed on 3 October 2022).
- MindTools. PEST Analysis. Available online: https://www.mindtools.com/pages/article/newTMC_09.htm (accessed on 3 October 2022).
- Investopedia. SWOT Analysis: How to with Table and Example. Available online: https://www.investopedia.com/terms/s/swot.asp (accessed on 3 October 2022).
- Project Management Research Institute. Alternatives Analysis. Available online: https://pmri.in/dictionary/alternatives-analysis/ (accessed on 3 October 2022).
- The Business Professor. Analysis of Alternatives—Explained. Available online: https://thebusinessprofessor.com/en_US/management-leadership-organizational-behavior/analysis-of-alternatives-definition (accessed on 3 October 2022).
- Imperial College London. Societal Engagement. Available online: https://www.imperial.ac.uk/be-inspired/societal-engagement/ (accessed on 14 September 2022).
- Center for Disease Control. Creating an Effective Dissemination Plan. Available online: https://www.cdc.gov/dhdsp/pubs/docs/cb_oct2015.pdf (accessed on 14 September 2022).
- Involve. People & Participation. How to Put Citizens at the Heart of Decision-Making. Available online: https://www.involve.org.uk/resources/publications/practical-guidance/people-and-participation-how-put-citizens-heart-decision (accessed on 14 September 2022).
- NIHR Imperial BRC Patient Experience Research Centre. A Rough Guide to Public Involvement. Available online: https://www.imperial.ac.uk/media/imperial-college/medicine/perc/PERCs-Rough-Guide-to-Public-Involvement---Dec-2021.pdf (accessed on 14 September 2022).
- University of Reading. Ten Challenges and Barriers to Public Engagement and Citizen Science. Available online: https://research.reading.ac.uk/openupsci/2019/01/16/challenges-and-barriers-to-public-engagement-and-citizen-science/ (accessed on 14 September 2022).
- University of Verona. Public Engagement. Available online: https://www.univr.it/en/our-services/-/servizi/public-engagement (accessed on 14 September 2022).
- University of York. Centre for Future Health. Public Engagement. Available online: https://www.york.ac.uk/future-health/engagement/ (accessed on 14 September 2022).
- UCL Institute of Health Informatics. Patient and Public Engagement. Available online: https://www.ucl.ac.uk/health-informatics/patient-and-public-engagement (accessed on 14 September 2022).
- University of Liverpool. Faculty of Health and Life Sciences. Public Engagement. Available online: https://www.liverpool.ac.uk/health-and-life-sciences/engage-with-us/public-engagement/ (accessed on 14 September 2022).
- Università degli Studi di Milano La Statale. Public Engagement. Available online: https://www.unimi.it/en/third-mission/social-responsibility/public-engagement (accessed on 14 September 2022).
- University of Vienna. Third Mission Activities of the University of Vienna. Available online: https://thirdmission.univie.ac.at/en/third-mission-activities/ (accessed on 14 September 2022).
- University of Cambridge. Public Engagement. Available online: https://www.cam.ac.uk/public-engagement/what-is-public-engagement (accessed on 14 September 2022).
- Arts Council England. Inspiring Learning for All. Available online: https://www.artscouncil.org.uk/advice-and-guidance/inspiring-learning-all-home-page/learn-how-collect-evidence#section-3 (accessed on 14 September 2022).
- Department for Constitutional Affairs. Justice, Rights and Democracy. UK. Making a Difference: A Guide to Evaluating Public Participation in Central Government. Written by Diane Warburton (Shared Practice/Involve) with Richard Wilson (Involve) and Elspeth Rainbow (Department for Constitutional Affairs). Available online: https://www.involve.org.uk/sites/default/files/uploads/Making-a-Difference-.pdf (accessed on 14 September 2022).
- Agenzia Nazionale di Valutazione del Sistema Universitario e della Ricerca. Terza Missione/Impatto. Terza Missione e Impatto Sociale di Atenei ed Enti di Ricerca. Available online: https://www.anvur.it/attivita/temi/ (accessed on 14 September 2022).
- REF Impact Case Studies Databank. Available online: https://impact.ref.ac.uk/casestudies/ (accessed on 14 September 2022).
- Maxwell, J.A. Qualitative Research Design. An Interactive Approach. In The SAGE Handbook of Applied Social Research, 2nd ed.; Bickman, L., Rog, D.J., Eds.; SAGE Publications Inc.: Thousand Oaks, CA, USA, 2013; pp. 214–253. [Google Scholar]
- Regoniel, P.A. Conceptual Framework: A Step-by-Step Guide on How to Make One. In Simply Educate Me. 2015. Available online: https://simplyeducate.me/2015/01/05/conceptual-framework-guide/ (accessed on 14 September 2022).
- Imperial College London. How Do I Evaluate My Public Engagement Activity? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-evaluate-my-public-engagement-activity.pdf (accessed on 14 September 2022).
- Imperial College London. How Do I Plan a Public Engagement Activity? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-plan-a-public-engagement-activity.pdf (accessed on 14 September 2022).
- Imperial College London. How Do I Champion Equality, Diversity and Inclusion in Public Engagement? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-champion-EDI-in-public-engagement.pdf (accessed on 14 September 2022).
- Reed, M.S. The Research Impact Handbook, 2nd ed.; Fast Track Impact: Aberdeenshire, UK, 2018. [Google Scholar]
- Vitae. Realizing the Potential of Researchers. Research Project Stakeholders. Available online: https://www.vitae.ac.uk/doing-research/leadership-development-for-principal-investigators-pis/leading-a-research-project/applying-for-research-funding/research-project-stakeholders (accessed on 14 September 2022).
- Imperial College London. How Do I Get People Involved in My Engagement Activity? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-get-people-involved-in-my-engagement-activity.pdf (accessed on 14 September 2022).
- Arts Council England. Learn How to Collect Evidence. Your Research Methods—Ethics. Available online: https://www.artscouncil.org.uk/advice-and-guidance/inspiring-learning-all-home-page/learn-how-collect-evidence#section-6 (accessed on 14 September 2022).
- Arts Council England. Inspiring Learning for All—Detailed Checklist Section 2: Places: Creating Inspiring and Accessible Learning Environments. Available online: https://www.artscouncil.org.uk/sites/default/files/S2D4_Detailed_Checklist_Places.docx (accessed on 14 September 2022).
- Imperial College London. How Do I Choose an Audience to Engage with? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-choose-an-audience-to-engage-with.pdf (accessed on 14 September 2022).
- Imperial College London. How Do I Fund My Public Engagement Activity? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-fund-my-public-engagement-activity.pdf (accessed on 14 September 2022).
- Sprout Social. How Do Mine Your Social Media Data for a Better ROI. Available online: https://sproutsocial.com/insights/social-media-data/ (accessed on 14 September 2022).
- Arts Council England. Inspiring Learning for All. Generic Learning Outcomes. Available online: https://www.artscouncil.org.uk/measuring-outcomes/generic-learning-outcomes#section-1 (accessed on 14 September 2022).
- Duke University. Social Impact: Definition and Why Is Social Impact Important? Available online: https://careerhub.students.duke.edu/blog/2021/09/03/social-impact-definition-and-why-is-social-impact-important/ (accessed on 14 September 2022).
- Imperial College London. How Do I Share My Societal Engagement Activities? Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/How-do-I-share-my-societal-engagement-activities.pdf (accessed on 14 September 2022).
- Fast Track Impact. What Is Impact? Available online: https://www.fasttrackimpact.com/what-is-impact-subpage (accessed on 14 September 2022).
- Sinkovics, N.; Sinkovics, R.R.; Yamin, M. The role of social value creation in business model formulation at the bottom of the pyramid—Implications for MNEs? Int. Bus. Rev. 2014, 23, 692–707. [Google Scholar] [CrossRef]
- Reichard, B.; Reed, M.S.; Chubb, J.; Hall, G.; Jowett, L.; Peart, A.; Whittle, A. Writing impact case studies: A comparative study of high-scoring and low-scoring case studies from REF2014. Palgrave Commun. 2020, 6, 31. [Google Scholar] [CrossRef] [Green Version]
- Dutta, B.; Peng, M.-H.; Chen, C.-C.; Sun, S.-L. Role of Infodemics on Social Media in the Development of People’s Readiness to Follow COVID-19 Preventive Measures. Int. J. Environ. Res. Public Health 2022, 19, 1347. [Google Scholar] [CrossRef] [PubMed]
- Lawrence, J.M.; Meyerowitz-Katz, G.; Heathers, J.A.J.; Brown, N.J.L.; Sheldrick, K.A. The lesson of ivermectin: Meta-analyses based on summary data alone are inherently unreliable. Nat. Med. 2021, 27, 1853–1854. [Google Scholar] [CrossRef]
- Chen, X.; Lee, W.; Lin, F. Infodemic, Institutional Trust, and COVID-19 Vaccine Hesitancy: A Cross-National Survey. Int. J. Environ. Res. Public Health 2022, 19, 8033. [Google Scholar] [CrossRef]
- Lo Moro, G.; Scaioli, G.; Bert, F.; Zacchero, A.L.; Minutiello, E.; Siliquini, R. Exploring the Relationship between COVID-19 Vaccine Refusal and Belief in Fake News and Conspiracy Theories: A Nationwide Cross-Sectional Study in Italy. Int. J. Environ. Res. Public Health 2022, 19, 9350. [Google Scholar] [CrossRef]
- The Lancet Infectious Diseases. The COVID-19 infodemic. Lancet Infect. Dis. 2020, 20, 875. [Google Scholar] [CrossRef]
- Ball, P.; Maxmen, A. The epic battle against coronavirus misinformation and conspiracy theories. Nature 2020, 581, 371–374. [Google Scholar] [CrossRef]
- Harper, L.; Herbst, K.W.; Bagli, D.; Kaefer, M.; Beckers, G.M.A.; Fossum, M.; Kalfa, N.; ESPU research committee. The battle between fake news and science. J. Pediatr. Urol. 2020, 16, 114–115. [Google Scholar] [CrossRef]
- Liu, D.W. Science denial and the science classroom. CBE Life Sci. Educ. 2012, 11, 129–134. [Google Scholar] [CrossRef]
- McLintic, A. The motivations behind science denial. N. Z. Med. J. 2019, 132, 88–94. [Google Scholar] [PubMed]
- Van der Linden, S. Countering science denial. Nat. Hum. Behav. 2019, 3, 889–890. [Google Scholar] [CrossRef] [PubMed]
- Guidotti, T.L. Between distrust of science and scientism. Arch. Environ. Occup. Health 2017, 72, 247–248. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Latkin, C.A.; Dayton, L.; Strickland, J.C.; Colon, B.; Rimal, R.; Boodram, B. An Assessment of the Rapid Decline of Trust in US Sources of Public Information about COVID-19. J. Health Commun. 2020, 25, 764–773. [Google Scholar] [CrossRef]
- Menczer, F.; Hills, T. Information Overload Helps Fake News Spread, and Social Media Knows it. Scientific American. 1 December 2020. Available online: https://www.scientificamerican.com/article/information-overload-helps-fake-news-spread-and-social-media-knows-it/ (accessed on 14 September 2022).
- Richards, D.; Caldwell, P.H.; Go, H. Impact of social media on the health of children and young people. J. Paediatr. Child Health 2015, 51, 1152–1157. [Google Scholar] [CrossRef]
- Swart, J. Tactics of news literacy: How young people access, evaluate, and engage with news on social media. New Med. Soc. 2021, 14614448211011447. [Google Scholar] [CrossRef]
- The Wall Street Journal. The Facebook Files. A Wall Street Journal Investigation. Available online: https://www.wsj.com/articles/the-facebook-files-11631713039 (accessed on 14 September 2022).
- The Washington Post. The Education of Frances Haugen: How the Facebook Whistleblower Learned to Use Data as a Weapon from Years in Tech. Available online: https://www.washingtonpost.com/technology/2021/10/11/facebook-whistleblower-frances-haugen/ (accessed on 14 September 2022).
- The challenge of the post-truth era. Nat. Cell. Biol. 2018, 20, 1231. [CrossRef]
- Imperial College London. Creating Podcasts and Videos. Available online: https://www.imperial.ac.uk/media/imperial-college/be-inspired/societal-engagement/public/Creating-podcasts-and-videos-for-the-web.pdf (accessed on 14 September 2022).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Busch, I.M.; Savazzi, S.; Bertini, G.; Cesari, P.; Guaraldo, O.; Nosè, M.; Barbui, C.; Rimondini, M. A Practical Framework for Academics to Implement Public Engagement Interventions and Measure Their Impact. Int. J. Environ. Res. Public Health 2022, 19, 13357. https://doi.org/10.3390/ijerph192013357
Busch IM, Savazzi S, Bertini G, Cesari P, Guaraldo O, Nosè M, Barbui C, Rimondini M. A Practical Framework for Academics to Implement Public Engagement Interventions and Measure Their Impact. International Journal of Environmental Research and Public Health. 2022; 19(20):13357. https://doi.org/10.3390/ijerph192013357
Chicago/Turabian StyleBusch, Isolde Martina, Silvia Savazzi, Giuseppe Bertini, Paola Cesari, Olivia Guaraldo, Michela Nosè, Corrado Barbui, and Michela Rimondini. 2022. "A Practical Framework for Academics to Implement Public Engagement Interventions and Measure Their Impact" International Journal of Environmental Research and Public Health 19, no. 20: 13357. https://doi.org/10.3390/ijerph192013357
APA StyleBusch, I. M., Savazzi, S., Bertini, G., Cesari, P., Guaraldo, O., Nosè, M., Barbui, C., & Rimondini, M. (2022). A Practical Framework for Academics to Implement Public Engagement Interventions and Measure Their Impact. International Journal of Environmental Research and Public Health, 19(20), 13357. https://doi.org/10.3390/ijerph192013357