Design Thinking Approach to Create Impact Assessment Tool: Cities2030 Case Study
Abstract
:1. Introduction
2. Background of Case Study and Methodology
2.1. Theoretical Research and Strategy Development
- Managing research in scientific databases to explore literature about impact and effectiveness;
- Gathering all relevant information about impact from the project proposal;
- Analyzing impact indicators from strategic documents mentioned in the project proposal;
- Creating measurement lists and their application;
- Describing strategy verification methodology;
- Creating conclusions and suggestions for future research.
2.1.1. Literature Review and Strategic Document Analysis
- Stage 1: An initial search yielded over 1,029,401 sources by filtering for terms such as “impact” and “effectiveness” in article titles and keywords.
- Stage 2: Relevant sources were selected based on their full-text availability, narrowing the selection to 175 publications.
- Stage 3: Duplicates were removed, and further refinement resulted in 133 unique sources which formed the basis of the analysis.
- Stage 4: The final stage focused on categorizing and analyzing the literature, identifying key criteria and models that would be used to build the impact assessment framework.
2.1.2. Project Impact Action Strategy (PIAS)
2.2. Data Collection Methods
- Focus Groups: Focus groups were chosen to capture the collective insights and group dynamics among stakeholders, following the approach outlined by Krueger and Casey (2015) [37]. This method allowed participants to discuss priorities, challenges, and opportunities, providing a nuanced understanding of the diverse viewpoints within the Cities2030 project. The use of focus groups was essential for identifying key stakeholder needs and aligning them with the objectives of the impact assessment tool.
- Design Thinking Workshops: Design thinking workshops were used to facilitate collaborative problem-solving and co-creation. The workshops included diverse stakeholders such as policymakers, urban planners, community representatives, and food system experts, ensuring that the criteria for the impact assessment tool were co-developed and refined to address the practical challenges faced by urban food systems. This iterative, human-centered approach, following the principles outlined by Brown (2009), was critical for creating a tool that is flexible and responsive to real-world conditions [21].
- Document Analysis: A systematic document analysis of project-related materials and strategic documents, including those aligned with the European Green Deal and Farm to Fork Strategy [7], was conducted. This analysis ensured that the framework was grounded in broader policy objectives and that the assessment tool aligned with high-level sustainability strategies. By cross-referencing the tool’s criteria with policy documents, the methodology ensured that the tool supported the overarching goals of food system sustainability, resilience, and circularity.
2.3. Data Analysis Techniques
- Thematic Coding: In line with Braun and Clarke (2006), thematic coding was employed to systematically identify recurring themes across focus group discussions, workshop transcripts, and document analysis [38]. This technique helped organize and interpret the data, particularly in the exploratory case study of Cities2030, where the aim was to uncover underlying patterns in stakeholder contributions. Key themes that emerged included the flexibility required in the design thinking process, the challenges of integrating diverse stakeholder perspectives, and the role of co-creation in fostering innovation and adaptability within the tool. Thematic coding is widely recognized in qualitative research for its utility in organizing complex datasets and revealing critical insights.
- Triangulation: To further validate the findings and mitigate the risk of bias from any single data source, methodological triangulation was applied, following Denzin’s (1978) framework [39]. Triangulation involved cross-referencing data from focus groups, interviews, and document analysis, ensuring a comprehensive and multi-dimensional view of the co-creation process and its impact on the tool’s development. This approach enhanced the validity of the findings and confirmed that the tool was contextually relevant and methodologically sound, adaptable to varied urban settings. Triangulation is critical in qualitative research for ensuring that findings are robust and reflective of multiple perspectives, thereby reducing potential methodological bias.
2.4. Integration of Quantitative Data
2.5. Validity and Reliability of the Findings
- Triangulation: Methodological triangulation was utilized to ensure consistency and reduce potential bias by cross-referencing data from multiple sources, including focus groups, workshops, and document analysis. This approach ensured that the findings were not reliant on any single data source, thus enhancing the robustness of the conclusions.
- Extended Partner Reviews: The tool’s applicability in real-world settings was further validated through extended partner reviews, involving the analysis of 20 practical documents [36]. These external reviews were essential in addressing both internal and external factors influencing urban food systems. The feedback provided by partners across diverse contexts was instrumental in refining the tool, ensuring its practicality, usability, and adaptability to various urban settings.
2.6. Methodological Contribution
- Theoretical Review and Strategy Development. The process begins with an extensive review of the relevant literature and policy frameworks to establish the core metrics for assessing social, environmental, and economic impacts. This stage sets the foundation for the initial design, ensuring that the tool is grounded in both theory and practice.
- Tool Version 1: Development and Initial Testing. The initial version of the tool is developed based on insights from the theoretical review. It undergoes preliminary testing to evaluate its usability and alignment with the Cities2030 objectives. Early-stage feedback is critical at this point to identify areas for refinement and validate the relevance of the metrics used.
- Design Thinking Workshop. A design thinking workshop is conducted with a diverse group of 65 stakeholders, including policymakers, food system experts, and community representatives. This workshop enables the co-creation of impact criteria and refines the focus areas of the tool, ensuring that it addresses the practical needs and priorities of the stakeholders involved.
- Tool Version 2: Thematic Analysis and Refinement. The second iteration of the tool is developed using thematic analysis and triangulation methods to incorporate insights from the workshop. This version addresses gaps identified during the workshop, enhancing the tool’s ability to capture complex, multi-dimensional impacts in diverse urban settings.
- Partner Feedback and Extended Review. Extended reviews and consultations with partners provide further insights into the tool’s applicability. This stage involves testing the tool across different settings, ensuring that it is contextually relevant and adaptable to a wide range of urban food systems. Inputs from practical assessments are integrated to refine the tool’s structure and usability.
- Tool Version 3: Simulation Testing. The third version of the tool undergoes simulation testing, which helps validate its robustness in various hypothetical scenarios. This phase tests the tool’s capability to handle complex data and accurately measure impacts, confirming its readiness for broader deployment.
- Full-Scale Data Collection. The final version of the tool is implemented in multiple regions, where it is used to collect comprehensive data on sustainability, food security, and resilience metrics. This stage provides a full-scale evaluation of the tool’s effectiveness and generates valuable insights for further refinement.
3. Results
3.1. Development Process of the Impact Assessment Tool
3.1.1. Theoretical Analysis and Strategy Development
- In total, 74% of the dimensions were non-financial, underscoring the importance of non-monetary impacts such as social and environmental outcomes, highlighting the need to assess social and environmental outcomes, rather than focusing solely on monetary measures.
- Only 36 financial indicators and 21 mixed indicators were identified, emphasizing the focus on non-financial metrics in sustainability assessments.
- Of the dimensions, 40% were considered universal, while 58% were context-specific, with the universality of four dimensions depending on the application, underscoring the necessity for a flexible tool that could accommodate diverse urban food systems.
3.1.2. Design Thinking Workshop and Stakeholder Engagement
- Initial Planning and Alignment. The design thinking workshops involved 65 stakeholders who collaborated to define the scope and purpose of six key impact categories: social, environmental, economic, legal, security, policy, and technological. This was done via several steps:
- Design Thinking Workshops: Initial workshops were organized to align key stakeholders and ensure a shared understanding of the categories to be developed. During these sessions, the importance of categorization was communicated, and participants prioritized criteria based on their relevance to different urban food systems. This process enhanced the tool’s flexibility and scalability across various city-region contexts.
- Defining Categories: The pre-defined categories were presented to the participants, and consensus was established on their definitions and relevance. Stakeholders provided input on additional categories and suggested modifications, ensuring that the tool addressed the diverse needs of each region.
- Goal Setting: The purpose of categorization—whether for evaluating performance, impact, or compliance—was clarified, and specific goals were established to guide the assessment process. Stakeholders reached an agreement on these primary goals, ensuring the criteria would drive comprehensive performance and impact assessments aligned with local priorities.
- Collaborative Workshops to Define Criteria. The workshop’s collaborative nature directly influenced the evolution of Tool Version 3, shaping its criteria and enhancing its usability and relevance. The key stages of the workshop process were structured as follows:
- Breakout Groups: Participants were divided into smaller working groups based on their areas of expertise or interest. Each group was assigned to a specific category (e.g., social, environmental, economic, etc.).
- Facilitated Brainstorming: Each group engaged in brainstorming sessions to generate potential criteria for their assigned category. Participants identified key areas and indicators based on their collective experience and expertise.
- The first two steps of the process were facilitated using a MIRO board (See Figure 4), which allowed participants to interact in real-time, streamline collaboration, and enhance the visualization of their ideas.
- Criteria Refinement: Through group discussions, the identified criteria were refined by removing overlaps, merging similar elements, and prioritizing the most significant metrics. This stage focused on reaching a consensus within each group on the finalized set of criteria.
- Group Presentations: Each team presented their finalized criteria to the larger group. Cross-group feedback, suggestions, and questions were encouraged to promote alignment and ensure coherence across all categories.
- Consensus Building and Framework Finalization. A voting and ranking process (see Figure 5) was used to prioritize the most relevant indicators within each category. This process ensured that the finalized criteria were measurable, adaptable, and applicable across various urban food system contexts. During the final review, criteria were further refined based on feedback, with some being clarified, split, or merged for better precision.
3.1.3. Tool Versions and Testing
Initial Testing and Feedback
- Improving the flexibility of metrics to better capture regional variations in urban food systems.
- Enhancing the user interface to simplify data entry and interpretation for non-expert users.
- Adjusting the criteria weights to reflect stakeholder priorities more accurately.
Tool Version 2: Refinement and Testing
Tool Version 3: Simulation and Full-Scale Testing
- The number of new partnerships formed
- Levels of community engagement
- Innovations in product development
- Reductions in CO2 emissions and transport emissions
3.2. Cities2030 Impact Assessment: Performance Evaluation
3.2.1. Evaluation of Full-Scale Data Collection 2023
Key Findings from Initial Testing and Feedback
- Social (13 Criteria)
- Environmental (nine Criteria)
- Economic (16 Criteria)
- Legal, Security, and Policy (eight Criteria)
- Culture and Values (four Criteria)
- Technological (four Criteria)
Data Collection and Process Overview
3.2.2. Tool Performance Analysis
- Adaptability Across Regions: The tool’s strongest feature was its ability to be customized for different regional contexts. Stakeholders across urban centers and smaller peri-urban areas confirmed its flexibility in addressing local challenges, such as CO2 emissions tracking in production-focused regions and evaluating socioeconomic equity in areas prioritizing community engagement. This adaptability ensured that the tool provided accurate and context-specific insights into sustainability interventions.
- Iterative Refinement for Enhanced Usability: Iterative refinement, based on feedback from 136 partners and design thinking workshops involving 65 stakeholders, resulted in significant usability improvements. By incorporating co-created impact criteria, Tool Versions 2 and 3 were optimized to handle a diverse range of stakeholder needs, from policymakers to urban planners. The result was a tool that evolved into a user-friendly system capable of capturing complex sustainability metrics efficiently.
- Effectiveness in Practical Applications: During the 2023 test year, the tool’s practical utility was evident through its data visualization and reporting capabilities. Stakeholders used these features to generate reports on CO2 reduction, waste minimization, and social engagement, facilitating evidence-based decision-making at the local government level. This capacity to translate data into actionable insights was a key factor in supporting the sustainability transitions within CRFSs.
3.2.3. Key Analytical Results and Findings
- Social Impact
- Two hundred and ninety-six new partnerships were formed, fostering collaboration among local governments, food producers, community organizations, and private enterprises within CRFSs.
- Two hundred and forty-nine external partner and crowd-initiated ideas were contributed, showcasing the engagement of stakeholders beyond the immediate project scope.
- Eleven thousand, seven hundred and four community members participated in various activities, with a notable three thousand, seven hundred and seventy-four young people engaged, highlighting the focus on youth participation.
- Three hundred and fifty-two food system experts provided guidance, enhancing the overall initiative.
- In total, 61.6% of user and non-user expectations were met, showcasing the tool’s effectiveness in addressing diverse needs.
- There was a 64% coherence with key policies such as the European Green Deal and Common Agricultural Policy (CAP) was achieved, aligning project outcomes with broader sustainability goals.
- Overall, 58% of participants demonstrated a commitment to learning and development, supporting ongoing knowledge transfer and capacity building.
- 2.
- Environmental Impact
- One thousand, three hundred and fifty-six stakeholders were actively involved, increasing visibility and recognition of CRFSs across regions.
- Of these, 43 stakeholders initiated carbon or sustainability reports aimed at reducing emissions.
- Further, 60 stakeholders adopted lean principles, improving resource efficiency in food systems.
- One hundred and nineteen cities and regions participated, expanding the project’s geographic reach.
- Seventy-nine activities enhanced circularity and 35 events addressed food poverty and waste reduction.
- Four hundred and forty sustainable food practices were promoted, with 17 natural resources protected or preserved.
- 3.
- Economic Impact
- Forty-eight product innovations and 11 process innovations were introduced, driving economic growth within CRFSs.
- Eighteen existing products or services were improved, supporting regional economic development.
- One hundred and fifty-six companies were consulted, leading to the engagement of 20 new employees in food systems.
- One hundred and fifty-seven food producers and 7719 new consumers participated in short food supply chains (SFSC), increasing market opportunities for sustainably produced goods.
- Ten meetings with investors were facilitated and 46 events were organized to boost CRFSs expertise among companies.
- 4.
- Technological Impact
- Twenty-nine new technologies were created and another twenty-nine technologies were improved through project partnerships.
- Seventeen research projects were identified as foundational for future technological advancements in urban food systems.
- 5.
- Legal, Policy, and Security Impact
- Ten urban food deserts were identified, leading to actions aimed at improving access to sustainable food retail points.
- Forty public policy documents now mention food-related issues, reflecting growing recognition of food systems in urban governance.
- Two hundred and twenty-two actions in schools promoted sustainable food education.
- Eleven cities engaged in the Milan Urban Food Policy Pact (MUFPP), demonstrating their commitment to sustainable food policies.
- Five hundred and thirteen activities focused on implementing key EU policies, including Food2030, the UN’s New Urban Agenda, and the Sustainable Development Goals (SDGs).
- Ninety governance- and policymakers were involved in CRFSs’ governance, with 45 practices examined and three policy documents currently in progress.
- 6.
- Cultural and Value Impact
- A total of 25,540 citizens were engaged through various cultural and value-driven activities.
- One hundred and ten events were organized to promote culturally appropriate food systems.
- Five hundred and twenty-six activities focused on making culturally appropriate food available in schools, workplaces, and neighborhoods.
- Ninety-one Food Systems Dialogues (FSD) were conducted, fostering discussions on the future of food systems.
- Twenty-one cross-border cooperation sessions facilitated knowledge sharing and innovation across regions.
4. Discussion
4.1. Key Findings and Interpretation in the Context of Previous Studies
4.1.1. Design Thinking for Impact Assessment
4.1.2. Multi-Dimensional Impact Measurement
4.1.3. Community Engagement and Co-Creation
4.1.4. Technological Innovation in Urban Food Systems
4.2. Addressing Key Successes and Areas for Improvement
- Formation of New Partnerships: The project facilitated the establishment of 296 new partnerships across diverse CRFSs. These collaborations involved local governments, food producers, community organizations, and private enterprises, creating networks that not only supported immediate project goals but also laid the groundwork for ongoing collaboration and innovation. This outcome is particularly relevant to the objectives outlined in the European Green Deal and Farm to Fork Strategy, where multi-stakeholder partnerships are considered crucial for sustainable urban food system transformation.
- Promotion of Innovation and Circular Economy Practices: The tool enabled participating cities to track and report innovations in urban agriculture, CO2 reduction, and food waste management. By enhancing supply chain efficiency and promoting the localization of food production, the tool contributed to both economic resilience and environmental sustainability. For instance, the adoption of circular economy practices not only supported environmental goals but also generated economic value for stakeholders by reducing operational costs and creating new market opportunities for sustainably produced goods.
- Tool Adaptability: A major success factor was the tool’s adaptability across different regions. Stakeholder feedback highlighted its ability to be customized according to the unique sustainability challenges and priorities of each region. Whether applied in densely populated urban centers or in smaller peri-urban areas, the tool proved flexible enough to assess interventions tailored to specific local contexts. This adaptability ensured that the tool remained relevant and scalable, demonstrating its potential for broader application within Europe and in diverse global contexts.
- Addressing Regional Disparities: Some regions, particularly those with limited technological infrastructure, faced challenges in data collection and tool implementation. Stakeholders in these regions struggled to gather accurate and comprehensive data, which affected the overall effectiveness of the tool in those contexts. This highlights the need for better integration of low-tech solutions or alternative data collection methodologies, such as mobile-based surveys or simplified data entry forms, that can be employed in regions with limited access to advanced digital infrastructure.
- Enhancing Training and Usability Support: Although the tool was designed to be user-friendly, stakeholder feedback indicated that additional training and capacity-building initiatives would significantly improve its implementation. In regions with less experience in data collection or impact assessment, the provision of workshops, online tutorials, or dedicated support teams would help stakeholders fully leverage the tool’s capabilities. Ensuring adequate training will be essential for expanding the tool’s application in a wider range of socio-economic and technological contexts.
- Long-Term Data-Tracking Capabilities: Another area for improvement is the tool’s capability for long-term monitoring and evaluation. While the tool performed well in capturing impacts during the 2023 test year, stakeholders emphasized the need for enhanced features to track sustainability metrics over extended periods. Improving the tool’s longitudinal tracking capabilities would enable users to monitor ongoing progress and make data-driven adjustments, ensuring the long-term sustainability and resilience of interventions.
4.3. Working Hypotheses Revisited
4.4. Implications for Policy and Urban Food Systems
- Alignment with EU Strategies: The Cities2030 tool directly supports key EU policy frameworks, including the European Green Deal, Farm to Fork, and Food2030 strategies. By integrating metrics such as CO2 reduction, food waste management, and community engagement, the tool enabled urban regions to quantify their contributions to these overarching goals. This alignment underscores the tool’s value in helping cities meet EU-wide sustainability targets, ensuring that local actions contribute to broader policy outcomes.
- Policy Development and Evidence-Based Decision-Making: One of the primary strengths of the Cities2030 tool is its capacity to generate multi-dimensional, data-driven insights. Policymakers can utilize these detailed metrics to understand the varied impacts of interventions, enabling more nuanced and targeted sustainability policies. Additionally, the tool’s robust data visualization capabilities foster enhanced communication between stakeholders, making it easier to advocate for and implement evidence-based policies.
- Potential for Broader Urban Applications: Although initially tailored for CRFSs, the Cities2030 framework has potential applicability in other urban sustainability contexts. Its adaptable structure can be modified to evaluate the sustainability performance of different urban sectors, such as energy, water, and waste management. The tool’s cross-sectoral potential makes it a strong candidate for developing integrated urban strategies that can tackle multiple aspects of urban resilience and sustainability concurrently.
4.5. Future Research Directions
- While the Cities2030 project has made significant contributions to urban sustainability research, further studies are needed to address emerging challenges and enhance the tool’s applicability in varied contexts. Future research should focus on refining and expanding the tool’s capabilities in the following areas:
- Long-Term Impact Assessment: Future research should prioritize the development of methods for the longitudinal tracking of sustainability and resilience in CRFSs. Long-term evaluations would provide a deeper understanding of the lasting effects of interventions and allow for more comprehensive assessments of their contributions to environmental, social, and economic sustainability.
- Scalability and Transferability to Global Contexts: The adaptability of the Cities2030 tool should be tested in diverse socio-economic and environmental contexts, including urban areas outside Europe. Investigating how the tool can be tailored to meet the specific sustainability needs of different regions would assess its scalability and global transferability, making it a potentially valuable resource for cities worldwide.
- Integration of Advanced Technologies: Exploring the integration of advanced technologies such as artificial intelligence (AI), blockchain, and the Internet of Things (IoT) could significantly enhance the tool’s functionality. These technologies would improve real-time data collection, increase transparency, and allow for more dynamic monitoring of sustainability interventions. Additionally, AI and machine learning could offer predictive capabilities, helping stakeholders identify trends and make more informed decisions based on complex data patterns.
- Cross-Sectoral Policy Integration: Further research should explore the applicability of the tool beyond food systems to include other urban sectors, such as energy, water, and waste management. Developing cross-sectoral impact assessment models would enable cities to address multiple dimensions of urban resilience and sustainability in a holistic manner. This would support the creation of integrated policies that break down silos and promote synergies between different urban systems, fostering more resilient and sustainable cities.
- By addressing these research gaps, future iterations of the Cities2030 tool can be enhanced to provide even more comprehensive, long-term, and scalable solutions for promoting sustainability across urban systems globally.
5. Conclusions
- The developed Methodological Framework for Impact Assessment, structured through iterative stages—ranging from theoretical review and design thinking workshops to thematic coding and simulation testing—ensured a comprehensive approach to tool development. This structured framework enabled the integration of diverse stakeholder inputs and facilitated real-time adaptability across different city-region contexts, highlighting the framework’s effectiveness in creating an evidence-based and scalable assessment tool.
- The use of a design thinking methodology proved crucial in overcoming the limitations of traditional, rigid assessment frameworks that often fail to capture the complexities of urban food systems. The iterative, human-centered approach fostered cross-sectoral collaboration and enabled the tool to evolve based on real-time feedback, ensuring it remained responsive to the dynamic needs of diverse urban contexts. This adaptive capacity directly addressed the challenge of developing an impact assessment tool that could handle the varied socio-economic and environmental conditions of different city-regions.
- The project successfully addressed the challenge of ensuring inclusivity and stakeholder alignment by involving 65 stakeholders in the co-creation process. This participatory approach facilitated consensus on the most relevant criteria for impact assessment, ensuring that the tool accurately reflected the priorities of policymakers, community members, and urban planners. By engaging stakeholders in multiple iterations, the tool strengthened ownership and ensured alignment with local, regional, and international sustainability goals.
- The iterative tool development process, incorporating input from 136 partner representatives and extensive theoretical and practical testing, overcame the challenge of balancing theoretical robustness with practical applicability. This approach ensured that the tool was thoroughly vetted and could be effectively deployed across real-world scenarios, making it versatile enough to be applied to both densely populated urban centers and smaller peri-urban regions.
- The framework’s capacity to evaluate impacts across six dimensions—social, environmental, economic, legal/policy, culture and values, and technological—addressed the need for a comprehensive assessment model that captures the full complexity of CRFSs. This multi-dimensionality allowed stakeholders to evaluate the interplay of various factors, ensuring a holistic understanding of sustainability interventions. It addressed a core challenge of traditional models, which often fail to account for the interconnected nature of urban systems.
- The initial application of the tool yielded significant outcomes, including 296 new partnerships, engagement of over 11,000 community members, 48 product innovations, and 29 new technologies. These results highlight the tool’s effectiveness in fostering collaboration, driving innovation, and promoting circular economy practices, ultimately contributing to sustainable urban food system transitions. This demonstrated success confirms that the tool is capable of generating meaningful, multi-dimensional impacts in diverse city-region contexts.
- The ability of the framework to be tailored to specific local contexts while maintaining alignment with broader European strategies was a key achievement. This adaptability addressed the challenge of creating a one-size-fits-all tool and ensured its relevance across diverse geographic, socio-economic, and political landscapes, thereby supporting localized solutions without losing sight of overarching sustainability goals.
- Despite its successes, challenges remain, particularly in enhancing the tool’s scalability and long-term applicability in regions with limited technological infrastructure. Addressing these challenges will require ongoing iterations and additional training programs to build capacity in less-developed regions. Further refinement will focus on integrating long-term tracking capabilities and exploring the potential of emerging technologies like artificial intelligence and IoT to further enhance the tool’s predictive capabilities.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
- Social impact selected indicators:
- Number of new partnerships and networks created in the Cities2030;
- Number of external partner and crowd-initiated ideas;
- Number of other community members involved in the project city/region activities;
- Number of youngsters involved in the project activities;
- Number of food system experts involved;
- Ability to cope with users and non-users expectations and needs (to what extent the needs and requirements of end users are met, and how CITIES2030 can meet their expectations) (evaluate in scale of 100%);
- Project coherence with other policies e.g., green deal, CAP, etc. (evaluate in 100%);
- Commitment towards learning and development (participants involved have adequate knowledge, skills and tools to achieve their full potential to support the development of SFSC, and ensure a sustainable growth of urban life quality (evaluate in 100% scale).
- Environmental:
- Increased visibility and recognition of CRFSs by number of stakeholders engaged (involved);
- Number of stakeholders that put out carbon or sustainability reports, limits harmful pollutants and chemicals or seeks to lower greenhouse gas emissions;
- Number of stakeholders that adapt lean principles in CRSFs;
- Number of cities and regions involved in CRFSs (in Cities2030 activities);
- Number of activities to enhance circularity and local food belts;
- Number of events to reduce CO2 emission, transport emissions by all actors in the chain at different stages;
- Number of events to stop food poverty, generation of surpluses and waste;
- Number of activities related to sustainable food;
- Number of optimized food delivery chains;
- Number of protected and preserved nature resources.
- Economical:
- Number of product innovations (new products or services);
- Number of process innovations (new production or delivery methods);
- Improved existing products or services;
- Number of companies consulted about CRFSs;
- Number of new employees involved (from partner companies) in CRFSs;
- Number of saved financial resources due to CRFSs (EUR);
- Incomes generated for stakeholders from CRFSs activities (EUR);
- Number of financial resources attracted (the amount of investment) to CRFSs (EUR);
- Number of food producers engaged in SFSC;
- Number of new consumers engaged in SFSC;
- Number of structured investment capital plans;
- Number of investors contacted;
- Number of meetings with investors;
- Number of investors’ Memorandum of Understandings signed;
- Number of events for companies to increase of expertise (the level of CRFSs expertise;
- Number of activities to increase salaries, expertise, competencies of employees at CRFSs due to project activities;
- Number of exploitation plans;
- Number of good practices (generated);
- Number of business plans for innovations.
- Technological:
- Number of new technologies created in project or partnerships;
- Number of technologies improved in the project or partnerships;
- Number of research projects that could be a base for new technologies;
- Number of developing transportable units with new technologies, for farmers and schools to teach STEM;
- Number of digital learning platforms.
- Legal, Political, Security:
- Number of CRFS-PL (policy labs);
- Number of CRFS-LL (living labs);
- Number of urban food deserts: distances home/sustainable food retail points;
- Number of public policies documents mentioning food stakes;
- Number of actions in schools, education;
- Number of cities engaged in MUFPT;
- Number of activities related with implementation of EU policies > Food2030, UN’s NUA and SDD-11, and consorts;
- Number of scientific papers related to Cities2030 legal, policy or security aspects;
- Number of practices (examined) in WP field;
- Number of interviews realized in WP field;
- Number of new policy documents in progress;
- Number of new policy documents in action;
- Number of governance- and policymakers involved.
- Cultural and Values:
- Number of citizens touched by Cities2030 activities (culture and value impact);
- Number of events organized or participated in (culture and value impact);
- Urban/rural food consumers’ perception on SFSC (number of new consumers engaged in SFSC);
- Number of activities related to culturally-appropriate food available in neighborhoods, in schools, in the work place, etc.;
- Number of Food Systems Dialogues (FSD);
- Number of cross-border cooperation sessions.
References
- United Nations. Sustainable Development Goals. Available online: https://sdgs.un.org/goals (accessed on 21 August 2024).
- United Nations, Department of Economic and Social Affairs, Population Division. World Urbanization Prospects: The 2018 Revision; United Nations: New York, NY, USA, 2018. [Google Scholar]
- Food and Agriculture Organization of the United Nations (FAO). Urban Food Systems and the Right to Food. Available online: https://www.fao.org/urban-food-agenda/en/ (accessed on 21 August 2024).
- Bell, S.; Mishra, H.S.; Elliott, L.; Shellock, R.; Vassiljev, P.; Porter, M.; Sydenham, Z.; White, M. Urban Blue Acupuncture: A Protocol for Evaluating a Complex Landscape Design Intervention to Improve Health and Wellbeing in a Coastal Community. Sustainability 2020, 12, 4084. [Google Scholar] [CrossRef]
- Vittuari, M.; Bazzocchi, G.; Blasioli, S.; Cirone, F.; Maggio, A.; Orsini, F.; Penca, J.; Petruzzelli, M.; Specht, K.; Amghar, S.; et al. Envisioning the Future of European Food Systems: Approaches and Research Priorities After COVID-19. Front. Sustain. Food Syst. 2021, 5, 642787. [Google Scholar] [CrossRef]
- Marotta, I.; Guarino, F.; Longo, S.; Cellura, M. Environmental Sustainability Approaches and Positive Energy Districts: A Literature Review. Sustainability 2021, 13, 13063. [Google Scholar] [CrossRef]
- European Commission. Farm to Fork Strategy. Available online: https://ec.europa.eu/food/farm2fork_en (accessed on 21 August 2024).
- Wheeler, T.; von Braun, J. Climate Change Impacts on Global Food Security. Science 2013, 341, 508–513. [Google Scholar] [CrossRef]
- FAO. The State of Food Security and Nutrition in the World 2021: Transforming Food Systems for Food Security, Improved Nutrition, and Affordable Healthy Diets for All; FAO, IFAD, UNICEF, WFP, WHO: Rome, Italy, 2021. [Google Scholar] [CrossRef]
- Ingram, J.; Ericksen, P.; Liverman, D. Food Security and Global Environmental Change; Routledge: London, UK, 2010; pp. 1–384. [Google Scholar] [CrossRef]
- Folke, C.; Carpenter, S.R.; Walker, B.; Scheffer, M.; Chapin, T.; Rockström, J. Resilience Thinking: Integrating Resilience, Adaptability and Transformability. Ecol. Soc. 2010, 15, 20. [Google Scholar] [CrossRef]
- Godfray, H.C.J.; Crute, I.R.; Haddad, L.; Lawrence, D.; Muir, J.F.; Nisbett, N.; Pretty, J.; Robinson, S.; Toulmin, C.; Whiteley, R. The Future of the Global Food System. Philos. Trans. R. Soc. B Biol. Sci. 2010, 365, 2769–2777. [Google Scholar] [CrossRef]
- Ingram, J. A Food Systems Approach to Researching Food Security and Its Interactions with Global Environmental Change. Food Secur. 2011, 3, 417–431. [Google Scholar] [CrossRef]
- Sonnino, R.; Blay-Palmer, A.; Custot, J. Urban Food Governance and the Politics of Space: The Case of Sustainable Food City Networks. Int. Plan. Stud. 2019, 24, 409–421. [Google Scholar]
- Zorpas, A.A. Strategy Development in the Framework of Waste Management. Sci. Total Environ. 2020, 716, 137088. [Google Scholar] [CrossRef]
- Béné, C.; Wood, R.G.; Newsham, A.; Davies, M. Resilience: New Utopia or New Tyranny? Reflection about the Potentials and Limits of the Concept of Resilience in Relation to Vulnerability Reduction Programmes. IDS Work. Pap. 2012, 405, 1–61. [Google Scholar] [CrossRef]
- Fischer, T.B.; Jha-Thakur, U.; Fawcett, P.; Clement, S.; Hayes, S.; Nowacki, J. Consideration of urban green space in impact assessments for health. Impact Assess. Proj. Apprais. 2017, 36, 32–44. [Google Scholar] [CrossRef]
- Scoones, I. The Politics of Sustainability and Development. Annu. Rev. Environ. Resour. 2016, 41, 293–319. [Google Scholar] [CrossRef]
- Clora, F.; Yu, W.; Baudry, G.; Costa, L. Impacts of Supply-Side Climate Change Mitigation Practices and Trade Policy Regimes Under Dietary Transition: The Case of European Agriculture. Environ. Res. Lett. 2021, 16, 124048. [Google Scholar] [CrossRef]
- Stelwagen, R.E.; Slegers, P.M.; Schutter, L.; Leeuwen, E.S. A Bottom-Up Approach to Model the Environmental Impact of the Last-Mile in an Urban Food-System. Sustain. Prod. Consum. 2021, 26, 958–970. [Google Scholar] [CrossRef]
- Brown, T. Change by Design: How Design Thinking Creates New Alternatives for Business and Society; Harper Business: New York, NY, USA, 2009. [Google Scholar]
- Kolko, J. Design Thinking Comes of Age. Harv. Bus. Rev. 2015, 93, 66–71. [Google Scholar]
- Zurek, M.; Hebinck, A.; Leip, A.; Vervoort, J.; Kuiper, M.; Garrone, M.; Havlík, P.; Heckelei, T.; Hornborg, S.; Ingram, J.; et al. Assessing Sustainable Food and Nutrition Security of the EU Food System—An Integrated Approach. Sustainability 2018, 10, 4271. [Google Scholar] [CrossRef]
- Sartika, R.C.; Purwaningsih, Y.; Gravitiani; Nitiyasa, P. The Role of Stakeholders in Achieving Sustainable Agriculture: A Case Study in Sragen Regency, Indonesia. In Nat. Environ. Pollut. Technol.; 2023; Volume 22, pp. 2181–2188. [Google Scholar] [CrossRef]
- Marsden, T.; Morley, A. Sustainable Food Systems: Building a New Paradigm; Routledge: London, UK, 2014; pp. 45–82. [Google Scholar]
- Feleki, E.; Vlachokostas, C.; Moussiopoulos, N. Characterisation of Sustainability in Urban Areas: An Analysis of Assessment Tools with Emphasis on European Cities. Sustain. Cities Soc. 2018, 43, 563–577. [Google Scholar] [CrossRef]
- Crenna, E.; Sinkko, T.; Sala, S. Biodiversity Impacts Due to Food Consumption in Europe. J. Clean. Prod. 2019, 227, 378–391. [Google Scholar] [CrossRef]
- Benton, T.G.; Bieg, C.; Harwatt, H.; Pudasaini, R.; Wellesley, L. Food System Impacts on Biodiversity Loss. Biol. Rev. 2021, 96, 331–356. [Google Scholar] [CrossRef]
- Arciniegas, G.; Wascher, D.; Eyre, P.; Sylla, M.; Vicente-Vicente, J.L.; Świąder, M.; Unger, T.; Prag, A.A.; Lysák, M.; Schafer, L.J.; et al. A participatory tool for assessing land footprint in city-region food systems—A case study from Metropolitan Copenhagen. Front. Sustain. Food Syst. 2022, 6, 846869. [Google Scholar] [CrossRef]
- Kremen, C.; Miles, A. Ecosystem Services in Biologically Diversified versus Conventional Farming Systems: Benefits, Externalities, and Trade-Offs. Ecol. Soc. 2012, 17, 40. [Google Scholar] [CrossRef]
- Reed, M.S.; Graves, A.; Dandy, N.; Posthumus, H.; Hubacek, K.; Morris, J.; Prell, C.; Quinn, C.H.; Stringer, L.C. Who’s in and Why? A Typology of Stakeholder Analysis Methods for Natural Resource Management. J. Environ. Manag. 2009, 90, 1933–1949. [Google Scholar] [CrossRef] [PubMed]
- Hoekman, B.; Rojas-Romagosa, H. EU Trade Sustainability Impact Assessments: Revisiting the Consultation Process. EUI RSC, 2022/07, Global Governance Programme-464, [Global Economics]. Available online: https://hdl.handle.net/1814/74038 (accessed on 1 June 2024).
- Pothukuchi, K.; Kaufman, J.L. The Food System: A Stranger to the Planning Field. J. Am. Plan. Assoc. 2000, 66, 113–124. [Google Scholar] [CrossRef]
- Cities 2030 Project. Available online: https://cities2030.eu/ (accessed on 21 August 2024).
- Yin, R.K. Case Study Research and Applications: Design and Methods, 6th ed.; SAGE Publications: Los Angeles, CA, USA, 2018; pp. 45–82. [Google Scholar]
- Stake, R.E. The Art of Case Study Research; SAGE Publications: Thousand Oaks, CA, USA, 1995. [Google Scholar]
- Krueger, R.A.; Casey, M.A. Focus Groups: A Practical Guide for Applied Research, 5th ed.; SAGE Publications: Thousand Oaks, CA, USA, 2015. [Google Scholar]
- Braun, V.; Clarke, V. Using Thematic Analysis in Psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef]
- Denzin, N.K.; Lincoln, Y.S. The SAGE Handbook of Qualitative Research, 4th ed.; SAGE Publications: Thousand Oaks, CA, USA, 2011; pp. 1–19. [Google Scholar]
- Creswell, J.W.; Plano Clark, V.L. Designing and Conducting Mixed Methods Research, 3rd ed.; SAGE Publications: Los Angeles, CA, USA, 2017. [Google Scholar]
- Burnes, B. Recipes for organisational effectiveness. Mad, bad, or just dangerous to know. Career Dev. Int. 1998, 3, 100–106. [Google Scholar] [CrossRef]
- Nelson, S.; Brunetto, Y.; Farr-Wharton, R.; Ramsay, S. Organisational effectiveness of Australian fast-growing small to medium-sized enterprises (SMEs). Manag. Decis. 2007, 45, 1143–1162. [Google Scholar] [CrossRef]
- Pors, N.O. Trust and organisational effectiveness. Perform. Meas. Metr. 2008, 9, 59–68. [Google Scholar] [CrossRef]
- Kataria, A.; Rastogi, R.; Garg, P. Organizational Effectiveness as a Function of Employee Engagement. South Asian J. Manag. 2013, 20, 56–73. [Google Scholar]
- Bratnicka, K. Creativity and effectiveness in organizations. A new approach to an old question. Management 2015, 19, 22–45. [Google Scholar] [CrossRef]
- Quinn, F.F.; Thorne, D.M. The Influence of organizational effectiveness and other correlates on the job satisfaction of staff employees at four-year institutions of higher education. Bus. Stud. J. 2014, 6, 67–84. [Google Scholar]
- Biswas, S. Relationship between psychological climate and turnover intentions and its impact on organisational effectiveness: A study in Indian organisations. IIMB Manag. Rev. 2010, 22, 102–110. [Google Scholar] [CrossRef]
- Rieley, J.B. Building Alignment to Improve Organizational Effectiveness. Glob. Bus. Organ. Excell. 2014, 33, 6–16. [Google Scholar] [CrossRef]
- Pee, L.G.; Kankanhalli, A. Interactions among factors influencing knowledge management in public-sector organizations: A resource-based view. Gov. Inf. Q. 2015, 32, 188–199. [Google Scholar] [CrossRef]
- Chidambaranathan, K.; Swarooprani, B.S. Knowledge Management as a Predictor of Organizational Effectiveness: The Role of Demographic and Employment Factors. J. Acad. Librariansh. 2009, 41, 758–763. [Google Scholar] [CrossRef]
- Zheng, W.; Yang, B.; McLean, G.N. Linking organizational culture, structure, strategy, and organizational effectiveness: Mediating role of knowledge management. J. Bus. Res. 2010, 63, 763–771. [Google Scholar] [CrossRef]
- Yang, J.T.; Wan, C.S. Advancing organizational effectiveness and knowledge management implementation. Tour. Manag. 2004, 25, 593–601. [Google Scholar] [CrossRef]
- Angle, H.; Perry, J.L. An Empirical Assessment of Organizational Commitment and Organizational Effectiveness. Adm. Sci. Q. 1981, 26, 1–14. [Google Scholar] [CrossRef]
- Kim, J.H.; Kim, C.S.; Kim, J.M. Analysis of the effect of leadership and organizational culture on the organizational effectiveness of radiological technologist’s working environments. Radiography 2011, 17, 201–206. [Google Scholar] [CrossRef]
- Ashraf, F.; Khan, M.A. Organizational Innovation and Organizational Effectiveness Among Employees of Cellular Companies. Pak. J. Psychol. Res. 2013, 28, 1–24. [Google Scholar]
- Gregory, B.T.; Harris, S.G.; Armenakis, A.A.; Shook, C.L. Organizational culture and effectiveness: A study of values, attitudes, and organizational outcomes. J. Bus. Res. 2009, 62, 673–679. [Google Scholar] [CrossRef]
- Nazi, N.A.; Lone, M.A. Validation of Denison’s model of organisational culture and effectiveness in the Indian context. VISION-J. Bus. Perspect. 2008, 12, 49–58. [Google Scholar] [CrossRef]
- An, J.Y.; Yom, Y.H.; Ruggiero, J.S. Organizational Culture, Quality of Work Life, and Organizational Effectiveness in Korean University Hospitals. J. Transcult. Nurs. 2011, 22, 22–30. [Google Scholar] [CrossRef] [PubMed]
- Braun, T.; Ferreira, A.I.; Sydow, J. Citizenship behavior and effectiveness in temporary organizations. Int. J. Proj. Manag. 2013, 31, 862–876. [Google Scholar] [CrossRef]
- Walz, S.M.; Niehoff, B.P. Organizational citizenship behaviours: Their relationship to organizational effectiveness. J. Hosp. Tour. Res. 2000, 24, 301–319. [Google Scholar] [CrossRef]
- Choo, C.W. Information culture and organizational effectiveness. Int. J. Inf. Manag. 2013, 33, 775–779. [Google Scholar] [CrossRef]
- Nayak, B.; Mishra, B.B. Impact of leadership style on organizational effectiveness. Manag. Labour Stud. 2005, 30, 90–103. [Google Scholar] [CrossRef]
- Santra, T.; Giri, V.N. Effect of Organizational Structure on Organizational Effectiveness through Face-to-Face Communication. Icfai J. Organ. Behav. 2008, 7, 28–38. [Google Scholar]
- Herman, R.D.; Renz, D.O. Theses on Nonprofit Organizational Effectiveness. Nonprofit Volunt. Sect. Q. 1999, 28, 107–126. [Google Scholar] [CrossRef]
- Eisenger, P. Organizational Capacity and Organizational Effectiveness Among Street-Level Food Assistance Programs. Nonprofit Volunt. Sect. Q. 2002, 31, 115–130. [Google Scholar] [CrossRef]
- Nobbie, P.D.; Brudney, J.L. Testing the Implementation, Board Performance, and Organizational Effectiveness of the Policy Governance Model in Nonprofit Boards of Directors. Nonprofit Volunt. Sect. Q. 2003, 32, 571–595. [Google Scholar] [CrossRef]
- Sowa, J.E.; Selden, S.C.; Sandfort, J.R. No Longer Unmeasurable? A Multidimensional Integrated Model of Nonprofit Organizational Effectiveness. Nonprofit Volunt. Sect. Q. 2004, 33, 711–728. [Google Scholar] [CrossRef]
- Shilbury, D.; Moore, K.A. A Study of Organizational Effectiveness for National Olympic Sporting Organizations. Nonprofit Volunt. Sect. Q. 2006, 35, 5–38. [Google Scholar] [CrossRef]
- Grabowski, L.; Neher, C.; Crim, T.; Mathiassen, L. Competing Values Framework Application to Organizational Effectiveness in Voluntary Organizations: A Case Study. Nonprofit Volunt. Sect. Q. 2015, 44, 908–923. [Google Scholar] [CrossRef]
- Liket, K.C.; Maas, K. Nonprofit Organizational Effectiveness: Analysis of Best Practices. Nonprofit Volunt. Sect. Q. 2015, 44, 268–296. [Google Scholar] [CrossRef]
- Willems, J. Building Shared Mental Models of Organizational Effectiveness in Leadership Teams Through Team Member Exchange Quality. Nonprofit Volunt. Sect. Q. 2016, 45, 568–592. [Google Scholar] [CrossRef]
- Wadongo, B.; Abdel-Kader, M. Contingency theory, performance management and organisational effectiveness in the third sector. Int. J. Product. Perform. Manag. 2014, 63, 680–703. [Google Scholar] [CrossRef]
- Lecy, J.D.; Scmitz, H.P.; Swedlund, H. Non-govermental and not-for-profit organizational effectiveness: A modern synthesis. Volunt. Int. J. Volunt. Nonprofit Organ. 2012, 23, 434–457. [Google Scholar] [CrossRef]
- Ullah, I.; Yasmin, R. The Influence of Human Resource Practices on Internal Customer Satisfaction and Organizational Effectiveness. J. Internet Bank. Commer. 2013, 18, 1–28. [Google Scholar]
- Ziebicki, B. Relations between organizational effectiveness and efficiency in public sector units. Probl. Manag. 21st Century 2013, 8, 102–110. [Google Scholar] [CrossRef]
- Boiral, O. ISO 9000 and Organizational Effectiveness: A Systematic Review. QMJ 2012, 19, 16–37. [Google Scholar] [CrossRef]
- Zooga, D.B.; Peng, M.W.; Woldu, H. Institutions, resources, and organizational effectiveness in Africa. Acad. Manag. Perspect. 2015, 29, 7–31. [Google Scholar] [CrossRef]
- Gerschewski, S.; Xiao, S.S. Beyond financial indicators: An assessment of the measurement of performance for international new ventures. Int. Bus. Rev. 2015, 24, 615–629. [Google Scholar] [CrossRef]
- Albizzati, P.F.; Tonini, D.; Astrup, T.F. A Quantitative Sustainability Assessment of Food Waste Management in the European Union. Environ. Sci. Technol. 2021, 55, 16099–16109. [Google Scholar] [CrossRef] [PubMed]
- Buchanan, R. Wicked Problems in Design Thinking. Des. Issues 1992, 8, 5–21. [Google Scholar] [CrossRef]
- Doherty, T.L.; Horne, T. Managing Public Services—Implementing Changes: A Thoughtful Approach to the Practice of Management; Routledge: London, UK, 2002. [Google Scholar]
Stage 1-In Article Title or/and Keywords Mentioned Terms | Stage 2- Directly About (Full Text Available) | Stage 3-Unique Sources | |
---|---|---|---|
Scopus | 16,592 | 36 | 133 |
ScienceDirect | 78,381 | 24 | |
Google Scholar | 23,700 | 15 | |
Sage Journals | 54,575 | 34 | |
Ebsco | 832,645 | 33 | |
Emerald | 23,456 | 25 | |
Web of Science | 52 | 8 | |
Sum: | 1,029,401 | 175 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mikelsone, E.; Cīrule, I. Design Thinking Approach to Create Impact Assessment Tool: Cities2030 Case Study. Sustainability 2024, 16, 9593. https://doi.org/10.3390/su16219593
Mikelsone E, Cīrule I. Design Thinking Approach to Create Impact Assessment Tool: Cities2030 Case Study. Sustainability. 2024; 16(21):9593. https://doi.org/10.3390/su16219593
Chicago/Turabian StyleMikelsone, Elina, and Iveta Cīrule. 2024. "Design Thinking Approach to Create Impact Assessment Tool: Cities2030 Case Study" Sustainability 16, no. 21: 9593. https://doi.org/10.3390/su16219593
APA StyleMikelsone, E., & Cīrule, I. (2024). Design Thinking Approach to Create Impact Assessment Tool: Cities2030 Case Study. Sustainability, 16(21), 9593. https://doi.org/10.3390/su16219593