Open Innovation and Determinants of Technology-Driven Sustainable Value Creation in Incubated Start-Ups
Abstract
:1. Introduction
- To identify business incubation trends and further perspectives related to OI and the sustainable value creation perspectives;
- To conduct a pilot study of incubated start-ups and to explore preliminary findings on the determinants of the technology driven sustainable value creation within incubated business start-ups;
- To validate the theoretical conceptual model and the research instruments.
2. Literature Review
2.1. Business Incubators as Quadruple Helix Actors Promoting Sustainable Value Creation through OI
2.2. Innovations and the Creation of Sustainable Value in Start-Ups
- The narrow—product, service, organisational, process and marketing, mainly associated with the products or processes in a particular company.
- The holistic—related to the business model and the value chain or the macro systemic level, as similarly proposed by Konezko et.al. [54].
- The nature of change—the technological innovations, non-technological innovations, incremental innovations; namely having the gradual nature of the change and radical innovations, or creating a completely new value or innovation.
2.3. Determinants of the Creation of Technology-Driven Sustainable Value in Start-Ups
- Compensate or reduce—while creating harmful and negative social or environmental impacts in one area, contribute positively to the sustainability issues in another area.
- Be sustainable—do not create negative social or environmental impacts, and purposely organise business activities—production or delivery of services—in a sustainable way.
- High level sustainable impact—a start-up invests efforts into solving broader environmental or social issues, incorporating this ambition into the business model essence and creating the sustainable value far beyond the company’s boundaries.
2.4. The OI Approach and the Sustainability Dimensions within the Business Incubation
- OI inbound and outbound practices are beneficial and meaningfully utilised by incubated start-ups, and are mainly performed in the following ways: (a) customer involvement in innovation and co-creation of the value [77,78]; (b) external networking [78,79,80,81]; (c) knowledge exploitation and provision [82,83,84]; (d) idea management [85,86,87];
- The OI approach in business incubation such as OI inbound and outbound practices, OI challenges and benefits;
- Start-up sustainability orientation, mainly the sustainability strategy and an ambition, planetary boundaries, sustainable business models and value creation, particularly a deeper analysis of technology-driven sustainable value creation;
- Start-up performances, such as competitiveness and innovation, as well as the incubators’ services, are complementary as they contribute to the adoption of the OI and sustainability approaches.
3. Methodology
4. Results and Discussion
4.1. Preliminary Results of the Pilot Survey of Incubated Start-Ups
4.2. Opportunities of Business Incubation through OI and Sustainability Perspectives
5. Conclusions and Suggestions
5.1. Theoretical and Practical Implications
5.2. Limitations and a Further Research Agenda
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
Code | Questions | Types of Responses |
---|---|---|
IQ1 | Represented institution | Open |
IQ2 | Incubator type | Closed: Public, University, Private, Other |
IQ3 | What are the current trends and actualities in business incubators? | Open |
IQ4 | What do you see as future possibilities for improving the work of the incubator? | Open |
IQ5 | What different/new services would you like to introduce and what would you like to change in the operation of business incubators? | Open |
IQ6 | How do you think it would be possible to manage the incubator more conveniently/accessible? | Open |
How are state, university and industry/private business incubators different? | Open | |
IQ7 | Do the incubated companies sufficiently use the networking services provided by the incubators? | Open |
IQ8 | How important is the creation of sustainable values for incubated companies? | Open |
IQ9 | How important is the role of the incubator in the creation of sustainable values in the incubated companies? | Open |
IQ10 | How important is physical presence in the incubator when receiving incubation service offering? | Open |
IQ11 | What most incubated companies expect from business incubators? | Open |
IQ12 | What difficulties do you think the incubated companies face when they leave the incubator? | Open |
IQ13 | What are the performance indicators of the incubation program and how are they measured in your incubator? | Open |
IQ14 | What is your understanding of open innovation approach, how you can use it in the work of the incubator? | Open |
Code | Questions | Type of Responses |
---|---|---|
A-SQ1 | Number of founders of a start-up company/start-up idea team? | (1) Less than 5; (2) 5–9; (3) 10–24; (4) 25–49; (5) 50–99; (6) 100–249; (7) 250–499; (8) 500+ |
A-SQ2 | How long you have spent in the incubator (used incubator’s services)? | (1) Up to 1 year; (2) 1–2 years; (3) 2–3 years; (4) 3–4 years; (5) 5 and more years |
A-SQ3 | The stage of development of your business? | (1) Idea; (2) Minimum viable product developed; (3) Active action/business or sales development |
A-SQ4 | Location during the incubation? | (1) On-site at the incubator’s premises; (2) Virtual incubation; (3) Combined—virtual and face-to-face |
A-SQ5 | By commercializing your innovation, you (YES/NO)? | (1) Sell patent licenses or know-how; (2) Use cooperation and sales agreements; (3) Collaborate to create new joint ventures or research companies; (4) provide research and development services to organizations and government agencies; (5) you perform external networking and cooperation with external participants (suppliers, customers, research institutions, competitors); (6) make your unused innovations available to others for free (for free), (7) actively participate in innovation projects of other parties; (8) use the knowledge and initiatives of your employees who are not directly involved in research and development |
Code | Questions | Responses |
---|---|---|
B-SQ1 | To what extent have you used the incubator’s sharing services and facilities (0–3, Scales: 0—Never, 1—sometimes, 3—often)? | (1) Secretariat; (2) Car parking; (3) Meeting rooms; (4) Shared office facilities (printer, etc.); (5) Co-creation room; (6) Private office; (7) Registered legal address; (8) Mailbox option |
B-SQ2 | To what extent have you used the incubator’s advisory services and consultations (0–3, Scales: 0—Never, 1—sometimes, 3—often)? | (1) Accounting advice; (2) Financial advice; (3) Marketing consultation; (4) Engineering consultation; (5) Fundraising; (6) Strategic and other business development consultations; (7) Coaching; (8) Mentoring; (9) Group training; (10) Seminars; (11) Legal advice; (12) Consultation on intellectual property rights (patent, etc.) |
B-SQ3 | To what extent have you used access to capital provided by the incubator (0–3, Scales: 0—Never, 1—sometimes, 3—often)? | (1) Network of business angels; (2) Venture capital; (3) Seed capital; (4) Private financing (loans from individuals); (5) EU and other public funds’ support; (6) International accelerators; (7) Other |
B-SQ4 | To what extent have you used specific services of LIDA (0–3, Scales: 0—Never, 1—sometimes, 3—often) ? | Closed with rating of scales from 0 to 3 (0—Never, 1—sometimes, 3—often): (1) Initial evaluation of a business idea; (2) 3-days business school; (3) “PINK” school to improve business ideas; (4) Experience stories and visits of experienced entrepreneurs; (5) Member of young entrepreneurs’ community in LV |
Code | Questions | Responses |
---|---|---|
C-SQ1 | Please indicate (yes/no) whether your business is in line with any of the following types of sustainable value creation | (1) Technology-driven sustainable value creation; (2) Socially driven value creation; (3) Organizational value creation |
C-SQ2 | Indicate (yes/no) whether your company has specific actions in place to address following environmental issues | (1) Climate change; (2) Biodiversity loss; (3) Ocean (water) acidification; (4) Exhaustion of atmospheric ozone; (5) Global freshwater consumption; (6) Agricultural land use change; (7) Nitrogen and phosphorus production; (8) Atmospheric pollution load; (9) Chemical pollution |
C-SQ3 | Sustainability ambition In your opinion, the degree of sustainability in your company | (1) Beginners; (2) Basic; (3) Sufficient and satisfactory; (4) Expert |
C-SQ4 | Rate the importance of following factors (1–5, scales: 1—not important and 5—very important) | (1) Environmentally responsible decisions (2) Socially responsible decisions; (3) Compliance to the sustainability principles in development of new products; (4) Importance of sustainability principles in the future; (5) A sustainability strategy is part of daily business practices and value creation activities; (6) Sustainable practices lead to innovation |
C-SQ5 | Which sustainability strategy does your company use? | (1) Compensating for harmful actions in one area by doing good in another; (2) Be sustainable without harming the environment or society; (3) Be sustainable by rethinking all actions to promote positive environmental or social impacts far beyond the company; |
C-SQ6 | To what extent (0–3) the following principles are adapted in your company (Scale: 0—Never, 1—sometimes, 3—often)? | (1) Sustainability policies; (2) Activities to reduce CO2 emissions; (3) During product design and development assess the environmental and social impact; (4) Inclusion of sustainability costs in the product development budget; (5) Selection of suppliers and partners based on sustainability criteria; (6) Introduction of environmentally-friendly production; (7) Use of eco-design practices; (8) Application of eco-innovation |
C-SQ7 | To what extent (1–5) does your company implement the principles of a sustainable business model (scale: 1—not implemented and 5—fully implemented)? | (1) less material and energy consumption through more efficient processes; (2) reuse or recycling of resources; (3) replacement of non-renewable resources with renewable and artificial processes that mimic or use processes in nature; (4) offering a solution to the customer without owning a product such as car sharing; (5) protecting the environment by encouraging certain customer behaviour; (6) providing information and incentives/bonuses that encourage less consumption; (7) use of organizational resources and opportunities to generate benefits for society or the environment; (8) providing value to previously unattainable stakeholders or involving them in the value creation process; (9) sustainable solutions and wider use of technology; (10) adoption of a shared business model; (11) Adoption of a “return and resale” product strategy; (12) promote longer use of the product; (13) offer a product as a service. |
Control Variable: Location at the Time of Incubation | Control Variable: The Stage of Development of Business when Starting or Receiving an Incubation Support | Sustainability Strategy | Sustainability Ambition | Technology-Driven Sustainable Value Creation | Planetary Boundary Climate Change | ||
---|---|---|---|---|---|---|---|
n | valide | 48 | 48 | 48 | 48 | 48 | 48 |
manquant | 6 | 6 | 6 | 6 | 6 | 6 | |
Average | 1.00 | 2.38 | 1.96 | 1.31 | 1.50 | 1.54 | |
Median | 1.00 | 2.00 | 2.00 | 1.00 | 1.50 | 2.00 | |
Standard deviation | 0.000 | 0.570 | 0.713 | 0.689 | 0.505 | 0.504 | |
Variance | 0.000 | 0.324 | 0.509 | 0.475 | 0.255 | 0.254 | |
Minimum | 1 | 1 | 1 | 1 | 1 | 1 | |
Maximum | 1 | 3 | 3 | 4 | 2 | 2 |
Control Variable (the Stage of Development of Business when Starting or Receiving an Incubation Support | Control Variable (Location at the Time of Incubation) | Sustainability Strategy | Sustainability Ambition | Technology-Driven Sustainable Value Creation | ||
---|---|---|---|---|---|---|
Control variable the stage of development of your business when starting an incubation or receiving business support | coefficient | 1.000 | 0.176 | 0.034 | 0.296 * | 0.176 |
sig. (bilateral) | . | 0.232 | 0.818 | 0.041 | 0.233 | |
“n” | 48 | 48 | 48 | 48 | 48 | |
Control variable location at the time of incubation/business support | coefficient | 0.176 | 1.000 | −0.254 | −0.294 * | −0.121 |
sig. (bilateral) | 0.232 | . | 0.082 | 0.043 | 0.415 | |
“n” | 48 | 48 | 48 | 48 | 48 | |
Sustainability strategy | coefficient | 0.034 | −0.254 | 1.000 | 0.234 | −0.113 |
sig. (bilateral) | 0.818 | 0.082 | . | 0.109 | 0.443 | |
“n” | 48 | 48 | 48 | 48 | 48 | |
Sustainability ambition | coefficient | 0.296 * | −0.294 * | 0.234 | 1.000 | −0.160 |
sig. (bilateral) | 0.041 | 0.043 | 0.109 | . | 0.278 | |
“n” | 48 | 48 | 48 | 48 | 48 | |
Technology-oriented value creation | coefficient | 0.176 | −0.121 | −0.113 | −0.160 | 1.000 |
sig. (bilateral) | 0.233 | 0.415 | 0.443 | 0.278 | . | |
“n” | 48 | 48 | 48 | 48 | 48 |
Not | Log of Likelihood −2 | Cox’s R-Square and Snell | R-Two of Nagelkerke |
---|---|---|---|
1 | 53.405 a | 0.239 | 0.319 |
Not | Chi-Square | dof | Sig. |
---|---|---|---|
1 | 5.099 | 8 | 0.747 |
References
- Chesbrough, H.W.; Vanhaverbeke, W. Open Innovation and Public Policy in the EU with Implications for SMEs. In Researching Open Innovation in SMEs; World Scientific Publishing Company: London, UK, 2018; pp. 455–492. [Google Scholar] [CrossRef]
- Hausberg, J.P.; Korreck, S. Business Incubators and Accelerators: A Co-Citation Analysis-Based, Systematic Literature Review. J. Technol. Transf. 2020, 45, 151–176. [Google Scholar] [CrossRef]
- Weingarden, A.; Raes, S. Innovation Diffusion in Latvia. A Regional Approach; OECD Publishing: Paris, France, 2022. [Google Scholar]
- Benedetti, F.C.; Sedláček, P.; Sterk, V. EU Start-Up Calculator: Impact of COVID-19 on Aggregate Employment: Scenario Analysis for Denmark, Estonia, Finland, France, Latvia, Lithuania, Portugal and Sweden; Publication Office of the European Union: Luxembourg, 2020. [CrossRef]
- Vanderstraeten, J.; van Witteloostuijn, A.; Matthyssens, P. Organizational Sponsorship and Service Co-Development: A Contingency View on Service Co-Development Directiveness of Business Incubators. Technovation 2020, 98, 102154. [Google Scholar] [CrossRef]
- Theodoraki, C.; Messeghem, K.; Audretsch, D.B. The Effectiveness of Incubators’ Co-Opetition Strategy in the Entrepreneurial Ecosystem: Empirical Evidence From France. IEEE Trans. Eng. Manag. 2022, 69, 1781–1794. [Google Scholar] [CrossRef]
- Hull, C.E.; Millette, S.; Williams, E. Challenges and Opportunities in Building Circular-Economy Incubators: Stakeholder Perspectives in Trinidad and Tobago. J. Clean. Prod. 2021, 296, 126412. [Google Scholar] [CrossRef]
- Fichter, K.; Hurrelmann, K. Sustainability-Oriented Business Incubation: Framing and Supporting Sustainable Entrepreneurship. In Handbook of Research on Business and Technology Incubation and Acceleration; Edward Elgar Publishing: Cheltenham, UK, 2021; pp. 478–495. [Google Scholar] [CrossRef]
- Costa, J.; Matias, J.C.O. Open Innovation 4.0 as an Enhancer of Sustainable Innovation Ecosystems. Sustainability 2020, 12, 8112. [Google Scholar] [CrossRef]
- Porter, M.E. The Changing Role of Business in Society. 2021. Available online: https://www.hbs.edu/ris/Publication%20Files/20210716%20Business%20in%20Society%20Paper%20For%20Website_84139c25-9147-4137-9ae9-28e27e1710a1.pdf (accessed on 19 June 2022).
- Intrum.lv. Ilgtspēja Kā Biznesa Veiksmes Formula. Available online: https://www.intrum.lv/biznesa-risinajumi/zinas/raksti/ilgtspeja-ka-biznesa-veiksmes-formula/ (accessed on 19 August 2022).
- Sabando-Vera, D.; Yonfa-Medranda, M.; Montalván-Burbano, N.; Albors-Garrigos, J.; Parrales-Guerrero, K. Worldwide Research on Open Innovation in SMEs. J. Open Innov. Technol. Mark. Complex. 2022, 8, 20. [Google Scholar] [CrossRef]
- Cirule, I.; Uvarova, I.; Caune, G. European Trends in Business Incubation Through Open Innovation Approach. Eur. Integr. Stud. 2022, 16, 111–124. [Google Scholar] [CrossRef]
- InCSR. Ilgtspējas Indekss 2022. Korporatīvās Ilgtspējas un Atbildības Indekss. Available online: https://www.incsr.eu/novertejumi/ilgtspejas-indekss/ilgtspejas-indekss-2022/ (accessed on 19 August 2022).
- Sempere-Ripoll, F.; Estelles-Miguel, S.; Rojas-Alvarado, R.; Hervas-Oliver, J.L. Does Technological Innovation Drive Corporate Sustainability? Empirical Evidence for the European Financial Industry in Catching-up and Central and Eastern Europe Countries. Sustainability 2020, 12, 2261. [Google Scholar] [CrossRef]
- Cirule, I.; Adela, S.; Grama, M.; Ludviga, I.; Kreituss, I. Open Innovation Strategies and Business Incubation Service Impact on the Success of Incubation. In Proceedings of the 2017 International Conference “Economic Science for Rural Development”, Jelgava, Latvia, 27–28 April 2017; Volume 44, pp. 36–43. [Google Scholar]
- Oganisjana, K.; Surikova, S.; Kozlovskis, K.; Svirina, A. Financial, Organisational and Informative Involvement of the Society in Social Innovation Processes in Latvia. Entrep. Sustain. Issues 2018, 6, 456–471. [Google Scholar] [CrossRef]
- Dobele, L.; Grinberga-Zalite, G.; Kelle, L. Sustainable Economic Development: Scenarios For Promotion Of Social Innovation In Latvia. J. Secur. Sustain. Issues 2015, 5, 149–158. [Google Scholar] [CrossRef]
- Uvarova, I.; Atstaja, D.; Korpa, V. Challenges of the Introduction of Circular Business Models Within Rural SMEs OF EU. Int. J. Econ. Sci. 2020, IX, 128–149. [Google Scholar] [CrossRef]
- Baraldi, E.; Ingemansson Havenvid, M. Identifying New Dimensions of Business Incubation: A Multi-Level Analysis of Karolinska Institute’s Incubation System. Technovation 2016, 50–51, 53–68. [Google Scholar] [CrossRef]
- Chesbrough, H.; Lettl, C.; Ritter, T. Value Creation and Value Capture in Open Innovation. J. Prod. Innov. Manag. 2018, 35, 930–938. [Google Scholar] [CrossRef]
- Carayannis, E.G.; Campbell, D.F.J.; Grigoroudis, E. Helix Trilogy: The Triple, Quadruple, and Quintuple Innovation Helices from a Theory, Policy, and Practice Set of Perspectives. J. Knowl. Econ. 2022, 13, 2272–2301. [Google Scholar] [CrossRef]
- Evans, S.; Fernando, L.; Yang, M. Sustainable Value Creation—From Concept Towards Implementation. Sustainable Manufacturing; Springer: Berlin/Heidelberg, Germany, 2017; pp. 203–220. [Google Scholar] [CrossRef]
- Chesbrough, H. The Logic of Open Innovation. Calif. Manag. Rev. 2003, 45, 33–58. [Google Scholar] [CrossRef]
- Carayannis, E.G.; Campbell, D.F.J. Triple Helix, Quadruple Helix and Quintuple Helix and How Do Knowledge, Innovation and the Environment Relate to Each Other? A Proposed Framework for a Trans-Disciplinary Analysis of Sustainable Development and Social Ecology. Int. J. Soc. Ecol. Sustain. Dev. 2010, 1, 41–69. [Google Scholar] [CrossRef]
- Uvarova, I.; Platonova, I.; Rascevska, Z.; Volkova, T.; Atstaja, D. The Value Co-Creation in Circular Business Models: QuadruplexHelix Perspective. In Proceedings of the 6th International Conference on New Business Models: New Business Models in a Decadeof Action: Sustainable, Evidence-Based, Impactful, Online, 9–11 June 2021; Hoveskog, M., Halila, F., Eds.; Halmstad University: Halmstad, Sweden, 2021; pp. 382–389. [Google Scholar]
- Grama-Vigouroux, S.; Royer, I. Impact Des Parties Prenantes et de l’innovation Collaborative Sur La Création de Valeur Des Start-Ups Incubées: Le Cas Des Incubateurs d’affaires Roumains. Innovations 2020, 62, 129–160. [Google Scholar] [CrossRef]
- Carayannis, E.G.; Grigoroudis, E.; Wurth, B. OR for Entrepreneurial Ecosystems: A Problem-Oriented Review and Agenda. Eur. J. Oper. Res. 2022, 300, 791–808. [Google Scholar] [CrossRef]
- Hasche, N.; Höglund, L.; Linton, G. Quadruple Helix as a Network of Relationships: Creating Value within a Swedish Regional Innovation System. J. Small Bus. Entrep. 2020, 32, 523–544. [Google Scholar] [CrossRef]
- Barcellos-Paula, L.; de la Vega, I.; Gil-Lafuente, A.M. The Quintuple Helix of Innovation Model and the Sdgs: Latin-American Countries’ Case and Its Forgotten Effects. Mathematics 2021, 9, 416. [Google Scholar] [CrossRef]
- Carayannis, E.G.; Campbell, D.F. Developed democracies versus emerging autocracies: Arts, democracy, and innovation in Quadruple Helix innovation systems. J. Innov. Entrep. 2014, 3, 1–23. [Google Scholar] [CrossRef]
- European Business and Innovation Centre Network. Solutions. High Quality Business Support. EUBIC: Brussels, Belgium. Available online: https://ebn.eu/solutions/ (accessed on 15 June 2022).
- Pedersen, E.R.G.; Lüdeke-Freund, F.; Henriques, I.; Seitanidi, M.M. Toward Collaborative Cross-Sector Business Models for Sustainability. Bus. Soc. 2021, 60, 1039–1058. [Google Scholar] [CrossRef]
- Kujala, J.; Lehtimäki, H.; Freeman, R.E. A Stakeholder Approach to Value Creation and Leadership. Leading Change in a Complex World: Transdisciplinary Perspectives; Tampere University Press: Tampere, Finland, 2019. [Google Scholar]
- Freudenreich, B.; Lüdeke-Freund, F.; Schaltegger, S. A Stakeholder Theory Perspective on Business Models: Value Creation for Sustainability. J. Bus. Ethics 2020, 166, 3–18. [Google Scholar] [CrossRef]
- Carayannis, E.G.; Goletsis, Y.; Grigoroudis, E. Composite Innovation Metrics: MCDA and the Quadruple Innovation Helix Framework. Technol. Soc. Change 2018, 131, 4–17. [Google Scholar] [CrossRef]
- Kramer, M.R.; Pfitzer, M.W. The Ecosystem of Shared Value. Harv. Bus. Rev. 2016, 94, 80–89. [Google Scholar]
- Geissdoerfer, M.; Savaget, P.; Bocken, N.M.P.; Hultink, E.J. The Circular Economy—A New Sustainability Paradigm? J. Clean. Prod. 2017, 143, 757–768. [Google Scholar] [CrossRef]
- Lüdeke-Freund, F. Sustainable Entrepreneurship, Innovation, and Business Models: Integrative Framework and Propositions for Future Research. Bus. Strategy Environ. 2020, 29, 665–681. [Google Scholar] [CrossRef]
- Gimenez, C.; Sierra, V.; Rodon, J. Sustainable Operations: Their Impact on the Triple Bottom Line. Int. J. Prod. Econ. 2012, 140, 149–159. [Google Scholar] [CrossRef]
- Porter, M.E.; Kramer, M.R. Creating Shared Value. How to Reinvent Capitalism-and Unleash a Wave of Innovation and Growth; Harvard Business Review: Brighton, MA, USA, 2011. [Google Scholar]
- Geissdoerfer, M.; Morioka, S.N.; de Carvalho, M.M.; Evans, S. Business Models and Supply Chains for the Circular Economy. J. Clean. Prod. 2018, 190, 712–721. [Google Scholar] [CrossRef]
- Korhonen, J.; Honkasalo, A.; Seppälä, J. Circular Economy: The Concept and Its Limitations. Ecol. Econ. 2018, 143, 37–46. [Google Scholar] [CrossRef]
- Stål, H.I.; Jansson, J. Sustainable Consumption and Value Propositions: Exploring Product–Service System Practices Among Swedish Fashion Firms. Sustain. Dev. 2017, 25, 546–558. [Google Scholar] [CrossRef]
- Bocken, N.; Ritala, P. Six Ways to Build Circular Business Models. J. Bus. Strategy 2021, 43, 184–192. [Google Scholar] [CrossRef]
- Stubbs, W.; Cocklin, C. Conceptualizing a “Sustainability Business Model”. Organ. Environ. 2008, 21, 103–127. [Google Scholar] [CrossRef]
- Schaltegger, S.; Lüdeke-Freund, F.; Hansen, E.G. Business Cases for Sustainability: The Role of Business Model Innovation for Corporate Sustainability. Int. J. Innov. Sustain. Dev. 2012, 6, 95–119. [Google Scholar] [CrossRef]
- Schaltegger, S.; Hansen, E.G.; Lüdeke-Freund, F. Business Models for Sustainability. Organ. Environ. 2016, 29, 3–10. [Google Scholar] [CrossRef]
- Lopes, J.M.; Gomes, S.; Oliveira, J.; Oliveira, M. The Role of Open Innovation, and the Performance of European Union Regions. J. Open Innov. Technol. Mark. Complex. 2021, 7, 120. [Google Scholar] [CrossRef]
- Porter, M.E.; van der Linde, C. Green and Competitive: Ending the Stalemate Harvard Business Review. Harv. Bus. Rev. 1995, 95507, 120–134. [Google Scholar]
- Díaz-García, C.; González-Moreno, Á.; Sáez-Martínez, F.J. Eco-Innovation: Insights from a Literature Review. Innovation 2015, 17, 6–23. [Google Scholar] [CrossRef]
- De Jesus, A.; Lammi, M.; Domenech, T.; Vanhuyse, F.; Mendonça, S. Eco-Innovation Diversity in a Circular Economy: Towards Circular Innovation Studies. Sustainability 2021, 13, 10974. [Google Scholar] [CrossRef]
- Cillo, V.; Petruzzelli, A.M.; Ardito, L.; del Giudice, M. Understanding Sustainable Innovation: A Systematic Literature Review. Corp. Soc. Responsib. Environ. Manag. 2019, 26, 1012–1025. [Google Scholar] [CrossRef]
- Konietzko, J.; Bocken, N.; Hultink, E.J. Circular Ecosystem Innovation: An Initial Set of Principles. J. Clean. Prod. 2020, 253, 119942. [Google Scholar] [CrossRef]
- Boons, F.; Lüdeke-Freund, F. Business Models for Sustainable Innovation: State-of-the-Art and Steps towards a Research Agenda. J. Clean. Prod. 2013, 45, 9–19. [Google Scholar] [CrossRef]
- Bakry, D.S.; Daim, T.; Dabic, M.; Yesilada, B. An Evaluation of the Effectiveness of Innovation Ecosystems in Facilitating the Adoption of Sustainable Entrepreneurship. J. Small Bus. Manag. 2022, 1–27. [Google Scholar] [CrossRef]
- Business Models for the Circular Economy Opportunities and Challenges from a Policy Perspective RE-CIRCLE Resource Efficiency & Circular Economy Project; OECD: Paris, France, 2018.
- Aagaard, A.; Saari, U.A.; Mäkinen, S.J. Mapping the Types of Business Experimentation in Creating Sustainable Value: A Case Study of Cleantech Start-Ups. J. Clean. Prod. 2021, 279, 123182. [Google Scholar] [CrossRef]
- Uvarova, I.; Atstaja, D.; Korpa, V.; Avena, L.; Erdmanis, M. End-of-Life Tyre Recycling: Going beyond to New Circular Business Models in Latvia. In Engineering for Rural Development; LLU: Jelgava, Latvia, 2020; Volume 19. [Google Scholar] [CrossRef]
- Maastricht Sustainability Institute (MSI). Case Studies of Circular Business Models. Available online: https://www.circularx.eu/en/cases (accessed on 22 July 2022).
- Kuckertz, A.; Berger, E.S.C.; Gaudig, A. Responding to the Greatest Challenges? Value Creation in Ecological Startups. J. Clean. Prod. 2019, 230, 1138–1147. [Google Scholar] [CrossRef]
- Bandera, C.; Thomas, E. The Role of Innovation Ecosystems and Social Capital in Startup Survival. IEEE Trans. Eng. Manag. 2019, 66, 542–551. [Google Scholar] [CrossRef]
- Oh, D.S.; Phillips, F.; Park, S.; Lee, E. Innovation Ecosystems: A Critical Examination. Technovation 2016, 54, 1–6. [Google Scholar] [CrossRef]
- Osorno-Hinojosa, R.; Koria, M.; Ramírez-Vázquez, D.D.C. Open Innovation with Value Co-Creation from University–Industry Collaboration. J. Open Innov. Technol. Mark. Complex. 2022, 8, 32. [Google Scholar] [CrossRef]
- Veleva, V.; Bodkin, G. Emerging Drivers and Business Models for Equipment Reuse and Remanufacturing in the US: Lessons from the Biotech Industry. J. Environ. Plan. Manag. 2018, 61, 1631–1653. [Google Scholar] [CrossRef]
- Steffen, W.; Persson, Å.; Deutsch, L.; Zalasiewicz, J.; Williams, M.; Richardson, K.; Crumley, C.; Crutzen, P.; Folke, C.; Gordon, L.; et al. The Anthropocene: From Global Change to Planetary Stewardship. Ambio 2011, 40, 739–761. [Google Scholar] [CrossRef]
- Whiteman, G.; Walker, B.; Perego, P. Planetary Boundaries: Ecological Foundations for Corporate Sustainability. J. Manag. Stud. 2013, 50, 307–336. [Google Scholar] [CrossRef]
- Steffen, W.; Richardson, K.; Rockström, J.; Cornell, S.E.; Fetzer, I.; Bennett, E.M.; Biggs, R.; Carpenter, S.R.; de Vries, W.; de Wit, C.A.; et al. Planetary Boundaries: Guiding Human Development on a Changing Planet. Science 2015, 347, 1259855. [Google Scholar] [CrossRef]
- Uvarova, I.; Mavlutova, I.; Atstaja, D. Development of the Green Entrepreneurial Mindset through Modern Entrepreneurship Education. IOP Conf.Ser. Earth Environ.Sci. 2021, 628, 012034. [Google Scholar] [CrossRef]
- Cabral, C.; Lochan Dhar, R. Green Competencies: Construct Development and Measurement Validation. J. Clean. Prod. 2019, 235, 887–900. [Google Scholar] [CrossRef]
- Hermes, J.; Rimanoczy, I. Deep Learning for a Sustainability Mindset. Int. J. Manag. Educ. 2018, 16, 460–467. [Google Scholar] [CrossRef]
- Baumgartner, R.J.; Ebner, D. Corporate Sustainability Strategies: Sustainability Profiles and Maturity Levels. Sustain. Dev. 2010, 18, 76–89. [Google Scholar] [CrossRef]
- Barber, N.; Taylor, C.; Strick, S. Wine Consumers’ Environmental Knowledge and Attitudes: Influence on Willingness to Purchase. Int. J. Wine Res. 2009, 1, 59–72. [Google Scholar] [CrossRef] [Green Version]
- Etzion, D. Research on Organizations and the Natural Environment, 1992-Present: A Review. J. Manage. 2007, 33, 637–664. [Google Scholar] [CrossRef]
- De Faria, V.F.; Santos, V.P.; Zaidan, F.H. The Business Model Innovation and Lean Startup Process Supporting Startup Sustainability. Procedia Comput. Sci. 2021, 181, 93–101. [Google Scholar] [CrossRef]
- Bocken, N.M.P. Sustainable Venture Capital—Catalyst for Sustainable Start-up Success? J. Clean. Prod. 2015, 108, 647–658. [Google Scholar] [CrossRef]
- Burcharth, A.L.d.A.; Knudsen, M.P.; Søndergaard, H.A. Neither Invented nor Shared Here: The Impact and Management of Attitudes for the Adoption of Open Innovation Practices. Technovation 2014, 34, 149–161. [Google Scholar] [CrossRef]
- Elia, G.; Margherita, A.; Passiante, G. Digital Entrepreneurship Ecosystem: How Digital Technologies and Collective Intelligence Are Reshaping the Entrepreneurial Process. Technol. Soc. Change 2020, 150, 119791. [Google Scholar] [CrossRef]
- Grama-Vigouroux, S.; Saidi, S.; Berthinier-Poncet, A.; Vanhaverbeke, W.; Madanamoothoo, A. From Closed to Open: A Comparative Stakeholder Approach for Developing Open Innovation Activities in SMEs. J. Bus. Res. 2020, 119, 230–244. [Google Scholar] [CrossRef]
- Montelisciani, G.; Gabelloni, D.; Tazzini, G.; Fantoni, G. Skills and Wills: The Keys to Identify the Right Team in Collaborative Innovation Platforms. Technol. Anal. Strat. Manag. 2014, 26, 687–702. [Google Scholar] [CrossRef]
- Holzmann, T.; Sailer, K.; Galbraith, B.; Katzy, B.R. Matchmaking for Open Innovation – Theoretical Perspectives Based on Interaction, Rather than Transaction. Technol. Anal. Strat. Manag. 2014, 26, 595–599. [Google Scholar] [CrossRef]
- Van de Vrande, V.; de Jong, J.P.J.; Vanhaverbeke, W.; de Rochemont, M. Open Innovation in SMEs: Trends, Motives and Management Challenges. Technovation 2009, 29, 423–437. [Google Scholar] [CrossRef]
- Lee, S.; Park, G.; Yoon, B.; Park, J. Open Innovation in SMEs—An Intermediated Network Model. Res. Policy 2010, 39, 290–300. [Google Scholar] [CrossRef]
- Wynarczyk, P.; Piperopoulos, P.; McAdam, M. Open Innovation in Small and Medium-Sized Enterprises: An Overview. Int. Small Bus. J. Res. Entrep. 2013, 31, 240–255. [Google Scholar] [CrossRef]
- Mikelsone, E.; Segers, J.-P.; Spilbergs, A. Governance of Web-Based Idea Management System Rewards: From the Perspective of Open Innovation. J. Open Innov. Technol. Mark. Complex. 2022, 8, 97. [Google Scholar] [CrossRef]
- Mikelsone, E.; Spilbergs, A.; Volkova, T.; Liela, E. Idea Management Systems in Developing Innovation Capacity. Int. J. Innov. Technol. Manag. 2022, 19, 2240001. [Google Scholar] [CrossRef]
- Gerlach, S.; Brem, A. Idea Management Revisited: A Review of the Literature and Guide for Implementation. Int. J. Innov. Stud. 2017, 1, 144–161. [Google Scholar] [CrossRef]
- Tsai, F.S.; Hsieh, L.H.Y.; Fang, S.C.; Lin, J.L. The Co-Evolution of Business Incubation and National Innovation Systems in Taiwan. Technol. Soc. Change 2009, 76, 629–643. [Google Scholar] [CrossRef]
- Zykiene, I.; Laučienė, R.; Daugėlienė, R.; Leskauskienė, A. Strengthening Lithuanian—Latvian Cross—Border Cooperation in the Context of International Trade. Eur. Integr. Stud. 2021, 1, 138–159. [Google Scholar] [CrossRef]
- Franco, M.; Haase, H.; Rodini, A. The Role of Incubators in the Internationalization Process of Incubated SMEs: A Perspective of International Cooperation. Glob. Bus. Rev. 2020, 097215092091938. [Google Scholar] [CrossRef]
- Gao, Q.; Cui, L.; Lew, Y.K.; Li, Z.; Khan, Z. Business Incubators as International Knowledge Intermediaries: Exploring Their Role in the Internationalization of Start-Ups from an Emerging Market. J. Int. Manag. 2021, 27, 100861. [Google Scholar] [CrossRef]
- Hansen, T.M.; Chesbrough, W.H.; Nohria, N.; Sull, N.D. Networked Incubators. Harv. Bus. Rev. 2000, 78, 74–84. [Google Scholar]
- Kambil, A.; Eselius, E.D.; Monteiro, K.A. Fast Venturing: The Quick Way To Start Web Businesses. Sloan. Manag. Rev. 2000, 41, 55. [Google Scholar]
- Ferreras-Méndez, J.L.; Fernández-Mesa, A.; Alegre, J. Export Performance in SMEs: The Importance of External Knowledge Search Strategies and Absorptive Capacity. Manag. Int. Rev. 2019, 59, 413–437. [Google Scholar] [CrossRef]
- Spender, J.-C.; Corvello, V.; Grimaldi, M.; Rippa, P. Startups and Open Innovation: A Review of the Literature. Eur. J. Innov. Manag. 2017, 20, 4–30. [Google Scholar] [CrossRef]
- Saeed, M.A.; Kersten, W. Drivers of Sustainable Supply Chain Management: Identification and Classification. Sustainability 2019, 11, 1137. [Google Scholar] [CrossRef]
- De Jesus, A.; Mendonça, S. Lost in Transition? Drivers and Barriers in the Eco-Innovation Road to the Circular Economy. Ecol. Econ. 2018, 145, 75–89. [Google Scholar] [CrossRef]
- Du, S.; Yalcinkaya, G.; Bstieler, L. Sustainability, Social Media Driven Open Innovation, and New Product Development Performance*. J. Prod. Innov. Manag. 2016, 33, 55–71. [Google Scholar] [CrossRef]
- Tiba, S.; van Rijnsoever, F.J.; Hekkert, M.P. Sustainability Startups and Where to Find Them: Investigating the Share of Sustainability Startups across Entrepreneurial Ecosystems and the Causal Drivers of Differences. J. Clean. Prod. 2021, 306, 127054. [Google Scholar] [CrossRef]
- Geissdoerfer, M.; Pieroni, M.P.P.; Pigosso, D.C.A.; Soufani, K. Circular Business Models: A Review. J. Clean. Prod. 2020, 277, 123741. [Google Scholar] [CrossRef]
- Bocken, N.M.P.; Rana, P.; Short, S.W. Value Mapping for Sustainable Business Thinking. J. Ind. Prod. Eng. 2015, 32, 67–81. [Google Scholar] [CrossRef]
- Barile, S.; Grimaldi, M.; Loia, F.; Sirianni, C.A. Technology, Value Co-Creation and Innovation in Service Ecosystems: Toward Sustainable Co-Innovation. Sustainability 2020, 12, 2759. [Google Scholar] [CrossRef]
- European Commission. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions; The European Green Deal: Brussels, Belgium, 2019.
- United Nations. The Sustainable Development Goals Report 2021; United Nations Publications: New York, NY, USA, 2021.
- Halkos, G.; Gkampoura, E.-C. Where Do We Stand on the 17 Sustainable Development Goals? An Overview on Progress. Econ. Anal. Policy 2021, 70, 94–122. [Google Scholar] [CrossRef]
- Latvijas Investīciju un Attīstības Aģentūra. Par Biznesa Inkubatoriem. Available online: https://www.liaa.gov.lv/lv/biznesa-inkubatori/par-projektu. (accessed on 25 June 2022).
- Cirule, I. Business Incubation Guidelines and Open Innovation. In Proceedings of the 2022 International Conference “Economic Science for Rural Development”, Jelgava, Latvia, 11–13 May 2022; pp. 435–446. [Google Scholar] [CrossRef]
- DeCampos, H.A.; Fawcett, S.E.; Melnyk, S.A. Collaboration Expectation Gaps, Transparency and Integrated NPD Performance: A Multi-Case Study. J. Purch. Supply Manag. 2022, 100789. [Google Scholar] [CrossRef]
- Gibbert, M.; Ruigrok, W.; Wicki, B. What Passes as a Rigorous Case Study? Strateg. Manag. J. 2008, 29, 1465–1474. [Google Scholar] [CrossRef]
- Hildén, M.; Jordan, A.; Huitema, D. Special Issue on Experimentation for Climate Change Solutions Editorial: The Search for Climate Change and Sustainability Solutions—The Promise and the Pitfalls of Experimentation. J. Clean. Prod. 2017, 169, 1–7. [Google Scholar] [CrossRef]
- Gaurav, J.K.; Rathi, V.; Burnwal, K.; Chaturvedi, A. Green Startups in India: Challenges and Opportunities. J. Gov. Spec. Issue Environ. 2019, 18, 235–244. [Google Scholar]
- Rabadjieva, M.; Terstriep, J. Ambition Meets Reality: Mission-Oriented Innovation Policy as a Driver for Participative Governance. Sustainability 2021, 13, 231. [Google Scholar] [CrossRef]
- Zizi, Y.; Jamali-Alaoui, A.; el Goumi, B.; Oudgou, M.; el Moudden, A. An Optimal Model of Financial Distress Prediction: A Comparative Study between Neural Networks and Logistic Regression. Risks 2021, 9, 200. [Google Scholar] [CrossRef]
- Lin-Lian, C.; De-Pablos-Heredero, C.; Montes-Botella, J.L. Value Creation of Business Incubator Functions: Economic and Social Sustainability in the Covid-19 Scenario. Sustainability 2021, 13, 6888. [Google Scholar] [CrossRef]
- Klofsten, M.; Lundmark, E.; Wennberg, K.; Bank, N. Incubator Specialization and Size: Divergent Paths towards Operational Scale. Technol. Soc. Change 2020, 151, 119821. [Google Scholar] [CrossRef]
- Rovanto, I.K.; Bask, A. Systemic Circular Business Model Application at the Company, Supply Chain and Society Levels—A View into Circular Economy Native and Adopter Companies. Bus. Strategy Environ. 2021, 30, 1153–1173. [Google Scholar] [CrossRef]
- Rutitis, D.; Smoca, A.; Uvarova, I.; Brizga, J.; Atstaja, D.; Mavlutova, I. Sustainable Value Chain of Industrial Biocomposite Consumption: Influence of COVID-19 and Consumer Behavior. Energies 2022, 15, 466. [Google Scholar] [CrossRef]
- Porter, E.M. The Competitive Advantage: Creating and Sustaining Superior Performance; Free Press: New York, NY, USA, 1985. [Google Scholar]
- Konietzko, J.; Bocken, N.; Hultink, E.J. A Tool to Analyze, Ideate and Develop Circular Innovation Ecosystems. Sustainability 2020, 12, 417. [Google Scholar] [CrossRef]
- Aarikka-Stenroos, L.; Ritala, P. Network Management in the Era of Ecosystems: Systematic Review and Management Framework. Ind. Mark. Manag. 2017, 67, 23–36. [Google Scholar] [CrossRef]
- Nylund, P.A.; Brem, A.; Agarwal, N. Innovation Ecosystems for Meeting Sustainable Development Goals: The Evolving Roles of Multinational Enterprises. J. Clean. Prod. 2021, 281, 125329. [Google Scholar] [CrossRef]
- Grosse, M.; Pohlisch, J.; Korbel, J.J. Triggers of Collaborative Innovation in Online User Communities. J. Open Innov. Technol. Mark. Complex. 2018, 4, 59. [Google Scholar] [CrossRef]
- Yin, D.; Ming, X.; Zhang, X. Sustainable and Smart Product Innovation Ecosystem: An Integrative Status Review and Future Perspectives. J. Clean. Prod. 2020, 274, 123005. [Google Scholar] [CrossRef]
- Leydesdorff, L. The Triple Helix, Quadruple Helix, …, and an N-Tuple of Helices: Explanatory Models for Analyzing the Knowledge-Based Economy? J. Knowl. Econ. 2012, 3, 25–35. [Google Scholar] [CrossRef]
- Cunningham, J.A.; Menter, M.; O’Kane, C. Value Creation in the Quadruple Helix: A Micro Level Conceptual Model of Principal Investigators as Value Creators. RD Manag. 2018, 48, 136–147. [Google Scholar] [CrossRef]
- Champenois, C.; Etzkowitz, H. From Boundary Line to Boundary Space: The Creation of Hybrid Organizations as a Triple Helix Micro-Foundation. Technovation 2018, 76, 28–39. [Google Scholar] [CrossRef]
Internal validity | The research framework was designed based on the literature review exploring key concepts, describing previously identified relationships between variables and constructing the theoretical conceptual model. The main highlights from previous research were compared and analysed in the context of the business incubators of LIDA and incubated start-ups. Though the theory triangulation we conceptualised main gaps and issues of this research, specified key theoretical concepts and interpreted them in relation to the results. |
Construct validity | This research framework followed the data triangulation principles. There were clear and precise guidelines developed for the semi-structured interviews. The interview questions were defined based on the literature review. Authors of this study performed original interviews by phone, Zoom or in written form and prepared transcripts for all interviews. Transcripts were reviewed by the consultative group of other academics (see Acknowledgments of this Article). The survey questions were defined based on the literature review and interviews. Survey questions were tested and validated before launching the pilot survey. The results and their interpretation were discussed within focus group discussions. |
External validity | The pilot survey was conducted in business incubators of LIDA, which represent publicly-funded business incubators and the largest population of incubated start-ups in Latvia since 2011. This provides a clear justification for selection of LIDA’s incubators for the pilot study in Latvia. The respondents of the pilot survey were incubated start-ups receiving incubation services (located in incubators) during the pilot study. The number of valid answers obtained in the pilot survey is not statistically significant (n = 48), but it covers the convenient part (24%) of all incubated tenants. In order to generalize the data, validate results and conclusions obtained in the pilot survey, semi-structured interviews and focus group discussions were conducted. In total 33 semi-structured interviews were conducted interviewing 18 incubator managers and 15 experts. A variety of experts invited to interviews ensured different perspectives and opinions about the research questions. |
Reliability | The pilot study was conducted assuming the transparency and replication in all steps and research methods. All interview guidelines have been developed and discussed with other scholars and are available for other future studies. Survey questions are tested with experts and discussed in focus group discussions, also, presented in Appendix A of this Article. Throughout the study the anonymity of informants, their answers, opinions, and other personal data were ensured. The methodological framework of the research included the study of foreign cases (from Finland and Estonia), which validates the replication of both—research instruments and results of this research. |
Orientation of the Sustainable Value Creation | YES | NO |
---|---|---|
Technology-driven value creation | 50% | 50% |
Organizationally-driven value creation | 43.70% | 56.30% |
Socially-driven value creation | 27.10% | 72.90% |
No | % | |
---|---|---|
Just an idea | 2 | 4.2% |
Minimum viable product | 26 | 54.1% |
Active action or sales | 20 | 41.7% |
No | % | |
---|---|---|
On-site at the incubator’s premises | 0 | 0% |
Virtual incubation | 9 | 18.7% |
Combined—virtual and face-to-face | 39 | 81.3% |
YES, % | Average | Median | |
---|---|---|---|
Climate change | 45.8% | 1.5 | 2.0 |
Biodiversity loss | 10.4% | 1.9 | 2.0 |
Ocean (water) acidification | 4.2% | 2.0 | 2.0 |
Exhaustion of atmospheric ozone | 4.2% | 2.0 | 2.0 |
Global freshwater consumption | 2.1% | 2.0 | 2.0 |
Agricultural land use change | 10.4% | 1.9 | 2.0 |
Nitrogen and phosphorus production | 4.2% | 2.0 | 2.0 |
Atmospheric pollution load | 8.3% | 1.9 | 2.0 |
Chemical pollution | 6.2% | 1.9 | 2.0 |
n | Average, % | |
---|---|---|
Compensating for harmful actions in one area by doing good in another | 13 | 27.1% |
Be sustainable without harming the environment or society | 24 | 50.0% |
Be sustainable by rethinking all actions to promote positive environmental or social impacts far beyond the company | 11 | 22.9% |
Variables | B | E.S | Wald | ddl | Sig. | Exp(B) |
---|---|---|---|---|---|---|
Control Variable The stage of development of your business when starting an incubation or receiving business support | 0.927 | 0.700 | 1.754 | 1 | 0.185 | 2.526 |
Control Variable Please indicate your location at the time of incubation | 0.208 | 1.017 | 0.042 | 1 | 0.838 | 1.231 |
Sustainability strategy | −0.020 | 0.493 | 0.002 | 1 | 0.968 | 0.980 |
Sustainability ambition | −1.728 | 0.922 | 3.513 | 1 | 0.061 | 0.178 |
Planetary Boundary (climate change) | 1.164 | 0.698 | 2.781 | 1 | 0.095 | 3.202 |
Constant | −2.391 | 3.689 | 0.420 | 1 | 0.517 | 0.091 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Cirule, I.; Uvarova, I. Open Innovation and Determinants of Technology-Driven Sustainable Value Creation in Incubated Start-Ups. J. Open Innov. Technol. Mark. Complex. 2022, 8, 162. https://doi.org/10.3390/joitmc8030162
Cirule I, Uvarova I. Open Innovation and Determinants of Technology-Driven Sustainable Value Creation in Incubated Start-Ups. Journal of Open Innovation: Technology, Market, and Complexity. 2022; 8(3):162. https://doi.org/10.3390/joitmc8030162
Chicago/Turabian StyleCirule, Iveta, and Inga Uvarova. 2022. "Open Innovation and Determinants of Technology-Driven Sustainable Value Creation in Incubated Start-Ups" Journal of Open Innovation: Technology, Market, and Complexity 8, no. 3: 162. https://doi.org/10.3390/joitmc8030162
APA StyleCirule, I., & Uvarova, I. (2022). Open Innovation and Determinants of Technology-Driven Sustainable Value Creation in Incubated Start-Ups. Journal of Open Innovation: Technology, Market, and Complexity, 8(3), 162. https://doi.org/10.3390/joitmc8030162