A Multi-Dimensional Framework for Assessing the Societal Benefits of Collaborative R&I Projects Over Time
Downloads
This paper contributes to the ongoing discussion on assessing the actual societal benefits of collaborative research and innovation (R&I) projects, focusing specifically on Circular Bioeconomy (CBE) initiatives funded under European Interreg programs. Utilizing an abductive method aligned with a grounded theory approach, the study conducted a multiple case study of five cross-border CBE projects. Data from project leaders and secondary sources underwent inductive content analysis and were classified using the Triple Bottom Line (TBL) framework. Seven cross-cutting benefit categories emerged: capacity building, collaborative learning, community empowerment, networking, knowledge sharing, policy development, and sustainable business practices, identified as influencing results across TBL dimensions temporally. Findings reveal projects excel at generating short/medium-term outputs and outcomes strongly aligned with the social dimension, particularly through capacity building, collaborative learning, and knowledge sharing. Over time, long-term impacts demonstrate a more balanced distribution across all three TBL dimensions (social, environmental, and economic), indicating a trajectory towards broader benefits. Policy development and networking are emphasized as key drivers for achieving significant long-term, multi-dimensional impacts. This study introduces a novel, empirically grounded, multi-dimensional theoretical model. By inductively categorizing benefits and analyzing their temporal manifestation across TBL, it provides a practical framework for assessing comprehensive societal impact beyond conventional output metrics.
Downloads
[1] Venkatesh, G. (2022). Circular Bio-economy—Paradigm for the Future: Systematic Review of Scientific Journal Publications from 2015 to 2021. Circular Economy and Sustainability, 2(1), 231–279. doi:10.1007/s43615-021-00084-3.
[2] Neves, A., Godina, R., Azevedo, S. G., & Matias, J. C. O. (2020). A comprehensive review of industrial symbiosis. Journal of Cleaner Production, 247. doi:10.1016/j.jclepro.2019.119113.
[3] Biggeri, M., & Ferrannini, A. (2020). Framing R&I for transformative change towards sustainable development in the European Union, Brussels, Belgium. doi:10.2777/503127.
[4] Santos, J. M. R. C. A., & Fernandes, G. (2024). Prioritizing Stakeholders in Collaborative Research and Innovation Projects Toward Sustainability. Project Management Journal, 55(4), 423–440. doi:10.1177/87569728241231266.
[5] Nepelski, D., & Piroli, G. (2018). Organizational diversity and innovation potential of EU-funded research projects. Journal of Technology Transfer, 43(3), 615–639. doi:10.1007/s10961-017-9624-6.
[6] Kostopoulos, K. C., Spanos, Y., Soderquist, K. E., Prastacos, G., & Vonortas, N. S. (2019). Market-, Firm-, and Project-Level Effects on the Innovation Impact of Collaborative R&D Projects. Journal of the Knowledge Economy, 10(4), 1384–1403. doi:10.1007/s13132-015-0342-8.
[7] Spanos, Y. E., Vonortas, N. S., & Voudouris, I. (2015). Antecedents of innovation impacts in publicly funded collaborative R&D projects. Technovation, 36, 53–64. doi:10.1016/j.technovation.2014.07.010.
[8] Ippoliti, R., Ramello, G. B., & Scherer, F. M. (2021). Partnership and innovation in the pharmaceutical industry: the case of clinical research. Economics of Innovation and New Technology, 30(3), 317–334. doi:10.1080/10438599.2019.1701782.
[9] Liu, H., Liu, Z., Lai, Y., & Li, L. (2021). Factors influencing collaborative innovation project performance: the case of China. Sustainability (Switzerland), 13(13), 1–19. doi:10.3390/su13137380.
[10] Yang, Z., & Xu, Y. (2021). The role of collaboration breadth attributes in research project and innovation: The example of national funded projects in china. Sustainability (Switzerland), 13(3), 1–16. doi:10.3390/su13031362.
[11] Schiebel, E., Eichler, M., Kalcik, R., Scherngell, T., Wagner, C., & Weber, K. M. (2019). A framework to measure the impact of science of a research organization. ISSI 2019 - 17th International Conference on Scientometrics & Infometrics, 2-5 September, 2019, Rome, Italy.
[12] Ferreira, P., Rocha, A., Araujo, M., Afonso, J. L., Antunes, C. H., Lopes, M. A. R., Osório, G. J., Catalão, J. P. S., & Lopes, J. P. (2023). Assessing the societal impact of smart grids: Outcomes of a collaborative research project. Technology in Society, 72, 102164. doi:10.1016/j.techsoc.2022.102164.
[13] Koskinen, I. (2023). Societal Impact in Research Col l aborations beyond the Boundaries of Science. Perspectives on Science, 31(6), 744–770. doi:10.1162/posc_a_00593.
[14] Cassi, L., Corrocher, N., Malerba, F., & Vonortas, N. (2008). The impact of EU-funded research networks on knowledge diffusion at the regional level. Research Evaluation, 17(4), 283–293. doi:10.3152/095820208X364535.
[15] Ruan, J., Zhang, W., & Hu, Z. (2024). The connection between academic achievements and market demand: The role and practice of technology and innovation in knowledge transfer. Edelweiss Applied Science and Technology, 8(6), 6165–6175. doi:10.55214/25768484.v8i6.3349.
[16] Xu, L., Ding, R., & Wang, L. (2022). How to facilitate knowledge diffusion in collaborative innovation projects by adjusting network density and project roles. Scientometrics, 127(3), 1353–1379. doi:10.1007/s11192-021-04255-9.
[17] Isomursu, M., Wallin, A., & Jaekel, M. (2016). Commercialisation challenges of European collaborative innovation projects addressing silver markets. International Journal of Business Innovation and Research, 10(2–3), 300–321. doi:10.1504/IJBIR.2016.074831.
[18] Ozga, J. (2013). Acts of construction: The conditions of collaboration. A response to vassiliki papatsiba. Policy Futures in Education, 11(4), 453–455. doi:10.2304/pfie.2013.11.4.453.
[19] Arsalan, M., Mubin, O., & Mahmud, A. Al. (2024). Dynamic interactions of research, publication, researchers, institutions, and countries: A Quintuple Helix model perspective on research impact. Malaysian Journal of Library and Information Science, 29(2), 19–59. doi:10.22452/mjlis.vol29no2.2.
[20] Rantala, T., Ukko, J., & Saunila, M. (2021). The Role of Performance Measurement in University-Industry Collaboration Projects as a Part of Managing Triple Helix Operations. Triple Helix, 8(3), 405–444. doi:10.1163/21971927-bja10011.
[21] Olsson, A. K., Bernhard, I., Arvemo, T., & Lundh Snis, U. (2020). A conceptual model for university-society research collaboration facilitating societal impact for local innovation. European Journal of Innovation Management, 24(4), 1335–1353. doi:10.1108/EJIM-04-2020-0159.
[22] Chai, S., & Shih, W. (2016). Bridging science and technology through academic-industry partnerships. Research Policy, 45(1), 148–158. doi:10.1016/j.respol.2015.07.007.
[23] Brandão, A. S., & Santos, J. M. R. C. A. (2023). On the societal impact of publicly funded Circular Bioeconomy research in Europe. Research Evaluation, 32(2), 441–457. doi:10.1093/reseval/rvad002.
[24] Brandão, A. S., Gonçalves, A., & Santos, J. M. R. C. A. (2021). Circular bioeconomy strategies: From scientific research to commercially viable products. Journal of Cleaner Production, 295. doi:10.1016/j.jclepro.2021.126407.
[25] Adil, M., Nasir, A., Sikandar, A., & Khan, N. M. (2022). Recent Advances in Circular Bioeconomy. Waste-to-Energy. Springer, Cham, Switzerland. doi:10.1007/978-3-030-91570-4_3.
[26] Filimonau, V., & Ermolaev, V. A. (2022). Exploring the potential of industrial symbiosis to recover food waste from the foodservice sector in Russia. Sustainable Production and Consumption, 29, 467–478. doi:10.1016/j.spc.2021.10.028.
[27] Bijon, N., Wassenaar, T., Junqua, G., & Dechesne, M. (2022). Towards a Sustainable Bioeconomy through Industrial Symbiosis: Current Situation and Perspectives. Sustainability (Switzerland), 14(3), 1–24. doi:10.3390/su14031605.
[28] Stegmann, P., Londo, M., & Junginger, M. (2020). The circular bioeconomy: Its elements and role in European bioeconomy clusters. Resources, Conservation and Recycling: X, 6(January), 100029. doi:10.1016/j.rcrx.2019.100029.
[29] Lokesh, K., Ladu, L., & Summerton, L. (2018). Bridging the gaps for a “circular” bioeconomy: Selection criteria, bio-based value chain and stakeholder mapping. Sustainability (Switzerland), 10(6), 1695. doi:10.3390/su10061695.
[30] Barbosa, J., Fernandes, G., Tereso, A. (2023). Benefits of University-Industry R&D Collaborations: A Systematic Literature Review. Innovations in Industrial Engineering II. icieng 2022, Lecture Notes in Mechanical Engineering, Springer, Cham, Switzerland. doi:10.1007/978-3-031-09360-9_22.
[31] Kardung, M., Cingiz, K., Costenoble, O., Delahaye, R., Heijman, W., Lovrić, M., van Leeuwen, M., M’Barek, R., van Meijl, H., Piotrowski, S., Ronzon, T., Sauer, J., Verhoog, D., Verkerk, P. J., Vrachioli, M., Wesseler, J. H. H., & Zhu, B. X. (2021). Development of the Circular Bioeconomy: Drivers and Indicators. Sustainability, 13(1), 413. doi:10.3390/su13010413.
[32] CBE (2025). Circular Bio-based Europe Joint Undertaking. Available online: https://www.cbe.europa.eu/ (accessed on June 2025).
[33] European Union. (2019). Fact Sheets on the European Union. Publications Office of the European Union, Brussels, Belgium.
[34] Korhonen, J. E., Koskivaara, A., Makkonen, T., Yakusheva, N., & Malkamäki, A. (2021). Resilient cross-border regional innovation systems for sustainability? A systematic review of drivers and constraints. Innovation: The European Journal of Social Science Research, 34(2), 202–221. doi:10.1080/13511610.2020.1867518.
[35] Aiello, E., Donovan, C., Duque, E., Fabrizio, S., Flecha, R., Holm, P., Molina, S., Oliver, E., & Reale, E. (2021). Effective strategies that enhance the social impact of social sciences and humanities research. Evidence and Policy, 17(1), 131–146. doi:10.1332/174426420X15834126054137.
[36] de Almeida, L., Augusto de Jesus Pacheco, D., Caten, C. S. ten, & Jung, C. F. (2021). A methodology for identifying results and impacts in technological innovation projects. Technology in Society, 66, 101574. doi:10.1016/j.techsoc.2021.101574.
[37] Hill, S. (2016). Assessing (For) impact: Future assessment of the societal impact of research. Palgrave Communications, 2(May), 1–7. doi:10.1057/palcomms.2016.73.
[38] Hiruy, K., & Wallo, M. T. (2018). Impact assessment: Assessing the social dimensions of fisheries research projects in the Asia-pacific region. Impact Assessment and Project Appraisal, 36(6), 444–455. doi:10.1080/14615517.2018.1500090.
[39] Al-Ashaab, A., Flores, M., Doultsinou, A., & Magyar, A. (2011). A balanced scorecard for measuring the impact of industry-university collaboration. Production Planning and Control, 22(5–6), 554–570. doi:10.1080/09537287.2010.536626.
[40] Vicente, M. R., Garciá-Muñiz, A. S., & Billón, M. (2020). Exploring European-funded project-based networks in ICT and their links with regional total factor productivity: The FP7 and the CIP. Research Evaluation, 29(4), 441–455. doi:10.1093/reseval/rvaa020.
[41] Nepelski, D., Van Roy, V., & Pesole, A. (2019). The organisational and geographic diversity and innovation potential of EU-funded research networks. Journal of Technology Transfer, 44(2), 359–380. doi:10.1007/s10961-018-9692-2.
[42] González-Piñero, M., Páez-Avilés, C., Juanola-Feliu, E., & Samitier, J. (2021). Cross-fertilization of knowledge and technologies in collaborative research projects. Journal of Knowledge Management, 25(11), 34–59. doi:10.1108/JKM-04-2020-0270.
[43] 46-Hilkenmeier, F., Fechtelpeter, C., & Decius, J. (2021). How to foster innovation in SMEs: evidence of the effectiveness of a project-based technology transfer approach. Journal of Technology Transfer, 1–29. doi:10.1007/s10961-021-09913-x.
[44] Zhao, X., Liu, Y., Lang, X., Liu, K., Yang, X., & Liu, L. (2024). Study on the Characteristics and Operational Mechanisms of Industry–University–Research Collaborative Innovation in Megaprojects: The Case from China. Systems, 12(12), 1–26. doi:10.3390/systems12120553.
[45] Ancona, A., Cerqueti, R., & Grassi, R. (2024). How do partner selection strategies affect the amount of funding in collaborative research projects? Evidence using the dual-projection approach. Technological Forecasting and Social Change, 208(September), 123744. doi:10.1016/j.techfore.2024.123744.
[46] Vieira, E. S. (2023). The influence of research collaboration on citation impact: the countries in the European Innovation Scoreboard. Scientometrics, 128(6), 3555–3579. doi:10.1007/s11192-023-04715-4.
[47] Arsanti, T. A., Rupidara, N., & Bondarouk, T. (2024). Managing knowledge flows within open innovation: knowledge sharing and absorption mechanisms in collaborative innovation. Cogent Business and Management, 11(1), 2351832. doi:10.1080/23311975.2024.2351832.
[48] Lindsay, C., Findlay, P., McQuarrie, J., Bennie, M., Corcoran, E. D., & Van Der Meer, R. (2018). Collaborative Innovation, New Technologies, and Work Redesign. Public Administration Review, 78(2), 251–260. doi:10.1111/puar.12843.
[49] Takahashi, M., Indulska, M., & Steen, J. (2018). Collaborative Research Project Networks: Knowledge Transfer at the Fuzzy Front End of Innovation. Project Management Journal, 49(4), 36–52. doi:10.1177/8756972818781630.
[50] García-Muñiz, A. S., Vicente, M. R., & Billon, M. (2022). ICT Research networks and regional competitiveness: an analysis of the 7th Framework Program. European Planning Studies, 30(10), 2063–2083. doi:10.1080/09654313.2021.2021505.
[51] Al-Abbas, M., & Saab, S. S. (2020). The Impact of Collaborative Research: A Case Study in a Developing Country. 2020 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), 1–7. doi:10.1109/ismsit50672.2020.9254613.
[52] Greenhalgh, T., Raftery, J., Hanney, S., & Glover, M. (2016). Research impact: A narrative review. BMC Medicine, 14(1), 78. doi:10.1186/s12916-016-0620-8.
[53] Nepelski, D., & Van Roy, V. (2021). Innovation and innovator assessment in R&I ecosystems: the case of the EU Framework Programme. Journal of Technology Transfer, 46(3), 792–827. doi:10.1007/s10961-020-09814-5.
[54] Hu, J., Yan, Y., & Xie, Z. (2024). Automatic Recognition Technology of Library Books Based on Convolutional Neural Network Model. HighTech and Innovation Journal, 5(1), 200–212. doi:10.28991/HIJ-2024-05-01-015.
[55] Ismail, M., Bello-Pintado, A., García-Marco, T., & Lazzarotti, V. (2023). Enhancing open innovation: Managing not invented here syndrome in collaborative projects. Technovation, 128(November), 102879. doi:10.1016/j.technovation.2023.102879.
[56] Blix Germundsson, L., Papadopoulou, E., Jönsson, H., Dimitrievski, I., Moudrý, J., & Melin, M. (2024). Participatory ex-ante impact assessment for interactive research and development in agriculture and food systems. Impact Assessment and Project Appraisal, 42(2), 160–172. doi:10.1080/14615517.2024.2330792.
[57] Bornmann, L. (2013). What is societal impact of research and how can it be assessed? a literature survey. Journal of the American Society for Information Science and Technology, 64(2), 217–233. doi:10.1002/asi.22803.
[58] Kastrinos, N., & Weber, K. M. (2020). Sustainable development goals in the research and innovation policy of the European Union. Technological Forecasting and Social Change, 157, 120056. doi:10.1016/j.techfore.2020.120056.
[59] Hammer, J., & Pivo, G. (2017). The Triple Bottom Line and Sustainable Economic Development Theory and Practice. Economic Development Quarterly, 31(1), 25–36. doi:10.1177/0891242416674808.
[60] Rovere, R. L., Mathema, S., Dixon, J., Mercado, P. A., & Gurung, K. (2009). Assessing impacts of maize research through a livelihoods lens: findings and lessons from the hill regions of Mexico and Nepal. Impact Assessment and Project Appraisal, 27(3), 233–245. doi:10.3152/146155109x467597.
[61] Scotland, J. (2012). Exploring the Philosophical Underpinnings of Research: Relating Ontology and Epistemology to the Methodology and Methods of the Scientific, Interpretive, and Critical Research Paradigms. English Language Teaching, 5(9), 9. doi:10.5539/elt.v5n9p9.
[62] González Rey, F., & Mitjáns Martínez, A. (2019). The Constructive-Interpretative Methodological Approach: Orienting Research and Practice on the Basis of Subjectivity. Subjectivity within Cultural-Historical Approach. Perspectives in Cultural-Historical Research, 5, Springer, Singapore. doi:10.1007/978-981-13-3155-8_3.
[63] Hollweck, T. (2015). Robert K. Yin. (2014). Case Study Research Design and Methods (5th Ed.). Canadian Journal of Program Evaluation, 30(1), 108–110. doi:10.3138/cjpe.30.1.108.
[64] Corbin, J., & Strauss, A. (2014). Basics of qualitative research: Techniques and procedures for developing grounded theory. SAGE Publications, Thousand Oaks, United States.
[65] Tongco, M. D. C. (2007). Purposive sampling as a tool for informant selection. Ethnobotany Research and Applications, 5, 147–158. doi:10.17348/era.5.0.147-158.
[66] Faccin, K., & Balestrin, A. (2018). The dynamics of collaborative practices for knowledge creation in joint R&D projects. Journal of Engineering and Technology Management, 48, 28–43. doi:10.1016/j.jengtecman.2018.04.001.
[67] Lesic, V., Hodgett, R. E., Pearman, A., & Peace, A. (2019). How to improve impact reporting for sustainability. Sustainability (Switzerland), 11(6), 1–21. doi:10.3390/su11061718.
[68] European Union, (2021). Interreg europe 2021-2027. European Union, Brussels, Belgium.
[69] Merino, S. S., & Carmenado, I. de los R. (2012). Capacity Building in Development Projects. Procedia - Social and Behavioral Sciences, 46, 960–967. doi:10.1016/j.sbspro.2012.05.231.
[70] De Paula, E. V., & De Abreu, M. C. S. (2019). Pressures from the context and institutional capacity building to develop industrial symbiosis networks. Gestao e Producao, 26(4). doi:10.1590/0104-530X3831-19.
[71] Fassio, F., & Minotti, B. (2019). Circular economy for food policy: The case of the RePoPP project in the City of Turin (Italy). Sustainability (Switzerland), 11(21), 1–17. doi:10.3390/su11216078.
[72] Li, L., & Lange, K. W. (2023). Planning Principles for Integrating Community Empowerment into Zero-Net Carbon Transformation. Smart Cities, 6(1), 100–122. doi:10.3390/smartcities6010006.
[73] Bäck, I., & Kohtamäki, M. (2016). Joint Learning in Innovative R&D Collaboration. Industry and Innovation, 23(1), 62–86. doi:10.1080/13662716.2015.1123613.
[74] Brandão, A. S., & Santos, J. M. R. C. A. (2024). Sustainability from Policy to Practice: Assessing the Impact of European Research and Innovation Frameworks on Circular Bioeconomy. Sustainability (Switzerland), 16(6), 2355. doi:10.3390/su16062355.
- This work (including HTML and PDF Files) is licensed under a Creative Commons Attribution 4.0 International License.
