Evaluating the Effectiveness of an Interactive Tool for Water Governance in Transboundary Basins: A Participation-Based Approach and Visualization of Water Security from a Vulnerability Perspective
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Area
2.2. Dashboard Design and Development
2.2.1. Understanding the Uncertainty in the Basin
- Uncertainty associated with climate change:
- Uncertainty associated with land use change:
2.2.2. Vulnerability Estimation
2.2.3. Data Visualization
- Context component
- Indexes component
- Vulnerability Analysis component
- Time series analysis of the WSI and other metrics: This corresponds to the temporal visualization of the modeled results from the XLRM (X: uncertain eXogenus factors, L: Levers for decision-makers, R: analytical tools to Relate uncertainties with levers, and M: Metrics of performance to evaluated outcomes) approach of the index under different uncertainties associated with vulnerability. The objective is to identify desirable performance levels that reduce the basin’s vulnerabilities through management strategies or policies. This visualization was implemented in the index component described above.
- Vulnerability calculation using conversion to a single-value form: In this step, the temporal data of the WSI are consolidated into a single value according to the performance of the system with respect to desirable levels defined by the stakeholders. In the case study, vulnerability was calculated as the equivalent of the Failure Frequency (from the reliability calculation method of [44]) of the system, with this being the percentage of times that the WSI falls below the desired threshold under different uncertainty conditions:
- 3.
- Visualization of the decision space: This graphical representation consists of four main components: (a) a menu for the selection of the index to be analyzed and the different scenario options; (b) a map showing the spatial display of the failure frequency of the selected index at the sub-basin level; (c) a control panel to adjust the thresholds corresponding to the different indexes; and (d) a graph in grid format presenting the failure frequency matrix of the selected index.
2.3. Effectiveness Assessment Approach
- What factors do you consider to contribute to the vulnerability of the CARL in terms of water quantity and quality?
- What are the main water uses in the CARL, and how might they relate to the vulnerability of the watershed?
- How do you think climate change could affect water security in the CARL?
- What are the trends in land use change in the CARL, and how might these trends affect the quantity and quality of water available in the basin?
- Which regions do you think are the most vulnerable in the CARL, and for what reason?
- Overview: This refers to a broad view of the entire visualization, understanding the big picture before focusing on details. It should also contain a moving view box to control the content of the view.
- Zoom: To drill down on specific elements, the user should have the option to zoom in on sections of interest, using tools that allow them to adjust the focus and zoom factor according to their needs.
- Filter: This is an option for filtering data to focus on relevant items, allowing users to sharpen their focus and view only information relevant to their specific interest or questions.
- Detail: Users can access more detailed information by selecting an item or group of interest, facilitating a deeper understanding of the selected data.
- Relate: This refers to options in the visualization for users to identify relationships between elements within the visualization, using dashboard capabilities to link variables and explore possible causalities or connections between phenomena.
3. Results
3.1. Impact of the Dashboard on the Understanding of Water Vulnerability
- Incorrect: The answers do not reflect an adequate understanding of the concepts.
- Partially incorrect: The answers reflect a partial understanding of the concepts. According to the topics addressed using the dashboard, part of the answer is correct, but part is not.
- Correct: The answers are aligned with the key concepts regarding the water vulnerability ability of the watershed.
3.2. Usability and Display Effectiveness Evaluation
3.3. Participation in Water Governance in a Transboundary Context
4. Discussion
4.1. Tool Strengths
- Interactivity and visualization: The possibility of direct and efficient comparison between different conditions and scenarios, thanks to the parallel visualization of maps and graphics, was highly valued. Therefore, this factor was considered as an enriching element by facilitating the interpretation of information through different perspectives. A better overall understanding was achieved by having visualizations that allow the information to be represented and analyzed in different ways. This is because the visualization that the dashboards facilitate leads to the expansion of more detailed information and is not limited to a single screen [51].
- Variables and structuring: The intuitive selection of variables was highlighted as a positive aspect. The user experience of the participants shows that the structure of the dashboard and the variables included facilitate interactive exploration with a rapid learning curve, conceptually assimilating what they represent in the model for the different scenarios.
- Specific areas of interest: The sections dedicated to demand, water quality, and vulnerability were identified as particularly useful by stakeholders. The usefulness of the water uses and the water quality indexes were also positively valued, as was the clear categorization of the different indexes. These elements provided a solid basis for analysis and allowed users to focus on critical areas for water resources management.
4.2. Difficulties in Its Use
- Interpretation of data and indexes: There was a partial perception of the indices as confusing and even counter-intuitive (especially the section related to failure frequency, probably because it is a concept with which there had been no previous interaction). In addition, difficulties were identified in understanding the index associated with groundwater behavior, suggesting the need for clarification. However, it is not entirely unexpected that there are difficulties in the interpretation of the information. One of the most frequent challenges in the use of dashboards is the misinterpretation of the information presented, which can result in not so accurate conclusions if the limitations in the data and their context are not adequately considered [51].
- Prior knowledge: Participants emphasized the importance of clearly understanding indicators, concepts, and weighting scales before using the dashboard. A lack of familiarity with these elements generated confusion during the analysis process, suggesting that providing educational resources or training sessions could significantly improve the user experience.
- Functionality limitations: A significant limitation noted was the inability to download data directly from the dashboard, which restricted the users’ ability to perform external analysis or custom presentations. Moreover, some stakeholders found the handling of percentages in the vulnerability analysis confusing, particularly regarding the failure frequency, which negatively affected the interpretation of the results.
4.3. Improvement Opportunities
- Training and support: Several stakeholders recommended increasing training on using the dashboard and its components. A section dedicated to practical exercises and examples of data handling and interpretation was suggested, with the objective of improving users’ ability to make informed decisions. This emphasizes the importance of providing additional resources to enable users to become thoroughly familiar with the tool and its applications.
- Additional functionalities: Among the proposals for improvement, the need for a more detailed glossary and the inclusion of the sources of the information used in the dashboard were highlighted. In addition, the ability to download data in formats such as spreadsheets was a functionality requested to facilitate external analysis. Another important suggestion was the incorporation of a comparative graph that would show historical and future scenarios simultaneously, avoiding the need to switch between scenarios on the map manually. Additionally, the generation of data at the micro-basin level and the inclusion of interpretative data scaled in the index tab were recommended to improve the understanding of results.
- Interface and user experience: The difficulty in the fluidity of the interaction experience with the dashboard was highlighted due to the speed of response of the dashboard. On the other hand, the inclusion of the legal context and criteria of each country was suggested to personalize and complement the analysis. Finally, it was recommended that explanatory information on the variables presented be included.
4.4. Contribution to Water Governance in a Transboundary Context
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Rogers, P. Water Governance for Latin America and the Caribbean; Inter-American Development Bank: Washington, DC, USA, 2002. [Google Scholar]
- Rogers, P.; Hall, A.W. Effective Water Governance; Global Water Partnership: Stockholm, Sweden, 2003; Available online: https://www.gwp.org/globalassets/global/toolbox/publications/background-papers/07-effective-water-governance-2003-english.pdf (accessed on 12 September 2023).
- World Water Council; Global Water Partnership; World Water Forum. Towards Water Security: A Framework for Action, 2nd ed.; Global Water Partnership: Stockholm, Sweden, 2000. [Google Scholar]
- Aguirre, K.A.; Cuervo, D.P. Water Safety and Water Governance: A Scientometric Review. Sustainability 2023, 15, 7164. [Google Scholar] [CrossRef]
- Jiménez, A.; Saikia, P.; Giné, R.; Avello, P.; Leten, J.; Lymer, B.L.; Schneider, K.; Ward, R. Unpacking Water Governance: A Framework for Practitioners. Water 2020, 12, 827. [Google Scholar] [CrossRef]
- Akamani, K.; Wilson, P.I. Toward the adaptive governance of transboundary water resources. Conserv. Lett. 2011, 4, 409–416. [Google Scholar] [CrossRef]
- UN Water. Water Security and the Global Water Agenda: A UN-Water Analytical Brief; United Nations University—Institute for Water, Environment and Health: Richmond Hill, ON, Canada, 2013. [Google Scholar]
- Xu, H.; Berres, A.; Liu, Y.; Allen-Dumas, M.R.; Sanyal, J. An overview of visualization and visual analytics applications in water resources management. Environ. Model. Softw. 2022, 153, 105396. [Google Scholar] [CrossRef]
- Zainuddin, Z.Q.M.; Yahya, F.; Moung, E.G.; Fazli, B.M.; Abdullah, M.F. Effective dashboards for urban water security monitoring and evaluation. Int. J. Electr. Comput. Eng. 2023, 13, 4291–4305. [Google Scholar] [CrossRef]
- Doeffinger, T.; Borgomeo, E.; Young, W.J.; Sadoff, C.; Hall, J.W. A diagnostic dashboard to evaluate country water security. Water Policy 2020, 22, 825–849. [Google Scholar] [CrossRef]
- Kiyan, A.; Gheibi, M.; Akrami, M.; Moezzi, R.; Behzadian, K.; Taghavian, H. The operation of urban water treatment plants: A Review of smart dashboard frameworks. Environ. Ind. Lett. 2023, 1, 28–45. [Google Scholar]
- Musyaffa, L.; Pramesti, D.; Bimantoro, M.; Fakhrurroja, H. Smart dashboard on an Internet of Things-based automatic water meter reading system. In Proceedings of the 2023 International Conference on Advancement in Data Science, E-learning and Information System (ICADEIS), Bali, Indonesia, 2–3 August 2023; pp. 1–6. [Google Scholar] [CrossRef]
- Bettin, A. Digital transformation for the water industry: How a data-driven business intelligence platform can improve operations. Water Pract. Technol. 2023, 18, 1599–1607. [Google Scholar] [CrossRef]
- Panagiotakopoulos, T.; Vlachos, D.; Bakalakos, T.; Kanavos, A.; Kameas, A. A FIWARE-based IoT Framework for Smart Water Distribution Management. In Proceedings of the 12th International Conference on Information, Intelligence, Systems & Applications (IISA), Crete, Greece, 12–14 July 2021; pp. 1–6. [Google Scholar] [CrossRef]
- Wardropper, C.; Brookfield, A. Decision-support systems for water management. J. Hydrol. 2022, 610, 127928. [Google Scholar] [CrossRef]
- Purkey, D.R.; Arias, M.I.E.; Mehta, V.K.; Forni, L.; Depsky, N.J.; Yates, D.N.; Stevenson, W.N. A Philosophical Justification for a Novel Analysis-Supported, Stakeholder-Driven Participatory Process for Water Resources Planning and Decision Making. Water 2018, 10, 1009. [Google Scholar] [CrossRef]
- Alhamadi, M.; Alghamdi, O.; Clinch, S.; Vigo, M. Data Quality, Mismatched Expectations, and Moving Requirements: The Challenges of User-Centred Dashboard Design. In ACM International Conference Proceeding Series; Association for Computing Machinery: New York, NY, USA, 2022. [Google Scholar] [CrossRef]
- WINROCK International. Creando un Futuro Sostenible; USAID: San Salvador, El Salvador, 2023. [Google Scholar]
- Hernández, W. Nacimiento y Desarrollo del río Lempa; Servicio Nacional de Estudios Territoriales (SV): San Salvador, El Salvador, 2005. [Google Scholar]
- BCIE and CTPT. Libro Resumen del Plan Maestro para la Región Trifinio, 2022. Available online: www.plantrifinio.int (accessed on 19 August 2024).
- CTPT. Agenda Hídrica Trinacional: Una Propuesta Participativa para la Gestión Integrada de los Recursos Hídricos en la Parte alta de la Cuenca del río Lempa; CTPT: San Salvador, El Salvador, 2008. [Google Scholar]
- CTPT. El Trifinio: Los Recursos Hídricos en la Parte alta de la Cuenca del río Lempa; CTPT: San Salvador, El Salvador, 2009. [Google Scholar]
- Oviedo, K. El Programa Trinacional de la Cuenca Alta del Río Lempa, Paradigma de Cooperación Sur-Sur en América Latina y el Caribe; Universidad Colegio Mayor de Nuestra Señora del Rosario: Bogota, Colombia, 2010. [Google Scholar]
- Yates, D.; Purkey, D. International Water Resources Association WEAP21-A Demand-, Priority-, and Preference-Driven Water Planning Model Part 1: Model Characteristics. Water Int. 2005, 30, 487–500. [Google Scholar] [CrossRef]
- Forni, L.G.; Galaitsi, S.; Mehta, V.K.; Escobar, M.I.; Purkey, D.R.; Depsky, N.J.; Lima, N.A. Exploring scientific information for policy making under deep uncertainty. Environ. Model. Softw. 2016, 86, 232–247. [Google Scholar] [CrossRef]
- Stolte, C.; Tang, D.; Hanrahan, P. Polaris: A system for query, analysis, and visualization of multidimensional relational databases. IEEE Trans. Vis. Comput. Graph. 2002, 8, 52–65. [Google Scholar] [CrossRef]
- Kundzewicz, Z.W.; Krysanova, V.; Benestad, R.E.; Hov, Ø.; Piniewski, M.; Otto, I.M. Uncertainty in climate change impacts on water resources. Environ. Sci. Policy 2018, 79, 1–8. [Google Scholar] [CrossRef]
- Borgomeo, E.; Mortazavi-Naeini, M.; Hall, J.W.; Guillod, B.P. Risk, Robustness and Water Resources Planning Under Uncertainty. Earth’s Futur. 2018, 6, 468–487. [Google Scholar] [CrossRef]
- Lempert, R.; Popper, S.; Bankes, S. Shaping the Next One Hundred Years: New Methods for Quantitative Long-Term Policy Analysis; RAND: Santa Monica, CA, USA, 2003. [Google Scholar]
- Polasky, S.; Carpenter, S.R.; Folke, C.; Keeler, B. Decision-making under great uncertainty: Environmental management in an era of global change. Trends Ecol. Evol. 2011, 26, 398–404. [Google Scholar] [CrossRef] [PubMed]
- Prestele, R.; Alexander, P.; Rounsevell, M.D.A.; Arneth, A.; Calvin, K.; Doelman, J.; Eitelberg, D.A.; Engström, K.; Fujimori, S.; Hasegawa, T.; et al. Hotspots of uncertainty in land-use and land-cover change projections: A global-scale model comparison. Glob. Chang. Biol. 2016, 22, 3967–3983. [Google Scholar] [CrossRef] [PubMed]
- IPCC. Climate Change 2022—Impacts, Adaptation and Vulnerability: Working Group II Contribution to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change; Cambridge University Press: Cambridge, UK, 2023. [Google Scholar] [CrossRef]
- Ayala, G.; Zamora, D.; Santos, T.; Aedo, S.; Rodríguez, Y. Aplicación de Índices de Vegetación para el Monitoreo Regional de la Tendencia de Cambios en la Superficie Agrícola, Caso de la Cuenca Alta del Río Lempa. In XXXI Congreso Latinoamericano de Hidráulica de la IAHR VOLUMEN 06 A: Agua, Ambiente y Sociedad del Conocimiento; Congreso Latinoamericano de Hidraulica: Medellín, Colombia, 2024. [Google Scholar]
- Alcaraz, D.; Paruelo, J.; Cabello, J. Identification of current ecosystem functional types in the Iberian Peninsula. Glob. Ecol. Biogeogr. 2006, 15, 200–212. [Google Scholar] [CrossRef]
- Tootoonchi, R.; Nourani, V.; Andaryani, S.; Tootoonchi, F. Application of Mann-Kendall trend test and Normalized Difference Vegetation Index (NDVI) in hydroclimatological change detection—A Case Study of Urmia Lake watershed, Iran. In Proceedings of the EGU General Assembly Conference 2020, Online, 4–8 May 2020. [Google Scholar]
- Mishra, B.K.; Kumar, P.; Saraswat, C.; Chakraborty, S.; Gautam, A. Water Security in a Changing Environment: Concept, Challenges and Solutions. Water 2021, 13, 490. [Google Scholar] [CrossRef]
- Jimenez-Cisneros, B. Responding to the challenges of water security: The Eighth Phase of the International Hydrological Programme, 2014–2021. Proc. Int. Assoc. Hydrol. Sci. 2015, 366, 10–19. [Google Scholar] [CrossRef]
- Mckee, T.B.; Doesken, N.J.; Kleist, J. The relationship of drought frequency and duration to time scales. In Proceedings of the eighth Conference on Applied Climatology, Anaheim, CA, USA, 17–22 January 1993. [Google Scholar]
- Ideam. Estudio Nacional del Agua 2022. Available online: https://fedemaderas.org.co/estudio-nacional-de-agua-2022/ (accessed on 19 August 2024).
- Wexler, S.; Shaffer, J.; Cotgreave, A. The Big Book of Dashboards: Visualizing Your Data Using Real-World Business Scenarios. Wiley: Hoboken, NJ, USA, 2017. [Google Scholar]
- Briscoe, J. Water Seurity: Why It Matters and What to Do About It; OECD: Paris, France, 2009. [Google Scholar]
- McCarthy, J.J.; Canziani, O.F.; Leary, N.A.; Dokken, D.J.; White, K.S. Climate Change 2001: Impacts, Aadaptation, and Vulnerability; Cambridge University Press: Cambridge, UK, 2001. [Google Scholar]
- Adger, W.N. Vulnerability. Glob. Environ. Chang. 2006, 16, 268–281. [Google Scholar] [CrossRef]
- Fowler, H.J.; Kilsby, C.G.; O’Connell, P.E. Modeling the impacts of climatic change and variability on the reliability, resilience, and vulnerability of a water resource system. Water Resour. Res. 2003, 39. [Google Scholar] [CrossRef]
- Ward, N.K.; Sorice, M.G.; Reynolds, M.S.; Weathers, K.C.; Weng, W.; Carey, C.C. Can interactive data visualizations promote waterfront best management practices? Lake Reserv. Manag. 2022, 38, 95–108. [Google Scholar] [CrossRef]
- Few, S. Data Visualization Effectiveness Profile. 2017. Available online: https://www.perceptualedge.com/articles/visual_business_intelligence/data_visualization_effectiveness_profile.pdf (accessed on 2 June 2024).
- Nemoto, T.; Beglar, D. Developing Likert-Scale Questionnaires Campus Reference Data. In Proceedings of the ALT 2013, Singapore, 6–9 October 2013. [Google Scholar]
- Kelleher, C.; Wagener, T. Ten guidelines for effective data visualization in scientific publications. Environ. Model. Softw. 2011, 26, 822–827. [Google Scholar] [CrossRef]
- Shneiderman, B. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. Available online: https://ieeexplore.ieee.org/document/545307 (accessed on 2 June 2024).
- Santos, B.S.; Dias, P. Evaluation in visualization: Some issues and best practices. In Proceedings of the Visualization and Data Analysis 2014, San Francisco, CA, USA, 2–6 February 2014; p. 90170O. [Google Scholar] [CrossRef]
- Matheus, R.; Janssen, M.; Maheshwari, D. Data science empowering the public: Data-driven dashboards for transparent and accountable decision-making in smart cities. Gov. Inf. Q. 2020, 37, 101284. [Google Scholar] [CrossRef]
- van Ginkel, K.C.H.; Hoekstra, A.Y.; Buurman, J.; Hogeboom, R.J. Urban Water Security Dashboard: Systems Approach to Characterizing the Water Security of Cities. J. Water Resour. Plan. Manag. 2018, 144, 04018075. [Google Scholar] [CrossRef]
- Harding, C. A User Analysis of the Environmental Finance Center’s Water and Wastewater Dashboard Tool. Master’s Thesis, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, 2021. [Google Scholar]
Criteria | Description |
---|---|
Usefulness | This refers to the ability of the tool to transmit information that is useful to the user, i.e., that the tool communicates information that is of value to the user in their decision-making process. The value of the information is a subjective aspect, as it depends on the user’s needs. |
Completeness | This refers to the ability of the tool to produce a desired level of understanding by presenting the right information and in the right amount, not presenting more information than is required to achieve the knowledge required by the user. Additionally, it concerns the ability to provide the necessary context to understand the information. |
Perceptibility | This refers to the ability of the tool to display information that the human eye and brain can perceive with minimum effort and adequate accuracy. |
Truthfulness | This refers to the degree of accuracy and validity of the information presented through the tool. Accuracy is a measure of reliability and precision. Validity indicates how well the phenomenon to be represented is being represented. |
Intuitiveness | This refers to the tool’s ability to be easily understood and usable, which feels familiar to the user. |
Esthetics | This refers to the ability of the tool to be pleasing to the human eye, considering that the user is likely to receive the information presented to them better if the tool is “beautiful” or esthetically pleasing. |
Engagement/Interest | This refers to the ability of the tool to invite the user to examine the information and generate interest in using it to gain knowledge of the phenomenon to be represented. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Rodríguez-Blásquez, Y.; Ticona, G.A.; Santos Santos, T.F.; Aedo-Quililongo, S.; Zamora, D.; Salazar, D.B.; Forni, L.; Alvarenga, M. Evaluating the Effectiveness of an Interactive Tool for Water Governance in Transboundary Basins: A Participation-Based Approach and Visualization of Water Security from a Vulnerability Perspective. Water 2025, 17, 278. https://doi.org/10.3390/w17020278
Rodríguez-Blásquez Y, Ticona GA, Santos Santos TF, Aedo-Quililongo S, Zamora D, Salazar DB, Forni L, Alvarenga M. Evaluating the Effectiveness of an Interactive Tool for Water Governance in Transboundary Basins: A Participation-Based Approach and Visualization of Water Security from a Vulnerability Perspective. Water. 2025; 17(2):278. https://doi.org/10.3390/w17020278
Chicago/Turabian StyleRodríguez-Blásquez, Yesica, Gustavo Ayala Ticona, Tania Fernanda Santos Santos, Sebastián Aedo-Quililongo, David Zamora, Doreen Brown Salazar, Laura Forni, and Miguel Alvarenga. 2025. "Evaluating the Effectiveness of an Interactive Tool for Water Governance in Transboundary Basins: A Participation-Based Approach and Visualization of Water Security from a Vulnerability Perspective" Water 17, no. 2: 278. https://doi.org/10.3390/w17020278
APA StyleRodríguez-Blásquez, Y., Ticona, G. A., Santos Santos, T. F., Aedo-Quililongo, S., Zamora, D., Salazar, D. B., Forni, L., & Alvarenga, M. (2025). Evaluating the Effectiveness of an Interactive Tool for Water Governance in Transboundary Basins: A Participation-Based Approach and Visualization of Water Security from a Vulnerability Perspective. Water, 17(2), 278. https://doi.org/10.3390/w17020278