Next Article in Journal
On the Presence and Ubiquity of the Exotic Batophora (J. Agardh) in the Mar Menor Lagoon (SE Spain)
Previous Article in Journal
Selective and Competitive Adsorption of Anions in Solution on Porous Adsorbent from Zea mays Steams: Kinetic and Equilibrium Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Framework for Water Security Data Gathering Strategies

by
Giacomo Butte
1,
Yady Tatiana Solano-Correa
2,3,*,
Maria Valasia Peppa
1,
Diana Marcela Ruíz-Ordóñez
2,
Rachael Maysels
2,
Nasser Tuqan
1,
Xanthe Polaine
1,
Carolina Montoya-Pachongo
4,
Claire Walsh
1 and
Thomas Curtis
1
1
School of Engineering, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
2
Grupo de Estudios Ambientales, University of Cauca, Popayán, Calle 5 #4-70, 190003, Colombia
3
Basic Sciences Faculty, Universidad Tecnológica de Bolívar, Km 1 Vía Turbaco, Cartagena 130011, Colombia
4
School of Civil Engineering, University of Leeds City, West Yorkshire, Leeds LS2 9JT, UK
*
Author to whom correspondence should be addressed.
Water 2022, 14(18), 2907; https://doi.org/10.3390/w14182907
Submission received: 1 September 2022 / Revised: 13 September 2022 / Accepted: 14 September 2022 / Published: 17 September 2022
(This article belongs to the Section Water Use and Scarcity)

Abstract

:
At the international level, the term “water security” (WS) has gained increasing attention in recent decades. At the operational level, WS is assessed using tools that define the concept using a variety of dimensions and sub-dimensions, with qualitative and quantitative indicators and parameters. The breadth of tools and concepts is an obstacle to the operationalisation of the concept of water security (WS). Clearly, we need a range of diverse data to evaluate water security (WS). However, there are several barriers to designing an optimal Data Gathering Strategy (DGS). Such a strategy must strike a balance between a wide range of competing and overlapping data requirements and characteristics including: resources, information, and impact. The proposed framework aims at filling the existing gaps, not by providing a strict procedure, but instead acting as a “compass”: five interfaces between data and context are identified to orient practitioners towards an optimal DGS. The conceptual aim of the framework can be summarised as shifting the focus of the DGS from a “data-to-information approach” to a “data-to-action approach,” therefore stressing the importance of reaching key stakeholders with information. The specific aims of this paper are to: identify the key issues that should be addressed in designing a Data Gathering Strategy for Water Security (DGSxWS); communicate the key issues with a clear conceptual framework; and suggest approaches and activities that could help water practitioners in dealing with the issues identified.

1. Introduction

Water Security: A Complex Concept

In recent decades, the term “water security” (WS) has increasingly become commonplace at the international level, whether as a concept, goal, or frame involving local and global political and economic institutions. The World Economic Forum recently described WS as “the gossamer that links together the web of food, energy, climate, and human challenges that the world faces over the next two decades” [1]. The breadth of water security, its interconnectedness, and its interdependencies, create a complex system that militates against a simple one-size-fits-all definition [2]. Consequently, and perhaps necessarily, the term WS has generated different framings, definitions, tools, indicators, and requirements.
Though several definitions of WS exist (e.g., [3,4,5,6,7]), they generally revolve around four main themes: water availability to human and ecosystems, human vulnerability to hazard, human needs and sustainability [8], and several thematic attributes (e.g., quantity, quality, ecosystems, risk, policy, resilience, global change, etc.) [9].
Different frameworks are used to approach the WS concept: scarcity, risk, security, development [10,11]. As a consequence of this diversity, the WS concept is connected to different types of securities (food, energy, infrastructure, geo-political) [8]. This diversity can be seen as a strength, by offering a broad spectrum of possibilities, but also as a weakness, by creating an excess of information that decreases the usability of the concept.
A systematic review on water vulnerability assessment tools [12] reported a variety of indices (~50) that differed on geographical scale, on the number and type of dimensions and sub-dimensions considered (water resources, economics, institutions, social, physical environment), and on the number of indicators. Overall, 710 indicators were identified and grouped into five dimensions and 22 sub-dimensions. All these layers (conceptual framing, definition, dimensions, indicators, parameters) form a complex framework surrounding WS.
Different WS assessment tools have different data requirements. Octavianti and Staddon [13] proposed a classification of data into two clusters. The first cluster, defined as experiential scale-based metrics, is associated with social sciences and was identified as aiming at, “Capturing water insecurity experiences, identifying vulnerable, water insecure groups and evaluating water interventions”. The data requirements for this cluster are typically based on household and individual surveys. The second cluster, defined as resource-based metrics, adopts an engineering and natural-science approach, aimed at, “Improving water security, identifying mitigation targets, allocation of funding and raising awareness (benchmarking)”. Data for this cluster are based more on secondary data from governmental agencies (see Section 4.1).
We present a framework to guide practitioners through the intrinsic complexity of gathering data for WS by fulfilling the following aims:
  • Identify the key issues that a Data Gathering Strategy for Water Security (DGSxWS) must address.
  • Document the key challenges and opportunities for each issue.
  • Help researchers and practitioners in WS to itemise and categorise those challenges and opportunities for better planning and monitoring.
  • Suggest activities, approaches, and references that can support the operationalization of the framework.

2. Conceptual and Operational Systems

At the operational level, WS is assessed using tools that define the concept using dimensions and sub-dimensions [9,12,14] that rely on qualitative and quantitative indicators and hence data [15]. Tools have been created for specific aspects of WS such as scarcity [14], freshwater [16], urban environments [10], specific geographical aspects such as small islands [17], different geographical scales, and different water domains [13].
The different elements contributing to WS definitions mean WS can be seen as a standalone system or in relation to others (food, economic, political security, etc.). As a result, definitions create a complex web (see Figure 1). Some themes are shared with others (for example, sufficient availability of water quantity and quality), while still others are only included in some definitions (such as affordability or energy needs). According to Figure 1, the different framings given to the WS concepts in literature can be seen at L2 in relation to L3, whereas L4 identifies the aim that WS wants to achieve in terms of activities, population, and environment. Some definitions refer to the external context or to a particular condition (L5).
To better understand the structure of a typical WS index, a tree diagram was used to break down WS dimensions into sub-dimensions, indicators, and—finally—parameters that could be measured. Figure 2 illustrates how the concept is defined across several dimensions. Dimensions are then divided into sub-dimensions that are assessed using one or multiple indicators. Indicators require single or multiple parameters to be defined. Finally, parameters may need one of several datasets to be compiled.
This wide range of indicator possibilities is an obstacle for the operationalisation of the concept of “water security” (WS). A large-scale survey of water practitioners in Canada on the use of WS assessment tools [18] found a number of different shortcomings, most alarmingly the lack of agreement on the definition of WS. They also found that monitoring and assessment is practised, but only a limited number of available indicators are used: 38% of the participants chose not to use the available tools due to difficulties and fragmentation (the main reason being tools were too specific to a region or a timeframe). In addition, the authors found other gaps such as the lack of centralised data and consistency, the low emphasis on governance in achieving WS (often not included in assessment tools), and the inadequate consideration given to the importance of non-state stakeholders in the governance of water systems.
In summary, gaps exist on several aspects: in some cases, assessment tools focus on a limited set of aspects of WS (for example, physical ones), ignoring the importance of others (such as socio-political) that may have similar or greater importance. Several tools, by trying to assess WS with clear and specific indicators, decrease the usability of the tool by requiring too much and too specific data. Lastly, it was also found that the focus is generally placed on transforming data to information, ignoring the importance of reaching stakeholders in order to produce action. The proposed framework attempts to fill these gaps using a systemic approach connecting five key areas (interfaces) that need to be addressed. Since a DGS needs to be tailored to a specific context, the framework does not provide a strict procedure, but suggests activities and areas of investigation, letting the practitioner create the most suitable strategy for the studied area.

3. Data Bases and Systems

Data is the foundation of WS assessment tools. The need for “high quality, accessible, timely and reliable disaggregated data” has been stressed and emphasised by the 2030 Sustainable Development Agenda [19] and by UN Deputy Secretary-General Eliasson who called data the “lifeblood of decision-making and the raw material for accountability” [20]. The need for accessible data has been acknowledged on various occasions [21,22] but data gaps still exist [22,23,24,25], particularly in water insecure countries [26]; naturally, this influences decision-making [27].
A systems strategy for Data Gathering Strategy for WS (DGSxWS) is essential if those data are to serve their purpose and to connect stakeholders (through the data) to actions that improve WS [28], and thus give a purpose to the data. Data not only informs a WS system, but also defines it, arguably as the first step in a systems approach by being a means of “finding out about the problematical situation and the characteristics of the intervention to improve it” [28]. The data gathered to represent WS in a given basin are therefore representative of WS problems. Existing systemic indicators attempt to measure a “level” of WS (as demonstrated in [29]), but do not provide the space for system lens to evaluate how the interconnections between elements of data gathering could be improved or better connected with stakeholders. These connections are needed if WS questions are to be linked to WS solutions and have a positive impact for those involved in the system.
Data gathering is not an end in itself. Data, and thus the DGSxWS, should form the basis for decisions that improve WS. DGSxWS should strengthen the linkage between data–information–stakeholders–positive impact. To achieve such a goal, several barriers need to be addressed, including: insufficient data, unsuitable solutions to localised problems, limited community involvement, and trade-offs between available resources, information, and impact. An integrated systems approach to data gathering is crucial to overcoming and addressing some of these barriers. A whole systems approach to the gathering and role of data in informing water security can enable an understanding of the “whole contextual water security picture”. Therefore, enabling the practitioner to better expose gaps and linkages between data and impact by observing an incomplete picture.
By a systems perspective, we mean the understanding that the emergent behaviour of water security is created by the aggregations and interactions within a system of systems—data associated with WS, which thus inherits the same trait. The systems are bound by the flow of water, and a systems perspective is required to understand the intersection of various data sub-systems [30].
Using this system lens, we must observe two main qualities for WS data. First, the nestedness between elements and groups of elements. This is demonstrated by the levels of dimensions, sub-dimensions, indicators, and parameters in existing data gathering frameworks (see Figure 2). However, the system lens understands this “breaking down” process as a formation of nestedness within the WS system, based more on the dynamics of emergent behaviours than the components of definitions. This aids the understanding of the role of data in the WS system.
Second, the connections and interactions with other elements. It is important to recognise the links between our data and how the data components of WS phenomenon do not sit alone in disciplinary silos. This can take the form of successful data sharing, but also encourages interdisciplinarity when assessing the data associated with WS components (Figure 3).
An example of this is the socio-ecological framework for data analysis, supported by the understanding that environmental problems are at their root—almost invariably—social problems [31]. These considerations suggest that water systems should be understood through human–nature linkages incorporating ecological, economic, cultural, and physical systems [32].
Socio-ecological systems are characterised by a systemic vision of the ecological and social components, and their structure, functioning, and emergent properties across spatial and temporal scales. This view supports a global architecture based on systems thinking [26] that not only considers information internal to the water system, but also external factors [13,33]. Hipel et al. [30] observe that systems methodologies and techniques are important for addressing complex water problems that involve nature, technology, and society. However, we must look beyond this for WS, and include other interconnected sub-systems with natural, social, and economic elements.

4. Proposed Interfaces of the DGSxWS

To avoid the “data rich but information poor syndrome” [34], data need to be strongly linked to information requirements by coherent purpose, collection method, and good communication. Information, to be considered ”useful”, needs to have three necessary characteristics: credibility, legitimacy, and salience [35], where:
  • Credibility is the creation of authoritative, believable, and trusted information;
  • Legitimacy is how “fair” an information-producing process is and whether it considers appropriate values, concerns, and perspectives of different actors;
  • Salience is how relevant it is to decision making bodies or the public.
To attain these characteristics, five relevant areas were identified and conceptualised as “interfaces”. The first three (interfaces A, B, and C) support the creation of credible data. Interface A relates to the existing “data-scape” because a DGSxWS must engage with existing knowledge gaps, using, and building upon, existing data. Interface B relates to the observed environment and seeks to describe the physical environment with data that has sufficient quality, robustness, and certainty. Interface C relates to project resources and the need to optimise those resources while gathering, editing, and communicating data.
Salience is created by identifying which information is relevant. This is achieved by integrating the DGSxWS with the socio-economic context (Interface D) and existing stakeholders (Interface E). Legitimacy of information is conferred through the relationship between data, data practitioners/managers, and the communities present in the study area. This is explored in the interface with stakeholders (Interface E), which aims to bring essential socio-cultural knowledge into the DGS.
The following sections give a concise overview of the five interfaces by underlining key concepts that need to be addressed and presenting essential references for an initial understanding of the most relevant issues. More specific suggestions on activities that could be conducted throughout the data gathering process are provided in Table 1.

4.1. Interface with the Existing Data-Scape

WS data have social, economic, and environmental components, which, together, characterise the physical environment (Figure 4). Data vary in spatial scale from global to national level, and down to regional, municipal, urban, or basin level. The last two scales are the most popular in water research [13]. Primary data are collected “first hand” and are contrasted with secondary data, which are reused from existing resources, previous studies, or both [36,37]. This division between primary and secondary data applies to any type of socio-economic and environmental analysis, as well as qualitative and quantitative datasets.
Examples of secondary data might include water volumes stored in reservoirs, daily water treatment capacity, the percentage of households with access to tap water supply, number of serious flooding events per year, economic loss due to water pollution, and so on. Such secondary data have been used to develop WS indices at the urban scale [38]. Data inaccessibility is a common problem, with secondary data retrieved from governmental and institutional agencies. Data inaccessibility hinders the assessment of data quality and water risk trends from historical data-series [38,39]. Conversely, when primary data are collected and preserved following the FAIR guiding principles (FAIR: Findable, Accessible, Interoperable, Reusable [40]) it becomes easier to capture the variability and uncertainty of the data. The Water Quality Portal [41] is a good example of the FAIR guiding principles. This resource includes millions of open-to-the-public water-related data, retrieved from multiple resources, that indicate the water quality life-cycle of lakes in the United States (US). Even with existing regulations for storing/sharing data in an open manner, there is still the need for seamless exchange of data and data harmonisation with existing datasets. Due to the absence of such regulated procedures, WS data development has lost its importance; hence, data cannot easily be reused and interpreted.
Scientists collect data for research, for industry (including the water industry), and in collaboration with stakeholders at great expense of both time and resources. However, the studies are preserved and retrievable in journals and project reports where the data are seldom published and open for others to use. Unless the data are collected and published by government agencies, most of it is lost. There is, however, some good practice: in geosciences, for example, there are well-established websites for storing and sharing data such as OneGeology [42], the U.S. Geoscience Information Network [43], and the Ocean Observatories Initiative [44]. Nevertheless, there is a need for open data websites in WS (and more generally). Open data have an important role to play in WS and sustainable development. An alternative to this problem is the use of blockchain-based methods, together with the FAIR guiding principles [45,46,47,48].
Primary data can be categorised based on acquisition mode between in situ (i.e., sensed in place; [49]) and remotely sensed data (i.e., observed from a great distance; [49]), depending on how it was collected. In situ point sampling is the traditional method for monitoring water quality, river flows, discharge, water depth, and so on. Point sampling typically requires either manual observations using portable devices [50] from shoreline or boat and/or automatic observations from permanently installed stations [51] at discrete locations with high temporal frequency [52]. In situ data collection can be labour-intensive, relatively costly (e.g., maintenance costs due to damaged permanent stations [52]), and can provide limited spatial resolution. There is also a risk to human health when operating in polluted environments [53]. By contrast, remote sensing Earth Observations (EO) can provide high spatio-temporal resolution for national, regional, and basin level using freely available satellite optical and radar imagery (e.g., [54]) and even for local lake spatial level using unmanned aerial systems (UAS) (e.g., [53]). However, in situ observations are typically required to calibrate, model, and validate remote sensing EO data.
Who physically collects observations is important. Conventionally, a professional acquires the data and such professionals are assumed to be reliable, trustworthy analysts. With the advance of citizen science over the last decade, amateurs and non-experts from local communities have contributed in the various steps of the data cycle, from collection to analysis and interpretation [55]. Previous studies have demonstrated the advantages of citizen science in: capturing data during episodic flooding events [56], gathering water-related data over data-poor regions, especially in the Global South [57], and collecting information related to previous years, where historical data might be missing.
Due to the multi-dimensional aspect of the proposed DGSxWS framework, an optimal data-scape could include the integration of in situ/remotely sensed and citizen/expert-generated data and capture the synergies between these different sources. A recent comprehensive review [58] demonstrated the potential of combining water quality sampling observations with freely available satellite imagery alongside advanced deep learning approaches to predict water pollution events. The evolution of cloud computing services alongside open-source methodologies (e.g., Google Earth Engine (GEE) [59], Open Data Cube [60]) with open data and “analysis-ready data” [61] is very important. These advances have facilitated the cost-efficient use of neural networks and EO data to analyse historical time series and to predict future scenarios [62]. For instance, Krause et al. [63] investigated the use of Open Data Cube for Australia to estimate the water quantity of open waterbodies using archival Landsat products since 1987. Similarly, [64] estimated algae bloom status by calculating chlorophyll and total suspended matter concentrations exploiting “analysis-ready data” from Landsat over waterbodies across the entirety of Australia. Both sets of findings have been integrated into Digital Earth Australia’s [65] platform to support stakeholders and decision making. In addition, [66] demonstrated the potential of the GEE cloud computing platform for mapping flood extent in Kerala, India, exploiting radar satellite imagery accessed close to the time of the flooding event.
GEE and Open Data Cube platforms can handle Big Data volumes and offer multiple low-level python scripts (e.g., [67]) for retrieving, processing, analysing, and visualising multi-modal and multi-temporal satellite image series, tailored to several applications related to SDG 6 [68,69], land-cover changes [70], water quality [64], water quantity [63], flooding [66], and many others.

4.2. Interface with the Physical Environment

The quality of data gathering is a key aspect to build data credibility. To deal with the different challenges, we suggest adopting a risk approach to WS [4,26,71]. Such an approach is grounded in the idea that water users are usually more concerned with their needs not being satisfied and this concern can easily be framed as the risk of non-compliance with regard to a given threshold. Water-security risks can then be broadly categorised into four groups: risk of shortage, risk of excess, risk of inadequate quality, and risk of undermining the resilience of the system [2]. This approach also promotes dialogue across disciplines and institutions [1,72] since risk concepts (hazard, vulnerability, exposure, mitigation, management, prevention) are commonly used by experts and communities and will favour stakeholder engagement. In addition, adopting a risk-based approach allows the conversion of different water-security-related phenomena into concepts such as probability of risk and odds ratio. This enables the comparison of such phenomena to different mitigation scenarios and/or international guidelines, as in the case of WHO ones.
When the purpose is to conduct water risk assessments, it is important to agree on proper definitions of hazards, hazardous, consequences, and uncertainty. Since risk assessments are used to inform decision makers about measures for risk, a basic question about the quality of such assessments is the degree to which these are able to adequately characterise the risk.

4.3. Interface with the Available Project Resources

Water security (WS), whether addressed in terms of water risk assessment, mitigation strategies, solutions development, or research settings, is typically undertaken in the context of projects. There is a strong correlation between data and projects. Data and knowledge management play an essential role in a projects’ success [73]. Project management approaches and techniques are widely considered as good practices in data gathering [74]. Consequently, the classical project constraints, time, cost, and quality [75], are extended to the data gathering process (Figure 5). In the specific case of data gathering, practitioners will need to identify data collection methods that can match available resources [76] while maintaining an acceptable quality level or develop methods that are less data-intensive [77]. Therefore, it is crucial to have a dynamic and data-centric interface managing the available project resources and to adopt decision techniques that are able to identify, across available possibilities, the most effective.
Several methodologies exist [78] to support decision making in situations with trade-offs and competing goals, such as: multi-criteria decision analysis [79,80], fuzzy logic [81,82], cost-benefit analysis [83], and using statistical tools [84,85,86].
Like projects, data gathering requires different resources, such as: money, people, material, equipment, and technology [87]. The type and size of resources required depends on the scope (contextual and geographical) and scale of data gathered. Naturally, resources limitation significantly affects the quantity and quality of data and thus may limit knowledge and understanding [88]. A lack of resources may also limit the uptake of tools [18]. A survey of water managers in 57 countries found that financial resources, together with data transfer, are the main factors limiting data collection [89]. This is expected due to the extended impacts of limited budgets on the other types of resources.
Since WS is essential for global sustainable development [3], international collaborations have long been established to overcome resource limitations. Despite significant achievements in the fields of capacity upscaling, sustainable infrastructure, and technological advances, we still cannot meet the required financial investments to achieve the availability and sustainable management of water and sanitation for all (in alignment with SDG6). These investments are estimated to cost 1.04 trillion USD globally every year until 2030 [90]. For instance, the cost of producing SDGs monitoring data in 77 International Development Association (IDA)-eligible countries was estimated to be 1 billion (USD) per year over a 15-year period, including 134 M-173 M USD for national survey programmes, 320 M USD for censuses, and 114 M USD for geospatial and hydrological monitoring data [91].
These numbers make it clear that a comprehensive and achievable data generation strategy must, inevitably, align with the resources available within the project. Effective project planning based on resources’ optimal allocation is a key for the success of projects (including data gathering projects) [92].
The sophistication of water security data gathering and the associated management tools is increasing, an increase driven by our improved understanding of the subject matter. This sophistication emphasises the importance and the urgency of a comprehensive DGS for all the entities and individuals involved. Documents such as Knowledge Management (KM) plans at an enterprise level [93], or Data Management Plans (DMP) in research projects [94] have emerged recently as standard practices.
The leadership, structure, and management of a data gathering organisation are extremely important and should not be overlooked, irrespective of the regional settings (Global North or South). For example, a study on water quality monitoring in Sub-Saharan Africa [95] identified leadership, knowledge, and staff retention as key drivers of success and arguably more important than equipment, procurement, infrastructure, and enforcement. Perhaps this is because caring leaders and knowledgeable staff can compensate for deficiencies in material. Conversely, excellent material cannot compensate for poor leadership and staff turnover.

4.4. Interface with Stakeholders

Human processes can limit WS because of the divergent visions, perceptions, biases, and values of stakeholders and decision makers across multiple scales. Our understanding of the motivations that drive environmental degradation should include an ethical approach that connects the values, behaviours, and actions that affect WS.
Even though the need to link different types of knowledge and stakeholder motivations for WS and sustainability has been recognised, little actual progress has been made in this regard [16,96]. Stakeholders are essential drivers of the WS system, due to the dynamics generated in the use, access, and management of water [97,98,99,100]. Stakeholders should be understood through their different roles: as sources and receivers of new information and as drivers of change with their own agency [101,102,103]. McNie [104] identified the interface with stakeholders as a key area for improvements, with knowledge gaps in: understanding better decision-making processes; creating linkages between scientists; boundary organisations and stakeholders; and understanding how funding organisations and research managers make decisions about research priorities.
Indices and approaches to WS often under-emphasise social aspects—in particular, governance [8], an important factor in malfunctioning water systems [105]. Incorporating human capabilities, socio-cultural dynamics, and political institutions into water governance could lead to a better understanding of WS [106,107]. Involving stakeholders in the co-creation of WS assessment tools [38] could help increase the legitimacy and salience of data. Local knowledge should be incorporated into citizen science strategies: people are sources of information but they also generate a common understanding of water dynamics in the context of the socio-ecological processes involved. Co-creation will facilitate the communication of WS data in a harmonised and aggregated way that improves decision making based on real scenarios with actively involved and engaged stakeholders [13,22,91,108].
Co-creation improves governance, as well as stakeholder cooperation and coordination around data availability—a weak aspect of many WS systems. One example of co-creation is through polycentric governance, where decision-making processes are more decentralised and diversified, by considering the relationships with stakeholders and the interactions among different scales of governance systems [109].
Traditionally, data credibility has received the most attention, but recent research shows that underestimating data legitimacy and salience can be detrimental, leading to the “information-rich but communication and action poor syndrome” [78] due to a lack of effective communication between science and decision-making processes. If properly addressed, this interface could transform information into real impact. Stakeholders provide local and specific data that can strengthen data saliency and legitimacy [110]: complementary tools such as the mapping and analysis of stakeholders (as referenced in Table 1) provide key information to make WS decisions more relevant.

4.5. Interface with the Socio-Economic Context

Effective DGSxWS lies in understanding the context of water security in different environments/basins. This context must include the socio-economic dynamics occurring at different scales within basins. These dynamics impact WS availability through productive activities, water use and access, and socio-cultural processes. Each one of these dynamics, individually or grouped, define the framework in which data should be analysed for WS.
Different socio-economic processes across multiple scales in the basins are conveyed in the data analysis clusters with experiential scale-based metrics and resource-based metrics that guide WS strategies. However, the wide range of conceptualisations of WS is reflected in the great variation in the methods of assessment of WS, which also vary greatly [9]. This variation in conception and assessment generates confusion that affects the course of decision making at individual, community, and government levels, as well as responses to development models, local conditions, market demands, and political frameworks.
Considering the socio-economic context of data collection will reinforce the saliency, legitimacy, and credibility of that data—characteristics that are necessary for the systemic approach, mentioned in the proposed interface of the DGSxWS. Socio-economic data collection should use both quantitative and qualitative research methods and consider different and complementary sources of data (stakeholder databases and primary data), type of systematisation requirements, and type of information analysis. For example, as the largest user of freshwater, the agricultural sector (land use, crop production, animal protein production, and supply chain) should be prioritised when developing a DGSxWS [111]. Moreover, the increasing demand of water for domestic use may be directly tied to urbanisation and, thus, the associated economic activities.
The socio-ecological framework with which data are analysed is supported by the understanding that environmental problems are, at their root, social problems [31]. These considerations suggest that water systems should be understood through the human–nature linkages incorporating ecological, economic, cultural, and physical systems at different levels [34]. Socio-ecological systems are characterised by a systemic vision of the ecological and the social components, and their structure, functioning, and emergent properties across spatial and temporal scales.
Studies around the world, including indices and approaches to WS, tend to focus on technical aspects [112], for example the cost of water quality monitoring for human consumptions [95,113,114,115], indicators for sustainable consumption and production activities [116], continuous access for water supply [117,118,119], rural conditions for water security [29], and urban metabolism [120]. While these studies offer distinct and/or complementary perspectives, they do not consider system thinking.
One of the largest challenges in gathering socio-economic data for WS is ensuring that the complexities of the socio-ecosystem are captured. When approaching an analysis for socio-ecological systems, the use of reductionist frameworks oversimplifies the system, ignoring underlying causes or unforeseen effects. Water use is often analysed from the scale of individual users. In a socio-ecological system, while it is important to recognise the role and behaviours of individuals, it is the relationships and interactions between individuals that represent the patterns of the system as a whole [121]. Water use (i.e., demand) is a key factor for socio-economic assessment. A systemic framework is needed to collect data that represent not just the surface level of water use, but the root drivers of water user behaviour [122].
In the field of ecological economics, a framework known as socio-economic metabolism has emerged as a way to analyse the human–nature relationship through their biophysical exchanges in socio-ecological systems [123]. This method has potential for DGSxWS. Metabolism studies have historically focused on finite natural resources such as fossil fuels and minerals; however, Fischer et al. [123] argue that water should be included due to the negative impacts on WS that socio-economic activities have caused. Madrid-López [124] found that water has been omitted from socio-economic metabolism, not because of a lack of data, but due to the conceptual challenge of analysing a renewable resource that flows in a more cyclical manner. The utilisation of a socio-ecological systems framework, which recognises complexity and interactions within systems, could be helpful to incorporate metabolism studies into water security.

5. Minimisation of Uncertainty and Ambiguity

5.1. Minimisation of Uncertainty

Two main challenges exist to make a risk assessment valid: uncertainties and ambiguity [125]. Uncertainty comprises different and distinct components, such as statistical variation, measurement errors, ignorance, and indeterminacy [126]. Such components have something in common: uncertainty reduces the strength of confidence in the estimated cause-and-effect chain(s) of risks [127]. If complexity cannot be resolved by scientific methods and the available data, uncertainty increases [127]. However, even simple relationships may be associated with high uncertainty if either the knowledge base is missing or the effects are indeterminate due to the stochastic (randomly structured) nature of the functional relationships [127]. One example is extreme weather events such as heavy rain and storms. As they are extreme and rare and a result of dynamic physical processes, their magnitude and consequences are uncertain. Looking at the past, i.e., relying on historical weather data, can lead to erroneous risk assessment. In cases like these, a focus on scenarios and resilience is advisable and decision makers should decide on what level of resilience they are able to adopt [128].
It is essential for data collection to be clearly linked to an objective; otherwise, data may not necessarily translate into information. Rose and Smith [129] observed that data are often gathered without a clear statement on how those data are to be evaluated. The lack of attention to this aspect creates a situation where errors in the sampling strategy tend to dominate other types of errors related to analytical measurements [130] and ultimately produce different results [131,132,133]. Additional causes of gross and systematic errors and uncertainty include: the inadequacy of observations, the density of the network, its dissemination, the quality assurance, and calibration [108]. It is more difficult to turn data into valuable information [34] if those data are inaccurate, of poor quality, or non-comparable [134].
A well-designed sampling strategy can also help minimise uncertainty. Several decisions can affect the final results, such as sample location [135], parameters, number of samples [136], frequency [137], and location of laboratories [138]. There are excellent studies on this topic, covering: network design, statistical tools, parameters, and frequency of sampling [130,139,140,141], and also considering optimisation for data-poor contexts [142]. The dynamic characteristics of the WS system should also be considered. Most WS indices do not account for the temporal dimension. Ignoring time may lead to a misinterpretation of the data and a failure to consider system dynamics. Incorporating time would allow the description of WS not as a static snapshot but as a trajectory [105,143], with the possibility of identifying trends [144,145]. Assessment tools should take full advantage of information technologies (IT) using dynamic datasets and real-time data.

5.2. Minimisation of Ambiguity

Ambiguity denotes the variability of (legitimate) interpretations based on identical observations or data assessments and questions their impact according to different values and perspectives [128]. Ambiguities may be minor or negligible when characterising the physical dimension of water security due to stronger scientific background supporting the information used for hazard identification. However, important ambiguities can emerge in the process of establishing the impacts of such hazards and defining actions to manage the associated risks.
Expert judgements may be a useful tool for combating ambiguity caused by the limitations of poorly defined data (it may be scarce, uncertain, and insufficient) and the difficulties of using hard data to describe events in complex systems. To reduce ambiguity in such judgements, events must be precisely defined. Furthermore, more evidence may still be required to identify whether uncertainties from global risk assessments can be lowered by reducing the scale and focusing more on local risks.

6. Water Security and Data Collection Strategy

6.1. Challenges

There are several valuable frameworks and handbooks on data gathering for WS that have approached the issue from different perspectives [141,146,147,148,149,150,151,152,153]. Due to the complexity of the problem, technical improvements, and variability across basins, there is no generally accepted practical strategy that is able to support all phases of a Water Security Monitoring Plan, planning and optimising in a holistic manner [140,154].
We observed that existing tools give different emphases to the five interfaces identified. The interface between data and the physical environment is the one that usually receives most attention, with information provided on sampling methods, approaches to sampling strategies, data quality best practices, statistical tools for analysis, and interpretation. This interface is key to creating credible [15] and robust data. Further work could be performed in incorporating the temporal dimension when assessing WS [105] by considering the dynamic of the WS system (understanding how internal changes are happening), and understanding the external stressors of the system (economic and political situation). A dynamic assessment would also be able to better capture socio-political changes, which are usually more abrupt than physio-hydrological ones. The incorporation of dynamics into the framework needs to be facilitated by a change in medium (and therefore in the content structure and usability) from printed to digital, since digital media is better for iterative processes, restriction, interlinkages, and dataset management [78].
The relationship with project resources is usually addressed in order to produce an estimate of costs [146,153]. In reality, resources are always finite and the trade-off between cost–quality–time should be acknowledged and managed, with the intent of optimising results given available project resources. A more recent framework [151] explicitly called for a capacity assessment, underlining the importance of project-tailored solutions. The reporting of data within existing requirements and legislation has been addressed extensively [146,153]. Lastly, soft aspects (motivation and leadership, knowledge, and staff retention) are influential factors [95] in the success of a monitoring project and should be considered of equal, if not greater, importance to financial and physical assets when evaluating project resources.
Bridging the gap between gathering, accessing, and sharing data is a strategically important step to global water security and achieving the associated SDGs (SDG6, but also SDGs 1, 2, 3, 4, 5, 7, 8, 9, 11, and 14). Technological innovation in the past decades has dramatically increased the amount of data that is gathered. Despite these advances, the creation of an open data culture is still in its infancy and will not only require a change of mindset, but also a revision of the whole process of data gathering, editing, storage, and access. As a starting point, following the FAIR guiding principles [40] is essential, yet the problem of properly transferring such knowledge to all users’ levels remains. While FAIR principles are known and accepted internationally in global-scale datasets, those working at small scales (e.g., municipalities, basins) are not always aware of, or follow, such principles. This is an important problem because most of the data required for understanding and assessing WS are gathered at these smaller scales. Thus, there is a need to bridge the gap between data gathering, access, and sharing.
The linkage between stakeholders and information is often approached from a top-down perspective, where the research community produces new information to be communicated to relevant stakeholders. The engagement of stakeholders as data producers has only emerged in recent years through the phenomenon of citizen science [57,155] and therefore is typically absent from older frameworks. Stakeholders should not be seen only as information receivers but also as active players in the identification of information needs [150]. A study by Timmerman et al. proposed different information categories (information for policy evaluation, for policy preparation, and for operational water management) but there was no mention of users, communities, or information-related to behavioural change, which is essential to achieving water security.
The socio-cultural context is often acknowledged but not incorporated into the data gathering framework. While this is not strictly part of a DGS, it is beneficial to be aware of social aspects since they may influence data quality salience and legitimacy [95]. Additionally, the involvement of stakeholders in the process is very beneficial in creating information that is understood and used. This requires a stronger collaboration between hard and social sciences and the co-creation of tools for implementation.
Operationalisation of a framework is, obviously, extremely important. The only data on the usage of WS assessment tools that was found [18] reported a gap between the abundance of analytic tools produced by academics and uptake by water professionals. A balance should be found between the necessary complexity needed to address WS and the tool usability. This also implies finding a compromise between the needs for generalisation and practicality. In this paper, the issue was addressed not by prescribing strict procedures but by bringing attention to key relationships and qualities that a DGS should have.
The conceptual aim of this framework can be summarised as shifting the focus of DGS from a “data-to-information approach” to a “data-to-action approach”. This implies moving from an intradisciplinary perspective (e.g., water quality, hydrology) to an interdisciplinary one that prioritises the relationship between produced information and stakeholders.

6.2. Suggested Steps

To address and overcome the obstacles, we have identified a set of activities that a research team or project could undertake when addressing a DGSxWS. These activities are intended as an initial step to bring attention to specific issues pertinent to the five interfaces (Table 1). For each interface, a set of goals was identified with a related activity and key references. This table is a suggestion; it is not to be understood as mandatory or limiting. In order to move from a “data-to-information approach” to a “data-to-action approach”, activities in Table 1 can be used as a starting point to evaluate and understand the current situation of a certain place in relation to the WS problem/concept.
Table 1. Summary of key activities related to each interface.
Table 1. Summary of key activities related to each interface.
GoalActivityReferences
A. Data-scape (data collected are harmonised and comparable with existing data)
A.1 Determine data requirementsReview of data requirements based on legislation, existing datasets, donors[156,157,158,159,160]
A.2 Harmonise data with existing ones to fill gaps and avoid duplicationReview existing secondary data for the WS dimension addressed in the DGS[38,59,161]
A.3 Set data management planUnderstand how to deal with data along the whole process (collect, edit, store, process, communicate)[13,36,41,162]
Complement the plan if risk analysis was considered in the aims of the project[125]
A.4 Collect and preserve data following the FAIR guiding principlesGuarantee the collection and reuse of data in the future by considering open-access approaches and FAIR principles[40,163]
B. Physical Environment (data are able to capture variability with acceptable level of statistical power and uncertainty)
B.1 Basic characterisation of study areaDefinition of basin boundaries and basic characterisation, including places of local amenities related to water[164,165]
B.2 Define scope and aim of investigation to ensure that data will translate into valuable informationIdentify WS dimension(s) for primary data collection[12,13,101,144]
Identify hypothesis to be testedIdentify possible interactions between dimensions, indicators, variables
B.4 Collect secondary dataBuild own dataset from existing open sources[166,167,168,169,170]
B.4 Primary data: sampling design and data collectionDraft sampling location based on project resources, hypothesis, and considering the places where hazards are created and risk manifest[130,135,139,140,141,146,171]
Draft sampling parameters based on hypothesis to be tested, existing data, project resources [2,11,131,146,147,156,172,173,174]
Draft sampling frequency and times based on project resources and hypothesis to be tested (e.g., drinking water quality may deteriorate due to low velocities and high water age, i.e., low or null water demand during night times in residential areas; illegal wastewater discharges may occur during night times, etc.) [78,136,137,156,172]
Choose sampling methods[149,152,153,156,172]
Choose appropriate laboratories according to analytical methods, certifications, and proximity to sampling locations to deliver samples at the right time[138]
Verify that sampling plan has enough statistical power to test the chosen hypothesis[175]
Create a team for sample collection and train them accordingly[176]
B.5 Ensure data quality controlData quality control is in place[149,152]
B.6 Analyse risks IIdentify hazards and location[125,177,178,179]
Identify vulnerabilities of people and assets[125]
Specify temporal considerations: period when hazardous events were observed and period when consequences were defined[180]
Report qualitative and quantitative uncertainties: probabilities and surprises (unknown unknowns, known unknowns, ignored events due to low probability of occurrence)[125]
Judge the strength of the knowledge[125]
C. Project resources (data strategies optimise project resources)
C.1 Understand project constraints (time, cost, and quality) and the feasibility of sampling strategy for these constraintsAssess project resources in the planning phase in terms of budget, time, scope, and quality of deliverables[87,181]
Verify that the sampling strategy is feasible within these constraints[87]
C.2 Optimise the drafted sampling strategy in relation to available resourcesRevise sampling strategy[182]
C.3 Plan for data while you plan the projectPrepare a knowledge management plan (for enterprise) or a data management plan (for research) during the planning phase of a project and keep them updated while monitoring and controlling the project’s implementation[93,94]
C.4 Maintain agility and ensure a continuous cycle of feedbackContinuously evaluate any discrepancies between what is planned and what is implemented[183]
Adjust sampling strategy accordingly (in case of deficit or surplus in any of the project’s constraints)
C.5 Avoid the failure of either project or data strategy through maintaining the right balance of resource allocationAvoid letting the sampling strategy exploit more resources than planned or letting the other components of the project expand on the expense of sampling strategy[184,185]
C.6 Invest in training and capacity developmentBuilding capacity, on the institutional and individual levels, by providing tailored training to achieve a proper implementation of all strategies and actions[186,187,188]
D. Stakeholder (information produced by data reaches relevant stakeholders (policy makers, community, private sector))
D.1 Understand role of stakeholders and their possible engagementStakeholder mapping and analysis[189]
D.2 Understand from key stakeholder, their information needs related to the study topicParticipatory Needs Assessment[133]
D.3 Analyse risks IIMap the stakeholder landscape to identify for whom and how assessments could be useful and to help identify opportunities for managing particular risks[190,191,192,193]
Determine actors and their mutual influences such as their capabilities for actions or effects, their goals and incentives, their use of communication channels and the nature of those channels, their knowledge, vulnerabilities, and values[194]
Carry out a conceptual model to identify power relationships and their direction and conflicts[28]
Involve river basin stakeholders and experts during the whole process[195,196,197,198]
Set clear ways of how stakeholders will participate and how their inputs will be included in the analysis[98,199,200,201]
Contact stakeholders and socialise the project with them, explaining objectives, potential impacts, and the importance of their participation
Manage clear expectations
Identify stakeholders’ water values and risk perceptions
D.4 Plan how to reach stakeholder with new information producedParticipatory workshops
D.5 Involve key stakeholders in the dissemination and processPlan for participation
D.6 Incorporate local knowledge from informal pathwaysLocal knowledge mining activities such as community mapping and participatory GIS[202,203]
D.7 Ethical considerationsDefine an ethical protocol for the exchange of information Signing of informed consent Document the process of interaction with stakeholders, especially when conflicts ariseEthics Forms and Processes (https://www.ncl.ac.uk/research/researchgovernance/ethics/process/, accessed on 1st March 2022)
D.8 Co-production of information on local scalesCitizen science[56,57,110]
E. Socio-economic context (data strategy takes into consideration specific characteristics)
E.1 Identify elements that characterise the contextPlace-based definition of WS
Map existence and location of ethnic communities in the river basin[204]
E.2 Assess external context identifying key factors that could promote water insecurityConduct a Rapid Assessment of WS system from secondary data and existing tools.[144,177,205]
E.3 Analyse risks IIIIdentify individuals, populations, or assets exposed to hazards[125,206]
Characterise exposed people according to gender, ethnicity, age, socio-economic status, etc.[125,206]
Determine exposure paths to hazards[125,206]
Quantify, exposure, or describe it qualitatively if uncertainty is high[125,206]
Identify vulnerabilities of individuals, populations, or assets exposed to hazards[125,206]
Include resilience as part of the vulnerability identification[125]
E.4 Understand causal relations, synergies, and trade-offs between system componentsSocial metabolism analysis[207]

7. Conclusions

The main purpose of this paper was to understand how a Data Gathering Strategy for Water Security (DGSxWS) could be designed in a way that ensures the data gathered are credible, legitimate, and salient. Additional attention should be given to how data are stored and shared amongst stakeholders so that the generated information can form the foundation for action to improve WS.
A complex system of knowledge emerged from a review of the literature. WS can be approached using different frameworks, has several accepted definitions, and has a multitude of indices and indicators, which in turn often need more than one parameter to be estimated. This complexity constitutes a barrier to the operationalisation of data and DGS by practitioners and thus change on the ground. Additionally, several of the existing tools were found to be very specific and limited physical and hydrological aspects, failing to incorporate important factors such as socio-economic and political characteristics.
In order to fill these gaps and orientate practitioners and researchers within this complexity, a logical framework was proposed. Given the diversity of approaches, research scopes, and socio-cultural contexts found across basins, a single rigid approach is not appropriate. Therefore, the proposed framework captures the key dimensions of an effective data collection strategy and retains sufficient flexibility to be applied in different contexts. It advocates for a new approach that addresses multiple spheres (physical environment, socio-economic), uses different data types (qualitative and quantitative data, primary and secondary), and stresses the importance of seeing the data gathering process as a step in the data–information–stakeholder-impact chain and thus real change on the ground.
The proposed tool directs the attention of practitioners to five key areas that should be addressed: the description of the observed environment, the available project resources, the relation with the existing data-scape, the relation to the socio-economic context, and the stakeholders. For each area, a set of activities that could help address key challenges was proposed. If successful, this framework will be able to guide practitioners in creating a data gathering strategy that is resource-effective, adapted to the studied context, and ultimately able to communicate to key stakeholders legitimate, salient, and credible information. Future work will include the application of the framework to a specific case study in order to validate and improve the proposed methodology.

Author Contributions

Conceptualisation: G.B., Y.T.S.-C. and C.W. Writing and editing: G.B., Y.T.S.-C., D.M.R.-O., M.V.P., R.M., N.T., X.P., C.M.-P., C.W., T.C. and Victoria Anker. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Water Security and Sustainable Development Hub funded by the UK Research and Innovation’s Global Challenges Research Fund (GCRF) [grant number: ES/S008179/1].

Acknowledgments

We want thank Victoria Anker, she helps us with the final reading and English corrections.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Economic Forum. The Global Risk Report. 2019. Available online: https://www.weforum.org/reports/the-global-risks-report-2019 (accessed on 1 June 2022).
  2. GWP. Assessing Water Security with Appropriate Indicators. Glob. Water Partnersh. 2014. Available online: https://www.gwp.org/globalassets/global/toolbox/publications/p763_gwp_proceedings_paper.pdf (accessed on 1 June 2022).
  3. Gain, A.K.; Giupponi, C.; Wada, Y. Measuring Global Water Security towards Sustainable Development Goals. Environ. Res. Lett. 2016, 11, 124015. [Google Scholar] [CrossRef]
  4. Garrick, D.; Hall, J.W. Water Security and Society: Risks, Metrics, and Pathways. Annu. Rev. Environ. Resour. 2014, 39, 611–639. [Google Scholar] [CrossRef]
  5. Lautze, J.; Manthrithilake, H. Water Security: Old Concepts, New Package, What Value? Nat. Resour. Forum 2012, 36, 76–87. [Google Scholar] [CrossRef]
  6. Staddon, C.; James, N. Water Security: A Genealogy of Emerging Discourses. In Globalized Water: A Question of Governance; Schneier-Madanes, G., Ed.; Springer: Dordrecht, The Netherlands, 2014; pp. 261–276. [Google Scholar] [CrossRef]
  7. Tarlock, D.; Wouters, P. Reframing the Water Security Dialogue. J. Water Law 2009, 20, 53–60. [Google Scholar]
  8. Cook, C.; Bakker, K. Water Security: Debating an Emerging Paradigm. Glob. Environ. Change 2012, 22, 94–102. [Google Scholar] [CrossRef]
  9. Gerlak, A.K.; House-Peters, L.; Varady, R.G.; Albrecht, T.; Zúñiga-Terán, A.; Grenade, R.R.; Cook, C.; Scott, C.A. Water Security: A Review of Place-Based Research. Environ. Sci. Policy 2018, 82, 79–89. [Google Scholar] [CrossRef]
  10. Hoekstra, A.Y.; Buurman, J.; van Ginkel, K.C.H. Urban Water Security: A Review. Environ. Res. Lett. 2018, 13, 053002. [Google Scholar] [CrossRef]
  11. Mason, N.; Calow, R. Water Security: From Abstract Concept to Meaningful Metrics, An Initial Overview of Options; Overseas Development Institute: London, UK, 2012. [Google Scholar]
  12. Plummer, R.; Loë, R.; Armitage, D. A Systematic Review of Water Vulnerability Assessment Tools. Water Resour. Manag 2012, 26, 4327–4346. [Google Scholar] [CrossRef]
  13. Octavianti, T.; Staddon, C. A Review of 80 Assessment Tools Measuring Water Security; Wiley: Hoboken, NJ, USA, 2021. [Google Scholar]
  14. Brown, A. A Review of Water Scarcity Indices and Methodologies; University of Arkansas: Fayetteville, AR, USA, 2011. [Google Scholar]
  15. Lehtonen, M. Indicators: Tools for Informing, Monitoring or Controlling? In The Tools of Policy Formulation; Edward Elgar Publishing: Cheltenham, UK, 2015. [Google Scholar]
  16. Norman, E.S.; Dunn, G.; Bakker, K.; Allen, D.M.; de Albuquerque, R.C. Water Security Assessment: Integrating Governance and Freshwater Indicators. Water Resour. Manag. 2013, 27, 535–551. [Google Scholar] [CrossRef]
  17. Holding, S.; Allen, D.M. Risk to Water Security for Small Islands: An Assessment Framework and Application. Reg. Environ. Chang. 2016, 16, 827–839. [Google Scholar] [CrossRef]
  18. Norman, E.S.; Bakker, K.; Dunn, G. Recent Developments in Canadian Water Policy: An Emerging Water Security Paradigm. Can. Water Resour. J. 2011, 36, 53–66. [Google Scholar] [CrossRef]
  19. Nations, U. Sustainable Development Goal 6: Synthesis Report on Water and Sanitation; United Nations: New York, NY, USA, 2018. [Google Scholar]
  20. UN-Water. Monitoring Water and Sanitation in the 2030 Agenda for Sustainable Development Water and Sanitation in the 2030 Agenda for Sustainable Development; UN-Water: Geneva, Switzerland, 2016. [Google Scholar]
  21. UN-Water. UN-Hlpw World Water Data Initiative; UN-Water: Geneva, Switzerland, 2017. [Google Scholar]
  22. UN-Water. Monitoring Progress in the Water Sector; UN-Water: Geneva, Switzerland, 2010. [Google Scholar]
  23. Schmidt-Traub, G.; Kroll, C.; Teksoz, K.; Durand-Delacre, D.; Sachs, J.D. National Baselines for the Sustainable Development Goals Assessed in the SDG Index and Dashboards. Nat. Geosci. 2017, 10, 547–555. [Google Scholar] [CrossRef]
  24. WHO. National Systems to Support Drinking-Water, Sanitation and Hygiene: Global Status Report 2019; WHO: Geneva, Switzerland, 2019.
  25. WHO; UNICEF. Progress on Household Drinking Water, Sanitation and Hygiene 2000–2017; UNICEF: New York, NY, USA; WHO: Geneva, Switzerland, 2019.
  26. Grey, A.D.; Garrick, D.; Blackmore, D.; Kelman, J.; Muller, M.; Sadoff, C. Water Security in a Blue Planet: Twenty First Century Policy Challenge for Science. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2013, 371, 1–10. [Google Scholar] [CrossRef] [PubMed]
  27. York, P.; Bamberger, M. Measuring Results and Impact in the Age of Big Data: The Nexus of Evaluation, Analytics, and Digital Technology; The Rockefeller Foundation: New York, NY, USA, 2020. [Google Scholar]
  28. Checkland, P.; Poulter, J. Learning for Action: A Short Definitive Account of Soft Systems Methodology, and Its Use for Practitioners, Teachers and Students; Wiley: Hoboken, NJ, USA, 2006. [Google Scholar]
  29. Dickson, S.E.; Schuster-Wallace, C.J.; Newton, J.J. Water Security Assessment Indicators: The Rural Context. Water Resour. Manag. 2016, 30, 1567–1604. [Google Scholar] [CrossRef]
  30. Hipel, K.W.; Fang, L.; Ouarda, T.B.M.J.; Bristow, M. An Introduction to the Special Issue on Tackling Challenging Water Resources Problems in Canada: A Systems Approach. Can. Water Resour. J. 2013, 38, 3–11. [Google Scholar] [CrossRef]
  31. World Bank. World Development Report 2003: Sustainable Development in a Dynamic World--Transforming Institutions, Growth, and Quality of Life; World Bank: Washington, DC, USA, 2003. [Google Scholar]
  32. Bogardi, J.J.; Dudgeon, D.; Lawford, R.; Flinkerbusch, E.; Meyn, A.; Pahl-Wostl, C.; Vielhauer, K.; Vörösmarty, C. Water Security for a Planet under Pressure: Interconnected Challenges of a Changing World Call for Sustainable Solutions. Curr. Opin. Environ. Sustain. 2012, 4, 35–43. [Google Scholar] [CrossRef]
  33. Briscoe, J. Water Security Why It Matters and What to Do about It, Hydrology. Innov. Technol. Gov. Glob. 2009, 4, 3–28. [Google Scholar] [CrossRef]
  34. Ward, R.C.; Loftis, J.C.; McBride, G.B. The “Data-Rich but Information-Poor” Syndrome in Water Quality Monitoring. Environ. Manag. 1986, 10, 291–297. [Google Scholar] [CrossRef]
  35. Cash, D.; Clark, W.C.; Alcock, F.; Dickson, N.; Eckley, N.; Jager, J. Salience, Credibility, Legitimacy and Boundaries: Linking Research. Assess. Decis. Mak. SSRN Electron. J. 2002. [Google Scholar] [CrossRef]
  36. Hox, J.J.; Boeije, H.R. Data Collection, Primary vs Secondary. Encycl. Soc. Meas. 2005, 1, 593–599. [Google Scholar] [CrossRef]
  37. NERC. Data Tree: A Free Online Course Related to Research Data Management by the Natural Environment Research Council (NERC). Available online: https://datatree.org.uk/ (accessed on 15 October 2021).
  38. Jensen, O.; Wu, H. Urban Water Security Indicators: Development and Pilot. Environ. Sci. Policy 2018, 83, 33–45. [Google Scholar] [CrossRef]
  39. Hering, D.; Borja, A.; Carstensen, J.; Carvalho, L.; Elliott, M.; Feld, C.K.; Heiskanen, A.-S.; Johnson, R.K.; Moe, J.; Pont, D.; et al. The European Water Framework Directive at the Age of 10: A Critical Review of the Achievements with Recommendations for the Future. Sci. Total Environ. 2010, 408, 4007–4019. [Google Scholar] [CrossRef] [PubMed]
  40. Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J.; Appleton, G.; Axton, M.; Baak, A.; Blomberg, N.; Boiten, J.-W.; da Silva Santos, L.B.; Bourne, P.E.; et al. The FAIR Guiding Principles for Scientific Data Management and Stewardship. Sci. Data 2016, 3, 160018. [Google Scholar] [CrossRef] [PubMed]
  41. Read, E.K.; Carr, L.; De Cicco, L.; Dugan, H.A.; Hanson, P.C.; Hart, J.A.; Kreft, J.; Read, J.S.; Winslow, L.A. Water Quality Data for National-Scale Aquatic Research: The Water Quality Portal. Water Resour. Res. 2017, 53, 1735–1745. [Google Scholar] [CrossRef]
  42. OneGeology. Available online: https://onegeology.org (accessed on 1 September 2022).
  43. US-GIN. U.S. Geoscience Information Network. Available online: https://usgin.org/ (accessed on 1 September 2022).
  44. OOI. Ocean Observatories Initiative. Available online: https://oceanobservatories.org/ (accessed on 1 September 2022).
  45. Farnaghi, M.; Mansourian, A. Blockchain an Enabling Technology for Transparent and Accountable Decentralized Public Participatory GIS. Cities 2020, 105, 102850. [Google Scholar] [CrossRef]
  46. Pincheira, M.; Donini, E.; Giaffreda, R.; Vecchio, M. A blockchain-based approach to enable remote sensing trusted data. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2020, IV-3/W2-2020, 35–40. [Google Scholar] [CrossRef]
  47. Ren, Y.; Leng, Y.; Cheng, Y.; Wang, J. Secure Data Storage Based on Blockchain and Coding in Edge Computing. Math. Biosci. Eng. 2019, 16, 1874–1892. [Google Scholar] [CrossRef] [PubMed]
  48. Zhang, L.; Gao, Y.; Chen, J.; Wang, X.; Huang, Z.; Wei, D. Research on Remote Sensing Data Sharing Model Based on Blockchain Technology. In Proceedings of the 2019 2nd International Conference on Blockchain Technology and Applications, Guangzhou, China, 12–15 November; ACM: New York, NY, USA, 2019. [Google Scholar]
  49. Teillet, P.M.; Gauthier, R.P.; Chichagov, A.; Fedosejevs, G. Towards Integrated Earth Sensing: Advanced Technologies for in Situ Sensing in the Context of Earth Observation. Can. J. Remote Sens. 2002, 28, 713–718. [Google Scholar] [CrossRef]
  50. Acharya, K.; Blackburn, A.; Mohammed, J.; Haile, A.T.; Hiruy, A.M.; Werner, D. Metagenomic Water Quality Monitoring with a Portable Laboratory. Water Res. 2020, 184, 116112. [Google Scholar] [CrossRef] [PubMed]
  51. Glasgow, H.B.; Burkholder, J.M.; Reed, R.E.; Lewitus, A.J.; Kleinman, J.E. Real-Time Remote Monitoring of Water Quality: A Review of Current Applications, and Advancements in Sensor, Telemetry, and Computing Technologies. J. Exp. Mar. Biol. Ecol. 2004, 300, 409–448. [Google Scholar] [CrossRef]
  52. Soares, L.M.V.; Calijuri, M. do C. Deterministic Modelling of Freshwater Lakes and Reservoirs: Current Trends and Recent Progress. Environ. Model. Softw. 2021, 144, 105143. [Google Scholar] [CrossRef]
  53. Lally, H.T.; O’Connor, I.; Jensen, O.P.; Graham, C.T. Can Drones Be Used to Conduct Water Sampling in Aquatic Environments? A Review. Sci. Total Environ. 2019, 670, 569–575. [Google Scholar] [CrossRef] [PubMed]
  54. Chawla, I.; Karthikeyan, L.; Mishra, A.K. A Review of Remote Sensing Applications for Water Security: Quantity, Quality, and Extremes. J. Hydrol. 2020, 585, 124826. [Google Scholar] [CrossRef]
  55. Bonney, R.; Shirk, J.L.; Phillips, T.B.; Wiggins, A.; Ballard, H.L.; Miller-Rushing, A.J.; Parrish, J.K. Next Steps for Citizen Science. Science 2014, 343, 1436–1437. [Google Scholar] [CrossRef] [PubMed]
  56. Starkey, E.; Parkin, G.; Birkinshaw, S.; Large, A.; Quinn, P.; Gibson, C. Demonstrating the Value of Community-Based (‘Citizen Science’) Observations for Catchment Modelling and Characterisation. J. Hydrol. 2017, 548, 801–817. [Google Scholar] [CrossRef]
  57. Walker, D.W.; Smigaj, M.; Tani, M. The Benefits and Negative Impacts of Citizen Science Applications to Water as Experienced by Participants and Communities. WIREs Water 2020, 8, e1488. [Google Scholar] [CrossRef]
  58. Sagan, V.; Peterson, K.T.; Maimaitijiang, M.; Sidike, P.; Sloan, J.; Greeling, B.A.; Maalouf, S.; Adams, C. Monitoring Inland Water Quality Using Remote Sensing: Potential and Limitations of Spectral Indices, Bio-Optical Simulations, Machine Learning, and Cloud Computing. Earth Sci. Rev. 2020, 205, 103187. [Google Scholar] [CrossRef]
  59. Gorelick, N.; Hancher, M.; Dixon, M.; Ilyushchenko, S.; Thau, D.; Moore, R. Google Earth Engine: Planetary-Scale Geospatial Analysis for Everyone. Remote Sens. Environ. 2017, 202, 18–27. [Google Scholar] [CrossRef]
  60. Dhu, T.; Dunn, B.; Lewis, B.; Lymburner, L.; Mueller, N.; Telfer, E.; Lewis, A.; McIntyre, A.; Minchin, S.; Phillips, C. Digital Earth Australia—Unlocking New Value from Earth Observation Data. Big Earth Data 2017, 1, 64–74. [Google Scholar] [CrossRef]
  61. Dwyer, J.L.; Roy, D.P.; Sauer, B.; Jenkerson, C.B.; Zhang, H.K.; Lymburner, L. Analysis Ready Data: Enabling Analysis of the Landsat Archive. Remote Sens. 2018, 10, 1363. [Google Scholar] [CrossRef]
  62. Hoeser, T.; Bachofer, F.; Kuenzer, C. Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review—Part II: Applications. Remote Sens. 2020, 12, 3053. [Google Scholar] [CrossRef]
  63. Krause, C.E.; Newey, V.; Alger, M.J.; Lymburner, L. Mapping and Monitoring the Multi-Decadal Dynamics of Australia’s Open Waterbodies Using Landsat. Remote Sens. 2021, 13, 1437. [Google Scholar] [CrossRef]
  64. Malthus, T.J.; Lehmann, E.; Ho, X.; Botha, E.; Anstee, J. Implementation of a Satellite Based Inland Water Algal Bloom Alerting System Using Analysis Ready Data. Remote Sens. 2019, 11, 2954. [Google Scholar] [CrossRef]
  65. DEA. Digital Earth Australia (DEA)—Geoscience Australian Sources of Information in Collaboration with the Australian Government; DEA: Springfield, VA, USA, 2018.
  66. Tiwari, V.; Kumar, V.; Matin, M.A.; Thapa, A.; Ellenburg, W.L.; Gupta, N.; Thapa, S. Flood Inundation Mapping-Kerala 2018; Harnessing the Power of SAR, Automatic Threshold Detection Method and Google Earth Engine. PLoS ONE 2020, 15, e0237324. [Google Scholar] [CrossRef] [PubMed]
  67. CEOS. CEOS Data Cube User Interface GitHub Repository by the Committee on Earth Observation Satellites (CEOS) System Engineering Office (SEO); CEOS: Washington, DC, USA, 2021. [Google Scholar]
  68. Mubea, K.; Killough, B.; Seidu, O.; Kimani, J.; Mugambi, B.; Kamara, S. Africa Regional Data Cube (ARDC) Is Helping Countries in Africa Report on the Sustainable Development Goals (SDGS). In Proceedings of the IGARSS 2020–2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA, 26 September–2 October 2020; pp. 3379–3382. [Google Scholar]
  69. Rizvi, S.R.; Killough, B.; Cherry, A.; Rattz, J.; Lubawy, A.; Gowda, S. Data Cube Application Algorithms for the United Nation Sustainable Development Goals (UN-SDGS). In Proceedings of the IGARSS 2020–2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA, 26 September–2 October 2020; pp. 3399–3402. [Google Scholar]
  70. Liu, H.; Gong, P.; Wang, J.; Wang, X.; Ning, G.; Xu, B. Production of Global Daily Seamless Data Cubes and Quantification of Global Land Cover Change from 1985 to 2020—IMap World 1.0. Remote Sens. Environ. 2021, 258, 112364. [Google Scholar] [CrossRef]
  71. Hall, J.; Borgomeo, E. Risk-Based Principles for Defining and Managing Water Security. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2013, 371, 1–22. [Google Scholar] [CrossRef]
  72. W.E.F. Global Risks Report 2019; World Economic Forum: Geneva, Switzerland, 2019. [Google Scholar]
  73. World Bank. Risk and Opportunity: Managing Risk for Development|World Bank Group. Available online: https://olc.worldbank.org/content/risk-and-opportunity-managing-risk-development-1 (accessed on 1 September 2022).
  74. Ekambaram, A.; Sørensen, A.Ø.; Bull-Berg, H.; Olsson, N.O.E. The Role of Big Data and Knowledge Management in Improving Projects and Project-Based Organizations. Procedia Comput. Sci. 2018, 138, 851–858. [Google Scholar] [CrossRef]
  75. Corti, L.; Van den Eynden, V.; Bishop, L.; Woollard, M. Managing and Sharing Research Data: A Guide to Good Practice; SAGE Publications: New York, NY, USA, 2019; ISBN 978-1-5264-8240-2. [Google Scholar]
  76. Dobson, M.S. The Triple Constraints in Project Management; Berrett-Koehler Publishers: Oakland, CA, USA, 2004; ISBN 978-1-56726-453-1. [Google Scholar]
  77. Allan, I.; Vrana, B.; Greenwood, R.; Mills, G.; Roig, B.; Gonzalez, C. A “Toolbox” for Biological and Chemical Monitoring Requirements for the European Union’s Water Framework Directive. Talanta 2006, 69, 302–322. [Google Scholar] [CrossRef] [PubMed]
  78. Braunisch, V.; Suchant, R. Predicting Species Distributions Based on Incomplete Survey Data: The Trade-off between Precision and Scale. Ecography 2010, 5, 826–840. [Google Scholar] [CrossRef]
  79. Valipour, M. Calibration of Mass Transfer-Based Models to Predict Reference Crop Evapotranspiration. Appl. Water Sci. 2017, 7, 625–635. [Google Scholar] [CrossRef] [Green Version]
  80. Behmel, S.; Damour, M.; Ludwig, R.; Rodriguez, M.J. Water Quality Monitoring Strategies—A Review and Future Perspectives. Sci. Total Environ. 2016, 571, 1312–1329. [Google Scholar] [CrossRef] [PubMed]
  81. Chowdhury, R.K.; Rahman, R. Multicriteria Decision Analysis in Water Resources Management: The Malnichara Channel Improvement. Int. J. Environ. Sci. Technol. 2008, 5, 195–204. [Google Scholar] [CrossRef]
  82. Xu, F.; Zhao, Y.; Yang, Z.; Zhang, Y. Multi-Scale Evaluation of River Health in Liao River Basin, China. Front. Environ. Sci. Eng. China 2011, 5, 227–235. [Google Scholar] [CrossRef]
  83. Karnib, A. An Approach to Elaborate Priority Preorders of Water Resources Projects Based on Multi-Criteria Evaluation and Fuzzy Sets Analysis. Water Resour. Manag. 2004, 18, 13–33. [Google Scholar] [CrossRef]
  84. Almaaofi, H.; Etemad-Shahidi, A.; Stewart, R. Strategic Evaluation Tool for Surface Water Quality Management Remedies in Drinking Water Catchments. Water 2017, 9, 738. [Google Scholar] [CrossRef]
  85. Langhans, S.D.; Hermoso, V.; Linke, S.; Bunn, S.E.; Possingham, H.P. Cost-Effective River Rehabilitation Planning: Optimizing for Morphological Benefits at Large Spatial Scales. J. Environ. Manag. 2014, 132, 296–303. [Google Scholar] [CrossRef]
  86. Shrestha, S.; Kazama, F. Assessment of Surface Water Quality Using Multivariate Statistical Techniques: A Case Study of the Fuji River Basin, Japan. Environ. Model. Softw. 2007, 22, 464–475. [Google Scholar] [CrossRef]
  87. Singh, K.P.; Malik, A.; Mohan, D.; Sinha, S. Multivariate Statistical Techniques for the Evaluation of Spatial and Temporal Variations in Water Quality of Gomti River (India)—A Case Study. Water Res. 2004, 38, 3980–3992. [Google Scholar] [CrossRef]
  88. Walker, D.; Jakovljević, D.; Savić, D.; Radovanović, M. Multi-Criterion Water Quality Analysis of the Danube River in Serbia: A Visualisation Approach. Water Res. 2015, 79, 158–172. [Google Scholar] [CrossRef]
  89. Sholarin, E.A.; Awange, J.L. Project Management Toolbox. In Environmental Project Management: Principles, Methodology, and Processes; Sholarin, E.A., Awange, J.L., Eds.; Springer International Publishing: Cham, Switzerland, 2015; pp. 295–334. ISBN 978-3-319-27651-9. [Google Scholar]
  90. Docherty, J.M.; Mao, F.; Buytaert, W.; Clark, J.R.; Hannah, D.M. A Framework for Understanding Water-Related Multi-Hazards in a Sustainable Development Context. Prog. Phys. Geogr. Earth Environ. 2020, 44, 267–284. [Google Scholar] [CrossRef]
  91. Kirschke, S.; Avellán, T.; Bärlund, I.; Bogardi, J.J.; Carvalho, L.; Chapman, D.; Dickens, C.W.S.; Irvine, K.; Lee, S.B.; Mehner, T.; et al. Capacity Challenges in Water Quality Monitoring: Understanding the Role of Human Development. Environ. Monit. Assess. 2020, 192, 298. [Google Scholar] [CrossRef] [PubMed]
  92. Strong, C.; Kuzma, S.; Vionnet, S.; Reig, P. Achieving Abundance: Understanding the Cost of a Sustainable Water Future; World Resources Institute: Washington, DC, USA, 2020. [Google Scholar]
  93. Espey, J.; Swanson, E.; Badiee, S.; Christensen, Z.; Fischer, A.; Levy, M.; Yetman, G.; Sherbinin, A.; Chen, R.; you, Q.; et al. Data for Development: A Needs Assessment for SDG Monitoring and Statistical Capacity Development, Sustainable Development Solutions Network. 2015. Available online: https://sdgs.un.org/sites/default/files/publications/2017Data-for-Development-Full-Report.pdf (accessed on 1 September 2022).
  94. Roel, L.; Herroelen, W. Stability and Resource Allocation in Project Planning. IIE Trans. 2004, 36, 667–682. [Google Scholar] [CrossRef]
  95. Pasher, E.; Ronen, T. The Complete Guide to Knowledge Management: A Strategic Plan to Leverage Your Company’s Intellectual Capital; Wiley: Hoboken, NJ, USA, 2011; ISBN 978-1-118-00140-0. [Google Scholar]
  96. Burnette, M.; Williams, S.; Imker, H. From Plan to Action: Successful Data Management Plan Implementation in a Multidisciplinary Project. J. Escience Librariansh. 2016, 5, e1101. [Google Scholar] [CrossRef]
  97. Peletz, R.; Kisiangani, J.; Bonham, M.; Ronoh, P.; Delaire, C.; Kumpel, E.; Marks, S.; Khush, R. Why Do Water Quality Monitoring Programs Succeed or Fail? A Qualitative Comparative Analysis of Regulated Testing Systems in Sub-Saharan Africa. Int. J. Hyg. Environ. Health 2018, 221, 907–920. [Google Scholar] [CrossRef]
  98. Zhongming, Z.; Linong, L.; Wangqiang, Z.; Wei, L. UN World Water Development Report 2021 ‘Valuing Water’; 2021. Available online: https://www.unwater.org/news/un-world-water-development-report-2021-%E2%80%98valuing-water%E2%80%99 (accessed on 1 September 2022).
  99. Braden, J.B.; Brown, D.G.; Dozier, J.; Gober, P.; Hughes, S.M.; Maidment, D.R.; Schneider, S.L.; Schultz, P.W.; Shortle, J.S.; Swallow, S.K.; et al. Social Science in a Water Observing System. Water Resour. Res. 2009, 45. [Google Scholar] [CrossRef]
  100. Gielczewski, M.; Stelmaszczyk, M.; Piniewski, M.; Okruszko, T. How Can We Involve Stakeholders in the Development of Water Scenarios? Narew River Basin Case Study. J. Water Clim. Change 2011, 2, 166–179. [Google Scholar] [CrossRef]
  101. Sullivan, C.A.; Meigh, J. Integration of the Biophysical and Social Sciences Using an Indicator Approach: Addressing Water Problems at Different Scales. Water Resour. Manag. 2006, 21, 111–128. [Google Scholar] [CrossRef]
  102. UN-Water. WWDR2: Water, a Shared Responsibility; UN-Water: Geneva, Switzerland, 2006. [Google Scholar]
  103. Kumpel, E.; MacLeod, C.; Stuart, K.; Cock-Esteb, A.; Khush, R.; Peletz, R. From Data to Decisions: Understanding Information Flows within Regulatory Water Quality Monitoring Programs. Npj Clean Water 2020, 3, 1–11. [Google Scholar] [CrossRef]
  104. Timmerman, J.G. The Need for Participatory Processes and Its Implications for Water Management Information. Reg. Environ. Chang. 2005, 5, 162–163. [Google Scholar] [CrossRef]
  105. Timmerman, J.G.; Beinat, E.; Termeer, K.; Cofino, W. Analyzing the Data-Rich-but-Information-Poor Syndrome in Dutch Water Management in Historical Perspective. Environ. Manag. 2010, 45, 1231–1242. [Google Scholar] [CrossRef] [Green Version]
  106. McNie, E.C. Reconciling the Supply of Scientific Information with User Demands: An Analysis of the Problem and Review of the Literature. Environ. Sci. Policy 2007, 10, 17–38. [Google Scholar] [CrossRef]
  107. Srinivasan, V.; Konar, M.; Sivapalan, M. A Dynamic Framework for Water Security. Water Secur. 2017, 1, 12–20. [Google Scholar] [CrossRef]
  108. Padowski, J.C.; Gorelick, S.M.; Thompson, B.H.; Rozelle, S.; Fendorf, S. Assessment of Human-Natural System Characteristics Influencing Global Freshwater Supply Vulnerability. Environ. Res. Lett 2015, 10, 104014. [Google Scholar] [CrossRef]
  109. Wutich, A.; Budds, J.; Eichelberger, L.; Geere, J.; Harris, L.M.; Horney, J.A.; Jepson, W.; Norman, E.; O’Reilly, K.; Pearson, A.L.; et al. Advancing Methods for Research on Household Water Insecurity: Studying Entitlements and Capabilities, Socio-Cultural Dynamics, and Political Processes, Institutions and Governance. Water Secur. 2017, 2, 1–10. [Google Scholar] [CrossRef]
  110. Wheater, H. Water in a Changing World. In Series on Environmental Science and Management; Imperial College Press and Distributed by World Scientific Publishing Co.: Singapore, 2000; pp. 17–65. [Google Scholar]
  111. Ostrom, V.; Tiebout, C.M.; Warren, R. The Organization of Government in Metropolitan Areas: A Theoretical Inquiry. Am. Political Sci. Rev. 1961, 55, 831–842. [Google Scholar] [CrossRef]
  112. De Filippo, D.; Sanz Casado, E.; Berteni, F.; Barisani, F.; Bautista Puig, N.; Grossi, G. Assessing Citizen Science Methods in IWRM for a New Science Shop: A Bibliometric Approach. Null 2021, 66, 179–192. [Google Scholar] [CrossRef]
  113. Hotlos, H.A. Quantity and Availability of Freshwater Resources: The World-Europe-Poland. Environ. Prot. Eng. 2008, 34, 67–77. [Google Scholar]
  114. Xenarios, S.; Assubayeva, A.; Xie, L.; Sehring, J.; Amirkhanov, D.; Sultanov, A.; Fazli, S. A Bibliometric Review of the Water Security Concept in Central Asia. Environ. Res. Lett 2020, 16, 013001. [Google Scholar] [CrossRef]
  115. Crocker, J.; Bartram, J. Comparison and Cost Analysis of Drinking Water Quality Monitoring Requirements versus Practice in Seven Developing Countries. Int. J. Environ. Res. Public Health 2014, 11, 7333–7346. [Google Scholar] [CrossRef]
  116. Delaire, C.; Peletz, R.; Kumpel, E.; Kisiangani, J.; Bain, R.; Khush, R. How Much Will It Cost to Monitor Microbial Drinking Water Quality in Sub-Saharan Africa? Environ. Sci. Technol 2017, 51, 5869–5878. [Google Scholar] [CrossRef]
  117. Peletz, R.; Kumpel, E.; Bonham, M.; Rahman, Z.; Khush, R. To What Extent Is Drinking Water Tested in Sub-Saharan Africa? A Comparative Analysis of Regulated Water Quality Monitoring. Int. J. Environ. Res. 2016, 13, 275. [Google Scholar] [CrossRef] [Green Version]
  118. Hoff, H.; Döll, P.; Fader, M.; Gerten, D.; Hauser, S.; Siebert, S. Water Footprints of Cities—Indicators for Sustainable Consumption and Production, Hydrol. Earth Syst. Sci 2014, 18, 213–226. [Google Scholar] [CrossRef]
  119. Giné, R.; Pérez-Foguet, A. Improved Method to Calculate a Water Poverty Index at Local Scale. J. Environ. Eng 2010, 136, 1287–1298. [Google Scholar]
  120. Jepson, W. Measuring ‘No-Win’ Waterscapes: Experience-Based Scales and Classification Approaches to Assess Household Water Security in Colonias on the US–Mexico Border. Geoforum 2014, 51, 107–120. [Google Scholar] [CrossRef]
  121. Sullivan, C.A.; Meigh, J.R.; Giacomello, A.M. The Water Poverty Index: Development and Application at the Community Scale. Nat. Res. Forum 2003, 27, 189–199. [Google Scholar] [CrossRef]
  122. Ghosh, R.; Kansal, A.; Venkatesh, G. Urban Water Security Assessment Using an Integrated Metabolism Approach—Case Study of the National Capital Territory of Delhi in India. Resources 2019, 8, 62. [Google Scholar] [CrossRef]
  123. Maniates, M. Sustainable Consumption—Three Paradoxes. GAIA Ecol. Perspect. Sci. Soc. 2014, 23, 201–208. [Google Scholar] [CrossRef]
  124. Spash, C.; Dobernig, K. Theories of (Un)Sustainable Consumption. In Handbook of Ecological Economics: Nature and Society; Spash, C., Ed.; Routledge: New York, NY, USA, 2017; pp. 227–236. [Google Scholar]
  125. Fischer-Kowalski, M.; Haberl, H. Sustainable Development, Long Term Changes in Socio-Economic Metabolism, and Colonization of Nature. Int. Soc. Sci. J. 1998, 50, 573–587. [Google Scholar] [CrossRef]
  126. Madrid-López, M.; Giampietro, C. The Water Metabolism of Socio-Ecological Systems: Reflections and a Conceptual Framework. J. Ind. Ecol. 2015, 19, 853–865. [Google Scholar] [CrossRef]
  127. Aven, T. The Science of Risk Analysis; Routledge: London, UK, 2019. [Google Scholar]
  128. Van Asselt, M.B.A. Perspectives on Uncertainty and Risk; Springer: Berlin/Heidelberg, Germany, 2000. [Google Scholar]
  129. Renn, O.; Laubichler, M.; Lucas, K.; Kröger, W.; Schanze, J.; Scholz, R.W.; Schweizer, P.-J. Systemic Risks from Different Perspectives. Risk Anal. 2020. [Google Scholar] [CrossRef]
  130. Renn, O.; Klinke, A.; Asselt, M. van Coping with Complexity Uncertainty and Ambiguity in Risk Governance: A Synthesis. Ambio 2011, 40, 231–246. [Google Scholar] [CrossRef]
  131. Rose, K.A.; Smith, E.P. Experimental design: The neglected aspect of environmental monitoring. Environ. Manag. 1992, 16, 691–700. [Google Scholar] [CrossRef]
  132. Zhang, J.; Zhang, C. Sampling and sampling strategies for environmental analysis. Int. J. Environ. Anal. Chem 2012, 92, 466–478. [Google Scholar] [CrossRef]
  133. Abbatangelo, J.; Byrne, A.; Butler, J.F.; Wilson, J.M. Application of Multi-Criteria Decision Analysis to Assess Sampling Strategies in Eutrophic Urbanized Waterbodies. Environ. Monit. Assess. 2019, 191, 1. [Google Scholar] [CrossRef]
  134. Olsen, R.L.; Chappell, R.W.; Loftis, J.C. Water Quality Sample Collection, Data Treatment and Results Presentation for Principal Components Analysis—Literature Review and Illinois River Watershed Case Study. Water Res. 2012, 46, 3110–3122. [Google Scholar] [CrossRef]
  135. Wang, Y.; Wilson, J.M.; VanBriesen, J.M. The Effect of Sampling Strategies on Assessment of Water Quality Criteria Attainment. J. Environ. Manag. 2015, 154, 33–39. [Google Scholar] [CrossRef]
  136. Milliman, J.D.; Farnsworth, K.L.L. River Discharge to the Coastal Ocean.: A Global Synthesis, Oceanography; Cambridge University Press: Cambridge, UK, 2011. [Google Scholar]
  137. Alilou, H.; Moghaddam Nia, A.; Saravi, M.M.; Salajegheh, A.; Han, D.; Bakhtiari Enayat, B. A Novel Approach for Selecting Sampling Points Locations to River Water Quality Monitoring in Data-Scarce Regions. J. Hydrol. 2019, 573, 109–122. [Google Scholar] [CrossRef]
  138. Merrington, G.; Sprang, P.V. Deriving Environmental Quality Standards in European Surface Waters: When Are There Too Few Data? Environ. Sci. Pollut. Res. 2013, 21, 67–76. [Google Scholar] [CrossRef]
  139. Anttila, S.; Ketola, M.; Vakkilainen, K.; Kairesalo, T. Assessing temporal representativeness of water quality monitoring data. J. Environ. Monit. 2012, 14, 589–595. [Google Scholar] [CrossRef]
  140. Wright, J.; Liu, J.; Bain, R.; Perez, A.; Crocker, J.; Bartram, J.; Gundry, S. Water Quality Laboratories in Colombia: A GIS-Based Study of Urban and Rural Accessibility. Sci. Total Environ. 2014, 485–486, 643–652. [Google Scholar] [CrossRef]
  141. Sanders, T.G.; Ward, R.C.; Loftis, J.C.; Steele, T.D.; Adrian, D.D.; Yevjevich, V. Design of Networks for Monitoring Water Quality; Water Resources Publications LLC: Lone Tree, CO, USA, 1983. [Google Scholar]
  142. Strobl, R.O.; Robillard, P.D. Network Design for Water Quality Monitoring of Surface Freshwaters: A Review. J. Environ. Manag. 2008, 87, 639–648. [Google Scholar] [CrossRef]
  143. Ward, R.C.; Loftis, J.C.; McBride, G.B. Design of Water Quality Monitoring Systems; John Wiley & Sons: Hoboken, NJ, USA, 1990. [Google Scholar]
  144. Taylor, D.D.J.J.; Khush, R.; Peletz, R.; Kumpel, E. Efficacy of Microbial Sampling Recommendations and Practices in Sub-Saharan Africa. Water Res. 2018, 134, 115–125. [Google Scholar] [CrossRef]
  145. Wagener, T.; Sivapalan, M.; Troch, P.A.; McGlynn, B.L.; Harman, C.J.; Gupta, V.H.; Kumar, P.; Rao, P.S.C.; Basu, N.B.; Wilson, J.S.; et al. The Future of Hydrology: An Evolving Science for a Changing World. Water Resour. Res. 2010, 46, 1–10. [Google Scholar] [CrossRef]
  146. Doeffinger, T.; Borgomeo, E.; Young, W.J.; Sadoff, C.; Hall, J.W. A Diagnostic Dashboard to Evaluate Country Water Security. Water Policy 2020, 22, 825–849. [Google Scholar] [CrossRef]
  147. Srinivasan, V.; Lambin, E.F.; Gorelick, S.M.; Thompson, B.H.; Rozelle, S. The Nature and Causes of the Global Water Crisis: Syndromes from a Meta-Analysis of Coupled Human-Water Studies. Water Resour. Res. 2012, 48, 1–16. [Google Scholar] [CrossRef]
  148. Bartram, J.; Ballance, R. (Eds.) WHO. Water Quality Monitoring: A Practical Guide to the Design and Implementation of Freshwater Quality Studies and Monitoring Programmes; CRC Press: Boca Raton, FL, USA, 1996; pp. 1–348.
  149. Chapman, D. Water Quality Assessments—A Guide to Use of Biota, Sediments and Water in Environmental Monitoring, 2nd ed.; E&FN Spon: London, UK, 1996; Available online: https://wedocs.unep.org/bitstream/handle/20.500.11822/8342/-Water%20Quality%20Assessments_%20A%20guide%20to%20the%20use%20of%20Biota,%20Sediments%20and%20water%20in%20Ecosystems-19923184.pdf?sequence=3&amp%3BisAllowed= (accessed on 1 September 2022).
  150. IISD. Water Quality Monitoring System Design; International Institute for Sustainable Development: Winnipeg, Canada, 2015; Volume 49. [Google Scholar]
  151. WMO. Good Practice Guidelines for Water Data Management Policy; World Water Data Initiative; 2018; Available online: https://public.wmo.int/en/resources/library/good-practice-guidelines-water-data-management-policy (accessed on 1 September 2022).
  152. Timmerman, J.G.; Ottens, J.J.; Ward, R.C. The Information Cycle as a Framework for Defining Information Goals for Water-Quality Monitoring. Environ. Manag. 2000, 25, 229–239. [Google Scholar] [CrossRef]
  153. UN-Environment. A Framework for Freshwater Ecosystem Management. 2017. Available online: https://www.unep.org/resources/publication/framework-freshwater-ecosystem-management (accessed on 1 September 2022).
  154. USEPA. Guidelines for the Preparation of the Comprehensive State Water Quality Assessments; USEPA: Washington, DC, USA, 1997.
  155. WMO. Planning of Water Quality Monitoring Systems; WMO: Washington, DC, USA, 2013. [Google Scholar]
  156. Khalil, B.; Ouarda, T.B.M.J.; St-Hilaire, A. A Statistical Approach for the Assessment and Redesign of the Nile Delta Drainage System Water-Quality-Monitoring Locations. J. Environ. Monit 2011, 13, 2190–2205. [Google Scholar] [CrossRef]
  157. Conrad, C.C.; Hilchey, K.G. A review of citizen science and community-based environmental monitoring: Issues and opportunities. Environ. Monit. Assess. 2011, 176, 273–291. [Google Scholar] [CrossRef]
  158. Sousa, J.C.G.; Ribeiro, A.R.; Barbosa, M.O.; Pereira, M.F.R.; Silva, A.M.T. A Review on Environmental Monitoring of Water Organic Pollutants Identified by EU Guidelines. J. Hazard. Mater. 2018, 344, 146–162. [Google Scholar] [CrossRef]
  159. World Bank. Readiness Assessment Tool. 2021. Available online: http://opendatatoolkit.worldbank.org/en/odra.html (accessed on 10 September 2022).
  160. CPD. Water Security 2020 Reporting Guidance. Available online: https://guidance.cdp.net/en/guidance?cid=15&ctype=theme&idtype=ThemeID&incchild=1&microsite=0&otype=Guidance&tags=TAG-646%252CTAG-607%252CTAG-600 (accessed on 22 January 2022).
  161. WHO. Guidelines for Drinking-Water Quality, 4th Edition, Incorporating the 1st Addendum; WHO: Geneva, Switzerland, 2017.
  162. WHO. Guidelines for the Safe Use of Wastewater, Excreta and Greywater in Agriculture and Aquaculture; WHO: Geneva, Switzerland, 2006.
  163. OGC. Open Geospatial Consortium WaterML Standards. 2022. Available online: https://www.ogc.org/projects/groups/waterml2.0swg (accessed on 22 January 2022).
  164. Holloway, J.; Mengersen, K. Statistical Machine Learning Methods and Remote Sensing for Sustainable Development Goals: A Review. Remote Sens. 2018, 10, 1365. [Google Scholar] [CrossRef]
  165. Degbelo, A. FAIR Geovisualizations: Definitions, Challenges, and the Road Ahead. Int. J. Geogr. Inf. Sci. 2021, 36, 1059–1099. [Google Scholar] [CrossRef]
  166. OSM. Open Street Map. 2022. Available online: https://www.openstreetmap.org (accessed on 1 September 2022).
  167. UN-CEO-Water-Mandate. Interactive Database of the World’s River Basins. Available online: http://riverbasins.wateractionhub.org (accessed on 1 September 2022).
  168. EC. Global Surface Water Explorer. Available online: https://wbwaterdata.org/dataset/global-surface-water-explorer (accessed on 1 September 2022).
  169. EO. Research Bluedot—Water Observatory. Available online: https://www.blue-dot-observatory.com (accessed on 1 September 2022).
  170. ESA. Copernicus Open Access Hub. Available online: https://scihub.copernicus.eu (accessed on 1 September 2022).
  171. ESA. ESA World Cover 2020. Available online: https://esa-worldcover.org/en (accessed on 1 September 2022).
  172. Google-Developers, Google Earth Engine Catalog. Available online: https://developers.google.com/earth-engine/datasets/ (accessed on 1 September 2022).
  173. Rajagopal, R. Optimal Sampling Strategies for Source Identification in Environmental Episodes. Environ. Monit. Assess. 1984, 4, 1–14. [Google Scholar] [CrossRef] [PubMed]
  174. Birk, S.; Bonne, W.; Borja, A.; Brucet, S.; Courrat, A.; Poikane, S.; Solimini, A.; Van De Bund, W.; Zampoukas, N.; Hering, D. Three Hundred Ways to Assess Europe’s Surface Waters: An Almost Complete Overview of Biological Methods to Implement the Water Framework Directive. Ecol. Indic. 2012, 18, 31–41. [Google Scholar] [CrossRef]
  175. van Griensven, A.; Meixner, T.; Grunwald, S.; Bishop, T.; Diluzio, M.; Srinivasan, R. A Global Sensitivity Analysis Tool for the Parameters of Multi-Variable Catchment Models. J. Hydrol. 2006, 324, 10–23. [Google Scholar] [CrossRef]
  176. Vrana, B.; Allan, I.J.; Greenwood, R.; Mills, G.A.; Dominiak, E.; Svensson, K.; Knutsson, J.; Morrison, G. Passive Sampling Techniques for Monitoring Pollutants in Water. TrAC Trends Anal. Chem. 2005, 24, 845–868. [Google Scholar] [CrossRef]
  177. PNNL Visual Sample Plan. Available online: https://www.pnnl.gov/projects/visual-sample-plan (accessed on 1 September 2022).
  178. Wolfson, L.; Lewandowski, A.; Bonnell, J.; Frankenberger, J.; Sleeper, F.; Latimore, J. Developing Capacity for Local Watershed Management: Essential Leadership Skills and Training Approaches. J. Contemp. Water Res. Educ. 2015, 156, 86–97. [Google Scholar] [CrossRef]
  179. UNEP Global Risk Data Platform. Available online: https://wesr.unepgrid.ch/?project=MX-XVK-HPH-OGN-HVE-GGN&language=en (accessed on 1 September 2022).
  180. WRI. Aqueduct. Available online: https://www.wri.org/aqueduct (accessed on 1 September 2022).
  181. WWF. Water Risk Filter. Available online: https://waterriskfilter.org (accessed on 1 September 2022).
  182. Logan, T.M.; Aven, T.; Guikema, S.; Flage, R. The Role of Time in Risk and Risk Analysis: Implications for Resilience, Sustainability, and Management. Risk Anal. 2021, 41, 1959–1970. [Google Scholar] [CrossRef]
  183. Westland, J. The Project Management Life Cycle: A Complete Step-By-Step Methodology for Initiating, Planning, Executing & Closing a Project Successf; Kogan Page Publishers: London, UK, 2007. [Google Scholar]
  184. Whitfield, P.H. Goals and data collection designs for water quality monitoring. JAWRA J. Am. Water Resour. Assoc. 1988, 24, 775–780. [Google Scholar] [CrossRef]
  185. Hidalgo, E.S. Adapting the Scrum Framework for Agile Project Management in Science: Case Study of a Distributed Research Initiative. Heliyon 2019, 5, e01447. [Google Scholar] [CrossRef]
  186. Kendrick, T. Identifying and Managing Project Risk: Essential Tools for Failure-Proofing Your Project; AMACOM: New York, NY, USA, 2015; ISBN 978-0-8144-3609-7. [Google Scholar]
  187. Phillips, C.A.; Stawarski, P.P. Data Collection: Planning for and Collecting All Types of Data; Wiley: Hoboken, NJ, USA, 2008. [Google Scholar]
  188. Ferrero, G. Capacity Building and Training Approaches for Water Safety Plans: A Comprehensive Literature Review. Int. J. Hyg. Environ. Health 2019, 222, 615–627. [Google Scholar] [CrossRef]
  189. McIntosh, B.S.; Taylor, A. Developing T-Shaped Water Professionals: Building Capacity in Collaboration, Learning, and Leadership to Drive Innovation. J. Contemp. Water Res. Educ. 2013, 150, 6–17. [Google Scholar] [CrossRef]
  190. Alaerts, G.; Dickinson, N. Water for a Changing World—Developing Local Knowledge and Capacity. In Proceedings of the International Symposium “Water for a Changing World Developing Local Knowledge and Capacity”, Delft, The Netherlands, 13–15 June 2007; Alaerts, G., Dickinson, N., Eds.; CRC Press: London, UK, 2008. ISBN 978-0-429-20688-7. [Google Scholar]
  191. Chinyio, E.; Olomolaiye, P. Construction Stakeholder Management 2009; Wiley: Hoboken, NJ, USA, 2009. [Google Scholar]
  192. Grimble, R.; Wellard, K. Stakeholder Methodologies in Natural Resource Management: A Review of Principles, Contexts, Experiences and Opportunities. Agric. Syst. 1997, 55, 173–193. [Google Scholar] [CrossRef]
  193. Mutekanga, F.P.; Kessler, A.; Leber, K.; Visser, S. The Use of Stakeholder Analysis in Integrated Watershed Management. Mred 2013, 33, 122–131. [Google Scholar] [CrossRef]
  194. Chambers, R. Participatory Workshops: A Sourcebook of 21 Sets of Ideas and Activities; Routledge: London, UK, 2002. [Google Scholar]
  195. IAP. IAP2 Public Participation Toolbox. Available online: https://icma.org/documents/iap2-public-participation-toolbox (accessed on 1 September 2022).
  196. Schweizer, P.-J.; Goble, R.; Renn, O. Social Perception of Systemic Risks. Risk Anal. 2021, 42, 1455–1471. [Google Scholar] [CrossRef]
  197. Dong, C.; Schoups, G.; van de Giesen, N. Scenario Development for Water Resource Planning and Management: A Review. Technol. Forecast. Soc. Change 2013, 80, 749–761. [Google Scholar] [CrossRef]
  198. Reynaud, A.; Markantonis, V.; Carmona Moreno, C.; N’Tcha M’Po, Y.; Sambienou, G.W.; Adandedji, F.M.; Afouda, A.; Agbossou, E.K.; Mama, D. Combining Expert and Stakeholder Knowledge to Define Water Management Priorities in the Mékrou River Basin. Water 2015, 7, 7078–7094. [Google Scholar] [CrossRef]
  199. Spruijt, P. Roles of Scientists as Policy Advisers on Complex Issues: A Literature Review. Environ. Sci. 2014, 10, 16–25. [Google Scholar]
  200. Edelenbos, J. Co-Producing Knowledge: Joint Knowledge Production between Experts, Bureaucrats and Stakeholders in Dutch Water Management Projects. Environ. Sci. 2011, 10, 675–684. [Google Scholar] [CrossRef]
  201. Borda, O.F. Participatory (Action) Research in Social Theory: Origins and Challenges. In Handbook of Action Research: Participative Inquiry and Practice; SAGE: Thousand Oaks, CA, USA, 2001. [Google Scholar]
  202. Kellert, S.R. A Biocultural Basis for an Ethic toward the Natural Environment. In Foundations of Environmental Sustainability; Oxford University Press: New York, NY, USA, 2008; pp. 321–332. [Google Scholar]
  203. Kellert, S.R. The Value of Life: Biological Diversity and Human Society; Island Press: Washington, DC, USA, 1996. [Google Scholar]
  204. Olson, R.; Hackett, J.; DeRoy, S. Mapping the Digital Terrain: Towards Indigenous Geographic Information and Spatial Data Quality Indicators for Indigenous Knowledge and Traditional Land-Use Data Collection. Cartogr. J. 2016, 53, 348–355. [Google Scholar] [CrossRef]
  205. Villamor, G.B.; Palomo, I.; Santiago, C.A.L.; Oteros-Rozas, E.; Hill, J. Assessing Stakeholders’ Perceptions and Values towards Social-Ecological Systems Using Participatory Methods. Ecol. Processes 2014, 3, 1–2. [Google Scholar] [CrossRef]
  206. FAO. FAO Hand-in-Hand Initiative. Available online: https://www.fao.org/hand-in-hand/en/ (accessed on 1 September 2022).
  207. Ginkel, K.C.H.H.; Hoekstra, A.Y.; Buurman, J.; Hogeboom, R.J. Urban Water Security Dashboard: Systems Approach to Characterizing the Water Security of Cities. J. Water Resour. Plan. Manag 2018, 144, 1–11. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Visualisation of six of the most-used definitions of WS according to interrelations and main aims/activities. The figure shows the framing given to WS (L2,L3) in order to support and satisfy a particular area of human society (L4) with a given condition (L5).
Figure 1. Visualisation of six of the most-used definitions of WS according to interrelations and main aims/activities. The figure shows the framing given to WS (L2,L3) in order to support and satisfy a particular area of human society (L4) with a given condition (L5).
Water 14 02907 g001
Figure 2. Typical structure of a WS index (in this case from Mason 2012) where the WS concept is defined across several dimensions.
Figure 2. Typical structure of a WS index (in this case from Mason 2012) where the WS concept is defined across several dimensions.
Water 14 02907 g002
Figure 3. Conceptual diagram showing WS as an integrative system (light blue circle) that includes several sub-systems (yellow, red, and brown clusters).
Figure 3. Conceptual diagram showing WS as an integrative system (light blue circle) that includes several sub-systems (yellow, red, and brown clusters).
Water 14 02907 g003
Figure 4. The figure shows how activities in the different interfaces could be carried out in order to strengthen the linkage between physical environment > data collection > production of information > stakeholder awareness > positive change > updated physical environment. These activities form a continuous cycle of transformation that may be repeated several times.
Figure 4. The figure shows how activities in the different interfaces could be carried out in order to strengthen the linkage between physical environment > data collection > production of information > stakeholder awareness > positive change > updated physical environment. These activities form a continuous cycle of transformation that may be repeated several times.
Water 14 02907 g004
Figure 5. The trade-offs that are necessary in a project when dealing with the triple constraints of time, quality, and cost. Since the three optimal goals (high quality, quickness, and low cost) are not achievable all together, project managers need to decide what is the best balance between the constraints.
Figure 5. The trade-offs that are necessary in a project when dealing with the triple constraints of time, quality, and cost. Since the three optimal goals (high quality, quickness, and low cost) are not achievable all together, project managers need to decide what is the best balance between the constraints.
Water 14 02907 g005
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Butte, G.; Solano-Correa, Y.T.; Peppa, M.V.; Ruíz-Ordóñez, D.M.; Maysels, R.; Tuqan, N.; Polaine, X.; Montoya-Pachongo, C.; Walsh, C.; Curtis, T. A Framework for Water Security Data Gathering Strategies. Water 2022, 14, 2907. https://doi.org/10.3390/w14182907

AMA Style

Butte G, Solano-Correa YT, Peppa MV, Ruíz-Ordóñez DM, Maysels R, Tuqan N, Polaine X, Montoya-Pachongo C, Walsh C, Curtis T. A Framework for Water Security Data Gathering Strategies. Water. 2022; 14(18):2907. https://doi.org/10.3390/w14182907

Chicago/Turabian Style

Butte, Giacomo, Yady Tatiana Solano-Correa, Maria Valasia Peppa, Diana Marcela Ruíz-Ordóñez, Rachael Maysels, Nasser Tuqan, Xanthe Polaine, Carolina Montoya-Pachongo, Claire Walsh, and Thomas Curtis. 2022. "A Framework for Water Security Data Gathering Strategies" Water 14, no. 18: 2907. https://doi.org/10.3390/w14182907

APA Style

Butte, G., Solano-Correa, Y. T., Peppa, M. V., Ruíz-Ordóñez, D. M., Maysels, R., Tuqan, N., Polaine, X., Montoya-Pachongo, C., Walsh, C., & Curtis, T. (2022). A Framework for Water Security Data Gathering Strategies. Water, 14(18), 2907. https://doi.org/10.3390/w14182907

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop