Next Article in Journal
Investigation on the Cavity Backwater of Chute Aerators under Various Atmospheric Pressures
Previous Article in Journal
Investigating the Granulometric Distribution of Fluvial Sediments through the Hybrid Technique: Case Study of the Baganza River (Italy)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a Deep Learning-Based Prediction Model for Water Consumption at the Household Level

1
Institute of Water Resources System, Inha University, Incheon 22201, Korea
2
Blackland Research and Extension Center, Texas A&M AgriLife, Temple, TX 76502, USA
3
Department of Civil Engineering, Inha University, Incheon 22201, Korea
*
Author to whom correspondence should be addressed.
Water 2022, 14(9), 1512; https://doi.org/10.3390/w14091512
Submission received: 6 April 2022 / Revised: 29 April 2022 / Accepted: 6 May 2022 / Published: 9 May 2022
(This article belongs to the Section Urban Water Management)

Abstract

:
The importance of efficient water resource supply has been acknowledged, and it is essential to predict short-term water consumption in the future. Recently, it has become possible to obtain data on water consumption at the household level through smart water meters. The pattern of these data is nonlinear due to various factors related to human activities, such as holidays and weather. However, it is difficult to accurately predict household water consumption with a nonlinear pattern with the autoregressive integrated moving average (ARIMA) model, a traditional time series prediction model. Thus, this study used a deep learning-based long short-term memory (LSTM) approach to develop a water consumption prediction model for each customer. The proposed model considers several variables to learn nonlinear water consumption patterns. We developed an ARIMA model and an LSTM model in the training dataset for customers with four different water-use types (detached houses, apartment, restaurant, and elementary school). The performances of the two models were evaluated using a test dataset that was not used for model learning. The LSTM model outperformed the ARIMA model in all households (correlation coefficient: mean 89% and root mean square error: mean 5.60 m3). Therefore, it is expected that the proposed model can predict customer-specific water consumption at the household level depending on the type of use.

1. Introduction

Water is one of humanity’s most essential resources, and water supply facilities are necessary for ensuring an efficient supply of limited water resources. The water supply penetration rate is over 80% in developed countries and less than 50% in developing countries, depending on the level of development [1]. In Korea, the water supply penetration rate was 99.3% in 2019, with the aging water supply network accounting for more than 32% [2]. This has caused various water problems, such as water quality deterioration and leakage, and further aggravated water stress.
Therefore, the focus used to be on establishing water supply facilities, but in recent years, the importance of efficient water resource supply has been acknowledged. Many studies have been conducted on short-term future water consumption prediction, which is vital for efficient water management [3,4,5,6]. For example, Alvisi et al. [7] emphasized that water supply should be operated based on future water demand to supply water efficiently. They predicted future water consumption patterns using an autoregressive (AR) model, which is a linear time series model that predicts water consumption for adequate water supply. Atsalakis et al. [8] stated that a large-scale water supply management system is necessary to predict water demand accurately. Therefore, they developed an adaptive neuro-fuzzy inference system (ANFIS) by applying the neuro-fuzzy concept to a linear time-series model and compared the predictive performance to that of the AR model. Paulo et al. [9] noted that accurate short-term water demand prediction is essential for water managers to make efficient decisions. They proposed the harmony search optimization algorithm based on the autoregressive integrated moving average (ARIMA) model to improve water demand prediction performance. Salah et al. [10] proposed a method for removing noise from water consumption data and used the noise-removed water consumption data and an AR model to predict monthly water demand. Furthermore, Haiyan et al. [11] predicted annual water demand for adequate water supply in Beijing, experiencing a water shortage as a result of rapid urban growth. The uncertain autoregressive (UAR) model, which can consider uncertainty in the AR model, was evaluated by comparing its water demand prediction performance to that of the traditional AR model. Traditional time series analysis models, such as AR and ARIMA models, have a limitation in that they cannot predict nonlinear patterns as they are based on linear patterns of past data.
With the recent development of computing technology, machine learning and deep learning are often used to predict nonlinear data in the hydrology field [12,13,14]. The machine learning and deep learning models, such as random forest (RF) and long short-term memory (LSTM), which can reflect the nonlinear time series characteristics of water consumption, are being used for predicting water consumption [15,16,17,18]. For example, Bougadis et al. [19] highlighted that it is necessary to predict future water demand and expand water supply infrastructures to build an optimal water distribution facility based on accurate water consumption prediction. They evaluated the artificial neural network (ANN) and ARIMA models for predicting potential water demand and discovered that the ANN-based prediction model outperformed the ARIMA model. Furthermore, Manuel et al. [20] stated that it is crucial to predict the water consumption of consumers to provide an efficient water supply, and they used ANN, RF, and support vector regression (SVR) algorithms to predict the water consumption of cities in southeastern Spain. SVR had the best predictive performance among the three machine learning algorithms. Mohammed et al. [21] stated that governments must plan water distribution to plan for sustainable development. Moreover, they used an ANN model to predict future water demand and used various optimization techniques, such as Levenberg–Marquardt (LM) and genetic algorithms (GA), to develop an optimal model. Li et al. [22] predicted daily water demand in Hefei, China, by applying various data-driven models, such as LSTM, SVR, and RF models. The SVR model had a mean absolute percentage error (MAPE) value of 7.66%, the RF model had a MAPE value of 2.64%, and the LSTM model demonstrated the best performance with a MAPE value of 1.36%. External factors must be considered to improve water consumption prediction as water consumption is influenced by nonlinear patterns such as holidays, weekdays, weather features, and human activities [23,24,25,26]. However, most previous studies have limitations in that they only used past water consumption data without considering external factors.
Bakker et al. [27] stated that predicting water consumption with only a single predictor can produce accurate results, but prediction errors can occur significantly depending on weather conditions. They used a multiple regression model that considers various meteorological variables to predict water consumption in urban areas. They discovered that prediction errors can be reduced by up to 11% when multiple meteorological variables are considered. Austin et al. [28] used a multiple regression model that considers demographics and weather conditions to predict water consumption in Seattle, Washington. Adam et al. [29] used ANN and multiple linear regression (MLR) models that consider historical water consumption data, humidity, and daily variables to predict daily water consumption in Torun, Poland. They discovered that the MAPE for the MLR model was 2.56%, while that for the ANN model was 2.28%, indicating that the ANN model performed better. Previous studies have revealed that it is essential to consider external factors such as weather conditions and previous water consumption data for accurate water demand prediction.
Smart technology has recently been introduced in the water supply field as a result of the advancement in information and communication technology and the fourth industrial revolution, and internet of things (IoT) devices such as smart water meters are being used for efficient water management [30,31,32,33]. Since data for individual users are collected, water leaks and errors can be easily assessed, and various services can be provided by analyzing water consumption patterns for each user. In the United Kingdom, Asset Management Plan 6 was launched to solve a serious leak problem, and the smart water meter project was promoted for efficient water management [34]. Maria et al. [35] used household water consumption data measured by a smart water meter to predict future water consumption in the United Kingdom. In addition, the effect of weather conditions on household water consumption was analyzed. Xenochristou et al. [36] predicted water consumption for one to seven days based on household water consumption data collected at 30-min intervals in the southwestern part of the United Kingdom. The characteristics of 600 households were identified and divided into five groups, and a gradient boosting machine (GBM) model was used to predict the water consumption of each group.
The smart water grid (SWG) project has been promoted in Incheon Metropolitan City, South Korea, and smart water meters have been installed in urban areas to manage water to solve the water shortage problem [37]. Choi and Kim [38] used a multiple regression model, a multilayer perceptron model, and an LSTM model to predict future water consumption based on hourly household and commercial water consumption data collected through smart water meters. They discovered that the LSTM model has better predictive performance than the other models. Various studies on smart water meters are being expanded to establish an efficient water supply plan and provide various water-related services. However, in South Korea, there are still insufficient studies on smart water meters to predict consumer-level water consumption.
Therefore, this study aimed to develop a model for predicting consumer-level water consumption using data from a smart water meter installed in Yeongjong Island, Incheon, South Korea. In this study we used an LSTM-based model, to predict water consumption prediction at the household level, that is suitable for time series analysis among deep learning models and can consider external factors. We evaluated its predictive performance by comparing it to the ARIMA model, which is a traditional stochastic model.

2. Materials and Methods

2.1. Study Area

The Republic of Korea is a peninsula located at 33°–38° North and 124°–131° East, with mountainous terrain covering more than half of the region. Korea’s rainfall characteristics are influenced by its monsoon climate, rainfall is concentrated in the summer (June–October), and regional variations are based on the topographical characteristics. The study area is Yeongjong Island, which is the sixth-largest island in Korea (total area: 125.7 km2) and a representative area with a water shortage problem. It is located in Jung-gu, Incheon.
The SWG project was promoted in Yeongjongdo Island in 2017 to improve efficient water management, and smart water meters were installed in about 500 households. Figure 1 shows the study area and the location of the installed smart water meters. According to the water-use type, the smart water meters were separated into residential, commercial, and public categories. The residential category was further divided into detached houses and large apartments. This research used a case study to develop a model for predicting consumer-level water consumption, and one representative household for each water-use type was selected and analyzed. In Figure 1, the red circle represents the entire location of the installed smart water meter, the blue marker represents the selected smart water meter, and the orange marker represents a meteorological station that collects weather information.

2.2. Data Description

A smart water meter can transmit and receive real-time water consumption and water quality data, which can be used to confirm water consumption fees, leakage, and additional details for each customer.
A smart water meter has been installed in this study area since January 2017 as part of the SWG project, and consumer water consumption data have since been collected. This study used a representative household for each water-use type as the target sensor, and water consumption data were collected from January 2017 to December 2019. Table 1 summarizes the water consumption data for the target sensor based on water-use type. Rows 1 and 2 contain descriptions of the type of use, while rows 3–5 contain water consumption statistics.
Type A represents residential use (detached house), and water consumption is low as the number of users is lower than that for other types. Type B represents residential use (apartment), with the largest number of users and the highest water consumption. Type C represents commercial use (restaurant), and it has the second-lowest water consumption level. Type D represents public use (elementary school) and has the second-highest water consumption level.
Figure 2 shows the weekly water consumption pattern for each water-use type. Types A, B, and C had similar patterns, and their water consumption was high on weekends and low on weekdays. However, the water consumption pattern of Type D was low on weekends and high on weekdays.
The reasons for these patterns are as follows: In Types A and B, individuals do not have much time to stay at home as they work on weekdays. In Type C, business is better on weekends than on weekdays depending on the floating population; thus, water consumption is higher on weekends. In Type D, water consumption is high during weekdays as students spend more time at school on weekdays than on weekends. In addition, the difference in water consumption between the days of the week is small in Type C as restaurants are open all days of the week. However, the difference in water consumption between the days of the week is significant in Type D as schools do not open on weekends. In this manner, information on weekdays and weekends is an essential variable for understanding the water consumption pattern by water-use type.
Additionally, weather information was used to identify nonlinear patterns for water consumption based on water-use type. Weather data, such as rainfall, relative humidity, and temperature, were collected at a meteorological station near the study area (orange marker in Figure 1). This station is managed by the Korea Meteorological Administration (KMA), and meteorological data were obtained as daily data from January 2017 to December 2019. Figure 3 shows the monthly time series for each weather condition. Rainfall, relative humidity, and temperature all have maximum values in summer (June to September in Korea) and minimum values in winter (December to February in Korea).

2.3. Methodology for Water Consumption Prediction

In this study, the traditional ARIMA model and the LSTM model were used to predict water consumption by consumers, and the performance of the two models was compared. Figure 4 shows the flow chart for this study, including (1) model training and (2) model evaluation. The water consumption data of the selected four types mentioned in Section 2.2 were collected from January 2017 to December 2019. The data were divided into a training dataset (January 2017 to December 2018) for model training and a test dataset (January 2019 to December 2019) for model evaluation. The ARIMA and LSTM models were trained using optimal parameters in the model training phase. The ARIMA model was trained using past data and the periodicity of the data. However, the LSTM model was trained by considering both the periodicity of the data and external variables such as weather and weekend information. In the model evaluation phase, the prediction results of the two models were evaluated for observed data, and the best-performing model was chosen as the final model. The root mean square error (RMSE) and correlation coefficient (CC) were used as the evaluation metrics in this case.

2.3.1. ARIMA Model

The AR model predicts output variables via linear dependence on the stochastic term of its previous values. This model assumes time series data as stationary, and it is expressed as Equation (1), where p is the lag time of the AR model, is the AR coefficient, y t i is the previous values before t i hours and ε t is the error term [39,40,41].
y t = 1 y t 1 + 2 y t 2 + + p y t p + ε t = i = 1 p i y t i + ε t
The moving average (MA) model predicts output variables using the error term ( ε t ) of its previous values. This model assumes time series data as stationary, similar to the AR model, and it is expressed as Equation (2). Here, q is the lag time of the MA model, μ is the mean of the series, and θ is the MA coefficient [42,43,44].
y t = μ + ε t + θ 1 ε t 1 + θ 2 ε t 2 + + θ q ε t q = μ + i = 1 q θ i ε t i + ε t
The autoregressive moving-average (ARMA) model, which combines the AR and MA models to predict a more accurate output variable, is expressed as Equation (3). The model is usually referred to as the ARMA (p, q) model, where p is the lag time of the AR part and q is the lag time of the MA part [45,46,47].
y t = 1 y t 1 + 2 y t 2 + + p y t p + ε t + θ 1 ε t 1 + θ 2 ε t 2 + + θ q ε t q
Box et al. [48] proposed an ARIMA model that can be used with nonstationary time series data. The nonstationary time series is converted into a stationary time series using the differencing. Here, the differencing is to make the average change in the time series constant through the difference in continuous observations. The model is usually referred to as the ARIMA (p, d, q) model and is expressed as Equation (4), where B is the backward shift operator, Δ is the differences, and d is the parameter of the differences.
p ( B ) Δ d y t = δ + θ q ( B )   ε t

2.3.2. LSTM Model

Various machine learning models are applied to predict non-linear data. The LSTM model is an effective advanced neural network model when the input data is sequential data. Thus, the LSTM model was used to predict water consumption in this study.
Hochreiter and Schmidhuber invented the LSTM, a type of artificial recurrent neural network (RNN) architecture used in the field of deep learning [49]. The LSTM model was developed to address the vanishing gradient problem when training traditional RNNs, and it is widely used in studies related to time series prediction [50,51,52].
An LSTM unit is composed of a cell state ( C t ), an input gate ( i t ), an output gate ( o t ), and a forget gate ( f t ), as shown in Figure 5. Each state exchanges information with one another. The cell state transfers past information ( C t 1 ) and updated information ( C t ) to the next cell through a forget gate, an input gate, and an output gate to update the information. The forget gate receives the new input data ( x t ) and previous hidden state data ( h t 1 ) and determines what information to convey to the cell state. The input gate determines what information to update among the new information and generates a new information value ( C ˜ t ) through an activation function (tanh). The output gate determines the information to be the output. Equations (5)–(10) can be used to depict this process. Here, σ is the activation function; W f , W i , W C , and W o are the weights of each gate; and b f , b i , b C , are b o are the biases of each gate.
f t = σ ( W f · [ h t 1 , x t ] + b f ) ,
i t = σ ( W i · [ h t 1 , x t ] + b i ) ,
C ˜ t = tanh ( W C · [ h t 1 , x t ] + b C ,
C t = f t · C t 1 + i t · C ˜ t ,
o t = σ ( W o · [ h t 1 , x t ] + b o ) ,
h t = o t · tanh ( C t ) .

2.4. Evaluation Metrics

The RMSE and CC were used to evaluate the performance of each model in this study. The RMSE is used to indicate representative errors in predicted and observed values. The lower the RMSE, the better the performance, and it can be expressed as Equation (11), where n is the number of data, y i is the observed value, and y ^ i is the predicted value.
RMSE = 1 n i = i n ( y i y ^ i ) 2 .
The CC measures the linear correlation between two datasets (predicted value and observed value). It is a ratio between the covariance of two datasets, and it is essentially a normalized measurement of the covariance, with the result always ranging between −1 and 1. A CC closer to −1 indicates a negative correlation, and a CC closer to +1 indicates a positive correlation. It is expressed as Equation (12), where y ¯ is the mean of the observed value and y ^ ¯ is the mean of the predicted value.
CC = ( y i y ¯ ) ( y ^ i y ^ ¯ ) ( y i y ¯ ) 2 ( y ^ i y ^ ¯ ) 2 .

3. Results

3.1. Application of the ARIMA Model

An autocorrelation function (ACF) analysis was conducted before training the ARIMA model (Figure 6). The autocorrelation decreased as the lag time increased, but it increased again when the lag time was seven or eight days. This result indicates that the dataset had a seven-day or eight-day cycle.
The ARIMA model consists of three parameters: an AR model parameter (p), an MA model parameter (q), and a differential parameter (d). In this study, the sensitivity of the parameters was analyzed to build the best ARIMA model for each type. The p and q parameters were considered from zero to eight with reference to the ACF results, and the d parameter was considered from zero to one. A total of 162 ( 8 ( p ) × 8 ( q ) × 2 ( d ) ) ARIMA models were developed according to parameter combination, and the ARIMA model with the lowest RMSE was selected. Table 2 summarizes the parameters of the optimal ARIMA model for each type. For Types A and D, the p and q parameters were set at seven, while the d parameter d was set at zero. For Types B and C, the p and q parameters were set at eight, while the d parameter d was set at zero.
Table 3 summarizes the performance of the optimal ARIMA model for each type. The CC and RMSE were used to evaluate the performance of the model in the training dataset. The average correlation between the four water-use types was calculated as 93%, and the average RMSE was calculated as 4.43 m3.
Figure 7 shows the prediction results of the ARIMA model in the training dataset as a time series. The solid blue lines represent the time series of the observed water consumption. At the same time, the red dashed lines represent the time series of the predicted water consumption by the ARIMA model. The solid blue lines and the red dashed lines exhibit almost similar results. Type D had the best performance in terms of performance by type, while Type B had the worst performance. This is due to Type D (school) having a relatively constant pattern, while Type B (apartment) has a complex pattern (see Figure 7).
Overall, the performance of the ARIMA model in the training dataset was excellent, indicating that it can make similar predictions for the observed water consumption.

3.2. Application of the LSTM Model

In contrast to the ARIMA model, the LSTM model can consider various explanatory variables to predict the target variable (water consumption). Water consumption data from the previous 1–7 days, weather conditions (air temperature, rainfall, and relative humidity), weekend information, and weekday information were used as explanatory variables by considering Refs. [27,28,29]. Table 4 shows the description of the target and explanatory variables used to train the LSTM model.
A sensitivity analysis was also performed on the LSTM model to derive the optimal parameters. The parameters of the LSTM model mainly deal with “units,” which refers to the number of chains, “batch size”, which refers to the number of data extracted for learning, and “epoch”, which refers to repetitive learning [12]. Here, the epoch and batch size are determined to repeat until they maximize learning performance according to the number of data, and units are determined to accommodate the information to the maximum according to the number of explanatory variables. In this study, the parameters were considered 6, 12, 24, and 36 for the units; 12, 36, 72, and 144 for the batch size; and 20, 30, 50, and 100 for the epoch; and grid search was performed for this list. In addition, activation function was considered as “Tanh”, and “dropout layer” was considered as 45% to minimize overfitting problem. On the other hand, the other parameters such as learning rate, momentum were set to their default values. The LSTM models were developed using 64 parameter combinations for each type, and the LSTM model with the best performance was selected. Table 5 shows the parameter combinations for the top four models. The batch size and epoch in the top four models are 12 and 100, respectively.
Figure 8 shows the loss graph for each type using the top four models. Here, the red line and points represent model 1, the blue line and points represent model 2, the yellow line and points represent model 3, and the green line and points represent model 4. The x-axis represents the epoch, and the y-axis represents the loss per epoch. When the LSTM models were trained, the RMSE was used as the loss metric, and the target variable was normalized. Thus, the loss unit in Figure 8 differs from the original consumption data unit. In addition, we used 20% of the batch size as a validation to prevent overfitting, and the loss presented in Figure 8 is the validation loss.
Figure 8 shows that as the epoch increased, the loss graph for all types decreased and converged, and the loss trend did not increase again, indicating that the overfitting problem did not occur. Thus, the loss was the smallest when Type A was model 3, Type B was model 3, Type C was model 2, and Type D was model 4. The optimal LSTM model for each type was determined through this result. Table 6 shows the performance of the optimal LSTM model in the training dataset, and Figure 9 shows the time series of the LSTM model’s prediction results. The average correlation for the four types was 89%, and the average RMSE was calculated to be 5.6 m3. It can also be seen that Type D has the highest correlation and Type B has the lowest correlation. All the LSTM models had a correlation of 80% or higher in the training dataset. Thus, the LSTM models were well-trained well for observing water consumption data.
When the performance of the ARIMA model (see Table 3) was compared to that of the LSTM model, it was discovered that the performance of the LSTM model was slightly lower. Therefore, the two models had to be evaluated in a test dataset that was not used for model learning.

3.3. Performance Evaluation of Each Model

The two models were evaluated in the test dataset (1 January 2019 to 31 December 2019). Figure 10 shows the time series of the predicted result by each model. The solid blue line represents the observed water consumption time series, the red dashed line represents the predicted time series of the LSTM model, and the solid green line represents the predicted time series of the ARIMA model. The red dashed line tends to be similar to the solid blue line, but the solid green line tends to be more underestimated than the solid blue line. In addition, the red dashed line appears to be more similar to the solid blue line than the green line. Table 7 summarizes the performance evaluation of each model in the test dataset. The ARIMA model had an average correlation of 62% and an average RMSE of 8.91 m3. The correlation decreased by about 31%, and the RMSE increased by 4.48 m3 in comparison to the results in the training dataset. Compared to that in the training dataset, the performance of the ARIMA model in the test dataset decreased due to overfitting. However, the LSTM model had an average correlation of 89% and an average RMSE of 5.60 m3. These results were similar to the performance in the training dataset. The LSTM model had a better correlation than the ARIMA model by an average of 27%.
Taylor diagrams are mathematical diagrams designed to graphically indicate the RMSE, CC and Standard deviation (SD) [53]. Figure 11 shows a Taylor diagram for each region. Green dotted line indicates RMSE, blue dotted line indicates SD, black dotted line indicates CC, and the green square point is SD of observation. In general, the smaller the RMSE and SD, and the closer CC is to one, the better the model performance. Here, the points that are closer to the green square point in this diagram mean better model performance, and the red and blue points represent the performance of ARIMA and LSTM in the diagram. As a result, blue points are closer to the green square point than red points. Therefore, the LSTM model outperforms the ARIMA model in predicting water consumption at the household level as it can be trained with various patterns.

4. Conclusions and Discussion

This study developed a model to predict water consumption for four different water-use types (A: detached house, B: apartment, C: restaurant, and D: elementary school) using smart water meter data. The ARIMA model, which is a traditional time series prediction model, and the deep learning-based LSTM model were used as the prediction models. The LSTM model considered both previous water consumption data and external factors such as weather and information on weekends and weekdays as explanatory variables. Types A, B, and C demonstrated a pattern of using much water on weekends, whereas Type D demonstrated a pattern of using much water on weekdays.
The analysis revealed that the ARIMA model outperformed the LSTM model by a slight difference in the training dataset, but both models demonstrated excellent performance. However, in the test dataset, the ARIMA model’s correlation decreased by about 31% on average, while the LSTM model demonstrated excellent performance (CC: 89% and RMSE: 5.60 m3), similar to the results in the training dataset. These results indicate that the ARIMA model has an overfitting problem and does not accurately learn the nonlinear characteristics of each water-use type. However, the proposed model was trained very well for each water-use type by employing a deep learning model to learn nonlinear characteristics and consider external factors. In addition, the proposed model can maintain performance even when new data is added. Therefore, this data can inform customers about the predicted water consumption fee or manage water efficiently.
Since the proposed model was designed to predict water consumption one day later, it cannot predict water consumption after one week or one month. This model also considers external factors such as weather and weekend information. Still, it has limitations in that it does not consider national holidays in Korea, such as Chuseok, and human activities. Therefore, the model will be improved in future research by designing it to consider various human activities and national holidays and predict water consumption over long periods, such as a week or a month. The target area will then be expanded using this model for all consumers at the household level in a single city. Therefore, it is believed that future studies will further improve the usability of the model.

Author Contributions

Conceptualization, J.K. and H.L.; Data curation, H.L. and D.K.; Formal analysis, J.K.; Methodology, J.K., M.L. and D.K.; Supervision, M.L., H.H. and H.S.K.; Writing—original draft, J.K. and H.L.; Writing—review and editing, H.H. and H.S.K. All authors have read and agreed to the published version of the manuscript.

Funding

INHA UNIVERSITY Research Grant.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This work was supported by INHA UNIVERSITY Research Grant.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Korea Environmental Industry & Technology Institute (KEITI). Water and Sewerage R&D Technology Trend Report; KEITI: Seoul, Korea, 2020. [Google Scholar]
  2. Ministry of Environmental (MOE). Water Supply Statistics; Ministry of Environmental: Sejong, Korea, 2019.
  3. Adamowski, J.; Chan, H.F.; Prasher, S.O.; Ozga-Zielinski, B.; Sliusarieva, A. Comparison of multiple linear and nonlinear regression, autoregressive integrated moving average, artificial neural network, and wavelet artificial neural network methods for urban water demand forecasting in Montreal, Canada. Water Resour. Res. 2012, 48. [Google Scholar] [CrossRef]
  4. Tripathi, A.; Kaur, S.; Sankaranarayanan, S.; Narayanan, L.K.; Tom, R.J. Water demand prediction for housing apartments using time series analysis. Int. J. Intell. Inf. Technol. 2019, 15, 57–75. [Google Scholar] [CrossRef]
  5. Razali, S.N.A.M.; Rusiman, M.S.; Zawawi, N.I.; Arbin, N. Forecasting of Water Consumptions Expenditure Using Holt-Winter’s and ARIMA. J. Phys. Conf. Ser. 2018, 995, 012041. [Google Scholar] [CrossRef] [Green Version]
  6. Du, H.; Zhao, Z.; Xue, H. ARIMA-M: A new model for daily water consumption prediction based on the autoregressive inte-grated moving average model and the markov chain error correction. Water 2020, 12, 760. [Google Scholar] [CrossRef] [Green Version]
  7. Alvisi, S.; Franchini, M.; Marinelli, A. A short-term, pattern-based model for water-demand forecasting. J. Hydroinform. 2007, 9, 39–50. [Google Scholar] [CrossRef] [Green Version]
  8. Atsalakis, G.; Minoudaki, C.; Markatos, N.; Stamou, A.; Beltrao, J.; Panagopoulos, T. Daily irrigation water demand prediction using adaptive neuro-fuzzy inferences systems (anfis). In Proceedings of the 3rd IASME/WSEAS International Conference on Energy, Environment, Ecosystems and Sustainable Development, Agios Nikolaos, Greece, 24–26 July 2007; pp. 369–374. [Google Scholar]
  9. Oliveira, P.J.; Steffen, J.L.; Cheung, P. Parameter Estimation of Seasonal Arima Models for Water Demand Forecasting Using the Harmony Search Algorithm. Procedia Eng. 2017, 186, 177–185. [Google Scholar] [CrossRef]
  10. Zubaidi, S.L.; Al-Bugharbee, H.; Muhsen, Y.R.; Hashim, K.; Alkhaddar, R.M.; Hmeesh, W.H. The Prediction of Municipal Water Demand in Iraq: A Case Study of Baghdad Governorate. In Proceedings of the 12th International Conference on Developments in eSystems Engineering, Kazan, Russia, 7–10 October 2019; pp. 274–277. [Google Scholar] [CrossRef]
  11. Li, H.; Wang, X.; Guo, H. Uncertain time series forecasting method for the water demand prediction in Beijing. Water Supply 2021, 22, 3254. [Google Scholar] [CrossRef]
  12. Xiang, Z.; Yan, J.; Demir, I. A rainfall-runoff model with LSTM-based sequence-to-sequence learning. Water Resour. Res. 2020, 56, e2019WR025326. [Google Scholar] [CrossRef]
  13. Kratzert, F.; Klotz, D.; Brenner, C.; Schulz, K.; Herrnegger, M. Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks. Hydrol. Earth Syst. Sci. 2018, 22, 6005–6022. [Google Scholar] [CrossRef] [Green Version]
  14. Kim, J.; Lee, M.; Han, H.; Kim, D.; Bae, Y.; Kim, H.S. Case Study: Development of the CNN Model Considering Teleconnection for Spatial Downscaling of Precipitation in a Climate Change Scenario. Sustainability 2022, 14, 4719. [Google Scholar] [CrossRef]
  15. Velasco, L.C.P.; Granados, A.R.B.; Ortega, J.M.A.; Pagtalunan, K.V.D. Performance analysis of artificial neural networks training algorithms and transfer functions for medium-term water consumption forecasting. Int. J. Adv. Sci. Appl. 2018, 9, 109–116. [Google Scholar] [CrossRef] [Green Version]
  16. Gagliardi, F.; Alvisi, S.; Franchini, M.; Guidorzi, M. A comparison between pattern-based and neural network short-term water demand forecasting models. Water Sci. Technol. Water Supply 2017, 17, 1426–1435. [Google Scholar] [CrossRef]
  17. Boudhaouia, A.; Wira, P. A Real-Time Data Analysis Platform for Short-Term Water Consumption Forecasting with Machine Learning. Forecasting 2021, 3, 682–694. [Google Scholar] [CrossRef]
  18. Salloom, T.; Kaynak, O.; He, W. A novel deep neural network architecture for real-time water demand forecasting. J. Hydrol. 2021, 599, 126353. [Google Scholar] [CrossRef]
  19. Bougadis, J.; Adamowski, K.; Diduch, R. Short-term municipal water demand forecasting. Hydrol. Processes Inter-Natl. J. 2005, 19, 137–148. [Google Scholar] [CrossRef]
  20. Herrera, M.; Torgo, L.; Izquierdo, J.; Pérez-García, R. Predictive models for forecasting hourly urban water demand. J. Hydrol. 2010, 387, 141–150. [Google Scholar] [CrossRef]
  21. Awad, M.; Zaid-Alkelani, M. Prediction of Water Demand Using Artificial Neural Networks Models and Statistical Model. Int. J. Intell. Syst. Appl. 2019, 11, 40–55. [Google Scholar] [CrossRef]
  22. Mu, L.; Zheng, F.; Tao, R.; Zhang, Q.; Kapelan, Z. Hourly and Daily Urban Water Demand Predictions Using a Long Short-Term Memory Based Model. J. Water Resour. Plan. Manag. 2020, 146, 05020017. [Google Scholar] [CrossRef]
  23. Firat, M.; Yurdusev, M.A.; Turan, M.E. Evaluation of Artificial Neural Network Techniques for Municipal Water Consumption Modeling. Water Resour. Manag. 2009, 23, 617–632. [Google Scholar] [CrossRef]
  24. Adamowski, J.; Karapataki, C. Comparison of multivariate regression and artificial neural networks for peak urban wa-ter-demand forecasting: Evaluation of different ANN learning algorithms. J. Hydrol. Eng. 2010, 15, 729–743. [Google Scholar] [CrossRef] [Green Version]
  25. Al-Zahrani, M.A.; Abo-Monasar, A. Urban Residential Water Demand Prediction Based on Artificial Neural Networks and Time Series Models. Water Resour. Manag. 2015, 29, 3651–3662. [Google Scholar] [CrossRef]
  26. Zubaidi, S.L.; Ortega-Martorell, S.; Kot, P.; Alkhaddar, R.M.; Abdellatif, M.; Gharghan, S.K.; Hashim, K. A method for pre-dicting long-term municipal water demands under climate change. Water Resour. Manag. 2020, 34, 1265–1279. [Google Scholar] [CrossRef]
  27. Bakker, M.; van Duist, H.; van Schagen, K.; Vreeburg, J.; Rietveld, L. Improving the Performance of Water Demand Forecasting Models by Using Weather Input. Procedia Eng. 2014, 70, 93–102. [Google Scholar] [CrossRef] [Green Version]
  28. Polebitski, A.S.; Palmer, R.N. Seasonal Residential Water Demand Forecasting for Census Tracts. J. Water Resour. Plan. Manag. 2010, 136, 27–36. [Google Scholar] [CrossRef]
  29. Piasecki, A.; Jurasz, J.; Kaźmierczak, B. Forecasting Daily Water Consumption: A Case Study in Torun, Poland. Period. Polytech. Civ. Eng. 2018, 62, 8241–8318. [Google Scholar] [CrossRef] [Green Version]
  30. Bennett, C.; Stewart, R.; Beal, C. ANN-based residential water end-use demand forecasting model. Expert Syst. Appl. 2013, 40, 1014–1023. [Google Scholar] [CrossRef] [Green Version]
  31. Candelieri, A.; Soldi, D.; Archetti, F. Short-term forecasting of hourly water consumption by using automatic metering readers data. Procedia Eng. 2015, 119, 844–853. [Google Scholar] [CrossRef]
  32. Vijai, P.; Sivakumar, P.B. Performance comparison of techniques for water demand forecasting. Procedia Comput. Sci. 2018, 143, 258–266. [Google Scholar] [CrossRef]
  33. Faiz, M.; Daniel, A.K. Wireless Sensor Network Based Distribution and Prediction of Water Consumption in Residential Houses Using ANN. In Proceedings of the International Conference on Internet of Things and Connected Technologies, Wuhan, China, 22–25 April 2022; pp. 107–116. [Google Scholar] [CrossRef]
  34. Water Services Regulation Authority. Business Retail Price Review 2016: Final Determinations; Water Services Regulation Authority: Birmingham, UK, 2016.
  35. Xenochristou, M.; Kapelan, Z.; Hutton, C. Using Smart Demand-Metering Data and Customer Characteristics to Investigate Influence of Weather on Water Consumption in the UK. J. Water Resour. Plan. Manag. 2020, 146, 04019073. [Google Scholar] [CrossRef]
  36. Xenochristou, M.; Hutton, C.; Hofman, J.; Kapelan, Z. Water Demand Forecasting Accuracy and Influencing Factors at Different Spatial Scales Using a Gradient Boosting Machine. Water Resour. Res. 2020, 56, e2019WR026304. [Google Scholar] [CrossRef]
  37. Korea Agency for Infrastructure Technology Advancement (KAIA). Water Grid Intelligence Research; KAIA: Anyang, Korea, 2017. [Google Scholar]
  38. Choi, J.; Kim, J. Analysis of water consumption dart from smart water meter using machine learning and deep learning algorithms. J. Inst. Electron. Inf. Eng. 2018, 55, 31–39. [Google Scholar]
  39. Bhansali, R.J. Linear Prediction by Autoregressive Model Fitting in the Time Domain. Ann. Stat. 1978, 6, 224–231. [Google Scholar] [CrossRef]
  40. Broersen, P.M. Autoregressive model orders for Durbin’s MA and ARMA estimators. IEEE Trans. Signal Process. 2000, 48, 2454–2457. [Google Scholar] [CrossRef]
  41. Cai, Z.; Tiwari, R.C. Application of a local linear autoregressive model to BOD time series. Env. Off. J. Int. Env. Soc. 2000, 11, 341–350. [Google Scholar] [CrossRef]
  42. Durbin, J. Efficient estimation of parameters in moving-average models. Biometrika 1959, 46, 306–316. [Google Scholar] [CrossRef]
  43. Galbraith, J.W.; Ullah, A.; Zinde-Walsh, V. Estimation of the Vector Moving Average Model by Vector Autoregression. Econ. Rev. 2002, 21, 205–219. [Google Scholar] [CrossRef]
  44. Akrami, S.A.; El-Shafie, A.; Naseri, M.; Santos, C.A.G. Rainfall data analyzing using moving average (MA) model and wavelet multi-resolution intelligent model for noise evaluation to improve the forecasting accuracy. Neural Comput. Appl. 2014, 25, 1853–1861. [Google Scholar] [CrossRef]
  45. Chen, J.-F.; Wang, W.-M.; Huang, C.-M. Analysis of an adaptive time-series autoregressive moving-average (ARMA) model for short-term load forecasting. Electr. Power Syst. Res. 1995, 34, 187–196. [Google Scholar] [CrossRef]
  46. Benjamin, M.A.; Rigby, R.A.; Stasinopoulos, D.M. Generalized autoregressive moving average models. J. Am. Stat. Assoc. 2003, 98, 214–223. [Google Scholar] [CrossRef]
  47. Pappas, S.S.; Ekonomou, L.; Karamousantas, D.C.; Chatzarakis, G.E.; Katsikas, S.K.; Liatsis, P. Electricity demand loads modeling using AutoRegressive Moving Average (ARMA) models. Energy 2008, 33, 1353–1360. [Google Scholar] [CrossRef]
  48. Box, G.E.P.; Jenkins, G.M.; Reinsel, G.C.; Ljung, G.M. Time Series Analysis: Forecasting and Control, 5th ed.; John Wiley & Sons: Hoboken, NJ, USA, 2015; pp. 23–88. ISBN 9781118674925. [Google Scholar]
  49. Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef] [PubMed]
  50. Sagheer, A.; Kotb, M. Time series forecasting of petroleum production using deep LSTM recurrent networks. Neurocomputing 2018, 323, 203–213. [Google Scholar] [CrossRef]
  51. Liu, P.; Wang, J.; Sangaiah, A.K.; Xie, Y.; Yin, X. Analysis and Prediction of Water Quality Using LSTM Deep Neural Networks in IoT Environment. Sustainability 2019, 11, 2058. [Google Scholar] [CrossRef] [Green Version]
  52. Anagnostis, A.; Papageorgiou, E.; Bochtis, D. Application of Artificial Neural Networks for Natural Gas Consumption Forecasting. Sustainability 2020, 12, 6409. [Google Scholar] [CrossRef]
  53. Taylor, K.E. Summarizing multiple aspects of model performance in a single diagram. J. Geophys. Res. Atmos. 2001, 106, 7183–7192. [Google Scholar] [CrossRef]
Figure 1. The location of the study area and smart water meter.
Figure 1. The location of the study area and smart water meter.
Water 14 01512 g001
Figure 2. Water consumption pattern according to the days of the week.
Figure 2. Water consumption pattern according to the days of the week.
Water 14 01512 g002
Figure 3. Monthly patterns of three meteorological data (rainfall, relative humidity, and temperature).
Figure 3. Monthly patterns of three meteorological data (rainfall, relative humidity, and temperature).
Water 14 01512 g003
Figure 4. Flow chart for this study.
Figure 4. Flow chart for this study.
Water 14 01512 g004
Figure 5. Conceptual diagram of the LSTM.
Figure 5. Conceptual diagram of the LSTM.
Water 14 01512 g005
Figure 6. ACF results for each type.
Figure 6. ACF results for each type.
Water 14 01512 g006
Figure 7. Time series of the predicted and observed values by the ARIMA model (training dataset).
Figure 7. Time series of the predicted and observed values by the ARIMA model (training dataset).
Water 14 01512 g007
Figure 8. Loss graph for each type using the top four models.
Figure 8. Loss graph for each type using the top four models.
Water 14 01512 g008
Figure 9. Time series of the predicted and observed values of the LSTM model (training dataset).
Figure 9. Time series of the predicted and observed values of the LSTM model (training dataset).
Water 14 01512 g009
Figure 10. Time series of the predicted and observed values in the test dataset for each model.
Figure 10. Time series of the predicted and observed values in the test dataset for each model.
Water 14 01512 g010
Figure 11. Taylor diagram for each type.
Figure 11. Taylor diagram for each type.
Water 14 01512 g011
Table 1. Water consumption data for each water-use type.
Table 1. Water consumption data for each water-use type.
DescriptionType AType BType CType D
Use typeResidential Residential CommercialPublic
Detail informationDetached house
(1 household)
Apartment
(366 households)
RestaurantElementary school
water consumption range (m3)0.5–2.823.8–214.80.78–23.70–55.9
Mean (m3)1.38153.910.9624.79
Standard deviation (m3)0.4230.132.489.95
Table 2. Parameters of the optimal ARIMA model for each type.
Table 2. Parameters of the optimal ARIMA model for each type.
TypeParameter pParameter dParameter q
A707
B808
C808
D707
Table 3. Performance of the optimal ARIMA model (training dataset).
Table 3. Performance of the optimal ARIMA model (training dataset).
TypeCorrelationRMSE
A93.91%0.13
B87.31%14.02
C95.18%0.73
D96.02%2.87
Table 4. Description of the target and explanatory variables.
Table 4. Description of the target and explanatory variables.
VariableAbbreviationDescription
Target variable W t Water consumption corresponding to t day
Explanatory variable W t 1 Water consumption before t 1 day
W t 2 Water consumption before t 2 day
W t 3 Water consumption before t 3 day
W t 4 Water consumption before t 4 day
W t 5 Water consumption before t 5 day
W t 6 Water consumption before t 6 day
W t 7 Water consumption before t 7 day
TDaily air temperature
R Daily rainfall
Rh Daily relative humidity
W . d Weekday and weekend
Table 5. Parameter combinations for the top four models.
Table 5. Parameter combinations for the top four models.
ModelUnitsBatch SizeEpoch
Model 1612100
Model 21212100
Model 32412100
Model 43612100
Table 6. Performance of the optimal LSTM model (training dataset).
Table 6. Performance of the optimal LSTM model (training dataset).
TypeCorrelationRMSE
A90.29%0.17
B80.96%17.07
C92.00%0.93
D93.71%4.24
Table 7. Performance evaluation of each model (test dataset).
Table 7. Performance evaluation of each model (test dataset).
ARIMALSTM
TypeCorrelationRMSECorrelationRMSE
A65.81%0.3692.70%0.19
B55.42%26.3782.96%17.58
C56.42%2.2189.15%1.24
D69.79%6.7191.29%4.75
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kim, J.; Lee, H.; Lee, M.; Han, H.; Kim, D.; Kim, H.S. Development of a Deep Learning-Based Prediction Model for Water Consumption at the Household Level. Water 2022, 14, 1512. https://doi.org/10.3390/w14091512

AMA Style

Kim J, Lee H, Lee M, Han H, Kim D, Kim HS. Development of a Deep Learning-Based Prediction Model for Water Consumption at the Household Level. Water. 2022; 14(9):1512. https://doi.org/10.3390/w14091512

Chicago/Turabian Style

Kim, Jongsung, Haneul Lee, Myungjin Lee, Heechan Han, Donghyun Kim, and Hung Soo Kim. 2022. "Development of a Deep Learning-Based Prediction Model for Water Consumption at the Household Level" Water 14, no. 9: 1512. https://doi.org/10.3390/w14091512

APA Style

Kim, J., Lee, H., Lee, M., Han, H., Kim, D., & Kim, H. S. (2022). Development of a Deep Learning-Based Prediction Model for Water Consumption at the Household Level. Water, 14(9), 1512. https://doi.org/10.3390/w14091512

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop