Next Article in Journal
Farmers’ Perceptions and Willingness of Compost Production and Use to Contribute to Environmental Sustainability
Previous Article in Journal
Factors Related to Profitability of Agritourism in the United States: Results from a National Survey of Operators
Previous Article in Special Issue
A Review of Monitoring Technologies for Solar PV Systems Using Data Processing Modules and Transmission Protocols: Progress, Challenges and Prospects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Data-Driven Remaining Useful Life Prediction for Lithium-Ion Batteries Using Multi-Charging Profile Framework: A Recurrent Neural Network Approach

by
Shaheer Ansari
1,
Afida Ayob
1,2,*,
Molla Shahadat Hossain Lipu
1,2,*,
Aini Hussain
1 and
Mohamad Hanif Md Saad
3,4
1
Department of Electrical, Electronic and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
2
Centre for Automotive Research (CAR), Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
3
Department of Mechanical and Manufacturing Engineering, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
4
Institute of IR 4.0, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
*
Authors to whom correspondence should be addressed.
Sustainability 2021, 13(23), 13333; https://doi.org/10.3390/su132313333
Submission received: 27 October 2021 / Revised: 23 November 2021 / Accepted: 23 November 2021 / Published: 2 December 2021

Abstract

:
Remaining Useful Life (RUL) prediction for lithium-ion batteries has received increasing attention as it evaluates the reliability of batteries to determine the advent of failure and mitigate battery risks. The accurate prediction of RUL can ensure safe operation and prevent risk failure and unwanted catastrophic occurrence of the battery storage system. However, precise prediction for RUL is challenging due to the battery capacity degradation and performance variation under temperature and aging impacts. Therefore, this paper proposes the Multi-Channel Input (MCI) profile with the Recurrent Neural Network (RNN) algorithm to predict RUL for lithium-ion batteries under the various combinations of datasets. Two methodologies, namely the Single-Channel Input (SCI) profile and the MCI profile, are implemented, and their results are analyzed. The verification of the proposed model is carried out by combining various datasets provided by NASA. The experimental results suggest that the MCI profile-based method demonstrates better prediction results than the SCI profile-based method with a significant reduction in prediction error with regard to various evaluation metrics. Additionally, the comparative analysis has illustrated that the proposed RNN method significantly outperforms the Feed Forward Neural Network (FFNN), Back Propagation Neural Network (BPNN), Function Fitting Neural Network (FNN), and Cascade Forward Neural Network (CFNN) under different battery datasets.

1. Introduction

Globally, the battery storage system has received significant consideration in addressing carbon emissions and climate change problems [1,2]. Among various energy storage systems, lithium-ion batteries offer high energy density, low voltage drops, high lifespan, and wide operating temperatures. Hence, they have gained wide acceptance in numerous applications including electric vehicles, aerospace, energy management systems, and communication [3,4]. When a battery is utilized for a particular application over a duration of time, its capacity starts declining due to the aging of its chemical substances, which leads to issues relating to performance degradation, cell energy storage, and loss of money [5,6]. Moreover, the life of the lithium-ion battery is influenced by many factors such as temperature, humidity, and quality of usage. The performance of the lithium-ion battery can be measured by evaluating the health prognostics so that acceptable results can be delivered within the design limits and storage lifetime [7]. Hence, it is essential to predict the health and remaining lifetime of the battery to ensure safe and reliable usage.
The remaining useful life (RUL) is crucial for the assessment of battery accuracy and robustness by determining the occurrence of failure and eliminating battery issues [8]. The battery health is represented by RUL, which has attracted increasing attention in recent times. The RUL prediction assists in timely predictive maintenance by delivering crucial information regarding fault occurrence [9]. In connection with RUL, various analyses and predictive verification are implemented to forecast the failure threshold by extracting various information such as the current, voltage, temperature, impedance, etc., to optimize the operation of battery usage related to machinery, electric vehicles, and power systems. During the cyclic charging and discharging operation, the capacity of the battery degrades regularly [10]. For safe operation, it is recommended to replace the battery when 70% or 80% of the initial capacity remains so that unexpected losses can be averted [11]. The degradation of capacity is non-linear, but it is subjected to degradation with irregular regeneration. These various characteristics need to be taken into consideration to accurately predict the RUL of lithium-ion batteries [12].
Currently, various methods such as experience-based methods, model-based methods, and data-driven-based methods have been explored significantly by the research community to predict the RUL for lithium-ion batteries [13,14,15]. Experience-based methods need knowledge from experts and engineering experience along with associated observed situations to predict the RUL of the battery. However, experience-based models are incapable of real-time monitoring and rely heavily on assigned rules from domain experts [16]. Model-based approaches comprise mathematical models and related parameters that require detailed experiments and extensive empirical data. Nevertheless, the model-based algorithm requires a large amount of data for understanding the battery degradation curve [16]. Lyu et al. [17] proposed a Particle Filtering (PF) framework for RUL prediction of the lead acid battery while incorporating an electrochemical model. The battery degradation state variable was employed for the PF framework. An improved Particle Learning (PL) framework for RUL prediction was also presented by Liu et al. [18]. The PL framework prevented particle degeneracy by resampling state particles based on current measurement and then propagating them to generate state posterior particles at that particular time. Su et al. [19] predicted the RUL of lithium-ion batteries by developing the Interacting Multiple Model Particle Filter (IMMPF) mechanism. Even though model-based techniques for RUL prediction have made significant progress in recent times, drawbacks still exist; for example, there is no exact aging model that can serve as a base for predicting the RUL of the battery. The accuracy of the most commonly employed PF for RUL prediction is compromised by particle degeneracy problem [18].
Apart from the model-based techniques discussed above, Zhang and Huang [20] developed the Ensemble Empirical Mode Decomposition (EEMD) and Auto Regressive Integrated Moving Average (ARIMA) technique for RUL prediction. Data were decomposed into multiple segments by utilizing EEMD, and prediction of the RUL was conducted using the ARIMA model. Zhang et al. [21] proposed a Box–Cox Transformation (BCT) and Monte Carlo (MC) simulation-based method for RUL prediction. However, for a non-linear system, the aforementioned methods prove insufficient in enhancing the modeling capability due to their shallow architectures, which have inadequate prognostic capability and suffer from the curse of dimensionality.
Data-driven techniques focus on selecting key degradation information from the data points by a specific learning algorithm [22]. For improving the efficiency and accuracy of data-driven techniques, it is important to extract suitable input parameters from the operating profiles of the battery. The correlation between the selection of suitable input parameters and battery capacity would prove fruitful towards delivering better RUL prediction results [23]. Data-driven methods exhibit advantageous features including non-complex mechanisms, flexibility, high accuracy, adaptability, robustness, and better generalization performance. Therefore, extensive research has been conducted by researchers for RUL prediction [24]. Wu et al. [25] designed a Feedforward Neural Network (FFNN) by employing importance sampling to predict the RUL of the battery. Battery terminal voltage during the charging cycle was chosen as an input parameter, and importance sampling was performed. Even though a simple technique was employed for the RUL prediction, suitable hyper-parameter adjustment can be performed to achieve better prediction results. Nuhic et al. [26] proposed a Support Vector Machine (SVM) to predict the state of health (SOH) and RUL of the battery. Liu et al. [27] proposed a Relevance Vector Machine (RVM) algorithm with an online training method to enhance the accuracy of RUL prediction. Patil et al. [28] proposed an SVM algorithm-based RUL prediction by utilizing battery voltage and temperature as key parameters. However, these models rely on the historical data of the battery degradation curve. Additionally, the accuracy and robustness of the model are affected by the non-availability of a large amount of data and hence the forecasting accuracy of the battery capacity is compromised. Recently, the recurrent neural network (RNN) has received widespread attention due to its improved learning performance, high accuracy, and robustness [29,30]. Shaheer et al. [31] presented the cascaded forward neural network (CFNN) for RUL prediction by employing various battery datasets. Liu et al. [32] introduced a Recurrent Neural Network (RNN) for system dynamic forecasting to predict the RUL of batteries. The above-mentioned techniques work satisfactorily for RUL prediction but require suitable hyper-parameter adjustments and an adequate amount of critical data for training the algorithm efficiently. The applicability of various parameters from the operating profiles of lithium-ion batteries to design an efficient model for RUL prediction was not considered. Therefore, it is necessary to utilize key parameters of the operating profiles and identify the critical samples for training the network towards achieving better prediction results, which are accomplished in the presented work.
In this paper, an enhanced RUL prediction framework is developed for lithium-ion batteries. The contributions of this paper are highlighted below:
  • An improved data-driven method based on RNN with multi-channel input (MCI) profile is employed to predict the RUL of lithium-ion batteries under various training datasets.
  • A 31-dimensional input data format is generated using the multi parameters under the charging profile including battery discharge capacity, voltage, current, and temperature.
  • Systematic sampling is implemented to identify and extract critical samples from charging parameters such as voltage, current, and temperature, where 10 samples are collected from every charging cycle. The execution of systematic sampling assists in reconstructing the predicted curve while training the models.
  • The effectiveness of the proposed intelligent RNN algorithm is executed under various training datasets, and a comparative analysis is carried out with other notable data-driven methods by evaluating various performance metrics.
The rest of the paper is organized into six sections. Section 2 presents the degradation mechanism of the lithium-ion battery. Section 3 delivers the acquisition of lithium-ion battery data from NASA. Section 4 explains the proposed methodology for RUL prediction. Section 5 describes the proposed framework consisting of data pre-processing, model selection, and RUL prediction. The results and discussion are outlined in Section 6. The concluding comments are highlighted in Section 7.

2. Degradation Mechanism of the Lithium-Ion Battery

The lithium-ion battery comprises four main components, namely a cathode, an anode, a separator, and an electrolyte. During the charging process, the lithium ions transfer from the cathode and are deposited on the anode, resulting in energy storage of the lithium-ion battery. However, when the lithium-ion battery is fully charged, lithium ions start to move towards the cathode, resulting in the release of stored energy. During continuous charging and discharging, battery degradation takes place [33]. One of the limiting factors in battery lifetime is attributed to battery degradation, which needs to be addressed efficiently [34].
A lithium-ion battery is regarded as a dynamic and time-varying electrochemical system that consists of non-linear behaviour and a complex internal degradation mechanism [35]. The deterioration in performance and life of a lithium-ion battery takes place due to the increase in the number of charging and discharging cycles [36]. The degradation takes places due to various causes consisting of physical mechanisms such as mechanical and thermal stress and a chemical mechanism comprising cell reactions [37]. The illustration of a common degradation mechanism in a lithium-ion battery is shown in Figure 1. Battery degradation takes place due to several degradation mechanisms, which can be classified into two categories, i.e., loss of lithium inventory, which takes place due to the utilization of lithium ions during side reaction, and active material loss, which causes a decline in storage capacity [38]. The active material loss occurs specifically due to solvent co-intercalation, graphite exfoliation, as well as copper current collector corrosion resulting in loss of electrical contact and electrode cracking [39]. Lithium-ion inventory loss takes place due to the formation of solid electrolyte interphase (SEI) film, decomposition of electrolytic material, and the occurrence of lithium plating, respectively. It is considered that the occurrence of the degradation process relates to the material composition of the lithium-ion battery. For instance, the development of SEI film occurs due to the lower operating voltage of the graphite anode compared to the electrochemical window of the electrolyte. However, there is no occurrence of SEI film formation when the graphite anode is replaced with a lithium titanium oxide (LTO) anode [40]. Additionally, the structural disordering is highly significant in lithium magnesium oxide (LMO) in comparison with lithium iron phosphate (LIP) cathode. This is due to the small volume change in the LIP cathode. Apart from material composition, the degradation mechanism in the lithium ion battery is closely linked with the operating condition and battery design.
Therefore, the RUL prediction of a lithium-ion battery is challenging due to the complex battery degradation mechanism. Nonetheless, accurate prediction of the battery RUL is essential for the battery management system (BMS) in ensuring consistency and reliability of the BMS operation in terms of timely maintenance to avert any unwanted circumstances. The degradation of battery performance is associated with various mechanisms, and the obtained degradation profile is non-linear. Therefore, the RUL prediction of the lithium-ion battery can be accomplished by acquiring battery aging data. The battery aging data are achieved by employing an accelerated aging test under pre-defined conditions. Currently, the RUL prediction of the lithium-ion battery is carried out by utilizing public datasets due to the complex and time-consuming parameter extraction mechanism.

3. Acquisition of Lithium-Ion Battery Data for RUL Prediction

The acquisition of critical health indicators (HI) depicts the battery capability towards delivering effective performance as well as indicates the battery degradation state. The acquisition of critical HI is essential for accurate RUL prediction of the battery. In this work, the NASA battery dataset is analysed to acquire four HI for RUL prediction as discussed.

3.1. Battery Dataset

The NASA battery dataset is used to predict RUL for lithium-ion batteries. The effectiveness of the proposed model is evaluated using four battery datasets including B0005, B0006, B0007, and B0018. The battery datasets consist of three operating profiles, namely charging, discharging, and impedance at room temperature [41]. The batteries underwent a charging process through the constant current and constant voltage (CCCV) principle, where charging was performed with a constant current of 1.5 A until the voltage reaches 4.2 V. Subsequently, constant voltage was applied until the current drops at 20 mA. Similarly, the discharging profile takes place at a constant current of 2 A until the cell voltage falls to 2.7, 2.5, 2.2, and 2.5 V for each battery. The impedance profile and discharging profile are also studied in the dataset, but it is not employed in the current method. The degradation curve of capacity for various batteries under continuous charging and discharging is presented in Figure 2.

3.2. Data Sampling from the Charging Profile

During the charging and discharging process, lithium ions escape and enter the electrode particles continuously. The life of the battery is affected by the irregular scattering of lithium ions. The more the scattering and unevenness of the lithium ion, the more battery particles are affected and hence the life of the battery becomes small. Hence, it becomes important to understand the characteristics of the charging as well as discharging profile for various battery parameters. It is studied that current during the discharging process is highly irregular with time, and thus it is difficult to obtain internal parameters, whereas it is easier to obtain internal parameters in the charging profile as it is based on pre-set protocols. Thereby, the data are extracted from the charging profiles to capture the change of internal battery parameters. With regards to data sampling, 10 samples of voltage, current, and temperature from each charging cycle are extracted at equal intervals systematically to reconstitute charging profile parameters [42]. From Figure 3, it is realized that voltage, current, and temperature vary at different charging cycles. In terms of voltage, the aged battery reaches 4.2 V earlier as compared to the fresh battery. In addition, the value of the current drops early in the aged battery compared to the fresh ones. Similarly, the temperature in aged batteries reaches a higher temperature in comparison with fresh batteries. It is noticed that voltage, current, and temperature parameters depend on the cyclic charging and discharging as well as associated battery capacity. Hence, the charging profile parameters are extracted, sampled, and utilized to develop a 31-dimensional input dataset to execute the training operation of the proposed algorithm to determine the RUL of lithium-ion batteries.

3.3. Phenomena of Capacity Regeneration

One of the important HI for predicting RUL of battery is its capacity [43]. Capacity regeneration phenomena is detected in the batteries during the rest time between the charging and discharging process. This occurs due to the movement of the lithium ion from the negative electrode to the positive electrode and vice versa. A secondary reaction is observed on the electrode surface, which leads to degradation and hence poor performance of the battery. Meanwhile, a re-balancing phenomenon occurs during the rest time between active materials and relaxation of gradients produced due to current flow. The re-balancing phenomenon is known as the capacity regeneration phenomenon. The phenomena affect the degradation curve during rest time between charging and discharging process and performance of RUL of battery. Thus, the capacity regeneration phenomena are adopted as a critical input parameter in determining the RUL of the battery.

4. RUL Prediction Approach Using Data-Driven Recurrent Neural Network Algorithm

4.1. Recurrent Neural Network Approach

RNN is employed in addressing time series problems due to its powerful computational capabilities [44]. It is utilized in numerous applications such as image processing, feature extraction, prediction, and forecasting. RNN consists of a dynamic memory that can address complex problems by assigning appropriate values of weights. Although RNNs are identical to FFNN, each layer in RNN consists of a recurrent connection with a tap delay. In addition, there exist some differences in the training process between FFNN and RNN. In RNN, the output is calculated depending upon the feedback process consisting of the output of the hidden layer at the present instant and previous instant. The structure of RNN is shown in Figure 4.
The prediction of RUL is carried out based on the input time series (X1, X2, …, Xt), hidden series (ht−1, ht, ht+1), and output vector yk. The expression for the procedure is as [45]:
n e t h = a w x , y x i + w h h h i 1 + θ x , y
o h = f ( n e t h )
n e t o = b w y , z o h + θ y , z
o o = f ( n e t o )
where xi denotes the weight between the input layer and hidden layer, wℎℎ is the weight between a hidden layer and itself at adjacent time steps, and xj is the weight between the hidden layer and output layer. Oh and Oo represent the output of the hidden layer and output layer. Θx,y and θy,z denote the hidden layer bias and output layer bias, respectively. The sigmoid activation function of RNN is defined as f (), which is expressed as:
f ( ) = 1 1 + e ( 1 n e t )
The backpropagation through time (BPTT) was implemented to train the RNN algorithm, which consists of two stages, namely forward pass and backward pass. Input and other hyperparameters are utilized in obtaining the output from the forward pass, whereas the error from the output layer is calculated by the backward pass algorithm, which is expressed as:
eo = ToOo
where To is actual output while Oo is predicted output, respectively.
In the proposed framework based on the RNN algorithm, the network consists of an input layer, a single hidden layer, and an output layer. The input layer takes a 31-dimensional input vector from the battery dataset to train the network. In addition, the hidden layer consists of a single layer of 10 neurons with a sigmoid function as the activation function. The output layer consists of single output in terms of capacity. The weight and bias are optimized by utilizing the Levenberg–Marquardt (LM) algorithm. Hyper-parameters such as hidden neurons, learning rate, epochs, and number of iterations for training the RNN model are selected by the validation method.

4.2. Levenberg–Marquardt Algorithm

The LM algorithm is based on approximation of Newton method and is considered one of the fastest training algorithms [46]. The weight of the RNN-based algorithm is updated by the following mathematical expression.
w = [ μ I + ( P = 1 ) ^ P   J P   ( w W ) T J   p   ( w ) ] 1 E ( w )
where JP(W) defines the Jacobian matrix of the error vector e P(W) is calculated in w; and I denotes the identity matrix. The error of the network P is characterized by vector JP(w), which is expressed as:
e p ( w ) = t p c p ( w )
The LM algorithm is executed through the following steps, as shown in Figure 5. The network output, error vector, and Jacobian matrix are calculated. Moreover, ∆w is calculated to recalculate the error with w + ∆w as network weights. For any new process, the new weights are introduced when the error is reduced, and further μ is divided by a factor of β. However, the iteration continues if the error is not decreased.

4.3. Systematic Sampling Technique for Feature Extraction

Systematic sampling is also known as probability sampling and consists of selecting the number of samples from an ordered sampling frame with fixed and periodic intervals. The periodic interval is known as a sampling interval and is obtained by dividing population size with sampling size. The technique is utilized due to its prediction simplicity. The sampling method is easy to perform when the data are arranged in an ordered manner, ensuring the coverage of all the data presented. In the proposed method, 10 values from each cycle of the charging profile are extracted for voltage, current, and temperature by the utilization of systematic sampling to frame 31-dimensional input data format for training the model. The method of sampling consists of three steps such as computation of the sampling interval (p), which is equal to the population size divided by preferred sampling size, selection of the sample from the population size in a random manner, and, lastly, selecting all the desired samples. While observing the systematic sampling, the population of voltage, current, and temperature at each charge cycle varies. The sampling size is selected as 10, while the sampling interval varies according to the population size of each parameter in each cycle.
In the conventional method for training the algorithm to predict the RUL of the battery, training depends on a single time series data input such as capacity. However, the single input may not be sufficient and efficient enough in training the algorithm for prediction. In addition, the prediction accuracy is not much affected by the inclusion of various input parameters from the same battery dataset. Hence, a 31-dimensional input vector feature is developed for training RNN consisting of different battery datasets.
In this study, a 31-dimensional input profile consisting of voltage, current, temperature, and discharge capacity from a single battery is selected for the SCI profile to train the model, as shown in Figure 6. In addition, the proposed MCI profile consists of 31-dimensional input profile features comprising of 10 samples of voltage, current, and temperature from each charging cycle and discharge capacity from multi, i.e., four batteries where input parameters are combined to train the model. It is noted that 168 charging cycles from battery datasets B0005, B0006, and B0007 and 132 from B0018 have been utilized for training the proposed model, as shown in Figure 7.

5. Methodological Framework and Implementation for RUL Prediction Using Multi-Charging Profile

The overall framework for predicting the RUL of a battery by utilizing the MCI profile is presented in Figure 8. The proposed framework consists of three phases. The first phase of the framework consists of feature extraction and data pre-processing, where features of various parameters such as charging voltage, current, temperature, and discharge capacity are extracted with data cleansing and data normalization. In the second phase, the data are split for training and testing. The training of the model is executed with various combinations of 31-dimensional input from batteries. Lastly, the RUL for lithium-ion batteries is predicted, and accuracy is checked using key assessment indicators including MAE, RMSE, MAPE, MSE, and SD.
In the first phase, raw data are extracted from NASA prognostics to construct an input feature profile for training the data-driven models. Multiple inputs from the charging profiles are selected including battery discharge capacity, current, voltage, and temperature. In addition, systematic sampling is implemented to extract 10 samples of each input from every charging cycle. Moreover, the extracted samples are organized in a 31-dimensional format based on multi-charging input variables, which then proceed into different data preprocessing steps consisting of data cleansing and data normalization. The normalization of extracted data consists of a minimum and maximum value of data, which is expressed as [47]
Z k s = ( x k s min ( x ) ) max ( x ) min ( x )
where x denotes the summation of charging cycle xks. The number of charging cycles is represented by s. The maximum and minimum values of the sample data are characterized by max(x) and min(x), respectively.
In the second stage, the data are split into two parts, i.e., training data and test data. In the proposed methodology for analysis, the data are split into various combinations for training the model to comprehensively analyze the prediction outcome while testing the same battery dataset as shown in Figure 9. For instance, battery B0005 is trained with various combinations of datasets such as B0006 B0007 B00018, B0006 B0007, B0007 B0018, etc., to evaluate the performance of the model under various datasets. The hyper-parameters for training the RNN algorithm are selected by the validation method. A single hidden layer is developed consisting of 10 hidden neurons. The number of iterations is assigned as 20 while the number of epochs is selected as 1000 with a learning rate of 0.005. The proposed method is executed in a host computer configured with memory of 4 GB RAM and the processor of core i7 and 3.60 GHz. To validate the proposed method, a detailed comparison study was carried out with other data-driven techniques such as the Back Propagation Neural Network (BPNN), Function Fitting Neural Network (FNN), Feed Forward Neural Network (FFNN), and Cascaded Forward Neural Network (CFNN). The hyper-parameters for training RNN were utilized to train other NN models as well. Several performance metrics are evaluated based on the training of algorithm such as RMSE, MSE, MAE, MAPE, and SD, which can be expressed as:
M S E = ( 1 n n = 1 n | c k c k | 2 )
R M S E = ( 1 n n = 1 n | c k c k | 2 )
M A P E = 1 n n = 1 n | c k c k | c k
M A E = 1 n n = 1 n | c k c k |
S D = ( 1 1 n n = 1 n | c k c k | 2 )
where ck is actual capacity, whereas ĉk is the predicted capacity and n is the number of cycles.
In the third phase of the algorithm, the estimated capacity of the battery under each case is observed, which is further utilized in predicting battery RUL. The RUL prediction is carried out for both SCI and MCI profiles. The expression for the R U L e r r o r is expressed as:
R U L e r r o r = R U L p r e d i c t e d R U L a c t u a l
where R U L p r e d i c t e d and R U L a c t u a l are referred to as predicted RUL and actual RUL, respectively.
The negative R U L e r r o r suggests that predicted RUL is less than actual RUL and vice versa. The predicted RUL is obtained by calculating the number of cycles from the starting point until the threshold limit. The presented work considers Cycle 1 as the starting point in each case for RUL prediction. The accuracy of the trained model is calculated by assessing various performance metrics. In addition, the validation of the proposed model is executed with various data-driven methods such as BPNN, FNN, FFNN, and CFNN, respectively.

6. Results and Discussion

The dataset from NASA is utilized to evaluate the effectiveness and robustness of the proposed RNN model for RUL prediction of lithium-ion batteries under various training datasets. Four data-driven models are employed for the comparative analysis, which are BPNN, FNN, FFN, and CFNN, respectively. The proposed MCI-based RNN methodology is compared to the SCI methodology, and accordingly, the results are discussed. The accuracy of the RUL prediction under different training datasets is evaluated based on several performance matrices such as RMSE, MSE, MAE, MAPE, and SD. For the SCI profile-based model, the algorithm is tested with the 70:30 ratio of the dataset, where 70% is assigned for training while 30% is assigned for testing. In addition, the MCI-profile-based RNN model is trained by utilizing various combinations of training datasets, as discussed earlier. The threshold value for each battery has been marked individually during the development of the prediction curve, including 1.41 Ah for B0005, 1.39 Ah for B0006, 1.51 Ah for B0007, and 1.41 Ah for B0018, respectively. In terms of the number of cycles, the threshold cycle for B0005 is 126, 110 for B0006, 122 for B0007, and 92 for B0018. The capacity regeneration for B0006 and B0018 battery datasets is also analysed.

6.1. Analysis for SCI Profile

For predicting the RUL based on the SCI profile, a 31-dimensional input vector is taken as an input to the model consisting of a single battery dataset. It is validated that the RNN model worked better than other data-driven models for various batteries under test. The RUL prediction of RNN model is more accurate and precise in comparison to BPNN, FNN, FFNN, and CFNN methods, as presented in Table 1. For B0005, the estimated RMSE for BPNN, FNN, FFNN, and CFNN is 0.7823, 0.5154, 0.3674, and 0.3311, respectively, as compared to 0.1708 for the RNN model. Due to the significance of capacity regeneration phenomena in B0006 and B0018, the measured value of the performance metrics is higher in B0006 and B0018 than B0005 and B0007, respectively. The values of MSE, RMSE, MAPE, MAE, and SD for B0005 are 2.9164 × 10−4, 0.1708, 0.0960, 0.0684 and 0.1566, respectively, for RNN compared to 0.0016, 0.4017, 0.1883, 0.1332, and 0.4015 for B0006 under SCI methodology. Moreover, the same scenario is noted in the case of B0018, where the estimated values are less significant compared to B0006. The RMSE for B0006 is 0.4017 in the RNN model, while it is 0.2693 in B0018. The RUL error for each case of the battery dataset is very small due to the implementation of a systematic sampling approach, which leads to reconstitution of the predicted curve in an efficient manner. Although the training of each model is performed with 70:30 data, it is concluded that the capability of BPNN, FNN, FFNN, and CFNN is not comprehensive with regard to regeneration phenomena compared to RNN due to an insufficient feedback connection structure, resulting in its low ‘memory’ ability. The RNN model delivers better results compared to other data-driven techniques in terms of RUL prediction for various batteries. The capacity curve for RUL prediction of different batteries is presented in Figure 10.

6.2. Analysis for MCI Profile

In terms of prediction of the RUL of the battery under MCI profile, a 31-dimensional input vector is created with multiple battery datasets. The proposed model is trained with the combination of various datasets under individual battery cells. For each battery, the training of each model is performed with three datasets, combinations of two datasets and a single battery dataset. From the proposed algorithm, the RNN approach outperforms other data-driven methods such as BPNN, FNN, FFNN, and CFNN in terms of accuracy and error under each case of training datasets. The MCI profile results are divided into three categories, namely training with three datasets, training with two datasets, and training with single datasets, respectively. It is seen that the reduction in the training datasets affects the performance of the algorithm as well as the prediction accuracy.

6.2.1. Training with Three Datasets

The training of the MCI profile-based algorithm with three datasets is examined to calculate the prediction accuracy of the various models. The RNN model outperforms other data-driven methods for each case of RUL prediction. Due to the phenomena of capacity regeneration in B0006 and B0018, the performance metrics are notably higher in comparison to B0005 and B0007, as presented in Table 2. The RMSE values calculated for B0005, B0006, B0007, and B0018 are 0.0030, 0.0555, 0.0095, and 0.0392 for the RNN model. The high RMSE value is reported in B0006 and B0018 because of capacity regeneration phenomena. In addition, the values of RMSE, MSE, MAE, MAPE, and SD in each case are the lowest with the RNN model compared to BPNN, FNN, FFNN, and CFNN, respectively. In B0005, the predicted RMSE for RNN model is 0.0030 compared to 0.4382 for BPNN, 0.0948 for FNN, 0.0880 for FFNN, and 0.0290 for CFNN. The prediction curve for various battery datasets under several models of operation is displayed in Figure 11. RNN model achieves the highest accuracy among other data-driven methods. With regards to RUL error, each data-driven model performs satisfactorily and delivered accurate results, but the RNN techniques outperforms other models to achieve higher accuracy.

6.2.2. Training with Two Datasets

When the proposed RNN method is trained with two battery datasets, the RNN approach performs better than the SCI profile in terms of accuracy and convergence of predicted curve with the original capacity degradation curve. Each battery under test is trained with three dataset combinations and, accordingly, the RUL prediction curve is obtained and presented in Table 3. It is realized that the RNN approach is highly convergent compared to BPNN, FNN, FFNN, and CFNN methods, respectively. The RUL prediction of all batteries while training the model under several combinations is presented in Figure 12. A significant reduction in the performance error is noted with the RNN approach for all the trained battery datasets. When B0005 is selected as the test battery while the RNN model is trained with B0006 and B0007, RMSE is calculated to be 0.0132 compared to 0.3041 for BPNN, 0.1422 for FNN, 0.0656 for FFNN, and 0.0398 for CFNN respectively. Significant phenomena of capacity regeneration in B0006 and B0018 result in performance metrics that are higher than B0005 and B0007, respectively. For instance, the RMSE reported in B0005 is 0.0520 when the proposed RNN model is trained with B0006, B0018. When the RNN model is trained with other two combinations of dataset i.e., B0006, B0007 and B0007, B0018 under the same condition, the calculated RMSE values are 0.0132 and 0.0204, respectively, describing the impact of capacity regeneration phenomena in the above results. Simultaneously, the assessment for RUL error during each testing battery was carried out. The BPNN model performed the least among other data-driven models. Due to the phenomena of capacity regeneration, the RUL error was higher when the model was trained with B0006 and B0018, respectively. For instance, in B0007, the RUL error for BPNN is 8 when trained with B0006, B0018, while it is 2 when trained with B0005, B0007 and B0005, B0018, respectively.

6.2.3. Training with One Dataset

Lastly, each battery is tested under a single dataset, and the prediction results are obtained and presented in Table 4 and Figure 13. It is noticed that RNN performs better with other respective models such as BPNN, FNN, FFNN, and CFNN in terms of prediction accuracy, but the training efficiency of each model is lower due to the smaller quantity of training data, thus making it difficult in capturing the capacity degradation curve in an enhanced manner. Furthermore, due to the introduction of systematic sampling in the proposed methodology, it is predicted that a significant sample for reconstitution will concentrate around a certain value, and thus lower prediction accuracy is attained. The prediction error of the RNN model is the lowest compared to BPNN, FNN, FFNN, and CFNN, respectively. In the case of B0005, when the RNN is trained under various battery datasets such as B0006, B0007, and B0018, RMSE, MAE, MAPE, MSE, and SD are estimated to be the lowest among other trained data-driven models. Additionally, due to the significant occurrence of capacity regeneration phenomena in B0006 and B0018, the performance metrics are higher than B0005 and B0007, respectively. For instance, the RMSE observed for B0007 while training with B0006 and B0018 was 0.7132 and 1.7598, which is comparatively higher when trained with B0005, i.e., 0.3995. The RUL error for various batteries has been evaluated to demonstrate the effectiveness of the proposed RNN model. It is noticed that capacity regeneration phenomena demonstrate a substantial role in the RUL prediction. The training of each data-driven model delivers higher RUL error when trained with B0006, B0018 as seen in the cases of B0005 and B0007, respectively.

7. Conclusions

In this paper, a comprehensive analysis of the MCI-profile-based RNN approach for RUL prediction under various datasets is performed. To achieve the target, NASA prognostics battery datasets are utilized for acquiring input parameters consisting of discharge capacity, current, voltage. and temperature. The input dataset framework including a 31-dimensional vector is created by extracting 10 samples of each input parameter at equal intervals of every charging cycle. In addition, the MCI-profile-based method is compared to the SCI profile under various battery datasets. Several performance metrics are assessed under different training conditions. It is examined that the RNN-based MCI profile technique predicts more accurate results than the SCI profile under the application of diverse datasets to train the model. For datasets under B0005, the RMSE for RNN model under the SCI profile is 0.1708, whereas RMSE was 0.0030 under the MCI profile while training with three datasets (B0006, B0007, and B0018). Further, the RMSE was 0.0132 when trained with B0006, B0007 datasets, 0.0204 when trained with the B0007, B0018 dataset, and 0.0364 when trained with the B0006, B0018 datasets, respectively. This suggests the effectiveness of MCI over the SCI profile by utilizing different input parameters. In terms of RUL error, each data-driven model performs satisfactorily due to the application of systematic sampling, which assists in developing the predicted capacity curve in similar manner compared to the actual curve. The BPNN performs the least, while the performance of RNN model was the most accurate among other data-driven techniques. However, when the proposed RNN models are trained with a single battery dataset under the MCI profile, the performance metrics are comparatively higher. Overall, it is concluded that performance metrics dropped when the trained data are more diverse under the MCI profile.
For future work, other internal battery parameters such as impedance and aging can be taken into consideration. Additionally, the validation of the proposed algorithm could be extended by considering discharging profile parameters. In addition, some heuristic optimization techniques can be proposed to find the best hyperparameters for training the model with a smaller amount of data.

Author Contributions

Conceptualization, S.A. and A.A.; methodology, S.A.; formal analysis, S.A. and M.S.H.L.; investigation, S.A. and M.S.H.L.; resources, S.A., A.A., and A.H.; data curation, S.A.; writing—original draft preparation, S.A.; writing—review and editing, S.A., A.A., and M.S.H.L., M.H.M.S.; supervision, A.A. and A.H.; project administration, A.A. and A.H.; funding acquisition, A.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Ministry of Higher Education Malaysia (MOHE) through the Long Term Research Grant Scheme (LRGS) project Grant Number LRGS/1/2018/UNITEN/01/1/4 (previous LRGS/2018/UNITEN-UKM/EWS/04 old code).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found here: [https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/#battery (accessed on 11 May 2021)].

Acknowledgments

The support from the Ministry of Higher Education Malaysia and Universiti Kebangsaan Malaysia is highly acknowledged.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

ARIMAAuto Regressive Integrated Moving Average
BCTBox–Cox Transformation
BMSBattery Management System
BPTTBackpropagation Through Time
CCCVConstant Current and Constant Voltage
CFNNCascaded Forward Neural Network
EEMDEnsemble Empirical Mode Decomposition
FNNFitting Forward Neural Network
FFNNFeed-forward Neural Network
HIHealth Indicator
IMMPFInteracting Multiple Model Particle Filter
LIPLithium Iron Phosphate
LMLevenberg–Marquardt
LMOLithium Magnesium Oxide
LTOLithium Titanium Oxide
MAEMean Average Error
MAPEMean Absolute Percentage Error
MCMonte Carlo
MCIMulti-Channel Input
MSEMean Square error
PFParticle Filtering
PLParticle Learning
RMSERoot Mean Square Error
RULRemaining Useful Life
RNNRecurrent Neural Network
RVMRelevance Vector Machine
SCISingle-Channel Input
SDStandard Deviation
SEISolid Electrolyte Interphase
SOHState of Health
SVMSupport Vector Machine

References

  1. Hannan, M.A.; Lipu, M.S.H.; Ker, P.J.; Begum, R.A.; Agelidis, V.G.; Blaabjerg, F. Power electronics contribution to renewable energy conversion addressing emission reduction: Applications, issues, and recommendations. Appl. Energy 2019, 251, 113404. [Google Scholar] [CrossRef]
  2. Yang, Y.; Wang, Z.; Guo, P.; Chen, S.; Bian, H.; Tong, X.; Ni, L. Carbon oxides emissions from lithium-ion batteries under thermal runaway from measurements and predictive model. J. Energy Storage 2021, 33, 101863. [Google Scholar] [CrossRef]
  3. Qu, J.; Liu, F.; Ma, Y.; Fan, J. A Neural-Network-Based Method for RUL Prediction and SOH Monitoring of Lithium-Ion Battery. IEEE Access 2019, 7, 87178–87191. [Google Scholar] [CrossRef]
  4. Ren, L.; Zhao, L.; Hong, S.; Zhao, S.; Wang, H.; Zhang, L. Remaining Useful Life Prediction for Lithium-Ion Battery: A Deep Learning Approach. IEEE Access 2018, 6, 50587–50598. [Google Scholar] [CrossRef]
  5. Jiao, R.; Peng, K.; Dong, J. Remaining Useful Life Prediction of Lithium-Ion Batteries Based on Conditional Variational Autoencoders-Particle Filter. IEEE Trans. Instrum. Meas. 2020, 69, 8831–8843. [Google Scholar] [CrossRef]
  6. Ma, G.; Zhang, Y.; Cheng, C.; Zhou, B.; Hu, P.; Yuan, Y. Remaining useful life prediction of lithium-ion batteries based on false nearest neighbors and a hybrid neural network. Appl. Energy 2019, 253, 1–11. [Google Scholar] [CrossRef]
  7. Li, P.; Zhang, Z.; Xiong, Q.; Ding, B.; Hou, J.; Luo, D.; Rong, Y.; Li, S. State-of-health estimation and remaining useful life prediction for the lithium-ion battery based on a variant long short term memory neural network. J. Power Sources 2020, 459, 228069. [Google Scholar] [CrossRef]
  8. Lipu, M.S.H.; Hannan, M.A.; Hussain, A.; Hoque, M.M.; Ker, P.J.; Saad, M.H.M.; Ayob, A. A review of state of health and remaining useful life estimation methods for lithium-ion battery in electric vehicles: Challenges and recommendations. J. Clean. Prod. 2018, 205, 115–133. [Google Scholar] [CrossRef]
  9. Che, Y.; Deng, Z.; Lin, X.; Hu, L. Predictive Battery Health Management With Transfer Learning and Online Model Correction. IEEE Trans. Veh. Technol. 2021, 70, 1269–1277. [Google Scholar] [CrossRef]
  10. Shen, P.; Ouyang, M.; Lu, L.; Li, J.; Feng, X. The Co-estimation of State of Charge, State of Health, and State of Function for Lithium-Ion Batteries in Electric Vehicles. IEEE Trans. Veh. Technol. 2018, 67, 92–103. [Google Scholar] [CrossRef]
  11. Zhang, L.; Mu, Z.; Sun, C. Remaining Useful Life Prediction for Lithium-Ion Batteries Based on Exponential Model and Particle Filter. IEEE Access 2018, 6, 17729–17740. [Google Scholar] [CrossRef]
  12. Chinomona, B.; Chung, C.; Chang, L.-K.; Su, W.-C.; Tsai, M.-C. Long Short-Term Memory Approach to Estimate Battery Remaining Useful Life Using Partial Data. IEEE Access 2020, 8, 165419–165431. [Google Scholar] [CrossRef]
  13. Khelif, R.; Chebel-Morello, B.; Zerhouni, N. Experience based approach for Li-ion batteries RUL prediction. IFAC-Pap. 2015, 28, 761–766. [Google Scholar]
  14. Liu, Q.; Zhang, J.; Li, K.; Lv, C. The Remaining Useful Life Prediction by Using Electrochemical Model in the Particle Filter Framework for Lithium-Ion Batteries. IEEE Access 2020, 8, 126661–126670. [Google Scholar] [CrossRef]
  15. Sun, T.; Xia, B.; Liu, Y.; Lai, Y.; Zheng, W.; Wang, H.; Wang, W.; Wang, M. A novel hybrid prognostic approach for remaining useful life estimation of lithium-ion batteries. Energies 2019, 12, 3678. [Google Scholar] [CrossRef] [Green Version]
  16. Liao, L.; Köttig, F. Review of hybrid prognostics approaches for remaining useful life prediction of engineered systems, and an application to battery life prediction. IEEE Trans. Reliab. 2014, 63, 191–207. [Google Scholar] [CrossRef]
  17. Lyu, C.; Lai, Q.; Ge, T.; Yu, H.; Wang, L.; Ma, N. A lead-acid battery ’ s remaining useful life prediction by using electrochemical model in the Particle Filtering framework. Energy 2017, 120, 975–984. [Google Scholar] [CrossRef]
  18. Liu, Z.; Sun, G.; Bu, S.; Han, J.; Member, S.; Tang, X.; Pecht, M. Particle Learning Framework for Estimating the Remaining Useful Life of Lithium-Ion Batteries. IEEE Trans. Instrum. Meas. 2016, 66, 280–293. [Google Scholar] [CrossRef]
  19. Su, X.; Wang, S.; Pecht, M.; Zhao, L.; Ye, Z. Microelectronics Reliability Interacting multiple model particle fi lter for prognostics of lithium-ion batteries. Microelectron. Reliab. 2017, 70, 59–69. [Google Scholar] [CrossRef]
  20. Zhou, Y.; Huang, M. Lithium-ion batteries remaining useful life prediction based on a mixture of empirical mode decomposition and ARIMA model. Microelectron. Reliab. 2016, 65, 265–273. [Google Scholar] [CrossRef]
  21. Zhang, Y.; Xiong, R.; He, H.; Pecht, M.G. Lithium-Ion Battery Remaining Useful Life Prediction with Box-Cox Transformation and Monte Carlo Simulation. IEEE Trans. Ind. Electron. 2019, 66, 1585–1597. [Google Scholar] [CrossRef]
  22. Li, Y.; Liu, K.; Foley, A.M.; Zülke, A.; Berecibar, M.; Nanini-Maury, E.; Van Mierlo, J.; Hoster, H.E. Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review. Renew. Sustain. Energy Rev. 2019, 113, 109254. [Google Scholar] [CrossRef]
  23. Deng, Z.; Hu, X.; Lin, X.; Xu, L.; Che, Y.; Hu, L. General Discharge Voltage Information Enabled Health Evaluation for Lithium-Ion Batteries. IEEE/ASME Trans. Mechatron. 2021, 26, 1295–1306. [Google Scholar] [CrossRef]
  24. Hossain Lipu, M.S.; Hannan, M.A.; Hussain, A.; Ayob, A.; Saad, M.H.M.; Karim, T.F.; How, D.N.T. Data-driven state of charge estimation of lithium-ion batteries: Algorithms, implementation factors, limitations and future trends. J. Clean. Prod. 2020, 277, 124110. [Google Scholar] [CrossRef]
  25. Wu, J.; Zhang, C.; Chen, Z. An online method for lithium-ion battery remaining useful life estimation using importance sampling and neural networks. Appl. Energy 2016, 173, 134–140. [Google Scholar] [CrossRef]
  26. Nuhic, A.; Terzimehic, T.; Soczka-Guth, T.; Buchholz, M.; Dietmayer, K. Health diagnosis and remaining useful life prognostics of lithium-ion batteries using data-driven methods. J. Power Sources 2013, 239, 680–688. [Google Scholar] [CrossRef]
  27. Liu, D.; Zhou, J.; Liao, H.; Peng, Y.; Peng, X. A health indicator extraction and optimization framework for lithium-ion battery degradation modeling and prognostics. IEEE Trans. Syst. Man Cybern. Syst. 2015, 45, 915–928. [Google Scholar]
  28. Patil, M.A.; Tagade, P.; Hariharan, K.S.; Kolake, S.M.; Song, T.; Yeo, T.; Doo, S. A novel multistage Support Vector Machine based approach for Li ion battery remaining useful life estimation. Appl. Energy 2015, 159, 285–297. [Google Scholar] [CrossRef]
  29. Lipu, M.S.H.; Hannan, M.A.; Hussain, A.; Saad, M.H.M.; Ayob, A.; Blaabjerg, F. State of Charge Estimation for Lithium-ion Battery Using Recurrent NARX Neural Network Model Based Lighting Search Algorithm. IEEE Access 2018, 6, 28150–28161. [Google Scholar] [CrossRef]
  30. Hannan, M.A.; Lipu, M.S.H.; Hussain, A.; Ker, P.J.; Mahlia, T.M.I.; Mansor, M.; Ayob, A.; Saad, M.H.; Dong, Z.Y. Toward Enhanced State of Charge Estimation of Lithium-ion Batteries Using Optimized Machine Learning Techniques. Sci. Rep. 2020, 10, 1–15. [Google Scholar]
  31. Ansari, S.; Ayob, A.; Lipu, M.S.H.; Hussain, A.; Hanif, M.S. A Comparative Analysis of Lithium Ion Battery Input Profiles for Remaining Useful Life Prediction by Cascade Forward Neural Network. In Proceedings of the IEEE World AI IoT Congress 2021, Seattle, WA, USA, 10–13 May 2021; pp. 181–186. [Google Scholar]
  32. Liu, J.; Saxena, A.; Goebel, K.; Saha, B.; Wang, W. An adaptive recurrent neural network for remaining useful life prediction of lithium-ion batteries. In Proceedings of the Annual Conference of the Prognostics and Health Management Society 2010, Portland, OR, USA, 10–16 October 2010; pp. 1–9. [Google Scholar]
  33. Ansari, S.; Ayob, A.; Lipu, M.S.H.; Hussain, A.; Saad, M.H.M. Multi-Channel Profile Based Artificial Neural Network Approach for Remaining Useful Life Prediction of Electric Vehicle Lithium-Ion Batteries. Energies 2021, 14, 7521. [Google Scholar] [CrossRef]
  34. Zhu, J.; Dewi Darma, M.S.; Knapp, M.; Sørensen, D.R.; Heere, M.; Fang, Q.; Wang, X.; Dai, H.; Mereacre, L.; Senyshyn, A.; et al. Investigation of lithium-ion battery degradation mechanisms by combining differential voltage analysis and alternating current impedance. J. Power Sources 2020, 448, 28–30. [Google Scholar] [CrossRef]
  35. Han, X.; Lu, L.; Zheng, Y.; Feng, X.; Li, Z.; Li, J.; Ouyang, M. A review on the key issues of the lithium ion battery degradation among the whole life cycle. eTransportation 2019, 1, 100005. [Google Scholar] [CrossRef]
  36. Jia, J.; Liang, J.; Shi, Y.; Wen, J.; Pang, X.; Zeng, J. SOH and RUL Prediction of Lithium-Ion Batteries. Energies 2020, 13, 375. [Google Scholar] [CrossRef] [Green Version]
  37. Lewis, J.A.; Tippens, J.; Cortes, F.J.Q.; McDowell, M.T. Chemo-Mechanical Challenges in Solid-State Batteries. Trends Chem. 2019, 1, 845–857. [Google Scholar] [CrossRef]
  38. Manthiram, A. An Outlook on Lithium Ion Battery Technology. ACS Cent. Sci. 2017, 3, 1063–1069. [Google Scholar] [CrossRef] [Green Version]
  39. Hu, X.; Xu, L.; Lin, X.; Pecht, M. Battery Lifetime Prognostics. Joule 2020, 4, 310–346. [Google Scholar] [CrossRef]
  40. Birkl, C.R.; Roberts, M.R.; McTurk, E.; Bruce, P.G.; Howey, D.A. Degradation diagnostics for lithium ion cells. J. Power Sources 2017, 341, 373–386. [Google Scholar] [CrossRef]
  41. Prognostics Center of Excellence—Data Repository. Available online: https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/ (accessed on 11 May 2021).
  42. Park, K.; Choi, Y.; Choi, W.J.; Ryu, H.Y.; Kim, H. LSTM-Based Battery Remaining Useful Life Prediction with Multi-Channel Charging Profiles. IEEE Access 2020, 8, 20786–20798. [Google Scholar] [CrossRef]
  43. Pang, X.; Huang, R.; Wen, J.; Shi, Y.; Jia, J.; Zeng, J. A lithium-ion battery rul prediction method considering the capacity regeneration phenomenon. Energies 2019, 12, 2247. [Google Scholar] [CrossRef] [Green Version]
  44. Li, J.; Mei, X.; Prokhorov, D.; Tao, D. Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene. IEEE Trans. Neural Netw. Learn. Syst. 2017, 28, 690–703. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Chaoui, H.; Ibe-Ekeocha, C.C. State of Charge and State of Health Estimation for Lithium Batteries Using Recurrent Neural Networks. IEEE Trans. Veh. Technol. 2017, 66, 8773–8783. [Google Scholar] [CrossRef]
  46. Lv, C.; Xing, Y.; Zhang, J.; Na, X.; Li, Y.; Liu, T.; Cao, D.; Wang, F.Y. Levenberg-marquardt backpropagation training of multilayer neural networks for state estimation of a safety-critical cyber-physical system. IEEE Trans. Ind. Inform. 2018, 14, 3436–3446. [Google Scholar] [CrossRef] [Green Version]
  47. Hannan, M.A.; Lipu, M.S.H.; Hussain, A.; Saad, M.H.; Ayob, A. Neural network approach for estimating state of charge of lithium-ion battery using backtracking search algorithm. IEEE Access 2018, 6, 10069–10079. [Google Scholar] [CrossRef]
Figure 1. Common lithium-ion battery degradation mechanism [40].
Figure 1. Common lithium-ion battery degradation mechanism [40].
Sustainability 13 13333 g001
Figure 2. Representation of capacity degradation curve for NASA battery datasets including B0005, B0006, B0007, and B0018.
Figure 2. Representation of capacity degradation curve for NASA battery datasets including B0005, B0006, B0007, and B0018.
Sustainability 13 13333 g002
Figure 3. Battery parameters during charging process (a) voltage; (b) current; (c) temperature.
Figure 3. Battery parameters during charging process (a) voltage; (b) current; (c) temperature.
Sustainability 13 13333 g003
Figure 4. The basic structure of RNN (a) folded and (b) unfolded.
Figure 4. The basic structure of RNN (a) folded and (b) unfolded.
Sustainability 13 13333 g004
Figure 5. Levenberg–Marquardt algorithm for training RNN method.
Figure 5. Levenberg–Marquardt algorithm for training RNN method.
Sustainability 13 13333 g005
Figure 6. SCI profile for training RNN algorithm.
Figure 6. SCI profile for training RNN algorithm.
Sustainability 13 13333 g006
Figure 7. MCI profile for training RNN algorithm.
Figure 7. MCI profile for training RNN algorithm.
Sustainability 13 13333 g007
Figure 8. Methodological flow diagram for MCI profile to train the RNN-based algorithm.
Figure 8. Methodological flow diagram for MCI profile to train the RNN-based algorithm.
Sustainability 13 13333 g008
Figure 9. Proposed MCI profile with input data format configuration together with the training data format and testing dataset.
Figure 9. Proposed MCI profile with input data format configuration together with the training data format and testing dataset.
Sustainability 13 13333 g009
Figure 10. SCI profile-based RUL prediction curve for different batteries: (a) B0005, (b) B0006, (c) B0007, and (d) B0018.
Figure 10. SCI profile-based RUL prediction curve for different batteries: (a) B0005, (b) B0006, (c) B0007, and (d) B0018.
Sustainability 13 13333 g010
Figure 11. SCI profile-based RUL prediction curve for different batteries: (a) B0005, (b) B0006, (c) B0007, and (d) B0018.
Figure 11. SCI profile-based RUL prediction curve for different batteries: (a) B0005, (b) B0006, (c) B0007, and (d) B0018.
Sustainability 13 13333 g011aSustainability 13 13333 g011b
Figure 12. MCI profile for RUL prediction by employing two datasets for each battery under test. For B0005, (a) training with B0006 B0007, (b) training with B0007 B0018, and (c) training with B0006 B0018. For B0006, (d) training with B0005 B0007, (e) training with B0007 B0018, (f) and training with B0005 B0018. For B0007, (g) training with B0005 B0006, (h) training with B0006 B0018, (i) and training with B0005 B0018. For B0018, (j) training with B0005 B0006, (k) training with B0006 B0007, (l) and training with B0005 B0007.
Figure 12. MCI profile for RUL prediction by employing two datasets for each battery under test. For B0005, (a) training with B0006 B0007, (b) training with B0007 B0018, and (c) training with B0006 B0018. For B0006, (d) training with B0005 B0007, (e) training with B0007 B0018, (f) and training with B0005 B0018. For B0007, (g) training with B0005 B0006, (h) training with B0006 B0018, (i) and training with B0005 B0018. For B0018, (j) training with B0005 B0006, (k) training with B0006 B0007, (l) and training with B0005 B0007.
Sustainability 13 13333 g012aSustainability 13 13333 g012b
Figure 13. MCI profile for RUL prediction by employing one dataset for each battery under test. For B0005, (a) training with B0006, (b) training with B0007, (c) training with B0006. For B0006, (d) training with B0005, (e) training with B0007, (f) training with B0018. For B0007, (g) training with B0005, (h) training with B0006, (i) training with B0018. For B0018, (j) training with B0005, (k) training with B0006, (l) training with B0007.
Figure 13. MCI profile for RUL prediction by employing one dataset for each battery under test. For B0005, (a) training with B0006, (b) training with B0007, (c) training with B0006. For B0006, (d) training with B0005, (e) training with B0007, (f) training with B0018. For B0007, (g) training with B0005, (h) training with B0006, (i) training with B0018. For B0018, (j) training with B0005, (k) training with B0006, (l) training with B0007.
Sustainability 13 13333 g013aSustainability 13 13333 g013b
Table 1. RUL prediction for SCI profile.
Table 1. RUL prediction for SCI profile.
Battery DatasetMethodsPerformance MetricsActual RULPredicted RULRUL Error
MSERMSEMAPEMAESD
B0005BPNN0.00610.78230.39580.28830.7756126124−2
FNN0.00270.51540.28420.19480.4930126124−2
FFNN0.00130.36740.25050.17320.3501126125−1
CFNN0.00110.33110.23650.15440.3311126125−1
RNN2.9164 × 10−40.17080.09600.06840.1566126125−1
B0006BPNN0.02871.69490.82550.64191.5140110113+3
FNN0.01661.07490.34680.25801.0446110112+2
FFNN0.00860.92590.39590.29750.8887110112+1
CFNN0.00280.53230.26490.17090.5178110111+1
RNN0.00160.40170.18830.13320.4015110111+1
B0007BPNN0.01521.23460.62780.42111.1073122124+2
FNN0.00230.48060.24600.16010.4703122123+1
FFNN0.00130.35520.23570.15120.3426122120−2
CFNN9.1250 × 10−40.30210.19730.12680.3029122121−1
RNN7.3445 × 10−40.27100.13760.09250.2596122121−1
B0018BPNN0.00300.54360.27360.19200.53829293+1
FNN0.00200.44580.24180.16500.44759293+1
FFNN0.00150.38680.20660.14380.36949293+1
CFNN0.00120.34730.16900.11400.34679291−1
RNN7.2506 × 10−40.26930.11730.08080.26859291−1
Table 2. RUL prediction accuracy when trained with three datasets.
Table 2. RUL prediction accuracy when trained with three datasets.
Testing DatasetTraining DatasetMethodsPerformance MetricsActual RULPredicted RULRUL Error
MSERMSEMAPEMAESD
B0005 BPNN0.00610.78230.39580.28830.7756126124−2
B0006FNN0.00270.51540.28420.19480.4930126124−2
B0007FFNN0.00130.36740.25050.17320.3501126125−1
B0018CFNN0.00110.33110.23650.15440.3311126125−1
RNN2.9164 × 10−40.17080.09600.06840.1566126125−1
B0006 BPNN0.02871.69490.82550.64191.5140110113+3
B0005FNN0.01661.07490.34680.25801.0446110112+2
B0007FFNN0.00860.92590.39590.29750.8887110112+1
B0018CFNN0.00280.53230.26490.17090.5178110111+1
RNN0.00160.40170.18830.13320.4015110111+1
B0007 BPNN0.01521.23460.62780.42111.1073122124+2
B0005FNN0.00230.48060.24600.16010.4703122123+1
B0006FFNN0.00130.35520.23570.15120.3426122120−2
B0018CFNN9.1250 × 10−40.30210.19730.12680.3029122121−1
RNN7.3445 × 10−40.27100.13760.09250.2596122121−1
B0018 BPNN0.00300.54360.27360.19200.53829293+1
B0005FNN0.00200.44580.24180.16500.44759293+1
B0006FFNN0.00150.38680.20660.14380.36949293+1
B0007CFNN0.00120.34730.16900.11400.34679291−1
RNN7.2506 × 10−40.26930.11730.08080.26859291−1
Table 3. RUL prediction accuracy when trained with two datasets.
Table 3. RUL prediction accuracy when trained with two datasets.
Testing DatasetTraining DatasetMethodsPerformance MetricsActual RULPredicted RULRUL Error
MSERMSEMAPEMAESD
B0005 BPNN9.2505 × 10−40.30410.23640.15060.3008126123−3
B0006FNN2.0229 × 10−40.14220.10580.06630.1363126124−2
B0007FFNN4.3063 × 10−50.06560.05080.03150.0651126124−2
CFNN1.5813 × 10−50.03980.03940.02540.0054126125−1
RNN1.7412 × 10−60.01320.00880.00560.0131126125−1
BPNN0.00280.52760.39480.25180.5168126124−2
B0007FNN7.5118 × 10−50.08670.07430.04910.0811126124−2
B0018FFNN2.5709 × 10−40.16030.11690.07610.1608126124−2
CFNN1.7999 × 10−50.04240.03470.02410.0319126125−1
RNN4.1439 × 10−60.02040.01440.00890.0197126125−1
BPNN0.03821.95471.63061.02151.8250126116−10
B0006FNN7.0358 × 10−40.26530.19220.12320.2173126120−6
B0018FFNN9.6784 × 10−40.31110.13530.08540.3116126128+2
CFNN3.1315 × 10−50.05600.03050.01780.0526126124−2
RNN2.7048 × 10−50.05200.03360.02080.0521126125−1
B0006 BPNN0.06822.61132.04691.39502.6118110116+6
B0005FNN0.00300.54730.40820.27540.5393110108−2
B0007FFNN0.00210.45880.23690.14640.4578110108−2
CFNN4.9482 × 10−50.07030.04670.02870.0702110109−1
RNN3.1804 × 10−50.05640.02280.01310.0556110109−1
BPNN0.01801.34090.89920.58271.2640110108−2
B0007FNN0.00410.64340.35800.26680.6023110108−2
B0018FFNN0.00230.47680.25610.15340.4751110108−2
CFNN9.5339 × 10−50.09770.08100.05680.0899110109−1
RNN8.3644 × 10−50.09150.03080.01900.0912110109−1
BPNN0.00650.80640.56970.38350.8087110108−2
B0005FNN0.00210.45400.29130.18690.4553110108−2
B0018FFNN0.00110.33440.26710.18810.2664110109−1
CFNN6.5913 × 10−50.08120.07890.05180.0191110109−1
RNN1.8108 × 10−50.04260.02150.01410.0396110109−1
B0007 BPNN0.01881.37180.96690.56211.3652122120−2
B0005FNN2.3479 × 10−40.15320.11640.07180.1226122120−2
B0006FFNN7.6538 × 10−50.08750.06080.03600.0877122121−1
CFNN3.7793 × 10−50.06150.05210.03020.0331122121−1
RNN2.0039 × 10−60.01420.01070.00640.0142122121−1
BPNN0.11323.36462.74131.68523.2590122114−8
B0006FNN0.00230.47570.42340.25910.4407122125−3
B0018FFNN0.00140.36920.29670.17790.3679122120−2
CFNN3.3179 × 10−50.05760.04140.02540.0521122120−2
RNN1.5112 × 10−50.03890.02910.01690.0295122121−1
BPNN0.01341.15560.80750.48761.1146122120−2
B0005FNN8.2667 × 10−40.28750.17010.09880.2336122120−2
B0018FFNN1.7690 × 10−40.13300.05910.03480.1301122120−2
CFNN1.718 × 10−50.04140.03470.02080.0411122121−1
RNN5.1220 × 10−60.02260.01190.00670.0222122121−1
B0018 BPNN0.04162.04011.58521.04481.897792102+10
B0005FNN0.00610.78130.57640.37710.59259296+4
B0006FFNN0.00380.61360.50100.32310.39549295+3
CFNN1.2124 × 10−40.11010.03850.02470.10959293+1
RNN3.6099 × 10−50.06010.03100.01920.05449291−1
BPNN0.10323.21302.26951.40282.80989288−4
B0006FNN0.00630.79340.32380.20460.76339289−3
B0007FFNN0.00180.42620.30260.19570.35689290−2
CFNN5.6511 × 10−50.07520.02550.01570.07269291−1
RNN1.8961 × 10−50.04350.01680.01060.04379291−1
BPNN0.06512.55142.18031.42771.81719286−6
B0005FNN0.01551.07260.59630.38731.07679288−4
B0007FFNN0.00110.33350.25610.17110.25769290−2
CFNN9.0269 × 10−40.30040.16120.10750.27079290−2
RNN1.5726 × 10−40.12540.04500.02840.12269291−1
Table 4. RUL prediction accuracy when trained with one dataset.
Table 4. RUL prediction accuracy when trained with one dataset.
Testing DatasetTraining DatasetMethodsPerformance MetricsActual RULPredicted RULRUL Error
MSERMSEMAPEMAESD
B0005B0006BPNN0.16714.08803.45562.26503.8375126132+6
FNN0.01171.08180.79720.47990.9484126129+3
FFNN0.00530.72520.60080.37030.7191126128+2
CFNN0.00180.42790.41740.26930.1433126125+1
RNN2.5076 × 10−40.15840.10860.06690.1519126125+1
B0007BPNN0.45066.71266.24973.95412.5462126142+16
FNN0.01301.13830.73770.49450.1281126122−4
FFNN0.00560.75020.57280.37020.6835126124−2
CFNN0.00230.48080.57280.37020.6835126125−1
RNN0.00160.40130.30030.18670.3057126125−1
B0018BPNN0.26345.13233.97062.54024.7825126129+3
FNN0.09323.05262.00031.22792.3591126123−3
FFNN0.06572.56311.87451.21292.0677126124−2
CFNN0.03601.89770.81570.50031.7679126124−2
RNN0.03291.81470.65790.39011.8201126125−1
B0006B0005BPNN0.19434.40793.48272.25764.4039110118+8
FNN0.04852.20191.65601.08242.1430110116+6
FFNN0.03751.93541.73611.15431.3600110114+4
CFNN0.01581.25761.03240.65411.2566110113+3
RNN0.00790.88850.72240.49630.6578110112+2
B0007BPNN0.69528.33776.59604.38978.3393110126+16
FNN0.26525.14984.45173.05872.9582110122+12
FFNN0.09303.05012.40231.66153.0295110113+3
CFNN0.05232.28702.04591.38211.5281110116+6
RNN0.04202.04861.53580.95101.6905110112+2
B0018BPNN0.30355.50863.98632.62825.4911110124+14
FNN0.14593.81942.48051.48763.7212110114+4
FFNN0.11423.37891.84701.15593.3501110113+3
CFNN0.06722.59311.40950.84772.2401110112+2
RNN0.04852.20231.20240.69141.9405110112+2
B0007B0005BPNN0.07402.72112.30711.40892.7292122126+4
FNN0.02491.57811.18150.68881.5521122125+3
FFNN0.00850.92390.7320.43530.9209122125+3
CFNN0.00180.42740.35380.21380.2432122124+2
RNN0.00160.39950.24220.13690.3819122124+2
B0006BPNN0.29015.38644.61912.84163.5351122116−6
FNN0.04932.22021.90661.18691.5142122126+4
FFNN0.04532.12931.55080.97611.5118122118−4
CFNN0.01291.13600.57750.35221.0993122120−2
RNN0.00510.71320.52860.31810.7068122121−1
B0018BPNN0.29465.42734.52802.72295.0548122128+6
FNN0.17924.23323.09931.75323.2424122125+3
FFNN0.11733.42532.46421.46293.4334122126+4
CFNN0.09063.01041.86021.10692.7933122123+1
RNN0.03101.75981.28560.76421.7019122121−1
B0018B0005BPNN0.48876.99075.22743.35725.53009288−4
FNN0.04142.03441.35610.86131.94679296+4
FFNN0.03551.88551.36150.93551.63269295+3
CFNN0.02171.47321.10000.69971.25149290−2
RNN0.01721.31100.79330.49221.22669293+1
B0006BPNN0.28625.34963.88652.37945.33419294+2
FNN0.02511.58310.90670.55521.35829294+2
FFNN0.00640.80310.55030.35380.76879290−2
CFNN0.01011.00600.34380.22711.00769290−2
RNN0.00920.95690.45390.29620.93929291−1
B0007BPNN0.39246.26454.46632.92525.68519286−6
FNN0.11553.39912.59471.64933.32559296+4
FFNN0.04262.06281.72921.11771.92589295+3
CFNN0.03771.83620.93050.59101.83799293+1
RNN0.01871.36690.93620.59261.34009291−1
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ansari, S.; Ayob, A.; Hossain Lipu, M.S.; Hussain, A.; Saad, M.H.M. Data-Driven Remaining Useful Life Prediction for Lithium-Ion Batteries Using Multi-Charging Profile Framework: A Recurrent Neural Network Approach. Sustainability 2021, 13, 13333. https://doi.org/10.3390/su132313333

AMA Style

Ansari S, Ayob A, Hossain Lipu MS, Hussain A, Saad MHM. Data-Driven Remaining Useful Life Prediction for Lithium-Ion Batteries Using Multi-Charging Profile Framework: A Recurrent Neural Network Approach. Sustainability. 2021; 13(23):13333. https://doi.org/10.3390/su132313333

Chicago/Turabian Style

Ansari, Shaheer, Afida Ayob, Molla Shahadat Hossain Lipu, Aini Hussain, and Mohamad Hanif Md Saad. 2021. "Data-Driven Remaining Useful Life Prediction for Lithium-Ion Batteries Using Multi-Charging Profile Framework: A Recurrent Neural Network Approach" Sustainability 13, no. 23: 13333. https://doi.org/10.3390/su132313333

APA Style

Ansari, S., Ayob, A., Hossain Lipu, M. S., Hussain, A., & Saad, M. H. M. (2021). Data-Driven Remaining Useful Life Prediction for Lithium-Ion Batteries Using Multi-Charging Profile Framework: A Recurrent Neural Network Approach. Sustainability, 13(23), 13333. https://doi.org/10.3390/su132313333

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop