4.1. Calibration and Validation of the CFD Model
The aim of the calibration is to identify the undisclosed membrane permeability coefficient. In the calibration process, the model was simulated with different values for the membrane permeability
at four selected input parameter combinations that are characterised by having different operating pressure, temperature, water mass fraction and mass flow rates. The coefficient of determination was used as metric for calibration and is defined as:
It measures the amount of variance present in the data that can be explained by the model. The fitted permeability coefficient was then used in validation simulations at further operating points. In
Table 6, the coefficient for calibration and validation is given.
In
Figure 5, the diffusion flow rates measured in the experiments are plotted against the simulated ones. The measurement uncertainty was calculated by the GUM method [
43], and the sensor data are given in
Table 2. The diffusion flow rate is one of the most important metrics when evaluating the humidifier performance. In order to compare model and simulation, the results of the simulation model were scaled to the size of the experimentally investigated humidifier. The operating temperature was varied between 60 and 80 °C, the pressure took values between 1.5 and 2.0 bar and the water mass fraction at the wet inlet was controlled between 0.0278 and 0.1728 (kg H
O)/(kg Dry Air). Overall, the simulation and experimental results agree well over the whole investigated parameter range. In
Table A1, all results are displayed. The maximum of the mean absolute error between measurement and simulation is 0.0016 g/s at point 8 in
Table A1. Furthermore, the maximum relative deviation is 13.1% for point 6 in
Table A1. At points with high vapour transfer rates, the measurement uncertainty is the highest due to the fact that the uncertainty of vapour measurements increases when the relative humidity increases. All simulation results of the vapour diffusion rate are within the range of the measurement uncertainty. An additional metric to assess humidifier performance is the mass transfer efficiency, as described by Brandau and Köhler [
8]:
This quantity describes the ratio of the actual to the maximum possible water transfer. The mass transfer efficiency predicted by the simulation model is plotted against the measured one in
Figure 5, and is solely used for validation purposes. Hence, it is not accounted for during the fitting process. It can be seen that the efficiency for all measured points is in the range from 0.62 to 0.72. The mean absolute error in the efficiency is 0.023. It it clearly visible in
Figure 5 that the measurement uncertainty is quite high for this quantity. This can be explained by the fact that three moisture measurements, which are subject to significant uncertainty, are included in the calculation of the mass transfer efficiency, cf. Equation (
20). The highest deviations that can be observed in
Figure 5 occur at operating points with relatively low vapour transfer rates. Due to this low value for the absolute vapour transfer rate, small absolute deviations cause a high relative deviation.
4.2. Set-Up and Evaluation of the Surrogate Models
The first step in the procedure is to calculate the sampling plan, where the FOM is evaluated. Based on these results, the POD-basis is calculated. In
Figure 4, the samplings of the different DoCEs are shown together with the measurement points used for calibration and validation. The mass flow rates of the CFD model are scaled to match the experiment. It is clearly visible that the fractional factorial design, which was extended by a centre point, places points in the corners of the design space. Only five points can be seen in the pair plots, except for the ones including the water mass fraction, due to the fact that always two points are sampled with the same temperature, pressure and mass flow rate. In terms of absolute humidity, seven points can be seen, which is because of the limitation posed to relative humidity, as explained above. As a consequence, the points are shifted from the right to the left part of the pair plots using the water mass fraction as the X-axis. In contrast to the fractional factorial design, the sampling points generated by the Halton sequence and the Latin-Hypercube are more evenly distributed in the design space. In the pair plots of temperature and water mass fraction, unfilled areas can be observed that result from the limitation to 100% relative humidity at the wet inlet. Both the Halton sequence and Latin-Hypercube do not guarantee that the corners of the design space are filled with points. In fact, without adjustments, no points will be placed in any corner of the design space. Hence, the choice of parameter limits should be adjusted, or additional corner points should be added manually in order to avoid extrapolation with the surrogate model.
After the solutions of the FOM are calculated at the given sampling points, the POD-basis can be calculated. To evaluate the surrogate models using the different DoCEs in combination with the interpolation methods, the surrogate model is evaluated at the points that were used above for validation, but this is not included in the DoCEs, cf.
Table A1. To assess and compare the set-up surrogate models, the following performance metrics are used:
The maximum absolute error that occurs in the whole fluid domain:
This metric is used to identify if there are outliers where the surrogate model predictions are very inaccurate. The mean absolute error is given by:
where
n is the number of mesh elements. The most important field variable in the membrane humidifier is the water mass fraction driving the water transport from the wet to the dry side. The water mass fraction is therefore used to calculate the MAE and maxAE. Additionally, the normalised mean absolute error (nMAE) is used, where the MAE is divided by the maximum driving potential for the water transfer:
Using this quantity, it is easier to compare simulations with different boundary conditions for the water mass fraction.
An overview of the MAE, maxAE and nMAE for the different surrogate models combining an interpolation method and a DoCE is given in
Figure 6. The results given in
Figure 6 are averaged over the 18 validation points to assess the overall performance of the surrogate models.
In
Figure 6, it can be seen that the surrogate models based on the fractional design produce the largest deviations in all metrics. Comparing the averaged metrics in
Figure 6 to each other, one can see that the results are similar to each other. Only for the fractional design using a linear interpolation an outlier in terms of maxAE can be identified. The MAEs, maxErr and nMAEs of the surrogate models using the fractional factorial design are significantly higher compared to the MAEs and nMAEs produced by surrogate models using LHD and Halton designs. Even though the deviations of the surrogate models using the fractional factorial sampling as basis are much higher than the other ones, the nMAE is below 2% for the water mass fraction in all cases. Furthermore, the results of the surrogate models using the LHD are more sensitive to the choice of the interpolation method than the Halton sequence-based ones. Overall, the Halton sequence-based models are quite robust in terms of the chosen interpolation method, since average results do not deviate much. The best combinations of an interpolation method with a given DoCE for the surrogate model of the humidifier are:
the thin-plate spline with the fractional factorial design,
the cubic spline with LHD,
the thin-plate spline with the Halton sequence,
as depicted in
Figure 6. On average, the model using the combination of the Halton sequence and thin-plate spline gives in the best surrogate model. Choosing this combination yields a MAE for a surrogate model below 1%. Moreover, Halton yields a deterministic sampling plan, which can be easily extended if more sample points are required, which is generally not the case for LHD-based sampling plans.
Figure 7 shows the results given in
Figure 6 broken down by the operating points given in
Table A1. However, only the best surrogate models for a given DoCE are considered in further analysis. For each operating point in
Table A1, three values expressing the MAE, the maxErr and the nMAE of the water mass fraction predictions of the best surrogate models based upon the three DoCEs are shown. From the results given in
Figure 7, a correlation of the MAE and the maximum error can be identified. The correlation coefficient between the MAE and the maxErr is higher than 0.96 for all surrogate models. This points out that those metrics are highly correlated and no extreme outliers are to be expected when the MAE is low. On the other hand, the nMAE behaves differently due to the scaling.
In
Figure 8, a box plot for each error metric is displayed. The box covers the range from the first to the third quartile. A one and a half interquartile range was used for the whiskers. In each of the subplots, a box plot is drawn for the best surrogate model based upon the previously introduced DoCEs. The plotted mean values correspond to the ones given in
Figure 6. As additional information, the median values are shown. When the median of the prediction errors is considered, the same order of surrogate models, as already shown for the mean values, is obtained. Again, the Halton+TPS model performs best overall. For all metrics but the MAE of the LHD+Cubic model, the median is lower compared to the mean. For the LHD+Cubic and the Halton+TPS models, an outlier in terms of MAE and maxAE can be identified. Moreover, the box plot of the Halton+TPS model displays an outlier in the nMAE. The highest range in all metrics can be observed for the fractional design, whereas the lowest range is produced by the LHD+Cubic model in all metrics.
Overall, the fractional factorial-based surrogate model achieves the minimum MAE in only two operating points. The LHD- and Halton-based models perform best at 10 and 6 operating points, respectively, when considering MAE. The same number of best results is obtained when considering the maximum error and the nMAE. Moreover, it can be seen in
Figure 7 that the model based on the Halton design produces the highest deviation in the 18th operating point, but the nMAE stays below 2%. Even the surrogate model using the fractional factorial design achieves an nMAE lower than 3% in all validation points. Therefore, a fractional factorial-based surrogate model may be a good choice in the early stages of an investigation or if a sampling plan has to obey additional constraints, as it might be the case if a physical experiment is set up.
In
Figure 9, the results of the surrogate model are displayed when only eight points are available for the POD-basis generation. The purpose of this investigation is to analyse the effect of varying available results, which is crucial when the proposed method should be employed in early stages of a parameter study. A clear trend can be seen in
Figure 9: the more results are available, the more accurate the surrogate solution becomes. The nMAE averaged for the 18 validation cases, and only 8 design points available, is
. This result is similar to the results produced by the fractional factorial design-based surrogate models.
Figure 10 shows a comparison of the water mass fractions predicted by the FOM and the surrogate model on a cutting plane in the middle of the hollow fibre module for cases 16 and 18 of the validation data. The shown results correspond to the validations points in
Table A1, where the mean absolute errors between FOM and surrogate models reached the minimum and maximum of the 18 points investigated. Overall, a high similarity between the results of the FOM and surrogate model can be observed from the contours. For both cases, the highest water mass fraction occurs in the fibres. Therefore, the fibres are well visible in
Figure 10 in all four simulation results. The random placement of the fibres results in higher fibre density in the upper centre part of the humidifier, whereas the lower part is less densely packed. Due to the laminar flow, only a small amount of mixing due to convection occurs in the shell. If the packing density of the fibres within a certain region is high and the convective mixing is low, a high wet volume flow is present, opposed to a small dry volume flow, in this region. As a result, the water mass fraction in the shell along the flow length increases faster in regions with high packing density than in regions with low packing density. This behaviour can be observed in
Figure 10 and is also present in FOM and surrogate results.
The lowest values of water mass fraction occur in the lower section of the contour shown. This can again be seen in both predictions. In the lower region of the humidifier, the distance between individual fibres is higher than in the upper section and, therefore, the water mass fraction in the shell is lower than in the densely packed regions. Both models predict the highest values of water mass fraction in the region where the fibre density is the highest. Deviations in the contours produced by the FOM and the surrogate model can be seen in places where a transition between contour levels in the high-fidelity model takes place. This applies to both fibres and the shell, with the greatest deviations occurring in the shell. For case 18, the highest deviations occur in the bottom region of the shell. The water mass fraction in fibres is well reproduced by the surrogate model.
Overall, it can be concluded that the surrogate model reproduces the results of the FOM with high accuracy, even at the parameter combination with the highest deviations. Our results suggest that the best combination of interpolation method and DoCE is the Halton design and TPS interpolation. However, the differences between the Halton and Latin-Hypercube DoCEs are relatively small. The same applies to the interpolation methods investigated in this study.
4.3. Using POD Solutions to Initialise the CFD Model
Even though the predictions of the surrogate models are as accurate as shown above, there might be situations where a full-order solution is desired. For this case, a POD+I solution can be used to accelerate the convergence of the CFD simulation. To show the benefit of the POD+I initialisation in terms of computational time saving, we use the Halton+TPS model to calculate the initial solutions and compare the computational time necessary for reaching convergence to a normal solution process.
For the comparison of computational times to reach converged simulation, the validation data set was used again. In the first step, the simulations are done using a uniform initialisation of the model. The water mass fractions in the whole field are set equal to the dry inlet, the velocity is set to zero and the pressure equals the outlet conditions.
To demonstrate the advantage of the POD+I initialisation compared to the uniform one, the two cases with the lowest, Case 16, and highest, Case 18, nMAE from the validation data set are considered. For both cases, each initialisation method is applied and the convergence behaviour with respect to the overall water transfer from wet to dry side is analysed. The residuals were checked to be below
for each quantity. Additionally, the water transfer is considered as the most important integrated quantity and, therefore, is analysed in more detail. The water transfer rate is considered converged if the relative change between two iterations is below
for 1000 iterations. In
Figure 11, the overall water transfer is plotted against the iterations. A zoom is provided to show the convergence behaviour of the POD+I-initialised simulation. The black dotted line marks the steady-state result and the grey area a relative deviation of 1 % from the steady state. It can be seen that the POD+I-initialised cases converge after fewer iterations for both cases. For case 16, the very low deviations between the POD+I solution and the full-order model result in a fast convergence after just 437 iterations and 1770 s of computing time on 8 cores. The normally initialised solution takes about 14,002 iterations and 22,602 s on 8 cores to converge. In the same figure, in the bottom plot, again, one curve for each of the initialisation methods is shown for case 18. In the zoom box, it can be seen that the POD+I-initialised solution converges after 5522 iterations. The time needed to reach convergence on 8 cores is 9015 s. In contrast, the uniformly initialised solution needs more than twice the iterations, about 20,728, and 35,489 s of computational time to converge.
The mean simulation time of the FOM averaged over the 18 validation points is 12.6 h per simulation to solve for 30,000 iterations using 8 CPU cores of an AMD EPYC 7302. This high amount of iterations was chosen to definitely achieve convergence. The necessary time to calculate the POD+I solution is much lower than the time required to solve the FOM. The calculation of the 18 validation points is done in 107 s. The average prediction time for a single operating point is 5.95 s. This time already includes the writing of the OpenFOAM files on the disk. In fact, the isolated evaluation time for POD+I lies below one second. The average solution time for a POD+I-initialised solution is 1.8 h. In summary, using POD+I solutions for initialisation can save significant computing time in case of the membrane humidifier.