Next Article in Journal
Effects of Material Properties on Angular Distortion in Wire Arc Additive Manufacturing: Experimental and Computational Analyses
Next Article in Special Issue
In-situ X-ray Differential Micro-tomography for Investigation of Water-weakening in Quasi-brittle Materials Subjected to Four-point Bending
Previous Article in Journal
Experimental and Constitutive Model on Dynamic Compressive Mechanical Properties of Entangled Metallic Wire Material under Low-Velocity Impact
Previous Article in Special Issue
Variational and Deep Learning Segmentation of Very-Low-Contrast X-ray Computed Tomography Images of Carbon/Epoxy Woven Composites
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Computed Tomography 3D Super-Resolution with Generative Adversarial Neural Networks: Implications on Unsaturated and Two-Phase Fluid Flow

1
Department of Earth- and Environmental Sciences, Katholieke Universiteit Leuven, Celestijnenlaan 200E, 3001 Leuven, Belgium
2
Hydrology and Hydraulic Engineering, Vrije Universiteit Brussel, Pleinlaan 2, 1050 Brussel, Belgium
*
Author to whom correspondence should be addressed.
Materials 2020, 13(6), 1397; https://doi.org/10.3390/ma13061397
Submission received: 25 January 2020 / Revised: 9 March 2020 / Accepted: 11 March 2020 / Published: 19 March 2020

Abstract

:
Fluid flow characteristics are important to assess reservoir performance. Unfortunately, laboratory techniques are inadequate to know these characteristics, which is why numerical methods were developed. Such methods often use computed tomography (CT) scans as input but this technique is plagued by a resolution versus sample size trade-off. Therefore, a super-resolution method using generative adversarial neural networks (GANs) was used to artificially improve the resolution. Firstly, the influence of resolution on pore network properties and single-phase, unsaturated, and two-phase flow was analysed to verify that pores and pore throats become larger on average and surface area decreases with worsening resolution. These observations are reflected in increasingly overestimated single-phase permeability, less moisture uptake at lower capillary pressures, and high residual oil fraction after waterflooding. Therefore, the super-resolution GANs were developed which take low (12 µm) resolution input and increase the resolution to 4 µm, which is compared to the expected high-resolution output. These results better predicted pore network properties and fluid flow properties despite the overestimation of porosity. Relevant small pores and pore surfaces are better resolved thus providing better estimates of unsaturated and two-phase flow which can be heavily influenced by flow along pore boundaries and through smaller pores. This study presents the second case in which GANs were applied to a super-resolution problem on geological materials, but it is the first one to apply it directly on raw CT images and to determine the actual impact of a super-resolution method on fluid predictions.

1. Introduction

Fluid storage and flow properties are important to assess how water, oil, and gas are stored in rocks and how these fluids might migrate. In this way, it is possible to estimate for example how much CO2 could be captured in pores in the deep subsurface, which is crucial information if we want to reduce anthropogenic greenhouse gases by carbon capture and storage (CCS) [1,2,3,4,5,6]. Furthermore, it is also possible to study how waterflooding could enhance oil recovery from a reservoir [7,8,9]. However, fluid storage and migration is not only relevant for reservoir applications, but also for construction materials. Such materials may contain water that can be stored or removed during capillary uptake and drying, respectively. This water could enhance weathering and corrosion, form a medium for mould growth, or could expand upon freezing, thus breaking the rock [10,11]. Each of these preceding examples requires detailed knowledge on fluid storage and flow properties which could be estimated through experiments, either carried out in specialized laboratories or deduced from digital rocks. Laboratory measurements, however, require expensive and complex set-ups, take a long time to complete, are often destructive, do not always entirely capture the studied properties and on top of that, experiments often fail to produce reproducible results between laboratories [9,12,13,14,15,16,17,18,19]. Therefore, numerical solutions have been developed allowing to compute fluid storage and flow properties on digital rocks [7,20,21,22,23]. Such digital rocks are acquired through direct imaging or numerical simulations of rocks.
Computed tomography (CT) is a technique to rapidly capture the three-dimensional structure of materials [22,24,25]. However, like any imaging technique, CT is plagued by a sample size versus resolution trade-off, which is adversely affecting fluid flow simulations. Both a high resolution and sufficiently large volume are required for accurate fluid flow estimations at the pore-scale [9,26,27,28]. Resolution impacts how well pore network topology and pore surfaces are resolved. At lower resolution, i.e., lower resolving power, pore sizes are often overestimated and specific surface area decreases. Additionally, fine pore connections like micropores, i.e., pores with sizes close or below resolution, might not be visualized while in reality they could be a determining factor for fluid flow. A combination of these factors leads to worsening fluid flow predictions with lowering resolution, even though total porosity tends to remain unchanged, especially for sandstones [20,26,27,29,30,31,32,33,34,35,36]. Unfortunately, it is impossible to only consider the highest possible resolution, because inevitably, a smaller volume would be imaged [24]. This smaller sample volume would risk zooming in on local heterogeneities, thus not studying a representative elementary volume, i.e., the minimal required volume to capture local heterogeneities that produces a homogeneous value for the studied property, like porosity or permeability [28,34,37,38,39]. This constant battle between using the highest possible resolution and the largest possible image size justifies the development of multiscale and super-resolution models. With respect to the latter, in this paper, an artificial resolution improvement method is presented.
Multiscale and super-resolution methods recently became more popular. Whereas some scientific questions concerning pore or grain size distributions can be answered by studying a single sample at multiple scales [15,16,40,41,42,43], others require the integration of different scales for fluid flow simulation. Several methods have been developed to integrate multiple scales, such as, multiscale pore networks in which fine pores are added explicitly to the pore network [44,45,46,47,48]. Instead of modelling fine pores explicitly, upscaled micropore properties could be added between macroscale pores as a continuum [49,50,51] or as local features, connecting pores parallel [52] or in series to macropore pore throats [23,53]. Apart from these pore network based approaches, which implicitly demand simplification of the pore structure via pore network extraction [22,54,55,56], multiscale images are another tactic to tackle the resolution versus sample size trade-off. Firstly, such multiscale models can be obtained through the superimposition of low and high resolution 2D images or 3D volumes. These 2D images are then obtained by extrapolating high resolution structures to larger images through two-point correlation functions and simulated annealing [57,58,59,60,61]. 3D volumes can be obtained from 2D images through process-reconstruction [62], two-point statistical relations [63,64], simulated annealing [59,65], phase recovery [66,67], and multiple point geostatistics [68,69,70,71,72]. These 3D models could then be superimposed to obtain a multiscale pore volume [48,73,74,75]. Secondly, multiscale images could be obtained by stochastically combining several scales and in contrast to image superposition, these models aim to jointly improve pore surfaces and fine-scale connectivity. Such multiscale images typically use expanding image grids to improve resolution through simulated annealing (SA) [61,76,77,78] or multiple-point geostatistics (MPS) [72,76]. Thirdly, super-resolution methods aim to introduce high resolution patterns into low resolution images by mapping a translation of low resolution features to high resolution equivalents. These methods could use self-similarity of images to improve details [79,80,81] or construct dictionaries linking low and high resolution image patch pairs through neighbour embedding [75,82] or sparse representation [83] by finding the closest matching high resolution image patch (e.g., 7 × 7 pixels) to a low resolution patch. These methods work in 2D using high resolution scanning electron microscopy (SEM) images and low resolution CT slices [75,82] and 3D, for which two CT scans at different resolutions were used [83]. Additionally, the translation from low to high resolution features could be addressed through neural networks [84,85,86,87]. Unfortunately, most of the preceding methods, especially those based on SA and MPS are rather slow in their performance and/or assume homogeneity of the simulated volume. These methods would be too computationally expensive to generate 3D simulations. This is problematic because porosity and fluid flow are 3D properties, thus they should be simulated in 3D.
This research builds on the efforts of Wang et al. [82,83,85] and Shams et al. [88] to super-resolve, or improve the resolution, of lower resolution scans and it will more specifically be applying 3D generative adversarial neural networks. In order to have the most solid neural network, two CT scans taken at different resolution of exactly the same volume are used for training, because artificial downsampling of a high-resolution image to get a low resolution image is not performed without the risk of oversimplifying the problem [32,89]. The effect of oversimplification is further elaborated on in this research by studying the effect of mechanically versus artificially reduced resolution on the pore network and related fluid flow. Furthermore, even though the true strength of super-resolution methods should lie in the improved capacity to predict geophysical property predictions, like fluid flow, none of the super-resolution studies have yet addressed this and have instead limited model verification to peak signal-to-noise-ratios and structural descriptors (see, for example, [85]). Therefore, this research verifies whether fluid flow predictions for single-phase, unsaturated, and two-phase flow improved and studies the pore network characteristics to elucidate what improved.
Convolutional neural networks were developed to mimic human sight and were initially mainly used for speech and image recognition [90,91,92]. Later on, these networks started getting used for super-resolution (SR) imaging [93] and some of the first applications focused on photographs (see, e.g., [93,94,95,96]) and movies [97]. They were rapidly used for the resolution enhancement of, for example, satellite images [98,99] and medical images [100], like magnetic resonance imaging [101,102] and CT [103,104,105,106,107]. The success of a lot of these SR applications is explained by the emergence of generative adversarial networks (GANs) [108] which are commonly known for their strength at generating realistic “fake” images [109]. These GANs have been used for geomaterial porosity simulation [110,111,112], but even though they have proven their capacity as super-resolution methods, they have not yet been applied to super-resolution of geological materials. In fact, neural networks have barely been used to solve this problem, except by Wang et al. [84,85] and Shams et al. [88]. Therefore, this research will apply 3D GANs to generate super-resolution models and it will do so by building on recent advances in super-resolution imaging.
The goal of this research is to present a proof-of-concept study for super-resolution simulations, using generative adversarial neural networks (GAN) and to present how the developed approach influences fluid flow predictions. Next to these models, an explorative study was added to understand the impact of resolution on fluid flow properties of the studied continental carbonate. This resolution impact study was augmented by comparing samples that are scanned at different resolutions (mechanical resolution reduction) or samples that are artificially generated from a high-resolution volume (4 µm) which was artificially downsampled. Afterwards, suggestions are formulated that can help stabilize GAN training and future research directions are formulated to pave the path to deploy the developed super-resolution method for routine digital rock analyses.

2. Materials and Methods

2.1. Study Material

The studied material are continental carbonates, which have long been used as building material [113] and have recently been studied extensively as reservoir analogues [114,115,116] as a response to the discovery of pre-salt oil reservoirs consisting of similarly complex carbonates offshore in Brazil [117,118,119]. These carbonates provide unique challenges with respect to their porosity because an interplay of biological, chemical, and physical processes during sedimentation and diagenesis gives rise to an extraordinarily complex multiscale pore network, resulting in cm-scale pores that are connected to each other through meso- and microporous pathways [120,121]. One core plug of these continental carbonates has been used in this study. This sample was selected to have pores well below the sample size, although heterogeneity in pore structures was not avoided. This is further shown in Section 2.4. The studied sample has a diameter of 8 mm and is analysed at four different resolutions, i.e., 4, 8, 12, and 16µm.

2.2. Computed Tomography

Computed tomography (CT) is a non-destructive technique that uses X-rays to obtain three-dimensional material reconstructions [24,25]. Three-dimensional volumes are represented by stacked 2D images in which grayscale variation is dictated by the Beer–Lambert law and is directly related to the attenuation coefficient of materials. These grayscales are then segmented into relevant material phases, which are, for this study, porosity and matrix (calcite) through hysteresis segmentation [122,123], in which two thresholds are selected and region growing corrects for misclassified voxels. These thresholds are manually selected by an experienced operator searching for the optimal balance between over- and underestimating connectivity. The major drawback of CT scanning is the resolution versus sample size trade-off, which is the major point of focus in this study. Three-dimensional visualization of these CT scans is obtained in Avizo Fire 9.0 software (ThermoFisher Scientific, Waltham, MA, USA).

2.3. Neural Networks

2.3.1. Convolutional Neural Network–Network Architecture

Convolutional neural networks combine convolutional, pooling, activation, and normalization layers to mimic human sight and achieve tasks like image recognition and segmentation [90,91,92]. In this research, a fully convolutional network, and more specifically a U-Net is used [124]. U-Net refers to a type of encoder-decoder network in which a symmetrical network is used whereby one side downsamples the input through (strided) convolutions or pooling and the other side upsamples the images through (strided) deconvolutions or upsampling. Such U-Nets were originally developed for segmentation tasks in which the downsampling part of the network allows to consider a larger field-of-view with smaller convolutional kernels, thus including more contextual information. Without downsampling, only local information, limited to the kernel size would be considered. The U-Net used in this research is shown in Figure 1. The downsampling section consists of four convolutional blocks in which each block consists of two convolutional layers, each followed by leaky Rectified Linear Units (ReLU) activation layer [125] and instance normalization [126]. The leaky ReLU activation layer avoids complete deactivation of neurons which is typical for the more commonly used ReLU. In a ReLU activation layer, positive neuron values are passed, and negative values are set to zero (ReLU), or are decreased by a certain factor (Leaky ReLU). Instance normalization better handles image contrasts and depends less on batch size used to train the network, in contrast to more commonly used batch normalization. In between each convolutional block, a strided convolution with stride of 2 downsamples the volumes. Strided convolution allows additional trainable parameters for downsampling, whereas maxpooling, as used in original U-Nets [124] potentially removes important information. The upsampling section of the U-Net uses blocks with deconvolution and strided deconvolution layers to upsample the volume. The downstream and upstream part of the U-Net are connected by long-range skip connections, which concatenate feature maps of convolutional blocks to each deconvolutional block at the same level. This procedure recovers spatial information that could have been lost during downsampling [127]. In addition to these connections, each (de-)convolutional block contains a short-range skip connection, which enhances training convergence and mitigates the gradient vanishing problem [127,128,129]. The number of filters in each (de-)convolutional layer starts at 32 in the upper level and doubles each downward level, reaching a maximum of 256 filters in the bottom level. The final activation layer has sigmoid activation.

2.3.2. Conditional Generative Adversarial Networks (GAN)—Super-Resolution Images

Generative adversarial networks consist of two convolutional neural networks of which one is the generator and the other is the discriminator [108,130]. The former network tries to generate realistic images, whereas the latter tries to differentiate these generated images from input training data. Both neural networks train to do their respective tasks better, but while the generator is getting better, it becomes more difficult for the discriminator the differentiate real and fake images. At the same time, a more effective discriminator increases the pressure on the generator to create more realistic images. Both networks are said to be playing a minimax game until a Nash-equilibrium has been reached in which both are sufficiently good at their tasks [108]. In reality, this usually means that the discriminator can correctly classify 50% of the images it receives [108,130,131]. The classification error is passed on to the generator as a measure of how bad it has functioned.
Typically, GANs create images from a random latent vector but in a conditional GAN an input image is given to the generator, which is then modified to create the desired image [132]. In this scenario, an additional loss function, apart from the discriminator loss is passed onto the generator to train. This additional loss function directly compares the generated image to the expected image (Figure 2).
In this research, the generator corresponds to the same U-Net as explained before. The discriminator is a convolutional network, with four strided convolutions (stride = 2) each followed by leaky ReLU activation and instance normalization. The first convolution starts with 64 filters and this is doubled for each subsequent convolution. These four convolutions are followed by a fifth convolution (stride = 1) with one filter, which is then flattened and followed by a dense network with one hidden layer (1024 neurons) followed by leaky ReLU activation, 50% dropout and a single output neuron with sigmoidal activation. This network decides whether the input images are real or generated by the generator.
GANs often show unstable training behavior. Therefore, the suggestions of Radford et al. [130] were followed by opting for strided convolutions instead of pooling and normalization and leaky ReLU activation layers after each convolution. Apart from this, network complexity was improved stepwise, adding a new level of network depth after each increment. Furthermore, residual skips over each convolutional block helped increasing stability. In order to reduce the effect of having insufficient pattern variability, the batches that were used to train the discriminator were randomly shuffled.

2.3.3. Training

The generator of the GAN is trained with generator loss, which is a mean absolute error (mae) loss and with adversarial loss which is obtained by feeding the discriminator “fake” images, but computing the mean squared error (mse) loss by labelling the images as real. If these images are labelled as “fake” by the discriminator, the generated did not fool the discriminator. Therefore, the loss will be higher, thus motivating the generator to improve. The generator and adversarial loss are fed to the generator in a 100:1 ratio. The input parameters are summarized in Table 1 and are the result of testing common input parameters found in the literature on medical CT applications [133] through a grid search approach on 2D test sets. The number of epochs was selected based on a trade-off of artefacts versus simulation time. Training is performed on a user-grade NVIDIA GeForce GTX 1080 graphical processing unit (GPU) with 8 GB of graphical memory. Furthermore, the networks are developed in Keras with a TensorFlow 1.14 backend.

2.4. Dataset Preparation

Four scans at resolutions of 4, 8, 12, and 16 µm, respectively, have been taken of a 8-mm core plug. From each of these scans the same volume is extracted, with dimensions of 4.8 mm × 4.8 mm × 6.6 mm, which corresponds to 1200 × 1200 × 1750 voxels in the 4 µm scan. In order to maximize the match of these volumes and to ensure that exactly the same volumes are compared for each resolution, the volumes at lower resolutions are cut by comparing bounding box slices through structural similarity [134]. These four volumes are used to verify the influence of resolution on pore network and fluid flow properties. Additionally, the 4 µm resolution scan has been downsampled by factors 2, 3, and 4 in order to obtain volumes at 8, 12 and 16 µm voxel size, respectively. Artificial resolution reduction or downsampling was performed by averaging voxel values of segmented images by, e.g., a mean filter of 2 × 2 × 2 to get resolution reduction from 4 to 8 µm. This procedure is preceded by a spline filter. This process allows comparison between artificially reduced resolution (ARR) and mechanically reduced resolution (MRR) and helps to establish whether ARR could suffice to train neural networks for large-scale deployment.
Two of the scanned volumes are used to train and validate the neural network, namely the volumes scanned at 4 and 12 µm resolution at high (HR) and low resolution (LR), respectively. These volumes are then divided into training data, 1000 slices, and validation data, 600 slices (Figure 3). The remaining 150 slices in between these two volumes, because the original volume had 1750 slices, are aimed to reduce similarity between training and validation data. Despite this potential similarity, it was preferred to take training and validation data from the same sample because grayscale contrast differences could occur for different samples, which are avoided for this proof-of-concept study. Additionally, continental carbonates are known for their complexity, thus making the lower and upper part of one sample sufficiently different (Figure 3). For example, in Figure 3, the upper part of the sample dominantly contains finer, regularly distributed pores, whereas the lower part has more irregularly distributed pores. The LR training and validation volumes are upsampled by approximately a factor of 3 to match the grid size of low and high resolution volumes, although the correct factor is determined from the volume matching procedure. This brings LR and HR data to the same voxel size. Finally, the validation and training datasets are subdivided into subvolumes of 64³ voxels and each of those volumes overlap by 25%. Such small volumes are required to allow training of the neural network on a single-GPU device, and the overlap is used to enhance the amount of samples in the training set. Validation is performed on larger volumes of 256 × 256 × 64, again with an overlap of 25%. Larger volumes and overlap are chosen to reduce stitching artefacts. Samples were not preprocessed elaborately as the future intended goal of these neural networks are routine use, independent of preprocessing. However, grayscale values were normalized between 0 and 1 so as to avoid exploding gradients in neural networks.
A validation dataset is provided to test whether the models could work on previously unseen data. This dataset also consists of a HR and LR volume. During validation, only the LR volume is fed to the GAN to create a super-resolved model (SRM). These SRM and the related fluid flow properties can be compared to those of the available HR volume.

2.5. Fluid Flow Properties

Fluid flow properties have been deduced from the subsamples of the studied CT scans. These subsamples have dimensions of 1000³ voxels to study the influence of resolution and 500³ voxels to study the efficiency of super-resolution GANs, compared to the original LR and expected HR volumes. For the resolution study, two volumes (V1r and V2r) were extracted at each resolution with an overlap of 40%. The volumes are taken at the exact same location at each resolution. To study the effect that super-resolution GANs can have after transforming LR data, four volumes (V1SRM, V2 SRM, V3 SRM and V4 SRM) were extracted from LR, HR and super-resolved models (SRM), with maximal overlap of 20%. Here, these four volumes are taken at the exact same spot. The volume size difference for the two studies is caused by the dimensions of modelled volumes, which are 1156 × 1156 × 576 voxels because validation was performed on the validation set which was not involved in training of the neural network, as to avoid overfitting (Figure 3). For the resolution study, the entire 1200 × 1200 by 1750 voxels cube was used. The different volumes, i.e., V1r and V2r or V1SRM, V2SRM, V3SRM, and V4SRM are not compared to each other as this would imply that a representative elementary volume (REV) was reached and computation of the REV was not part of this study.

2.5.1. Lattice Boltzmann Simulation—Single-Phase Permeability

Lattice Boltzmann simulations (LB) are used to solve the discretized Boltzmann equation to simulate fluid flow on a regular lattice [135,136,137]. The D3Q19 lattice was selected to balance accuracy and computability [138,139]. LB simulations were performed in the Palabos open-source package [140] with an applied pressure difference of 0.0005 Pa [72]. Results are visualized with Paraview [141,142]. Additionally, porosity and specific surface of models are computed by counting porosity voxels on segmented CT volumes to obtain the total pore volume and through marching cubes algorithm for surface area. This surface area is then translated to specific surface area by dividing the surface area by pore volume.

2.5.2. Pore Network Models (PNM)

Fluid flow simulations are most easily computed on pore network models. These models present a simplified representation of the pore structure, in which the pore network is simplified into pores and pore throats, represented as balls and sticks. The network extraction algorithm of Raeini et al. [55] was used to generate input for fluid flow simulations. On these extracted pore network models (PNM), single-phase absolute permeability, two-phase relative permeabilities and unsaturated flow properties were determined.

2.5.3. Unsaturated Flow: Moisture

Unsaturated moisture flow is often used for building materials and looks at moisture retention and flow in materials. These properties are of prime importance in ensuring safe building materials by avoiding mould growth and corrosion. Islahuddin and Janssen [10,19,143] developed unsaturated fluid flow simulations, which are directly applied in this research, using modified OpenPNM code [144] to simulate moisture retention and permeability in relation to capillary pressure, pc through the Young-Laplace equation, modified by Bakke and Øren [62]:
p c t = ( 1 + 2 π G )   σ cos θ r
where θ is the contact angle, σ is surface tension, and G is the shape factor.
A good explanation of all used equations and physics behind the computed properties are found in Islahuddin and Janssen [19]. In the present research, air entrapment, corner and adsorbed flow, and Knudsen diffusion are included, even though Knudsen diffusion should not make a large difference because of the relatively large pores encountered in this study.

2.5.4. Two-Phase Flow: Oil and Water

Two-phase flow simulations are often used to model displacement of water by oil or oil by water during primary drainage or waterflooding, respectively. Usually, PNM are used for these simulations, as direct simulations require careful tracking of fluid interfaces making them computationally expensive [9]. Therefore, this research applies the code of Valvatne [145] and Valvatne and Blunt [7] to simulate two-phase fluid flow on PNM by considering primary oil flooding and subsequent water flooding. The rock is initially assumed to be water-wet, although after oil flooding, pore boundaries in contact with oil become oil wet, making the carbonates mixed-wet [7,9].
In these two-phase simulations, capillary pressure corresponds to the pressure difference between water and oil. Simulations will run until a certain fraction of oil-filled pores is attained or until all pores are filled with oil. During primary oil flooding, the only relevant flow mechanism is piston-like displacement [146] and pore entry capillary pressures (pce) are given through the Young–Laplace equation, modified by Mason and Morrow [147] and Øren et al. [56]:
p c e = ( 1 + 2 π G )   σ   cos θ r r   F d ( θ r ,   G ,   β )
where θr is the receding contact angle and β the corner half-angle. The main difference with the unsaturated threshold capillary pressure (Equation (1)) relates to the Fd as dimensionless correction factor, accounting for liquid that remains in pore corners, further elaborated in Valvatne and Blunt [7]. The receding contact angle is in its turn depending on factors like surface rugosity, wettability, and mineralogy [148].

3. Results

The result section combines the pore network and fluid flow properties that were obtained to study the resolution influence and implementation of super-resolution models (SRM). Both are analysed using the same techniques, resulting in similar tables and figures, thus please take attention to the figure axes and table headers. When comparing low resolution input, super-resolved models and the expected high-resolution output, the abbreviations LR, SRM, and HR will be used, respectively. Furthermore, whenever results are visualized, the results of only one volume are used, but all properties show similar variability, as is demonstrated by supplying all quantitative values in table format for each volume. Furthermore, all results are plotted in the Supplementary Material for the reader to assess the similarity between all volumes. Whenever the term “resolution” is used, the voxel size is implied and not resolvability.

3.1. Visual Results

Slices of LR input, expected (HR) result and SRM are compared in Figure 4. The SRM (Figure 4b,e) has reduced salt and pepper noise, compared to HR (Figure 4c,f). Furthermore, zones with grayscale values in between porosity and matrix are influenced by the partial volume effect, and are better resolved in SRM than in LR, as they as are in HR as well. However, the SRM pores do not necessarily match HR one-to-one. This is shown in detail in Figure 4d–f. Figure 5 shows a three-dimensional visualization of the LR input, expected HR result, and SRM after segmentation.

3.2. Pore Network Properties

Pore network properties are determined on pore network models extracted from segmented images. The influence of resolution on these properties is shown in Figure 6 for V1 and in Table 2. This table distinguishes real mechanical resolution reduction (MRR), as obtained from scanning at multiple resolutions and artificial resolution reduction (ARR), which was obtained from downsampling the sample scanned at 4µm. Note that all data shown with respect to lengths and volumes are transformed through log10 transformation. The ratio of pore throats to pores remains constant at approximately 1.60 for MRR, while this ratio increases from 1.60 to 2.75 for ARR. Similarly, the coordination number increases from 3.13 to 5.38 for ARR while remaining constant around 3 for MRR (Figure 6c,f). The mean pore shape factor increases from 0.045 to 0.052 for MRR while decreasing to 0.039 for ARR (Figure 6b,e). The pore and throat shape factor distributions (Figure 6) show that pores and pore throats with lower shape factor are disappearing for real volumes (Figure 6b), while in “fake” volumes, this shape factor distribution becomes heavier towards lower pore values and remains rather constant for pore throats. All other length related properties, like pore and throat radii, volumes and lengths, increase on average, both for ARR and MRR, although violin plots (Figure 6a–c,g,h) show that artificial volumes contain relatively more smaller pores and pore throats than MRR volumes. Additionally, Figure 6 shows that the amount of pore throats with the smallest possible throat radius (Figure 6g), equal to 1 voxel or the resolution, is much higher for ARR than for MRR.
Pore network property distributions comparing LR, HR, and SRM, as well as the cumulative distributions of these properties are shown in Figure 7. Furthermore, average values of pore network properties are summarized in Table 3. Compared to LR input, SRM contains almost as many pores and pore throats as the expected HR output does. At least, the ratio of pore throats per node is better represented. Further, all other properties, like coordination number and pore volumes as well as throat radii and lengths of SRM more closely represent HR data than the LR data. In addition to these mean values, violin plots and cumulative distributions (Figure 7) show that pore volumes (Figure 7a,d), throat lengths (Figure 7h,j) and radii (Figure 7g,i) and coordination numbers (Figure 7c,f) of SRM are more similar to HR than they are to input LR. Conversely, the pore shape factor mean and distribution remain more similar to LR despite the different pore counts (Figure 7b,e). Additionally, throat radii are larger in SRM than they are for HR, although they present an improvement compared to the larger radii in LR input.
Additional pore network properties which are not explicitly shown in this sections, like pore radii, throat volumes and throat shape factors are added as supplementary material (Supplementary Figure S1 for resolution influence and S2 for model validation), as each of these properties provides similar results to its pore or pore throat counterpart.

3.3. Porosity and Absolute Permeability

The influence of resolution on porosity, specific surface area (SSA) and absolute permeability estimated from pore network models, is shown in Table 4. With increasing resolution, porosity decreases slightly for MRR, from 0.26 to 0.23, while it remains constant for ARR. The specific pore surface area halves for MRR, while it only decreases up to 20% for ARR. Permeability is increasing with worsening resolution and this increase is more pronounced for MRR than for ARR.
The effect of super-resolution modelling (SRM) on porosity, SSA and permeability is shown in Table 5. These results show a consistent porosity overestimation between 9% and 13% compared to the expected HR data. However, permeability is better estimated by SRM than it was for LR, despite a remaining overestimation between 39% and 91%. LBM-simulated permeability closely matches PNM-derived permeability and a visualization of these models is shown in Figure 8. In this figure, the bottom row shows a 2D cross-section perpendicular to the flow direction and shows pores that are not transporting any fluids (Figure 8g–i). A larger fraction of pores is disconnected in (LR—Figure 8g) with higher fluid velocity in the largest pores, in comparison to the other two volumes. However, SRM shows additional pore connections and slightly higher fluid velocities compared to HR. In general, HR shows a low velocity zone at the borders of flow paths (Figure 8c,f,i), thus at the borders of pores, whereas these low velocity zones are less represented in LR. The SRM fits in between these two volumes as lower velocity zones are better represented, although fluid flow velocities tend to be higher than in HR (Figure 8b,e,h). The SSA is underestimated by approximately 10% in SRM in comparison with HR, but this is a serious improvement to the 40% underestimation in LR.

3.4. Unsaturated Flow

The influence of resolution on unsaturated flow is shown in Figure 9. This influence is most pronounced in the onset of moisture content increase at lower capillary pressures for the highest resolutions (Figure 9a,b). Maximal moisture is achieved at similar capillary pressures for all resolutions. The highest resolution sample has the highest saturated moisture content and this gradually decreases with worsening resolution. Furthermore, drying onsets more or less at the same capillary pressure, but shows the smoothest curve at the highest resolution. This highest resolution sample is also the last to be completely dry. Permeability follows a similar course to moisture increase as the onset of permeability increase occurs at lower capillary pressure for the highest resolution sample but levels out at the same capillary pressure (Figure 9c,d). However, despite lower saturated moisture content at the lowest resolutions, final permeability is higher at these low resolutions. All these observations are much less pronounced or even invisible for ARR (Figure 9 and Supplementary Figure S3).
Unsaturated flow properties for SRM validation are shown in Figure 10. During moisture uptake, moisture increases at lower capillary pressure, approximately −104.6 Pa, for SRM and HR data than for LR, where moisture starts collecting at approximately −104.3. This same observation is made during drying where drying starts sooner for LR than for HR and SRM reconstructions. However, saturated moisture content is highest for SRM and lowest for HR (Figure 10, Supplementary Figure S4, Table 6). Moisture permeability shows a similar pattern, in which permeability rises more rapidly for SRM and HR, while it is later for LR. In Table 6, quantitative values are shown to compare moisture permeabilities at maximal saturation and at the plateau between −108 to −106 Pa, which represents vapour permeability. This vapour permeability is overestimated by 27%–37% for SRM whereas it is better estimated by LR with a 8%–18% difference from HR estimates. In contrast, maximal permeability is better represented by SRM with overestimations of 71%–106%, while LR overestimated this permeability by 118%–270%.

3.5. Two-Phase Flow

Two-phase fluid flow simulations have been performed in two cycles, i.e., oil-flooding and water-flooding. The effect of resolution on these simulations is shown in Figure 11. Most of these profiles look similar over all resolutions, both for MRR (Figure 11a) and ARR (Figure 11b). However, the major difference is visible during water-flooding (oil extraction), where residual oil is significantly different for the different resolutions and the effect of MRR is clearly more pronounced, as shown in Figure 12.
The effect of two-phase flow on SRM is shown in Figure 13 for V1SRM, and other volumes are shown in the supplementary materials section (Supplementary Figure S5). In this image, drainage (oil-flooding) and imbibition (water-flooding) largely have similar profiles for the three samples (LR, HR and SRM), although the final amount of residual oil varies between 25% and 36% for the high resolution (HR) volumes, between 41% and 46 % for low resolution (LR) volumes, and between 32% and 35% for super-resolved models (SRM), as shown in Table 7. This results in relative overestimations between 15% and 40% for SRM, with one sample underestimating residual oil fraction by only 4%. This is less than the 15%–82% overestimations for LR. Furthermore, huge variability is observed for final water permeability after waterflooding, with only two of the four volumes having estimates of both LR and SRM within the range of HR. In these two cases, the SRM better predicted this value than the LR volumes, and the latter significantly underestimated this final water permeability. In the fourth volume, Krw appears severely overestimated in SRM, although here Krw, is almost non-existent for HR, LR, and SRM. Additional plots are shown in Supplementary Figure S5.

3.6. Training and Simulation Speed

The models trained approximately eight days on a user-grade NVIDIA GEFORCE GTX 1080 graphical processing unit (GPU) with 6800 training volumes and a batch size of four samples. After training, 1.73 volumes with dimensions 256 × 256 × 64 voxels could be simulated per second on this same GPU with a batch size of 1 sample. Processing these same volumes with solely a CPU rendered simulations much slower, taking 11 s for each 256 × 256 × 64 voxel volume.

4. Discussion

In this study, three-dimensional generative adversarial (neural) networks were used to achieve super-resolution CT scans. The three-dimensional results were analysed through pore network extraction and subsequent fluid flow simulations for single-phase, unsaturated and two-phase flow. Comparisons for fluid flow simulations are only possible by comparing to results from the highest resolution image because no experimental data is available. Therefore, it will be assumed that simulations at the highest resolution provide the most realistic and accurate results. This assumption is validated by observations made by Shah et al. [32] for two-phase flow and Arns et al. [20], Alyafei et al. [26,30], and Guan et al. [33] among others for single-phase flow. However, the influence of resolution on all studied parameters has been analysed at four different resolutions for the presently studied sample to put this super-resolution analysis in a framework and to understand how decaying resolution impacts each studied parameter.

4.1. Resolution Influence

The influence of reduced resolution has been studied for mechanical (MRR) and artificial (ARR) resolution reduction. The former is the result of either scanning larger samples or shifting the sample further from the X-ray source while keeping the source-detector distance constant. The latter, artificial resolution reduction, downsamples a sample scanned at a resolution of 4 µm through average voxel binning. ARR is interesting because it creates perfectly coupled volumes at several resolutions which is the ideal dataset for training a neural network, such as the super-resolution GAN used in this research. However, in order to deploy such SR-GANs to real situations, the training data should be representative of whatever input would be provided. Therefore, mechanical and artificial resolution decrease is compared to verify whether ARR sufficiently captures quality loss of actually scanned samples. Additionally, this study of the impact of resolution on fluid flow properties validates the possible need for super-resolution models.
A mechanical reduction in resolution reduces resolved porosity, even though this effect is more pronounced for carbonates [20,26,32]. This decrease was also seen here and even though while porosity decreased, permeability increased. This effect is rather contradictory, because resolution reduction should normally sever connections by smaller pores [26,29,30,31,33,36], but the pore network models actually join smaller pores together as larger pores, resulting in larger pore and throat radii and volumes [26,35]. This, in turn, results in higher permeability, as permeability is largely dependent on throat radii. Additionally, the microporous network did not appear to be restrictive to flow in this sample and increasing permeability with decreasing resolution was also mentioned by Zhang et al. [27], Keehm and Mukerji [34], and Ortega Ramírez et al. [35]. The artificially reduced resolution did not change porosity and permeability was only slightly impacted. This is because connectivity is much better retained during ARR than for MRR, as can be seen from Figure 6, the much higher coordination number in ARR (Figure 6f), and a disproportionate amount of pore throats for the amount of remaining nodes. This higher coordination number and throat-to-pore ratio for ARR is caused by the retention of thin, one-pixel width features at pore boundaries which are misclassified as pores and throats by the pore network extraction algorithm. This also causes the more accurately estimated specific surface area for ARR, although these one-pixel pores and pore throats are unrealistic artefacts from ARR. MRR has decreasing SSA because surface rugosity is lost with decreasing resolution.
During moisture absorption, higher resolution samples show faster uptake of moisture in the pore network because of the presence of smaller pores because Equation (1) shows that liquid will faster condense in smaller pores. During drying, the moisture profile (Figure 9a,b) is smoother at a higher resolution which suggests that overall smaller pores might be present, and a certain part of the larger pores is better shielded from the drying front by smaller pores which longer retain water (Equation (2)). This is the ink-bottle effect [143]. Moisture permeability follows the moisture uptake profile (Figure 9c,d) and permeability increases faster for higher resolution images during moisture absorption or decreases slower during drying. This effect is caused by the larger fraction of small pores (Figure 6a) which retain water but is also caused by the water absorbed on pore margins, which is better absorbed when pore margins are complex and contain crevices. These smaller pores and pore boundaries are better resolved at higher resolutions, as seen from the shape factor (Figure 6b,e) which is lower at better resolutions and the SSA which increases, both suggesting more complex pore boundaries. This allows fine pores and surface water to build and maintain a liquid backbone along which liquid water starts and keeps flowing. This liquid water has a much higher impact on total permeability than vapour. This absorbed water can be important in describing building materials as more water equals more corrosion, a higher risk for frost damage, and it forms a substrate for microbial build-up [17,19]. None of these things are desirable in a building stone, therefore the best possible description is required, which is obtained at higher resolutions [19]. Additionally, simulations to characterize moisture retention for groundwater analyses also benefit from using the most optimal resolution [29,36].
The evolution of relative permeability during two-phase flow is not heavily influenced by resolution (Figure 11), however, the amount of residual oil after oil drainage differs distinctly. This was also mentioned by Shah et al. [32]. Logically, whenever an oil reservoir is exploited, oil companies are more interested in how much oil can be extracted, thus this residual oil is an important characteristic. Studying a sample at a lower resolution (MRR), might result in a 44% more trapped oil: 36% of oil is trapped when scanning a sample at 12 µm, while instead 25% is trapped when studying exactly the same volume at 4 µm (Figure 12). This residual oil fraction is impacted by surface flow, in oil-wet pores, which is longer sustained when more pore boundary irregularities and crevices are present. These complexities are better resolved at higher resolution. Additionally, because some finely porous connections that possibly remained oil-wet were removed, snap-off events are more successful at trapping oil. Even though these observations cannot be directly translated to a two-phase brine-CO2 system, which is studied for the capillary trapping of CO2 [4,149], it can be seen that such major differences in trapping are important when analysing a reservoir for CO2 storage. Therefore, the impact of resolution is not negligible and the best possible resolution should be used for two-phase flow simulations [29,32,36].
The influence of ARR is much less pronounced than MRR. This is caused by the retention of pore complexities, such as small pore throats of one voxel across or relates to surface area, as seen from the decreasing shape factors (Figure 6b,e) and specific surface area. These small pores and pore complexities are responsible for better reproduction of the remaining oil fraction and the moisture uptake pattern, because small pores and surface complexities sustain oil flow over a longer water saturation range. Thus, ARR with simple voxel binning is incapable of reproducing realistic information loss that is observed with MRR. The same ARR technique was used by Keehm and Mukerji [34], Alyafei et al. [26], and Ortega Ramírez et al. [35] amongst others, but more complex methods, like that of Wang et al. [85], could mitigate this problem. However, to train neural networks it might be more desirable to work with different CT scans of one sample at different resolutions (MRR), because deployment to real situations better benefits from a well-trained network than from one trained on an easier problem. Therefore, this research prefers to train and validate the super-resolution GAN on two scans obtained at two different resolutions.
Additionally, this resolution study, even though it was only limited to one sample, has merit in research, as often, the impact of resolution is only studied, either for artificial resolution reduction [26,34,150] or for mechanically lower resolution but on different samples [20,30,151,152]. Only rarely was the effect of resolution studied on the same volume, but results and conclusions are consistent with other studies.

4.2. Super Resolution Models and Their Impact on Fluid Flow Simulation

Low resolution (LR) images were fed to a generative adversarial neural network to obtain images at a higher resolution thus artificially improving the resolution, also referred to as super-resolution models (SRM). Modelled results were compared to actual high resolution (HR) scans that match the LR input data, thus representing the “ground truth”. Visual simulation results show that smaller pores which are close to the resolution limit of the LR volume, are better resolved and high frequency noise that is visible in CT scans was not reproduced in SRM (Figure 4). Additionally, pore boundaries are better resolved, which is confirmed by better resolved specific surface area. Furthermore, all pore network properties, especially pore and throat count and pore and throat radius distributions are much closer to HR properties (Figure 7), although shape factor distributions (Figure 7b,e) still resemble the distribution of LR volumes and pores with lower shape factors are insufficiently reproduced. Total porosity is slightly overestimated in each volume, albeit only by a small fraction. This overestimation lies within the range of porosity distributions noted by Wang et al. [84] and is slightly higher than in Shams et al. [88].
Despite overestimation of total porosity, SRM better estimate all fluid flow properties than LR volumes do. Single-phase absolute permeability is better estimated by SRM than LR, although an overestimation between 39% and 91% remains, whereas this originally was 72%–171% for LR volumes. This better permeability estimation can be explained by the better representation of the smaller pore throats and LBM simulations show that additional connections and improved surface area contribute to more accurate predictions. The better predictions of SSA are reflected by fluid flow paths that are slowed down at pore boundaries by additional collisions on pore surface rugosity (Figure 8 h). Apart from this, additional connections that open up part of the pore network that was disconnected in LR better distributes fluid velocities (Figure 8h). This is seen from lower fluid flow velocities in larger pores of SRM (Figure 8b,e,h) than they are in LR (Figure 8a,d,g), thus closer representing HR (Figure 8c,f,i). However, the SRM still exaggerates fluid flow velocities compared to HR volumes. This overestimation is caused by slightly overestimated connectivity (Figure 8h,i) and pore surface rugosity that is underestimated (Figure 8), thus insufficiently slowing fluids down.
The onset of moisture absorption was better predicted in SRM than for LR and started at lower log(Pc) values (Figure 10). This lower Pc value suggests that smaller pores and pore throats are better represented in SRM. Despite the overestimated saturated moisture content, which is directly related to total porosity, moisture permeability evolution is better estimated for SRM and is closer to HR. This is related to the development of the liquid backbone through which fluids migrate, which is built at a lower capillary pressure, as it is in HR. Hence, the variation of moisture permeability with increasing (or decreasing) capillary pressure much more resembles the HR behaviour than the LR path (Figure 10). This early development of liquid backbone is dominated by the finer pores in the simulated volume, rather than pore boundary irregularities along which a water film could have formed. These pore surface irregularities are probably less significant because, despite a clear increase in specific surface area, shape factors of pores and pore throats are not much better represented in pore network models of SRM than they were in LR. Absorption-drying hysteresis is broader for SRM than it is for LR, much alike HR. This probably relates to a pore and throat size distribution that generally favours smaller pores, as opposed to LR (Figure 7a,g). These smaller pores improve the ink-bottle effect, thus delaying drying of larger pores [19,153]. As previously mentioned, the prediction of the absorption and drying aspects of a material are important to assess whether a material might be suitable for usage as construction material. These properties are best computed on digital material samples, as not one laboratory techniques covers the entire relevant capillary pressure spectrum [153,154,155] and analyses are often not reproducible between laboratories [12]. Therefore, such unsaturated models could benefit from the developed super-resolution workflow, although additional research is required to also represent the smallest pores because nanoporosity is relevant for construction material studies as well.
The evolution of relative permeabilities in two-phase flow (Figure 13) did not show significant variation with resolution and neither does it when comparing SRM, LR and HR volumes. If any similarities between the volumes ought to be noted, the SRM Kr,w pattern during primary water drainage most resembles the pattern observed in LR. However, the preceding discussion on resolution influence showed that major differences are noted in the remaining oil fraction, as was also noted by Shah et al. [32]. This remaining oil fraction is much better represented with a 4%–40% mismatch with HR, resulting in an average (n = 4) 33.73±1.23% remaining oil for SRM, while it would be 29.38±4.65% for HR, and 43.23±1.78% for LR (Table 7). This better estimated remaining oil fraction is explained by an oil-wetting backbone that sustains flow for a longer pressure range and maintains connections for pores which might otherwise be closed off by snap-off. This backbone remains because of better resolved smaller pores and possibly better resolved pore surfaces. However, this latter property was not well represented in the shape factors of SRM thus is probably less important than the smaller pores and better estimated pore and throat radii. Nevertheless, the higher SSA might be implied in smaller pores in the network, which could be segmented as if they are separate pores and pore throats, connected to a larger pore. This incorrect segmentation into pores and pore throats should, however, not be too pronounced in the used algorithm of Raeini et al. [55].
Generally, the SRM pore network approximates the HR pore network, although porosity is overestimated. Despite this overestimation, the SRM pore network is much more efficient at predicting fluid flow than LR is and closely represents HR. This shows that the proposed super-resolution method based on GANs could be interesting in post-processing CT scans in order to get more adequate fluid flow estimations of larger volumes. Moreover, once the GANs are well-trained, simulations are fast and can be performed on normal computers. However, it is expected that with an increasing gap in resolution between low- and high-resolution scans, the models could further overestimate porosity in some areas, as the “uncertain voxels”, i.e., those with grayscale values between porosity and matrix are more common. The neural network, which ends with a sigmoid activation layer attempts to make a decision between matrix and porosity allowing little room for uncertainty, therefore causing the small porosity overestimation. Additionally, more fine pores could be lost when the resolution gap increases, because at lower resolutions, smaller pores would be less visible, thus further challenging the neural network to learn how to super-resolve these fine pores.
The proposed super-resolution method fits within the group of techniques that attempts to mitigate or solve the resolution versus sample-size trade-off. Up to now, these super-resolution methods have not often received attention for geological applications and were mainly addressed by Wang et al. [82,83,85] and Wu et al. [75] who attempted classical super-resolution methods like neighbour embedding [75,82,156,157,158] and sparse representation [83,159], although Wang et al. [84,85] were also the first to use convolutional neural networks to address the super-resolution problem for geological materials. Compared to these networks, the presented research used deeper neural networks, an encoder-decoder architecture with residual connections and generative training to better conform to approaches in recent super-resolution literature [93,96,100]. Additionally, Shams et al. [88] were the first to use a GAN to solve the super-resolution problem and worked directly on segmented images, of which the low resolution images were artificially prepared. Furthermore, other super-resolution studies checked the adequacy of their models with structural parameters like peak signal to noise ratio and structural similarity. However, the goal of super-resolved models is to improve fluid flow predictions and therefore this research verified that the developed SR models had improved fluid flow predictions over LR significantly and they did so for unsaturated flow and one or two-phase saturated flow.

4.3. Limitations and Future Perspectives

There are some limitations to this work that should be addressed in future research. We address three of them. Further, general drawbacks on the use of neural networks are addressed too. Firstly, this work provides a proof-of-concept study, which is why only one sample was tested and both training and validation data are derived from the same sample although at different locations within the sample. In future steps, this should be expanded to be able to use this workflow on unseen samples by creating a CT library. In order to do this, the challenge of grayscale variability between scans and machine related noise should be overcome. Even though the neural network architecture was optimized for this, by using instance normalization instead of batch normalization, data augmentation by grayscale and contrast variation during training could generalize the trained networks. However, the severely increased amount of data forces the usage of supercomputers with AI dedicated GPUs, whereas training on one sample was possible on a standard workstation. Once the network is trained, it could again be used on a standard computer. Secondly, the step from 12 µm to 4 µm is small albeit significant. Further steps should include the addition of higher resolution methods, like FIB-SEM. However, it should be ensured that sufficient overlap between scales remains. Thirdly, this research presents quite a simple GAN which requires supervised learning, thus needs matched datasets. The usage of cycle-GANs would allow for unsupervised learning and is promising for super-resolution applications for CT [107]. However, these cycle-GANs would require a sufficiently large GPU to train, as two GANs are trained simultaneously [107]. Furthermore, hierarchical GANs are promising in training efficiency and if a strategic sampling workflow is applied, new training data could be introduced during each increment of these hierarchical GANs [109,160].
Even though neural networks, and more particularly, generative adversarial neural networks (GAN), prove to be promising, some challenges and drawbacks were identified. Firstly, neural networks present a black-box approach, which makes it harder to identify why certain things can go wrong, like the overestimation of porosity in this research. Secondly, related to this black-box, GAN training can be unstable and sometimes it is hard to find a solution for this. Even though Radford et al. [130] provide very good suggestions to overcome training instability, building the networks of this research showed that a lower learning rate for the discriminator (10−5 instead of 10−4) was essential to overcome the problem that the low and high resolution images show similar structures. This similarity issue also required the use of a network that is not too deep and that contains short-range residual skips in order to avoid gradient loss. Additionally, batches that are fed to the discriminator could be shuffled to introduce additional randomization. Despite these suggestions, the models remain a “best guess” and imperfections, like the overestimation of porosity indicate that improvements are still needed. Most likely, this could be improved by introducing larger training datasets and image augmentation, although training such networks could not be done on a user-grade desktop, like used in this research.

5. Conclusions

In this paper, a super-resolution method based on generative adversarial networks is used to improve the resolution of CT scans with the goal to obtain better fluid flow simulations. First a small study verified the impact of resolution on the pore network and on the studied fluid flow properties. In general, a lower resolution results in a decreased count of pores and pore throats, while also increasing the average pore and throat sizes. Absolute single-phase permeability is overestimated severely with worsening resolution, despite constant porosity. This is a result of a lower specific surface area (SSA) and generally larger pores and pore throats. The effect of resolution on unsaturated permeability is mainly distinct in the lower capillary pressure range where moisture content and permeability start to increase at lower capillary pressures when higher resolution volumes are used. This is the result of a liquid backbone originating in the finest pores and on pore surfaces, where liquids are best captured within surface irregularities. This effect of such liquid backbone is also produced in two-phase simulations, where a wetting layer will remain in fine pores and pore surface irregularities, allowing more oil extraction during waterflooding thus resulting in decreased remaining oil fraction with improving resolution. In general, the effect of resolution is less marked in volumes with artificially reduced resolution. Therefore, in this research, neural networks are trained using samples effectively scanned at various resolutions.
The applied super-resolution method succeeds in generating visually more appealing results. Furthermore, the simulated volumes have a more realistic pore network with more pores and pore throats, compared to the low-resolution input. Additionally, smaller pores and pore throats are better characterized, although shape factors of the modelled pores are not yet approximating those of the high-resolution input, despite a clear increase in specific surface area. Single-phase fluid flow simulations show that the models present a significant improvement over low resolution input volumes. Visualization of such fluid flow shows that better connectivity, albeit overestimated, more realistically distributes fluid flow velocities and the higher surface area slows down fluids at pore boundaries. Moreover, unsaturated flow is better represented, especially in the lower capillary pressure range, where the onset of moisture uptake and the increase of moisture permeability is better predicted in super-resolved models in comparison to low resolution input. Moreover, saturated moisture permeability is better predicted despite overestimated saturated moisture content. Ultimately, two-phase flow simulations show that even though the relative permeability evolution with water fraction has not clearly changed, the remaining oil fraction is much better predicted in super-resolved models than it was in low resolution input. The improved fluid flow characteristics of all fluid transport, whether it is saturated or unsaturated single-phase flow or two-phase fluid flow are related to a better representation of the pore network and better representation of pore and throat boundary irregularities.
The applied super-resolution method could therefore be interesting as a pre-processing step in a fluid flow study, where a GAN is adequately trained to capture multiple cases. This procedure would allow researchers to take scans at lower resolutions, allowing to use larger samples or save a lot of scanning time, and then artificially increase the resolution. After a GAN is trained, potentially on a GPU-dedicated computing node of a supercomputer, it does not require heavy computing capacities to apply the super-resolution procedure on samples. However, caution is required when training a GAN, and therefore the following suggestions were made: (1) use a lower learning rate for discriminator, (2) avoid gradient loss by not making networks too deep, (3) add short-range residual skips, and (4) try to shuffle discriminator batches to increase randomization and thus stabilize training.

Supplementary Materials

The following are available online at https://www.mdpi.com/1996-1944/13/6/1397/s1, Figure S1: Pore network properties for influence of resolution, Figure S2: Pore network properties for super-resolution model validation, Figure S3: Influence of resolution on unsatured fluid flow, Figure S4: Super-resolution model validation for unsaturated fluid flow, Figure S5: Influence of resolution and super-resolution models on two-phase flow models.

Author Contributions

Conceptualization, N.J., M.H. and R.S.; Data curation, N.J.; Formal analysis, N.J.; Funding acquisition, N.J. and R.S.; Investigation, N.J.; Methodology, N.J.; Project administration, N.J.; Resources, R.S.; Supervision, M.H. and R.S.; Validation, N.J.; Writing—original draft, N.J.; Writing—review & editing, N.J., M.H. and R.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Fonds Wetenschappelijk Onderzoek, grant number 1S43318N.

Acknowledgments

The authors thank Steven Claes, Muhammad Islahuddin and Hans Janssen for supplying the OpenFOAM based code which was used to model unsaturated flow. Furthermore, Martin Blunt and his research group is thanked for supplying open access to their pore network extraction algorithms and their two-phase flow solvers. Finally, the three anonymous reviewers are thanked for their valuable comments to improve this contribution.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Stappen, J.; Van de Kock, T.; Boone, M.A.; Olaussen, S.; Cnudde, V. Pore-scale characterisation and modelling of CO2flow in tight sandstones using X-ray micro-CT.; Knorringfjellet formation of the longyearbyen CO2lab, Svalbard. Nor. J. Geol. 2014, 94, 201–215. [Google Scholar]
  2. Andrew, M.; Menke, H.; Blunt, M.J.; Bijeljic, B. The Imaging of Dynamic Multiphase Fluid Flow Using Synchrotron-Based X-ray Microtomography at Reservoir Conditions. Transp. Porous Media 2015, 110, 1–24. [Google Scholar] [CrossRef] [Green Version]
  3. Menke, H.P.; Bijeljic, B.; Andrew, M.G.; Blunt, M.J. Dynamic three-dimensional pore-scale imaging of reaction in a carbonate at reservoir conditions. Environ. Sci. Technol. 2015, 49, 4407–4414. [Google Scholar] [CrossRef] [Green Version]
  4. Bachu, S. CO2 storage in geological media: Role, means, status and barriers to deployment. Prog. Energy Combust. Sci. 2008, 34, 254–273. [Google Scholar] [CrossRef]
  5. Metz, B.; Davidson, O.; de Coninck, H.; Loos, M.; Meyer, L. The IPCC Special Report on Carbon Dioxide Capture and Storage; Cambridge University Press: Cambridge, UK, 2005; ISBN 9608758424. [Google Scholar]
  6. Herzog, H.; Caldeira, K.; Reilly, J. An issue of permanence: Assessing the effectiveness of temporary carbon storage. Clim. Chang. 2003, 59, 293–310. [Google Scholar] [CrossRef]
  7. Valvatne, P.H.; Blunt, M.J. Predictive pore-scale modeling of two-phase flow in mixed wet media. Water Resour. Res. 2004, 40, 1–21. [Google Scholar] [CrossRef] [Green Version]
  8. Al-Kharusi, A.S.; Blunt, M.J. Multiphase flow predictions from carbonate pore space images using extracted network models. Water Resour. Res. 2008, 44, 1–14. [Google Scholar] [CrossRef] [Green Version]
  9. Blunt, M.J.; Bijeljic, B.; Dong, H.; Gharbi, O.; Iglauer, S.; Mostaghimi, P.; Paluszny, A.; Pentland, C. Pore-scale imaging and modelling. Adv. Water Resour. 2013, 51, 197–216. [Google Scholar] [CrossRef] [Green Version]
  10. Islahuddin, M.; Janssen, H. Hygric property estimation of porous building materials with multiscale pore structues. Energy Procedia 2017, 132, 273–278. [Google Scholar] [CrossRef] [Green Version]
  11. Janssen, H.; Vereecken, E.; Holúbek, M. A confrontation of two concepts for the description of the over-capillary moisture range: Air entrapment versus low capillarity. Energy Procedia 2015, 78, 1490–1494. [Google Scholar] [CrossRef] [Green Version]
  12. Roels, S.; Carmeliet, J.; Hens, H.; Adan, O.; Brocken, H.; Cerny, R.; Pavlik, Z.; Hall, C.; Kumaran, K.; Pel, L.; et al. Interlaboratory Comparison of Hygric Properties of Porous Building Materials. J. Therm. Envel. Build. Sci. 2004, 27, 307–325. [Google Scholar] [CrossRef]
  13. Arns, J.; Sheppard, A.P.; Arns, C.H.; Knackstedt, M.A.; Yelkhovsky, A.; Pinczewski, W.V. Pore-level validation of representative pore networks obtained from micro-CT images. In Proceedings of the Annual Symposium of the Society of Core Analysis, Calgary, Canada, 10–12 September 2007; p. 12. [Google Scholar]
  14. Knackstedt, M.; Jaime, P.; Butcher, A.R.; Botha, P.W.S.K.; Middleton, J.; Sok, R. Integrating reservoir characterization: 3D dynamic, petrophysical and geological description of reservoir facies. In Proceedings of the SPE Asia Pacific Oil & Gas Conference and Exhibition, Brisbane, Queensland, Australia, 18–20 October 2010; pp. 1–9. [Google Scholar]
  15. Hemes, S.; Desbois, G.; Urai, J.L.; De Craen, M.; Honty, M. Variations in the morphology of porosity in the Boom Clay Formation: Insights from 2D high resolution BIB-SEM imaging and Mercury injection Porosimetry. Neth. J. Geosci. 2013, 92, 275–300. [Google Scholar] [CrossRef] [Green Version]
  16. Keller, L.M.; Schuetz, P.; Erni, R.; Rossell, M.D.; Lucas, F.; Gasser, P.; Holzer, L. Characterization of multi-scale microstructural features in Opalinus Clay. Microporous Mesoporous Mater. 2013, 170, 83–94. [Google Scholar] [CrossRef]
  17. Janssen, H. Simulation efficiency and accuracy of different moisture transfer potentials. J. Build. Perform. Simul. 2014, 7, 379–389. [Google Scholar] [CrossRef]
  18. De Kock, T.; Boone, M.A.; De Schryver, T.; Van Stappen, J.; Derluyn, H.; Masschaele, B.; De Schutter, G.; Cnudde, V. A pore-scale study of fracture dynamics in rock using X-ray micro-CT under ambient freeze-thaw cycling. Environ. Sci. Technol. 2015, 49, 2867–2874. [Google Scholar] [CrossRef]
  19. Islahuddin, M.; Janssen, H. Pore-Structure-Based Determination of Unsaturated Hygric Properties of Porous Materials. Transp. Porous Media 2019, 130, 675–698. [Google Scholar] [CrossRef]
  20. Arns, C.; Bauget, F.; Sakellariou, A.; Senden, T.J.; Sheppard, A.P.; Sok, R.M.; Pinczewski, V.; Bakke, S.; Berge, L.I.; Oren, P.E.; et al. Pore Scale Characterization of Carbonates Using X-ray Microtomography. SPE J. 2005, 2005, 475–484. [Google Scholar] [CrossRef]
  21. Wildenschild, D.; Hopmans, J.W.; Rivers, M.L.; Kent, A.J.R. Quantitative analysis of flow processes in a sand using synchrotron-based X-ray microtomography. Vadose Zone J. 2005, 4, 112–126. [Google Scholar] [CrossRef]
  22. Wildenschild, D.; Sheppard, A.P. X-ray imaging and analysis techniques for quantifying pore-scale structure and processes in subsurface porous medium systems. Adv. Water Resour. 2013, 51, 217–246. [Google Scholar] [CrossRef]
  23. Bultreys, T.; Van Hoorebeke, L.; Cnudde, V. Multi-scale, micro-computed tomography-based pore network models to simulate drainage in heterogeneous rocks. Adv. Water Resour. 2015, 78, 36–49. [Google Scholar] [CrossRef]
  24. Cnudde, V.; Boone, M.N. High-resolution X-ray computed tomography in geosciences: A review of the current technology and applications. Earth Sci. Rev. 2013, 123, 1–17. [Google Scholar] [CrossRef] [Green Version]
  25. Ketcham, R.; Carlson, W.D. Acquisition, optimization and interpretation of x-ray computed tomographic imagery: Applications to the geosciences. Comput. Geosci. 2001, 27, 381–400. [Google Scholar] [CrossRef]
  26. Alyafei, N.; Raeini, A.Q.; Paluszny, A.; Blunt, M.J. A sensitivity study of the effect of image resolution on predicted petrophysical properties. Transp. Porous Media 2015, 110, 157–169. [Google Scholar] [CrossRef]
  27. Zhang, D.; Zhang, R.; Chen, S.; Soll, W.E. Pore scale study of flow in porous media: Scale dependency, REV, and statistical REV. Geophys. Res. Lett. 2000, 27, 1195–1198. [Google Scholar] [CrossRef]
  28. Bear, J.; Bachmat, Y. Introduction to Modeling of Transport Phenomena in Porous Media; Kluwer Academic Publishers: Dordrecht, The Netherlands, 1990; ISBN 0792305574. [Google Scholar]
  29. Thakur, M.M.; Penumadu, D.; Bauer, C. Capillary Suction Measurements in Granular Materials and Direct Numerical Simulations Using X-ray Computed Tomography Microstructure. J. Geotech. Geoenviron. Eng. 2020, 146, 1–13. [Google Scholar]
  30. Alyafei, N.; Gharbi, O.; Raeini, A.Q.; Yang, J.; Iglauer, S.; Blunt, M.J. Influence of micro-computed tomography image resolution on the predictions of petrophysical properties. In Proceedings of the Society of Petroleum Engineers-International Petroleum Technology Conference 2013, IPTC 2013: Challenging Technology and Economic Limits to Meet the Global Energy Demand, Beijing, China, 26–28 March 2013; pp. 1291–1298. [Google Scholar]
  31. Takbiri-Borujeni, A.; Lane, N.M.; Thompson, K.; Tyagi, M. Effects of image resolution and numerical resolution on computed permeability of consolidated packing using LB and FEM pore-scale simulations. Comput. Fluids 2013, 88, 753–763. [Google Scholar] [CrossRef]
  32. Shah, S.M.; Gray, F.; Crawshaw, J.P.; Boek, E.S. Micro-computed tomography pore-scale study of flow in porous media: Effect of voxel resolution. Adv. Water Resour. 2016, 95, 276–287. [Google Scholar] [CrossRef] [Green Version]
  33. Guan, K.M.; Nazarova, M.; Guo, B.; Tchelepi, H.; Kovscek, A.R.; Creux, P. Effects of image resolution on sandstone porosity and permeability as obtained from X-ray microscopy. Transp. Porous Media 2019, 127, 233–245. [Google Scholar] [CrossRef]
  34. Keehm, Y.; Mukerji, T. Permeability and relative permeability from digital rocks: Issues on grid resolution and representative elementary volume. In Proceedings of the SEG International Exposition and 74th Annual Meeting, Denver, CO, USA, 10–15 October 2004; pp. 1–3. [Google Scholar]
  35. Ortega Ramírez, M.P.; Oxarango, L.; Strozzi, A.G. Effect of X-ray CT resolution on the quality of permeability computation for granular soils: Definition of a criterion based on morphological properties. Soil Res. 2019, 57, 589–600. [Google Scholar] [CrossRef]
  36. Thakur, M.M.; Penumadu, D. Sensitivity analysis of pore morphology method and X-ray CT imaging in SWCC predictions for Ottawa Sand. In Advances in Computer Methods and Geomechanics. Lecture Notes in Civil Engineering; Prashant, A., Sachan, A., Desai, C., Eds.; Springer: Singapore, 2020. [Google Scholar]
  37. Bear, J. Dynamics of Fluids in Porous Media; American Elsevier: New York, NY, USA, 1972. [Google Scholar]
  38. Rozenbaum, O.; Du Roscoat, S.R. Representative elementary volume assessment of three-dimensional x-ray microtomography images of heterogeneous materials: Application to limestones. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 2014, 89, 1–11. [Google Scholar] [CrossRef] [Green Version]
  39. Mostaghimi, P.; Blunt, M.J.; Bijeljic, B. Computations of absolute permeability on micro-CT images. Math. Geosci. 2013, 45, 103–125. [Google Scholar] [CrossRef]
  40. Desbois, G.; Urai, J.L.; Hemes, S.; Schröppel, B.; Schwarz, J.O.; Mac, M.; Weiel, D. Multi-scale analysis of porosity in diagenetically altered reservoir sandstone from the Permian Rotliegend (Germany). J. Pet. Sci. Eng. 2016, 140, 128–148. [Google Scholar] [CrossRef]
  41. Sok, R.; Varslot, T.; Ghous, A.; Latham, S.; Sheppard, A.P.; Knackstedt, M.A. Pore scale characterization of carbonates at multiple scales: Integration of micro-CT, BSEM, and FIBSEM. Petrophysics 2010, 51, 379–387. [Google Scholar]
  42. Grader, A.S.; Clark, A.B.S.; Al-Dayyani, T.; Nur, A. Computations of porosity and permeability of sparic carbonate using multi-scale CT images. In Proceedings of the International Symposium of the Society of Core Analysts, Noordwijk aan Zee, The Netherlands, 27–30 September 2009; p. 10. [Google Scholar]
  43. Pamukcu, A.S.; Guilherme, A.R. Quantitative 3D petrography using X-ray tomography 2: Combining information at various resolutions. Geosphere 2010, 6, 775–781. [Google Scholar] [CrossRef]
  44. Prodanović, M.; Mehmani, A.; Sheppard, A.P. Imaged-based multiscale network modelling of microporosity in carbonates. Geol. Soc. Lond. Spec. Publ. 2014, 406, 95–113. [Google Scholar] [CrossRef]
  45. Tahmasebi, P.; Kamrava, S. Rapid multiscale modeling of flow in porous media. Phys. Rev. E 2018, 98, 1–13. [Google Scholar] [CrossRef] [Green Version]
  46. Mehmani, A.; Prodanović, M. The effect of microporosity on transport properties in porous media. Adv. Water Resour. 2014, 63, 104–119. [Google Scholar] [CrossRef]
  47. Jiang, Z.; Van Dijke, M.I.J.; Sorbie, K.S.; Couples, G.D. Representation of multiscale heterogeneity via multiscale pore networks. Water Resour. Res. 2013, 49, 5437–5449. [Google Scholar] [CrossRef]
  48. Yao, J.; Wang, C.; Yang, Y.; Wang, X. Upscaling of carbonate rocks from micropore scale to core scale. Int. J. Multiscale Comput. Eng. 2013, 11, 497–504. [Google Scholar] [CrossRef]
  49. Moctezuma, A.; Békri, S.; Laroche, C.; Vizika, O. A Dual Network Model for Relative Permeability of Bimodal Rocks: Application in a Vuggy Carbonate. In Proceedings of the International Symposium of the Society of Core Analysts, Pau, France, 21–24 September 2003; pp. 1–13. [Google Scholar]
  50. Békri, S.; Laroche, C.; Vizika, O. Pore Network Models To Calculate Transport and Electrical Properties of Single or Dual-Porosity Rocks. In Proceedings of the International Symposium of the Society of Core Analysts, Toronto, Canada, 21–25 August 2005; pp. 1–16. [Google Scholar]
  51. Youssef, S.; Rosenberg, E.; Gland, N.; Kenter, J.A.M.; Skalinski, M.; Vizika, O. High resolution CT and pore-network models to assess petrophysical properties of homogeneous and heterogeneous carbonates. In Proceedings of the SPE/EAGE Reservoir Characterization and Simulation Conference, Abu Dhabi, UAE, 28–31 October 2007; pp. 280–291. [Google Scholar]
  52. Bauer, D.; Youssef, S.; Fleury, M.; Bekri, S.; Rosenberg, E.; Vizika, O. Improving the estimations of petrophysical transport behavior of carbonate rocks using a dual pore network approach combined with computed microtomography. Transp. Porous Media 2012, 94, 505–524. [Google Scholar] [CrossRef]
  53. De Vries, E.T.; Raoof, A.; Van Genuchten, M. Advances in Water Resources Multiscale modelling of dual-porosity porous media; A computational pore-scale study for flow and solute transport. Adv. Water Resour. 2017, 105, 82–95. [Google Scholar] [CrossRef]
  54. Dong, H.; Blunt, M.J. Pore-network extraction from micro-computerized-tomography images. Phys. Rev. E 2009, 80, 036307. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Raeini, A.Q.; Bijeljic, B.; Blunt, M.J. Generalized network modeling: Network extraction as a coarse-scale discretization of the void space of porous media. Phys. Rev. E 2017, 96, 1–17. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Øren, P.E.; Bakke, S.; Arntzen, O.J. Extending Predictive Capabilities to Network Models. SPE J. 1998, 3, 324–335. [Google Scholar] [CrossRef]
  57. Wu, K.; Nunan, N.; Crawford, J.W.; Young, I.M.; Ritz, K. An efficient Markov Chain Model for the Simulation of Heterogeneous Soil Structure. Soil Sci. Soc. Am. J. 2004, 68, 346–351. [Google Scholar] [CrossRef]
  58. Gerke, K.M.; Karsanina, M.V.; Mallants, D. Universal stochastic multiscale image fusion: An example application for shale rock. Sci. Rep. 2015, 5, 1–12. [Google Scholar] [CrossRef] [Green Version]
  59. Yao, J.; Wang, C.; Yang, Y.; Hu, R.; Wang, X. The construction of carbonate digital rock with hybrid superposition method. J. Pet. Sci. Eng. 2013, 110, 263–267. [Google Scholar] [CrossRef]
  60. Karsanina, M.V.; Gerke, K.M.; Skvortsova, E.B.; Ivanov, A.L.; Mallants, D. Enhancing image resolution of soils by stochastic multiscale image fusion. Geoderma 2018, 314, 138–145. [Google Scholar] [CrossRef]
  61. Karsanina, M.V.; Gerke, K.M. Hierarchical optimization: Fast and robust multiscale stochastic reconstructions with rescaled correlation functions. Phys. Rev. Lett. 2018, 121, 1–6. [Google Scholar] [CrossRef]
  62. Bakke, S.; Øren, P.-E. 3-D Pore-Scale Modelling of Sandstones and Flow Simulations in the Pore Networks. SPE J. 1997, 2, 136–149. [Google Scholar] [CrossRef] [Green Version]
  63. Quiblier, J.A. A new three-dimensional modeling technique for studying porous media. J. Colloid Interface Sci. 1984, 98, 84–102. [Google Scholar] [CrossRef]
  64. Caers, J. A General Algorithm for Building 3D Spatial Laws from Lower Dimensional Structural Information; Stanford University: Main Quad, CA, USA, 2006. [Google Scholar]
  65. Jiao, Y.; Stillinger, F.H.; Torquato, S. Modeling heterogeneous materials via two-point correlation functions. II. Algorithmic details and applications. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 2008, 77, 1–35. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Hasanabadi, A.; Baniassadi, M.; Abrinia, K.; Safdari, M.; Garmestani, H. 3D microstructural reconstruction of heterogeneous materials from 2D cross sections: A modified phase-recovery algorithm. Comput. Mater. Sci. 2016, 111, 107–115. [Google Scholar] [CrossRef]
  67. Izadi, H.; Baniassadi, M.; Hormozzade, F.; Dehnavi, F.N.; Hasanabadi, A.; Memarian, H.; Soltanian-Zadeh, H. Effect of 2D Image Resolution on 3D Stochastic Reconstruction and Developing Petrophysical Trend. Transp. Porous Media 2018, 125, 41–58. [Google Scholar] [CrossRef]
  68. Okabe, H.; Blunt, M.J. Pore space reconstruction using multiple-point statistics. J. Pet. Sci. Eng. 2005, 46, 121–137. [Google Scholar] [CrossRef]
  69. Hajizadeh, A.; Safekordi, A.; Farhadpour, F. A multiple-point statistics algorithm for 3D pore space reconstruction from 2D images. Adv. Water Resour. 2011, 34, 1256–1267. [Google Scholar] [CrossRef]
  70. Ding, K.; Teng, Q.; Wang, Z.; He, X.; Feng, J. Improved multipoint statistics method for reconstructing three-dimensional porous media from a two-dimensional image via porosity matching. Phys. Rev. E 2018, 97, 1–10. [Google Scholar] [CrossRef]
  71. Comunian, A.; Renard, P.; Straubhaar, J. 3D multiple-point statistics simulation using 2D training images. Comput. Geosci. 2012, 40, 49–65. [Google Scholar] [CrossRef] [Green Version]
  72. Soete, J.; Claes, S.; Claes, H.; Janssens, N.; Cnudde, V.; Huysmans, M.; Swennen, R. Lattice Boltzmann Simulations of fluid flow in continental carbonate reservoir rocks and in upscaled rock models generated with multiple-point geostatistics. Geofluids 2017, 1–24. [Google Scholar] [CrossRef] [Green Version]
  73. Okabe, H.; Blunt, M.J. Pore space reconstruction of vuggy carbonates using microtomography and multiple-point statistics. Water Resour. Res. 2007, 43, 3–7. [Google Scholar] [CrossRef]
  74. Tahmasebi, P.; Javadpour, F.; Sahimi, M.; Piri, M. Multiscale study for stochastic characterization of shale samples. Adv. Water Resour. 2016, 89, 91–103. [Google Scholar] [CrossRef]
  75. Wu, Y.; Tahmasebi, P.; Lin, C.; Ren, L.; Dong, C. Multiscale modeling of shale samples based on low- and high-resolution images. Mar. Pet. Geol. 2019, 109, 9–21. [Google Scholar] [CrossRef]
  76. Lemmens, L.; Rogiers, B.; Jacques, D.; Huysmans, M.; Swennen, R.; Urai, J.L.; Desbois, G.; Laloy, E. Nested multiresolution hierarchical simulated annealing algorithm for porous media reconstruction. Phys. Rev. E 2019, 100, 1–21. [Google Scholar] [CrossRef] [PubMed]
  77. Campaigne, W.R.; Fieguth, P.W. Frozen-State Hierarchical Annealing. IEEE Trans. Image Process. 2013, 22, 1486–1497. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Pant, L.M.; Berkeley, L.; Secanell, M. Multigrid hierarchical simulated annealing method for reconstructing heterogeneous media A Multigrid Hierarchical Simulated Annealing Method for Reconstructing. Phys. Rev. E 2015, 92, 1–12. [Google Scholar] [CrossRef] [PubMed]
  79. Mariethoz, G.; Renard, P.; Straubhaar, J. Extrapolating the fractal characteristics of an image using scale-invariant multiple-point statistics. Math. Geosci. 2011, 43, 783–797. [Google Scholar] [CrossRef] [Green Version]
  80. Plenge, E.; Poot, D.H.J.; Niessen, W.J.; Meijering, E. Super-Resolution reconstruction using cross-scale self-similarity in multi-slice MRI. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention-MICCAI, Nagoya, Japan, 22–26 September 2013; Springer: Berlin/Heidelberg, Germany, 2013; pp. 123–130. [Google Scholar]
  81. Glasner, D.; Bagon, S.; Irani, M. Super-Resolution from a Single Image. In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan, 29 September–2 October 2009; pp. 349–356. [Google Scholar]
  82. Wang, Y.; Rahman, S.S.; Arns, C.H. Super resolution reconstruction of µ -CT image of rock sample using neighbour embedding algorithm. Physica A 2018, 493, 177–188. [Google Scholar] [CrossRef]
  83. Wang, Y.; Arns, J.Y.; Rahman, S.S.; Arns, C.H. Three-dimensional porous structure reconstruction based on structural local similarity via sparse representation on micro-computed-tomography images. Phys. Rev. E 2018, 98, 1–16. [Google Scholar] [CrossRef]
  84. Wang, Y.; Arns, C.H.; Rahman, S.S.; Arns, J. Porous structure reconstruction using convolutional neural networks. Math. Geosci. 2018, 50, 781–799. [Google Scholar] [CrossRef]
  85. Wang, Y.; Teng, Q.; He, X.; Feng, J.; Zhang, T. CT-image of rock samples super resolution using 3D convolutional neural network. Comput. Geosci. 2019, 133, 1–11. [Google Scholar] [CrossRef] [Green Version]
  86. Dong, C.; Loy, C.C.; He, K.; Tang, X. Image Super-Resolution Using Deep Convolutional Networks. IEEE Trans. Pattern Anal. Mach. Intell. 2016, 38, 295–307. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  87. Ledig, C.; Theis, L.; Huszár, F.; Caballero, J.; Cunningham, A.; Acosta, A.; Aitken, A.; Tejani, A.; Totz, J.; Wang, Z.; et al. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 105–114. [Google Scholar]
  88. Shams, R.; Masihi, M.; Boozarjomehry, R.B.; Blunt, M.J. Coupled generative adversarial and auto-encoder neural networks to reconstruct three-dimensional multi-scale porous media. J. Pet. Sci. Eng. 2020, 186, 1–15. [Google Scholar] [CrossRef]
  89. Latief, F.D.E.; Fauzi, U.; Irayani, Z.; Dougherty, G. The effect of X-ray micro computed tomography image resolution on flow properties of porous rocks. J. Microsc. 2017, 266, 69–88. [Google Scholar] [CrossRef]
  90. Fukushima, K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybermetics 1980, 36, 193–202. [Google Scholar] [CrossRef] [PubMed]
  91. Weng, J.J.; Ahuja, N.; Huang, T.S. Learning recognition and segmentation of 3-D objects from 2-D images. In Proceedings of the 1993 IEEE 4th International Conference on Computer Vision, Berlin, Germany, 11–14 May 1993; pp. 121–127. [Google Scholar]
  92. Lecun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef] [PubMed]
  93. Dong, C.; Loy, C.C.; He, K.; Tang, X. Learning a deep convolutional network for image super-resolution. In Proceedings of the Lecture Notes in Computer Science, Zurich, Switzerland, 6–12 September 2014; Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T., Eds.; Springer: Cham, Switzerland, 2014; Volume 8692, pp. 184–199. [Google Scholar]
  94. Dong, C.; Loy, C.C.; Tang, X. Accelerating the super-resolution convolutional neural network. In Proceedings of the Lecture Notes in Computer Science, Amsterdam, The Netherlands, 11–14 October 2016; Volume 9906, pp. 391–407. [Google Scholar]
  95. Kim, J.; Lee, J.K.; Lee, K.M. Accurate Image Super-Resolution Using Very Deep Convolutional Networks. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas Valley, NV, USA, 26 June–1 July 2016; pp. 1646–1654. [Google Scholar]
  96. Mao, X.J.; Shen, C.; Yang, B.Y. Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain, 5–10 December 2016; pp. 2810–2818. [Google Scholar]
  97. Kupyn, O.; Budzan, V.; Mykhailych, M.; Mishkin, D.; Matas, J. DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–22 June 2018; pp. 8183–8192. [Google Scholar]
  98. Chang, Y.; Luo, B. Bidirectional convolutional LSTM neural network for remote sensing image super-resolution. Remote Sens. 2019, 11, 1–18. [Google Scholar] [CrossRef]
  99. Liebel, L.; Körner, M. Single-image super resolution for multispectral remote sensing data using convolutional neural networks. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences-ISPRS Archives, Prague, Czech Republic, 12–19 July 2016; Volume 41, pp. 883–890. [Google Scholar]
  100. Kaji, S.; Kida, S. Overview of image-to-image translation by use of deep neural networks: Denoising, super-resolution, modality conversion, and reconstruction in medical imaging. Radiol. Phys. Technol. 2019, 12, 235–248. [Google Scholar] [CrossRef] [Green Version]
  101. Chen, Y.; Shi, F.; Christodoulou, A.G.; Xie, Y.; Zhou, Z.; Li, D. Efficient and accurate MRI super-resolution using a generative adversarial network and 3D multi-level densely connected network. In Proceedings of the Lecture Notes in Computer Science, Grenada, Spain, 16–20 September 2018; Frangi, A., Schnabel, J., Davatzikos, C., Alberola-López, C.F.G., Eds.; Springer: Cham, Switzerland, 2018; Volume 11070, pp. 91–99. [Google Scholar]
  102. Pham, C.H.; Tor-Díez, C.; Meunier, H.; Bednarek, N.; Fablet, R.; Passat, N.; Rousseau, F. Multiscale brain MRI super-resolution using deep 3D convolutional networks. Comput. Med. Imaging Graph. 2019, 77, 1–15. [Google Scholar] [CrossRef] [Green Version]
  103. Umehara, K.; Ota, J.; Ishimaru, N.; Ohno, S.; Okamoto, K.; Suzuki, T.; Shirai, N.; Ishida, T. Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs. In Proceedings of the Medical Imaging 2017, Orlando, FL, USA, 13–16 February 2017; Image Processing. Styner, M.A., Angelini, E.D., Eds.; International Society for Optics and Photonics: Washington, DC, USA, 2017; Volume 10133, pp. 1–8. [Google Scholar]
  104. Umehara, K.; Ota, J.; Ishida, T. Application of Super-Resolution convolutional neural network for enhancing image resolution in chest CT. J. Digit. Imaging 2018, 31, 441–450. [Google Scholar] [CrossRef]
  105. Hatvani, J.; Horvath, A.; Michetti, J.; Basarab, A.; Kouame, D.; Gyongy, M. Deep Learning-Based Super-Resolution Applied to Dental Computed Tomography. IEEE Trans. Radiat. Plasma Med. Sci. 2019, 3, 120–128. [Google Scholar] [CrossRef] [Green Version]
  106. Li, M.; Shen, S.; Gao, W.; Hsu, W.; Cong, J. Computed tomography image enhancement using 3D convolutional neural network. In Proceedings of the Lecture Notes in Computer Science, Grenada, Spain, 20 September 2018; pp. 291–299. [Google Scholar]
  107. You, C.; Li, G.; Zhang, Y.; Zhang, X.; Shan, H.; Li, M.; Ju, S.; Zhao, Z.; Zhang, Z.; Cong, W.; et al. CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble (GAN-CIRCLE). IEEE Trans. Med. Imaging 2019, 39, 188–203. [Google Scholar] [CrossRef] [Green Version]
  108. Goodfellow, I.J.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative Adversarial Nets. In Proceedings of the NIPS’14 27th International Conference on Neural Information Processing Systems, Montréal, QC, Canada, 8–13 December 2014; pp. 2672–2680. [Google Scholar]
  109. Zhang, H.; Xu, T.; Li, H.; Zhang, S.; Wang, X.; Huang, X.; Metaxas, D.N. StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks. IEEE Trans. Pattern Anal. Mach. Intell. 2016, 1–14. [Google Scholar]
  110. Mosser, L.; Dubrule, O.; Blunt, M.J. Stochastic Reconstruction of an Oolitic Limestone by Generative Adversarial Networks. Transp. Porous Media 2018, 125, 81–103. [Google Scholar] [CrossRef] [Green Version]
  111. Mosser, L.; Dubrule, O.; Blunt, M.J. Reconstruction of three-dimensional porous media using generative adversarial neural networks. Phys. Rev. E 2017, 96, 1–17. [Google Scholar] [CrossRef] [Green Version]
  112. Mosser, L.; Dubrule, O.; Blunt, M.J. Conditioning of generative adversarial networks for pore and reservoir scale models. In Proceedings of the 80th EAGE Conference and Exhibition 2018: Opportunities Presented by the Energy Transition, Copenhagen, Denmark, 11–14 June 2018; pp. 1–5. [Google Scholar]
  113. Pedley, M. Tufas and travertines of the Mediterranean region: A testing ground for freshwater carbonate concepts and developments. Sedimentology 2009, 56, 221–246. [Google Scholar] [CrossRef]
  114. Claes, H.; Soete, J.; Van Noten, K.; El Desouky, H.; Marques Erthal, M.; Vanhaecke, F.; Özkul, M.; Swennen, R. Sedimentology, three-dimensional geobody reconstruction and carbon dioxide origin of Pleistocene travertine deposits in the Ballık area (south-west Turkey). Sedimentology 2015, 62, 1408–1445. [Google Scholar] [CrossRef]
  115. Ronchi, P.; Cruciani, F. Continental carbonates as hydrocarbon reservoir, an analog case study from the travertine of Saturnia, Italy. Am. Assoc. Pet. Geol. Bull. 2015, 99, 711–734. [Google Scholar] [CrossRef]
  116. Mancini, A.; Capezzuoli, E.; Erthal, M.; Swennen, R. Hierarchical approach to define travertine depositional systems: 3D conceptual morphological model and possible applications. Mar. Pet. Geol. 2019, 103, 549–563. [Google Scholar] [CrossRef]
  117. Terra, J.G.S.; Spadini, A.R.; França, A.B.; Sombra, C.L.; Zambonato, E.E.; Juschaks, L.C.S.; Arienti, L.M.; Erthal, M.M.; Blauth, M.; Franco, M.P.; et al. Classificações clássicas de rochas carbonáticas. Bol. Geociencas Petrobras 2010, 18, 9–29. [Google Scholar]
  118. Borsato, R.; Jones, W.; Greenhalgh, J.; Martin, M.; Roberson, R. South Atlantic Conjugate Margin: An Exploration Strategy. First Break 2012, 30, 79–84. [Google Scholar]
  119. Lottaroli, F.; Meciani, L.; Andreotti, P. West Africa Presalt Exploration: Background and Perspective of the West African “Tupi” myth. In Proceedings of the New Understanding of the Petroleum Systems of Continental Margins of the World, Houston, TX, USA, 2–5 December 2012; pp. 460–468. [Google Scholar]
  120. Soete, J.; Claes, S.; Claes, H.; Erthal, M.M.; De Boever, E.; Foubert, A.; Klitzsch, N.; Özkul, M.; Swennen, R. Unravelling the pore network and its behaviour: An integrated NMR, MIP and petrographical study of continental carbonates from the Ballık area, SW Turkey. Mar. Pet. Geol. 2016, 59, 320–335. [Google Scholar] [CrossRef] [Green Version]
  121. Soete, J.; Kleipool, L.M.; Claes, H.; Claes, S.; Hamaekers, H.; Kele, S.; Özkul, M.; Foubert, A.; Reijmer, J.J.G.; Swennen, R. Acoustic properties in continental carbonates and their relation to depositional environments, porosity and pore types. Mar. Pet. Geol. 2015, 59, 320–335. [Google Scholar] [CrossRef] [Green Version]
  122. Wirjadi, O. Survey of 3D image segmentation methods. Ber. Fraunhofer ITWM 2007, 123, 1–25. [Google Scholar]
  123. Canny, J. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 1986, 8, 679–698. [Google Scholar] [CrossRef] [PubMed]
  124. Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the Lecture Notes in Computer Science, Munich, Germany, 5–9 October 2015; Volume 9351, pp. 234–241. [Google Scholar]
  125. Maas, A.L.; Hannun, A.Y.; Ng, A.Y. Rectifier nonlinearities improve neural network acoustic models. In Proceedings of the ICML Workshop on Deep Learning for Audio, Speech and Language Processing, Atlanta, Georgia, 16 June 2013; Volume 28, pp. 1–6. [Google Scholar]
  126. Ulyanov, D.; Vedaldi, A.; Lempitsky, V. Improved texture networks: Maximizing quality and diversity in feed-forward stylization and texture synthesis. In Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 4105–4113. [Google Scholar]
  127. Drozdzal, M.; Vorontsov, E.; Chartrand, G.; Kadoury, S.; Pal, C. The importance of skip connections in biomedical image segmentation. In Proceedings of the Lecture Notes in Computer Science, Athens, Greece, 17–21 October 2016; Volume 10008, pp. 179–187. [Google Scholar]
  128. Lim, B.; Son, S.; Kim, H.; Nah, S.; Lee, K.M. Enhanced Deep Residual Networks for Single Image Super-Resolution. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA, 21–26 July 2017; pp. 1132–1140. [Google Scholar]
  129. He, K.; Zhang, X.; Ren, S.; Sin, J. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016; pp. 1951–1954. [Google Scholar]
  130. Radford, A.; Metz, L.; Chintala, S. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv 2015, arXiv:1511.06434. [Google Scholar]
  131. Salimans, T.; Goodfellow, I.; Cheung, V.; Radford, A.; Chen, X. Improved Techniques for Training GANs. arXiv 2016, arXiv:1606.03498. [Google Scholar]
  132. Mirza, M.; Osindero, S. Conditional Generative Adversarial Nets. arXiv 2014, arXiv:1411.1784. [Google Scholar]
  133. Mirsky, Y.; Mahler, T.; Shelef, I.; Elovici, Y. CT-GAN: Malicious Tampering of 3D medical imagery using deep learning. In Proceedings of the 28th USENIX Security Symposium, Santa Clara, CA, USA, 14–16 August 2019; pp. 461–478. [Google Scholar]
  134. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Green Version]
  135. Sukop, M.C.; Thorne, D.T. Lattice Boltzmann Modeling: An Introduction for Geoscientists and Engineers; Springer: Berlin, Germany, 2006; ISBN 9783540279815. [Google Scholar]
  136. Bhatnagar, P.L.; Gross, E.P.; Krook, M. A model for collision processes in gases. I. Small amplitude processes in charged and neutral one-component systems. Phys. Rev. 1954, 94, 511–525. [Google Scholar] [CrossRef]
  137. Succi, S. The Lattice Boltzmann Equation for Fluid Dynamics and Beyond; Clarendon Press: Oxford, UK, 2001. [Google Scholar]
  138. Meakin, P.; Tartakovsky, A.M. Modeling and simulation of pore-scale multiphase fluid flow and reactive transport in fractured and porous media. Rev. Geophys. 2009, 47, 1–47. [Google Scholar] [CrossRef]
  139. Mei, R.; Shyy, W.; Yu, D.; Luo, L.S. Lattice Boltzmann Method for 3-D Flows with Curved Boundary. J. Comput. Phys. 2000, 161, 680–699. [Google Scholar] [CrossRef] [Green Version]
  140. Latt, J. alabos: Parallel lattice Boltzmann solver, FlowKit-Numeca; Unige Palabos: Lausanne, Switzerland, 2009. [Google Scholar]
  141. Ahrens, J.; Geveci, B.; Law, C. ParaView: An End-User Tool for Large Data Visualization. In The Visualization Handbook; Elsevier: Amsterdam, The Netherlands, 2005. [Google Scholar]
  142. Ayachit, U. The ParaView Guide: A Parallel Visualization Application; Kitware: Clifton Park, NY, USA, 2015. [Google Scholar]
  143. Islahuddin, M.; Janssen, H. Numerical estimation of isothermal moisture storage and transport properties. In Proceedings of the Central European Symposium on Building Physics, Dresden, Germany, 14–16 September 2016; pp. 301–308. [Google Scholar]
  144. Gostick, J.; Aghighi, M.; Hinebaugh, J.; Tranter, T.; Hoeh, M.A.; Day, H.; Spellacy, B.; Sharqawy, M.H.; Bazylak, A.; Burns, A.; et al. OpenPNM: A Pore Network Modeling Package. Comput. Sci. Eng. 2016, 18, 60–74. [Google Scholar] [CrossRef] [Green Version]
  145. Valvatne, P.H. Predictive Pore-Scale Modelling of Multiphase Flow; Imperial College London: London, UK, 2004. [Google Scholar]
  146. Lenormand, R.; Zarcone, C.; Sarr, A. Mechanisms of the displacement of one fluid by another in a network of capillary ducts. J. Fluid Mech. 1983, 135, 337–353. [Google Scholar] [CrossRef] [Green Version]
  147. Mason, G.; Morrow, N.R. Capillary behavior of a perfectly wetting liquid in irregular triangular tubes. J. Colloid Interface Sci. 1991, 141, 262–274. [Google Scholar] [CrossRef]
  148. Andrew, M.; Bijeljic, B.; Blunt, M.J. Pore-scale contact angle measurements at reservoir conditions using X-ray microtomography. Adv. Water Resour. 2014, 68, 24–31. [Google Scholar] [CrossRef] [Green Version]
  149. Qi, R.; LaForce, T.C.; Blunt, M.J. Design of carbon dioxide storage in aquifers. Int. J. Greenh. Gas Control 2009, 3, 195–205. [Google Scholar] [CrossRef]
  150. Ledesma-Alonso, R.; Barbosa, R.; Ortegón, J. Effect of the image resolution on the statistical descriptors of heterogeneous media. Phys. Rev. E 2018, 97, 1–14. [Google Scholar] [CrossRef] [Green Version]
  151. Peng, S.; Hu, Q.; Dultz, S.; Zhang, M. Using X-ray computed tomography in pore structure characterization for a Berea sandstone: Resolution effect. J. Hydrol. 2012, 472, 254–261. [Google Scholar] [CrossRef]
  152. Beckingham, L.E.; Peters, C.A.; Um, W.; Jones, K.W.; Lindquist, W.B. 2D and 3D imaging resolution trade-offs in quantifying pore throats for prediction of permeability. Adv. Water Resour. 2013, 62, 1–12. [Google Scholar] [CrossRef]
  153. Carmeliet, J.; Roels, S. Determination of the Isothermal Moisture Transport Properties of Porous Building Materials. J. Therm. Envel. Build. Sci. 2001, 24, 183–210. [Google Scholar] [CrossRef]
  154. Carmeliet, J.; Descamps, F.; Houvenaghel, G. A Multiscale network model for simulating moisture transfer properties of porous media. Transp. Porous Media 1999, 35, 67–88. [Google Scholar] [CrossRef]
  155. Carmeliet, J.; Roels, S. Determination of the Moisture Capacity of Porous Building Materials. J. Build. Phys. 2002, 25, 209–237. [Google Scholar]
  156. Timofte, R.; De Smet, V.; Gool, L. Van A +: Adjusted anchored neighborhood regression for fast super-resolution. In Proceedings of the Asian Conference on Computer Vision, Singapore, 1–5 November 2014; Springer: Cham, Switzerland, 2014; pp. 111–126. [Google Scholar]
  157. Chan, T.; Zhang, J.; Pu, J.; Huang, H. Neighbor embedding based super-resolution algorithm through edge detection and feature selection. Pattern Recognit. Lett. 2009, 30, 494–502. [Google Scholar] [CrossRef]
  158. Chang, H.; Yeung, D.; Xiong, Y.; Bay, C.W.; Kong, H. Super-Resolution Through Neighbor Embedding. In Proceedings of the 2009 IEEE 12th International Conferenc on Computer Vision, Kyoto, Japan, 29 September–2 October 2009; pp. 1–8. [Google Scholar]
  159. Yang, J.; Member, S.; Wright, J.; Huang, T.S.; Ma, Y. Image Super-Resolution Via Sparse Representation. IEEE Trans. Image Process. 2010, 19, 2861–2873. [Google Scholar] [CrossRef]
  160. Huang, H.; Zhang, F.; Zhou, Y.; Yin, Q.; Hu, W. High Resolution SAR image synthesis with hierarchical generative adversarial networks. In Proceedings of the IGARSS 2019—2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, 28 July–2 August 2019; pp. 2782–2785. [Google Scholar]
Figure 1. Fully convolutional neural network that was used for super-resolution Computed Tomography (CT) images. This sketch shows the followed path in only two dimensions, but in reality a three-dimensional approach was applied. The architecture is based on a U-Net [124], although short-range residual skips [127,129] have been added and span each convolutional block of three subsequent convolutions with as goal to speed up training.
Figure 1. Fully convolutional neural network that was used for super-resolution Computed Tomography (CT) images. This sketch shows the followed path in only two dimensions, but in reality a three-dimensional approach was applied. The architecture is based on a U-Net [124], although short-range residual skips [127,129] have been added and span each convolutional block of three subsequent convolutions with as goal to speed up training.
Materials 13 01397 g001
Figure 2. Conditional generative adversarial network (C-GAN) which was used for the super-resolution task in this research. A C-GAN consists of two neural networks, the generator and discriminator. The generator corresponds to the fully convolutional Residual U-Net shown in Figure 1 and the discriminator is a convolutional network combined with a dense network tasked to classify real and “fake” images. The goal of this C-GAN is to train the generator to simulate high-resolution (HR) equivalents of low-resolution (LR) input volumes by training using a generator and an adversarial loss.
Figure 2. Conditional generative adversarial network (C-GAN) which was used for the super-resolution task in this research. A C-GAN consists of two neural networks, the generator and discriminator. The generator corresponds to the fully convolutional Residual U-Net shown in Figure 1 and the discriminator is a convolutional network combined with a dense network tasked to classify real and “fake” images. The goal of this C-GAN is to train the generator to simulate high-resolution (HR) equivalents of low-resolution (LR) input volumes by training using a generator and an adversarial loss.
Materials 13 01397 g002
Figure 3. Dataset preparation. The same prism is extracted from each input volume, which are four scans at resolutions 4, 8, 12 and 16µm, respectively. Then, from the 4 and 12 µm scans, training and validation data was extracted for training of the super-resolution C-GAN. Training and validation data are non-overlapping and not adjacent to ensure sufficient variability between the pore network, as to avoid overfitting of the neural networks. A and B show that pore structures can significantly change within one sample. A. has smaller, regularly distributed pores, at the top of the sample and B has more pore size variation in the lower part of the sample.
Figure 3. Dataset preparation. The same prism is extracted from each input volume, which are four scans at resolutions 4, 8, 12 and 16µm, respectively. Then, from the 4 and 12 µm scans, training and validation data was extracted for training of the super-resolution C-GAN. Training and validation data are non-overlapping and not adjacent to ensure sufficient variability between the pore network, as to avoid overfitting of the neural networks. A and B show that pore structures can significantly change within one sample. A. has smaller, regularly distributed pores, at the top of the sample and B has more pore size variation in the lower part of the sample.
Materials 13 01397 g003
Figure 4. Visual results comparing the low resolution (LR) input (a,d) to the output (SRM) of the super-resolution GAN (b,e) and to the expected high resolution (HR) output (c,f). The blurriness of LR has disappeared in SRM and small pores are more clearly delineated, similar to HR. Furthermore, both LR and HR contain noise, which has disappeared in the SRM. However, SRM and HR do not have a one-to-one match.
Figure 4. Visual results comparing the low resolution (LR) input (a,d) to the output (SRM) of the super-resolution GAN (b,e) and to the expected high resolution (HR) output (c,f). The blurriness of LR has disappeared in SRM and small pores are more clearly delineated, similar to HR. Furthermore, both LR and HR contain noise, which has disappeared in the SRM. However, SRM and HR do not have a one-to-one match.
Materials 13 01397 g004
Figure 5. Three-dimensional volumes comparing LR input (a,d) to the super-resolved model (SRM—b,e) and the expected HR volume (c,f). The LR volume gives the impression of containing less pores and smoother pore edges. SRM appears to have more pores and more complex pore boundaries, compared to the LR input, although it does not yet fully equate to the expected HR. However, visually SRM is more closely resembling HR than LR.
Figure 5. Three-dimensional volumes comparing LR input (a,d) to the super-resolved model (SRM—b,e) and the expected HR volume (c,f). The LR volume gives the impression of containing less pores and smoother pore edges. SRM appears to have more pores and more complex pore boundaries, compared to the LR input, although it does not yet fully equate to the expected HR. However, visually SRM is more closely resembling HR than LR.
Materials 13 01397 g005
Figure 6. Study of resolution effect. Pore network properties showing the influence of resolution (in µm) in cumulative distribution plots, while violin plots also show how these properties vary for artificial (fake) versus mechanical (real) resolution reduction. In cumulative distribution plots, only the mechanically reduced resolution is shown. Data from first volume (V1). Pore volume (a,d) increases with decreasing volume, pore shape factor (b,e) increases for MRR (real) and decreases for ARR (fake), coordination number (c,f) is constant for MRR (real) and raises for ARR (fake). Pore throat radii (g,i) and lengths (h,j) decrease with improving resolution.
Figure 6. Study of resolution effect. Pore network properties showing the influence of resolution (in µm) in cumulative distribution plots, while violin plots also show how these properties vary for artificial (fake) versus mechanical (real) resolution reduction. In cumulative distribution plots, only the mechanically reduced resolution is shown. Data from first volume (V1). Pore volume (a,d) increases with decreasing volume, pore shape factor (b,e) increases for MRR (real) and decreases for ARR (fake), coordination number (c,f) is constant for MRR (real) and raises for ARR (fake). Pore throat radii (g,i) and lengths (h,j) decrease with improving resolution.
Materials 13 01397 g006
Figure 7. Study of effect of SR models. Pore network properties of Low Resolution model input, super-resolved (SR) model output and the expected high resolution output in cumulative distribution plots and violin plots. Only data from first volume (V1) is shown. Pore volume distribution (a,d) is closer to HR for SRM than LR and pore shape factor distribution (b,e) of SRM is in between distributions of LR and HR. Coordination number (c,f) is better approximating HR in SRM than in LR. Pore throat radii (g,i) and lengths (h,j) are also better reproduced by SRM than LR can show.
Figure 7. Study of effect of SR models. Pore network properties of Low Resolution model input, super-resolved (SR) model output and the expected high resolution output in cumulative distribution plots and violin plots. Only data from first volume (V1) is shown. Pore volume distribution (a,d) is closer to HR for SRM than LR and pore shape factor distribution (b,e) of SRM is in between distributions of LR and HR. Coordination number (c,f) is better approximating HR in SRM than in LR. Pore throat radii (g,i) and lengths (h,j) are also better reproduced by SRM than LR can show.
Materials 13 01397 g007
Figure 8. Visualization of lattice Boltzmann simulations in 3D along a side view (X-Z) and a bottom view (X–Y) in which the green dots indicate the same point in each volume that was added for orientation. Fluids flow from left to right and red indicates higher fluid flow velocities, while blue indicates slower fluid flow. In the top row (ac), the HR sample (c) has two higher fluid velocity zones with a lower fluid velocity zone in the middle. This distinction is less obvious in LR sample (a), while the slightly bluer colour in the middle of SRM (b) suggests a certain improvement of the model. The middle row (df) show an unconnected zone in the lower left corner of the LR sample (d), which is again connected in the SRM image (e), as it should be, as shown in (f). The bottom row (gi) shows a 2D slice perpendicular to this flow and is taken in the middle of the sample. In this slice, the grey colours indicate unconnected porosity. These slices show that the SRM (h) have more pores and are better connected than the LR volume (g). However, connectivity and fluid flow velocities are still exaggerated compared to HR (i). This is also seen from the 3D volumes where SRM volumes (b,e) have a redder colour than HR (c,f), although it is slightly more blue than LR volumes (a,d).
Figure 8. Visualization of lattice Boltzmann simulations in 3D along a side view (X-Z) and a bottom view (X–Y) in which the green dots indicate the same point in each volume that was added for orientation. Fluids flow from left to right and red indicates higher fluid flow velocities, while blue indicates slower fluid flow. In the top row (ac), the HR sample (c) has two higher fluid velocity zones with a lower fluid velocity zone in the middle. This distinction is less obvious in LR sample (a), while the slightly bluer colour in the middle of SRM (b) suggests a certain improvement of the model. The middle row (df) show an unconnected zone in the lower left corner of the LR sample (d), which is again connected in the SRM image (e), as it should be, as shown in (f). The bottom row (gi) shows a 2D slice perpendicular to this flow and is taken in the middle of the sample. In this slice, the grey colours indicate unconnected porosity. These slices show that the SRM (h) have more pores and are better connected than the LR volume (g). However, connectivity and fluid flow velocities are still exaggerated compared to HR (i). This is also seen from the 3D volumes where SRM volumes (b,e) have a redder colour than HR (c,f), although it is slightly more blue than LR volumes (a,d).
Materials 13 01397 g008
Figure 9. Resolution influence on unsaturated moisture absorption and desorption or drying (a,b) and moisture permeability (c,d) with changing capillary pressure. Absorption would increase capillary pressure because this pressure is linked to relative humidity thus following the graphs from right to left. Desorption or drying follows the opposite direction. The difference between the solid and dotted line shows ”hysteresis”. Only data from first volume (V1) is shown. Note that a and b have their x-axes cropped to represent a narrower capillary pressure range than moisture permeability (c,d), because no visible moisture variation occurs in the higher log(-Pa) range. In samples obtained through Mechanical Resolution Reduction (MRR), the spread on the onset of moisture increase (a) and permeability increase (c) is higher than for samples obtained from Artificial Resolution Reduction (ARR), as seen for moisture uptake (b) and permeability increase (d).
Figure 9. Resolution influence on unsaturated moisture absorption and desorption or drying (a,b) and moisture permeability (c,d) with changing capillary pressure. Absorption would increase capillary pressure because this pressure is linked to relative humidity thus following the graphs from right to left. Desorption or drying follows the opposite direction. The difference between the solid and dotted line shows ”hysteresis”. Only data from first volume (V1) is shown. Note that a and b have their x-axes cropped to represent a narrower capillary pressure range than moisture permeability (c,d), because no visible moisture variation occurs in the higher log(-Pa) range. In samples obtained through Mechanical Resolution Reduction (MRR), the spread on the onset of moisture increase (a) and permeability increase (c) is higher than for samples obtained from Artificial Resolution Reduction (ARR), as seen for moisture uptake (b) and permeability increase (d).
Materials 13 01397 g009
Figure 10. Impact of super-resolved models (SRM) on unsaturated moisture absorption and desorption on moisture permeability (right) and drying (left) with changing capillary pressure. Absorption would increase capillary pressure because this pressure is linked to relative humidity thus following the graphs from right to left. Desorption or drying follows the opposite direction. The difference between the solid and dotted line shows ”hysteresis”. Only data from first volume (V1) is shown and note that the left graph has its x-axes cropped to represent a narrower capillary pressure range than moisture permeability (right plot), because no visible moisture variation occurs in the higher log(-Pa) range.
Figure 10. Impact of super-resolved models (SRM) on unsaturated moisture absorption and desorption on moisture permeability (right) and drying (left) with changing capillary pressure. Absorption would increase capillary pressure because this pressure is linked to relative humidity thus following the graphs from right to left. Desorption or drying follows the opposite direction. The difference between the solid and dotted line shows ”hysteresis”. Only data from first volume (V1) is shown and note that the left graph has its x-axes cropped to represent a narrower capillary pressure range than moisture permeability (right plot), because no visible moisture variation occurs in the higher log(-Pa) range.
Materials 13 01397 g010
Figure 11. Resolution influence on relative permeability evolution of oil (Kro) and water (Krw) with varying water saturation (Sw) during oil-flooding (drainage) and water-flooding (imbibition). Kro decreases with increasing water saturation and Krw increases. a shows the evolution of relative permeabilities for the same volume at four different resolutions obtained from Mechanical Resolution Reduction (MRR) and in b this is shown for Artificial Resolution Reduction (ARR).
Figure 11. Resolution influence on relative permeability evolution of oil (Kro) and water (Krw) with varying water saturation (Sw) during oil-flooding (drainage) and water-flooding (imbibition). Kro decreases with increasing water saturation and Krw increases. a shows the evolution of relative permeabilities for the same volume at four different resolutions obtained from Mechanical Resolution Reduction (MRR) and in b this is shown for Artificial Resolution Reduction (ARR).
Materials 13 01397 g011
Figure 12. Resolution influence residual oil fraction after waterflooding, studied for mechanical (real) and artificial (fake) resolution reduction.
Figure 12. Resolution influence residual oil fraction after waterflooding, studied for mechanical (real) and artificial (fake) resolution reduction.
Materials 13 01397 g012
Figure 13. Impact of super-resolved models on relative permeability evolution of oil (Kro) and water (Krw) with varying water saturation (Sw) during oil-flooding (drainage) and water-flooding (imbibition).
Figure 13. Impact of super-resolved models on relative permeability evolution of oil (Kro) and water (Krw) with varying water saturation (Sw) during oil-flooding (drainage) and water-flooding (imbibition).
Materials 13 01397 g013
Table 1. Training input parameters for generator and discriminator.
Table 1. Training input parameters for generator and discriminator.
ParameterGeneratorDiscriminator
Loss functionMean absolute error (mae) and adversarial loss (100:1 ratio)Mean squared error (mse)
OptimizerAdamAdam
Learning rate104105
β10.50.5
Batch size4
Epochs500
Table 2. Influence of resolution on mean pore network properties, studied for two volumes and for mechanical and artificial resolution reduction. Relative difference with expected highest resolution data is added to check the decay of properties.
Table 2. Influence of resolution on mean pore network properties, studied for two volumes and for mechanical and artificial resolution reduction. Relative difference with expected highest resolution data is added to check the decay of properties.
ParameterRes.VALUESRELATIVE TO 4 µm
MechanicalArtificialMechanicalArtificial
V1V2V1V2V1V2V1V2
Amount of pores/throats4 µm21088/3375627299/4339621089/3375627299/433961.00/1.001.00/1.001.00/1.001.00/1.00
8 µm5798/97197406/121586097/134967724/169530.27/0.290.27/0.280.29/0.400.28/0.39
12 µm2762/45383423/55052801/70293439/86650.13/0.130.13/0.130.13/0.210.13/0.20
16 µm1527/23491920/29451445/39541732/47710.07/0.070.07/0.070.07/0.120.06/0.11
Throats per node4 µm1.601.591.601.591.001.001.001.00
8 µm1.681.642.212.191.051.031.381.38
12 µm1.641.612.512.521.031.011.571.59
16 µm1.541.532.742.750.960.961.711.73
Mean Pore Volume log(m³)4 µm−13.23−13.25−13.23−13.251.001.001.001.00
8 µm−12.43−12.45−12.39−12.420.940.940.940.94
12 µm−12.01−12.03−11.95−11.960.910.910.900.90
16 µm−11.73−11.75−11.61−11.630.890.890.880.88
Mean Pore Shape Factor4 µm0.0440.0450.0440.0451.001.001.001.00
8 µm0.0480.0490.0400.0401.081.090.900.90
12 µm0.0490.0510.0390.0401.111.130.890.89
16 µm0.0510.0520.0380.0391.151.160.870.88
Mean Coordination number4 µm3.143.133.143.131.001.001.001.00
8 µm3.253.214.324.311.041.021.381.38
12 µm3.163.124.884.941.001.001.551.58
16 µm2.922.965.295.380.930.941.691.72
Mean Throat Radius log(m)4 µm−5.04−5.06−5.04−5.061.001.001.001.00
8 µm−4.78−4.80−4.89−4.900.950.950.970.97
12 µm−4.64−4.67−4.77−4.790.920.920.950.95
16 µm−4.54−4.56−4.67−4.690.900.900.930.93
Mean Throat Total Length log(m)4 µm−4.32−4.34−4.32−4.341.001.001.001.00
8 µm−4.12−4.13−4.12−4.130.950.950.950.95
12 µm−4.02−4.03−4.00−4.010.930.930.930.92
16 µm−3.94−3.95−3.89−3.900.910.910.900.90
Table 3. Impact of super-resolution models on mean pore network properties, studied for four volumes of 500³ voxels each (3 first columns). Relative difference with expected high-resolution data (last 2 columns).
Table 3. Impact of super-resolution models on mean pore network properties, studied for four volumes of 500³ voxels each (3 first columns). Relative difference with expected high-resolution data (last 2 columns).
ParameterVol. VALUESRELATIVE TO HR
SRMHRLRSRMLR
Amount of pores/throatsV11956/34252211/3809850/13640.88/0.900.38/0.36
V22949/48963094/50771243/17080.95/0.960.40/0.34
V32959/44183249/50141264/14660.91/0.880.39/0.29
V42702/38182815/42381160/14760.96/0.900.41/0.35
Throats per nodeV11.751.721.601.020.93
V21.661.641.371.010.84
V31.491.541.160.970.75
V41.411.511.270.940.85
Mean Pore Volume log(m³)V1−13.13−13.23−12.620.990.95
V2−13.19−13.24−12.681.000.96
V3−13.21−13.26−12.751.000.96
V4−13.17−13.20−12.671.000.96
Mean Pore Shape FactorV10.0460.0430.0461.081.08
V20.0480.0440.0481.081.09
V30.0490.0450.0491.091.10
V40.0470.0430.0491.091.13
Mean Coordination numberV13.393.343.061.010.91
V23.213.182.611.010.82
V32.893.002.180.960.73
V42.732.912.410.940.83
Mean Throat Radius log(m)V1−4.93−5.02−4.680.980.93
V2−4.98−5.04−4.710.990.93
V3−4.99−5.06−4.750.990.94
V4−4.97−5.03−4.740.990.94
Mean Throat Total Length log(m)V1−4.24−4.30−4.180.990.97
V2−4.31−4.35−4.230.990.97
V3−4.32−4.37−4.260.990.98
V4−4.32−4.36−4.250.990.97
Table 4. Impact of resolution on porosity, specific surface area and absolute permeability determined from pore network models, studied for two volumes of 1000³ voxels each. Relative difference with expected highest resolution data is added.
Table 4. Impact of resolution on porosity, specific surface area and absolute permeability determined from pore network models, studied for two volumes of 1000³ voxels each. Relative difference with expected highest resolution data is added.
TypeVol.PorositySpecific Surface Area (mm²/mm³)PNM Permeability (Darcy)
Resolution 4 µm8 µm12 µm16 µm4 µm8 µm12 µm16 µm4 µm8 µm12 µm16 µm
VALUESMech.V10.260.260.250.2315.6910.678.466.8113.8022.0229.0035.40
V20.250.250.230.2218.0212.109.387.453.836.678.4710.49
Artif.V10.260.260.260.2615.6914.7313.6112.6413.8014.5216.1018.39
V20.250.250.250.2518.0216.8715.5314.373.834.896.698.21
RELATIVE TO 4µmMech.V11.001.000.950.911.000.680.540.431.001.602.102.56
V21.000.990.920.861.000.670.520.411.001.742.212.73
Artif.V11.001.001.001.001.000.940.870.811.001.051.171.33
V21.001.001.001.001.000.940.860.801.001.281.742.14
Table 5. Impact of super-resolution models on porosity, specific surface area and absolute permeability determined from pore network models (PNM) and from Lattice Boltzmann Method (LBM), studied for four volumes of 500³ voxels each. Relative difference with expected high-resolution data is added.
Table 5. Impact of super-resolution models on porosity, specific surface area and absolute permeability determined from pore network models (PNM) and from Lattice Boltzmann Method (LBM), studied for four volumes of 500³ voxels each. Relative difference with expected high-resolution data is added.
TypePorositySpecific Surface Area (mm²/mm³)PNM Permeability (Darcy)LBM Permeability (D)
Subvolume V1V2V3V4V1V2V3V4V1V2V3V4V1
VALUESSRM0.320.320.300.23112.4131.2121.7111.517.4029.5950.882.2919.08
HR0.280.280.270.21123.9142.8136.2124.712.5216.9931.171.2012.21
LR0.300.290.280.2176.385.379.173.124.7746.0253.672.6827.61
RELATIVE TO HRHRM1.131.131.101.090.910.920.890.891.391.741.631.911.56
LR1.051.031.011.000.620.600.580.591.982.711.722.242.26
Table 6. Impact of super-resolution models on moisture saturation, saturated moisture permeability and vapour permeability studied for four volumes of 500³ voxels each. Relative difference with expected high-resolution data is added.
Table 6. Impact of super-resolution models on moisture saturation, saturated moisture permeability and vapour permeability studied for four volumes of 500³ voxels each. Relative difference with expected high-resolution data is added.
ParameterSubvolumeValuesRelative to HR
SRMHRLRSRMLR
Moisture saturationV1305.09269.83284.051.131.05
V2311.64274.53275.581.141.00
V3290.30264.79261.681.100.99
V4215.36198.79194.401.080.98
Saturated moisture permeabilityV11.50 × 10−58.52 × 10−62.30 × 10−51.762.70
V22.73 × 10−51.60 × 10−53.95 × 10−51.712.48
V32.06 × 10−51.00 × 10−52.76 × 10−52.062.75
V42.15 × 10−61.18 × 10−62.58 × 10−61.822.18
Plateau vapour permeabilityV12.41 × 10−161.84 × 10−162.17 × 10−161.311.18
V23.27 × 10−162.39 × 10−162.72 × 10−161.371.14
V32.39 × 10−161.84 × 10−162.14 × 10−161.301.16
V41.02 × 10−168.03 × 10−177.41 × 10−171.270.92
Table 7. Impact of super-resolution models on residual oil fraction and relative water permeability after waterflooding from two-phase oil-water fluid flow simulations on pore network models on four volumes of 500³ voxels each. Relative difference with expected high-resolution data is added. In the fourth volume, SRM relative water permeability appears severely overestimated.
Table 7. Impact of super-resolution models on residual oil fraction and relative water permeability after waterflooding from two-phase oil-water fluid flow simulations on pore network models on four volumes of 500³ voxels each. Relative difference with expected high-resolution data is added. In the fourth volume, SRM relative water permeability appears severely overestimated.
TypeRelative Water Permeability (after Water-Flooding)Residual Oil Fraction
Subvolume V1V2V3V4V1V2V3V4
VALUESSRM0.210.710.696.0 × 10−30.320.330.350.35
HR0.050.760.832.2 × 10−70.280.290.250.36
LR3.8 × 10−90.610.295.5 × 10−90.430.430.460.41
RELATIVE TO HRSRM4.090.940.83277181.151.161.400.96
LR7.7 × 10−80.800.350.031.561.481.821.15

Share and Cite

MDPI and ACS Style

Janssens, N.; Huysmans, M.; Swennen, R. Computed Tomography 3D Super-Resolution with Generative Adversarial Neural Networks: Implications on Unsaturated and Two-Phase Fluid Flow. Materials 2020, 13, 1397. https://doi.org/10.3390/ma13061397

AMA Style

Janssens N, Huysmans M, Swennen R. Computed Tomography 3D Super-Resolution with Generative Adversarial Neural Networks: Implications on Unsaturated and Two-Phase Fluid Flow. Materials. 2020; 13(6):1397. https://doi.org/10.3390/ma13061397

Chicago/Turabian Style

Janssens, Nick, Marijke Huysmans, and Rudy Swennen. 2020. "Computed Tomography 3D Super-Resolution with Generative Adversarial Neural Networks: Implications on Unsaturated and Two-Phase Fluid Flow" Materials 13, no. 6: 1397. https://doi.org/10.3390/ma13061397

APA Style

Janssens, N., Huysmans, M., & Swennen, R. (2020). Computed Tomography 3D Super-Resolution with Generative Adversarial Neural Networks: Implications on Unsaturated and Two-Phase Fluid Flow. Materials, 13(6), 1397. https://doi.org/10.3390/ma13061397

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop