Research on Image Identification Method of Rock Thin Slices in Tight Oil Reservoirs Based on Mask R-CNN
Abstract
:1. Introduction
2. SMR Methods
2.1. Establishment of Slice Image Data Sets
2.2. Augmentation of Slice Images
- (1)
- Flipping: image horizontal/vertical/diagonal mirror flipping.
- (2)
- Rotation: images were rotated by 30 degrees, 60 degrees, 90 degrees and 120 degrees clockwise.
- (3)
- Gaussian blur: 3 × 3, 5 × 5 and 7 × 7 Gaussian kernels were applied to blur images globally, horizontally, vertically and diagonally.
- (4)
- Change exposure: increase and decrease operations of global, horizontal, vertical and diagonal exposures on images.
- (5)
- Noise injection: global, horizontal, vertical and diagonal noise addition operations were performed by using 0.05, 0.075, 0.1 and 0.125 noise percentages.
2.3. Identification of Slice Image Components
- (1)
- The backbone consists of ResNet101 [31] and Feature Pyramid Network (FPN), as marked by ③ in Figure 1. ResNet101 extracts image features through residual network to obtain the feature layer; FPN extracts the features and semantic values of each component in the feature layer by undersampling, and then generates the effective feature layer (P2, P3, P4, P5, P6) [32] by upsampling and fusion of feature layers, to complete feature extraction, as shown in Figure 2.
- (2)
- The ROI area is the area where the region proposal network (RPN) slides on the effective feature layer to obtain and output the possible slice components [33], as marked by ④ in Figure 1. The RPN consists of a binary classification network and a regression network. The former detects the slice components of the candidate area by judging the intersection over union value (IOU) in region proposals, and the latter outputs the edge boxes of each component region proposal. The RPN structure is shown in Figure 3. If the region proposal detected by the binary classification network does not contain components, the edge box is invalid. Each ROI area is finally adjusted to ROI align of the same size.
- (3)
- The segmentation and recognition part is composed of fully connected layers and mask branch, as marked by ⑤ in Figure 1. Fully connected layers identify each component category with ROI align as input, and regress and refine the edge box of each component; mask branch applies a small fully connected network to generate pixel-level object masks for each component in ROI align and complete the instance segmentation of components. The total loss function of Mask R-CNN can be defined by Equation (2) [20], where is the recognition process loss; is the box regression loss; is the segmentation loss.
2.4. Mask R-CNN Algorithm Training
3. Experimental Scheme
3.1. Accuracy Experiment
3.1.1. Segmentation Accuracy Experiment
3.1.2. Accuracy Experiment
3.1.3. Execution Speed Experiment
3.1.4. Migration Experiment
4. Experimental Results and Discussion
4.1. Accuracy Experiment Results
4.1.1. Segmentation Accuracy Experiment Results
4.1.2. Accuracy Experiment Results
4.2. Execution Speed Experiment Results
4.3. Migration Experiment Results
5. Conclusions
- (1)
- Image preprocessing can improve image quality and avoid noise interference;
- (2)
- The self-labeling image data augmentation mechanism can increase the number of samples and ensure the availability of samples;
- (3)
- Image segmentation and recognition can be simultaneously realized with the improved Mask R-CNN algorithm. The error of segmentation accuracy and manual calculation results was within 10%, and the overall recognition accuracy was 93.18%, so it can be applied to characteristic identification of rock thin slices of tight oil reservoirs.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Cheng, K.; Wu, W.; Holditch, S.A.; Ayers, W.B.; Mcvay, D.A. Assessment of the distribution of technically-recoverable resources in North American Basins. In Proceedings of the Canadian Unconventional Resources and International Petroleum Conference, Calgary, AB, Canada, 19–21 October 2010; pp. 1–11. [Google Scholar]
- Vidas, H.; Hugman, B. Availability, Economics, and Production Potential of North American Unconventional Natural Gas Supplies; The INGAA Foundation, Inc.: Fairfax, VA, USA, 2008; pp. 11–12. [Google Scholar]
- Zhao, J. Conception, Classification and Resource Potential of Unconventional Hydrocarbons. Nat. Gas Geosci. 2012, 23, 393–406. [Google Scholar]
- Cheng, G.J.; Yang, J.; Huang, Q.Z.; Liu, Y. Rock image classification recognition based on probabilistic neural networks. Sci. Technol. Eng. 2013, 13, 9231–9235. [Google Scholar]
- Zhou, Y.; Ji, Y.; Xu, L.; Che, S.; Niu, X.; Wan, L.; Zhou, Y.; Li, Z.; You, Y. Controls on reservoir heterogeneity of tight sand oil reservoirs in Upper Triassic Yanchang Formation in Longdong Area, southwest Ordos Basin, China: Implications for reservoir quality prediction and oil accumulation. Mar. Pet. Geol. 2016, 78, 110–135. [Google Scholar] [CrossRef]
- Wang, M.; Yang, Z.; Shui, C.; Yu, Z.; Wang, Z.; Cheng, Y. Diagenesis and its influence on reservoir quality and oil-water relative permeability: A case study in the Yanchang Formation Chang 8 tight sandstone oil reservoir, Ordos Basin, China. Open Geosci. 2019, 11, 37–47. [Google Scholar] [CrossRef]
- Cai, Y.H.; Teng, Q.Z.; Tu, C.Y. Automatic extraction of pores in thin slice images of rock castings based on deep learning. Sci. Technol. Eng. 2021, 28, 296–304. [Google Scholar]
- Zhou, H.; Zhang, C.L.; Zhang, X.; Chen, Q.X.; Zhang, Y.; Zhong, C.C. Edge Extraction and Particle Segmentation Based on Coherent Features of Rock Slice Sequence lmages. J. Jilin Univ. (Earth Sci. Ed.) 2021, 51, 1897–1907. [Google Scholar]
- Jiang, F.; Gu, Q.; Hao, H.Z.; Li, N.; Hu, X.M. Grain segmentation of sandstone thin section images based on semantic feature extraction. Sci. Sin. Inf. 2020, 50, 109–127. [Google Scholar]
- Jiang, F.; Gu, Q.; Hao, H.Z.; Li, N.; Chen, D.X. Survey on Content-Based I mage Segmentation Methods. J. Softw. 2017, 28, 160–183. [Google Scholar]
- Budennyy, S.; Pachezhertsev, A.; Bukharev, A.; Erofeev, A.; Mitrushkin, D.; Belozerov, B. Image processing and machine learning approaches for petrographic thin section analysis. In Proceedings of the SPE Russian Petroleum Technology Conference, Moscow, Russia, 16–18 October 2017; OnePetro: Richardson, TX, USA, 2017. [Google Scholar]
- Asmussen, P.; Conrad, O.; Günther, A.; Kirsch, M.; Riller, U. Semi-automatic segmentation of petrographic thin section images using a “seeded-region growing algorithm” with an application to characterize wheathered subarkose sandstone. Comput. Geosci. 2015, 83, 89–99. [Google Scholar] [CrossRef]
- Huang, P.; Zheng, Q.; Liang, C. Overview of Image Segmentation Methods. J. Wuhan Univ. (Nat. Sci. Ed.) 2020, 66, 519–531. [Google Scholar]
- Yang, Y.; Liu, N.; Cheng, G.; Qiang, X.; Wang, X. Clustering Analysis of Rock Images Based on Spark Platform. J. Xi’an Shiyou Univ. (Nat. Sci. Ed.) 2016, 31, 114–118. [Google Scholar]
- Jiang, F.; Gu, Q.; Hao, H.; Li, N.; Wang, B.; Hu, X. A method for automatic grain segmentation of multi-angle cross-polarized microscopic images of sandstone. Comput. Geosci. 2018, 115, 143–153. [Google Scholar] [CrossRef]
- Saxena, N.; Day-Stirrat, R.J.; Hows, A.; Hofmann, R. Application of deep learning for semantic segmentation of sandstone thin sections. Comput. Geosci. 2021, 152, 104778. [Google Scholar] [CrossRef]
- Ghiasi-Freez, J.; Soleimanpour, I.; Kadkhodaie-Ilkhchi, A.; Ziaii, M.; Sedighi, M.; Hatampour, A. Semi-automated porosity identification from thin section images using image analysis and intelligent discriminant classifiers. Comput. Geosci. 2012, 45, 36–45. [Google Scholar] [CrossRef]
- Izadi, H.; Sadri, J.; Mehran, N.A. Intelligent mineral identification using clustering and artificial neural networks techniques. In Proceedings of the 2013 First Iranian Conference on Pattern Recognition and Image Analysis (PRIA), Birjand, Iran, 6–8 March 2013; pp. 1–5. [Google Scholar]
- Li, N.; Gu, Q.; Jiang, F.; Hao, H.Z.; Yu, H.; Ni, C. Feature Representation Method of Microscopic Sandstone Images Based on Convolutional Neural Network. J. Softw. 2020, 31, 3621–3639. [Google Scholar]
- He, K.; Gkioxari, G.; Dollar, P.; Girshick, R. Mask R-CNN, International Conference on Computer Vision. In Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 25 December 2017; pp. 2980–2988. [Google Scholar]
- Johnson, J.W. Automatic nucleus segmentation with Mask-RCNN. In Proceedings of the Science and Information Conference, Las Vegas, NV, USA, 2–3 May 2019; Springer: Cham, Switzerland, 2019; pp. 399–407. [Google Scholar]
- Bloice, M.; Stocker, C.; Holzinger, A. Augmentor: An image augmentation library for machine learning. arXiv 2017, arXiv:1708.04680. [Google Scholar] [CrossRef]
- Buades, A.; Coll, B.; Morel, J.M. Non-Local Means Denoising. Image Processing Line 2011, 1, 208–212. [Google Scholar] [CrossRef] [Green Version]
- Chachada, S.; Oh, B.T.; Cho, N.; Phong, S.A.; Manchala, D.; Kuo, C.C.J. Extension of Non-Local Means (NLM) algorithm with Gaussian filtering for highly noisy images. In Proceedings of the 2011 Visual Communications and Image Processing (VCIP), Tainan, China, 6–9 November 2011; pp. 1–4. [Google Scholar]
- Russell, B.C.; Torralba, A.; Murphy, K.P.; Freeman, W.T. LabelMe: A database and web-based tool for image annotation. Int. J. Comput. Vis. 2008, 77, 157–173. [Google Scholar] [CrossRef]
- Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 2012, 25, 1097–1105. [Google Scholar] [CrossRef]
- Shorten, C.; Khoshgoftaar, T.M. A survey on Image Data Augmentation for Deep Learning. J. Big Data 2019, 6, 60. [Google Scholar] [CrossRef]
- Ma, Y.; Tang, P.; Zhao, L.; Zhang, Z. Review of data augmentation for image in deep learning. J. Image Graph. 2021, 26, 487–502. [Google Scholar]
- Moreno-Barea, F.J.; Strazzera, F.; Jerez, J.M.; Urda, D.; Franco, L. Forward noise adjustment scheme for data augmentation. In Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI), Bangalore, India, 18–21 November 2018; pp. 728–734. [Google Scholar]
- Inoue, H. Data augmentation by pairing samples for images classification. arXiv 2018, arXiv:1801.02929. [Google Scholar]
- Burke, C.J.; Aleo, P.D.; Chen, Y.C.; Liu, X.; Peterson, J.R.; Sembroski, G.H.; Lin, J.Y.Y. Deblending and classifying astronomical sources with Mask R-CNN deep learning. Mon. Not. R. Astron. Soc. 2019, 490, 3952–3965. [Google Scholar] [CrossRef] [Green Version]
- Qin, J.; Zhang, Y.; Zhou, H.; Yu, F.; Sun, B.; Wang, Q. Protein Crystal Instance Segmentation Based on Mask R-CNN. Crystals 2021, 11, 157. [Google Scholar] [CrossRef]
- Tan, C.; Sun, F.; Kong, T.; Zhang, W.; Liu, C. A Survey on Deep Transfer Learning. In Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece, 4–7 October 2018; pp. 270–279. [Google Scholar]
- Lin, T.Y.; Maire, M.; Belongie, S.; Hays, J.; Zitnick, C.L. Microsoft Coco: Common Objects in Context; Springer International Publishing: Berlin/Heidelberg, Germany, 2014; pp. 740–755. [Google Scholar]
- Bolya, D.; Zhou, C.; Xiao, F.; Lee, Y.J. YOLACT: Real-time instance segmentation. arXiv 2019, arXiv:1904.02689. [Google Scholar]
- Su, D.; Wang, X.; Yang, H.W.; Hong, C. Roughness analysis of general-shape particles, from 2D closed outlines to 3D closed surfaces. Powder Technol. 2019, 356, 423–438. [Google Scholar] [CrossRef]
- Su, D.; Yan, W.M. Quantification of angularity of general-shape particles by using Fourier series and a gradient-based approach. Constr. Build. Mater. 2018, 161, 547–554. [Google Scholar] [CrossRef]
- Dietler, N.; Minder, M.; Gligorovski, V.; Economou, A.M.; Joly, D.A.H.L.; Sadeghi, A.; Rahi, S.J. A convolutional neural network segments yeast microscopy images with high accuracy. Nat. Commun. 2020, 11, 5723. [Google Scholar] [CrossRef]
- Kruitbosch, H.T.; Mzayek, Y.; Omlor, S.; Guerra, P.; Milias-Argeitis, A. A convolutional neural network for segmentation of yeast cells without manual training annotations. Bioinformatics 2022, 38, 1427–1433. [Google Scholar] [CrossRef]
- Zhang, T.; Li, Y.; Chen, Y.; Feng, X.; Zhu, X.; Chen, Z.; Yao, J.; Zheng, Y.; Cai, J.; Song, H.; et al. Review on space energy. Appl. Energy 2021, 292, 116896. [Google Scholar] [CrossRef]
- Zhang, T.; Li, Y.; Li, Y.; Sun, S.; Gao, X. A self-adaptive deep learning algorithm for accelerating multi-component flash calculation. Comput. Methods Appl. Mech. Eng. 2020, 369, 113207. [Google Scholar] [CrossRef]
The Amount of Data | Number of Original Images | Number of Amplified Images |
---|---|---|
100 | 2 | 98 |
200 | 4 | 196 |
400 | 6 | 394 |
600 | 8 | 592 |
800 | 10 | 790 |
1000 | 12 | 988 |
Ingredient Name | Quartz | Feldspar | Lithic | PP | CP | CDP | Microcrack | |
---|---|---|---|---|---|---|---|---|
Precision | SYL | 0.61 | 0.22 | 0.98 | 0.76 | 0.16 | 0.96 | 0.5 |
SMR | 0.78 | 0.46 | 0.99 | 0.84 | 0.38 | 0.98 | 0.5 | |
Recall | SYL | 0.83 | 0.74 | 0.86 | 0.80 | 0.68 | 0.82 | 0.5 |
SMR | 0.92 | 0.88 | 0.94 | 0.89 | 0.84 | 0.91 | 0.75 |
Experimental Algorithm | Number of Test Sets (N) | MRT(S) |
---|---|---|
SYL Algorithm | 100 | 9.08 |
200 | 19.06 | |
400 | 40.30 | |
600 | 63.58 | |
800 | 91.03 | |
1000 | 121.32 | |
SMR Algorithm | 100 | 9.08 |
200 | 18.86 | |
400 | 36.68 | |
600 | 55.04 | |
800 | 74.12 | |
1000 | 95.34 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, T.; Li, C.; Liu, Z.; Zhang, K.; Liu, F.; Li, D.; Zhang, Y.; Liu, Z.; Liu, L.; Huang, J. Research on Image Identification Method of Rock Thin Slices in Tight Oil Reservoirs Based on Mask R-CNN. Energies 2022, 15, 5818. https://doi.org/10.3390/en15165818
Liu T, Li C, Liu Z, Zhang K, Liu F, Li D, Zhang Y, Liu Z, Liu L, Huang J. Research on Image Identification Method of Rock Thin Slices in Tight Oil Reservoirs Based on Mask R-CNN. Energies. 2022; 15(16):5818. https://doi.org/10.3390/en15165818
Chicago/Turabian StyleLiu, Tao, Chunsheng Li, Zongbao Liu, Kejia Zhang, Fang Liu, Dongsheng Li, Yan Zhang, Zhigang Liu, Liyuan Liu, and Jiacheng Huang. 2022. "Research on Image Identification Method of Rock Thin Slices in Tight Oil Reservoirs Based on Mask R-CNN" Energies 15, no. 16: 5818. https://doi.org/10.3390/en15165818
APA StyleLiu, T., Li, C., Liu, Z., Zhang, K., Liu, F., Li, D., Zhang, Y., Liu, Z., Liu, L., & Huang, J. (2022). Research on Image Identification Method of Rock Thin Slices in Tight Oil Reservoirs Based on Mask R-CNN. Energies, 15(16), 5818. https://doi.org/10.3390/en15165818