Enhanced Generative Adversarial Networks for Isa Furnace Matte Grade Prediction under Limited Data
Abstract
:1. Introduction
- To select the most relevant and the least redundant variable subsets, a maximum relevance minimum redundancy (MRMR) algorithm is introduced to screen the variables, which ensures that the selected variables can effectively capture the change pattern of the matte grade and reduce redundant information.
- Three GAN data augmentation models with different activation functions are constructed, and a data fusion criterion generated based on the root mean squared error (RMSE) and the coefficient of determination (R2) is designed, which can improve the global features’ ability to represent a generative network and the quality of the generated data.
- A matte grade prediction model based on GANs and random forest (RF) is proposed. The prediction method is verified by the production data of a copper smelting enterprise in southwest China. The experimental results show that the proposed method has high prediction accuracy.
2. Theory and Methodology
2.1. Maximum Correlation Minimum Redundancy Algorithm
2.2. The Principle of GAN
2.3. RF Model
- A training subset is constructed by randomly selecting x samples from the original training set. And, m variables are randomly selected from the training subset, and the corresponding decision tree is constructed.
- Repeating step (1) n times, a total of n training subsets are obtained, forming n decision trees, and all the decision trees are combined together to obtain an RF model.
- The predictions of all the decision trees were averaged as the final prediction of the random forest regression model.
3. A Matte Grade Prediction Model Incorporating EGAN and RF
3.1. Variable Selection Based on MRMR Algorithm
- The variable Xj is selected from the input variable set X that has the maximum mutual information with the matte grade and placed into the optimal input variable subset S.
- The incremental search method is used to select the variable Xj that satisfies the condition and place it into the optimal input variable subset S.
- Whether the set threshold reached (ψ(D,R) > 0) is determined. If the threshold condition is met, the selected variable is output; otherwise, the second step is performed.
3.2. Data Augmentation and Data Fusion Based on GANs
- The key influencing variables of matte grade were obtained by using the MRMR algorithm for variable selection, which was divided into a training set and a test set in the ratio of 8:2.
- The training set D was input into the RGAN model, and the generated data D1 under RGAN were obtained according to a ratio of real data to generated data of 1:1.
- The generated data D1 obtained under the RGAN model were used as the extended data of training set D and fed into the RF model, and the evaluation metrics C1 was computed.
- Steps (2) and (3) were repeated following the same method to obtain the generated data D2 and D3 under LRGAN and PRGAN, respectively, as the extended data for training set D. Then, they were input into the RF model and evaluation indexes C2 and C3 were computed sequentially.
- Weights w1, w2, and w3, corresponding to each GAN model’s generated data, and the weighted fusion of the three generated data were calculated to obtain the final generated data Df.
3.3. Matte Grade Prediction Based on Random Forest
4. Experimental Results and Analysis
4.1. Data Sources and Experimental Settings
4.1.1. Copper Smelting Mechanism and Data Sources
- 1.
- Decomposition reaction of sulfides. The main components of copper concentrate are CuFeS2, CuS, FeS2, etc. After the copper concentrate enters the Isa furnace, the decomposition reaction of high-valence sulfides occurs rapidly, as shown in Equations (14)–(16).The FeS and Cu2S produced by the decomposition of the above sulfides will continue to be oxidized or form copper matte, and the resulting S2 will continue to be oxidized into SO2 into the flue gas, as shown in Equation (17).
- 2.
- Oxidation reaction of sulfides. In the Isa furnace, in addition to the decomposition reaction, the sulfide will be directly oxidized, the oxidation reaction will occur, and some will be reduced to high-valence oxides, as shown in Equations (18)–(22).
- 3.
- Reaction between sulfides and oxides. The oxidation reaction in the Isa furnace is intense, and the reaction product will contain a small amount of Cu2O and Fe3O4. In the separation process of matte and slag in the electric furnace, the sulfide in the matte will further react with the metal oxide in the slag, as shown in Equations (23) and (24).
- 4.
- Slagging reaction. The impurities in the molten copper are removed by adding a slagging agent to produce a slagging reaction, as shown in Equations (25) and (26).
4.1.2. Model Parameter Settings
4.2. Data Preprocessing and Variable Screening
4.3. Data Enhancement and Data Fusion Results and Analysis
4.3.1. Quality Evaluation of Generated Data
4.3.2. Visualization of Generated Data
4.4. Prediction Results and Analysis of Matte Grade
4.4.1. Evaluation Index of Matte Grade Prediction Model
4.4.2. Visualization of Matte Grade Prediction Results
4.5. Interpretability Analysis
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Zhao, L.; Zhu, D.F.; Liu, D.F.; Wang, H.T.; Xiong, Z.M.; Jiang, L. Prediction and Optimization of Matte Grade in ISA Furnace Based on GA-BP Neural Network. Appl. Sci. 2023, 13, 4246. [Google Scholar] [CrossRef]
- Wang, G.B.; Yang, Y.B.; Zhou, S.W.; Li, B.; Wei, Y.G.; Wang, H. Data Analysis and Prediction Model for Copper Matte Smelting Process. Metall. Mater. Trans. 2024, 55, 2552–2567. [Google Scholar] [CrossRef]
- Yu, S.Y.; Wang, J.L.; Peng, X.B. Prediction model of craft parameters based on neural network during the process of copper flash smelting. J. Cent. South Univ. (Sci. Technol.) 2007, 38, 523–527. [Google Scholar]
- Gui, W.H.; Wang, L.Y.; Yang, C.H.; Xie, Y.F.; Peng, X.B. Intelligent prediction model of matte grade in copper flash smelting process. Trans. Nonferrous Met. Soc. China 2007, 17, 1075–1081. [Google Scholar] [CrossRef]
- Yang, C.H.; Xie, M.; Gui, W.H.; Peng, X.B. A Prediction Model for Matte Grade in Copper Flash Smelting Process. Inf. Control. 2008, 37, 28–33. [Google Scholar]
- Peng, X.B.; Gui, W.H.; Li, Y.G.; Wang, L.Y.; Chen, Y. Copper flash smelting parameter soft sensor based on dynamic T-S recurrent fuzzy neural network. Chin. J. Sci. Instrum. 2008, 29, 2029–2033. [Google Scholar]
- Liu, J.H.; Gui, W.H.; Xie, Y.F.; Wang, Y.L.; Jiang, Z.H. Key process indicators predicting for copper flash smelting process based on projection pursuit regression. Chin. J. Nonferrous Met. 2012, 22, 3255–3260. [Google Scholar]
- Zhang, X.L.; Yao, S.W.; Hu, J.H.; Dong, R.S.; Wang, H. Adaptive Soft Measurement of Process Parameters of ISA Furnace during Copper Melting Based on Generalized Maximum Entropy Regression. J. Kunming Univ. Sci. Technol. (Nat. Sci. Ed.) 2012, 37, 19–25+67. [Google Scholar]
- He, M.Q.; Yu, G.; Yang, C.; Han, L. Dynamic soft sensor modeling of matte grade in copper oxygen-rich side blow bath smelting process. Measurement 2023, 223, 113792. [Google Scholar]
- Ge, Y.Z.; Xu, X.; Yang, S.R.; Zhou, Q.; Shen, F.R. Survey on Sequence Data Augmentation. J. Front. Comput. Sci. Technol. 2021, 15, 1207–1219. [Google Scholar]
- Kegel, L.; Hahmann, M.; Lehner, W. Feature-based comparison and generation of time series. In Proceedings of the 30th International Conference on Scientific and Statistical Database Management, Bozen-Bolzano, Italy, 9–11 July 2018; pp. 1–12. [Google Scholar]
- Goodfellow, I.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Qzair, S.; Courville, A.; Bengio, Y. Generative adversarial networks. Commun. ACM 2020, 63, 139–144. [Google Scholar] [CrossRef]
- Ma, Z.R.; Wang, J.J.; Feng, Y.S.; Wang, R.K.; Zhao, Z.H.; Chen, H.W. Hydrogen yield prediction for supercritical water gasification based on generative adversarial network data augmentation. Appl. Energy 2023, 49, 120814. [Google Scholar] [CrossRef]
- Hao, X.C.; Dang, H.; Zhang, Y.X.; Liu, L.; Huang, G.L.; Zhang, Y.F.; Liu, J.B. SSP-WGAN-Based Data Enhancement and Prediction Method for Cement Clinker f-CaO. IEEE Sens. J. 2022, 22, 22741–22753. [Google Scholar] [CrossRef]
- Chen, Z.S.; Hou, K.R.; Zhu, M.Y.; Xu, Y.; Zhu, Q.X. A virtual sample generation approach based on a modified conditional GAN and centroidal Voronoi tessellation sampling to cope with small sample size problems: Application to soft sensing for chemical process. Appl. Soft Comput. J. 2021, 21, 107070. [Google Scholar] [CrossRef]
- Wu, Y.J.; Li, Z.X.; Wang, Y.Z.; Guo, W.H.; Lu, B.H. Study on the Process Window in Wire Arc Additive Manufacturing of a High Relative Density Aluminum Alloy. Metals 2024, 14, 330. [Google Scholar] [CrossRef]
- Chen, Z.S.; Zhu, M.Y.; He, Y.L.; Xu, Y.; Zhu, Q.X. Quantile regression CGAN based virtual samples generation and its applications to process modeling. CIESC J. 2021, 72, 1529–1538. [Google Scholar]
- Yao, Z.J.; Zhao, C.H.; Li, Y.L.; Fu, C.; Qiao, H.L. Customized generative adversarial data imputation model for industrial soft sensing. Control. Decis. 2021, 36, 2929–2936. [Google Scholar]
- Gao, F.; Shao, X.Y. Prediction of annual electricity consumption based on feature selection and iJaya-SVR. Control. Decis. 2024, 39, 1039–1047. [Google Scholar]
- Zhang, S.F.; Li, T.M.; Hu, C.H.; Du, D.B.; Si, X.S. Missing data generation method and its application in remaining useful life prediction based on deep convolutional generative adversarial network. Acta Aeronaut. Astronaut. Sin. 2022, 43, 441–455. [Google Scholar]
- Boto, F.; Murua, M.; Gutierrez, T.; Casado, S.; Carrillo, A. Data Driven Performance Prediction in Steel Making. Metals 2022, 12, 172. [Google Scholar] [CrossRef]
- Huang, Q.Y.; Yan, N.; Zhong, X.J. Wind Power Ramping Events Prediction Based On Generative Adversarial Network. Acta Energiae Solaris Sin. 2023, 44, 226–231. [Google Scholar] [CrossRef]
- Hao, X.C.; Liu, L.; Huang, G.L.; Zhang, Y.X.; Zhang, Y.F.; Dang, H. R-WGAN-based multitimescale enhancement method for predicting f-CaO cement clinker. IEEE Trans. Instrum. Meas. 2021, 71, 1–10. [Google Scholar] [CrossRef]
- Ma, J.Y.; Liang, P.W.; Yu, W.; Chen, C.; Guo, X.J.; Wu, J.; Jiang, J.J. Infrared and visible image fusion via detail preserving adversarial learning. Inf. Fusion 2020, 54, 85–98. [Google Scholar] [CrossRef]
- Chang, J.T.; Qiao, Z.X.; Kong, X.G.; Yang, S.K.; Luo, C.W. Novel Product Duration Prediction Method of Complicated Product Based on Multi-Dimensional Nonlinear Feature Reconstruction and Fusion. J. Mech. Eng. 2023, 59, 294–308. [Google Scholar]
- Zhao, H.L.; Lu, T.T.; Yin, P.; Mu, L.Z.; Liu, F.Q. An Experimental and Simulated Study on Gas-Liquid Flow and Mixing Behavior in an ISASMELT Furnace. Metals 2019, 9, 565. [Google Scholar] [CrossRef]
- Yan, L.Q.; Wang, Z.L. Multi-step predictive soft sensor modeling based on STA-BiLSTM-LightGBM combined model. CIESC J. 2023, 74, 3407–3418. [Google Scholar]
- Liu, C.H.; Li, W.L.; Jiao, J.; Wang, J.X.; Zhang, J.N. An Interpretable Cloud Platform Task Termination State Prediction Method. J. Comput. Res. Dev. 2024, 61, 716–727. [Google Scholar]
Positive Correlation Variables | Description | Negative Correlation Variables | Description |
---|---|---|---|
X1 | Oxygen concentration | X7 | Fe content of flux silicon material |
X2 | Blowing air volume | X8 | H2O content of flux silicon material |
X3 | Amount of diesel fuel added | X11 | Ca content in copper concentrate |
X4 | Amount of coal added | X12 | Fe content in copper concentrate |
X5 | Slagging agent silicon addition | X13 | Zn content in copper concentrate |
X6 | Si content of flux silicon material | X14 | H2O content in copper concentrate |
X9 | Copper concentrate addition | X15 | S content in copper concentrate |
X10 | Cu content in copper concentrate | X16 | Si content in copper concentrate |
Y | Matte grade | X17 | As content in copper concentrates |
Model | Generator | Discriminator |
---|---|---|
RGAN | ReLU × 4 + Sigmoid × 1 | LeakyReLU × 4 + Sigmoid × 1 |
LRGAN | LeakyReLU × 4 + Sigmoid × 1 | LeakyReLU × 4 + Sigmoid × 1 |
PRGAN | PReLU × 4 + Sigmoid × 1 | LeakyReLU × 4 + Sigmoid × 1 |
Parameter Name | Parameter Setting |
---|---|
n_epoch | 1000 |
batch_size | 64 |
noise_dim | 128 |
learning rate | 0.0005 |
criterion | BCELoss |
optimization algorithm | Adam |
Parameter Name | Parameter Setting |
---|---|
n_estimators | 150 |
criterion | MSE |
max_depth | 45 |
min_samples_split | 2 |
min_samples_leaf | 5 |
max_features | Auto |
Data to Be Fused | The Data Obtained after Fusion |
---|---|
D1D2 | Df1 |
D1D3 | Df2 |
D2D3 | Df3 |
D1D2D3 | Df4 |
Model | RMSE | R2 | Ci | Wi |
---|---|---|---|---|
MRMR_RGAN_RF (D1) | 0.7241 | 0.8237 | 1.1376 | 0.4652 |
MRMR_LRGAN_RF (D2) | 0.7038 | 0.8585 | 1.2198 | 0.5348 |
Model | RMSE | R2 | Ci | Wi |
---|---|---|---|---|
MRMR_RGAN_RF (D1) | 0.7241 | 0.8237 | 1.1376 | 0.5243 |
MRMR_PRGAN_RF (D3) | 0.7414 | 0.8033 | 1.0835 | 0.4757 |
Model | RMSE | R2 | Ci | Wi |
---|---|---|---|---|
MRMR_LRGAN_RF (D2) | 0.7038 | 0.8585 | 1.2198 | 0.5590 |
MRMR_PRGAN_RF (D3) | 0.7414 | 0.8033 | 1.0835 | 0.4410 |
Model | RMSE | R2 | Ci | Wi |
---|---|---|---|---|
MRMR_RGAN_RF (D1) | 0.7241 | 0.8237 | 1.1376 | 0.3229 |
MRMR_LRGAN_RF (D2) | 0.7038 | 0.8585 | 1.2198 | 0.3981 |
MRMR_PRGAN_RF (D3) | 0.7414 | 0.8033 | 1.0835 | 0.2790 |
Model | RMSE | MAE | MAPE | R2 |
---|---|---|---|---|
LR | 1.0826 | 0.4568 | 0.7893 | 0.6753 |
SVR | 0.9579 | 0.4288 | 0.7341 | 0.7061 |
LSTM | 0.8938 | 0.4093 | 0.6873 | 0.7269 |
BP | 0.9361 | 0.4206 | 0.7198 | 0.7195 |
RF | 0.8498 | 0.3691 | 0.6251 | 0.7628 |
Model | RMSE | MAE | MAPE | R2 |
---|---|---|---|---|
MRMR_RF | 0.7931 | 0.3447 | 0.5803 | 0.7813 |
MRMR_RGAN_RF | 0.7241 | 0.3152 | 0.5398 | 0.8237 |
MRMR_LRGAN_RF | 0.7038 | 0.2985 | 0.5097 | 0.8585 |
MRMR_PGAN_RF | 0.7414 | 0.3253 | 0.5513 | 0.8033 |
MRMR_RGAN + LRGAN_RF | 0.6876 | 0.2911 | 0.4921 | 0.8727 |
MRMR_RGAN + PRGAN_RF | 0.7164 | 0.3114 | 0.5327 | 0.8476 |
MRMR_LRGAN + PRGAN_RF | 0.7011 | 0.3081 | 0.5193 | 0.8623 |
MRMR_EGAN(RGAN + LRGAN + PRGAN)_RF | 0.6653 | 0.2805 | 0.4837 | 0.8815 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ma, H.; Li, Z.; Shu, B.; Yu, B.; Ma, J. Enhanced Generative Adversarial Networks for Isa Furnace Matte Grade Prediction under Limited Data. Metals 2024, 14, 916. https://doi.org/10.3390/met14080916
Ma H, Li Z, Shu B, Yu B, Ma J. Enhanced Generative Adversarial Networks for Isa Furnace Matte Grade Prediction under Limited Data. Metals. 2024; 14(8):916. https://doi.org/10.3390/met14080916
Chicago/Turabian StyleMa, Huaibo, Zhuorui Li, Bo Shu, Bin Yu, and Jun Ma. 2024. "Enhanced Generative Adversarial Networks for Isa Furnace Matte Grade Prediction under Limited Data" Metals 14, no. 8: 916. https://doi.org/10.3390/met14080916
APA StyleMa, H., Li, Z., Shu, B., Yu, B., & Ma, J. (2024). Enhanced Generative Adversarial Networks for Isa Furnace Matte Grade Prediction under Limited Data. Metals, 14(8), 916. https://doi.org/10.3390/met14080916