X-Band Radar Attenuation Correction Method Based on LightGBM Algorithm
Abstract
:1. Introduction
2. Materials and Methods
2.1. Radar Data and Area of Interest
2.2. Traditional Attenuation Correction Algorithms
2.3. Construction of the X-Band Radar Attenuation Correction Model (XACL)
- (1)
- The X-band and S-band radar data with precipitation echo detection were screened out.
- (2)
- The polar coordinate conversion relationship between X-band radar and S-band radar was analyzed, and the reflectivity data were matched. The samples dataset is composed of X-band radar reflectivity (ZH), Doppler velocity (V), spectrum width (W), differential phase shift (φDP), differential phase shift rate (KDP), the copolarization correlation coefficient (ρHV), differential reflectivity (ZDR), the radial distance between the range gate and the radar antenna (ranges), average reflectivity between range gates and radar antenna (meanZH), and S-band radar reflectivity (S_ ZH).
- (3)
- The abnormal data in the matched samples dataset were removed. The criteria for excluding data are as follows: The machine learning model cannot produce meaningful results when there are null values in the sample, so samples with null values need to be removed, and the numerical difference between X-band radar and S-band radar reflectivity is greater than 50 dBZ and needs to be removed to avoid erroneous results.
- (1)
- After preprocessing shown in Figure 2, a dataset of 331,250 samples was obtained. Using five-fold cross-validation, the model was validated. The samples dataset is randomly shuffled and divided into five groups. One group takes turns as the test dataset and the other four groups as the training dataset.
- (2)
- The training dataset was imported into the LightGBM machine learning algorithm. LightGBM implements a GBDT framework composed of gradient boosting trees, and the trees are the classification and regression tree (CART) algorithm, which is a series of regression trees. This series of CARTs continuously fit the negative gradient of the loss function and accumulate the results of all weak learners (regression trees) to obtain the prediction result of the final model.
- (3)
- The test dataset was used to evaluate the model. The evaluation index was RMSE. The smaller the RMSE, the better the fitting of the model [31,32]. To obtain a model with a smaller RMSE, the model parameters of LightGBM were adjusted by Grid Search, a Python package. Using five-fold cross-validation, five models were obtained, and the model with the smallest RMSE was used.
- (4)
- After continuously adjusting the parameters to obtain the optimal model, nine features processed from X-band radar data were input into the model. Based on the fixed parameters, the model provides the predicted value, which is the corrected value of the X-band radar reflectivity.
2.4. Method of Radar Quantitative Precipitation Estimation
2.5. Evaluation of Model Results
2.6. The Contribution Degree of Each Feature Vector to the Model
3. Results and Discussion
3.1. Correction Effect Analysis
3.1.1. Images before and after Reflectivity Attenuation Correction
3.1.2. Evaluation of Radial Correction Effect
3.1.3. S-Band Radar Comparative Inspection
3.2. Application in Rainfall Case
3.2.1. Rainfall Case Overview
3.2.2. Radar Precipitation Estimation
4. Conclusions
Supplementary Materials
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Hobbs, P.V.; Persson, P.O.G. The mesoscale and microscale structure and organization of clouds and precipitation in midlatitude cyclones. Part V: The substructure of narrow cold-frontal rainbands. J. Atmos. Sci. 1982, 39, 280–295. [Google Scholar] [CrossRef]
- Lobaccaro, G.; De Ridder, K.; Acero, J.A.; Hooyberghs, H.; Lauwaet, D.; Maiheu, B.; Sharma, R.; Govehovitch, B. Applications of models and tools for mesoscale and microscale thermal analysis in mid-latitude climate regions—A review. Sustainability 2021, 13, 12385. [Google Scholar] [CrossRef]
- Whiton, R.C.; Smith, P.L.; Bigler, S.G.; Wilk, K.E.; Harbuck, A.C. History of operational use of weather radar by u.s. weather services. part ii: Development of operational doppler weather radars. Weather Forecast. 1998, 13, 244–252. [Google Scholar] [CrossRef]
- Yeary, M.; Cheong, B.L.; Kurdzo, J.M.; Yu, T.Y.; Palmer, R. A brief overview of weather radar technologies and instrumentation. IEEE Instrum. Meas. Mag. 2014, 17, 10–15. [Google Scholar] [CrossRef]
- Li, B.; Gu, Q.T.; Li, R.Y.; Cao, J.; Wang, X. Analyses on disastrous weather monitoring capability of cinrad and future development. Meteorol. Mon. 2013, 39, 265–280. [Google Scholar]
- Han, L.; Sun, J.; Zhang, W. Convolutional neural network for convective storm nowcasting using 3d doppler weather radar data. IEEE Trans. Geosci. Remote Sensing. 2019, 58, 1487–1495. [Google Scholar] [CrossRef]
- Prudden, R.; Adams, S.; Kangin, D.; Robinson, N.; Ravuri, S.; Mohamed, S.; Arribas, A. A review of radar-based nowcasting of precipitation and applicable machine learning techniques. arXiv 2020, arXiv:2005.04988. [Google Scholar] [CrossRef]
- Wu, B.; Wei, M.; Li, Y. Dual-Polarization Radar Observations of the Evolution of a Supercell Tornado and Analysis of the Echo Mechanisms. Atmosphere 2022, 13, 797. [Google Scholar] [CrossRef]
- Antonini, A.; Melani, S.; Corongiu, M.; Romanelli, S.; Mazza, A.; Ortolani, A.; Gozzini, B. On the implementation of a regional X-band weather radar network. Atmosphere 2017, 8, 25. [Google Scholar] [CrossRef]
- Snyder, J.C.; Bluestein, H.B.; Zhang, G.; Frasier, S.J. Attenuation correction and hydrometeor classification of high-resolution, x-band, dual-polarized mobile radar measurements in severe convective storms. J. Atmos. Ocean. Technol. 2010, 27, 1979–2001. [Google Scholar] [CrossRef]
- Delrieu, G.; Andrieu, H.; Creutin, J.D. Quantification of path-integrated attenuation for X-and C-band weather radar systems operating in Mediterranean heavy rainfall. J. Appl. Meteorol. 2000, 39, 840–850. [Google Scholar] [CrossRef]
- Bringi, V.N.; Chandrasekar, V.; Balakrishnan, N.; Zrni, D. An examination of propagation effects in rainfall on polarimetric variables at microwave frequencies. J. Atmos. Ocean. Technol. 1990, 7, 829–840. [Google Scholar] [CrossRef]
- Park, S.G.; Bringi, V.N.; Chandrasekar, V.; Maki, M.; Iwanami, K. Correction of radar reflectivity and differential reflectivity for rain attenuation at x band. part i: Theoretical and empirical basis. J. Atmos. Ocean. Technol. 2005, 22, 1621–1632. [Google Scholar] [CrossRef]
- Testud, J.; Le Bouar, E.; Obligis, E.; Ali-Mehenni, M. The rain profiling algorithm applied to polarimetric weather radar. J. Atmos. Ocean. Technol. 2000, 17, 332–356. [Google Scholar] [CrossRef]
- Gou, Y.; Chen, H.; Zheng, J. An improved self-consistent approach to attenuation correction for c-band polarimetric radar measurements and its impact on quantitative precipitation estimation—Sciencedirect. Atmos. Res. 2019, 226, 32–48. [Google Scholar] [CrossRef]
- Schneebeli, M.; Sakuragi, J.; Biscaro, T.; Angelis, C.F.; da Costa, I.C.; Morales, C.; Baldini, L.; Machado, L.A.T. Polarimetric x-band weather radar measurements in the tropics: Radome and rain attenuation correction. Atmos. Meas. Tech. 2012, 5, 2183–2199. [Google Scholar] [CrossRef]
- Kalogiros, J.; Anagnostou, M.N.; Anagnostou, E.N.; Montopoli, M.; Marzano, F.S. Evaluation of a new polarimetric algorithm for rain-path attenuation correction of x-band radar observations against disdrometer. IEEE Trans. Geosci. Remote Sens. 2013, 52, 1369–1380. [Google Scholar] [CrossRef]
- Kim, M.S.; Kwon, B.H. Attenuation correction of x-band radar reflectivity using adjacent multiple microwave links. Remote Sens. 2020, 12, 2133. [Google Scholar] [CrossRef]
- Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016. [Google Scholar]
- Jin, D.; Lu, Y.; Qin, J.; Cheng, Z.; Mao, Z. SwiftIDS: Real-time intrusion detection system based on LightGBM and parallel intrusion detection mechanism. Comput. Secur. 2020, 97, 101984. [Google Scholar] [CrossRef]
- Qi, M. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Neural Information Processing System; Curran Associates Inc.: Red Hook, NY, USA, 2017. [Google Scholar]
- Liu, X.; Duan, H.; Huang, W.; Guo, R.; Duan, B. Classified Early Warning and Forecast of Severe Convective Weather Based on LightGBM Algorithm. Atmos. Clim. Sci. 2021, 11, 284–301. [Google Scholar] [CrossRef]
- Ju, Y.; Sun, G.; Chen, Q.; Zhang, M.; Zhu, H.; Rehman, M.U. A model combining convolutional neural network and LightGBM algorithm for ultra-short-term wind power forecasting. IEEE Access 2019, 7, 28309–28318. [Google Scholar] [CrossRef]
- Zhang, C.; Wu, M.; Chen, J.; Chen, K.; Zhang, C.; Xie, C.; He, Z. Weather visibility prediction based on multimodal fusion. IEEE Access 2019, 7, 74776–74786. [Google Scholar] [CrossRef]
- Kramer, S.; Verworn, H.-R.; Redder, A. Improvement of X-band radar rainfall estimates using a microwave link. Atmos. Res. 2005, 77, 278–299. [Google Scholar] [CrossRef]
- Delrieu, G.; Caoudal, S.; Creutin, J.D. Feasibility of using mountain return for the correction of ground-based X-band weather radar data. J. Atmos. Ocean. Technol. 1997, 14, 368–385. [Google Scholar] [CrossRef]
- Hu, Z.; Liu, L.; Chu, R.; Jin, R. Comparison of different attenuation correction methods and their effects on estimated rainfall using X-band dual linear polarimetric radar. Acta Meteorol. Sin. 2008, 66, 251–261. [Google Scholar] [CrossRef]
- Matrosov, S.Y.; Clark, K.A.; Martner, B.E.; Tokay, A. X-band polarimetric radar measurements of rainfall. J. Appl. Meteorol. 2002, 41, 941–952. [Google Scholar] [CrossRef]
- Lakshmanan, V.; Smith, T.; Hondl, K.; Stumpf, G.J.; Witt, A. A real-time, three-dimensional, rapidly updating, heterogeneous radar merger technique for reflectivity, velocity, and derived products. Weather. Forecast. 2006, 21, 802–823. [Google Scholar] [CrossRef]
- Wu, C.; Liu, L.; Zhang, Z. Quantitative comparison algorithm between the S-band phased array radar and the CINRAD/SA and its preliminary application. Acta Meteorol. Sin. 2014, 72, 390–401. [Google Scholar] [CrossRef]
- Gong, R.; Fonseca, E.; Bogdanov, D.; Slizovskaia, O.; Gomez, E.; Serra, X. Acoustic scene classification by fusing LightGBM and VGG-net multichannel predictions. Proc. IEEE AASP Chall. Detect. Classif. Acoust. Scenes Events 2017, 1–4. Available online: https://dcase.community/documents/challenge2017/technical_reports/DCASE2017_Gong_189.pdf (accessed on 9 November 2022).
- Ge, D.; Gu, J.; Chang, S.; Cai, J. Credit card fraud detection using lightgbm model. In Proceedings of the 2020 International Conference on E-Commerce and Internet Technology (ECIT), Zhangjiajie, China, 22–24 April 2020; pp. 232–236. [Google Scholar]
- Hu, B.; Palta, M.; Shao, J. Properties of R2 statistics for logistic regression. Stat. Med. 2006, 25, 1383–1395. [Google Scholar] [CrossRef]
- Chen, T.; Xu, J.; Ying, H.; Chen, X.; Feng, R.; Fang, X.; Wu, J. Prediction of extubation failure for intensive care unit patients using light gradient boosting machine. IEEE Access 2019, 7, 150960–150968. [Google Scholar] [CrossRef]
Validation Rounds | RMSE | MAE | R2 |
---|---|---|---|
1 | 3.31 | 1.74 | 0.89 |
2 | 3.31 | 1.74 | 0.90 |
3 | 3.34 | 1.76 | 0.90 |
4 | 3.34 | 1.75 | 0.90 |
5 | 3.34 | 1.76 | 0.89 |
mean | 3.326 | 1.751 | 0.896 |
Number of Stations | Rain Rate Level (mm/h) | I1 (mm/h) | I2 (mm/h) | I3 (mm/h) | I4 (mm/h) | Rain Gauge I (mm/h) | ||||
---|---|---|---|---|---|---|---|---|---|---|
418 | 0–1.0 | 0.22 | 0.48 | 0.26 | 0.38 | 0.45 | 49.43 | 8.1 | 43.24 | 15.65 |
319 | 1.0–2.5 | 0.68 | 1.25 | 0.73 | 1.04 | 1.6 | 57.5 | 21.87 | 54.37 | 35 |
290 | 2.5–5.0 | 1.36 | 2.87 | 1.71 | 2.61 | 3.51 | 62.25 | 18.23 | 51.28 | 26.64 |
94 | 5.0–8.0 | 2.26 | 4.51 | 2.69 | 4.19 | 6.19 | 63.49 | 27.14 | 56.54 | 32.32 |
74 | 8.0–16.0 | 3.39 | 7.38 | 3.91 | 6.16 | 10.45 | 70.81 | 29.38 | 62.58 | 41.05 |
13 | >16.0 | 5.85 | 15.86 | 8.39 | 13.24 | 23.32 | 75.9 | 32 | 64.02 | 43.22 |
Total average | 1.03 | 2.15 | 1.23 | 1.88 | 2.79 | 57.09 | 17.21 | 50.21 | 26.28 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yang, Q.; Feng, Y.; Guan, L.; Wu, W.; Wang, S.; Li, Q. X-Band Radar Attenuation Correction Method Based on LightGBM Algorithm. Remote Sens. 2023, 15, 864. https://doi.org/10.3390/rs15030864
Yang Q, Feng Y, Guan L, Wu W, Wang S, Li Q. X-Band Radar Attenuation Correction Method Based on LightGBM Algorithm. Remote Sensing. 2023; 15(3):864. https://doi.org/10.3390/rs15030864
Chicago/Turabian StyleYang, Qiang, Yan Feng, Li Guan, Wenyu Wu, Sichen Wang, and Qiangyu Li. 2023. "X-Band Radar Attenuation Correction Method Based on LightGBM Algorithm" Remote Sensing 15, no. 3: 864. https://doi.org/10.3390/rs15030864
APA StyleYang, Q., Feng, Y., Guan, L., Wu, W., Wang, S., & Li, Q. (2023). X-Band Radar Attenuation Correction Method Based on LightGBM Algorithm. Remote Sensing, 15(3), 864. https://doi.org/10.3390/rs15030864