Progress towards an HF Radar Wind Speed Measurement Method Using Machine Learning
Abstract
:1. Introduction
2. Materials and Methods
2.1. Data Sets
2.2. Methods
- Identify radar features/metocean parameters that may be linked to wind speed.
- Apply machine learning (ML) methods using these features for a subset of the data (training set) and the available wind product to develop the wind speed measurement model
- Test the model on a different subset of the data (testing set).
- Evaluate the results and select the best ML method for these data.
- Apply the best model to data sets not included in the above to determine whether the method is robust to changes in location, frequency, depth, etc.
2.2.1. Radar Parameters
2.2.2. Machine Learning Methods
3. Results
3.1. Statistics
3.2. Time Series and Maps
4. Discussion
- Lack of in situ wind measurements covering a wide enough range of radar frequencies, geometries and water depths. It is not really satisfactory to use model data since, at least in part, the purpose of providing a radar measurement is to validate or reveal errors in model data. In addition, it is necessary to establish whether the extra variability on time scales of less than six hours seen in the radar data are accurate or only reflecting statistical uncertainty in the radar measurements. We are intending to look at combining the data sets from the different sites to explore the possibility of a more generally applicable method, although this would be more satisfying if we had in-situ measured data in all cases. The use of autonomous surface vehicles to provide low-cost wind observations at multiple locations across a radar coverage area has been suggested [20]. Such an approach could be helpful in the Celtic Sea although a long trial would be needed to provide enough metocean variability. However, since the accuracies achieved in this work are so much better than the currently used algorithms, using model winds for a site specific ML model where wind speeds are likely to be useful could be a first step.
- Radar data errors. All the data sets presented here were collected over 10 years ago and improvements in radar data control and signal processing could lead to better results for this type of analysis when new radar data sets with local in-situ wind measurements become available.
- Quality control of the metocean measurements has been the subject of a lot of work [27], and all recommended filters have been applied to the data sets used here. However, better quality control of the radar feature measurements is probably required. For example, signal-to-noise limits need to be determined and estimates using single Doppler frequencies, which can have high statistical uncertainty, could be replaced with local means or centres of gravity.
- Choice of ML method and the associated hyperparameters. There is scope for more experimentation here including use of neural networks. As has been reported in Section 2.2.2, we have used the SKlearn GridSearchCV module but so far only in a limited way.
- Selection of features. It is clear that not all features have the same weight in the SVR method. There may be scope to simplify the modelling by removing features of low or negative importance. However, the relative importance of the features was found to vary for the different sites as can be seen in Figure 9 so any reduction needs to be done with care. Not surprisingly, the models obtained are different at each site so a transportable method has not yet been developed, although, as seen in Figure 8 and Table 5, accuracies are not so different.
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Huang, W.; Gill, E.W. (Eds.) Ocean Remote Sensing Technologies—High-Frequency, Marine and GNSS-Based Radar; SciTech Publishing: Luxembourg, 2021. [Google Scholar]
- Fujii, S.; Heron, M.L.; Kim, K.; Lai, J.W.; Lee, S.H.; Wu, X.; Wu, X.; Wyatt, L.R.; Yang, W.C. An Overview of Developments and Applications of Oceanographic Radar Networks in Asia and Oceania Countries. Ocean Sci. J. 2013, 48, 69–97. [Google Scholar] [CrossRef]
- Wyatt, L. The IMOS Ocean Radar Facility, ACORN. In Coastal Ocean Observing Systems; Elsevier: Amsterdam, The Netherlands, 2015; pp. 143–158. [Google Scholar] [CrossRef]
- Rubio, A.; Mader, J.; Corgnati, L.; Mantovani, C.; Griffa, A.; Novellino, A.; Quentin, C.; Wyatt, L.; Shulz-Stellenfleth, J.; Horstmann, J.; et al. HF Radar Activity in European Coastal Seas: Next, Steps Toward a Pan-European HF Radar Network. Front. Mar. Sci. 2017, 4, 8. [Google Scholar] [CrossRef] [Green Version]
- Roarty, H.; Cook, T.; Hazard, L.; George, D.; Harlan, J.; Cosoli, S.; Wyatt, L.; Alvarez Fanjul, E.; Terrill, E.; Otero, M.; et al. The Global High Frequency Radar Network. Front. Mar. Sci. 2019, 6, 164. [Google Scholar] [CrossRef]
- Wyatt, L. Ocean wave measurement. In Ocean Remote Sensing Technologies—High-Frequency, Marine and GNSS-Based Radar; Huang, W., Gill, E.W., Eds.; SciTech Publishing: Raleigh, NC, USA, 2021; pp. 145–178. [Google Scholar]
- Wyatt, L.R.; Green, J.J.; Middleditch, A.; Moorhead, M.D.; Howarth, J.; Holt, M.; Keogh, S. Operational wave, current and wind measurements with the Pisces HF radar. IEEE J. Ocean. Eng. 2006, 31, 819–834. [Google Scholar] [CrossRef]
- Lopez, G.; Conley, D.C. Comparison of HF Radar Fields of Directional Wave Spectra Against In Situ Measurements at Multiple Locations. J. Mar. Sci. Eng. 2019, 7, 271. [Google Scholar] [CrossRef] [Green Version]
- Wyatt, L.R.; Ledgard, L.; Anderson, C. Maximum likelihood estimation of the directional distribution of 0.53Hz ocean waves. J. Atmos. Ocean. Tech. 1997, 14, 591–603. [Google Scholar] [CrossRef]
- Wyatt, L.R. A comparison of scatterometer and HF radar wind direction measurements. J. Oper. Oceanogr. 2018, 11, 54–63. [Google Scholar] [CrossRef]
- Wyatt, L.R. Spatio-temporal metocean measurements for offshore wind power. J. Energy Power Technol. 2021, 3, 15. [Google Scholar] [CrossRef]
- Barrick, D.E. First order theory and analysis of MF/HF/VHF scatter from the sea. IEEE Trans. Antenn. Propag. 1972, 20, 2–10. [Google Scholar] [CrossRef] [Green Version]
- Barrick, D.E. Remote sensing of sea state by radar. In Remote Sensing of the Troposphere; Derr, V.E., Ed.; GPO: Washington, DC, USA, 1972; Chapter 12. [Google Scholar]
- Merz, C.R.; Liu, Y.; Weisberg, R.H. Sea surface current mapping with HF radar—A primer. In Ocean Remote Sensing Technologies—High-Frequency, Marine and GNSS-Based Radar; Huang, W., Gill, E.W., Eds.; SciTech Publishing: Raleigh, NC, USA, 2021; pp. 95–116. [Google Scholar]
- Emery, B.; Kirincich, A. HF radar observations of nearshore winds. In Ocean Remote Sensing Technologies—High-Frequency, Marine and GNSS-Based Radar; Huang, W., Gill, E.W., Eds.; SciTech Publishing: Raleigh, NC, USA, 2021; pp. 191–216. [Google Scholar]
- Dexter, P.; Theodorides, S. Surface wind speed extraction from HF sky-wave radar Doppler spectra. Radio Sci. 1982, 17, 643–652. [Google Scholar] [CrossRef]
- Zeng, Y.; Zhou, H.; Roarty, H.; Wen, B. Wind speed inversion in high frequency radar based on neural network. Int. J. Antennas Propag. 2016, 2016, 2706521. [Google Scholar] [CrossRef] [Green Version]
- Vesecky, J.; Drake, J.A.; Laws, K.; Ludwig, F.L.; Teague, C.C.; Meadows, L.A. Using multifrequency HF radar to estimate ocean wind fields. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Anchorage, AK, USA, 20–24 September 2004; pp. 1167–1170. [Google Scholar]
- Shen, W.; Gurgel, K.-W.; Voulgaris, G.; Schlick, T.; Stammer , D. Wind-speed inversion from HF radar first-order backscatter signal. Ocean Dynam. 2012, 62, 105–121. [Google Scholar] [CrossRef]
- Kirincich, A. Remote Sensing of the Surface Wind Field over the Coastal Ocean via Direct Calibration of HF Radar Backscatter Power. J. Atmos. Ocean. Tech. 2016, 33, 1377–1392. [Google Scholar] [CrossRef]
- Meteo-France; Ifremer; MET Norway; DMI; KNMI. OSI SAF Product Requirement Document Version 1.4. Available online: http://www.osi-saf.org/sites/default/files/dynamic/public_doc/osisaf_cdop3_gen_prd_1.4.pdf (accessed on 20 March 2022).
- Meteo-France; Ifremer; MET Norway; DMI; KNMI. OSI SAF Half-Yearly Operations Report, 1st Half 2021, Version 1.1. Available online: https://osi-saf.eumetsat.int/documentation/project-documentation (accessed on 20 March 2022).
- DNV GL; Frazer-Nash Consultancy; Multiversum Consulting; Fraunhofer IWES. Carbon Trust Offshore Wind Accelerator Roadmap for the Commercial Acceptance of Floating LiDAR Technology, Version 2.0; Carbon Trust: London, UK, 2018. [Google Scholar]
- Howarth, M.J.; Proctor, R.; Smithson, M.J.; Player, R.; Knight, P. The Liverpool Bay Coastal Observatory. In Proceedings of the IEEE/OES Eighth Working Conference on Current Measurement Technology, Southampton, UK, 28–29 June 2005. [Google Scholar] [CrossRef] [Green Version]
- Lopez, G.; Conley, D.; Greaves, D. Calibration, validation and analysis of an empirical algorithm for the retrieval of wave spectra from HF radar sea-echo. J. Atmos. Ocean. Tech. 2015, 33, 245–261. [Google Scholar] [CrossRef]
- National Network of Regional Coastal Monitoring Programmes of England. Available online: http://www.coastalmonitoring.org (accessed on 22 February 2022).
- Wyatt, L.R.; Green, J.J.; Middleditch, A. HF radar data quality requirements for wave measurement. Coast. Eng. 2011, 58, 327–336. [Google Scholar] [CrossRef]
- Wyatt, L.R. An evaluation of wave parameters measured using a single HF radar system. Can. J. Remote Sens. 2002, 28, 205–218. [Google Scholar] [CrossRef]
- Tucker, M.J. Waves in Ocean Engineering Measurement, Analysis, Interpretation; Ellis Horwood: Chichester, UK, 1991. [Google Scholar]
- Gaffard, C.; Parent, J. Remote sensing of wind sped at sea surface level using HF skywave echoes from decametric waves. Geophys Res. Lett. 1990, 17, 615–618. [Google Scholar] [CrossRef]
- Kingsley, S.; Matoses, A.; Wyatt, L. Analysis of second order HF radar sea spectra recorded in storm conditions. In Proceedings of the IEEE Oceanic Engineering Society. OCEANS’98. Conference (Cat. No.98CH36259), Nice, France, 28 September–1 October 1998; Volume 1, pp. 459–462. [Google Scholar] [CrossRef]
- Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
- Scikit-Learn. Available online: https://scikit-learn.org/stable/ (accessed on 24 February 2022).
- Smola, A.J.; Schölkopf, B. A tutorial on support vector regression. Stat. Comput. 2004, 14, 199–222. [Google Scholar] [CrossRef] [Green Version]
- Kundu, P.K. Ekman veering observed near the ocean bottom. J. Phys. Oceanogr. 1976, 6, 238–242. [Google Scholar] [CrossRef]
Source | Method | rms/sep ms | SI | SI | Bias ms | Correlation Coeff | Max Speed ms |
---|---|---|---|---|---|---|---|
[7] | Inverse wave model [16] | 5.188 | 0.35 | 15.0 | |||
[18] | PLS | 1 | −0.4 | 0.8 | 14 | ||
[19] | NN using peaks | 2.07 | 0.1 | 0.84 | 20 | ||
[19] | NN using spreading | 2.8 | 0.14 | 0.67 | 20 | ||
[15] | First-order model [20] | 1.89 | 0.19 | 10 | |||
[17] | NN using metocean | 1.7 | 0.34 | 0.13 | 1.37 | 0.68 | 13 |
Location | Sites | Radar | Dates | Frequency MHz | Wind ‘Truth’ |
---|---|---|---|---|---|
Liverpool Bay (LB) | Llandulais Formby | WERA | October 2005– February 2006 | 12.45–13.43 | In Situ anemometer |
S Celtic Sea (SCS) | Perranporth Pendeen | WERA | November 2012 | 11.77–12.43 | Perranporth Coastal |
N Celtic Sea (NCS) | Nabor Point Castlemartin | Pisces | December 2003– June 2005 | 5.73–10.43 | Met Office Model |
Feature | RI | Reason |
---|---|---|
Bragg ratio (BR) | I | As wind speed increase the power in the spectrum increases in a way that depends on wind direction which in turn is related to the Bragg ratio. |
integrated central region | R | Signal from short wind waves [30] |
integrated second order | R | Used in empirical waveheight estimates and in part due to local wind |
integrated second order moment | R | Used in empirical period estimate |
2nd order ratio (rat2) | R | Depends on wave directions and amplitudes |
2nd order peak signal to noise (sn2) | R | Increases with increasing wind speed |
2nd order relative to 1st order (max12) | R | Decreases with increasing wind speed |
2nd order slope | R | Reduces as wind speed increases [31] |
water depth | I | 2nd order power for same wave conditions varies with water depth |
radar frequency | I | as for depth |
radial current speed | R | Part of current may be related to wind speed |
radial (or beam) direction | I | Influences the radial current speed |
vector current speed, u- v-components | R | as above |
wind direction | I | as for Bragg ratio |
short wave directional spreading | R | Empirical evidence from many sources that this is linked to wind speed e.g., [29] |
Feature | LB | SCS1 | SCS2 | NCS |
---|---|---|---|---|
integrated central region | 0.01/0.03 | 0.36/−0.21 | 0.29/−0.02 | 0.21/0.04 |
integrated second order | 0.53/0.63 | 0.25/0.48 | 0.25/0.31 | 0.38/0.48 |
integrated second order moment | 0.47/0.5 | −0.01/0.05 | −0.05/−0.05 | 0.05/0.23 |
rat2 | 0.01/−0.28 | −0.14/0.13 | −0.07/−0.14 | 0.09/0.12 |
sn2 | 0.37/0.59 | −0.01/0.37 | 0.06/0.23 | 0.19/0.41 |
max12 | −0.37/−0.57 | −0.06/−0.49 | −0.19/−0.3 | −0.35/−0.5 |
2nd order slope | 0.44/0.45 | −0.06/−0.02 | 0.0/−0.06 | 0.3/0.37 |
radial current speed | −0.1/−0.06 | −0.04/−0.28 | 0.0/−0.11 | −0.11/−0.09 |
vector current speed | −0.16 | 0.03 | 0.1 | 0.1 |
u | 0.07 | 0.08 | 0.02 | 0.12 |
v | −0.19 | −0.16 | −0.16 | −0.02 |
short wave directional spreading | 0.45 | 0.29 | 0.23 | 0.33 |
Statistic | LB | SCS1 | SCS2 | NCS | ||||
---|---|---|---|---|---|---|---|---|
Train | Test | Train | Test | Train | Test | Train | Test | |
N | 892 | 892 | 629 | 70 | 642 | 72 | 5396 | 5396 |
bias, ms | 0.02 | 0.27 | 0.05 | 0.63 | 0.05 | 0.56 | 0.04 | 0.14 |
MAE, ms | 0.74 | 1.18 | 1.15 | 1.68 | 1.13 | 1.58 | 1.05 | 1.45 |
rms, ms | 1.06 | 1.5 | 1.72 | 2.05 | 1.74 | 2.01 | 1.44 | 1.92 |
SI | 0.13 | 0.19 | 0.19 | 0.15 | 0.19 | 0.15 | 0.15 | 0.2 |
SI | 0.05 | 0.09 | 0.07 | 0.09 | 0.07 | 0.08 | 0.06 | 0.08 |
CC | 0.95 | 0.83 | 0.9 | 0.9 | 0.91 | 0.9 | 0.9 | 0.82 |
complex correlation coefficient | 0.94 | 0.92 | 0.93 | 0.95 | 0.93 | 0.96 | 0.91 | 0.91 |
mean direction difference, degrees | −0.04 | 0.13 | −2.18 | −6.02 | 5.05 | −0.76 | −3.76 | −4.16 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wyatt, L.R. Progress towards an HF Radar Wind Speed Measurement Method Using Machine Learning. Remote Sens. 2022, 14, 2098. https://doi.org/10.3390/rs14092098
Wyatt LR. Progress towards an HF Radar Wind Speed Measurement Method Using Machine Learning. Remote Sensing. 2022; 14(9):2098. https://doi.org/10.3390/rs14092098
Chicago/Turabian StyleWyatt, Lucy R. 2022. "Progress towards an HF Radar Wind Speed Measurement Method Using Machine Learning" Remote Sensing 14, no. 9: 2098. https://doi.org/10.3390/rs14092098
APA StyleWyatt, L. R. (2022). Progress towards an HF Radar Wind Speed Measurement Method Using Machine Learning. Remote Sensing, 14(9), 2098. https://doi.org/10.3390/rs14092098