Next Article in Journal
An Efficient Multi-AUV Cooperative Navigation Method Based on Hierarchical Reinforcement Learning
Previous Article in Journal
Factors Controlling the Pore Development of Low-Mature Marine–Continental Transitional Shale: A Case Study of the Upper Permian Longtan Shale, Western Guizhou, South China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Incoherent Shallow-Water Seabed Logging Using Numerical-Model-Based Optimization for the Prediction of Unperturbed UEP Signatures

1
General and Theoretical Electrical Engineering (ATE), University of Duisburg–Essen, and CENIDE—Center for Nanointegration Duisburg–Essen, D-47048 Duisburg, Germany
2
Technical Center for Ships and Naval Weapons, Naval Technology and Research (WTD71), Bundeswehr, D-24340 Eckernfoerde, Germany
*
Author to whom correspondence should be addressed.
J. Mar. Sci. Eng. 2023, 11(10), 1864; https://doi.org/10.3390/jmse11101864
Submission received: 3 August 2023 / Revised: 14 September 2023 / Accepted: 21 September 2023 / Published: 26 September 2023
(This article belongs to the Section Marine Environmental Science)

Abstract

:
Underwater electric potential (UEP) ship signatures are evaluated at a test site that provides only incoherent data from electric field sensors placed on the seabed. This paper shows how these data sets can be used to extract significant seabed parameters, which are evaluated by a numerical model combined with an optimization process in the frequency range from 1 Hz up to 100 kHz. This is in contrast to the controlled electromagnetic source technology used by geophysicists, which has to track both phase and amplitude, and, therefore, cannot simply be applied to data from per se stationary systems. Using the aforementioned frequency range within COMSOL Multiphysics (v6.0), the finite-element-based simulation software, a sensitivity analysis of seabed parameter behavior within a seabed depth range from 1 m to 20 m is evaluated for the highest sensitivity for each of the measurable field amplitudes of the locally available sensors. From this, the electrical conductivities of two seabed layers and the depth of the first layer can be extracted using a combination of a genetic algorithm and the Nelder–Mead method. In summary, phase information is not required to characterize the stratified seabed, providing a cost-effective approach to obtaining effective environmental conditions for free-water signature calculations.

1. Introduction

In the context of maritime security and vessel protection, the measurement of the underwater electrical potential (UEP) signature is becoming more important with regard to the rising threats of modern naval mine technology. This signature is the result of electrolytic corrosion between different metals in an electrolytic solution as well as the corrosion protection systems used. For example, the use of protective coatings (passive) or impressed current anodes (active) contributes to the resulting current flow in the solution. Together with the electrical conductivity σ , a current density J results in a measurable electric field E known as the UEP signature. In order to obtain the ship’s lowest possible UEP signature in the open sea, measurements of the ship are taken at a local site with sensors placed close to the seabed. However, the data received is subject to distortion due to the local environmental conditions. The desired UEP signature of the vessel extracted from the measurement data should ultimately result in a location-independent signature, called the free-water signature. De-embedding the environmental setup can be achieved by a seabed logging (SBL) method using incoherent AC-excited field information.
To resolve the distortions from the local seawater-seabed environment, it is necessary to determine the local stratification parameters of seawater and especially the seabed. To determine the parameters of the surrounding seawater profile, a probe can be used which measures the conductivity, temperature and the depth, called a CTD-probe in short. The more complicated task is to isolate the seabed parameters, which are also included in the field measurements. These measurements are recorded by field sensors that are placed on the seabed and, thus, receive a non-negligible influence from it. For high accuracy and successful decomposition of the measured object from environmental conditions, the extraction of the seabed parameters at the measurement site is of significant importance. Only with knowledge of the local seabed parameters can the ship’s signature be identified precisely to estimate the risk of detection at different locations at sea.
In order to obtain information about the free-water UEP signature, different methods can be used to solve the given inverse problem. In the field of underwater communications, for example, methods for locating objects near the seabed have been researched for many years [1,2]. In recent years, an attempt to compute shallow water signatures from stationary signatures was published by a group in 2022, which is based on an analytical computational model [3]. For numerical models, a PSO optimization method was presented in 2020 to perform inversions of UEP signatures associated with the representation of vessels emitting only DC signatures [4].
As a solution to unravel the local structure of the site, seabed logging techniques are used here. Different exploration methods for these techniques have been applied by geophysicists around the world for several decades now. The controlled source electromagnetics (CSEM) method is commonly used in underwater EM seabed exploration, and utilizes a source such as a dipole [5,6,7] or a coil system [8,9] under a defined applied current which acts as a transmitter and/or receiver that transmits signals into the stratified seabed and surrounding seawater, which are subsequently detected by coupled receivers. The commonly used systems are coherent systems using the phase information in time domain (TD) analysis, in which the transit times of the emitted signals in the individual layers are evaluated [10]. As early as 1968, Chessmann, Edwards and Chave presented an overview of seabed logging by using an EM source with a transient evaluation technique and outlined the relationship between the transient field distribution and the electrical conductivities in the layers [11]. Thereby, the signals used could be stationary or frequency-dependent in a very low range from 0.1 Hz up to 10 Hz, all including phase detection. Most of the systems use TD analysis, which reaches its limits in shallow water regions. There, reflections from the water surface are superimposed upon the response from hydrocarbon (HC) deposits, making it difficult to determine the exact location. To determine the parameters at shallow seabed depths, a TD method has been applied by a Swedish group to proprietary exploration systems with a coupled transmitter and receiver, whose electric dipole transmitter-receiver system can create a model of the stratified seabed at depths of a few tens of meters [12]. For locations where such phase-detecting systems are not available or cannot be built due to limited budget and experience, seabed parameters have previously been estimated to provide an approximately reliable UEP signature measured on site. The sensors on the seabed are capable of recording the values of the electric and magnetic field components. The combination of the frequency domain method and the information obtained from the local measurement system can be used to obtain a simple incoherent seabed exploration system.
In this study, a method is presented that uses the received field amplitudes measured by locally positioned electric field sensors that are excited by a sinusoidal signal for different frequencies. The parameters of a stratified seabed at the evaluated site are determined from the received signals. Due to uncertainties in the measurement, resulting from an imprecise sensor overrun of the ship, the corresponding data are pre-processed before they are used for further investigations. Based on this pre-processed data set, an environmental analysis is performed using a frequency sweep in the defined range from 1 Hz to 100 kHz, which by default includes the frequencies emitted by a ship. This procedure is evaluated using COMSOL Multiphysics software [13] based on the finite element method (FEM). The procedure represents the forward solution of the inverse problem, and, in combination with an optimization procedure, forms a search heuristic, which is to find the best fitness value between an input signal and the simulation model. The optimizer used is a combination of a genetic algorithm (GA) and the Nelder–Mead process, which uses only field amplitude data for evaluation [14,15]. Finally, different simulated input data are used to classify the optimizer, which reaches a performance of ≤1% deviation. The method is a cost-efficient way of using the hardware at a measurement site to receive information on significant local seabed parameters.
To summarize, the main research development regarding the point of innovation is given in the following short list:
  • Reducing the wavelength requires a full-wave simulation model within the specific frequency range of the research 1 Hz to 100 kHz;
  • Providing an identical UEP signature overrun;
  • Using incoherent field data from a given site for SBL;
  • Using the simulation model and optimization algorithms for shallow water SBL;
The remainder of the paper is organized as follows: Section 2 summarizes how to measure a UEP signature using E-field sensors as hardware positioned close to the seabed. Difficulties include inaccuracies due to swell and the ship’s shifting or tilting course over the sensor array, resulting in incomparable data sets. Therefore, as a precaution for further post-processing, a method is presented that normalizes the measurements and ultimately provides corrected data sets from a fixed scenario. Section 3 follows by describing the reconstruction of the measurement site within COMSOL Multiphysics. The required modules are presented, as well as possible simplifications due to the use of a dipole excitation source. Further on, in Section 4, the main analysis of the seabed parameters under investigation is presented. The derivation of each relevant seabed parameter is presented with respect to the given field data from the electric field sensors, resulting in a single frequency value for the further optimization algorithm. Section 5 outlines the parameters used by the optimization tool. The fitness function and the final optimization process of the two optimizers used are presented with the defined fitness function and the optimization results. Finally, Section 6 presents the main findings and discusses the results of the previous sections. Additionally, an overview of future applications based on this research topic is given to summarize the topic.

2. UEP Signature Recording of a Naval Vessel

This section describes the scenario of recording the electrical fields emitted by a naval vessel, which were recorded by moving past a sensor field of seven sensors located at the Aschau range, Germany. Uncertainties due to the sea state and deviations in the ship’s course are included in the procedure and are eliminated by an adaption process to provide comparable data sets for further processing. Finally, recorded sensor overruns can be made available for further post-processing without the influence of actual weather conditions and course uncertainties.

2.1. UEP Signature Measurement

The recording of a UEP signature is arranged as follows: The object to be measured (e.g., a ship) travels at a constant speed on a predetermined course to cross the stationary field sensors orthogonally. This is known as a sensor overrun. This array contains seven sensors (in the case of Aschau) placed at a fixed distance to each other, ideally on a line close to the seabed to measure the electric field. These are referred to throughout this paper as E-field sensors.
Figure 1 shows the initial situation of a measurement site, where several E-field sensors have been placed close to the seabed. The vessel’s signature is modeled by a dipole field, which is visualized as a vector field in the horizontal plane (x-y-plane) at the vessel’s depth and in the z-plane for the underkeel position.
Starting from a large distance away from the E-field sensors where the signature is below the noise level, the ship begins to cross the array. Typical distances of a sensor overrun from a normally sized vessel are 200 m, starting from a point far away and ending at a point behind the sensors, where the signature decreases and disappears again in the noise of the measurement signal. By knowing the ship’s speed, the recorded time domain (TD) fields can be assigned to a specific position.
The signature of such a naval vessel, which is generally represented by a higher order multipole, can be simplified in the far field as a dipole. Under an applied current, the dipole represents the excitation source, used below to represent the vessel’s signature, and will be referred to as the current dipole.
The seabed parameters are, of course, best detectable by placing the source as close as possible to the seabed. In order to avoid any collision with the measurement hardware placed so close to the seabed, a safe distance to the given seawater depth is chosen, resulting in a fixed source depth of 3 m below the seabed.

2.2. Adaption Process for Measurement Data to Eliminate Uncertainties of Individual Measurement Runs

During the process of performing the measurement, the recorded UEP signature is subject to uncertainties due to the swell and the displaced or tilted course of the vessel during the overrun of the E-field sensors. In order to receive comparable measured input data that can be used in the following simulation model, a correction technique is used to compensate for poor sensor overruns and provide identical data sets from multiple overruns for further processing. To obtain comparable data sets, an adaption procedure for measured electrical fields has been developed. For the Aschau site, this method is used to provide field data for a perfect measurement scenario, where the source traverses the sensors in an orthogonal direction without any deviation.
Using MATLAB software (v9.13.0 (R2022b)), the measured data from a current dipole (DC- or AC-excited) are output and displayed as the magnitude of the electric field in the x-y-plane at the depth of the sensor in a surface plot (see Figure 2). The visualized field represents the measured field of the dipole discretized by the seven E-field sensors. However, due to the large distance between each sensor, the recorded field requires better resolution to evaluate the real source position and the misalignment of the sensors. The data set shown in Figure 2 was obtained from a towed current dipole with a distance to the water surface of 1.5 m. The object was towed at a fixed course as orthogonally as possible over the sensor array at Aschau, excited by a direct current of 3 A and an alternating current signal of 75 Hz and also 3 A.
First, the measurement data is cubically interpolated in order to be able to determine the exact overrun position using better resolution. The maximum can then be evaluated to shift the electric field to manually define a specific path for the vessel, orthogonal to the sensors. Deviations in the trajectory of the overrun will result in a rotation of the field, which is calculated by analyzing the field shift using the contour lines from the MATLAB function, taking the recorded fields from each of the sensors as its input.
In order to de-embed the real sensor position on the seabed, the time difference of the maximum of the recorded field value can be used as presented in [16]. The result is a rotation angle that can be used in a coordinate transformation for field correction. An example of a pre-processed measured overrun as described above is outlined in Figure 3.

3. Simulation of the Measuring Site and Frequency-Dependent UEP Signatures

To evaluate the seabed parameters from a measured dipole overrun, we use the COMSOL Multiphysics software environment in combination with Livelink for MATLAB to investigate the signal propagation behavior within the multilayered structure [13,17]. The simulations are performed using COMSOL Version 6.0 with the electric currents (ec) physics interface within the AC/DC module and the electromagnetic waves (emw) physics interface found in the RF module. All simulations are performed using a PC with an i7-6700K processor and 64GB of RAM. When simulating frequency fields in the context of UEP signature measurements and their environmental setup, full wave simulation physics is already required due to wave attenuation caused mainly by the electrical conductivity of the given ambient media.

3.1. Representation of a Local Environmental Setup with COMSOL Multiphysics

To mimic the measurement procedure of the UEP signature in COMSOL Multiphysics, the inhomogeneous seabed has to contain a minimum of two different seabed layers ([18], p. 229 ff.). The main parameters of the seabed which influence the E-field in the given frequency range from 1 Hz to 100 kHz, namely the electrical conductivities and seabed layer depth, are to be predicted by the model. The relative permeability, which does not have an effect on the recorded E-field values, is set to 1 in both seabed layers. Also, the relative permittivity, which is less frequency dependent within the investigated range, is fixed to 30 in the first seabed layer (due to water saturation) and 1 in the second. Together with the seawater and the water-air interface, the simulation model represents four domains with different electrical parameters in corresponding layers. All domains are surrounded by an artificial domain of 10 m thickness emulating an approximately infinite domain (in the ec physics interface) or a perfectly matched layer (PML) (in the emw physics interface).
The seawater is represented by a domain of 23 m thickness (adapted to the local conditions of the measurement site) and is followed by two seabed layers: the first is set to a thickness of 10 m as a starting value for the subsequent optimization process and the second has a vertical dimension of 50 m enclosed by the PML domain. To represent a sensor overrun of a moving vessel within the simulation model, a static current dipole is used within the software, combined with a sensor line containing multiple discrete points to record each position of the virtual overrun. Each sensor is represented by a single sensor line, which together form a virtual sensor matrix to record the electric field at each point. For further simplification, and to reduce simulation time, the symmetry of a dipole field is used in combination with the following boundary conditions to make the model numerically efficient: the air domain is replaced by an impedance boundary and, furthermore, the area is split using a PEC due to the normal components of the electric field directly at the symmetry plane. The outer boundary regions are placed as close as possible to the sensor-dipole region to reduce the simulation area. This also results in a truncated sensor line at a distance of x = 80 m . The described simulation model is shown in Figure 4 and is used for all further investigations.

3.2. UEP Signature Simulation in the Frequency Domain

In order to determine the electric field values excited by a source under a defined applied current, a simulation module has to be chosen in which the effects of the field behavior within the frequency range will be included. Due to the electrical conductivities and the dimensions of the layers in Figure 4, the field distribution produces significant losses at a much lower frequency than one would expect, so that the model of the test site has to be analyzed using two physics interfaces initially [19]. Therefore, the COMSOL model used to represent the given measurement scenario is simulated using both the ec and emw interfaces. The model presented in the previous Section 3.1 is now simulated using both of these interfaces within a frequency range from 1 Hz up to 100 kHz.
For the frequency-dependent evaluation of the seabed parameters on the electric field amplitudes, the electric field values in the given frequency range are displayed in Figure 5. For the visualization of the physical comparison from COMSOL, the sensor point that is located directly below the excitation is selected in order to present the electric field behavior over the frequency range because it has the smallest distance to the dipole source.
This sensor has only an E x -component in the case of an ideal sensor overrun, and is used for the visualization of the comparison of both simulation interfaces. To show the electric field coupling between the excitation and the environmental conditions recorded at the E-field sensors, the electric field is plotted with amplitude and phase from each COMSOL physics interface. Figure 5 displays the E-field values from both simulation interfaces, representing the field data received by the sensor line. The phase information indicates the field propagation within the simulation area.
As an indicator of the need for the full-wave equation model (emw) in the underwater region, a difference limit of the field amplitudes δ from the COMSOL physics interfaces is defined in Equation (1) and set to a 5% deviation.
δ = E x , ec E x , emw E x , ec + E x , emw · 100 ( % ) 5 %
Up to the frequency point where the phase starts to differ from 0 , the magnetic field component has an influence and, thus, the ec physics interface provides incorrect results. In the water domain, which has a relative permittivity of 81 and an electrical conductivity of 3 S / m , a deviation of 5 % is reached at a frequency of 15 Hz . Above this frequency, the emw physics interface has to be used for reliable results. The phase at the above-mentioned 5 % threshold and the given frequency is 1.37°. The resulting zero point at the frequency of 1050 Hz is due to an interference effect of the given geometry, and, thus, the point is neither constant at the same location, nor suitable due to a non-negligible phase, which becomes close to −90°.

4. Analysis of Input Field Data Regarding the Seabed Parameter Sensitivity

In order to discriminate the individual seabed parameters from the field data received by the sensors at the measurement site, the best data point has to be elaborated in terms of the maximum sensitivity of the field amplitudes within the frequency range investigated, as well as the positioning during the sensor overrun. Furthermore, due to the fact that a numerical simulation is necessary, this analysis may lead to a minimization of the required data set and, thus, faster simulation results.
To determine the best sensitivity points of the given electric field data from the sensors, those points with the highest sensitivity regarding the variable seabed parameters ( σ 2 , σ 3 and d 2 ) at each sensor location are investigated. For the measurement site in Aschau, Germany, this means that seven sensors placed on the seafloor can be analyzed at corresponding sensor positions at a distance of 10 m from each other. Each field sensor provides different field information due to its distance from the source, which is ultimately relevant for reconstructing the individual seabed parameters. In the simulation model, the maximum amount of different sensor data in one dimension is limited by the amount of sensors at the measurement site. Therefore, the dipole source is positioned over the second of the seven sensors as already displayed in Figure 4. The discretization of half of the sensor line was chosen to include 201 equidistant data points.
Due to the symmetrical field distribution of the dipole, the highest information content is found in a sensor chain located on one side of the symmetry axis of the dipole. By placing the source over the second sensor, it is, therefore, possible to analyze as many different sensor readings as are available from the site to obtain information on seabed parameters. If the last sensor within the row were chosen for source positioning, the adaption process from Section 2.2 would no longer be able to find the misalignment between the source and the sensor array. Due to the symmetric signature of the dipole, the sensors to its left and right of the dipole provide identical information. Over the frequency bandwidth from 1 Hz to 100 kHz , the derivative of the electric field with respect to each extracted seabed parameter, electrical conductivities ( σ 2 and σ 3 ) and seabed depth ( d 2 ), is calculated for each sensor as written in Equations (5)–(7) at a fixed development point. From this point, the parameters of the seabed are called the starting point and each parameter is given the index “sp” as an indicator. A two-layered seabed structure is used for the sensitivity evaluation in Equations (2)–(4) and the parameters used are given in Table 1 along with their incremental changes. As an example, Equation (2) describes the new electrical conductivity σ 2 used in the sensitivity analysis in the model, which is given by the conductivity at the starting point σ sp plus an arbitrarily chosen conductivity delta. This forms the electrical conductivity for the second parameter point for the subsequent evaluation of the sensitivity of the E -fields of the individual sensors. The same applies to σ 3 and d 2 . Furthermore, the input sensitivity value δ σ 2 E ν is calculated for each sensor ζ in the model and leads to the partial derivative of each component of the E-field, which depends significantly upon the sensor location (r) and the current frequency f, as well as the individual seabed parameters at the point of origin. The evaluation of the development point was carried out within the simulation model displayed in Figure 4, representing a simplification of the measurement site at Aschau, Germany.
σ 2 = σ 2 , sp + δ σ 2
σ 3 = σ 3 , sp + δ σ 3
d 2 = d 2 , sp + δ d 2
{ σ 2 E ν } ζ = 1 , 2 , . . . , 7 E ν r , f , σ 2 , σ 3 , d 2 σ 2 ζ
{ σ 3 E ν } ζ = 1 , 2 , . . . , 7 E ν r , f , σ 2 , σ 3 , d 2 σ 3 ζ
{ d 2 E ν } ζ = 1 , 2 , . . . , 7 E ν r , f , σ 2 , σ 3 , d 2 d 2 ζ where ν x , y , z and ζ 1 7 .
For each sensor, the values of the individual field components along the sensor overrun direction are determined, showing the maximum sensitivity values with dipole overrun position and frequency. Figure 6 shows the sensitivity for sensor 3, which is directly next to the source. The evaluation of the maxima are independent of any given unit, explaining why the color bars in the figure are given with an arbitrary unit (a.u.). As can be seen, the E y and E z components of sensor 3, the maximum sensitivity points are not directly orthogonal to the sensor, meaning that the best evaluation point can be found at a position before the object crosses the E-field sensors.
In order to obtain as much independent information from the given sensors as possible, all three field components of a sensor should be used, which is the case for sensors 3–7, located next to the intersection of the sensor line and the object path.
By selecting sensors with all components present, it is possible to select those sensors with the best electric field amplitude ratio and good sensitivity to the seabed parameters of interest. The most balanced field amplitude distributions, considering all three electric field components with respect to the sensitivity of the seabed parameters, are, therefore, not on the orthogonal sensor axis. Furthermore, they are also not directly below the source, although the highest amplitude occurs there.
To elucidate the sensitivity maxima of all seven sensors in terms of their amplitudes, the maximum of each component of all the sensors is plotted in Figure 7. Here, the distribution of the sensitivity maxima from all seven simulated sensors is displayed over the frequency range and the overrun position. Figure 7 can be used to identify identical sensitivity maxima and find a frequency and position where as many sensors as possible have the highest sensitivity. This is done to reduce the search field and, thus, the parameter space, which ultimately saves computational effort. The narrowing and possible reduction is marked by a line in Figure 7. Looking at the best sensitivity points of the outboard sensors, it can be seen that the sensitivity maximum occurs at an overrun position that is further away from the array intersection and at a lower frequency. To capture additional information from the outer sensors, a fixed frequency of 1 kHz is defined for the best sensitivity of all sensors.
It can be seen that the maxima of the E z -component are responsible for the shift of the line to a lower single frequency point. If the information from the E z component is neglected, a higher frequency point would be displayed. Furthermore, the best dipole overrun position for the evaluation of seabed parameters lies between 0 m and 31 m away from the sensor position.
The use of only one fixed frequency point leads to a fast simulation result and saves time when taking measurements. Even though not all sensor maxima are exactly placed at 1 kHz , the visualization of the sensitivities of the individual field components depicts that the field amplitude values have a slowly decreasing sensitivity and, thus, there is still a relevant intensity in the area around the maximum point.
Therefore, the frequency point of 1 kHz is sensitive enough regarding most of the sensors to obtain individual information from the field amplitudes to extract the seabed parameters. The chosen frequency and position selection are valid for this specially chosen sourcedepth. One has to keep in mind that by changing the source depth, the sensitivity has to be recalculated in order to reevaluate the frequency and best position in relation to the sensor overrun.

5. Optimization for the Evaluation of the Seabed Parameters

The following section describes how the electrical field data from the sensors is processed and combined into a single value that can be used as the input of the optimization tool. The algorithm used is presented, followed by a test function for the evaluation of the optimization process. The given incoherent E-field values resulted in a successfully adapted optimization process that fitted a seabed parameter to a given input field.

5.1. Choosing a Parameter to Define an Optimization Function

To de-embed the parameters from a layer of the environmental setup, which influences the recorded electrical field data given by a sensor overrun, the input field data is compared with the data from the COMSOL model. To achieve this, a single value is necessary that contains information about the inhomogeneous seabed derived from the amplitudes of the electric field components, which can then be used by an optimization tool to determine the local seabed parameters. This evaluation variable makes use of the incoherent field information from the measured sensor path of the current dipole. The first step is to define a test and reference system for this purpose, containing the information of all electric field components of the seven sensors. Within the input data, the test system is defined as either the measured sensor overrun or a simulation model for further evaluation of the optimization. This data set is compared to a reference system represented by the simulation model from Section 4 with variable seabed parameters to find identical field data.
This approach is shown in Equation (8) below.
Δ E ν = | E TS , ν ( f ) p E RS , ν ( f ) p | E TS , ν ( f ) p
Fitness = 1 ν = 1 3 Δ E ν ( f ) 2 + 1 e 50
where ν [ x , y , z ] and TS is the test system, RS is the reference system, and p represents the discrete points along the sensor line.
The inversion of the value Δ E results in a fraction, which, in the best case, has a denominator of zero if the test and reference systems are identical. To avoid an infinite fitness value, an infinitesimal value is added to the sum of the field values to prevent division by exactly zero. The fitness value given in Equation (9) can be used to compare a measured dipole overrun with the simulation model replicating the measurement site. Using the results from the sensitivity analysis from Section 4, the range of evaluation of the field data from the sensor overrun is limited and used for the fitness function at a single frequency of 1 kHz . The distance between the discretization points used on the sensor lines is gradually reduced from x = 50 m down to x = 0 m , a range which includes each sensitivity maximum of the sensors and maintains a distance to the first maximum at x = 31 m (see Figure 7).

5.2. Optimization Tools Used

The fitness function defined in Equation (9) is used by two optimization tools, in combination with the numerical model (see Figure 4). A genetic algorithm (GA) is combined with a local fast search method, the Nelder–Mead algorithm. This combination allows the parameter search to be performed in a time-efficient manner using a comparison between the input field data set and the numerical model. Starting with the global search method of the genetic algorithm, a convergence criterion is defined to determine the input of the Nelder–Mead algorithm, which solves the function within 45 iterations maximum. The criterion is defined in Equation (10) and analyzes the iteration process using the difference between the last two fitness values over a defined iteration number. If the GA is still at the identical fitness level after several iterations, a second criterion is applied, which limits the iteration number to a specific value.
convergence criteria = Δ fitness values ( last , penultimate ) iteration number
In the same manner as for the GA explained in [14], the optimizer was programmed using MATLAB software and set up with the input parameters from Table 2. A wide range of possible seabed parameters are given for the GA starting points to avoid parameter detection close to the limits, which would lead to inaccuracies in the optimization process.
The basis for the Nelder–Mead algorithm used here is the MATLAB optimisation toolbox function fminsearch, which contains the algorithm procedure [20]. This function was changed to find the maximum value for a given fitness. Its input parameters are listed in Table 3.

5.3. Optimization Process with Simulated Test Data

To evaluate the optimization process generated above, several input test data sets representing possible input fields are simulated using the COMSOL model (see Figure 4). The data is used to test the fitness function in the combined optimizer. The computational time of the process is tracked and the relative deviation between the test system and the reference system is calculated in Equation (11).
relative deviation = | p optimizer   output p test   system | p test   system · 100 % where p σ 2 , σ 3 , d 2 .
The test data generated with the COMSOL model from Figure 4 is inserted into the fitness function from Equation (9) and finally entered into the optimization process (visualized in Appendix A). This was performed with a range of possible seabed parameters, which can be extracted from the literature [21,22]. For each optimization process, the final parameters and the time required to determine them provide information about the quality of the method. In Table 4, data showing the relative deviation of four test systems are displayed.
These optimization processes show a relative deviation of less than 1%. The convergence time varies from 2 h   24 min up to 2 h   43 min . This variation depends on the random starting values of the genetic algorithm and the fitness value resulting from the given parameters. The compact COMSOL model shown in Figure 4 requires approximately 30 s for one simulation run.

6. Conclusions and Outlook

This paper has presented a low-cost method using only the incoherent data from an existing monitoring station to obtain seabed information in a simple manner. The use of measurement data from an existing measurement site with field sensors represents a low investment. The key of using incoherent data makes the coupling of transmitter and receiver not necessary and, thus, simple data extraction at the measurement site is possible by feeding the numerical model with measured data. The most important parameters, namely the electrical conductivities of the first and second layers of the seabed σ 2 , σ 3 , as well as the depth of the first layer d 2 , can be extracted from a measured UEP signature. This was performed using a known source compared with a simulation model, in which the local parameters were then evaluated in the frequency domain. Following the analysis of previously measured current dipole electric fields from sensor overruns, a correction method for the measurement data was presented, which detects and calculates measurement errors due to the current sea state and a skewed path deviating from an orthogonal overrun of the E-field sensors. The range of parameters was then investigated to find the best positioning between the sensors and the dipole source at a depth of 3 m above the seabed that would allow a sensor overrun without colliding with the E-field sensors. The stratified seabed was analyzed at a specific investigation point using the sensor data in order to evaluate a suitable frequency range and position for the highest sensitivity of the E-field sensors with respect to the seabed parameters. This resulted in a single frequency and includes the location (i.e., necessary evaluation points) along the overun path. The absolute electric field components forming the main information for the fitness function were combined into a single fitness value using the least squares method. Two optimization tools, i.e., a genetic algorithm and the Nelder–Mead optimization method were used to determine the seabed parameters of the given local monitoring station in comparison with a simulation model.
The most important conclusion is that neither the transient evaluation techniques used by geophysicists nor phase-coupled transmitter and receiver systems are necessary to obtain local information about the seabed. In the frequency range from 1 Hz up to several kHz , it is possible to de-embed information from amplitude signals using only a single selected frequency (here 1 kHz ) in the most sensitive range. The test environmental conditions can be reproduced in a simulation model with a relative deviation of less than 1%, which provides a good basis for later measured field overruns. These introduce inaccuracies due to noise components in the measured signal as well as deviations from the ideal simulation model, which should be left as unaffected as possible by the optimization system. Combined with the adaptive methodology to neglect measurement problems due to poor ship course or weather conditions, the method can be used to provide the unknown local seabed parameters at each measurement site where some local sensors are available. Knowledge of commonly influenced local parameters becomes important as it can now be used to calculate the free-water signature of a naval vessel. This is necessary in order to be aware of the vessel’s signature on the open sea and to keep it as low as possible, thus increasing the safety of the vessel and the crew.
Problems, such as rapid reflection from the water surface, as described in the introduction, are completely decoupled by the use of transient evaluation methods, as the signals emitted by the source are no longer strong enough along the entire source-to-water-surface sensor path due to the relatively high frequency. Moreover, the method used here reduces distortion due to broadband noise by choosing only one frequency and, thus, leads to higher noise immunity.
To evaluate the resulting extraction process, test data sets were generated from a numerical simulation model that demonstrated high accuracy for output seabed parameters. After this evaluation, the simulation model can be used to verify the seabed parameters at the measurement station in Aschau, Germany. The current simulation model represents this location by means of the dimensions of the layer depths and the number of sensors, which allows simple implementation in this case. To use these methods for other measurement sites, the COMSOL model must be adapted to local conditions before parameters can be accurately predicted.

Author Contributions

C.B. conceived and designed the calculation method as well as the adaptation method; C.B. and C.T. performed the simulations; C.B. and D.E. wrote the paper; F.L. provided the measurement data and advised on UEP signature measurements; A.R. supervised the findings in this work and contributed to the writing process. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Technical Center for Ships and Naval Weapons, Naval Technology and Research (WTD71), Bundeswehr, grant number E/E71S/L1341/EF025.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Optimization Tools Used

Figure A1 shows the optimization process as described in Section 5.2. The GA uses the convergence criterion defined by Equation (10), and then uses the best parameter combination as the starting point for the Nelder–Mead optimization process. The process makes use of several data sets from one example of a field simulated for the given measurement site in Aschau, Germany.
Figure A1. Fitness value of the GA optimization process (on the left-hand side) and of the Nelder–Mead optimization process (on the right-hand side). The grey dots visualised in the GA, represent the fitness values of the output generated by this algorithm and show the new fitness values of the seabed parameter combinations. The best value from the GA is used as the starting point for the Nelder–Mead algorithm, which finally reaches a maximum with the given convergence criteria (grey dots on the right).
Figure A1. Fitness value of the GA optimization process (on the left-hand side) and of the Nelder–Mead optimization process (on the right-hand side). The grey dots visualised in the GA, represent the fitness values of the output generated by this algorithm and show the new fitness values of the seabed parameter combinations. The best value from the GA is used as the starting point for the Nelder–Mead algorithm, which finally reaches a maximum with the given convergence criteria (grey dots on the right).
Jmse 11 01864 g0a1

References

  1. Su, X.; Ullah, I.; Liu, X.; Choi, D. A Review of Underwater Localization Techniques, Algorithms, and Challenges. J. Sens. 2020, 2020, 6403161. [Google Scholar] [CrossRef]
  2. Ullah, I.; Liu, Y.; Su, X.; Kim, P. Efficient and Accurate Target Localization in Underwater Environment. IEEE Access 2019, 7, 101415–101426. [Google Scholar] [CrossRef]
  3. Wołoszyn, M.; Buszman, K.; Rutkowski, T.; Tarnawski, J.; Rodrigo Saura, F.J. An analytical four-layer horizontal electric current dipole model for analysing underwater electric potential in shallow seawater. Sci. Rep. 2022, 12, 8727. [Google Scholar] [CrossRef] [PubMed]
  4. Peng, Y.; Cheng, J.F.; Jiang, R.X. Inversion of UEP signatures induced by ships based on PSO method. Def. Technol. 2020, 16, 172–177. [Google Scholar] [CrossRef]
  5. Edwards, R.N.; Chave, A.D. A transient electric dipole-dipole method for mapping the conductivity of the sea floor. Geophysics 1986, 51, 984–987. [Google Scholar] [CrossRef]
  6. Constable, S.C.; Srnka, L.J. An introduction to marine controlled-source electromagnetic methods for hydrocarbon exploration. Geophysics 2007, 72, WA3–WA12. [Google Scholar] [CrossRef]
  7. Kong, F.N.; Westerdahl, H.; Ellingsrud, S.; Eidesmo, T.; Johansen, S. ‘Seabed logging’: A possible direct hydrocarbon indicator for deepsea prospects using EM energy. Oil Gas J. 2002, 100, 30–38. [Google Scholar]
  8. Smith, R.S.; Edwards, R.N.; Buselli, G. An automatic technique for presentation of coincident-loop, impulse-response, transient, electromagnetic data. Geophysics 1994, 59, 1542–1550. [Google Scholar] [CrossRef]
  9. Safipour, R.; Hölz, S.; Jegen, M.; Swidinsky, A. On electric fields produced by inductive sources on the seafloor. Geophysics 2017, 82, E297–E313. [Google Scholar] [CrossRef]
  10. Chave, A.D.; Constable, S.C.; Edwards, A.N. Chapter 12: Electrical Exploration Methods for the Seafloor. In Electromagnetic Methods in Applied Geophysics; Application, Parts A and B; Society of Exploration Geophysicists: Houston, TX, USA, 1991; Volume 2. [Google Scholar] [CrossRef]
  11. Cheesman, S.J.; Edwards, R.N.; Chave, A.D. On the theory of sea-floor conductivity mapping using transient electromagnetic systems. Geophysics 1987, 52, 204–217. [Google Scholar] [CrossRef]
  12. Fristedt, T.; Lundqvist, B.; Aklint, M.; Hall, J.-O.; Soderberg, P. Electromagnetic footprint measurements from a towed platform for characterizing sub-bottom conductivities and structures in the Stockholm archipelago. In Proceedings of the 2008 IEEE/OES US/EU-Baltic International Symposium, Tallinn, Estonia, 27–29 May 2008; pp. 1–8. [Google Scholar] [CrossRef]
  13. COMSOL Multiphysics. Finite Element Method Solver. Available online: https://www.comsol.de (accessed on 6 January 2023).
  14. Goldberg, D.E. Genetic Algorithms in Search, Optimization and Machine Learning, 1st ed.; Addison-Wesley Longman Publishing Co., Inc.: Boston, MA, USA, 1989; ISBN 978-0-201-15767-3. [Google Scholar]
  15. Singer, S.; Nelder, J. Nelder-mead algorithm. Scholarpedia 2009, 4, 2928. [Google Scholar] [CrossRef]
  16. Broecheler, C.; Thiel, C.; Rennings, A.; Ludwar, F.; Erni, D. Correction technique for misalignment between UEP sensor array and longitudinal vessel axis. In Proceedings of the COMSOL-Conference, Southampton, UK, 19–21 April 2023. [Google Scholar]
  17. COMSOL Multiphysics. LiveLink™ for MATLAB. Available online: https://www.comsol.de/livelink-for-matlab (accessed on 6 January 2023).
  18. Broecheler, C.; Rennings, A.; Erni, D. Abschlussbericht des Projektes: Untersuchung zur Elektrischen Signatur im Rahmen von SiRAMIS II, Allgemeine und Theoretische Elektrotechnik; Technical Report; University of Duisburg-Essen: Duisburg-Essen, Germany, 2020. [Google Scholar]
  19. Broecheler, C.; Thiel, C.; Rennings, A.; Ludwar, F.; Doose, J.; Erni, D. Frequency Dependent UEP Signatures of Naval Vessels Modeled by a Current Dipole. In Proceedings of the COMSOL-Conference-2018, Lousanne, Switzerland, 8 November 2018. [Google Scholar]
  20. The MathWorks, Inc. MATLAB Version: 9.13.0 (R2022b). 2022. Available online: https://www.mathworks.com (accessed on 6 January 2023).
  21. Mackens, S. Kombination von Kapazitiver Geoelektrik und Georadar zur Bestimmung der Sedimentarchitektur im Orchontal, Mongolei, 10th March, 2010. Available online: https://epic.awi.de/id/eprint/29721/1/Mac2010b.pdf (accessed on 22 September 2023).
  22. Schloegel, G. Modellierung und Lokalisierung Kleinraeumiger Einlagerungen (Kriegsrelikte) im Untergrund mit Georadar, 29 June 2007. Available online: https://pure.unileoben.ac.at/de/publications/modellierung-und-lokalisierung-kleinräumiger-einlagerungen-kriegs (accessed on 22 September 2023).
Figure 1. Initial situation of a measurement location where the UEP signature of a naval vessel can be measured by E-field sensors, placed close to the seabed. The environment includes the air domain, the seawater, and the multilayered seabed with different conductive layers. Several sensors placed equidistant to each other on the seabed form a line orthogonal to the overrun direction to record the E-field. The vessel is represented as a vector field in the x-y-plane (blue arrows) at its depth and in the z-plane (red arrows) of the underkeel axis. As an example, the E x and E z -component of an emitted AC-field is displayed for one sensor.
Figure 1. Initial situation of a measurement location where the UEP signature of a naval vessel can be measured by E-field sensors, placed close to the seabed. The environment includes the air domain, the seawater, and the multilayered seabed with different conductive layers. Several sensors placed equidistant to each other on the seabed form a line orthogonal to the overrun direction to record the E-field. The vessel is represented as a vector field in the x-y-plane (blue arrows) at its depth and in the z-plane (red arrows) of the underkeel axis. As an example, the E x and E z -component of an emitted AC-field is displayed for one sensor.
Jmse 11 01864 g001
Figure 2. Measured electric field magnitudes of a current dipole for DC and AC excitation at sensor locations 1–7 in Aschau, Germany. The dipole was subject to an applied current of 3 A and was towed by a ship in a water depth of 1.5 m .
Figure 2. Measured electric field magnitudes of a current dipole for DC and AC excitation at sensor locations 1–7 in Aschau, Germany. The dipole was subject to an applied current of 3 A and was towed by a ship in a water depth of 1.5 m .
Jmse 11 01864 g002
Figure 3. Adapted measured dipole field, which has been interpolated, shifted and rotated to represent a sensor overrun of the central sensor of the Aschau measurement site in Germany.
Figure 3. Adapted measured dipole field, which has been interpolated, shifted and rotated to represent a sensor overrun of the central sensor of the Aschau measurement site in Germany.
Jmse 11 01864 g003
Figure 4. Simplification of the given measurement site (left-hand side) and permutation of the COMSOL model (right-hand side) representing the multilayered structure with a current dipole over a sensor line with 7 sensors. The different domains are represented by a water domain, and two different seabed layers. The water-air interface is approximated by an impedance boundary, and the entire sensor overrun halved from 80 m to 0 m and terminated with a PEC at the sensor position due to the dipole symmetry of the electric field. The current dipole is placed over the sensor line. Each sensor line consists of 201 discrete ideal sensor points at which all three field components are extracted (see sensor cutout below right). The surrounding cylinder is inserted to provide finer resolution of the meshed elements. The depth of the seawater is set according to the measurement location on site (Aschau, Germany), followed by an estimated seabed model to de-embed the field influence on the sensors. Each layer includes parameters for the material by defining the permittivity ε and the electrical conductivity σ of the media. The outer domain of the model obeys absorbing boundary conditions. The first seabed layer is assigned the thickness parameter d 2 , which is later varied by the optimization process.
Figure 4. Simplification of the given measurement site (left-hand side) and permutation of the COMSOL model (right-hand side) representing the multilayered structure with a current dipole over a sensor line with 7 sensors. The different domains are represented by a water domain, and two different seabed layers. The water-air interface is approximated by an impedance boundary, and the entire sensor overrun halved from 80 m to 0 m and terminated with a PEC at the sensor position due to the dipole symmetry of the electric field. The current dipole is placed over the sensor line. Each sensor line consists of 201 discrete ideal sensor points at which all three field components are extracted (see sensor cutout below right). The surrounding cylinder is inserted to provide finer resolution of the meshed elements. The depth of the seawater is set according to the measurement location on site (Aschau, Germany), followed by an estimated seabed model to de-embed the field influence on the sensors. Each layer includes parameters for the material by defining the permittivity ε and the electrical conductivity σ of the media. The outer domain of the model obeys absorbing boundary conditions. The first seabed layer is assigned the thickness parameter d 2 , which is later varied by the optimization process.
Jmse 11 01864 g004
Figure 5. Simulated field coupling from the excitation and the recorded field of the two different COMSOL physics interfaces. The given field component is recorded at the middle point of the sensor line, which is orthogonally below the dipole excitation, and is visualized over the investigated frequency range. Both the emw and ec interfaces are shown on one coordinate system. (a) shows the amplitude, while (b) displays the phase. The difference between the two interfaces is shown in (c), which also shows that the threshold reaches its specified value at a frequency as low as 11 Hz .
Figure 5. Simulated field coupling from the excitation and the recorded field of the two different COMSOL physics interfaces. The given field component is recorded at the middle point of the sensor line, which is orthogonally below the dipole excitation, and is visualized over the investigated frequency range. Both the emw and ec interfaces are shown on one coordinate system. (a) shows the amplitude, while (b) displays the phase. The difference between the two interfaces is shown in (c), which also shows that the threshold reaches its specified value at a frequency as low as 11 Hz .
Jmse 11 01864 g005
Figure 6. Derivation of the simulated seabed parameters with respect to the electric field components of the third sensor in the direction of the sensor overrun and over the selected frequency range. The different amplitudes of each field component, caused by the variation in the seabed parameters (conductivity and depth), shows that the highest sensitivity of each parameter is not orthogonal to the sensor (position marked in each case with different symbols). The sensor shown here is 20 m from the point which is orthogonally below the power source. The sensitivity fields are given in an arbitrary unit. The sensor is simulated from a distance of zero meters, which is the point where the dipole is perpendicular below the sensor array, up to 20 m away from the sensor.
Figure 6. Derivation of the simulated seabed parameters with respect to the electric field components of the third sensor in the direction of the sensor overrun and over the selected frequency range. The different amplitudes of each field component, caused by the variation in the seabed parameters (conductivity and depth), shows that the highest sensitivity of each parameter is not orthogonal to the sensor (position marked in each case with different symbols). The sensor shown here is 20 m from the point which is orthogonally below the power source. The sensitivity fields are given in an arbitrary unit. The sensor is simulated from a distance of zero meters, which is the point where the dipole is perpendicular below the sensor array, up to 20 m away from the sensor.
Jmse 11 01864 g006
Figure 7. Maxima of the sensitivity values from all 7 sensors of the given array at Aschau over the frequency range and the position during the sensor overrun. Each sensitivity value of the extracted seabed parameters is indicated by a different marker and the sensors are represented by different colors. The sensor overrun of the current dipole starts at a position of 30 m away from the sensors and displays the overrun up to 0 m, where the dipole is perpendicular to the E-field sensor array. The optical center, taking into account as many maxima of each E-field component as possible, can determine a single frequency characterized by a regression line that lies within a small distance of most maxima.
Figure 7. Maxima of the sensitivity values from all 7 sensors of the given array at Aschau over the frequency range and the position during the sensor overrun. Each sensitivity value of the extracted seabed parameters is indicated by a different marker and the sensors are represented by different colors. The sensor overrun of the current dipole starts at a position of 30 m away from the sensors and displays the overrun up to 0 m, where the dipole is perpendicular to the E-field sensor array. The optical center, taking into account as many maxima of each E-field component as possible, can determine a single frequency characterized by a regression line that lies within a small distance of most maxima.
Jmse 11 01864 g007
Table 1. Parameters at the point of investigation using seabed parameter variation.
Table 1. Parameters at the point of investigation using seabed parameter variation.
ParameterValueIncrementValue
σ 2 , sp 1 S / m δ σ 2 1 S / m
σ 3 , sp 0.1 S / m δ σ 3 0.4 S / m
d 2 , sp 5 m δ d 2 5 m
Table 2. Settings for the MATLAB function of the genetic algorithm.
Table 2. Settings for the MATLAB function of the genetic algorithm.
ParameterValueFormula/Description
’variableLimits’ σ 2 = 0.1 S / m  -  3 S / m ;Search field of σ 2
’variableLimits’ σ 3 = 1 e 4 S / m  -  1 S / m Search field of σ 3
’variableLimits’ d 2 = 1 m  -  20 m Search field of d 2
’genBitN’6Bit number for the resolution of parameters from the search space
popN 50 Start population
iterLimitinfGlobal iteration limit
simLimit 5000 Simulation limit
fitLimit 2000 Maximum of fitness
ProgLimit 1 e 4 Progress: F i t v a l u e ( i 1 ) F i t v a l u e ( i ) I t e r a t i o n S
crossOverN 2 Value for the bit changes in the mutation process
Table 3. Settings for the MATLAB function fminsearch. The function represents a Nelder–Mead method.
Table 3. Settings for the MATLAB function fminsearch. The function represents a Nelder–Mead method.
ParameterValueFormula/Description
MaxIter45 Set the maximum iteration steps within a constant fitness value
TolFun1e-3 Termination criterion of the tolerance of the fitness value
TolX1e-3 Termination criterion of the fitness parameter tolerance
Table 4. Optimization run of the combined optimization process. A genetic algorithm has been combined with a Nelder–Mead algorithm and the corresponding termination criteria for the determination of the seabed parameters. The optimization times and relative deviations are outlined.
Table 4. Optimization run of the combined optimization process. A genetic algorithm has been combined with a Nelder–Mead algorithm and the corresponding termination criteria for the determination of the seabed parameters. The optimization times and relative deviations are outlined.
Pos.TargetParameter
( σ 2 σ 3 d 2 )
Optimization Output
( σ 2 σ 3 d 2 )
Relative Deviation (%)Duration
1 1.89 0.46 12.3 1.8901 0.4629 12.268 0.01 0.65 0.25 2:43 (h:min)
2 0.87 0.027 13.8 0.870 0.02740 13.80 0.01 0.56 0.00 2:24 (h:min)
3 1.15 0.23 7.8 1.1493 0.2287 7.838 0.06 0.53 0.50 2:24 (h:min)
4 1.7 0.15 6.7 1.698 0.1509 6.699 0.09 0.61 0.00 2:26 (h:min)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Broecheler, C.; Thiel, C.; Ludwar, F.; Rennings, A.; Erni, D. Incoherent Shallow-Water Seabed Logging Using Numerical-Model-Based Optimization for the Prediction of Unperturbed UEP Signatures. J. Mar. Sci. Eng. 2023, 11, 1864. https://doi.org/10.3390/jmse11101864

AMA Style

Broecheler C, Thiel C, Ludwar F, Rennings A, Erni D. Incoherent Shallow-Water Seabed Logging Using Numerical-Model-Based Optimization for the Prediction of Unperturbed UEP Signatures. Journal of Marine Science and Engineering. 2023; 11(10):1864. https://doi.org/10.3390/jmse11101864

Chicago/Turabian Style

Broecheler, Claas, Christian Thiel, Frank Ludwar, Andreas Rennings, and Daniel Erni. 2023. "Incoherent Shallow-Water Seabed Logging Using Numerical-Model-Based Optimization for the Prediction of Unperturbed UEP Signatures" Journal of Marine Science and Engineering 11, no. 10: 1864. https://doi.org/10.3390/jmse11101864

APA Style

Broecheler, C., Thiel, C., Ludwar, F., Rennings, A., & Erni, D. (2023). Incoherent Shallow-Water Seabed Logging Using Numerical-Model-Based Optimization for the Prediction of Unperturbed UEP Signatures. Journal of Marine Science and Engineering, 11(10), 1864. https://doi.org/10.3390/jmse11101864

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop