1. Introduction
A stochastic filtering theory provides methods for solving very different practical problems. The moving objects control tasks, including the most interesting ones such as target tracking and navigation [
1], attract our attention to a greater extent. An atypical property of the models used for such tasks is the observations random time delays [
2,
3]. The source of these delays is the aquatic environment, and autonomous underwater vehicles (AUVs) are a practical application [
4]. This rapidly developing applied area regularly generates new and original challenges for researchers. For example, sea currents are a characteristic phenomenon of the aquatic environment, and they have a specific effect on the most typical analysis algorithms [
5]. The water peculiarities can affect not only the conditions but also the movement goals. At the same time, it seems that researchers pay more attention to the target tracking models and tasks than to others [
6,
7,
8,
9,
10,
11,
12,
13,
14]. But first of all, the specificity of the water affects the measuring instruments. Within the cooperative scenario framework, when the AUV interacts with measuring instruments to solve the positioning problem, different measuring instruments are available for use [
15,
16], all based on common physical laws. These are acoustic sensors, which means that their performance is influenced by various factors, such as temperature, salinity, and water pressure [
17,
18,
19]. As a result, the observer has a time delay in AUV’s position characteristics receiving data. This delay is random and may turn out to be quite large since the propagation velocity of the acoustic wave is not that high.
The lack of accurate measurement-performing-moment information is the studied model’s main feature. These kinds of problems are well known and not unique. Typical situations arise in the use of distributed telecommunications and global positioning systems [
20,
21], as well as in AUV control [
22]. Generally, the time out of sync between data sources is an obstacle in the work. Among the tasks solved in such conditions, there is also a tracking problem whose solution is provided by the use of nonlinear filters [
23,
24]. The fundamental difference of the considered here model is that the desynchronization time is not only unknown and random, but it also changes during observation.
The idea of researching a stochastic dynamic observation system model that takes into account the acoustic signal delay factor appeared in a study described in [
2]. The article in [
3] presented a detailed computational experiment with the tracking problem-solving methodology based on the concept of conditionally optimal filtering [
25,
26] and on its evolution—conditionally minimax nonlinear filtering (CMNF) [
27]. This work takes the model and experiment of [
3] as a basis and adapts them to more complex conditions.
Here, we focus on the issue of AUV movement model identification. This is a question of the assumption that the moving object state model is known, which is typical for stochastic observation systems. In practice, this does not happen, but we use models with certain errors. To compensate for the impact of these errors, an error model can be included in the state equations. Researchers working in the field of robust estimation [
28] have studied a large number of tasks and methods of this kind. Another approach, known as parametric systems identification [
29], suggests describing model inaccuracies with parameters and evaluating them. Having obtained parameter estimates, we can consider the system identified, i.e., use parameter estimates in the motion model. The identified system can be used further to solve basic tasks, positioning, and target tracking, i.e., to use filters. Because pre-identification is not always possible, it is quite natural to combine the filtering and identification tasks. It is convenient to do this within the Bayesian approach framework, i.e., under the assumption that unknown model parameters are random. This is a widely used and well-known method that has been around for a long time [
30,
31]. In this article, we apply it to a model with random observation delays (
Section 2). As a result, we present the optimal Bayesian filter equations (
Section 3), the adapted for identification CMNF structure (
Section 4), and a detailed analysis of the computational experiment, reproducing the calculations performed in [
3] in the model with unknown AUV movement parameters.
2. Filtering and Model Parameters Identification Problems Statement
Three formal variants of the discrete stochastic dynamic observation system model describe motion and measuring instruments in [
3]. The simple model that assumes additive disturbances in dynamics and additive noises in observations is most suitable for the practical purposes set out in this paper. It quite adequately reflects the real physics in the target application area. To the basic model, we will add the assumption of motion model incomplete information, for which we will include unknown parameters in the state equations. In addition, the observation model requires a priori knowledge of the time delay maximum possible value
It means that the reflected acoustic wave object is located at a quite large distance. Therefore, it takes some time for the acoustic signal to reach the sensor that receives it. This time is unknown and random, but, according to the proposed model, it does not exceed the value of
Since the sound velocity in the water can be considered known, this assumption boils down to estimating the maximum distance between the sensors and the observed object, which should not be difficult. Next, we assume that the object tracking start moment is
and a discrete variable
describes the time. This variable should take the values
Then, at the moment
, measurements corresponding to the object positions at all previous time points down to and including
will be guaranteed to be formed.
Let us consider the object position, denoted by the vector and the unknown motion model parameters vector . Here and hereafter, we use « to denote a transposed vector or matrix.
So, the position can consist of an object coordinate vector and its velocity vector in a geocentric inertial reference frame. The parameters do not change values during the observation time and may include, for example, an unknown initial position and/or average velocities. The position–parameter pair forms the dynamic system state vector .
Following the Bayesian approach, we assume the unknown parameter vector
to be random and its distribution to be given. We will also consider the initial position of the object to be random, denoted by
. Given that the time variable
starts counting time from the value
, the initial position must be determined as
. Next, we assume that
and
are independent and have probability densities
and
, so the initial Bayesian filter condition (vector
) probability density
takes the form
where
and
are the probability density arguments corresponding to random vectors
and
.
The observation vector consists of the position measurements at different times, shifted from the current time by a random delay. Moreover, each element has its own offset, which is determined by a discrete random variable . This means that the observation consists of object state measurements at different time points .
Values
make a vector
that defines a known function
. Thus, the dynamic system has the form:
where additive dynamic disturbances
and additive measurement noises
are discrete-time vector white noises having known distributions. The vectors
are assumed to be independent in aggregate, and the functions
,
and
satisfy sufficient conditions for the filtering estimates existence from Theorems 1 and 2 in [
3]. These are typical conditions for the growth rate of the functions and the disturbances distributions, which guarantee the existence of finite second moments of the processes
and
.
Let us introduce a new composite state vector
, combining the object position vector
and unknown parameter vector
. To do this, we determine that under the designation
it refers to the vector of positions
shifted in accordance with the delays
. Now the observation system model (1) takes the following traditional dynamic system form:
For (2), we can state the filtering problem, i.e., the estimation problem for the state by the observations Solving the filtering problem for this composite state vector, we will get both a tracking problem solution in the form of a current position filtering estimate and a solution to the movement model parameter identification in the form of a filtering estimate of the state vector second part . This estimate is a parameter Bayesian estimate.
It remains to be noted that, in estimating the problem under consideration, the evaluation accuracy criterion for some estimates
is the mean square, i.e.,
where
is the vector
mathematical expectation and
is the vector
usual Euclidean norm. The Bayesian estimates
and
obtained in the next section represent conditional mathematical expectations
where
is the
-algebra, generated by observations
The conditional minimax filter estimates
used further as an effective computational alternative turn out to be the closest to Bayesian in the sense of the specified quadratic criterion on a class of the given structure filters. The main attention in this filter synthesis is paid precisely to the suitable structure choice that takes into account the specific features of model (2).
Section 4 of the paper contains a detailed description of this choice.
The last feature, which we will add to model (2), affects the interpretation of the problem of the tracking object movement model parameter identification. The traditional task of the system parametric identification [
29] is to estimate unknown parameters. This means that it is possible to obtain an unlimited number of observations so that the current parameter estimate can be improved with each new observation, achieving estimate convergence to the true parameter value. This identifies the system. In reality, of course, the observation scope is limited. In addition, the assumption of the identified parameters constancy is also valid generally for a limited time. Thus, movement conditions change from time to time, for example, under the influence of external control factors, after which another model has to be identified. There are different ways to take such situations into account. This paper proposes the following model.
Suppose, in addition to the position
, there is a Poisson process with a known intensity. It can be enabled by extending the state as follows. For the sake of certainty, we will assume that
where
is a standard Poisson process and the variable
denotes continuous time at the same observation interval as
. That is, we assume that the tracking interval
is sampled in increments of
. Let
be a discrete-time white noise with distribution
. Then, instead of Equation (2), we will consider a dynamic observation system model of the following form:
Note that, formally, model (3) can be reduced to form (2) if we limit the Poisson process switching jumps number. Then, it is enough to expand the vector putting and meaning that are initial unknown movement model parameters, is unknown movement model parameters generated at the first jump, is unknown movement model parameters generated at the second jump, etc. The number of jumps is limited by the value In this case, all should be independent random vectors with the distribution . Then, from the filtering point of view, both Bayesian and conditionally minimax, the estimation statements in model (3) and in model (2) do not differ. From a practical point of view, the difference between these models is fundamental. In model (3), it is impossible to achieve the system identification goal by parameter estimation with any accuracy. First, unknown model parameters change within the same trajectory. Second, there is only a finite number of observations to parameter estimation at any interval of their constancy. Thus, when performing experimental or practical model (3) calculations, it is necessary to estimate the unknown current parameters estimate the -th interval of constancy boundaries of the switching process adapt to the current movement model within the interval, and form a accurate position estimate, providing a solution to the main target-tracking task.
It may be noted right away that such a movement observation model complication will not necessarily make the filtering algorithms more difficult. Indeed, a certain physical meaning is embedded in the model, namely, is the target position coordinates and is the data of this position measurements, for example, bearings and ranges. Therefore, the parameter importance may not be so great since these parameters have a greater impact on the object’s future positions, and for filtering, it is much more important to observe the estimating current position. Such a situation occurs in the computational experiment discussed below but only in the absence of time delays, i.e., when . As soon as begins to differ significantly from the prediction accuracy, for which estimates are needed, begins to contribute significantly to the target-tracking problem-solving.
3. Optimal Bayesian Filtering and Identification
In order to obtain the Bayesian estimate
for model (1) or (2), i.e., to obtain the relations for the a posteriori probability density [
32], we need to repeat the proof of Theorem 1 from [
3]. There are no fundamental difficulties here, so we will describe it briefly, omitting the details.
To write the filter, an extended position vector
is needed since all possible time delays must be taken into account. The desired a posteriori probability density of the vector
given the observation vector
denotes
. For a more concise writing form, we also introduce an unnormalized a posteriori density
so that
Let us pay attention to the convenient notation for the a posteriori density arguments: , and . They correspond to vectors , и .
The extended position vector
and the equation for
has the following form:
where
denotes a sub-vector of vector
with elements from
-th to
-th.
Using the corresponding additive noise
we obtain the equation for
as:
Similarly, for observations
we have the following equation:
where the observations matrix function
is as follows:
and delays matrix
is defined as:
It means that the element
takes the value
if the observation
corresponds to the position
Here we can enumerate the values
,
of the
putting the sequence number
:
where
is the row number of the
–th column of the matrix
, in which there is
. Exactly the same, the possible values
of the time delay vector
are numbered as follows:
For random vectors and , the probability densities used below will be denoted as follows: is the marginal density of , is the density of the composite vector , and is the conditional density of given under the additional assumption .
To find the conditional distribution of the state
defined by (5) given the observations
defined by (6), we write down recurrent Bayesian relations for an unnormalized a posteriori probability density by analogy with the classical solution [
32].
Let us constitute the desired a posteriori density in the following form:
In the last equation, it is taken into account that in (6), there is no explicit dependence of on which means equality
Next, for the first multiplier
, we perform the following transformations:
For the second multiplier
, it holds
The numerator of the obtained equality is the desired non-normalized a posteriori density (4), since the denominator performs only the function of normalization, i.e.,
Recall that the defined above variable
numbers the values of
and
. Calculations start with the following initial condition:
Here we used the notations , for the dynamic model disturbance probability density and for the observation error probability density.
After solving (7) and normalizing
the Bayesian estimates
and
are obtained by integrating:
4. Conditionally Minimax Nonlinear Filter
So, there is a fundamental possibility to obtain optimal estimates. This is the first conclusion from the optimal Bayesian filtering and identification relations obtained in the previous section. However, it is not possible to rely on their practical application. This is how we get the second conclusion. Indeed, even in the case of an AUV moving in a plane at a constant velocity for tracking, we would need to implement Formula (7) calculation for dimensions and which gives the dimension of the vector equal to and the same number of values It seems, at the least, rash to hope for success in calculating integrals for such dimensions with good accuracy in the real-time mode receipt of observations .
If we are unable to implement an optimal solution, then we need to use a suboptimal estimate that has good accuracy and is practically feasible. There are many methodologies that could provide such a tool. The choice can be made from various universal solutions, such as the extended Kalman filter [
33], the Gaussian sum filter [
34], particle filters [
35,
36], and sigma point filters [
37,
38]. Specialized methods, such as pseudo-measurement filters [
39], may be more promising in such tasks, as demonstrated in [
40]. However, all these methods are intended for use in the models (5) and (6) and cannot be applied in model (3) without refinement. The huge dimensions that prevent the optimal filter use will also lead to great difficulties when using known suboptimal filters. Moreover, the characteristic and long-known tendency of such filters to diverge will exacerbate the complexity of calculations.
Only the concept of conditionally optimal filtering [
25,
26] allows usage to the proposed random time observations delays model without deep refinement. An important part of this concept is the initial filter structure flexibility. Anyone can take into account physical, geometric, and other laws in force in a particular observation system. The final filter structure obtained as a result of its parameter optimization guarantees the estimation of the statistical properties, namely, non-bias, non-divergence, and superiority over the a priori estimate. In the problem under consideration, the flexible filter structure allows for taking into account not only the laws governing the AUV movement and measurements but also time delays. In addition, the conditionally optimal filter optimization is grounded on the well-known Gaussian distribution minimax property [
27], which provides robustness to the Kalman filter [
41]. Complementing all this with the filter parameters calculation using computer simulation, we obtain effective, high-quality, and realizable solutions to both the target-tracking and movement parameter identification problems.
Based on the conditional minimax terminology [
27] and the designations used in the target-tracking statement in [
3], we briefly describe the CMNF synthesis stages, adapting the description to the problem under consideration for the system (1) or (3).
The desired filtering estimate
combines the position
estimate and the movement model random parameter
estimate given the observations of
This estimate has the standard prediction–correction form:
Here, to compute a position prediction , it is necessary to choose the basic prediction function and to compute a correction, it is necessary to choose the basic correction function , , . After selecting them, the prediction is calculated as the transformation minimizing the distance to the correction is calculated as the transformation minimizing the distance to Distance has mean square sense, as mentioned above.
Note, the correction does not use the parameter estimate (there is no argument ), which is explained by the absence of the parameters in the observation model.
Implementing
and
functions is linear:
where
In (9), in addition to the mathematical expectation notation
is the covariance of
and
is Moore–Penrose pseudoinversion [
42]. At the same time, the position prediction
estimates
and
are unbiased with the following estimation error covariances:
where matrices
и
are upper and lower diagonal blocks of the matrix
.
Basic prediction and correction function linear transformations (8) have a minimax justification as the best estimates for classes of all probability distributions with a known mean and covariance [
27]. We replace the filter coefficient
,
,
, and
analytical calculations by Monte Carlo estimates in practical calculations, i.e., instead of
in (9), we substitute
where
are
sample values modeled on a computer. Finally, estimate (8) existence of sufficient conditions in relation to model (1) is in [
2,
3].
Thus, to obtain the target-tracking problem solution, we need to specify movement and observation conditions and synthesize the CMNF by selecting the basic prediction and correction functions.
5. Tracking and Parameter Identification of an AUV Moving in a Plane
5.1. Observation System Model
The paper [
3] contains the results of the first practical study of the proposed random delayed observation model and the filtering algorithms (8) and (9). The computational experiment idea for this work is to completely reproduce the same dynamic system and measuring complex, adding only the unknown movement parameter assumption. Therefore, we are considering a simple AUV movement model in a plane with unknown velocity. AUV moves in the horizontal plane
and has custom coordinates
and
(km), i.e., the position is
The Gaussian vector
gives the initial AUV’s position
and has the mean
and the covariance
The continuous movement model is sampled in increments of h (hour). The movement begins at time and ends at time , i.e., the movement lasts moment h or 6 min.
We denote and AUV velocity values by directions and , respectively. At first, we will assume that the velocity on each trajectory is constant, i.e., and . Initial Gaussian vector has the known mean, kph and kph and the covariance . Accordingly, we assume that the values and are unknown and subject to identification, i.e., , , .
Then, turning to model (3), we will assume that the velocity keeps constant values at time intervals between process jumps where which corresponds to three velocity changes on average over the tracking period, or an average velocity constant time of 2 min. Next jump in interval means that in time point the previous constant velocity value replaces the new value, which has the same distribution as .
The AUV is affected by disturbances
in the
axis direction and
in the
axis direction. They form a real velocity deviating from the nominal velocity
to a random value of the order of 25 kph. So, the position vector has the form:
Describing chaotic velocity changes, vector is assumed to be Gaussian with the mean and the covariance .
The measuring complex consists of the same type of observers located at two points on the
plane: the first has coordinates
,
km, the second has coordinates
,
km. Assuming that acoustic sonars are used for observation, and the velocity of sound in water is equal to
kph, we can determine the maximum possible observation delay. We have already indicated above that
, i.e., the maximum value by which observations can be delayed is
s. Suppose the observers are stationary acoustic beacons installed in advance. Typical measurements performed by such devices are bearing angles [
43]. In order not to clutter up our model, we will measure the distance to the AUV since the receiving measurements delay depends on the distance. It is clear that with two beacons, distance determining is a simple geometric problem solution. In the experiment, we immediately assume that each observer measures the distance to the target and the bearing angle.
So, we get the measurements (distances measured by the first and second observers) and (direction cosines measured by the first and second observer). The Gaussian vector of observation errors has the mean and the covariance
The observers measure the AUV position characteristics at time points
and
, i.e., with a delay from the current position
by the value of
(first) and
(second), that take the following values:
In (12), the notation is used for the floor function of and the potential possibility of the observed object going at a distance for which the delay value becomes greater than the specified maximum is taken into account.
Thus, the observation vector
is as follows:
To bring these designations into line with (1) the vector components must be expressed using and from (12) as and .
5.2. CMNF Synthesis
The filter (8) synthesis consists of the structural functions
and
and in the coefficients (9) approximate calculation by the Monte Carlo method. The proposed in [
3] structure fully meets the problem under consideration. It remains only to clarify the aspects related to the identified velocity.
Thus, the basic prediction function
has the form due to the dynamics (11), i.e.,
where
,
.
Further, to make a correction, we need to estimate (more exactly to predict) values for delays (12), which are naturally set as follows:
where
.
We define the basic correction function
as a result of recalculating the distances and cosines into Cartesian coordinates. The obtained approximate coordinates correspond to the AUV’s position with the delays
so it needs to be shifted. For the shifting, we use the delay estimates
and
out of (14) and the current velocity identification estimates
. Finally, the correction itself is the difference between the predicted position and the calculated approximate coordinates:
5.3. Computer Simulations
In all performed computational experiments, we simulated two independent samples of random trajectories of the observation system (11) and (13) (in two versions (1) or (3)), CMNF (8) with basic correction (15) position estimate , and velocity estimate We used the first sample to calculate the filter coefficients (9) and their theoretical accuracy (10). This sample can be called a training sample. The second sample allows us to calculate the CMNF estimate and actual quality. When the model is system (1), then and the task is unknown constant velocity identification, more precisely its systematic component. When the model is system (3), then is an estimate of the current velocity, which remains constant over a certain time interval. We need to see how accurate the velocity estimate is at these intervals and how the filter responds to sudden changes in velocity.
The estimate error mean square standard deviations denoted by determine the estimation accuracy of the AUV’s position and velocity. This is practical accuracy. The values represent the theoretical accuracy of the CMNF position estimate. The values represent the theoretical accuracy of the CMNF velocity estimate. We compare these values with the actual accuracy and if they coincide (sufficiently close), we conclude that the filter synthesis is successful, i.e., there is the sufficient statistical volume of the training sample.
Our fundamental interest, of course, is models with the specified time delay value and two options (1) or (3) for movement parameter identification, i.e., with velocity components and standard deviations kph and kph, respectively. But in order to understand what effect the time delay and unknown movement parameter factors have on the result, we also performed calculations without time delay modeling, i.e., for and without velocity identification, i.e., for zero variances and assuming that they are known.
Figure 1,
Figure 2 and
Figure 3 begin to illustrate the obtained results. These figures represent several randomly selected trajectories from the available
trajectories of the second sample and the diversity of the AUV movement nature. The characteristics of the estimates’ accuracy are discussed below.
Figure 1 shows several typical AUV trajectories
and the corresponding CMNF position estimates
The graphs at the top are trajectories for the switching velocity model (3), and the bottom graphs are trajectories for the constant and unknown velocity model (1). We see how, in the lower graphs, the trajectories are quite diverse and chaotic. However, they still show clearly defined directions that remain constant throughout the entire observation period. Compared with the trajectories in the upper graphs, these show only the general trend of AUV movement away from observers as provided by the model. At the same time, the nature and movement direction do not demonstrate constancy but change at different moments, in different directions, with different magnitudes.
Figure 2 complements the trajectories examples. It presents the velocity estimate
trajectories. As in the previous figure, the graphs above correspond to model (3), and below to model (1). In all the graphs presented, we can see that the filter is trying to identify an unknown velocity and does it quite successfully. But if we look at the graphs below, we can see a typical example of parametric identification where the estimates tend to converge to a specific value. On the other hand, in the graphs above, the filter does not have enough time and observations to indicate convergence. Instead, it can only demonstrate “intentions” toward convergence. It is all the more interesting to see how such a difference affects the solution of the main task of AUV tracking.
Figure 3 of this group illustrates several time delay value trajectories,
and
from (12). Here, we can assess the adequacy of the assumption
and the variety of forms.
Figure 1,
Figure 2 and
Figure 3 demonstrate a qualitative picture of the estimation problem solutions. To determine the estimates’ objective quality and compare them, we need to calculate a quadratic criterion. According to (10), filter coefficients (9) determine the theoretical accuracy
and
so we find out these values when we synthesize the filter in the first sample.
The second sample purpose is only to verify the synthesis effectiveness, for which we need to calculate the actual accuracy
For ease of interpretation, the measurement unit for the quality of the AUV’s position estimate quality is meters, and kph is left for velocity.
Figure 4 shows a graph of the position estimate accuracy, and
Figure 5 shows a graph of the velocity estimate accuracy. In each pair of graphs, first of all, we compare the calculation results for model (3) (left) and for model (1) (right).
All these visual and quantitative figures illustrate the real difference between models with and without velocity jumps. Of course, as seen in both
Figure 4 and
Figure 5, the differences between the theoretical and actual accuracy of all CMNF estimates are very small. To give a completely quality objective assessment of the performed estimates,
Table 1 and
Table 2 below show the accuracy numerical characteristics. Namely, the quality analysis of
gives the following values:
The values characterizing the quality of identification of the estimates
have the following form:
To make the comparison as informative as possible, we have supplemented the calculations for the main models (1) and (3) with a few more simplified ones. The most complete model (3) is denoted in the tables as
and its simpler version without velocity jumps is denoted as
The example for the model with known velocity
kph,
kph complements the options for comparison, and its notation is
Table 2 does not contain this model because there is no identification in it. And for all three models, we repeated the calculation under the assumption
. Note that the calculations for the third (
) and sixth (
) models correspond to the experiment presented in [
3].
Once again, note that the quantities dimensions in
Table 1 are meters. It should be noted that the parameters in models (11)–(13), although they do not conflict with common sense, may have “extreme” values in some sense. This applies both to the “fast” and chaotic AUV movement, as well as to observers who are not very accurate and are located far away. This choice is meaningful because the computational experiment task was to compare models and analyze certain factors that influence the estimates’ accuracy. For this reason, such “large” parameters were chosen. Some more adequate numerical characteristics can be found in [
44].