1. Introduction
Due to the motion experienced by ship-borne mechanical platforms on the sea, it is essential to consider the three degrees of freedom: heave, roll, and pitch. Typically, the motion signal in the heave direction is acquired through double integration of data from an acceleration sensor. However, ship-borne mechanical platforms also experience movements in roll and pitch directions, which can cause the acceleration sensor to deviate from the ideal horizontal plane. These inclination angles cause additional horizontal forces to be exerted on the piezoelectric element of the acceleration sensor, leading to errors in the displacement measurement obtained through integration. As a result, it becomes difficult to accurately calculate the behavior of the ship-borne mechanical platform.
The key concerns in estimating the behavior of ship-borne mechanical platforms are mainly about improving the accuracy and real-time performance of the sensor system, particularly under the influence of low-frequency motion caused by sea waves. Challenges arise as each type of sensor has its limitations and cannot solely obtain accurate multidimensional behavior data. Aggressively increasing the number of sensors is not a wise solution, as it brings a massive computational burden. To achieve a precise estimation of ship-borne mechanical platform behavior while eliminating information redundancy, an efficient multiple-sensor fusion method with multilevel information processing abilities is required.
To address the shortcomings of a single sensor in accurately estimating real-time and comprehensive multi-degree-of-freedom information, scholars have conducted extensive research on multi-sensor fusion techniques. Luo R.C. proposed the sensor data fusion system in 1988 [
1]. Durrant-Whyte H.F. developed a fully decentralized architecture for data fusion problems in 1990 [
2]. Wen W. in 1992 described an algorithm for implementing multi-sensor systems considering constraints in a model-based environment [
3]. Harris C.J. formally introduced the process of data fusion and sensor integration and various implementation architectures in 1998, considering data fusion as a key element of the overall system integration [
4]. Llinas J. provided a tutorial on data fusion in 1998, presenting data fusion applications, process models, and the identification of suitable techniques [
5]. Chen S. designed a multi-sensor data fusion system in 2003 [
6]. Herpel T. conducted a study in 2008 on the impact of combining sensor data at different abstraction levels on the performance of multi-sensor systems [
7]. In the same year, Manjunatha P. proposed a multi-sensor data fusion algorithm in WSN [
8]. Dong J. presented an overview of recent advances in multi-sensor fusion [
9]. Wolter P.T. used partial least squares regression to integrate different combinations of satellite sensor data in 2010 [
10]. Medjahed H. proposed an automatic in-home healthcare monitoring system with several sensors in 2011 [
11]. Banerjee T.P. proposed a method for fault signal classification based on sensor data fusion in 2012 [
12]. Frikha A. proposed a method to determine the weights of a sensor reading set [
13]. Azimirad E. presented a comprehensive review of data fusion architecture in 2015 [
14]. In the same years, G. Fortino proposed a system based on a multi-sensor data fusion schema [
15]. S. Rawat used a neural network to solve an inherent problem of multi-sensor data fusion in 2016 [
16]. Duro J.A. proposed a novel multi-sensor data fusion framework in 2016 [
17]. Maimaitijiang M. used thermal data fusion to estimate parameters in 2017 [
18]. Jing L. proposed an adaptive multi-sensor data fusion method for fault diagnosis in 2017 [
19]. Kumar P. proposed a multi-sensor fusion framework in 2017 [
20]. Bouain M. proposed a multi-sensor data fusion (MSDF) in 2018 [
21]. Xiao F. proposed a method for multi-sensor data fusion in 2018 [
22]. Zhang W. proposed a model based on multi-sensor data fusion in 2019 [
23]. De Farias C.M. proposed a technique that attributes an interval to an abstract sensor in 2019 [
24]. Xiao F. proposed a method for multi-sensor data in 2019 and then proposed a hybrid MSDF method in 2020 [
25,
26]. Muzammal M. proposed a data fusion-enabled ensemble approach in 2020 [
27]. Li N. proposed a method based on a multi-sensor data fusion model in 2021 [
28]. Kashinath S.A. reviewed methods used for real-time and multi-sensor studies in 2021 [
29]. Fei S. proposed a method based on multi-sensor data that can improve prediction accuracy in 2023 [
30]. Han C. proposed an absolute displacement measurement method in 2023 [
31]. R.G. Wright integrated the multi-sensor fusion method into autonomous ships in 2019 [
32]. R. Ma proposed a target fusion algorithm based on multisensory information in 2020 [
33]. U. Ali proposed a solution based on a board sensor in 2021 [
34]. E. Higgins evaluated data fusion algorithms in 2022 [
35]. However, in the field of three-degree-of-freedom motion measurement of ship-borne mechanical platforms, the method of multi-sensor fusion has been seldom used. There are still many technical problems in the application of ship-borne mechanical platform motion measurements. Especially, the inherent interference between the effects of different degree-of-freedom ship movements on sensor outputs causes challenges to traditional sensor-fusion methods.
In this paper, we propose a ship-borne mechanical platform motion measurement correction method based on multi-sensor fusion to improve the accuracy of the ship-borne mechanical platform motion signal computed by the double integration of the single-degree-of-freedom acceleration sensor. The proposed sensor configuration includes a set of angle sensors and four sets of acceleration sensors, which eliminates the influence of the inclination angle on the integral displacement signal in the heave direction. We utilize the Kalman filter to estimate the optimal inclination angle and heave displacement. In the proposed Kalman filtering-based algorithm, we use the calculated angle signal as the estimation value and the angle signal collected by the angle sensor as the observation value to iteratively optimize the inclination angles. In order to prove the effectiveness of the method, we verified the proposed algorithm on the laboratory platform by simulating the motion of the ship-borne mechanical platform and computing the multi-sensor fusion heave displacement estimation. Finally, we compared the estimated data with the standard motion signal obtained by a laser sensor. It is verified that the algorithm based on the data fusion of acceleration sensors and tilt angle sensors can restore the actual motion characteristics of the ship-borne mechanical platform more precisely than methods using only one type of motion sensor.
The main contributions of this paper are summarized as follows:
A method for measuring and correcting the heave direction of ship-borne mechanical platform motion based on multi-acceleration-sensor fusion is proposed. The heave displacement signal of the platform under an unknown tilt angle is calculated by the outputs of four sets of acceleration sensors with improved accuracy.
A method for measuring the change in inclination angle of ship-borne mechanical platform motion based on the Kalman filtering technique using sensor fusion of an acceleration sensor and an angle sensor is proposed. The calculated tilt angle of the platform in roll and pitch directions calculated by four sets of acceleration sensors is used as the estimation value, and the inclination angle signal measured by the angle sensor is used as the observation value. Innovation-based adaptive Kalman filtering is used to obtain the inclination angle and the heave displacement of the platform with higher accuracy.
The subsequent sections of this manuscript are organized as follows:
Section 2 presents the effect of tilt angle on the integrated displacement signal in the heave direction.
Section 3 details the correction principle and the proposed correction method for ship-borne mechanical platform motion measurement based on multi-sensor fusion.
Section 4 designs experiments to verify the effectiveness of the ship-borne mechanical platform motion measurement correction method based on multi-sensor fusion.
Section 5 presents the conclusion and provides suggestions for future work.
2. Preliminary Work
There are two main types of acceleration sensors at present: piezoelectric sensors and capacitive sensors. Both sensors output acceleration-related signals, but with different working mechanisms.
Capacitive acceleration sensors use changes in capacitance to measure acceleration. It usually consists of two parallel metal plates with a central mass. When the sensor is subjected to acceleration, the mass will be displaced relative to the metal plate, thereby changing the capacitance value between the metal plates. By measuring the change in the capacitance value, the acceleration experienced by the sensor can be calculated.
Piezoelectric acceleration sensors use the piezoelectric effect for measurement. It usually consists of one or more piezoelectric crystals, a vibrating proof mass, and signal processing circuitry. When the sensor is subjected to acceleration, the vibrating proof mass compresses or stretches the piezoelectric crystal, which creates an electrical charge and generates a voltage signal. The signal processing circuit will amplify, filter, and digitize the voltage signal to finally obtain the measured value of acceleration.
However, in ship-borne mechanical platform motion measurement, capacitive sensors have many disadvantages:
Capacitance is seriously interfered with by the marine environment, such as temperature, humidity, and other factors. Generally, it needs to be shielded and filtered; otherwise, it will affect the measurement accuracy.
Capacitive sensors need to be installed on the hull, which is easily subjected to vibration and shock from the hull.
In marine environments, capacitive sensors are susceptible to seawater corrosion and water pressure, requiring special protection methods.
Piezoelectric sensors are known to be sensitive to temperature drifts and humidity. The sensitivity of the sensor to these environmental factors can lead to measurement errors and reduced accuracy. To mitigate these effects, several techniques have been proposed, such as temperature compensation and humidity shielding. Temperature compensation involves designing the sensor to be insensitive to temperature changes by using materials with a low coefficient of thermal expansion. Humidity shielding involves coating the sensor with a material that is impermeable to water vapor, such as polytetrafluoroethylene (PTFE), to prevent moisture from affecting the sensor’s performance. These techniques can help improve the accuracy and reliability of piezoelectric sensors in various applications.
Therefore, piezoelectric sensors are usually more suitable for use in ship-borne mechanical platform motion measurements. Piezoelectric sensors are not affected by harsh environments such as high temperature and high pressure and have better anti-interference abilities, which provide more accurate measurement results. We will discuss the acceleration sensor based on piezoelectric effects in the rest of the article.
During the process of measuring acceleration with a piezoelectric sensor, the output results can be directly affected by vertical and horizontal movements, such as pitching and rolling. These movements can alter the orientation of the sensor and therefore affect the accuracy of measurements. Additionally, any tilting movements can also impact the sensor’s signal, in addition to any coupling effects on the overall system. Mainly because any movement or tilting of the acceleration sensor can affect the orientation of the mass within the device and therefore alter the output signal. For example, if the acceleration sensor is tilted to one side, the gravitational force acting on the mass will be shifted, leading to inaccurate measurements. Similarly, if the acceleration sensor is subjected to any pitching or rolling movements, the direction of gravitational force will change and affect the measurements accordingly.
To compensate for these effects, it is important to properly calibrate the acceleration sensor and account for any potential sources of error. This can include adjusting for any tilting or coupling effects. The influence of the inclination angle on the integrated displacement signal in the heave direction is shown in
Figure 1.
When the ship-borne mechanical platform is in its horizontal position, the relationship between the heave acceleration and the support force
of the ship-borne mechanical platform to the acceleration sensor is given by
where
and
are the mass and the gravity force of the proof mass, respectively. As the output voltage of the piezoelectric sensor
is approximately linear to the applied stress, we obtain that
where
is the linearized piezoelectric coefficient. The sensitivity
of the acceleration sensor could be expressed as
However, in real-world applications, pitch angle
and roll angle
tilt the ideal coordinates, and the data should be accordingly adjusted in real-time. The transformation matrix from the earth coordinate system to the accelerator platform coordinate system is obtained as follows:
Since the acceleration sensor only measures normal acceleration in the O-X
1Y
1 plane, the detected acceleration
could be calculated by
Therefore, the output voltage of the piezoelectric sensor is
The actual acceleration
of the sensor can be obtained by
where
and
are the slope correction factor and intercept correction factor of the acceleration sensor, respectively, as follows:
and
where
is the acceleration of gravity.
Now we assume that the accelerator has a displacement of
in the heave direction. In other words, the movement of the sensor
can be denoted as:
During this small time period,
and
can be regarded as constant. Therefore, the displacement of the acceleration sensor
under the ship-borne mechanical platform coordinate system is computed as follows:
As shown in
Figure 2, the integration result of the sensor output is essentially the track along
(the black arrows), which can be obtained by Equation (11):
Based on the relationship of
and
in Equation (12), the displacement correction function is thus established as
where
is the actual displacement of the sensor in the heave direction (the blue arrow).
3. Proposed Algorithm
In this work, a multi-sensor fusion ship-borne sensing platform consisting of one gyroscope for angle detection and four piezoelectric acceleration sensors for displacement detection is developed. The proposed sensing system aims to optimize the real-time estimation of the three degrees of freedom of ship-borne mechanical platform movement through two novel multi-sensor fusion algorithms, which will be discussed in detail in the following. The sensor configurations are demonstrated in
Figure 3. Four uniaxial acceleration sensors S
A, S
B, S
C, and S
D are installed at the corners of the square platform with sides of length L. Moreover, a gyroscope for tilt angle detection is fixed at the center of the square platform.
3.1. Multi-Sensor Fusion of Acceleration Sensor Sets
In the actual heave direction, four acceleration sensors have displacements of
Za,
Zb,
Zc, and
Zd, respectively. These displacement values can be obtained by calculating the double integral over time of the sensor outputs. However, due to the unstable tilting motion of the ship-borne mechanical platform, the measured acceleration data tracks the displacement along the direction perpendicular to the mounting base instead. We denote these deflected displacements as
Xa,
Xb,
Xc, and
Xd, respectively. As discussed in
Section 2, we can theoretically calculate the actual heave displacement according to the available sensor data and the ship-borne mechanical platform motion status as follows:
Considering the real-time operations in the controlling process, the above equation can also be written in discrete forms as follows:
where
,
,
, and
are the real-time velocities obtained by the four sensor outputs at time
, respectively.
Because of the known spatial arrangement of the sensor sets, the outputs of four acceleration sensors can be synthetically combined to estimate the tilt angles. The kinematic equation for the pitch angle is as follows:
Similarly, the kinematic equation for the roll angle is
By combining Equations (16) and (17), roll angle and pitch angle can be solved. In this way, an estimation of heave displacement is made in real-time utilizing the above solutions in Equation (15).
3.2. Motion Estimation Based on Kalman Filtering
In the previous section, a tilt angle estimation method relying on just four acceleration sensor sets was proposed. Another commonly used ship-borne sensor is the gyroscope for direct angle detection. Generally, piezoelectric acceleration sensors have superior robustness and accuracy due to their direct electromechanical coupling characteristics, whereas angle sensors possess lower drift with the help of gravity. It would greatly improve the precision of motion estimation if these two types of sensor signals were rationally combined. In this work, we adopt the Kalman filtering technique, in which the measurement data from the angle sensor
is the observation and the computed data from the acceleration sensor sets
is the estimate. In this case, the system state dynamics in discrete form can be written as
where
and
are the computed angle vectors from acceleration sensor sets at time
k and time
k−1, respectively.
denotes the state transition matrix.
and
represent the noise drive matrix and noise vector, respectively.
,
, and
are measurement vectors from the angle sensor, measurement matrix, and measurement noise vector at time
k, respectively. Both
and
are assumed to have zero mean normal distributions with
and
, where
and
are the transposes of vectors
and
respectively, and
is the observation noise covariance matrix.
In the Kalman filtering process, a prior state estimate is first performed using
The prior estimate covariance is
Afterwards, the state estimate is updated based on the observation data and we have the posterior state estimate as
where K is the optimal Kalman gain, given by
The posterior estimate covariance is
However, it is hard to accurately evaluate the statistical characteristics of noise in both integral error and angle measurement. Such limitations hinder the implementation of Kalman filtering for estimating ship-borne mechanical platform motion in real-time. A robust adaptive filtering technique is thus needed, in which robust estimation theory is applied to eliminate measurement outliers and adaptive factors are incorporated to control the influence of dynamic model error. Given these considerations, we further propose an innovation-based adaptive filtering step to verify the angle measurement results. The procedures are shown as follows: First, the innovation
and its covariance
are computed by
Then, we define a weigh boundary value function as
where
is the matrix trace of covariance
. The adaptive factor
is thus determined by
where
is a constant set between 0.9 and 1. Here,
= 0.9 is adopted. We can then adjust the Kalman gain accordingly, as
By repeating the two processes of prediction and update, the motion state estimation can be iteratively optimized until the results are converged. The whole Kalman filtering process is schematically illustrated in
Figure 4.
4. Experimental Results
To experimentally verify the feasibility of the proposed algorithm, we set up the ship-borne mechanical platform with one gyroscope and four piezoelectric acceleration sensors in the lab. As shown in
Figure 5, four acceleration sensors were fixed at the corners of a square on the six-degree-of-freedom wave compensation platform (orange points). One gyroscope for angle measurement was placed at the center of the upper plane (blue point). A laser-ranging sensor is installed on the center bracket under the platform (black) to provide the standard heave motion signal for the ship-borne mechanical platform.
In this experiment, we use the WitMotion HWT901B RS232 Sensor. It has the following advantages:
(1) High Precision Pitch Roll (X and Y-axis) Accelerometer + Angular Velocity + Angle + Magnet Field + Air Pressure + Altitude data output. Robust MEMS designs and high performance in harsh environments.
(2) Designed with advanced Kalman filters and a 32-bits processor, it ensures high stability and precision of 0.1–200 Hz data output and a dynamic angle measurement accuracy of 0.05 degree.
(3) In-built with a military-grade RM3100 magnet field sensor, which cannot be affected by magnetic field interference, it can automatically correct the data output to an accurate value.
(4) With extremely high resolution, acceleration (0.005 g), gyroscope (0.61°/s), and magnet field (16 bits).
(5) High angular accuracy after calibration: X, Y-axis: 0.05° (Static), X, Y-axis: 0.1° (Dynamic).
In addition, the laser sensor we use is the Panasonic HG-C series. As compact as a photoelectric sensor, the CMOS laser sensor allows the display of the actual measured distance as accurately as a displacement sensor. It has the following characteristics:
Accurate and Linearity: +/−0.1% F.S.
Compact and Lightweight: W20 mm × H44 mm × D25 mm
Precise level detection, Repeatability: 10 μm
By sending instructions to the servo controller, the ship-borne mechanical platform was controlled to simulate the three-degree-of-freedom movement of the ship. We used a data collector to acquire all sensor data with a sampling frequency of 200 Hz and a sampling time of 100 s.
Figure 6 displays the obtained signal after integrating four acceleration sensors, respectively.
Pitch and roll angle values for observation input in the filtering process were obtained by the angle sensor. Their outputs are shown in
Figure 7.
Using the proposed multi-sensor fusion method, the displacement values integrated by the four acceleration sensors were corrected, and the real displacement signal in the heave direction was finally calculated. The estimated displacement signal was compared with the standard displacement signal collected by the laser sensor. The laser displacement signal is considered to be the real heave displacement value of the ship-borne mechanical platform. The data shows that the heave displacement signal corrected based on multi-sensor fusion can effectively improve the accuracy of displacement signal measurement compared with the integrated displacement signal of a single acceleration sensor. The comparison results of the displacement signal based on multi-sensor fusion correction and the displacement signal of the laser sensor are shown in
Figure 8. The comparison results of the integrated displacement signal of a single acceleration sensor and the displacement signal of the laser sensor are shown in
Figure 9.
After analyzing the above results, we found that the average error between the displacement signal corrected by using multiple sensors and the laser standard heave displacement signal was 25.34 mm. As a comparison, when a single acceleration sensor was used, the average error of the heave displacement signal denoted by No. 1–4 is [128.1711 mm, 65.32 mm, 73.63 mm, 71.8513 mm].
At the same time, based on multi-sensor fusion data, we used the acceleration sensor to calculate the roll angle signal and pitch angle signal of the ship-borne mechanical platform and performed Kalman filtering on the inclination signal and angle sensor signal to estimate the inclination angle with improved accuracy. Here, the value of our process noise Q in Kalman filtering was [4 0; 0 1]; the value of observation noise variance R was 1, which made the estimated value more inclined to the angle sensor signal data. The results of the roll angle signal and pitch signal of the ship-borne mechanical platform calculated using the integrated displacement signal of the acceleration sensor are shown in
Figure 10. After Kalman filtering with a combination of the angle sensor measurement signal and the calculated angle data through acceleration sensors, the comparison of these three sets of angle information is shown in
Figure 11.
Combining the roll angle and pitch angle signals collected by the angle sensors in
Figure 7, correlation analysis was performed on the angle signals calculated based on multiple acceleration sensors. The results showed that the correlation coefficient of the two groups of signals was 0.87, which proved that the inclination signal of the ship-borne mechanical platform calculated by the acceleration sensor was reliable. It can be seen from the experimental results that the angle signal calculated by the acceleration sensor and the angle signal measured by the angle sensor have the following advantages after Kalman filtering:
Reduce the influence of noise and error. The angle signal calculated by the acceleration sensor usually has large noise and error. Meanwhile, the angle signal measured by the angle sensor may also be affected by external interference. Through Kalman filtering, these noises and errors can be filtered out so as to obtain more accurate angle signals.
Improved response speed. The angle signal calculated by the acceleration sensor has a faster response speed, but there are large noises and errors. On the other hand, the angle signal measured by the angle sensor has a slower response speed but possesses higher precision. Through Kalman filtering, the advantages of the two can be combined, which not only improves the response speed but also improves the accuracy.
Improve system stability. Since the angle signal calculated by the acceleration sensor has large noise and errors, the system may jitter or become unstable. Through adaptive Kalman filtering, these noises and errors can be filtered out, thereby improving the stability of the system.
Reduced cost: the cost of the angle signal calculated by acceleration sensors is lower than that of the angle signal measured by advanced angle sensors. Through the Kalman filter, the angle signal calculated by the acceleration sensor can be filtered to obtain a result comparable to or even better than the angle signal measured by the angle sensor, thereby reducing the cost of using expensive gyroscopes.
5. Conclusions
This paper proposes a correction method for shipborne platform motion measurements based on multi-sensor fusion. First, by analyzing the principle of the piezoelectric acceleration sensor, a correction method with a novel configuration of four acceleration sensors is proposed based on the fusion results, which eliminates the influence of the roll angle and pitch angle on the displacement signal after acceleration integration. Secondly, adaptive Kalman filtering is performed to combine the angle signals collected by the angle sensor and the angle signal calculated by the acceleration sensor sets. The estimated inclination angle of the ship-borne mechanical platform showed an improved correlation with the standard motion data obtained by a laser sensor, as verified by the experiments.
The advantage of this method is that it can improve the accuracy of measuring the displacement signal of the ship-borne mechanical platform in the heave direction. It can correct the influence of the roll angle and pitch angle on the integral of the heave direction when the ship-borne mechanical platform moves with three degrees of freedom, eliminate the error caused by the inclination angle, and greatly improve the reliability of the motion signal. At the same time, the disadvantage of this method is that multiple sets of acceleration sensors are used, there is a signal calibration problem, and the sensitivity of the calibration cannot be well controlled, which will also cause errors in the measurement of the displacement signal.
In the present work, the system we built is based on the fusion of four acceleration sensors to correct the displacement signals of the ship-borne mechanical platform in the heave direction, and by combining the angle sensor data, Kalman filtering is performed on the roll angle signal and the pitch angle signal to estimate the true inclination angle. In future work, we will further study the calibration problem of multiple acceleration sensors. By combining algorithms such as neural networks, the sensors can be calibrated with nonlinear characteristics to overcome the problem of acceleration sensitivity under different sea conditions.
At the same time, in order to reduce costs, we may also look for directions such as the use of inertial mechanical structures for research. By designing a novel inertial mechanical structure instead of multi-sensor fusion to correct the angle effect, the cost of solving the angle effect is further reduced.