Next Article in Journal
Markerless Knee Joint Position Measurement Using Depth Data during Stair Walking
Previous Article in Journal
Optimal Pricing and Power Allocation for Collaborative Jamming with Full Channel Knowledge in Wireless Sensor Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel 3D Pedestrian Navigation Method for a Multiple Sensors-Based Foot-Mounted Inertial System

School of Electronic and Information Engineering, Beihang University, Beijing 100083, China
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(11), 2695; https://doi.org/10.3390/s17112695
Submission received: 19 September 2017 / Revised: 3 November 2017 / Accepted: 17 November 2017 / Published: 22 November 2017
(This article belongs to the Section Physical Sensors)

Abstract

:
In this paper, we present a novel method for 3D pedestrian navigation of foot-mounted inertial systems by integrating a MEMS-IMU, barometer, and permanent magnet. Zero-velocity update (ZUPT) is a well-known algorithm to eliminate the accumulated error of foot-mounted inertial systems. However, the ZUPT stance phase detector using acceleration and angular rate is threshold-based, which may cause incorrect stance phase estimation in the running gait pattern. A permanent magnet-based ZUPT detector is introduced to solve this problem. Peaks extracted from the magnetic field strength waveform are mid-stances of stance phases. A model of peak-peak information and stance phase duration is developed to have a quantitative calculation method of stance phase duration in different movement patterns. Height estimation using barometer is susceptible to the environment. A height difference information aided barometer (HDIB) algorithm integrating MEMS-IMU and barometer is raised to have a better height estimation. The first stage of HDIB is to distinguish level ground/upstairs/downstairs and the second stage is to calculate height using reference atmospheric pressure obtained from the first stage. At last, a ZUPT-based adaptive average window length algorithm (ZUPT-AAWL) is proposed to calculate the true total travelled distance to have a more accurate percentage error (TTDE). This proposed method is verified via multiple experiments. Numerical results show that TTDE ranges from 0.32% to 1.04% in both walking and running gait patterns, and the height estimation error is from 0 m to 2.35 m.

1. Introduction

With the rapid development of location-based services (LBSs), multiple pedestrian navigation systems are being widely studied, which can roughly be divided into indoor and outdoor scenarios. Global navigation satellites systems (GNSSs), including GPS, GLONASS, Beidou and GALILEO, are a good method for outdoor navigation [1]. They provide global services and users can get accurate position, velocity and time (PVT) in the open air. However, GNSS signal availability is limited in indoors and urban canyons, so some alternative techniques need to be studied [2].
Several infrastructure-based alternative methods such as WIFI [3,4,5], Bluetooth [6,7], RFID [8], Ultra-Wide Band (UWB) [9,10], LED [11] and ultrasound [12] have been studied over the past years. These methods can provide sufficient positioning accuracy for LBS in normal situations. However, in some special scenarios such as fire emergency relief, infrastructure-based indoor positioning systems are not available. The inertial navigation system (INS) is an infrastructure-free one that uses inertial sensors such as accelerometers and gyroscopes which do not require external reference and installation beforehand [13]. Furthermore, the development of micro-electromechanical system inertial measurement unit (MEMS-IMU) has facilitated the production of inexpensive, lightweight and small-size inertial sensors with low power consumption [14].
MEMS-IMU can provide high accuracy positioning for a short time. However, the drift accumulates very fast, which over time leads to large positioning errors. In order to solve this problem, some researchers have utilized the zero-velocity update (ZUPT) algorithm, which is based on the status of the left and right foot. In other words, the left and right foot alternate between a stationary stance phase and a moving swing phase. The system detects the stance phase and applies ZUPT as pseudo measurements into the extended Kalman filter (EKF) navigation error corrector. This allows the EKF to correct the velocity error during each gait cycle, breaking the cubic-in-time error growth and replacing it with an error accumulation that is linear in the number of steps [15]. Many researchers have improved the ZUPT-aided EKF method. In [16], zero angular rate update (ZARU), heuristic heading reduction (HDR) and electronic compass are used for mitigating heading drift. In [17,18], a module consisting of both hardware and embedded software is provided. In [19], details of how to implement a foot-mounted MEMS-IMU positioning system are described.
The elegance of ZUPT lies in the fact that the foot swings to stance phase periodically during most types of human locomotion, such as walking, running, ascending and descending stairs. The stance phase is the time period during which the ZUPT can be applied to the system with the foot in stationary status [20]. Different ZUPT detectors can be classified into two categories depending on the equipment used. The first kind is using MEMS-IMU alone and the other is integrated with additional devices. MEMS-IMU-based ZUPT detectors utilize acceleration and angular rate which represent the state of motion of the pedestrian directly. Most ZUPT detectors utilize acceleration and angular rate obtained from MEMS-IMU. In [21,22], the stance phase estimation problem is formalized as a binary hypothesis testing problem. Four zero-velocity detectors including the acceleration moving variance detector, the acceleration magnitude detector, the angular rate energy detector, and the stance hypothesis optimal detector are evaluated. In [14,16], three conditions including the magnitude of the acceleration, the local acceleration variance and the magnitude of the gyroscope are used for foot stationary detection. The three conditions must be satisfied simultaneously. The structure of this kind of ZUPT detectors is simple and they have a good stance phase detection accuracy in walking, but when the pedestrian runs, the performance is limited because that this kind of method is threshold-based and the running threshold is not the same compared with walking. The second kind of ZUPT detector uses additional devices such as a shoe-embedded radar [23], a shoe-embedded RF sensor [24], or a shoe-embedded high resolution pressure sensor [25]. Generally speaking, this can bring better performance, but the complexity of system also increases. A permanent magnet-based stance phase detection method was developed in [26]. The authors attached a permanent magnet on one foot and an MEMS-IMU on the other foot. The walking pattern is measured based on the magnetic field strength of the permanent magnet, which changes very rapidly when the foot is in the mid-stance phase. The advantage of a permanent magnetic-based ZUPT detector is that it is not threshold-based and can be applied in both walking and running gait patterns. Compared with other ZUPT detectors using additional devices, mag-ZUPT has a more compact structure in that the measurement device is still a MEMS-IMU and the permanent magnet does not need a power supply. However, stance phase duration is not considered in [26]. Mid-stance should be expanded to stance phase with stance phase duration knowledge. In [27,28,29], the percentage of time involved in the stance is approximately 24.8%. However, we have performed some experiments and found that the stance phase duration is in fact associated with different movement patterns and the 24.8% value is only suitable for walking gait patterns. Stance phase duration is closely related with movement patterns. In order to develop a model of stance phase duration and movement pattern, peak-peak period information obtained from mag-ZUPT is used. Every mid-stance is called one peak and peak-peak period information depicts the frequency of stance phase which is relative with the stance phase duration. Compared with [26], we have a further research of the model of mag-ZUPT. Relationship of peak-peak information and stance phase duration is developed to have a quantitative calculation method of different movement patterns.
The height estimation suffers more from the MEMS-IMU drifts. MEMS-barometers are cheap and useful sensors to be implemented into the MEMS-IMU positioning system [30]. However, the barometer output is heavily influenced by the environment [31,32]. In order to solve this problem, a height difference information-aided barometer (HDIB) algorithm is developed. HDIB is based on the principle that the short time accuracy of INS output is very high and can be used to distinguish the patterns of a person’s vertical movement including walking on the level ground, ascending and descending stairs. This prior information can be used to filter the height estimation results from a barometer.
Percentage error of total travelled distance (TTDE) is used to evaluate the positioning accuracy of INS [33]. It is calculated from positioning error and total travelled distance in closed paths. However, because that the sampling frequency of MEMS-IMU is very high (usually more than 50 Hz), the trajectory calculated from the pedestrian navigation system is the trace of the foot which is mounted with MEMS-IMU. The length of this trajectory is longer than the actual trajectory which leads to the result that TTDE is smaller than the reality. In this paper, we develop a ZUPT based adaptive average window length method (ZUPT-AAWL). It is a more accurate and universal total travelled distance calculation method.
In conclusion we explore three questions in this paper:
  • How to use the permanent magnet in running movement to get a more accurate ZUPT estimation?
  • How to get a more accurate height estimation fusing MEMS-IMU and barometer?
  • How to get a more accurate TTDE?
In order to solve these problems, we developed a novel 3D pedestrian navigation method integrating MEMS-IMU, barometer and permanent magnet which is shown in Figure 1.
This system contains three sensors including one MEMS-IMU, one barometer and one permanent magnet. In fact, magnetometer is not part of IMU. Considering that usually accelerometer, gyroscope and magnetometer are integrated in one device, magnetometer is regarded as part of MEMS-IMU in this paper for convenience. MEMS-IMU collects the 3-axis accelerometer, gyroscope and magnetometer readings which are ( a x b , a y b , a z b ) , ( ω x b , ω y b , ω z b ) and ( m a g x b , m a g y b , m a g z b ) , respectively. The magnetometer readings are the composite magnetic field strength of the earth magnetic field and the permanent magnet which is used to detect the mid-stance phase and then expanded to the stance phase. Unlike acceleration and angular rate, air pressure value obtained from barometer is only one dimension.
The basic structure of a foot-mounted MEMS-IMU positioning system is INS-EKF-ZUPT (IEZ). Stance phase information obtained from mag-ZUPT is used to get the error estimation and transmitted to EKF to calculate error state vector. INS calculates the positioning results (posx,posy,posz). (posx,posy) is the planar positioning result and posz is the vertical positioning result. In order to get a better height estimation, a barometer is used in this system. The difference information of posz can distinguish the patterns of the person’s vertical movement including walking on the level ground, ascending and descending stairs. This information can be used to filter the height estimation from the barometer to get a better height positioning result.
TTDE is an important indicator to evaluate positioning accuracy. In order to get an accurate TTDE, the total travelled distance must be correctly calculated. ZUPT information is used to estimate the average window length and this novel method is called ZUPT-based adaptive average window length method (ZUPT-AAWL).
The reminder of this paper is organized as follows: in Section 2, our MEMS-IMU-based foot-mounted inertial navigation system is described. In Section 3, a novel permanent magnet-based zero-velocity detector (mag-ZUPT) is described. In Section 4, a height difference information aided barometer (HDIB) algorithm is provided. In Section 5, a mag-ZUPT-based adaptive average window length method (ZUPT-AAWL) is provided. In Section 6, experiments on different trajectories are undertaken and the performance is verified. Finally, Section 7 concludes this work and offers some future research suggestions.

2. MEMS-IMU Based Foot-Mounted Inertial Navigation System

2.1. Inertial Navigation System (INS)

A foot-mounted INS uses 3-axis accelerations and angular rates to calculate the position of pedestrians. The principle of INS is that the integration of acceleration is velocity and the integration of velocity is position. The outputs of MEMS-IMU are in the sensor body coordinate frame (b-frame) and should be transferred to the navigation coordinate frame (n-frame). The definition of b-frame and n-frame are shown in Figure 2.
The b-frame is determined by the MEMS-IMU hardware and usually defined as a right-handed Cartesian coordinate system, which is shown in Figure 2a. The forward, left and upward direction are x, y and z axis, respectively. Considering the convenient of usage, the n-frame applied in our system is the local East, North, Up (ENU) Cartesian coordinate system whose origin is the same with b-frame which is more intuitive and practical than ECEF or Geodetic coordinates. By convention, the east axis is labelled x, the north y and the up z. ECEF and ENU are depicted in Figure 2b. The MEMS-IMU readings including acceleration, angular rate and magnetic field strength are in b-frame and should be transferred to ENU in order to derive the velocity and the position. The two different coordinate systems are transferred through the rotation matrix C b n . It is defined from yaw, pitch and roll:
C b n = [ cos θ cos ψ cos γ sin ψ + sin γ sin θ cos ψ sin γ sin ψ + cos γ sin θ cos ψ cos θ sin ψ cos γ cos ψ + sin γ sin θ sin ψ sin γ cos ψ + cos γ sin θ sin ψ sin θ sin γ cos θ cos γ cos θ ]
where ψ is yaw, θ is pitch and γ is roll. C b n should be initialized using accelerometer measurements before one pedestrian starts to walk. In the rotation matrix initialization step, MEMS-IMU remains stable for several seconds and the accelerations measured in the x, y and z axes of b-frame are [ a x b , a y b , a z b ] , and the gravity of the n-frame is [ 0 , 0 , g ] . Therefore, the initialization equation is:
[ a x b a y b a z b ] = ( C b n ) T [ 0 0 g ]
The calculated result of Equation (2) is:
{ γ 0 = arctan ( a y b a z b ) θ 0 = arctan ( a x b ( a y b ) 2 + ( a z b ) 2 )
where γ 0 is initial roll and θ 0 is initial pitch. We can’t get initial yaw ( ψ 0 ) using accelerations alone. In some researches, ψ 0 is manually set to a constant like 0. Magnetometer measurements are used to obtain ψ 0 in this paper and the magnetometer have been calibrated to the local geomagnetic field.
ψ 0 = arctan ( m a g z b sin ( γ 0 ) m a g y b cos ( γ 0 ) m a g x b cos ( θ 0 ) + m a g y b sin ( θ 0 ) sin ( γ 0 ) + m a g z b sin ( θ 0 ) cos ( γ 0 ) )
where m a g x b ,   m a g y b , and m a g z b are the x-axis, y-axis and z-axis magnetometer measurements of the b-frame, respectively.
The 3-axis gyroscope makes it possible to update C b n . Integrating the angular rates gives the relative orientation of the IMU [16]:
C b n ( k ) = C b n ( k 1 ) 2 I 3 × 3 + Ω ( k ) 2 I 3 × 3 Ω ( k )
where Ω(k) is:
Ω ( k ) = [ 0 ω z ( k ) ω y ( k ) ω z ( k ) 0 ω x ( k ) ω y ( k ) ω x ( k ) 0 ]
where ω x ,   ω y and ω z are the x-axis, y-axis and z-axis of the b-frame gyroscope measurements, respectively. Finally, C b n should be corrected according to the error state vector from the EKF process. It will be explained in the INS error model and the extended Kalman filter part of this paper.
The 3-axis gyroscope makes it possible to calculate C b n . Integrating the angular rates gives the relative orientation of the IMU, which can be used to transform the accelerometer measurement [18].
Euler angles, direction cosines and quaternions are the three most used rotation matrix parametrization methods. The reasons why quaternions are better to be used in navigation applications is:
  • Quaternions only need to solve four equations, while direction cosines need to solve six differential equations. Therefore, the computational complexity of quaternions is smaller and this advantage is in favor of a real-time navigation system.
  • Euler angles would bring singular values when the angles are ±90°. Quaternions do not have such a problem.
The quaternions were first developed by Irish mathematician William Rowan Hamilton in 1843. Quaternions are very useful to calculate three-dimensional rotations and unit quaternions can represent any rotation operation in three-dimensional space. Quaternions are a number system that extends the complex numbers and usually represented in the following form:
q = q 0 + q 1 i + q 2 j + q 3 k
where q 0 ,   q 1 ,   q 2 and q 3 are real numbers. i, j and k are fundamental quaternion units. The differential equation of quaternion is:
q ( k ) = { cos Δ θ 0 2 I + [ Δ θ ] Δ θ 0 sin Δ θ 0 2 } q ( k 1 )
where Δ θ x ,   Δ θ y ,   Δ θ z and   Δ θ 0 are defined as:
{ Δ θ x , Δ θ y , Δ θ z } = { ω x ( k ) , ω y ( k ) , ω z ( k ) } Δ t
Δ θ 0 = Δ θ x 2 + Δ θ y 2 + Δ θ z 2
and Δ θ is:
Δ θ = [ 0 Δ θ x Δ θ y Δ θ z Δ θ x 0 Δ θ z Δ θ y Δ θ y Δ θ z 0 Δ θ x Δ θ z Δ θ y Δ θ x 0 ]
The rotation matrix can be transferred to the quaternion form:
C b n = [ q 0 2 + q 1 2 q 2 2 q 3 2 2 ( q 1 q 2 q 0 q 3 ) 2 ( q 1 q 3 + q 0 q 2 ) 2 ( q 1 q 2 + q 0 q 3 ) q 0 2 q 1 2 + q 2 2 q 3 2 2 ( q 2 q 3 q 0 q 1 ) 2 ( q 1 q 3 q 0 q 2 ) 2 ( q 2 q 3 + q 0 q 1 ) q 0 2 q 1 2 q 2 2 + q 3 2 ]
and we can calculate the four real numbers of quaternion from C b n using:
{ q 0 = 1 + C b n ( 1 , 1 ) + C b n ( 2 , 2 ) + C b n ( 3 , 3 ) 2 q 1 = C b n ( 2 , 3 ) C b n ( 3 , 1 ) 4 q 0 q 2 = C b n ( 3 , 1 ) C b n ( 1 , 3 ) 4 q 0 q 3 = C b n ( 1 , 2 ) C b n ( 2 , 1 ) 4 q 0
Figure 3 shows the flowchart of the pedestrian navigation system with EKF and ZUPT. HDIB, ZUPT-AAWL and mag-ZUPT described in this paper is also shown in this figure. The pedestrian navigation system mainly contains three parts which are INS mechanization equations, EKF for error estimation and ZUPT.
INS mechanization equations are a set of equations which form the basis of inertial navigation. Firstly, gravity should be subtracted from accelerometer measurements in n-frame. Then position is calculated with the gravity-free acceleration value. At last, orientation of the MEMS-IMU is updated with the gyroscope measurements. These equations take slight different forms in different navigation frames [34]. The basic equation utilizing accelerometers and gyroscopes to calculate position is [17]:
[ v k p k q k ] = [ v k 1 + ( q k 1 a k q k 1 1 g ) d t k p k 1 + v k 1 d t k Ω ( ω k d t k ) q k 1 ]
where k is a time index, g is the gravity, v k is the velocity of the pedestrian, a k is the accelerometer measurements, p k is the positon of the person, q k is the quaternion describing the orientation frame, d t is the time differential and Ω ( · ) is the quaternion update matrix.

2.2. INS Error Model and the Extended Kalman Filter (EKF)

The state vector of this system is a 15-element vector which is δ x = [ δ r , δ v , δ φ , δ a , δ ω ] , where δ r is the position error, δ v is the velocity bias, δ φ is the attitude error, δ a is the accelerometer bias, δ ω is the gyroscope error. In addition, δ r , δ v , δ φ , δ a , δ ω are all 3-dimension vectors.
The state transition matrix F and G are:
F = [ I I Δ t O O O O I S t Δ t C b n Δ t O O O I O C b n Δ t O O O I O O O O O I ]
G = [ O O O O C b n Δ t O O O O C b n Δ t O O O O I O O O O I ]
where Δt is the sample interval, O and I are:
O = [ 0 0 0 0 0 0 0 0 0 ]
I = [ 1 0 0 0 1 0 0 0 1 ]
St is the skew-symmetric matrix of acceleration:
S t = [ 0 a z ( k ) a y ( k ) a z ( k ) 0 a x ( k ) a y ( k ) a x ( k ) 0 ]
The measurement model is:
z ( k ) = v ( k )
where v ( k ) is the velocity when ZUPT detects that the person is in stance phase:
H = [ O I O O O ]
The algorithm has the following steps:
(1)
The acceleration and angular rate are compensated according to the acceleration and angular rate bias output of EKF:
a ( k ) = a ( k ) + δ a ( k 1 )
ω ( k ) = ω ( k ) + δ ω ( k 1 )
where a’(k) and ω’(k) are the compensated acceleration and angular rate at the time index k. a(k) and ω(k) are the original acceleration and angular rate at time index k. δa’(k−1) and δω(k−1) are the acceleration and angular rate error from EKF at time index k − 1.
(2)
Update the quaternion:
q ( k ) = { cos Δ θ 0 2 I + [ Δ θ ] Δ θ 0 sin Δ θ 0 2 } q ( k 1 )
where Δ θ 0 = | ω ( k ) | 2 ,   Δ θ is:
Δ θ = [ 0 ω x ( k ) ω y ( k ) ω z ( k ) ω x ( k ) 0 ω z ( k ) ω y ( k ) ω y ( k ) ω z ( k ) 0 ω x ( k ) ω z ( k ) ω y ( k ) ω x ( k ) 0 ]
where ω x ( k ) ,   ω y ( k ) and ω z ( k ) are the three components of ω ( k ) in the x, y and z axis, respectively.
(3)
Velocity and position update:
v ( k ) = v ( k 1 ) + a n ( k ) Δ t
r ( k ) = r ( k 1 ) + v ( k ) Δ t + 1 2 a n ( k ) Δ t 2
where k is the time index, v(k) is the velocity and r(k) is the position, an(k) is the original acceleration transferred to the navigation-frame.
(4)
Correct rotation matrix C b n . δ φ is used to compensate C b n :
C b n ( k ) = 2 I 3 × 3 + δ Θ ( k ) 2 I 3 × 3 δ Θ ( k ) C b n ( k )
where δ Θ is:
δ Θ = [ 0 δ φ ( 3 ) δ φ ( 2 ) δ φ ( 3 ) 0 δ φ ( 1 ) δ φ ( 2 ) δ φ ( 1 ) 0 ]
where δ φ ( 3 ) ,   δ φ ( 2 ) and δ φ ( 1 ) are the three components of δ φ from EKF which are the yaw, pitch and roll errors, respectively. C b n ( k ) and C b n ( k ) are the attitude matrix before and after compensation. I is the 2-dimension unitary matrix.
(5)
Compensate velocity and position using the error measurements from EKF:
r ( k ) = r ( k ) + δ r ( k 1 )
v ( k ) = v ( k ) + δ v ( k 1 )
where r’(k) is the compensated position and v’(k) is the compensated velocity. δ r ( k 1 ) and δ v ( k 1 ) are position and velocity error at time index k − 1.

3. A Novel Stance Phase Duration Model of Permanent Magnet Based ZUPT Detector (Mag-ZUPT)

3.1. Disadvantages of Threshold Based Stance Phase Detector in Running

There is a basic phenomenon that when the pedestrian’s foot is totally on the ground, the velocity and angular velocity are almost zero. Considering that the positioning errors will accumulate fast due to the sensor drift, the zero-velocity information is efficient in the error correction. The detection problem is a binary hypothesis testing problem. All the ZUPT methods are based on the MEMS-IMU information including the accelerometer and gyroscope readings [22]. It can be depicted by:
T = f ( a , ω )     γ
where a is the acceleration, ω is the angular rate, γ is the stance phase threshold. T is the test statistics of the detector. One typical detector is the stance hypothesis optimal detector (SHOE):
T ( k ) = 1 W n = k k + W 1 1 σ a 2 a ( n ) g a ( k ) ¯ a ( k ) ¯ 2 + 1 σ w 2 w ( n ) 2 γ
where k is a time index, W is the window length, σ a 2 and σ w 2 denote the accelerometer and gyroscope noise variance, is the 2-norm calculation, a ( k ) ¯ is the average of a during the average window W at time index k:
a ( k ) ¯ = 1 W n = k k + W 1 a ( n )
This ZUPT detector is efficient in most walking scenarios. However, this method is threshold- based and it may not be suitable when the pedestrian runs. Figure 4 shows the comparison of T in walking and running gait patterns. It is obvious that T of a running gait pattern is larger than when walking and the stance detector suitable for walking is not a proper choice for running. Therefore, if the pedestrian moves in a hybrid pattern including walking and running, there may be a wrong stance detection of running which will lead to a large accumulative error.
The stance phase estimation error of running gait pattern is shown in Figure 5. It is clear that the No. 2, 3 and 7 stance phases are not detected.

3.2. Mid-Stance Detection Method with a Permanent Magnet Moutned on the Foot

It is important to research a new stance phase detector which is more robust and can be applied in both walking and running gait patterns. In [26] a permanent magnet is used as an additional device to have a better stance phase detection. One permanent magnetic detector is attached to the MEMS-IMU free foot to create a local magnetic field and from which the mid-stance can be detected. The basic principle is about the relationship of magnetic field strength and distance. It is obvious that the magnetic field strength is stronger when the distance between magnet and sensor decrease. An experiment was taken to analyze this phenomenon and the result is shown in Figure 6.
One of the advantages of applying a permanent magnet is that the magnetic field strength is smoother than the acceleration and angular rate. Figure 7 and Figure 8 show the comparison of the waveforms of accelerations, angular rates and magnetic field strength in walking and running gait patterns, respectively.
It is clear that the waveform of magnetic field strength contains less noise than acceleration and angular rate. Furthermore, in the running gait pattern, the waveform of acceleration becomes worse while magnetic field strength remains steady. The fluctuation of acceleration and angular rate leads to wrong estimation of stance phase which is shown in Figure 9. The stance phase is misjudged to swing phase, while the mid-stance can be correctly detected. The magnetic field strength of the permanent magnet is useful to develop a better ZUPT detector.
Mid-stances can be extracted from peaks of magnetic field strength waveforms which are closely related with the placing relation of MEMS-IMU and the permanent magnet. In this system, the norm of ( m a g x , m a g y , m a g z ) is used:
m a g n o r m = m a g x 2 + m a g y 2 + m a g z 2
where magnorm is the norm of (magx,magy,magz). The comparison of different magnetic field waveforms is shown in Figure 10. From this figure we can conclude that the norm of (magx,magy,magz) is the best mid-stance indicator and m a g y has a similar performance while magx and magz are not proper choices. There are many methods to detect the peaks of magnorm such as utilizing the gradient of the waveforms. The peaks are also shown in Figure 10 with red triangles.

3.3. Mag-ZUPT Method with a Stance Phase Duration Model

Mid-stance can be extracted from the magnetic field strength waveform of the permanent magnet. However, mid-stance is only a point of the stance phase. The sketch map of one gait cycle is shown in Figure 11. One gait cycle can be divided into stance phase and swing phase. Mid-stance is a time point when the foot is totally on the ground.
An experiment was taken to have a more clear clarification of the components in one gait cycle which is shown in Figure 12. T is the test statistics of the SHOE detector calculated from Equation (33). With the information of the time duration of stance phase in one gait cycle, each mid-stance can be expanded to a stance phase. According to former researches, the duration of the stance phase is about 24.8%. However, the duration of stance phase is related with the different moving patterns. If 24.8% is used in the running gait pattern, the total travelled distance will be smaller than the reality because that some swing phases are misjudged to stance-phase.
The two typical types of a pedestrian indoor are walking and running. Considering that the length between the neighbor mid-stances is one complete gait cycle, the gait cycle length of the same person in one trajectory is directly related with the moving pattern. Figure 13 depicts the peak-peak time period of walking, standing still and running. This experiment is taken in a designed scene: (1) Firstly a person walks for 140 s; (2) Secondly, the person remains stationary for 5 s; (3) At last, the person runs for 80 s. The statistic result is shown in Table 1. The maximum of running peak-peak time period is even smaller than the minimums of walking peak-peak time period. Therefore, peak-peak time period is a reliable method to distinguish walking and running gait patterns.
A simple stance phase duration model is proposed. The relationship between peak-peak period and stance phase duration is:
s p d ( k ) = 1 1000 N n = k k + N 1 p p ( k )
where k is a time index, N is the window length, spd is stance phase duration and pp is the peak-peak period. For example, referring to the experiment of Figure 13 and Table 1, the stance phase durations of walking and running gait patterns are 25.9% and 14.8%. These two values are acceptable in walking/running mix trajectories. In fact, the relationship between movement patterns and stance phase duration is complex. We should consider many factors like body height and leg length. In the next paper, we will develop a more sophisticated model using big data trained by artificial neural network. In addition, a random forest based moving pattern estimation method will also be described.
The flowchart of how to detect mid-stance and how to expand mid-stance to stance phase is shown in Figure 14. The mag-ZUPT algorithm contains three steps. The first step is to extract mid-stance from magnetic field waveforms. The second step is to distinguish walking/running gait patterns using peak-peak period. Finally, mid-stance is expanded to stance phase with stance phase duration.
Like other ZUPT detectors, stance phase is represented as 1 and swing phase is represented as 0 to compose mag-ZUPT. The results of traditional ZUPT and mag-ZUPT is shown in Figure 15. The two ZUPT detectors have a similar performance in walking. While as to the running gait pattern, seven stance phases are correctly detected by mag-ZUPT compared with only one stance phase is detected by traditional ZUPT. Therefore, mag-ZUPT has a better performance especially in running scenarios.
An experiment of a walking/running mix trajectory was undertaken to verify the performance of the mag-ZUPT method. The trajectory is a closed path that the first half of the trajectory is walking and then the pedestrian ran back to the start point. The positioning results using mag-ZUPT and traditional ZUPT are shown in Figure 16. It is obvious that the walking trajectory (first half) of these two methods are similar. However, the running trajectory using traditional ZUPT diverges rapidly because of the stance phase estimation errors.

4. Height Difference Information Aided Barometer (HDIB) Algorithm

Considering that a bias of only a few meters can lead to an error of several floors, the demand of height accuracy is even higher than the level ground scenario. However, the accelerometer and the gyroscope drifts are accumulated to obtain a poor height estimation. As to the barometer, it is easy to be influenced by the environment and this phenomenon is shown in Figure 17. An experiment was taken that the pedestrian walked on the level ground for 100 s and it is obvious that even on the level ground, the atmospheric pressure fluctuates with the pedestrian movement which leads to height estimation errors.
In order to achieve a high accuracy height estimation in our 3D positioning system, a novel height difference information aided barometer (HDIB) algorithm is developed. HDIB utilizes both MEMS-IMU and barometer readings. It is dependent on the basic thinking that normally the height motion of a person is determined by the ground mode which includes level ground, upstairs and downstairs. When walking on a level ground, the height is invariant. While walking up or down, the height estimation should be updated. Luckily, MEMS-IMU has the ability to estimate the ground mode precisely because although the error accumulated, the short-time results of IMU are accurate. The accumulative error of height estimation is shown in Figure 18. We can see that only 5000 sampling points later (25 s), the height error is 2 m which is unacceptable. However, we can see that, in Figure 18b, the maximum height difference every one second is 0.11 m. It stays steady and is possible to use this information to aid barometer to estimate the height more precisely.
The flowchart of HDIB is shown in Figure 19. It has two stages. The first stage is to distinguish level ground/upstairs/downstairs with MEMS-IMU readings. The second stage is to adaptively set the reference atmospheric pressure according to the result of the first stage. Then difference between the measured atmospheric pressure and the reference atmospheric pressure is used to calculate pedestrians’ vertical position.
We can get accurate height difference between contiguous steps using MEMS-IMU. It can be used to judge whether a person is walking on the level ground, walking upstairs or downstairs. The equations of ground mode estimation are:
{ h k = 1 w n = k w + 1 k w + w I M U h n h d k = h k h k 1 α < h d k < β H D F k = f l a t h d k < α H D F k = d o w n h d k > β H D F k = u p
where IMUh is the height estimation result from INS, w is the window length for the average calculation, h is the mean height calculated from the IMU system, hd is the height difference, k is the time index, α is the down threshold which is a negative number, β is the up threshold which is a positive number.
The value of w is based on the sampling frequency of MEMS-IMU. Normally w = 1/f is acceptable. Considering that a person’s leg raises 20 cm during a gait cycle and the average time is set to one second, α is set to −0.1 m and β is set to +0.1 m.
The second stage is to calculate pedestrians’ vertical position [30]. The ideal atmospheric equation is:
P = ρ R d T
where P is the atmospheric pressure, ρ is the air density, Rd is the gas constant whose value is 287.05287 m2/(s2K), T is the thermodynamic temperature of the air. According to the atmospheric static equation, the relationship of atmospheric pressure and height is:
d P = ρ g d H
where g is the local gravity, d ( · ) is the differential calculation, H the height. Take (38) to (39):
d P P = g R d T d H
Ignoring the variation of gravity and temperature, from vertical position Hr to Hm, Equation (40) can be integrated:
P r P m d P P = H r H m g R d T d H
where Hr is the reference vertical position, Hm is the vertical position needed to be measured, Pr is the atmospheric pressure of Hr, Pm is the atmospheric pressure of Hm. The calculation result of Equation (41) is:
H m = R d T k g ln P r P m + H r
where Tk is a simplified temperature integration result of Equation (41) which is an average value of Tr (temperature of Hr) and Tm (temperature of Hm):
T k = T r + T m 2
Hr is adaptively adjusted to the result from stage 1 of HDIB. An experiment was taken to test HDIB. The pedestrian started from the second floor, then walked up four floors and went down four floors to return to the start point. This experiment was taken in a shopping mall and the total vertical moving height is around 24 m. The height of start point and end point is 0 m. The sequence of walking is flat, up, flat, up, flat, up, flat, down, flat, up, flat, down, flat, down, flat, down and flat. The estimation result of level ground/upstairs/downstairs is shown in Figure 20 and it matches with the reference height (true height). The positioning results are shown in Figure 21. Three different methods are tested which are MEMS-IMU, barometer and HDIB. Height estimation from MEMS-IMU is the worst because of the accumulative error. The result of using barometer alone fluctuates because of the instability of barometer outputs and the environment. HDIB performs well comparing with the two traditional methods. The height estimation error of the three methods are listed in Table 2.

5. A Mag-ZUPT-Based Adaptive Average Window Length Method (ZUPT-AAWL)

TTDE is an important indicator to evaluate the performance of the inertial navigation system. TTDE is defined as the percentage error of the total travelled distance in a closed-loop trajectory:
T T D E = p ( s t a r t ) p ( e n d ) L
where p(end) and p(start) are the end point and start point of the positioning results, is the 2-norm calculation, L is the total travelled distance.
Considering that the MEMS-IMU sampling frequency is very high, the original positioning results depict the trajectory of the MEMS-IMU mounted foot (IMU-foot), which is not the same with the walking trajectory. Traditionally, the original positioning results are averaged in a fix length like 1 s because that the gait cycle duration is around 1 s. There is a problem that the averaged results are not one complete gait cycle. It may be a little larger or smaller than the gait cycle according to the length of the average window.
As is shown in Figure 22, during every gait cycle, there must be a time that the IMU-foot is on the ground. It is obvious that k 1 k 2 ¯ , k 2 k 3 ¯ , k 3 k 4 ¯ , and k 4 k 5 ¯ are better choices to be used as the average window length. Because that the length of every gait cycle is different, this window length is adaptive to the specific gait cycle. The flowchart of ZUPT-AAWL algorithm is shown in Figure 23.
Start and end point of stance phase information from ZUPT can be used to determine the average window length:
w i n l e n ( k ) = s t i l l k ( e n d ) s t i l l k ( s t a r t )
where winlen(k) is the k-th average window length of stance phase, stillk(end) is the end point of the k-th stance phase and stillk(start) is the start point of the k-th stance phase. Therefore, the value of average window length is represented in sampling points and has no unit.
The k-th trajectory will be averaged with the window length winlen(k):
t r a j s m o o t h ( k ) = 1 w i n l e n ( k ) × i = 1 w i n l e n ( k ) t r a j k ( i )
where trajsmooth(k) is the average length of the k-th stance phase, trajk is the trajectory of the k-th stance phase. The trajectory length is calculated using:
t r a j l e n ( k ) = ( t r a j s m o o t h x ( k ) t r a j s m o o t h x ( k 1 ) ) 2 + ( t r a j s m o o t h y ( k ) t r a j s m o o t h y ( k 1 ) ) 2
where trajlen(k) is the k-th trajectory length, trajsmoothx and trajsmoothy are the x and y values of trajsmooth, respectively.
All the trajectory lengths are summed to calculate the total travelled distance:
L = t r a j l e n ( k )
An experiment was performed to verify ZUPT-AAWL. The real total travelled distance measured by a laser range-finder is 1355 m. The relationship of total travelled distance and average window length is shown in Figure 24. The total travelled distance is decreased with the increase of average window length. The red dots are the range of ZUPT-AAWL average window lengths. It ranges from 20 to 381 sampling points according to different gait cycles. The total travelled distance results of four typical fix window length including 1, 100, 200, 300, 400 sampling points and ZUPT-AAWL are shown in Table 3. The result using ZUPT-AAWL is closest to the real length. In addition, ZUPT-AAWL is a more universal method that is adaptive to different trajectories, different moving patterns and different gait cycles.

6. Experimental Results

6.1. Experimental Setup

In order to evaluate the performance of the 3D positioning system, trajectories of multiple scenarios are tested. The MEMS-IMU used in our system is an AHRS-1 (Inertial Labs, Paeonian Springs, VA, USA), which contains a 3-axis accelerometer, a 3-axis gyroscope and a 3-axis magnetometer. The MEMS-IMU is mounted on the heel of the left shoe and one permanent magnet is mounted on the right shoe. The diameter and thickness of the permanent magnet used in the experiment is 2.5 cm and 1 cm, respectively. A processing board is also mounted on the left shoe. Furthermore, a BMP280 barometer (Bosch, Stuttgart, Baden-Württemberg, Germany) is installed on the processing board. The raw data and processed positioning results are saved in the storage card of the processing board. The 9-axis data obtained from the sensor is processed on board to get the pedestrian positioning results and then transmitted to the server in real-time. In order to evaluate the performance more carefully, in this paper, the raw 9-axis data is processed on the MATLAB platform. The system hardware structure is shown in Figure 25.
The experiments are designed to have a full test of the system. Firstly, three walking gait pattern, three running gait pattern and three walking/running mixed trajectories are taken to test the mag-ZUPT performance. The evaluation indicator of this experiment is the accuracy rate of stance phase estimation. Secondly, nine different ascending/descending stairs experiments are taken to test HDIB algorithm. Finally, six 3D trajectories are taken to evaluate the general performance of this system. In order to get an accurate TTDE, ZUPT-AAWL is used to calculate the total walking distance.

6.2. Mag-ZUPT Experiments

Nine tests are taken on the 100 m runway of a stadium. Three walking gait pattern, three running gait pattern and three walking/running mix trajectories are taken to test the mag-ZUPT performance. The true stance phase number is countered by a tester recording the steps. Stance phases of SHOE (shown in Equation (33)) and mag-ZUPT are calculated from the number of 1 in ZUPT.
The results of the nine tests are listed in Table 4. Stance phase estimation performance of walking gait pattern is similar because that in the low dynamic movement, acceleration and angular rate are relatively stable. As to the running gait pattern, the stance phase estimation error of SHOE is serious because that the threshold is adjusted to walking, while mag-ZUPT method has good performance. In the walking/running tests, the subject walks and runs for several steps in turn. Considering that there are some walking steps, stance phase estimation of SHOE is better than the running tests.
The average stance phase number of the nine tests is 50.3. The average error of SHOE and mag-ZUPT is 13.9/50.3 and 0.3/50.3, respectively. The mag-ZUPT method can get a much better stance phase estimation accuracy and ZUPT estimation in multiple moving patterns.
Furthermore, the mistake of stance phase estimation leads to the positioning result divergence. Table 5 shows the total travelled distance of SHOE and mag-ZUPT. It is closely connected with the stance phase estimation result. Choosing Running_3 as an example, the stance phase estimation of SHOE is only 4/37 which leads to a total travelled distance estimation of 686.4/100. The average total moving length average error of SHOE is 100.4/100 comparing 2.3/100 of mag-ZUPT. As an example stance phase duration calculated using Equation (36) and Figure 14 of Mix_1 is shown in Figure 26. It is obvious that peak-peak information can be used to distinguish movement patterns including walking and running. Stance phase duration should be adjusted with different gait cycles.

6.3. HDIB Experiments

Six typical trajectories including walking on the level ground, ascending stairs and descending stairs are taken to evaluate HDIB performance. Description of the test trajectories are shown in Table 6. Height_1 and Height_2 are walking on the level ground indoor and outdoor, respectively. Height_3–Height_6 are walking indoor.
Height estimation error root mean square (RMS) is utilized to evaluate the results of the six trajectories, which is shown in Table 7. We can get the following conclusions from the results:
Barometer based height estimation method is heavily influenced by the environment. Outdoor environment is more complex than indoor. RMS of Height-1 (indoor) is 1.18 m comparing with 0.19 m of Height_2 (outdoor). Generally speaking, height estimation error of barometer is from 1 m to 2 m which is about half of the floor height.
MEMS-IMU based height estimation method has a large error. However, the short-time accuracy of MEMS-IMU is high and invulnerable to environment factors. Height_5 is a short trajectory with only one floor up and down and MEMS-IMU based method is even better than barometer.
HDIB gets the best accuracy among all the six tests.
As an example, height estimation results of MEMS-IMU, barometer and HDIB of Height_4 trajectory is shown in Figure 27. RMS of MEMS-IMU, barometer and HDIB is 4.28, 1.78 and 0.69 m, respectively. It is obvious that we can get a more accurate height estimation result using HDIB.

6.4. Comprehensive Pedestrian Trajectory Experiments

Six comprehensive experiments are taken to evaluate the 3D positioning system. The key indicators including height error and TTDE are summarized in Table 8. Traj_1 is ascending stairs from floor 2 to floor 11, then walking around a rectangle in floor 11. Finally, the pedestrian returns to the starting point. The total travelled distance of Traj_1 is 261 m with 18 floors up and down. This scenario is mainly to verify the height estimation promotion of HDIB. The 3D positioning result is shown in Figure 28. TTDE of Traj_1 is 0.32% and the height error is 0.68 m.
Traj_2 is a mix of walking on the flat, ascending and descending the stairs. The total travelled distance is 368 m with 5 floor up/down. The 3D and top view of Traj_2 positioning result is shown in Figure 29. TTDE of Traj_2 is 0.76% and the height error is 0.27 m.
Traj_3 is a walking/running mix trajectory along a rectangle of 5 loops. The positioning result is shown in Figure 30a and ZUPT results are shown in Figure 30b. The stance phase estimation of SHOE is less than the real number which leads to the divergence of the positioning result. While the stance phase estimation of mag-ZUPT performs well and the accumulative error is efficiently eliminated. TTDE of Traj_3 is 0.39%.
Traj_4 is a walking and running mix trajectory which is divided to five walking segments and four running segments. The positioning results and ZUPT comparison of SHOE and mag-ZUPT are shown in Figure 31. Considering that SHOE is threshold based which is different in walking and running gait patterns. In this experiment, SHOE-WALK and SHOE-RUNNING are adjusted to the walking and running gait patterns, respectively. The threshold of SHOE-WALK is smaller than SHOE-RUN. If the positioning system applies SHOE-WALK, the calculated trajectory will be longer than the real because more stance phases are misjudged to swing phases. And if SHOE-WALK is applied, the result is contrary to the former one. More swing phases are misjudged to stance phases and the calculated trajectory is much shorter. However, mag-ZUPT is not threshold based and it will self-adjust according to the mid-stance and peak-peak period. Therefore, the TTDE of mag-ZUPT is 0.77% which is much better than SHOE.
Traj_5 and Traj_6 are long distance indoor-outdoor tests. The start point is on floor 6. The pedestrian walks down to the outdoor and walks in the campus, then goes up 6 floors to the start point. Traj_6 with one loop along the stadium is more complex than Traj_5. Positioning results of Traj_5 and Traj_6 are shown in Figure 32 and Figure 33, respectively. TTDE of Traj_5 is 0.63% and the height error is 0.20 m. TTDE of Traj_6 is 1.04% and the height error is 2.35 m.The results show that the method described in this paper can obtain a good 3D positioning result of the complex indoor/outdoor trajectory.

7. Conclusions

A novel 3D pedestrian navigation method integrating a MEMS-IMU, barometer and permanent magnet is presented in this paper to solve the stance phase detection, height estimation and total travelled distance calculation problems of foot-mounted inertial systems. Stance phase could be misjudged using acceleration and angular rate-based ZUPT detector like SHOE, especially in running. Mag-ZUPT applying magnetic field strength information of the foot-mounted permanent magnet is proposed to estimate stance phase. Stance phase duration is calculated using the proposed model of stance phase duration and peak-peak information. With stance phase duration, mid-stance is expanded to stance phase. HDIB combines the advantages of MEMS-IMU and barometer to provide high accuracy height estimation. This algorithm has two stages which are level ground/ upstairs/downstairs distinction and height calculation. ZUPT-AAWL is proposed using stance phase information in a gait cycle to set the average window length to calculate the total travelled distance more precisely. The biggest difference of ZUPT-AAWL and the traditional algorithm is that the average window length is adaptively changed according to different gait cycles.
Three kinds of experiments are taken to evaluate performance of the proposed method. The first one includes nine tests of walking/running/mix trajectories. It aims to compare the stance phase detection performance of SHOE and mag-ZUPT. The results show that mag-ZUPT is much better, especially in running. The second one has six tests which include walking on a level ground, ascending stairs and descending stairs to evaluate HDIB performance. The results show that RMS of height estimation of the six tests are all less than one meter, which is much better than MEMS-IMU and barometer alone. The last one contains six comprehensive trajectories including indoor/outdoor, walking/running, ascending/descending stairs. Numerical results show that TTDE of these experiments ranges from 0.32% to 1.04% in both walking and running gait patterns, and the height estimation error is from 0 m to 2.35 m. This 3D positioning method can obtain a good height and TTDE accuracy in both walking and running gait patterns. In our future work, we will use low-cost MEMS-IMU to achieve a similar TTDE performance. More experiments will be taken to establish a more accurate model of stance phase duration and peak-peak period information.

Acknowledgments

This study is supported by the Beihang Beidou Technology Industrialization Funding program (Grant No.: BARI1701).

Author Contributions

Wei Yang, Chundi Xiu, Jianmin Zhang and Dongkai Yang conceived and designed the experiments; Wei Yang and Jianmin Zhang performed the experiments; Wei Yang wrote the paper. All of the work in this paper is done under the supervision of Chundi Xiu and Dongkai Yang.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kaplan, E.D.; Hegarty, C. Understanding GPS: Principles and Applications; Artech House: Norwood, MA, USA, 2005; pp. 598–599. [Google Scholar]
  2. Mautz, R. Indoor Positioning Technologies. Ph.D. Thesis, ETH Zurich, Zurich, Switzerland, 2012. [Google Scholar]
  3. Du, Y.; Yang, D.; Xiu, C. A Novel Method for Constructing a WIFI Positioning System with Efficient Manpower. Sensors 2015, 15, 8358–8381. [Google Scholar] [CrossRef] [PubMed]
  4. Youssef, M.A.; Agrawala, A.; Shankar, A.U. WLAN Location Determination via Clustering and Probability Distributions. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications, Fort Worth, TX, USA, 23–26 March 2003; pp. 143–150. [Google Scholar]
  5. Du, Y.; Yang, D.; Yang, H.; Xiu, C. Flexible indoor localization and tracking system based on mobile phone. J. Netw. Comput. Appl. 2016, 69, 107–116. [Google Scholar]
  6. Li, X.; Wang, J.; Liu, C. A Bluetooth/PDR Integration Algorithm for an Indoor Positioning System. Sensors 2015, 15, 24862–24885. [Google Scholar] [CrossRef] [PubMed]
  7. Diaz, J.J.M.; Maues, R.D.A.; Soares, R.B.; Nakamura, E.F.; Figueiredo, C.M.S. Bluepass: An indoor Bluetooth-based localization system for mobile applications. In Proceedings of the IEEE Symposium on Computers and Communications, Riccione, Italy, 22–25 June 2010; pp. 778–783. [Google Scholar]
  8. Shirehjini, A.A.; Yassine, A.; Shirmohammadi, S. Equipment location in hospitals using RFID-based positioning system. IEEE Trans. Inf. Technol. Biomed. 2012, 16, 1058–1069. [Google Scholar] [CrossRef] [PubMed]
  9. Jourdan, D.; Dardari, D.; Win, M.Z. Position error bound for UWB localization in dense cluttered environments. IEEE Trans. Aerosp. Electron. Syst. 2008, 44, 613–628. [Google Scholar] [CrossRef]
  10. Zhang, C.; Kuhn, M.J.; Merkl, B.C.; Fathy, A.E. Real-Time Noncoherent UWB Positioning Radar with Millimeter Range Accuracy: Theory and Experiment. IEEE Trans. Microw. Theory Tech. 2010, 58, 9–20. [Google Scholar] [CrossRef]
  11. Yoshino, M.; Haruyama, S.; Nakagawa, M. High-accuracy positioning system using visible LED lights and image sensor. In Proceedings of the Radio and Wireless Symposium, Orlando, FL, USA, 22–24 January 2008; pp. 439–442. [Google Scholar]
  12. Holm, S. Hybrid ultrasound-RFID indoor positioning: Combining the best of both worlds. In Proceedings of the IEEE International Conference on RFID, Orlando, FL, USA, 27–28 April 2009; pp. 155–162. [Google Scholar]
  13. Zhang, R.; Hoflinger, F.; Reindl, L. Inertial Sensor Based Indoor Localization and Monitoring System for Emergency Responders. IEEE Sens. J. 2013, 13, 838–848. [Google Scholar] [CrossRef]
  14. Zheng, L.; Zhou, W.; Tang, W.; Zheng, X.; Peng, A.; Zheng, H. A 3D indoor positioning system based on low-cost MEMS sensors. Simul. Model. Pract. Theory 2016, 65, 45–56. [Google Scholar] [CrossRef]
  15. Foxlin, E. Pedestrian Tracking with Shoe-Mounted Inertial Sensors. IEEE Comput. Graph. Appl. 2005, 25, 38–46. [Google Scholar] [CrossRef] [PubMed]
  16. Jiménez, A.R.; Seco, F.; Prieto, J.C.; Guevara, J. Indoor pedestrian navigation using an INS/EKF framework for yaw drift reduction and a foot-mounted IMU. In Proceedings of the 2010 7th Workshop on Positioning Navigation and Communication, Dresden, Germany, 11–12 March 2010; pp. 135–143. [Google Scholar]
  17. Nilsson, J.O.; Gupta, A.K.; Handel, P. Foot-mounted inertial navigation made easy. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation, Busan, Korea, 27–30 October 2014; pp. 24–29. [Google Scholar]
  18. Nilsson, J.O.; Skog, I.; Handel, P.; Hari, K.V.S. Foot-mounted INS for everybody—An open-source embedded implementation. In Proceedings of the Position Location and Navigation Symposium, Myrtle Beach, SC, USA, 23–26 April 2012; pp. 140–145. [Google Scholar]
  19. Fischer, C.; Sukumar, P.T.; Hazas, M. Tutorial: Implementing a Pedestrian Tracker Using Inertial Sensors. IEEE Pervas. Comput. 2013, 12, 17–27. [Google Scholar] [CrossRef]
  20. Wang, Z.; Zhao, H.; Qiu, S.; Gao, Q. Stance-Phase Detection for ZUPT-Aided Foot-Mounted Pedestrian Navigation System. IEEE/ASME Trans. Mechatron. 2015, 20, 3170–3181. [Google Scholar] [CrossRef]
  21. Skog, I.; Handel, P.; Nilsson, J.O.; Rantakokko, J. Zero-Velocity Detection—An Algorithm Evaluation. IEEE Trans. Biomed. Eng. 2010, 57, 2657–2666. [Google Scholar] [CrossRef] [PubMed]
  22. Skog, I.; Nilsson, J.O.; Händel, P. Evaluation of zero-velocity detectors for foot-mounted inertial navigation systems. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation, Zurich, Switzerland, 15–17 September 2010; pp. 1–6. [Google Scholar]
  23. Zhou, C.; Downey, J.; Stancil, D.; Mukherjee, T. A Low-Power Shoe-Embedded Radar for Aiding Pedestrian Inertial Navigation. IEEE Trans. Microw. Theory Tech. 2010, 58, 2521–2528. [Google Scholar] [CrossRef]
  24. Zhou, C.; Downey, J.; Choi, J.; Stancil, D. A Shoe-Embedded RF Sensor for Motion Detection. IEEE Microw. Wirel. Compon. Lett. 2011, 21, 169–171. [Google Scholar] [CrossRef]
  25. Bebek, O.; Suster, M.A.; Rajgopal, S.; Fu, M.J. Personal navigation via shoe mounted inertial measurement units. In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, 18–22 October 2010; Volume 25, pp. 1052–1058. [Google Scholar]
  26. Norrdine, A.; Kasmi, Z.; Blankenbach, J. Step Detection for ZUPT-Aided Inertial Pedestrian Navigation System Using Foot-Mounted Permanent Magnet. IEEE Sens. J. 2016, 16, 1. [Google Scholar] [CrossRef]
  27. Wang, J.S.; Lin, C.W.; Yang, Y.T.; Ho, Y.J. Walking pattern classification and walking distance estimation algorithms using gait phase information. IEEE Trans. Biomed. Eng. 2012, 59, 2884–2892. [Google Scholar] [CrossRef] [PubMed]
  28. Godha, S.; Lachapelle, G. Foot mounted inertial system for pedestrian navigation. Meas. Sci. Technol. 2008, 19, 75202. [Google Scholar] [CrossRef]
  29. Lee, J.A.; Cho, S.H.; Lee, Y.J.; Yang, H.K.; Lee, J.W. Portable activity monitoring system for temporal parameters of gait cycles. J. Med. Syst. 2010, 34, 959–966. [Google Scholar] [CrossRef] [PubMed]
  30. Xia, H.; Wang, X.; Qiao, Y.; Jian, J.; Chang, Y. Using Multiple Barometers to Detect the Floor Location of Smart Phones with Built-in Barometric Sensors for Indoor Positioning. Sensors 2015, 15, 7857–7877. [Google Scholar] [CrossRef] [PubMed]
  31. Li, B.; Harvey, B.; Gallagher, T. Using barometers to determine the height for indoor positioning. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation, Montbeliard-Belfort, France, 28–31 October 2013; pp. 1–7. [Google Scholar]
  32. Romanovas, M.; Goridko, V.; Klingbeil, L.; Bourouah, M.; Al-Jawad, A.; Traechtler, M.; Manoli, Y. Pedestrian Indoor Localization Using Foot Mounted Inertial Sensors in Combination with a Magnetometer, a Barometer and RFID; Springer: Berlin/Heidelberg, Germany, 2013; pp. 151–172. [Google Scholar]
  33. Ruiz, A.R.J.; Granja, F.S.; Prieto Honorato, J.C.; Rosas, J.I.G. Accurate Pedestrian Indoor Navigation by Tightly Coupling Foot-Mounted IMU and RFID Measurements. IEEE Trans. Instrum. Meas. 2012, 61, 178–189. [Google Scholar] [CrossRef] [Green Version]
  34. Ilyas, M.; Cho, K.; Baeg, S.H.; Park, S. Drift Reduction in Pedestrian Navigation System by Exploiting Motion Constraints and Magnetic Field. Sensors 2016, 16, 1455. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Structure of this novel 3D positioning system.
Figure 1. Structure of this novel 3D positioning system.
Sensors 17 02695 g001
Figure 2. Sketch map of sensor body coordinate frame (b-frame) and navigation coordinate frame (n-frame). (a) Shows the b-frame and three Euler angels which are yaw, pitch and roll; (b) shows the relation between earth-centered, earth fixed (ECEF) coordinate system and east-north-up (ENU) coordinate system. ENU is better to be applied in our system than ECEF because that it has the same origin with b-frame. Therefore, the rotation matrix will be simpler.
Figure 2. Sketch map of sensor body coordinate frame (b-frame) and navigation coordinate frame (n-frame). (a) Shows the b-frame and three Euler angels which are yaw, pitch and roll; (b) shows the relation between earth-centered, earth fixed (ECEF) coordinate system and east-north-up (ENU) coordinate system. ENU is better to be applied in our system than ECEF because that it has the same origin with b-frame. Therefore, the rotation matrix will be simpler.
Sensors 17 02695 g002
Figure 3. Flowchart of the pedestrian navigation system with EKF and ZUPT.
Figure 3. Flowchart of the pedestrian navigation system with EKF and ZUPT.
Sensors 17 02695 g003
Figure 4. Comparison of T in a walking and running gait pattern.
Figure 4. Comparison of T in a walking and running gait pattern.
Sensors 17 02695 g004
Figure 5. Stance phase detection errors of running gait pattern. The black wave contains eight running gait cycles. The red line represents ZUPT results in which 1 is the stance phase and 0 is the swing phase. The numbers from 1 to 8 are the identifier of the gait cycle.
Figure 5. Stance phase detection errors of running gait pattern. The black wave contains eight running gait cycles. The red line represents ZUPT results in which 1 is the stance phase and 0 is the swing phase. The numbers from 1 to 8 are the identifier of the gait cycle.
Sensors 17 02695 g005
Figure 6. Relationship of distance and magnetic field strength; (a) is a picture of the experiment scene. The left shoe is mounted with a MEMS-IMU and the right shoe is mounted with a permanent magnet. The right shoe moves along the ruler and stops every 10 cm; (b) is the result of the relationship between distance and magnetic field strength.
Figure 6. Relationship of distance and magnetic field strength; (a) is a picture of the experiment scene. The left shoe is mounted with a MEMS-IMU and the right shoe is mounted with a permanent magnet. The right shoe moves along the ruler and stops every 10 cm; (b) is the result of the relationship between distance and magnetic field strength.
Sensors 17 02695 g006
Figure 7. Waveforms of accelerations, angular rates and magnetic field strength during the same time period of walking gait pattern.
Figure 7. Waveforms of accelerations, angular rates and magnetic field strength during the same time period of walking gait pattern.
Sensors 17 02695 g007
Figure 8. Waveforms of accelerations, angular rates and magnetic field strength during the same time period of running gait pattern.
Figure 8. Waveforms of accelerations, angular rates and magnetic field strength during the same time period of running gait pattern.
Sensors 17 02695 g008
Figure 9. ZUPT errors and the magnetic field strength waveform.
Figure 9. ZUPT errors and the magnetic field strength waveform.
Sensors 17 02695 g009
Figure 10. Comparison of different magnetic field strength waveforms. The blue line, red line, green line and black line are magx, magy, magz and magnorm, respectively. Mid-stances (peaks) from magnorm are marked with red triangles.
Figure 10. Comparison of different magnetic field strength waveforms. The blue line, red line, green line and black line are magx, magy, magz and magnorm, respectively. Mid-stances (peaks) from magnorm are marked with red triangles.
Sensors 17 02695 g010
Figure 11. Sketch map of one gait cycle. It contains stance phase and swing phase. Paper [25] only shows how to detect mid-stance. We expend mid-stance to stance phase using stance phase duration information.
Figure 11. Sketch map of one gait cycle. It contains stance phase and swing phase. Paper [25] only shows how to detect mid-stance. We expend mid-stance to stance phase using stance phase duration information.
Sensors 17 02695 g011
Figure 12. Relationship of mid-stance, stance phase, swing phase and gait cycle. Mid-stance can be expanded to stance phase using stance phase duration information. T is the test statics of SHOE detector.
Figure 12. Relationship of mid-stance, stance phase, swing phase and gait cycle. Mid-stance can be expanded to stance phase using stance phase duration information. T is the test statics of SHOE detector.
Sensors 17 02695 g012
Figure 13. Using peak-peak time period information to distinguish walking/running gait pattern.
Figure 13. Using peak-peak time period information to distinguish walking/running gait pattern.
Sensors 17 02695 g013
Figure 14. Flowchart of mag-ZUPT. Mid-stance (peak) is extracted from magnetic field strength waveforms. Peak-peak period is used to distinguish walking/running gait patterns and then to obtain stance phase duration. Finally, mid-stance is expanded to stance phase.
Figure 14. Flowchart of mag-ZUPT. Mid-stance (peak) is extracted from magnetic field strength waveforms. Peak-peak period is used to distinguish walking/running gait patterns and then to obtain stance phase duration. Finally, mid-stance is expanded to stance phase.
Sensors 17 02695 g014
Figure 15. Traditional ZUPT and mag-ZUPT results in walking and running gait patterns; (a) is the walking scenario. The two ZUPT detectors have a similar performance; (b) is the running scenario. Seven stance phases are correctly detected by mag-ZUPT while only one stance phase is detected by traditional ZUPT.
Figure 15. Traditional ZUPT and mag-ZUPT results in walking and running gait patterns; (a) is the walking scenario. The two ZUPT detectors have a similar performance; (b) is the running scenario. Seven stance phases are correctly detected by mag-ZUPT while only one stance phase is detected by traditional ZUPT.
Sensors 17 02695 g015
Figure 16. Positioning results of a walking/running mix trajectory. The first half path is walking and the second half path is running. Traditional ZUPT cannot detect stance phase correctly of running gait pattern, therefore the positioning result diverges rapidly.
Figure 16. Positioning results of a walking/running mix trajectory. The first half path is walking and the second half path is running. Traditional ZUPT cannot detect stance phase correctly of running gait pattern, therefore the positioning result diverges rapidly.
Sensors 17 02695 g016
Figure 17. The atmospheric pressure fluctuates when the pedestrian walks on the same height; (a) is the atmospheric pressure; (b) is the height estimation error caused by atmospheric pressure fluctuation. The red line in (b) is the true vertical position (0 m).
Figure 17. The atmospheric pressure fluctuates when the pedestrian walks on the same height; (a) is the atmospheric pressure; (b) is the height estimation error caused by atmospheric pressure fluctuation. The red line in (b) is the true vertical position (0 m).
Sensors 17 02695 g017
Figure 18. The accumulative error of height estimation and the height difference every one second; (a) is the accumulative error. It reaches 2 m after 5000 sampling points (25 s); (b) is the height difference every one second. Although the height error accumulated, the height difference stay steady and it is possible to use this information to aid barometer to estimate the height more precisely.
Figure 18. The accumulative error of height estimation and the height difference every one second; (a) is the accumulative error. It reaches 2 m after 5000 sampling points (25 s); (b) is the height difference every one second. Although the height error accumulated, the height difference stay steady and it is possible to use this information to aid barometer to estimate the height more precisely.
Sensors 17 02695 g018
Figure 19. Flowchart of height difference information aided barometer (HDIB) algorithm.
Figure 19. Flowchart of height difference information aided barometer (HDIB) algorithm.
Sensors 17 02695 g019
Figure 20. Height difference and the level ground/upstairs/downstairs estimation results. LG is short for level ground. U is short for upstairs. D is short for downstairs.
Figure 20. Height difference and the level ground/upstairs/downstairs estimation results. LG is short for level ground. U is short for upstairs. D is short for downstairs.
Sensors 17 02695 g020
Figure 21. Height estimation using MEMS-IMU, barometer and HDIB. The blue line, red line and black line are height estimation from MEMS-IMU, barometer and HDIB, respectively. The green line is the reference height (true height).
Figure 21. Height estimation using MEMS-IMU, barometer and HDIB. The blue line, red line and black line are height estimation from MEMS-IMU, barometer and HDIB, respectively. The green line is the reference height (true height).
Sensors 17 02695 g021
Figure 22. The sketch map of the trajectory of IMU-foot. There are four gait cycles in this figure. Red dots represent that IMU-foot is on the ground which is the mid-stance.
Figure 22. The sketch map of the trajectory of IMU-foot. There are four gait cycles in this figure. Red dots represent that IMU-foot is on the ground which is the mid-stance.
Sensors 17 02695 g022
Figure 23. Flowchart of ZUPT-AAWL.
Figure 23. Flowchart of ZUPT-AAWL.
Sensors 17 02695 g023
Figure 24. Relationship of total travelled distance and average window length. The red dots are range of ZUPT-AAWL average window length which ranges from 20 to 381 sampling points.
Figure 24. Relationship of total travelled distance and average window length. The red dots are range of ZUPT-AAWL average window length which ranges from 20 to 381 sampling points.
Sensors 17 02695 g024
Figure 25. Hardware structure of the 3D positioning system.
Figure 25. Hardware structure of the 3D positioning system.
Sensors 17 02695 g025
Figure 26. Mid-stance and stance phase duration of Mix_1; (a) is magnetic field strength waveform and mid-stances (peaks) extracted from this wave; (b) is stance phase duration with different gait cycles. Peak-peak information can represent movement patterns including walking and running. Stance phase duration is calculated according to peak-peak information.
Figure 26. Mid-stance and stance phase duration of Mix_1; (a) is magnetic field strength waveform and mid-stances (peaks) extracted from this wave; (b) is stance phase duration with different gait cycles. Peak-peak information can represent movement patterns including walking and running. Stance phase duration is calculated according to peak-peak information.
Sensors 17 02695 g026
Figure 27. Height estimation results of MEMS-IMU, Barometer and HDIB of Height_4 trajectory. The blue line, red line and black line are height estimation from MEMS-IMU, barometer and HDIB, respectively. The green line is the reference height (true height).
Figure 27. Height estimation results of MEMS-IMU, Barometer and HDIB of Height_4 trajectory. The blue line, red line and black line are height estimation from MEMS-IMU, barometer and HDIB, respectively. The green line is the reference height (true height).
Sensors 17 02695 g027
Figure 28. Positioning result of Traj_1; (a) is the 3D view of the positioning result; (b) is the top view of the positioning result. TTDE of Traj_1 is 0.32% and the height error is 0.68 m.
Figure 28. Positioning result of Traj_1; (a) is the 3D view of the positioning result; (b) is the top view of the positioning result. TTDE of Traj_1 is 0.32% and the height error is 0.68 m.
Sensors 17 02695 g028
Figure 29. Positioning result of Traj_2; (a) is the 3D view of the positioning result; (b) is the top view of the positioning result. TTDE of Traj_2 is 0.76% and the height error is 0.27 m.
Figure 29. Positioning result of Traj_2; (a) is the 3D view of the positioning result; (b) is the top view of the positioning result. TTDE of Traj_2 is 0.76% and the height error is 0.27 m.
Sensors 17 02695 g029
Figure 30. Positioning and ZUPT result of traditional ZUPT and mag-ZUPT of Traj_3; (a) is the positioning result. The trajectory of mag-ZUPT is more matched to the true trajectory; (b) is ZUPT information. Mag-ZUPT based stance phase estimation has a better performance. TTDE of this test is 0.39%.
Figure 30. Positioning and ZUPT result of traditional ZUPT and mag-ZUPT of Traj_3; (a) is the positioning result. The trajectory of mag-ZUPT is more matched to the true trajectory; (b) is ZUPT information. Mag-ZUPT based stance phase estimation has a better performance. TTDE of this test is 0.39%.
Sensors 17 02695 g030
Figure 31. Positioning results and ZUPT comparison of Traj_4; (a) is the positioning result. Blue line and red line are the results of SHOE-ZUPT method whose threshold is adjusted to walking and running, respectively. Black line is the result of the novel mag-ZUPT method developed in this paper; (b) is the ZUPT result of SHOE-WALK, SHOE-RUN and mag-ZUPT. TTDE of mag-ZUPT is 0.77%.
Figure 31. Positioning results and ZUPT comparison of Traj_4; (a) is the positioning result. Blue line and red line are the results of SHOE-ZUPT method whose threshold is adjusted to walking and running, respectively. Black line is the result of the novel mag-ZUPT method developed in this paper; (b) is the ZUPT result of SHOE-WALK, SHOE-RUN and mag-ZUPT. TTDE of mag-ZUPT is 0.77%.
Sensors 17 02695 g031
Figure 32. Positioning result of Traj_5 overlaid on a satellite campus picture; (a) is the top view; (b) is height estimation result. TTDE of this test is 0.63% and the height error is 0.20 m.
Figure 32. Positioning result of Traj_5 overlaid on a satellite campus picture; (a) is the top view; (b) is height estimation result. TTDE of this test is 0.63% and the height error is 0.20 m.
Sensors 17 02695 g032
Figure 33. Positioning result of Traj_6 overlaid on a satellite campus picture; (a) is the top view; (b) is height estimation result. TTDE of this test is 1.04% and the height error is 2.35 m.
Figure 33. Positioning result of Traj_6 overlaid on a satellite campus picture; (a) is the top view; (b) is height estimation result. TTDE of this test is 1.04% and the height error is 2.35 m.
Sensors 17 02695 g033
Table 1. Statistics of peak-peak time period of walking and running gait patterns.
Table 1. Statistics of peak-peak time period of walking and running gait patterns.
ItemsPeak-Peak Period of Walking Peak-Peak Period of Running
Maximum277156
Minimum242141
Average259.4148.1
Table 2. Height estimation result of MEMS-IMU, Barometer and HDIB.
Table 2. Height estimation result of MEMS-IMU, Barometer and HDIB.
MethodStart & End (m)Peak (m)Final Height (m)Height Error (m)
MEMS-IMU02451.7251.72
Barometer0245.985.98
HDIB0242.042.04
Table 3. Typical total travelled distance results.
Table 3. Typical total travelled distance results.
Average Window LengthTotal Travelled Distance (m)
Real length1355
11612
1001394
2001353
3001342
4001332
ZUPT-AAWL1356
Table 4. Stance phase estimation accuracy of SHOE and mag-ZUPT.
Table 4. Stance phase estimation accuracy of SHOE and mag-ZUPT.
TrajectoryStance Phase NumberStance Phase Number of SHOEStance Phase Number of Mag-ZUPT
Walking_1706970
Walking_2686968
Walking_3676667
Running_1391439
Running_2381437
Running_337436
Mix_1453445
Mix_2453244
Mix_3442844
Average errorNone13.9/50.30.3/50.3
Table 5. Total travelled distance of SHOE and mag-ZUPT.
Table 5. Total travelled distance of SHOE and mag-ZUPT.
TrajectoryActual Moving LengthMoving Length of SHOEMoving Length of Mag-ZUPT
Walking_110094.898.5
Walking_210095.698.6
Walking_310094.497.2
Running_1100176.996.6
Running_2100185.998.2
Running_3100686.4104.7
Mix_1100104.8102.1
Mix_2100153.898.1
Mix_3100180.5101.5
Average errorNone100.4/1002.3/100
Table 6. Description of the test trajectories.
Table 6. Description of the test trajectories.
TrajectoryHeight Change Description
Height_1Walking on the level ground for 396 m, the height change is 0 m.
Height_2Walking on the level ground for 408 m, the height change is 0 m.
Height_3Height of each floor is 3.55 m, ascending 4 floors, descending 5 floors, ascending 1 floor
Height_4Height of each floor is 3.55 m, ascending 4 floors, descending 5 floors, ascending 1 floor
Height_5Height of each floor is 3.55 m, descending 1 floor and ascending 1 floor
Height_6Walking from floor 2 to floor 11, height from floor 2 to 7 is 4.108 m, height from floor 7 to floor 11 is 3.792 m
Table 7. RMS results of IMU based height estimation, barometer based height estimation and HDIB based height estimation.
Table 7. RMS results of IMU based height estimation, barometer based height estimation and HDIB based height estimation.
TrajectoryTotal Height Change (m)IMU Height Error RMS (m)Barometer Height Error RMS (m)HDIB Height Error RMS (m)
Height_1014.150.190
Height_2022.071.180
Height_335.510.291.310.26
Height_435.54.281.780.69
Height_57.10.800.960.27
Height_635.716.941.070.30
Table 8. Key indicators of the six experiments.
Table 8. Key indicators of the six experiments.
TrajectoryTotal Moving Distance (m)Height Error (m)TTDE
Traj_12610.680.32%
Traj_23680.270.76%
Traj_340900.39%
Traj_420200.77%
Traj_514300.200.63%
Traj_626962.351.04%

Share and Cite

MDPI and ACS Style

Yang, W.; Xiu, C.; Zhang, J.; Yang, D. A Novel 3D Pedestrian Navigation Method for a Multiple Sensors-Based Foot-Mounted Inertial System. Sensors 2017, 17, 2695. https://doi.org/10.3390/s17112695

AMA Style

Yang W, Xiu C, Zhang J, Yang D. A Novel 3D Pedestrian Navigation Method for a Multiple Sensors-Based Foot-Mounted Inertial System. Sensors. 2017; 17(11):2695. https://doi.org/10.3390/s17112695

Chicago/Turabian Style

Yang, Wei, Chundi Xiu, Jianmin Zhang, and Dongkai Yang. 2017. "A Novel 3D Pedestrian Navigation Method for a Multiple Sensors-Based Foot-Mounted Inertial System" Sensors 17, no. 11: 2695. https://doi.org/10.3390/s17112695

APA Style

Yang, W., Xiu, C., Zhang, J., & Yang, D. (2017). A Novel 3D Pedestrian Navigation Method for a Multiple Sensors-Based Foot-Mounted Inertial System. Sensors, 17(11), 2695. https://doi.org/10.3390/s17112695

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop