Next Article in Journal
Monitoring Scapular Kinematics through Wearable Magneto-Inertial Measurement Units: State of the Art and New Frontiers
Previous Article in Journal
Operability of Smart Spaces in Urban Environments: A Systematic Review on Enhancing Functionality and User Experience
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Mechanomyography Signal Pattern Recognition of Knee and Ankle Movements Using Swarm Intelligence Algorithm-Based Feature Selection Methods

1
School of Mechanical Engineering, Nantong University, Nantong 226019, China
2
School of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
3
School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(15), 6939; https://doi.org/10.3390/s23156939
Submission received: 27 June 2023 / Revised: 24 July 2023 / Accepted: 3 August 2023 / Published: 4 August 2023
(This article belongs to the Topic Bio-Inspired Systems and Signal Processing)

Abstract

:
Pattern recognition of lower-limb movements based on mechanomyography (MMG) signals has a certain application value in the study of wearable rehabilitation-training devices. In this paper, MMG feature selection methods based on a chameleon swarm algorithm (CSA) and a grasshopper optimization algorithm (GOA) are proposed for the pattern recognition of knee and ankle movements in the sitting and standing positions. Wireless multichannel MMG acquisition systems were designed and used to collect MMG movements from four sites on the subjects thighs. The relationship between the threshold values and classification accuracy was analyzed, and comparatively high recognition rates were obtained after redundant information was eliminated. When the threshold value rose, the recognition rates from the CSA fluctuated within a small range: up to 88.17% (sitting position) and 90.07% (standing position). However, the recognition rates from the GOA drop dramatically when increasing the threshold value. The comparison results demonstrated that using a GOA consumes less time and selects fewer features, while a CSA gives higher recognition rates of knee and ankle movements.

1. Introduction

For diseases such as stroke, if patients do not realize the importance of rehabilitation training or cannot persist in it because of insufficient enthusiasm, their body function will deteriorate in the long term, negatively affecting their quality of life. Reasonable rehabilitation, especially active training with another person can have a positive effect on the recovery of the neuromuscular system and prevent palindromia or sequela. Thus it is necessary to study accurate and real time recognition method of human limb movements for rehabilitation training with human machine interaction.
Currently, biomedical signals, especially surface electromyography (sEMG), have been widely used in the pattern recognition of lower limb movements, and great progresses has been made in fields such as exoskeleton rehabilitation training, human machine interaction (HMI) systems and prosthetics [1]. Ryu et al. [2] proposed a method to extracted top and slope (TAS) features of sEMG to detect human lower movements. This method can reflect the time characteristic of sEMG and improve average detective accuracy. Yao et al. [3] extracted time-domain and frequency features of an 8-channel sEMG and adopted a support vector machine (SVM), extreme learning machine (ELM) and deep neural network (DNN) to achieve the recognition of 6-class gait movements. Shi et al. [4] used principal component analysis (PCA) to reduce the dimensionality after extracting features based on wavelet transform and then proposed a novel method to achieve the recognition of 5-class lower limb movements. He et al. [5] proposed a sparrow search algorithm-optimized deep belief network (SSA-DBN) classification method of gait movements after extracting wavelet features. The results demonstrated that the SSA effectively improved the performance of the DBN. Qin and Shi [6] extracted 11 features of three-channel sEMG and adopted a multikernel-relevant vector machine to achieve the recognition of 5-class upper-limb movements with a recognition rate up to 96%. In another study on the pattern recognition of upper limb movements, Wei et al. [7] proposed a method based on tunable Q-factor wavelet transform (TQWT) and Kraskov entropy, and achieved a high recognition rate of 4-class lower limb movements.
In contrast to sEMG, mechanomyography (MMG) is a low-frequency mechanical signal generated from muscle’s lateral oscillation and has application value in human machine interaction technology. Compared with sEMG, MMG is more convenient for collecting since it is unaffected by sweating and can be collected through specific cloth material [8,9]. Yu et al. [10] collected 4-channel MMG from the thigh and adopted a hidden Markov model to achieve recognition of gait movements. In another study, a Salp Swarm Algorithm (SSA) was used for time-domain feature extraction, and obtained better recognition results compared with some traditional feature-selection algorithms [11]. Nowadays, deep learning has been made great progress in image and natural-language processing and has been applied in the classification of biomedical signals with good performance [12,13,14], especially for big data. Since deep learning needs hardware with a higher configuration and takes a much longer time to train models, machine learning still has a certain application value if a simple model can perform the recognition task. Therefore machine learning is still worth investigating in pattern recognition of limb movements based on MMG.
When studying machine learning for biomedical signals, feature extraction and selection are two factors that directly affect classification accuracy. So far, time-domain [15,16], frequency-domain [17,18], and time-frequency-domain features [19,20] have been increasingly applied in the machine learning of sEMG, and nonlinear dynamic analysis features [7] have been used in the pattern recognition of human movements. If the dimension of the feature set is too high, the structure of the trained model will be overly complicated. Thus, an effective method for selecting features should be found before the features are input into the classifiers. Currently, some filter-feature selection methods, such as ReliefF and Laplacian, have been adopted to investigate the pattern recognition of human movement based on sEMG [21]. These methods have high efficiency, but they are not classification algorithms, and this may lead to a comparatively lower quality of selected features for a specific classification algorithm. Unlike the filter-feature selection method, a heuristic searching algorithm can adopt swarm intelligence, which simulates the model to use local information to generate unpredictable swarm behavior. The advantage is that the solution of a whole problem does not depend on just one part, giving the model stronger robustness and globally optimizing the problem in many situations. On the one hand, some swarm intelligence algorithms (SIAs) have so far been used to explore the pattern recognition of human movement based on biomedical signals by optimizing some classification algorithms [22,23]. On the other hand, an SIA can be used as the optimization algorithm of feature selection, i.e., taking the results of feature selection as the design variables as has been achieved in some fields [24,25]. Thus, feature-selection methods based on SIAs are worth being studied for biomedical signals. The main contribution of this paper is that MMG feature selection methods based on a chameleon swarm algorithm (CSA) and grasshopper optimization algorithm (GOA) are proposed for investigating the pattern recognition of knee and ankle movements, analyzing the relationship between threshold values and classification accuracy, and obtaining comparatively high recognition rates provided that redundant information is eliminated.

2. Materials and Methods

2.1. Experiment Protocol and Data Preprocessing

This experiment was approved by the Ethics Committee of East China University of Science and Technology (Number 001/2019). In the experiment, seven healthy subjects (students from East China University of Science and Technology aged 23 to 26) who had no history of lower-limb muscle disorder and who had not done strenuous exercise within 48 h before the experiment were recruited. They agreed with the content of experiments and gave informed consent. An acquisition system each with a module integrated by MMG sensors (ADXL355, Analog Device, Inc., Norwood, MA, USA)—Seeeduino Xiao microprocessor (Seeed Technology, Co., Ltd, Shenzhen, China), power-supply with 3.7 V and 400 mAh (PULAN Technology, Co., Ltd., Hong Kong, China) and wireless-transmission units nRF24L01 (Nordic Semiconductor, Co., Ltd, Stockholm, Sweden)—was designed to collect MMG, shown as Figure 1. Since the main frequency band of MMG is lower than 100 Hz, the sampling rate was set at 250 Hz. Four sites on the thigh, i.e., vastus lateralis, vastus medialis, gastrocnemius lateralis and gastrocnemius medialis were selected for MMG collection, recorded as Channel 1 to 4. The experiment was divided into two cases, as shown in Figure 2. In Case 1, the subjects performed four class movements: knee extension (KE1), knee flexion (KF1), ankle dorsiflexion (AD1) and ankle plantar (AP1) in a sitting position, as shown in Figure 2a. In Case 2 the subjects performed four class movements: knee extension (KE2), knee flexion (KF2), ankle dorsiflexion (AD2) and ankle plantar (AP2) in a standing position, as shown in Figure 2b. They performed the knee and ankle movements without muscular discomfort. They performed the movements in time to a metronome in a quiet environment. To avoid muscle fatigue and hampering accurate performance, the movements of each class were repeated 100 times with plenty of rest between movements of different classes. Based on above the conditions, MMG was obtained from the standard movements.
According the characteristics of MMG, a 5–100 Hz band-pass digital filter was used to process the signals, retaining useful information and removing the motion artifact [26]. The processed MMG signals are shown as Figure 3. Then the signals were segmented by the short-time energy method according each movement. In particular, the signals were divided into data blocks by a moving window. The average energy was calculated from the data blocks of all the channels, and then the start and end situations were found according to a threshold. Finally, the signal segments were obtained [27]. The MMG signals of a movement are shown in Figure 4.

2.2. Feature Extraction

2.2.1. Time Domain Features

Since the signals can be regarded as a function of time, time-domain (TD) features can be calculated directly from a one-dimensional signal. Ten time-domain features [28]—root mean square (RMS), variance (VAR), zero crossing (ZC), wavelet length (WL), slope sign change (SSC), log detector (LOG), mean absolute value (MAV), v-order, simple square integral (SSI) and average amplitude change (AAC)—were extracted from all signals.

2.2.2. Frequency Domain Features

Frequency domain (FD) features are indexes that analyze signals in the frequency domain. It can be calculated based on the power spectrum density (PSD), which is the power function of the frequency component in the unit bandwidth power. Two regularly used features—mean power frequency (MPF) and median frequency (MF) [29]—were adopted in this paper.

2.2.3. Wavelet Packet Node Energy

Time-frequency analysis uses the joint distribution function of time and frequency to represent a signal, and wavelet analysis is a common method in biomedical signal processing [24]. After MMG was decomposed by a wavelet packet, a set of wavelet coefficients was obtained:
S ( t ) = j = 0 2 i 1 f i , j ( t j ) = f i , 0 ( t 0 ) + f i , 1 ( t 1 ) + f i , j ( t j )
where f i , j ( t j ) is the reconstructed signal of MMG node ( i , j ) decomposed by a wavelet packet. After calculating the node energy according to Parseval’s theorem, the energy of the i th level signal was defined as
E i , j ( t j ) = k = 1 m x j , k 2
where E i , j ( t j ) is the energy of frequency band in the j th node of the i th level signal; m is the number of the sampling data; and x j , k is the amplitude of the discrete point of the reconstructed signal. A four-level wavelet packet decomposition was adopted, and the energy features of 11 nodes corresponding to 7.8–93.8 Hz were extracted.

2.2.4. Nonlinear Dynamic Analysis Feature

A human biomedical signal has obvious nonlinear characteristics; thus, some features based on a nonlinear dynamic (NLD) analysis—approximate entropy (AEn), sample entropy (SEn) and fuzzy entropy (FEn)—were used in the study of sEMG [30]. However, the computational requirements of NLD features are much more demanding, so they were adopted comparatively less in HMI systems based on sEMG. Lempel Ziv complexity (LZC) was used to represent the time series by symbol, and it increased with the disorder degree of signals. In this paper, AEn, SEn, FEn and LZC were extracted from each signal segment.

2.3. Swarm Intelligence Algorithms

2.3.1. Chameleon Swarm Algorithm

A chameleon swarm algorithm (CSA) [31] is a kind of novel meta-heuristic optimization algorithm based on chameleon predation. It solves optimization problems mainly according to updated positions from the following three stages: searching for the prey, moving the eyes to find the prey; and catching the prey.
Step 1: Initialize the population size N , the position X i , and the maximum iteration times T max . The initial positions of the chameleons can be described as
X i j = U b + r × ( U b L b )
where x i j is the position of the j th dimension of the i th chameleon; U b and L b are the upper bound and lower bound of the searching space; r is a random number between (0, 1).
Step 2: During the predation stage, the chameleon swarm searches for prey by updating their positions. The updated positions can be described as
X i j t + 1 = X i j t + p 1 r 2 ( P i j t G j ) + p 2 r 1 ( G j x i j t ) , r P p X i j t + 1 = X i j t + μ ( r 3 ( U b L b ) + L b ) sgn ( r a n d 0.5 ) , r < P p
where X i j t is the iteration position of the j th dimension of the i th chameleon; p 1 and p 2 are the control parameters of developing ability; r 1 and r 2 are the random numbers between (0, 1); P i j t is the global optimization position of the j th dimension of the i th chameleon; P p is the perceptual parameter; μ is the control parameter of searching ability, μ = e ( α t / T ) 3 α is the sensitivity coefficient; T is the maximum iteration number and t is the current iteration number.
Step 3: The chameleon finds the prey by moving its eyes and updating its own position according to the location of the prey. The updated position can be described as
X i t + 1 = m × ( X i t X ¯ i t ) + X ¯ i t
where X i t is the iteration position of the i th chameleon; X ¯ i t is the central position of the i th chameleon; and m is the rotation matrix.
Step 4: When the prey is near, the chameleon will use its tongue to catch the prey. The velocity of movement can be described as
v i , j t + 1 = ω v i , j t + c 1 r 1 ( G j X i j t ) + c r ( P i j t X i j t ) ω = ( 1 t / T ) p t / T
where v i j t + 1 is the velocity of the j th dimension of the i th chameleon; c 1 and c 2 are two constant numbers; r 1 and r 2 are random numbers between (0, 1); and ω is the linearly decreasing inertial weight.
The updated position can be described as
X i j t + 1 = X i j t + [ ( v i j t ) 2 ( v i j t 1 ) 2 ] / 2 a
where a is the acceleration and a = 2590 × ( 1 e l g t ) .

2.3.2. Grasshopper Optimization Algorithm

Grasshopper optimization algorithm (GOA) [32] is one other kind of novel meta-heuristic optimization algorithm, which is based on foraging of grasshopper.
Step 1: Initialize the population size N , the position X i , the maximum iteration times T max , the range c max and c min . The position of the i th individual is
X i = S i + G i + A i
where S i is the effect on the i th individual from the population; G i is the effect from gravity; and A i is the effect from wind.
To solve the optimization problems, G i and A i were often replaced with the position of targeted food T d , thus
X i = S i + T d
S i = j = 1 , j i N s ( x j x i ) x j x i x j x i
where s ( r ) is the interaction force and it is defined as
s ( r ) = f e r l e r
where the individuals attract each other when s > 0 , and exclude each other when s < 0 . Here f is the attractive factor, and l is the attractive scale.
Step 2: Calculate the fitness function value of each grasshopper.
Step 3: Update the control parameter c of the searching space, which can be described as
c = c max t c max c min T max
where t is the current iteration time, and T max is the maximum iteration time.
Step 4: The updated position of grasshopper can be described as
X i d = c j = 1 , j i N c U b L b 2 s ( x j x i ) x j x i x j x i + T d
where U b and L b are the upper and lower bounds of the searching space, and T d is the best solution of the swarms in the space.

2.4. Classification Algorithm

As a kind of algorithm with good performance in high dimension and nonlinear classification problems, a support vector machine (SVM) was used to build the classifier. If a set with two classes of data { x i , y i } ( i = 1 , 2 , , N , y i { 1 , + 1 } , x i R d ) were given, the slack variable ξ i 0 and penalty parameter C > 0 were introduced, and then the optimal hyperspace was
max i = 1 m α i 1 2 i = 1 m α i α j y i y j ( x i , x j ) ,   s . t .   0 α i C ,   i = 1 m α i y i = 0 ,   i = 1 , , m
where α i is the Lagrange factor.
The kernel function was introduced to increase the dimension, thereby obtaining the optimal hyperspace as f ( x ) = s i g n [ i = 1 N α i y i K ( x i x ) + b ] . Some kernel functions such as the radial basic function (RBF) had the characteristic of a simple structure and high generalization performance. The formula of RBF is
K ( x , x ) = exp ( x x 2 σ 2 )
In some studies about the classification of sEMG, using a SVM with RBF can achieve better results than using K nearest neighbor (KNN), linear discriminant analysis (LDA), random forest (RF) or some other classification algorithms [33,34].

2.5. Feature Selection

Feature selection can be used to obtain important and representative features from the set, reducing the dimension of feature set. For the optimization problem, classification accuracy was taken as the target function f ( X ) to evaluate the effect of feature selection. In this paper, CSA and GOA were used as two searching algorithms to derive an optimal feature subset. Each individual represented a solution, and its position information X i was taken as the design variable for the optimal problem. The value of X i was changed by a transfer function and compared with a threshold T to decide if this feature were retained. The flow chart of feature selection based on SIAs is shown in Figure 5.
Several functions can be adopted as the transfer function as shown as Table 1. In this paper, S1 was adopted. In the process of iteration, the position of an individual was updated according to the fitness function. When the classification accuracy was higher and the number of selected features was lower, the result of the feature selection was meaningful. The fitness function was defined as
F i t n e s s = α a c c + β ( 1 R / N ) ,   β = 1 α
where a c c is the classification accuracy; R and N are the numbers of selected features and all features, respectively; and α is 0.99.
The updated positions were changed by the transfer function, and then the values were compared with the threshold T . If the values were larger than T , the corresponding features were selected; otherwise, the corresponding features were not selected. The classification results of the models were obtained based on intra-subject since it was impossible to avoid the differences between subjects. A 10-fold cross validation was applied to evaluate the performance of the classifier and the effect of feature selection. The final results are shown as Equations (2)–(17) and Equations (2)–(18). The samples of every subject were divided into 10 folds, and 1 fold from each was retained as a testing set; the other 9 were used for training a model.
m e a n _ a c c = 1 K i = 1 K a c c ( i )
m e a n _ R = 1 K i = 1 K R ( i )

3. Results

3.1. Classification Results from Different Feature Set

To evaluate the effect on movement classification from different feature sets, 7 feature set were constructed from TD, FD, WE and NLD features. For two cases (sitting and standing), the classification accuracy and time consumption are shown in Figure 6 and Figure 7. Among all the feature sets, using TD + FD + NLD obtained better results. For the CSA, the classification accuracy was 88.43% for movement in a sitting position and 89.73% for movements in a standing position; there was no significant difference (p > 0.05). For the GOA, the classification accuracy was 86.87% for sitting and 89.01% for standing; there was also no difference significant difference (p > 0.05). In the situation with a specific T , using the CSA to select features achieved a higher classification accuracy than using the GOA. TD features played an important role in high classification accuracy since using FD + WE (without TD) merely obtained an accuracy of 70.59% (sitting) and 76.02% (standing), much lower than using other feature sets (sitting: vs. TD, p < 0.01; vs. TD + FD, p < 0.01; vs. TD + WE, p < 0.01; vs. TD + FD + WE, p < 0.01, vs. TD + NLD, p < 0.01; vs. TD + FD + NLD, p < 0.01.) (standing: vs. TD, p < 0.05; vs. TD + FD, p < 0.05; vs. TD + WE, p < 0.05; vs. TD + FD + WE, p < 0.05; vs. TD + NLD, p < 0.05; vs. TD + FD + NLD, p < 0.01.). Concerning average time consumption, using a TD feature set can take less time. For the classification of knee and ankle movements in the sitting position, time consumption was 5.21 s (CSA) and 4.81 s (GOA); For the classification of movements in standing position, time consumption was 4.52 s (CSA) and 4.29 s (GOA). The TD + FD + WE feature set had the highest time consumption. For the classification of knee and ankle movements in the sitting position, time consumption was 10.21 s (CSA) and 9.00 s (GOA); For the classification of movements in the standing position, time consumption was 9.28 s (CSA) and 8.58 s (GOA).
In the sitting position, the confusion matrix of the four-class movements based on CSA-feature selection is shown as Table 2. The recognition rates of AD1 and AP1 were higher than 90% while that of KE1 and KF1 were comparatively lower: only slightly higher than 85%. A possible reason is that the distinction of muscle vibration between KE1 and KF1 was smaller, leading to lower feature-vector differences between the two class movements. When standing, the confusion matrix of movements based on CSA-feature selection is shown as Table 3. The recognition rate of KE2 was the lowest at 86.55%, while that of AD2 was the highest at 93.35%. Thus, both in sitting and standing, the recognition rates of KE and KF were lower than that for AD and AP.

3.2. Classification Results from Different Channel Combinations

For several 3-channel combinations, the recognition rates of knee and ankle movements based on CSA and GOA feature selection are shown in Figure 8 and Figure 9. Whether sitting or standing, using Channel 2 + 3 + 4 obtained the best classification results. When sitting, using CSA feature selection in the TD + FD + NLD feature set achieved a recognition rate of 88.56%. The recognition rates were 87.49% from Channel 1 + 2 + 3; 87.52% from Channel 1 + 2 + 4; and 87.14% from Channel 1 + 3 + 4. In the standing position, using CSA feature selection in the TD + FD + NLD feature set obtained a recognition rate of 89.56%. The recognition rates were 89.47% from Channel 1 + 2 + 3; 88.35% from Channel 1 + 2 + 4; and 89.42% from Channel 1 + 3 + 4. The results demonstrated that MMG from three muscles, i.e., vastus medialis, gastrocnemius lateralis and gastrocnemius medialis may have had a greater contribution to the recognition results than did vastus lateralis.

3.3. Classification Results from Different Threshold

In the sitting position, for a different threshold T , the relationship between classification accuracy and T values is shown as Figure 10. There were obvious distinctions between feature selection methods based on CSA and GOA. For the same T value, using CSA feature selection achieved higher accuracy than using the GOA, while the number of selected features from using the GOA was fewer. Taking 0.3 as an example, the average number of selected features by the CSA was 58.66 (sitting) and 59.03 (standing), while that of the GOA are 39.16 (sitting) and 44.27 (standing). When the value increased from 0.3 to 0.6, CSA classification accuracy for most of the subjects did not fluctuate much (the range values were 0.98) while that for the GOA decreased sharply: range value 25.58. There was no significant difference between the T value in 0.3 and 0.6 (p > 0.05) by using the CSA while the classification accuracy had a significant difference (p < 0.01) from using the GOA. For the two SIAs, the number of selected features decreased almost linearly as the threshold increased. When the threshold value was 0.35, the high accuracy of movement (in the standing situation) was 90.07%, and the average number of selected features was 53.26. When the threshold was 0.5, the average number of selected features (CSA) was 40.18 (sitting) and 38.67 (standing), and the classification results were 87.72% (sitting) and 88.75% (standing). When the threshold was 0.3, the average number of selected features (GOA) was 39.16 (sitting) and 44.27 (standing), and the classification results were 86.36% (sitting) and 89.33% (standing). Under these circumstances, the average number of selected features by the two intelligence algorithms were similar. By using feature selection methods based on CSA and GOA, the relationship between the recognition rates of each class movement and the threshold values is shown in Table 4 and Table 5. For the CSA, as the threshold increased from 0.3 to 0.6, the recognition rates of most class movements fluctuated slightly, though that of AP1 dropped from 90.40 to 87.90%. In contrast, for the GOA, the recognition rates of each class movements decreased sharply to lower than 70% when the threshold was 0.6.
In the standing position, the relationship between classification accuracy and the T values is shown in Figure 11. Similar to sitting position, using CSA feature selection achieved better classification results than using the GOA; however the number of selected features from using the CSA was higher. By using feature selection methods based on CSA and GOA, the relationship between the recognition rates of each class movements and the threshold values are shown as Table 6 and Table 7. For the CSA, the recognition rates of most class movements fluctuated in a small range as the threshold increased (the range value is 1.37, p > 0.05). However, for the GOA, the recognition rates dropped to below 75%: range value 19.11 (p < 0.01) when the threshold value was 0.6.

4. Discussion

For lower limb rehabilitation training, multichannel MMG signals were collected from the thigh, and feature selection methods based on two swarm intelligence algorithms were proposed for investigating pattern recognition of knee and ankle movement in sitting and standing positions, thereby demonstrating the relationship between classification accuracy and number of selected features. EMG sensors on the legs were adopted to represent the electrical activity of muscles during a lower limb movement [35]. Currently, studies about pattern recognition of lower limb movements based on sEMG, especially gait recognition are being applied to an exoskeleton [36]. Compared with sEMG, another biomedical signal, MMG is convenient for data collection, having investigative value for rehabilitation training system. Though MMG is different from sEMG in physical characteristics, both are enhanced and attenuated as muscles contract and relax, having some synchrony in static and transient states.
As an import part of biomedical-signal machine learning, feature extraction and selection directly affect the results of pattern recognition. The biomedical-signal features can be generally divided into TD, FD, TFD and NLD features, of which TD features are the most frequently adopted for sEMG or MMG classification problems. Because TD feature extraction is easy to compute and use it can achieve satisfactory classification results in many cases. In some other studies, the representative TD features, such as MAV, ZC, RMS, were used with high accuracy [37,38]. However, TD features alone may not use sufficient signal information; thus, sometimes they are combined with other features [39]. In this paper, though the TD features made a great contribution to MMG recognition rates of knee and ankle movements, using a TD + FD + NLD feature set achieved better results.
The design of the classifier is another important part in the studies about pattern recognition of gait movements based on sEMG. So far many scholars have applied various classification algorithms such as linear discriminant analysis [40], hidden Markov model [40], extreme learning machine [30] and SVM [33]. Khomami et al. [33] demonstrated that using an SVM with an RBF to build a classifier can achieve better sEMG classification results compared to other algorithms. In this paper, an SVM with an RBF were applied to be the classification algorithm of knee and ankle movements based on MMG. After feature extraction to remove the redundant information and improve applicability, feature transformation or selection were usually used to reduce the dimension [39], and the selected features reflected the difference between the patterns of samples. Currently, the traditional feature selection method ReliefF [21] has been used while a feature selection method based on swarm intelligence algorithms are reported comparatively less often. The CSA and GOA are two novel SIAs proposed in recent years, and it has been demonstrated that they have excellent performance in engineering optimization problems. MMG feature selection methods based on the CSA and GOA were proposed in this paper to investigate the pattern recognition of knee and ankle movements.
Although multiple signal channels can improve classification accuracy, fewer channels are more convenient. Thus, reducing the number of channels was meaningful for retaining high accuracy. According to the results from several three-channel combinations, using Channel 2 + 3 + 4 achieved the highest accuracy, approximating to using all four channels and higher than using the other three-channel combinations. It illustrated that, of the four thigh muscles, the vastus medialis, gastrocnemius lateralis and gastrocnemius medialis gave more positive classification results when the subjects performed the four-class knee and ankle movements. Regarding acquisition sites, collecting MMG from these three muscles gave better in classification results.
Muscle group synergy is a kind of neural control strategy that coordinates movements via the central nervous system. It can activate a muscle group according in different proportions. If muscle group synergy is considered with pattern recognition of lower limb movements, it is better for human physical mechanism. In the future, more experiments will be done to increase the number of samples, and deep learning combined with muscle group synergy will be used to investigate more applicable methods for lower limb movements.

5. Conclusions

In this paper, MMG feature selection methods based on the CSA and GOA were proposed for pattern recognition of knee and ankle movements. Of all the feature sets, TD + FD + NLD gave the best classification results. For the CSA-based feature-selection method, the classification accuracy of knee and ankle movements was 88.17% (sitting) and 90.07% (standing). Of all the three channel combinations, Channel 2 + 3 + 4 (vastus medialis, gastrocnemius lateralis and gastrocnemius medialis) made the most important contribution to accuracy. Concerning the same threshold, using CSA feature selection achieved higher accuracy than using the GOA, while the number of selected features by using the GOA was lower. For the CSA, recognition rates of most class movements fluctuated in a small range as the threshold increased. However, for the GOA, recognition rates decreased sharply when the threshold increased.

Author Contributions

Conceptualization, Y.Z. and M.S.; methodology, Y.Z.; software, Y.Z. and J.Z.; validation, Y.Z., M.S. and G.C.; formal analysis, Y.Z. and J.Z.; investigation, Y.Z.; resources, C.X.; data curation, G.C.; writing—original draft preparation, Y.Z.; writing—review and editing, C.X.; supervision, Q.W.; project administration, Q.W.; funding acquisition, M.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Shanghai University Youth Teacher Training Assistance Scheme, grant number ZZ 202203047.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of East China University of Science and Technology.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the patients to publish this paper.

Acknowledgments

The authors gratefully acknowledge our test subjects, our funding support, University of Shanghai for Science and Technology.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sharma, T.; Sharma, K.P.; Veer, R.K. Decomposition and evaluation of SEMG for hand prostheses control. Measurement 2021, 186, 110102. [Google Scholar] [CrossRef]
  2. Ryu, J.; Lee, B.H.; Kim, D.H. sEMG signal-based lower limb human motion detection using a top and slope feature extraction algorithm. IEEE Signal Proc. Lett. 2017, 24, 154–196. [Google Scholar] [CrossRef]
  3. Yao, T.; Gao, F.R.; Zhang, Q.Z.; Ma, Y.L. Multi-feature gait recognition with DNN based on sEMG signals. Math. Biosci. Eng. 2021, 18, 3521–3542. [Google Scholar] [CrossRef] [PubMed]
  4. Shi, X.; Qin, P.; Zhu, M.; Shi, W. Feature extraction and classification of lower limb motion based on sEMG signals. IEEE Access 2020, 19, 132882–132892. [Google Scholar] [CrossRef]
  5. He, J.; Wang, R.F.; Wang, Q.X.; Zhang, Q.Z.; Lin, W.J. A method combining multi-feature fusion and optimized deep belief network for EMG-based gait classification. Mathematics 2022, 10, 4387. [Google Scholar] [CrossRef]
  6. Qin, P.; Shi, X. Evaluation of feature extraction and classification for lower limb motion based on sEMG signal. Entropy 2020, 22, 852. [Google Scholar] [CrossRef]
  7. Wei, C.; Wang, H.; Zhou, B.; Feng, N.; Hu, F.; Lu, Y.; Jiang, D.; Wang, Z. sEMG Signal-based Lower Limb movements recognition using Tunable Q-factor wavelet transform and Karskov Entropy. IRBM 2023, 44, 100883. [Google Scholar] [CrossRef]
  8. Wang, H.F.; Wang, D.Q.; Huang, Q.; Gao, L.F. Real-time continuous recognition of knee motion using multi-channel mechanomyography signals detected on clothes. J. Electromyogr. Kinesiol. 2018, 38, 94–102. [Google Scholar]
  9. Zhang, Y.; Cao, G.S.; Zhao, T.T.; Zhang, H.Y.; Zhang, J.T.; Xia, C.M. A pilot study of mechanomygraphy-based hand movements recognition emphasizing on the influence of fabrics between sensors and skin. J. Mech. Med. Biol. 2020, 20, 2050054. [Google Scholar] [CrossRef]
  10. Yu, J.; Zhang, Y.; Xia, C.M. Study of gait recognition based on fusion of mechanomyography and attitude angel signal. J. Mech. Med. Biol. 2020, 20, 1950085. [Google Scholar] [CrossRef]
  11. Zhang, H.Y.; Wang, X.P.; Zhang, Y.; Cao, G.S.; Xia, C.M. Design a wireless mechanomyography acquisition equipment and feature selection for lower limb motion recognition. Biomed. Signal Process. 2022, 77, 103679. [Google Scholar] [CrossRef]
  12. Bittibssi, T.M.; Zekry, A.H.; Genedy, M.A.; Maged, S.A. sEMG pattern recognition based on recurrent neural. Biomed. Signal Process. 2021, 70, 103048. [Google Scholar] [CrossRef]
  13. Chen, X.; Li, Y.; Hu, R.C. Hand gesture recognition based on surface electromyography using convolutional network with transfer learning method. IEEE J. Biomed. Health 2021, 25, 1292–1304. [Google Scholar] [CrossRef]
  14. Wang, Y.; Wu, Q.; Dey, N.; Fong, S.; Ashour, A.S. Deep back propagation-long short term-memory network based upper-limb sEMG signal classification for automated rehabilitation. Biocybern. Biomed. Eng. 2020, 40, 987–1001. [Google Scholar] [CrossRef]
  15. Karnam, N.K.; Turlapaty, A.C.; Dubey, S.R.; Gokaraju, B. Classification of sEMG signals of hand gestures based on energy features. Biomed. Signal Process. 2021, 70, 102948. [Google Scholar] [CrossRef]
  16. Veer, K. A technique for classification and decomposition of muscle signal for control of myoelectric prostheses based on wavelet statistical classifier. Measurement 2015, 60, 283–291. [Google Scholar] [CrossRef]
  17. Fatimah, B.; Singh, P.; Singhal, A.; Pachori, R.B. Hand movement recognition from sEMG signals using Fourier decomposition method. Biocyberne. Biomed. Eng. 2021, 41, 690–703. [Google Scholar] [CrossRef]
  18. Lv, Z.M.; Xiao, F.Y.; Wu, Z.; Liu, Z.S.; Wang, Y. Hand gesture recognition from surface electromyogram signal based on self-organizing mapping and radial basis function network. Biomed. Signal Process. 2021, 68, 102629. [Google Scholar] [CrossRef]
  19. Karheily, S.; Moukadem, A.; Courbot, J.B.; Adbeslam, D.O. sEMG time-frequency features for hand movements classification. Expert Syst. Appl. 2022, 210, 118282. [Google Scholar] [CrossRef]
  20. Tuncer, T.; Dogan, S.; Subasi, A. Surface EMG signal classification using ternary pattern and discrete wavelet transform based feature extraction for hand movement recognition. Biomed. Signal Process. 2020, 58, 101872. [Google Scholar] [CrossRef]
  21. Xiao, F.Y.; Yang, D.C.; Lv, Z.M.; Guo, X.H.; Luo, Z.S.; Wang, Y. Classification of hand movements using variational mode decomposition and composite permutation entropy index with surface electromyogram signals. Future Gener. Comput. Syst. 2020, 110, 1023–1036. [Google Scholar] [CrossRef]
  22. Gu, Y.; Yang, D.P.; Huang, Q.; Wang, W.; Liu, H. Robust EMG pattern recognition in the presence of confounding factors: Features, classifiers and adaptive learning. Expert Syst. Appl. 2018, 96, 208–217. [Google Scholar] [CrossRef]
  23. Sui, X.W.; Wan, K.X.; Zhang, Y. Pattern recognition of SEMG based on wavelet packet transform and improved SVM. Optik 2019, 176, 228–235. [Google Scholar] [CrossRef]
  24. Rostami, M.; Berahmand, K.; Nasiri, E.; Forouzandeh, S. Review of swarm intelligence-based feature selection methods. Eng. Appl. Artif. Intell. 2021, 100, 104210. [Google Scholar] [CrossRef]
  25. Dhal, P.; Azad, C. A multi-objective feature selection method using Newton’s law based on PSO with GWO. Appl. Soft Comput. 2021, 107, 107394. [Google Scholar] [CrossRef]
  26. Zhang, Y.; Xia, C.M. A preliminary study of classification of upper limb motions and forces based on mechanomyography. Med. Eng. Phys. 2020, 81, 97–104. [Google Scholar] [CrossRef] [PubMed]
  27. Wang, J.H.; Cao, D.G.; Wang, J.Q.; Liu, C.Y. Action recognition of lower limbs based on surface electromyography weighted feature method. Sensors 2021, 21, 6147. [Google Scholar] [CrossRef] [PubMed]
  28. Phinyomark, A.; Phukpattaranont, P.; Limsakul, C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
  29. Chen, Y.Z.; Zhou, Y.Q.; Cheng, X.L.; Fan, X.H.; Zhang, Y.W. Bispectrum-based sEMG multi-domain joint feature extraction for upper limb motion classification. Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci. 2016, 230, 248–258. [Google Scholar]
  30. Shi, J.; Cai, Y.; Zhu, J.; Zhong, J.; Wang, F. SEMG-based hand motion recognition using cumulative residual entropy and extreme learning machine. Med. Biol. Eng. Comput. 2013, 51, 417–427. [Google Scholar] [CrossRef] [PubMed]
  31. Braik, M.S. Chameleon swarm algorithm: A bio-inspired optimizer for solving engineering design problems. Expert Syst. Appl. 2021, 174, 114585. [Google Scholar] [CrossRef]
  32. Saremi, S.; Mirjalili, S.; Lewis, A. Grasshopper optimisation algorithm: Theory and application. Adv. Eng. Softw. 2017, 105, 30–47. [Google Scholar] [CrossRef] [Green Version]
  33. Khomami, S.A.; Shamekhi, S. Persian sign language recognition using IMU and surface EMG sensors. Measurement 2021, 168, 108471. [Google Scholar] [CrossRef]
  34. Wang, C.Y.; Li, X.N.; Guo, Y.; Zhang, R.X.; Chen, W.Y. Classification of human movements with and without spinal orthosis based on surface electromyogram signals. Med. Nov. Technol. Devices 2022, 16, 100165. [Google Scholar] [CrossRef]
  35. Daniel, N.; Sybilski, K.; Kaczmarek, W.; Siemiaszko, D.; Malachowski, J. Relationship between EMG and fNIRS during Dynamic Movements. Sensors 2023, 23, 5004. [Google Scholar] [CrossRef] [PubMed]
  36. Liu, J.; Wang, C.; He, B.; Li, P.; Wu, X. Metric learning for robust gait phase recognition for a lower limb exoskeleton robot based on sEMG. IEEE Trans. Med. Robot. Bionics 2022, 4, 472–479. [Google Scholar] [CrossRef]
  37. Wu, Q.; Shao, J.K.; Wu, X.H.; Zhou, Y.J.; Liu, F.P.; Xiao, F. Upper limb motion recognition based on LLE-ELM method of sEMG. Int. J. Pattern Recogn. 2017, 31, 1750018. [Google Scholar] [CrossRef]
  38. Fariman, H.J.; Ahmad, S.A.; Marhaban, M.H.; Ghasab, M.A.; Chappell, P.H. Hand movements classification for myoelectric control system using adaptive resonance theory. Australas. Phys. Eng. Sci. Med. 2016, 39, 85–102. [Google Scholar] [CrossRef]
  39. Mendes Junior, J.J.A.; Freitas, M.L.B.; Siqueira, H.V.; Lazzaretti, A.E.; Pichorim, S.F.; Stevan, S.L., Jr. Feature selection and dimensionality reduction: An extensive comparison in hand gesture classification by sEMG in eight channels armband approach. Biomed. Signal Process. 2020, 59, 101920. [Google Scholar] [CrossRef]
  40. Rivela, D.; Scannella, A.; Pavan, E.E.; Frigo, C.A.; Belluco, P.; Gini, G. Analysis and comparison of features and algorithms to classify shoulder movements from sEMG signals. IEEE Sens. J. 2018, 18, 3714–3721. [Google Scholar] [CrossRef]
Figure 1. Acquisition system with 4 channels.
Figure 1. Acquisition system with 4 channels.
Sensors 23 06939 g001
Figure 2. (a). Four classes of knee and ankle movement in the sitting position. (b). Four classes of knee and ankle movement in the standing position.
Figure 2. (a). Four classes of knee and ankle movement in the sitting position. (b). Four classes of knee and ankle movement in the standing position.
Sensors 23 06939 g002
Figure 3. MMG signals with filtering and normalization.
Figure 3. MMG signals with filtering and normalization.
Sensors 23 06939 g003
Figure 4. Four-channel MMG of one ankle dorsiflexion motion.
Figure 4. Four-channel MMG of one ankle dorsiflexion motion.
Sensors 23 06939 g004
Figure 5. Flow chart of feature selection based on swarm intelligence algorithms.
Figure 5. Flow chart of feature selection based on swarm intelligence algorithms.
Sensors 23 06939 g005
Figure 6. Classification accuracy (%) of four-class movements and time consumption (s) of feature selection (sitting situation).
Figure 6. Classification accuracy (%) of four-class movements and time consumption (s) of feature selection (sitting situation).
Sensors 23 06939 g006
Figure 7. Classification accuracy (%) of four-class movements and time consumption (s) of feature selection (standing situation).
Figure 7. Classification accuracy (%) of four-class movements and time consumption (s) of feature selection (standing situation).
Sensors 23 06939 g007
Figure 8. (a). Recognition rate obtained from 3-channel MMG (sitting, CSA). (b). Recognition rate obtained from 3-channel MMG (sitting, GOA).
Figure 8. (a). Recognition rate obtained from 3-channel MMG (sitting, CSA). (b). Recognition rate obtained from 3-channel MMG (sitting, GOA).
Sensors 23 06939 g008
Figure 9. (a). Recognition rate obtained from 3-channel MMG (standing, CSA). (b). Recognition rate obtained from 3-channel MMG (standing, GOA).
Figure 9. (a). Recognition rate obtained from 3-channel MMG (standing, CSA). (b). Recognition rate obtained from 3-channel MMG (standing, GOA).
Sensors 23 06939 g009
Figure 10. Classification accuracy and number of selected features (sitting).
Figure 10. Classification accuracy and number of selected features (sitting).
Sensors 23 06939 g010
Figure 11. Classification accuracy and number of selected features (standing).
Figure 11. Classification accuracy and number of selected features (standing).
Sensors 23 06939 g011
Table 1. Formula of the transfer function.
Table 1. Formula of the transfer function.
NameFormulationNameFormulation
S1 1 1 + e x V1 tanh ( x )
S2 1 1 + e 2 x V2 x 1 + x 2
S3 1 1 + e ( x / 2 )
Table 2. Confusion matrix of movements based on CSA-feature selection (sitting).
Table 2. Confusion matrix of movements based on CSA-feature selection (sitting).
TargetedPredicted Motion
MotionKE1KF1AD1AP1
KE185.217.122.545.13
KF17.6185.394.852.12
AD13.763.9791.072.20
AP12.572.572.2290.60
Table 3. Confusion matrix of movements based on CSA-feature selection (standing).
Table 3. Confusion matrix of movements based on CSA-feature selection (standing).
TargetedPredicted Motion
MotionKE2KF2AD2AP2
KE288.267.482.781.48
KF28.4086.552.013.04
AD24.103.5990.242.07
AP23.073.071.9193.35
Table 4. Recognition rates of each movements in sitting situation (CSA).
Table 4. Recognition rates of each movements in sitting situation (CSA).
0.30.350.40.450.50.550.6
KE184.3384.0185.6985.6984.8285.5183.75
KF185.3986.5886.3886.2384.3183.7584.01
AD193.5991.6991.1990.4090.7590.1891.52
AP190.4090.4390.2189.8690.6289.4387.90
Table 5. Recognition rates of each movements in sitting situation (GOA).
Table 5. Recognition rates of each movements in sitting situation (GOA).
0.30.350.40.450.50.550.6
KE183.0681.9081.8781.1177.2873.3064.84
KF185.0484.6583.9883.5678.8574.7661.94
AD190.7690.8389.1486.4784.5675.8967.80
AP187.8387.9487.7485.4281.8474.6863.91
Table 6. Recognition rates of each movements in standing situation (CSA).
Table 6. Recognition rates of each movements in standing situation (CSA).
0.30.350.40.450.50.550.6
KE287.8087.2785.6287.3886.4586.5085.41
KF287.5686.7288.0287.4487.5787.1185.70
AD290.0889.4791.0290.0089.6390.2789.72
AP293.0994.0592.2092.7093.5493.4492.28
Table 7. The recognition rates of each movements in standing situation (GOA).
Table 7. The recognition rates of each movements in standing situation (GOA).
0.30.350.40.450.50.550.6
KE288.0887.4186.3483.9581.1676.3866.19
KF286.1186.1984.2383.4481.1073.9466.54
AD290.6589.5689.5088.4288.8385.0572.36
AP292.9592.7992.4792.4088.9785.8374.79
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, Y.; Sun, M.; Xia, C.; Zhou, J.; Cao, G.; Wu, Q. Mechanomyography Signal Pattern Recognition of Knee and Ankle Movements Using Swarm Intelligence Algorithm-Based Feature Selection Methods. Sensors 2023, 23, 6939. https://doi.org/10.3390/s23156939

AMA Style

Zhang Y, Sun M, Xia C, Zhou J, Cao G, Wu Q. Mechanomyography Signal Pattern Recognition of Knee and Ankle Movements Using Swarm Intelligence Algorithm-Based Feature Selection Methods. Sensors. 2023; 23(15):6939. https://doi.org/10.3390/s23156939

Chicago/Turabian Style

Zhang, Yue, Maoxun Sun, Chunming Xia, Jie Zhou, Gangsheng Cao, and Qing Wu. 2023. "Mechanomyography Signal Pattern Recognition of Knee and Ankle Movements Using Swarm Intelligence Algorithm-Based Feature Selection Methods" Sensors 23, no. 15: 6939. https://doi.org/10.3390/s23156939

APA Style

Zhang, Y., Sun, M., Xia, C., Zhou, J., Cao, G., & Wu, Q. (2023). Mechanomyography Signal Pattern Recognition of Knee and Ankle Movements Using Swarm Intelligence Algorithm-Based Feature Selection Methods. Sensors, 23(15), 6939. https://doi.org/10.3390/s23156939

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop