Next Article in Journal
Chitosan Microparticles Loaded with New Non-Cytotoxic Isoniazid Derivatives for the Treatment of Tuberculosis: In Vitro and In Vivo Studies
Previous Article in Journal
Preparations and Properties of Ionic Liquid-Assisted Electrospun Biodegradable Polymer Fibers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design of Fuzzy Logic Motion Detection Algorithm for the Bracelet Type Sensor Consisting of Conductive Layer-Polymer Composite Film

Department of Mechanical & Automotive Engineering, Youngsan University, Junam-ro 288, Yangsan-si 48015, Korea
Polymers 2022, 14(12), 2309; https://doi.org/10.3390/polym14122309
Submission received: 2 May 2022 / Revised: 31 May 2022 / Accepted: 3 June 2022 / Published: 7 June 2022
(This article belongs to the Section Polymer Applications)

Abstract

:
To improve the motion detection performance of a bracelet-type sensor that uses only two tiny sensor modules developed using carbon-based conductive polymer composite films, a fuzzy-logic algorithm was developed in this study. A polyethylene terephthalate polymer film with a conductive layer composed of carbon paste was used as the integral material utilized for the composite film; a small sensor module composed of mechanical parts mounted on the film was developed to effectively detect the surface resistance variations of the film. A participant wore a bracelet sensor, which consisted of two sensor modules, on their forearm, and the resistance variations of the contact area between the forearm and the sensor modules corresponding to the flexion changes of the surface of the body due to muscle contraction and relaxation were detected. The surface resistance variations of the film were converted to voltage signals, which were used as inputs to the fuzzy logic algorithm to detect four consecutive motions of the forearm. The results demonstrated that the fuzzy-logic algorithm attained an accuracy of 94%. The fuzzy algorithm successfully detected four motions and the resting state of the forearms; moreover, it showed improved performance compared to previous research.

1. Introduction

Recently, wearable devices have been applied in numerous fields because they enable the use of physiological and internally and externally produced information in real-time.
One of the important technologies in wearable devices involves the detection of human movement intention [1], which enables a variety of applications, such as prosthetic device control, sports, entertainment, and various creative applications, by connecting with the Internet of Things (IoT). Therefore, a variety of sensors have been utilized to develop effective wearable sensors. The conventional method is to use a patch type electrode attached on the skin to measure the body’s surface electromyography (sEMG) signals. The sEMG supplied the overall synergistic activity data of a set of muscular units for quantitative analysis to detect the intention of movement. However, the noises caused by the movements of other muscles and the effects inside and outside the body, such as muscle fatigue and changes in attachment position disturb the effective detection of body movement. Therefore, signal processing techniques are required to extract useful signals from the sEMG. Moreover, sEMG measurement requires multiple electrodes attached to the surface of the body because at least three electrodes must be attached; among which, two electrodes are for differential amplification and one for the ground. Owing to the requirement of multiple electrodes in sEMG measurement, bracelet-type sensors using sEMG have restrictions in terms of size reduction and are therefore fabricated in the shape of a wide armband [2,3,4].
To overcome these inconveniences of using sEMGs, researchers have been developing wearable sensor systems to detect the motion intention of the body without using sEMG signals. Most studies have used commercially available sensors such as strain gauges [5], tactile sensors [6,7,8,9,10], and acceleration sensors [11,12] to develop sensor systems that can detect human movement.
There have been studies on the development of sensor materials that can be applied to wearable sensors. A strain gauge element with a specific pattern was fabricated for movement detection and strain measurement [13,14,15]. To develop an elastic strain gauge sensor, researchers have used liquid-phase metals [16,17,18,19,20] and force sensors to detect the expansion pressure by muscle contraction to detect the movement intention [21,22]. Several types of sustainable composite materials of self-sufficient power sources exist, converting energy from the environment into electrical energy. An example of such materials is triboelectric composite materials, which are suitable for wearable sensor applications. Triboelectric materials show good response under high-frequency stimuli [23]. Therefore, they have been used for developing acceleration sensors to detect different motions, such as sitting, standing, and walking [24]; they have also been used as energy harvesting nanogenerator from body movements corresponding to high-frequency stimuli [25].
Studies on the development of band-type sensors using commercial or developed sensor elements have been reported. Commercial pressure and inertial sensors have been applied to detect hand gestures and the arm and leg motions, respectively [11,12]. An ionic liquid-based fluidic strain sensor was developed and worn on a leg and fingers to detect movements [26]. A flexible optical pressure sensor was developed and worn on index finger to detect flexion and extension of it [27].
In a previous study, a thin bracelet-type wearable sensor module, which uses a carbon-based conductive layer-polymer composite film to detect the movement intention of the human body, was developed; a comprehensive study was conducted to verify the sensor performance as a wearable sensor [28]. The integral material utilized for the composite film is 0.1 mm thick PET (polyethylene terephthalate) polymer film with a conductive layer made using a carbon paste and the heat press process, which is sufficiently flexible to detect the changes in the resistance corresponding to the flexion changes of the body surface due to muscle contraction and relaxation. The detailed fabrication procedure for the composite films can be found in ref. [28]. Figure 1 shows the mechanism of surface resistance variation of the polymer film. The width changes in the fine (<10 μm) crack gaps in the conductive layer play a key role in the surface resistance variations corresponding to the bending motion of the film, which was investigated in ref. [29]. As shown in Figure 1a, the sliding movement of the mechanical parts holding each tip of the film occurs owing to the contraction and extension of the inner muscles of the contact area, which causes the bending motion of the film (state A). When the film was bent, tensile stress was applied to the conductive layer of the film, and the width of the crack gaps increased, resulting in an increase in surface resistance (Figure 1b). When the film returned to state B, the cracks closed, decreasing the surface resistance (Figure 1c). A detailed explanation of the relationship between the variation in crack gaps and surface resistance variation with the images of generated cracks can be found in refs. [28,29].
The fabricated film was cut into pieces of dimensions 2 (w) × 18 (l) (mm). Because the thin film is easily damaged by the surrounding effects, a mechanical module that protects the film from environmental effects and guides its bending action without degradation of the conductive layer was developed, and the film was mounted on the module. Figure 2a,b shows the structure and fabricated image of the sensor module comprising the two connected parts. The distance between each part of the module increases or decreases during the sliding motion, where the moving distance (x mm in Figure 2b) is limited from 0 to 3 mm. When the distance between two parts is 0 mm, the dimensions of a mechanical module are 12.0 (w) × 30.5 (l) × 5.0 mm (h). Corresponding to the flexion changes of the contacting surface of the body, the mechanical module converts its stretching and shrinking motions to the bending motion of the mounted film. In addition, the mechanical module limits the application of an excessive compressive force on the conductive layer of the film because the compressive force degrades the conductive layer, resulting in a decrease in the reproducibility of the sensor. In previous research, compressive forces caused more severe degradation of the surface conductive layer compared to the tensile forces. A detailed explanation of the conductive layer degradation mechanism under compressive and tensile forces can be found in [29]. To fabricate the bracelet-type sensor, two sensor modules were connected to each other using a flexible bend with a width of 9 mm and worn on the forearm. Figure 2c shows the variation in resistance owing to the sliding movement of the mechanical parts in the module and the worn image of the bracelet-type sensor. The variations in the surface resistance measured by the bracelet sensor are converted into voltage signals through a transducer circuit, and they are measured to detect the motions of the forearm. A more detailed explanation of the fabrication method of the film and bracelet sensors is provided in ref. [28].
The developed sensor system had several advantages. First, a single, thin bracelet-type sensor can be worn around the forearm instead of the conventional patch sensors used in the sEMG method, which would cover most parts of the forearm. As a result, compared to the conventional sEMG technique, the developed sensor enables a reduction in the number of sensors contacting the skin surface by more than 70%. Therefore, the proposed sensor should be comfortable in terms of wearability and practical for various applications. Second, conductive paste and PET film, which are easier to handle and more cost effective than other approaches that use carbon materials such as CNTs [30,31,32,33,34] are the materials used in this study. Finally, because a highly sensitive signal is produced by the simple bending motion of the polymer film, the proposed method has a wide application area with various types of mechanical guides in wearable sensor technology to detect body movements.
Although the developed bracelet sensor shows promising performance, there are drawbacks that must be improved before practical use. In the previous study, a simple algorithm, comprising of ‘if and else’ statements, was used and a motion detection test for four motions of the forearm was conducted for a single motion at a time. However, wearable sensors should be able to detect a variety of motions occurring continuously in real applications. Therefore, further research to develop improved algorithms should be conducted to detect various consecutive motions over a long period of time.
To improve motion detection performance, the algorithm should be able to classify the complex and nonlinear signals generated from the complex structure of the human body. Fuzzy logic is extensively used in the motion-detection technique [35,36,37,38,39,40,41].
In this study, a fuzzy logic algorithm was developed to detect four motions of the forearm, wrist extension, ulnar deviation, finger flexion, and wrist flexion, and the performance verification of the algorithm focuses on the detection of the consecutive motions. Moreover, it is possible to decrease the number of sensor modules in the bracelet sensor when the designed fuzzy logic algorithm is applied, resulting in a simplified structure of the bracelet sensor. In a previous study, the performance of a bracelet sensor using two and three sensor modules was compared, and the bracelet sensor with three sensor modules showed better performance [28]. However, in this study, a bracelet sensor with two sensor modules was used with the fuzzy motion detection algorithm. In the experiment, the detection performance of 24 combinations of four consecutive motions was conducted, and it showed excellent performance in detection of a single motion as well as in the detection of consecutive motions.

2. Experimental Setup

In this study, the same experimental procedure as that used in [28] was applied. However, the bracelet sensor used in this study consists of only two sensor modules. Figure 2 shows the structure and an image of the fabricated sensor. The fabricated sensor module had sufficient sensitivity to detect even smaller flexion variations on the surface of the human body. A graph showing the sensitivity of the resistance variations of the composite film corresponding to the stretched length of each module, which is represented by x (mm) in Figure 2b, can be found in [28]. In addition, the reproducibility and repeatability data during 120 bending cycles, where each cycle consisted of 11 bending motions below 90°, can be found in [29]. To detect the four motions of the forearm, wrist extension, ulnar deviation, finger flexion, and wrist flexion shown in Figure 3, the bracelet sensor was worn such that the two sensor modules contacted the surface of the forearm muscle groups: extensor carpi ulnaris and flexor carpi ulnaris.
As shown in Figure 2c, the sensor module stretches in the longitudinal direction and the conductive layer resistance decreases when the muscles contract, resulting in skin protrusion. Conversely, the sensor module contracts in the longitudinal direction, and the resistance of the conductive layer increases when the muscles expand, resulting in depression of the skin surface.
Because the band connecting the two mechanical parts in the sensor module (band A, Figure 2a) exhibits lower elasticity than the band connecting the sensor modules (band B, Figure 2a), the protrusions and depressions can be effectively detected by the sensor module.
Figure 4a shows the data acquisition procedure for detecting the forearm motion using the fuzzy logic algorithm, and Figure 4b shows the transducer circuit.
The present study only uses two sensor modules comprising a bracelet sensor developed to measure the signals generated by the four motions. However, the conventional sEMG method to detect the movement of the body requires two electrodes to be attached on each muscle group to measure the charge of sEMG signals; therefore, nine electrodes, including one ground electrode, are required to be attached to detect the four motions of the forearm, on the locations of the muscle group, which govern each motion.
Figure 4b shows the transducer circuit, which consists of a bridge circuit and differential amplifier IC (INA114) for each module to convert the surface resistance variations to voltage signals. A 50-KΩ RG is used to obtain amplification by a factor of 50. The signals transmitted by each sensor module on the upper arm were collected using an NI-DAQ with a sampling frequency of 1 kHz. In this study, 0.1-μF capacitors were used to remove high-frequency noises.
The signal was measured for 30 s. During the first 5 s of data collection for each movement, the forearm rested on the table without any movement. Subsequently, four consecutive motions were performed, where each motion was maintained for approximately 5 s, after which a resting state was maintained for the remaining 5 s. During all the combinations of the four motions, a total of 24 data sets of the measured signals were gathered. All movements were performed at a constant speed throughout the entire range of motion of the joint.
The measured datasets were loaded into MATLAB, and motion detection was conducted using the designed fuzzy logic algorithm. Although the developed sensor exhibited good performance, as proven by previous studies, it was difficult to acquire constant signals for the same motion owing to variations in factors such as muscle fatigue, strength, and speed of motion. Therefore, the fuzzy rules in the algorithm were adjusted for each motion set to obtain the optimal result.

3. Design of Fuzzy Logic Motion Detection Algorithm

A fuzzy logic system generally consists of three-step data processing: fuzzification, rule evaluation, and defuzzification. First, the fuzzification phase converts the measured data from the two sensor modules into fuzzy data with the names (HighN, LowN, Off, Low, Med, High in Figure 5b) and weight from zero to one. This process is conducted using the input membership function. Second, the rule evaluation phase uses the ‘ifthen’ conditional statement relating the fuzzy values from the input membership function to the level of outputs in Table 1. Third, the defuzzification process estimates the motion of the forearm using the weights of all active rules (with nonzero weights generated by the input triangular functions (f1–f10 in Figure 5) and the center values. All fuzzy logic processes were conducted using MATLAB (Ver. R2019a).

3.1. Fuzzification

Through the fuzzification process, the mean of every five measured data points from modules 1 and 2 located on two muscle groups, extensor carpi ulnaris and flexor carpi ulnaris, are sequentially reclassified into weighted fuzzy data using the input membership function. Figure 5a shows the measured data from modules 1 and 2, while four consecutive motions of the forearm, wrist extension, ulnar deviation, finger flexion, and wrist extension were performed, where each motion was maintained for approximately 5 s. Figure 5b shows the input membership function, where XN is the mean of all the negative data values appearing during the wrist extension motion, marked as P1 in Figure 5a. XP is the mean of the positive data that appears during the other three motions, marked as P2 in Figure 5a. The XO is the mean of the data measured during the resting state. During the fuzzification process, two input membership functions are used for each data point. The membership functions comprise trigonometric functions consisting of six names (HighN, LowN, Off, Low, Med, and High) according to the input range, and each waveform is configured to have a 50% overlap. In each fuzzification step, the means of five datasets from modules 1 and 2 are classified as names corresponding to the range where the data belong, and each name has a weight value ranging from zero to one. Because two trigonometric functions overlap in the range between the boundaries (b1 and b2 in Figure 5b) on the x-axis, the two names have weight values, while the other four names have ‘0’ weight values. Depending on where the data belong, the data exceeding the boundaries, the name of the fuzzy data is either ‘HighN’ or ‘High’, and the weight of name is fixed as ‘1’, and other five names have ‘0’ weight values.
Algorithm 1 shows the MATLAB code algorithm used to realize fuzzification using the input membership function in Figure 5b. Because the code generates six fuzzy names and their own weights from the signal measured by a single module, 12 fuzzy values with each name and weight are generated in every fuzzification step.
Algorithm 1. Fuzzification algorithm for signals from modules 1 and 2.
If   Mean of 5 data from Modulek > X O + 3 X P 2      Then
    HighN = 0, LowN = 0, Off = 0, Low = 0, Med = 0, High = 1
Else if X P < Mean of 5 data from Modulek X O + 3 X P 2   Then
    Calculate the weight of Med and High by using f2 and f1 in Figure 5b
    HighN = 0, LowN = 0, Off = 0, Low = 0
Else if X O + X P 2 < Mean of 5 data from Modulek X P    Then
    Calculate the weight of Low and Med by using f4 and f3 in Figure 5b
    HighN = 0, LowN = 0, Off = 0, High = 0
Else if X O < Mean of 5 data from Modulek X O + X P 2    Then
    Calculate the weight of Off and Low by using f6 and f5 in Figure 5b
    HighN = 0, LowN = 0, Med = 0, High = 0
Else if X N   < Mean of 5 data from Modulek X O      Then
    Calculate the weight of LowN and Off by using f8 and f7 in Figure 5b
    HighN = 0, Low = 0, Med = 0, High = 0
Else if 3 X N X O 2   < Mean of 5 data from Modulek X N      Then
    Calculate the weight of HighN and LowN by using f10 and f9 in Figure 5b
    Off = 0, Low = 0, Med = 0, High = 0
Else  HighN = 1, LowN = 0, Off = 0, Low = 0, Med = 0, High = 0
end
(Module number: k = 1, 2)

3.2. Rule Evaluation

In the rule evaluation step, the names of the fuzzy values were used as inputs to the fuzzy rules to classify the forearm movements. The rules consist of conditional statements, such as ‘if {the fuzzy name (weight value) of the signal from module 1 and the fuzzy name (weight value) of the signal from module 2} then {(the strength of wrist extension motion is …), (the strength of ulnar deviation motion is …), (the strength of finger flexion motion is …), and (the strength of wrist flexion motion is …)}’. In this study, fuzzy rules were designed, where each rule determines the strength of each motion corresponding to the combinations of fuzzy names generated in the fuzzification process. Because the two signals from modules 1 and 2 generated a six-name the fuzzy state in every step, a total of 36 combinations of fuzzy rules were developed. Note that the strength of each motion in the fuzzy rules is determined only by the fuzzy names. The weight values corresponding to each fuzzy name are used in the defuzzification process. Table 1 shows an example of fuzzy rules.

3.3. Defuzzification

In the defuzzification step, the final defuzzification value for each motion is calculated. Because there are fuzzy names with zero weights, the only rules for which none of the fuzzy weight values correspond to the two fuzzy names for each module1 and 2 are zero are activated and used in the calculation of the final strength of each motion. The activated rules are categorized into five data sets, each consisting of three data columns: two columns for the weights of fuzzy names and one for the strengths of each motion in Table 1. The final strength of each motion is calculated using Equation (1) in each data set.
x = i = 1 n u m b e r   o f   a c t i v a t e d   r u l e s m i × w i i = 1 n u m b e r   o f   a c t i v a t e d   r u l e s m i  
In Equation (1), x is the defuzzification value of a motion, and m is the output of the activated rules, that is, the minimum non-zero weight of the fuzzy names in the activated rules. w is the center value; two, one, and 0.5 correspond to the strengths of motions ‘Highmotion’, ‘Medmotion’, and ‘Lowmotion’, respectively, as shown in the Table 1.
Algorithm 2 shows the MATLAB code algorithm to realize rule evaluation and defuzzification using Equation (1). The algorithm calculated all the defuzzification values of the four motions, and the motion with the maximum value was selected as the final motion of the forearm.
Algorithm 2. Rule evaluation and defuzzification algorithm to detect the four motions: wrist extension, ulnar deviation, finger flexion, and wrist flexion.
1. Acquiring fuzzy values consisting of names and weights from the modules 1 and 2
   Module 1: HighN1(weight), LowN1(weight), Off1(weight), Low1(weight), Med1(weight), High1(weight)
  Module 2: HighN2(weight), LowN2(weight), Off2(weight), Low2(weight), Med2(weight), High2(weight)
2. Defuzzification process using (1)
(1) Calculation of numerator in (1):
  WEnum = MIN (HighN1, HighN2)Rule1 × Highmotion(=2) + ···
       + MIN (Low1, Off2)Rule21 × Lowmotion(=0.5) + ··· + MIN (High1, High2)Rule36 × Lowmotion(=0.5)
  UDnum = MIN (HighN1, HighN2)Rule1 × Lowmotion(=0.5) + ···
       + MIN (Low1, Off2)Rule21 × Highmotion(=1) + ··· + MIN (High1, High2)Rule36 × Lowmotion(=0.5)
  FFnum = MIN (HighN1, HighN2)Rule1 × Lowmotion(=0.5) + ···
       + MIN (Low1, Off2)Rule21 × Lowmotion(=1) + ··· + MIN (High1, High2)Rule36 × Lowmotion(=0.5)
  WFnum = MIN (HighN1, HighN2)Rule1 × Lowmotion(=0.5) + ···
       + MIN (Low1, Off2)Rule21 × Lowmotion(=0.5) + ··· + MIN (High1, High2)Rule36 × Highmotion(=0.5)
  OSnum = MIN (HighN1, HighN2)Rule1 × Lowmotion(=0.5) + ···
       + MIN (Low1, Off2)Rule21 × Medmotion(=0.5) + ··· + MIN (High1, High2)Rule36 × Lowmotion(=2)
(2) Calculation of denominator in (1):
  WEden = MIN (HighN1, HighN2)Rule1 + ··· + MIN (Low1, Off2)Rule21 + ··· + MIN (High1, High2)Rule36
  UDden = MIN (HighN1, HighN2)Rule1 + ··· + MIN (Low1, Off2)Rule21 + ··· + MIN (High1, High2)Rule36
  FFden = MIN (HighN1, HighN2)Rule1 + ··· + MIN (Low1, Off2)Rule21 + ··· + MIN (High1, High2)Rule36
  WFden = MIN (HighN1, HighN2)Rule1 + ··· + MIN (Low1, Off2)Rule21 + ··· + MIN (High1, High2)Rule36
  OSden = MIN (HighN1, HighN2)Rule1 + ··· + MIN (Low1, Off2)Rule21 + ··· + MIN (High1, High2)Rule36
(3) Calculation of defuzzification vlaues for each motion:
  Defuzzification value for wrist extension = WEnum/WEden = α
  Defuzzification value for wrist extension = UDnum/UDden = β
  Defuzzification value for ulnar deviation = FFnum/FFden = γ
  Defuzzification value for finger flexion = WFnum/WFden = δ
  Defuzzification value for wrist flexion = OSnum/OSden = ε
(4) Decision of the motion of forearm:
  The motion of forearm = MAX[α β γ δ ε]

4. Results and Discussion

Figure 6 shows the detected result of 24 sets of motions consisting of all the combinations of the four motions using the measured signals and fuzzy algorithm.
The intention of the motions is expressed using the points on the graph as follows: ‘1’ for off state, ‘2’ for wrist extension, ‘3’ for ulnar deviation, ‘4’ for finger flexion, and ‘5’ for wrist flexion.
The results show that the fuzzy algorithm effectively detects all consecutive motions of the forearm. However, some failures occurred while detecting these motions. All detection failures occurred when the motion was changed from wrist extension to ulnar deviation, as shown in Figure 6 (18), (20), and (22). The red circles in Figure 6 indicate the locations where detection failures occurred. Table 2 shows the accuracy rate of each motion where Accuracy rate1 and Accuracy rate2 represent the success percentiles of motion detection with and without including the three detection failure cases, respectively.
These results show that, when the developed fuzzy logic algorithm was applied on the motion detection of ‘wrist extension’ and ‘ulnar deviation’ motions, approximately 100% detection accuracies were obtained as shown in the second row in Table 2. In addition, the detection accuracies of the ‘off state’ were approximately 100%. Moreover, the detection accuracies of ‘finger flexion’ and ‘wrist flexion’ motions were close to 90%, which was similar or higher than the accuracy rates of other studies that applied neural networks and fuzzy logic using sEMG [3,4,36,37,39,42]. To adjust the connection strength within the internal network, the neural network theory, which is a learning approach based on repetition, must be conducted in advance. In general, as the number of learning iterations increases, the error between the command signal and the actual movement decreases; here, the final mean accuracy rates were close to 95% [3,4,36,37].
The advantages of the developed sensor are as follows. First, the patch sensors used in the sEMG method, which would cover most parts of the forearm, were substituted with a single thin bracelet-type sensor that could be worn around the forearm. As a result, compared to the conventional sEMG technique, the number of sensors in contact with the skin surface was reduced by more than 70%. Second, the developed bracelet sensor has the thinnest size compared to other band type sensors that were reported [3,6,11,12,22,23,24,43] because the width of the module, which is the largest width of the sensor, is only 12 mm, with a thickness of 5 mm. Therefore, the proposed device should be comfortable to wear and easy to use in practical applications. Third, the key materials of the sensor are PET film and conductive carbon paste, which enable low-cost fabrication compared to other sensors using CNTs [30,31,32,33,34]. Although the thin PET film is fragile, it was safely bent under the guidance of the mechanical parts of the sensor module by avoiding excessive compressive forces due to undesirable bending motions, such as opposite directional bending, folding, and twisting. Moreover, the convenience of handling of the PET film and carbon paste makes it possible to fabricate smaller sensors. Finally, because the simple bending motion of the polymer film produces a signal with high sensitivity, the proposed method has promising applications in wearable sensor technology for detecting body movements. They can also be widely applied to various types of mechanical guides.
Although the developed bracelet sensor exhibited promising performance, there are some drawbacks that must be improved before it can be practically applied. In this study, two sensor modules were placed on the surface area of the forearm muscle groups: extensor carpi ulnaris and flexor carpi ulnaris. If the location of the sensor module varies, the pattern of the signals will vary, resulting in a decrease in the efficiency of motion detection. Therefore, future research will focus on the investigation of techniques to produce constant performance without considering the location of the sensor modules of the bracelet sensor, such as the recognition of the shape variation of the entire forearm circumference, where the sensor is placed by using multiple sensor modules. In addition, the transducer circuit will be integrated into the bracelet sensor with a more downsized sensor module design.

5. Conclusions

This study developed a fuzzy logic algorithm to detect the four motions of the forearm using the signals from the bracelet sensor, which was developed in a previous study [25]. The fuzzy algorithm successfully detected four motions and the resting state of the forearms. Compared with the results of previous research, two issues were improved in this study. First, herein, two sensor modules were used, which showed successful results in detecting motions of the forearm, whereas, in the previous research, the bracelet sensor with three sensor modules detected the motion more effectively. Second, in this research, 24 cases of four consecutive motions of the forearm were detected using the designed fuzzy logic algorithm, whereas, in the previous research, the motion detection experiment was conducted only for each separate motion. Although the overall accuracy rate was 94%, the accuracy rates for the resting state, wrist extension, and ulnar deviation were approximately 100%. However, detection failure was observed in three cases, as shown in Figure 6 (18), (20), and (22), because the relative variation in the surface area in contact with the sensor module is very small, whereas the forearm changed its motion from wrist extension to ulnar deviation.
The developed bracelet sensor and motion detection algorithm provided more comfortable wearing and ease of practical use. Future work will be conducted to overcome the drawbacks observed during the study and to apply it for practical use.

Funding

This work was supported by the Basic Science Research Program of the National Research Foundation (NRF) of Korea (No. 2021R1F1A1062782).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Xie, H.; Tao, X.; Ye, H.; Lu, J. WeCare: An intelligent badge for elderly danger detection and alert. In Proceedings of the International Conference Ubiquitous Intelligence & Computing, Vietri sul Mare, Italy, 18–21 December 2013. [Google Scholar] [CrossRef]
  2. Arozi, M.; Ariyanto, M.; Kristianto, A.; Setiawan, J.D. EMG signal processing of Myo armband sensor for prosthetic hand input using RMS and ANFIS. In Proceedings of the 7th International Conference on Information Technology, Computer, and Electrical Engineering, Semarang, Indonesia, 24–25 September 2020. [Google Scholar]
  3. Wang, M.; Bulger, M.; Dai, Y.; Noël, K.; Axon, C.; Brandenberger, A.; Fay, S.; Gao, Z.; Gilmer, S.; Hamdan, J.; et al. A 3D-Printed, adjustable armband for electromyography-based finger movement classification with haptic feedback. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Toronto, ON, Canada, 11–14 October 2020. [Google Scholar]
  4. Gue, W.; Sheng, X.; Liu, J.; Hua, L.; Zhang, D.; Zhu, X. Towards zero training for myoelectric control based on a wearable wireless sEMG armband. In Proceedings of the IEEE International Conference on Advanced Intelligent Mechatronics, Busan, Korea, 7–11 July 2015. [Google Scholar]
  5. Zizoua, C.; Raison, M.; Boukhenous, S.; Attari, M.; Achiche, S. Development of a bracelet with strain-gauge matrix for movement intention identification in traumatic amputees. IEEE Sens. J. 2017, 17, 2464–2471. [Google Scholar] [CrossRef]
  6. Honda, Y.; Weber, S.; Lueth, T.C. Intelligent recognition system for hand gestures. In Proceedings of the 3rd International IEEE/EMBS Conference on Neural Engineering, Kohala Coast, HI, USA, 2–5 May 2007. [Google Scholar]
  7. Kõiva, R.; Riedenklau, E.; Viegas, C.; Castellini, C. Shape conformable high spatial resolution tactile bracelet for detecting hand and wrist activity. In Proceedings of the International Conference on Rehabilitation Robotics (ICORR), Singapore, 11–14 August 2015. [Google Scholar] [CrossRef] [Green Version]
  8. Luo, W.; Sharma, V.; Young, D.J. A paper-based flexible tactile sensor array for low-cost wearable human health monitoring. J. Microelectromech. Syst. 2020, 29, 825–831. [Google Scholar] [CrossRef]
  9. Shao, Y.; Hu, H.; Visell, Y. A wearable tactile sensor array for large area remote vibration sensing in the hand. IEEE Sens. J. 2020, 20, 6612–6623. [Google Scholar] [CrossRef] [Green Version]
  10. Castellini, C.; Kõiva, R. Using a high spatial resolution tactile sensor for intention detection. In Proceedings of the 13th International Conference on Rehabilitation Robotics (ICORR), Seattle, WA, USA, 24–26 June 2013. [Google Scholar] [CrossRef] [Green Version]
  11. Liu, S.Q.; Zhang, J.C.; Zhu, R. A wearable human motion tracking device using micro flow sensor incorporating a micro accelerometer. IEEE Trans. Biomed. Eng. 2020, 67, 940–948. [Google Scholar] [CrossRef] [PubMed]
  12. Liu, S.Q.; Zhang, J.C.; Li, G.Z.; Zhu, R. A wearable flow-MIMU device for monitoring human dynamic motion. IEEE Trans. Neural Sys. Rehabil. Eng. 2020, 28, 637–645. [Google Scholar] [CrossRef] [PubMed]
  13. Lu, N.; Lu, C.; Yang, S.; Rogers, J. Highly sensitive skin-mountable strain gauges based entirely on elastomers. Adv. Funct. Mater. 2012, 22, 4044–4050. [Google Scholar] [CrossRef]
  14. Zens, M.; Ruhhammer, J.; Goldschmidtboeing, F.; Feucht, M.J.; Bernstein, A.; Niemeyer, P.; Mayr, H.O.; Woias, P. Polydimethylsiloxane strain gauges for biomedical applications. In Proceedings of the 18th International Conference on Solid-State Sensors, Actuators and Microsystems (Transducers), Anchorage, AL, USA, 21–25 June 2015. [Google Scholar] [CrossRef]
  15. Baloda, S.; Ansari, Z.A.; Singh, S.; Gupta, N. Development and analysis of graphene nanoplatelets (GNPs)-based flexible strain sensor for health monitoring applications. IEEE Sens. J. 2020, 20, 13302–13309. [Google Scholar] [CrossRef]
  16. Chossat, J.B.; Park, Y.L.; Wood, R.J.; Duchaine, V. A soft strain sensor based on ionic and metal liquids. IEEE Sens. J. 2013, 13, 3405–3414. [Google Scholar] [CrossRef]
  17. Park, Y.L.; Chen, B.R.; Wood, R.J. Design and fabrication of soft artificial skin using embedded microchannels and liquid conductors. IEEE Sens. J. 2012, 16, 2711–2718. [Google Scholar] [CrossRef]
  18. Part, Y.L.; Majidi, C.; Kramer, R.; Bérard, P.; Wood, R.J. Hyperelastic pressure sensing with a liquid-embedded elastomer. J. Micromech. Microeng. 2010, 20, 125029. [Google Scholar] [CrossRef] [Green Version]
  19. Zhao, Z.N.; Lin, J.; Zhang, J.; Yu, Y.; Yuan, B.; Fan, C.C.; Wang, L.; Liu, J. Liquid metal enabled flexible electronic system for eye movement tracking. IEEE Sens. J. 2018, 18, 2592–2598. [Google Scholar] [CrossRef]
  20. Zhang, J. Liquid metal based stretchable sensor for human-computer interact. In Proceedings of the International Conference on Nanoscience and Technology, Chengdu, China, 26–28 June 2021. [Google Scholar]
  21. Đorđević, S.; Stančin, S.; Meglič, A.; Milutinović, V.; Tomažič, S. MC sensor—A novel method for measurement of muscle tension. Sensors 2011, 11, 9411–9425. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Lukowicz, P.; Hanser, F.; Szubski, C.; Schobersberger, W. Detecting and interpreting muscle activity with wearable force sensors. In Proceedings of the International Conference on Pervasive Computing, Dublin, Ireland, 7–10 May 2006; Springer: Berlin/Heidelberg, Germany. [Google Scholar] [CrossRef]
  23. Ejehi, F.; Mohammadpour, R.; Asadian, E.; Sasanpour, P.; Fardindoost, S.; Akhavan, O. Graphene oxide papers in nanogenerators for self-powered humidity sensing by finger tapping. Sci. Rep. 2020, 10, 7312. [Google Scholar] [CrossRef] [PubMed]
  24. Huang, H.; Li, X.; Sun, Y. A triboelectric motion sensor in wearable body sensor network for human activity recognition. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Orlando, FL, USA, 16–20 August 2016. [Google Scholar]
  25. Li, W.; Sengupta, D.; Pei, Y.; Kottapalli, A.G.P. Wearable nanofiber-based triboelectric nanogenerator for body motion energy harvesting. In Proceedings of the 2021 IEEE International Conference on Flexible and Printable Sensors and Systems, Manchester, UK, 20–23 June 2021. [Google Scholar]
  26. Nhu, C.T.; Ngoc, A.N.; Dau, V.T.; Van, C.L.; Duc, C.; Bui, T.T. Wearable fluidic strain sensor for human motion sensing. In Proceedings of the IEEE Sensors, Rotterdam, The Netherlands, 25–28 October 2020. [Google Scholar]
  27. Kwon, D.; Na, K.; Kang, K.; Lee, J.Y.; Park, I. Flexible optical pressure sensor and its application to wearable human motion detecting device. In Proceedings of the IEEE Micro Electro Mechanical Systems, Belfast, UK, 21–25 January 2018. [Google Scholar]
  28. Park, K. Wearable sensor for forearm motion detection using a carbon-based conductive layer-polymer composite film. Sensors 2022, 22, 2236. [Google Scholar] [CrossRef] [PubMed]
  29. Park, K.; Yoon, M.-K.; Lee, S.; Choi, J.; Thubrikar, M. Effects of electrode degradation and solvent evaporation on the performance of ionic-polymer–metal composite sensors. Smart Mater. Struct. 2010, 19, 075002. [Google Scholar] [CrossRef]
  30. Kanoun, O.; Muller, C.; Benchirouf, A.; Sanli, A.; Gerlach, C.; Bouhamed, A. Carbon nanotube polymer composites for high performance strain sensors. In Proceedings of the 1st Workshop on Nanotechnology in Instrumentation and Measurement, Lecce, Italy, 24–25 July 2015. [Google Scholar] [CrossRef]
  31. Wicaksono, D.H.B.; Benhanan, B.; Parung, D.E.; Ughi, F.; Shafi, A.; Mandala, S.; Biben, V.; Maulana, N.; Arisanti, F.; Herbani, Y.; et al. Carbon nanotube-coated thread as sensor for wearable mechanomyography of leg muscles. In Proceedings of the IEEE Sensors, New Delhi, India, 28–31 October 2018. [Google Scholar] [CrossRef]
  32. Pyo, S.; Jo, E.; Kwon, D.S.; Kim, W.; Chang, W.; Kim, J. Fabrication of carbon nanotube-coated fabric for highly sensitive pressure sensor. In Proceedings of the 19th International Conference on Solid-State Sensors, Actuators and Microsystems (Transducers), Kaohsiung, Taiwan, 18–22 June 2017. [Google Scholar] [CrossRef]
  33. Kuzubaşoğlu, B.A.; Bahadir, S.K. Modeling of carbon nanotube-based wearable textile temperature sensor via artificial intelligence. In Proceedings of the 29th Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkey, 9–11 June 2021. [Google Scholar] [CrossRef]
  34. Dinh, T.; Nguyen, T.; Dau, V.T.; Riduan, F.A.; Tran, C.D.; Phan, H.P.; Nguyen, T.K.; Guzman, P.; Nguyen, N.T.; Dao, D.V. Flexible and wearable flow sensor using spinnable carbon nanotube nanofilm for respiration monitoring. In Proceedings of the IEEE 33rd International Conference on Micro Electro Mechanical Systems (MEMS), Vancouver, BC, Canada, 18–22 January 2020. [Google Scholar] [CrossRef]
  35. Karuna, M.; Ganesh, C.; Das, R.P.; Kumar, V. Classification of wrist movements through EMG signals with fuzzy logic algorithm. In Proceedings of the International conference on Energy, Communication, Data Analytics and Soft Computing, Chennai, India, 1–2 August 2017. [Google Scholar]
  36. Güvenç, S.A.; Demir, M.; Ulutas, M. Detection of forearm movements using wavelets and adaptive neuro-fuzzy inference system. In Proceedings of the IEEE International Symposium on Innovations in Intelligent Systems and Applications, Alberobello, Italy, 23–25 June 2014. [Google Scholar]
  37. Jia, G.; Lam, H.K.; Ma, S.; Yang, Z.; Xu, Y.; Xiao, B. Classification of electromyographic hand gesture signals using modified fuzzy c-means clustering and two-step machine learning approach. IEEE Trans. Neural Sys. Rehabil. Eng. 2020, 28, 1428–1435. [Google Scholar] [CrossRef] [PubMed]
  38. Mittal, H.K.; Divya. Efficiency improvement of IoT in healthcare using embedded fuzzy technique. In Proceedings of the 4th International Conference on Computational Intelligence and Communication Technologies, Sonepat, India, 3 July 2021. [Google Scholar]
  39. Çelik, M.S.; Eminoğlu, İ. Fuzzy logic based classification for multifunctional upper limb prostheses. In Proceedings of the Medical Technologies National Congress, Antalya, Turkey, 27–29 October 2016. [Google Scholar]
  40. Maeda, Y.; Ishibashi, S. Operating instruction method based on EMG for omnidirectional wheelchair robot. In Proceedings of the 17th World congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems, Otsu, Japan, 27–30 June 2017. [Google Scholar]
  41. Karlik, B.; Osman Tokhi, M.; Alci, M. A fuzzy clustering neural network architecture for multifunction upper-limb prosthesis. IEEE Trans. Biomed. Eng. 2003, 50, 1255–1261. [Google Scholar] [CrossRef] [PubMed]
  42. Ajiboye, A.B.; Weir, R. A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 280–291. [Google Scholar] [CrossRef] [PubMed]
  43. Atitallah, B.B.; Abbasi, M.B.; Barioul, R.; Bouchaala, D.; Derbel, N.; Kanoun, O. Simultaneous pressure sensors monitoring system for hand gestures recognition. In Proceedings of the IEEE Sensors, Rotterdam, The Netherlands, 25–28 October 2020. [Google Scholar] [CrossRef]
Figure 1. Description of the sensor mechanism: (a) Bending generation mechanism, (b) Relationship between the bending of film and the increase in the width of crack gaps, and (c) Illustration of resistance variation on the conductive layer.
Figure 1. Description of the sensor mechanism: (a) Bending generation mechanism, (b) Relationship between the bending of film and the increase in the width of crack gaps, and (c) Illustration of resistance variation on the conductive layer.
Polymers 14 02309 g001
Figure 2. Movement mechanism and fabricated form of sensor module: (a) Top view, (b) Side view with fabricated image of module, (c) Voltage signal variation due to the change in the surface resistance of the composite film mounted on the sensor module and the image of final version sensor modules when worn with permission from [28]. 2022 MDPI Publishing. (K. Park, Sensors, vol. 22, 2022, MDPI Publishing).
Figure 2. Movement mechanism and fabricated form of sensor module: (a) Top view, (b) Side view with fabricated image of module, (c) Voltage signal variation due to the change in the surface resistance of the composite film mounted on the sensor module and the image of final version sensor modules when worn with permission from [28]. 2022 MDPI Publishing. (K. Park, Sensors, vol. 22, 2022, MDPI Publishing).
Polymers 14 02309 g002aPolymers 14 02309 g002b
Figure 3. Forearm movements.
Figure 3. Forearm movements.
Polymers 14 02309 g003
Figure 4. Experimental setup and Transducer circuit converting resistance variation to voltage signal: (a) Composition of data acquisition procedure, (b) Transducer circuit.
Figure 4. Experimental setup and Transducer circuit converting resistance variation to voltage signal: (a) Composition of data acquisition procedure, (b) Transducer circuit.
Polymers 14 02309 g004
Figure 5. Relationship between the measured signal and the input membership function: (a) Measured signal data from module 1 and 2, (b) Input membership function.
Figure 5. Relationship between the measured signal and the input membership function: (a) Measured signal data from module 1 and 2, (b) Input membership function.
Polymers 14 02309 g005
Figure 6. Detection results of 24 consecutive motions of forearm (WE: wrist extension, UL: ulnar deviation, FF: finger flexion, and WF: wrist extension).
Figure 6. Detection results of 24 consecutive motions of forearm (WE: wrist extension, UL: ulnar deviation, FF: finger flexion, and WF: wrist extension).
Polymers 14 02309 g006
Table 1. Summary of fuzzy rules.
Table 1. Summary of fuzzy rules.
RulesIfFuzzy NamesThenStrength of Motions
Module1andModule2Wrist
Extension
Ulnar
Deviation
Finger
Flexion
Wrist
Flexion
Off State
1IfHighNandHighNThenHighmotionLowmotionLowmotionLowmotionLowmotion
2HighNLowNMedmotionLowmotionLowmotionLowmotionLowmotion
3HighNOffLowmotionLowmotionLowmotionLowmotionLowmotion
7LowNHighNMedmotionLowmotionLowmotionLowmotionLowmotion
8LowNLowNMedmotionLowmotionLowmotionLowmotionMedmotion
9LowNOffLowmotionLowmotionLowmotionLowmotionMedmotion
13OffHighNLowmotionLowmotionLowmotionLowmotionLowmotion
14OffLowNLowmotionLowmotionLowmotionLowmotionMedmotion
15OffOffLowmotionLowmotionLowmotionLowmotionHighmotion
21LowOffLowmotionHighmotionLowmotionLowmotionMedmotion
22LowLowLowmotionMedmotionLowmotionLowmotionMedmotion
23LowMedLowmotionLowmotionLowmotionLowmotionLowmotion
28MedLowLowmotionMedmotionLowmotionLowmotionLowmotion
29MedMedLowmotionLowmotionMedmotionLowmotionLowmotion
30MedHighLowmotionLowmotionHighmotionLowmotionLowmotion
34HighLowLowmotionLowmotionLowmotionLowmotionLowmotion
35HighMedLowmotionLowmotionMedmotionMedmotionLowmotion
36HighHighLowmotionLowmotionLowmotionHighmotionLowmotion
Table 2. Motion detection errors.
Table 2. Motion detection errors.
MotionResting StateWrist ExtensionUlnar DeviationFinger FlexionWrist Flexion
Accuracy rate1 (%)99.8099.7985.6787.8884.43
Accuracy rate2 (%)99.8099.7598.5286.6887.34
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Park, K. Design of Fuzzy Logic Motion Detection Algorithm for the Bracelet Type Sensor Consisting of Conductive Layer-Polymer Composite Film. Polymers 2022, 14, 2309. https://doi.org/10.3390/polym14122309

AMA Style

Park K. Design of Fuzzy Logic Motion Detection Algorithm for the Bracelet Type Sensor Consisting of Conductive Layer-Polymer Composite Film. Polymers. 2022; 14(12):2309. https://doi.org/10.3390/polym14122309

Chicago/Turabian Style

Park, Kiwon. 2022. "Design of Fuzzy Logic Motion Detection Algorithm for the Bracelet Type Sensor Consisting of Conductive Layer-Polymer Composite Film" Polymers 14, no. 12: 2309. https://doi.org/10.3390/polym14122309

APA Style

Park, K. (2022). Design of Fuzzy Logic Motion Detection Algorithm for the Bracelet Type Sensor Consisting of Conductive Layer-Polymer Composite Film. Polymers, 14(12), 2309. https://doi.org/10.3390/polym14122309

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop