Next Article in Journal
3D-Printed Tumor-on-a-Chip Model for Investigating the Effect of Matrix Stiffness on Glioblastoma Tumor Invasion
Next Article in Special Issue
Modeling and Analysis of Human Comfort in Human–Robot Collaboration
Previous Article in Journal
Preparation and Characterization of Nano-Silver-Loaded Antibacterial Membrane via Coaxial Electrospinning
Previous Article in Special Issue
Adaptive Circadian Rhythms for Autonomous and Biologically Inspired Robot Behavior
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a New Control System for a Rehabilitation Robot Using Electrical Impedance Tomography and Artificial Intelligence

by
Alireza Abbasimoshaei
*,
Adithya Kumar Chinnakkonda Ravi
and
Thorsten Alexander Kern
Institute for Mechatronics in Mechanics, Hamburg University of Technology, Eissendorferstr. 38, 21073 Hamburg, Germany
*
Author to whom correspondence should be addressed.
Biomimetics 2023, 8(5), 420; https://doi.org/10.3390/biomimetics8050420
Submission received: 14 August 2023 / Revised: 29 August 2023 / Accepted: 5 September 2023 / Published: 11 September 2023
(This article belongs to the Special Issue Intelligent Human-Robot Interaction)

Abstract

:
In this study, we present a tomography-based control system for a rehabilitation robot using a novel approach to assess advancement and a dynamic model of the system. In this model, the torque generated by the robot and the impedance of the patient’s hand are used to determine each step of the rehabilitation. In the proposed control architecture, a regression model is developed and implemented based on the extraction of tomography signals to estimate the muscles state. During the rehabilitation session, the torque applied by the patient is adjusted according to this estimation. The first step of this protocol is to calculate the subject-specific parameters. These include the axis offset, inertia parameters, passive damping and stiffness. The second step involves identifying the other elements of the model, such as the torque resulting from interaction. In this case, the robot will calculate the torque generated by the patient. The developed robot-based solution and the suggested protocol were tested on different participants and showed promising results. First, the prediction of the impedance–position relationship was evaluated, and the prediction was below 2% error. Then, different participants with different impedances were tested, and the results showed that the control system controlled the force and position for each participant individually.

Graphical Abstract

1. Introduction

According to the World Stroke Organization (WSO), stroke remains a major global health issue, ranking as the second most common cause of mortality and the third most frequent cause of both death and disability globally [1]. The impact of strokes is not only felt in terms of deaths, but also represents a significant economic burden, with an estimated global cost of more than EUR 721 billion [2]. The aftermath of a stroke can result in several limitations, including movement and speech problems, and changes in cognitive and emotional states. With the growing prevalence of conditions, such as stroke and spinal cord injuries, there is an increasing need for innovative rehabilitation techniques that can help patients recover their mobility and functionality [3], particularly relevant for patients undergoing extended training periods [4].
Advanced technology has greatly impacted the development of automated medical and rehabilitation systems [5,6]. This technology today allows patients to receive therapy and exercise programs remotely, which can be especially helpful for those who live in rural or remote areas, have mobility issues, or have limited access to physical therapy facilities. On the other hand, there is an increasing need for occupational therapists to assist patients with a wide range of exercises, so these devices can be used as remote rehabilitation systems to reduce the therapists’ workload [7]. Research also shows that remote rehabilitation can have several potential advantages, such as keeping patients engaged beyond the clinical context and tracking and assessing movements when they are at home [8]. Moreover, remote rehabilitation has the potential to reduce healthcare costs [7] by eliminating the need for patients to travel to physical therapy appointments and by reducing the need for in-person therapy sessions. Their design can also be optimized by combining parallel and serial mechanisms, or by using new methods to change the shape of the end effectors [9,10]. Therefore, remote robotic rehabilitation represents a promising area of research to improve the delivery and accessibility of physical therapy services [11].
Therapists must possess a deep understanding of the forces that affect repaired tendons and the tensile strengths of various repairs. Measuring the amount of flexion through conventional methods can be challenging. However, a rehabilitation device can gradually increase the amount of flexion, making it an ideal method for rehabilitation compared to traditional physical therapy [12,13,14]. These systems can be programmed to provide targeted exercises that help patients build strength, support compensation [15], improve range of motion and regain motor control. They have been shown to be effective in improving mobility, reducing pain, and enhancing the overall quality of life for patients undergoing rehabilitation [7,16,17,18]. In addition to these benefits, for robotic devices to perform better, they should be able to monitor the patient’s condition and provide valid data to the therapist so that he or she can get an idea of the patient’s progress.
Electrical impedance tomography (EIT) is a method that is based on the measurement of the electrical impedance of body tissues and can provide images of the internal structures of the body without using harmful radiation or invasive procedures [19]. EIT has been used in a variety of medical applications, such as monitoring lung function [20], detecting breast cancer [21,22] and monitoring brain activity [23]. However, it is not commonly used in robotic rehabilitation. The use of EIT technology in rehabilitation robotics has the potential to change the way medicine approaches rehabilitation, providing clinicians with a powerful tool for monitoring patient progress and tailoring rehabilitation programs to individual needs.
Given the various advantages of using remote robotic rehabilitation, this study presents a novel approach to design and produce a rehabilitation robot that restores wrist and forearm functionality through an automated rehabilitation protocol. In addition, the rehabilitation protocol proposed in this study uses EIT technology to evaluate muscle growth and an intelligent algorithm to update the patient’s hand model according to the patient’s improvement. The control system includes a mathematical model that describes the dynamics of forearm and wrist rotations [24] in three degrees of freedom and evaluates the torques of the forearm and wrist. The process of creating a model of the forearm and wrist enables evaluation of the rehabilitation progress and identification of the basic elements of the dynamic model. Therefore, the following three phases consist of these objectives: in the first phase, the system is calibrated with the patient’s healthy hand; in the second phase, the subject’s constant parameters are determined; and in the third phase, the patient is evaluated and exercises are performed. In the third phase, patients are asked to perform the desired movements, applying the necessary torque to move the robot in the desired direction. During therapy, the range of motion of the end effector and the electrical impedance of the forearm or wrist are measured. If the previous values are reached, the values are extended, and the new maximum values are increased for the next cycle. Otherwise, the current maximum values become the new endpoints. In the following, this paper will dive deeper into the details of the protocol by first explaining the design of the rehabilitation robot and then the model and control system, followed by the implementation of the tomography and finally the description of the protocol of the system and tests.

2. Methodology and Design

2.1. Mechanical Design

The mechanical structure was designed with consideration of the anatomical constraints of forearm and wrist movements shown in Figure 1. Figure 2 shows the robot with the main components of the assembly listed in Table 1. Also, the system is adjustable in the X and Y directions to be useful for both hands. The design also took into account physical limitations to create a simple system with low weight.
The model consists of six main parts. Each part with its elementary components is described in Table 1. The rotating plate is connected to the motor, which enables the movement of the hand. Unlike similar solutions, the robot is driven by a single motor that performs the three degrees of freedom (DOFs) of the forearm and wrist. We offer a new solution with 3 DOFs, using a single motor instead of three motors to drive the joint. Based on an interchangeable end effector, the robot enables the three basic movements of the wrist and forearm: flexion/extension, ulnar/radial, and supination/pronation. In fact, the distance between the forearm holder and the motor place can be adjusted in the horizontal and vertical directions. The actual state shown in Figure 3 and Figure S1 in the supplementary file provides different degrees of freedom by changing the end effector.
It shows the mechanical transformation that ensures the three basic wrist and forearm movements. The designed robotic system is user-friendly and straightforward to operate, requiring no specialized training for setup. It is a portable device that is simple to handle. Additionally, the robot is powered by a medium-torque Dynamixel motor, which supplies the necessary torque for implementing the innovative rehabilitation approach.

2.2. Mechanical Model of the Forearm and Wrist Rotations

This section introduces a mathematical model that captures the rotational dynamics of the forearm and wrist across three degrees of freedom (DOFs). It assesses the torques needed for these rotations and identifies key terms and parameters in the model that are essential for exercise applications. The model’s validity will be confirmed through experimental observations of forearm and wrist movements, conducted with a rehabilitation robot, to define the dynamics of these rotations.
The joints studied can be kinematically described as a universal joint with nonoverlapping axes (Figure S2 in the supplementary file). Supination–pronation occurs about the Y axis and is represented by α (Figure 3 and Figure S2 in the supplementary file). Flexion and extension is represented by β and occurs about the Z axis. Ulnar–radial deviation is represented by γ and occurs about the rotated X axis. As rotations occur, a series of torques are applied to the hand. Contraction of the muscles produces active torques. They are represented here as a group and resolved (without loss of generality) along the axes of supination/pronation (SP), flexion/extension (FE), and ulnar/radial (UR) (Figure S2 in Supplementary file). Passive torques result from the mechanical properties of the forearm and wrist, and gravity. The resulting torques are a combination of active and passive torques. To simplify the calculations, it is assumed that the damping and stiffness torques are linear and symmetrical about the neutral position.
Figure 3. Control architecture design.
Figure 3. Control architecture design.
Biomimetics 08 00420 g003
Inverse kinematics is used for joint angles, where SP, FE, and UR represent the Euler angles of the forearm and wrist in supination/pronation, flexion/extension, and ulnar/radial movements, respectively. They are considered positive for pronation, flexion, and ulnar deviation. The frame XYZ is fixed in the hand (third metacarpal joint) and rotates with the hand. This results in the following equations of motion, which relate the torque in each DOF to the resulting motion:
τ S P τ F E τ U R = τ S P θ S P θ S P + τ S P θ F E θ F E + τ S P θ U R θ U R τ F E θ S P θ S P + τ F E θ F E θ F E + τ F E θ U R θ U R τ U R θ S P θ S P + τ U R θ F E θ F E + τ U R θ U R θ U R = τ S P θ S P τ S P θ F E τ S P θ U R τ F E θ S P τ F E θ F E τ F E θ U R τ U R θ S P τ U R θ F E τ U R θ U R θ S P θ F E θ U R
Then, the following formula and table are obtained:
τ S P τ F E τ U R = A α ¨ β ¨ γ ¨ + B α ˙ β ˙ γ ˙ + C α β γ + D
In Equation (2), the left-hand side signifies the overall active torques, attributable to muscle contractions. These torques could be influenced by both displacement and its rate of change, as well as neuronal activation. This is because neuronal activation has an impact on muscle stiffness and damping characteristics. [A] shows the inertial torque, [B] is the damping torque, [C] represents the stiffness torque, and [D] is for gravitational torques and those associated with coupled rotations. Since the system is an intelligent system, it can adapt to the hand situation after a few trials. Therefore, we used the average values for men and women for the coefficients [25]. Thus, the matrix values are found and given in the equations in the supplementary file.
For the numbers, we used the averaged values. As an example, based on the related literature [26], the flexion axis was measured 3.9 ± 2.0 mm, and 3.9 ± 1.4 mm was measured for the extension axis of male. In this work, all male subjects were given 4 mm.

2.3. Control Architecture

As shown in Figure 3, the main architecture contains different subsystems. The flow begins with data received from the patient and diagnosis of the initial condition by electrodes connected to the hand. Based on the electrode data, the learning algorithm sets a target for the current exercise. In parallel, the wrist and forearm model sends the initial torque signal to the neural network to define the initial parameters and send the signal to rotate the motor. According to the performance of the patient and the sensor signals, the model parameters are updated in real time during the experiment with the recurrent neural network algorithm. Based on the new model, the error between the target and the current position, and the torque input from the patient, the new signals are sent from the recurrent neural network to the robot and define the force that should be exerted on the hand, and this loop continues to reach the target.
The model of the hand is dynamically refreshed to compute the resulting torque for the entire system. This resulting torque is determined by taking the estimated muscle-applied torque and subtracting the output torque predicted by the model. Thus, the initial and feedback values affect the updated forearm and wrist model each time. According to the model parameters, an output torque is estimated and from the subtraction of this torque by the torque applied by the muscle, the resultant torque is determined. The flow chart for this can be found in Figure S3 in the supplementary file.
On the other hand, the necessary motor torque is derived from the latest sensor impedance readings and the current hand position, as captured by the encoder linked to the Dynamixel motor. As depicted in Figure 4, the recurrent neural network (RNN) learning algorithm evaluates various inputs, such as the present joint position, applied torque, motor-generated torque, and torque assessed based on hand impedance. It then transmits the updated target values to the robot. For the purpose of measuring the patient-applied torque, a strain gauge setup is designed and put into action, as shown in Figure 5.
Incorporated into this system is an adaptive learning algorithm, specifically a recurrent neural network (RNN), which plays a pivotal role in real-time adaptability. This algorithm processes multiple forms of input data. Based on these inputs, the RNN continually updates the control signals and model parameters, thereby tailoring the rehabilitation process to each individual patient’s needs and performance metrics. Such real-time adaptability not only enhances the precision of the rehabilitation process but also contributes to the system’s overall robustness.
Regarding safety concerns, a multi-faceted approach is implemented to ensure that both the mechanical and software aspects of the system operate within safe parameters. On the mechanical front, mechanical stops are integrated into the system that act as hard limits to prevent any unintended or extreme movements by the robot, thereby enhancing physical safety.
From an electrical standpoint, the system continuously measures the current flow during operation. If the current exceeds a predetermined safe threshold, the system automatically stops all movements, serving as an electrical safety measure.
On the software side, some algorithms are designed that monitor these safety parameters in real-time and take corrective action as needed. Moreover, an emergency stop button is incorporated into the system interface. This allows the users to immediately stop all operations if they feel discomfort or perceive any form of risk, providing an additional layer of user-controlled safety.
These safety measures collectively provide a robust framework that prioritizes the well-being of the user while ensuring that the system operates within safe and effective boundaries.

2.4. Tomography

Tomography is a method of scanning cross sections by penetrating waves. It is used to evaluate the situation of the user’s wrist and forearm. It calculates the resistance between two poles of an electrode, and the result of this measurement is called bio-impedance. The sensor chosen for impedance measurement is the AD5933 impedance converter and network analyzer, also called an impedance sensor. This sensor was chosen because of its communication protocol, which sends data directly to the Arduino via an I2C bus connection. The sensor is inexpensive and reliable. Thanks to its small size of 4.1 cm × 2.0 cm, we can easily mount it anywhere. As part of the data input for the analysis, a PmodIA impedance analyzer with an integrated AD5933 is used to measure the impedance between two points [27].

2.4.1. Impedance Analyzer Setup

An AD5933 impedance analyzer is a 12-bit analyzer with a measurement range of 100 Ω to 10 M Ω . The PmodIA employs the AD5933 to stimulate an unidentified external impedance at a predetermined frequency, utilizing its integrated frequency generator and analog-to-digital converter (ADC). The frequency is fed internally via one of the subminiature version A (SMA) connectors. Other SMA connectors capture the frequency response and transmit it to the ADC. The sampled data undergo a discrete Fourier transform (DFT), after which the real and imaginary components of the outcome are processed within the on-chip data registers [27,28]. Using I2C interfaces, we can communicate with a microcontroller, such as Arduino, and extract data. In this case, we used the Arduino Uno. The choice of the Arduino Uno for this project is due to its form factor and lower cost. The PmodIA acts as the slave device, and the Arduino acts as the primary device that communicates using the I2C protocol. Figure S4 in the supplementary file shows the schematic and implemented connection between PmodIA and the Arduino microcontroller, and Figure 6 shows the concept and setup on hand.

2.4.2. Impedance Calculations

The analog-to-digital converter starts a frequency sweep at each point to calculate the unknown frequency response at up to 100 kHz with a resolution of 12 bits. Before the measurements are evaluated, a DFT is applied to the sampled data at each frequency step. Two values are stored in each register, one real and one imaginary. The electrical impedance can be expressed with Equation (3):
Z = R e a l + j i m a g i n a r y
The first step in impedance is to calculate the amount, which can be calculated using Equation (4):
M a g n i t u d e = ( R 2 + I 2 )
R is the real number stored at register addresses 0 × 94 and 0 × 95. I is the imaginary number stored at register addresses 0 × 96 and 0 × 97. The built-in ADC and DFT capture the response signal, which is then processed by a digital signal processor. At each output frequency, the DFT function returns real and imaginary data. Impedance is calculated by inverting the product of the gain factor and magnitude. Note that the gain factor is calculated during the calibration process of the system, where a known impedance is connected:
I m p e d a n c e = 1 G a i n F a c t o r M a g n i t u d e
Since the sensor has a finite series of frequency responses, the gain factor may vary with frequency. This can lead to an error in a certain frequency range. To reduce the error, we keep the frequency range as low as possible, and a low frequency is sufficient for our goal of estimating the hand impedance.

2.4.3. Torque Calculation Based on Hand Impedance

Based on the estimated active stiffness and impedance of the hand, the torque provided by the end effector should be adjusted:
T = C ω + K E
where C is the damping coefficient, ω is the angular velocity, K is the stiffness, and E is the error between the target position and the actual position. The torque (T) is determined by this formula and helps the patient to reach the target point. It helps in providing adaptive and personalized therapy for all individuals, as the degree of disability and physical abilities are inherently different. By telling the patient the level of assistance, they are motivated to keep better records. The controller should learn this in real time and provide an appropriate assistance torque to accomplish the task. Therefore, the robot should provide higher assistance and lower compliance when rehabilitating severely impaired patients, and high compliance and lower assistance as the patient improves.
The patient starts the control process by entering the desired settings. After appropriate processing, the required parameters are transmitted to the advanced control block implemented in the human–machine interface (HMI). The robot receives the calculated parameters, including the required torque and position. The board processes the data from the sensors and encoder before sending them back to the controller. Then, the extracted impedance features are used to estimate muscle stiffness. The motion control block uses position feedback to make the correct choice. The settings and results are stored in the database. Figure 7 shows the operational flowchart of the system. The robot manages the torque and data in the designed architecture. In this case, the calculated torque is the topic to be published.

2.4.4. Protocol Description

The first step is the calibration of the system using the patient’s electrical impedance. The subject must use the healthy arm to calibrate the impedance values. During the second step, the impedance values are used by the system to calculate the subject’s constant parameters for the wrist and forearm model. The third step is to perform exercises and evaluate the patient’s condition and rehabilitation progress. The subject must perform the desired exercises and apply the necessary torque to move the robot to the desired point. In this case, the robot measures the range of motion of the end effector and the electrical impedance of the lower arm and compares them with the previous values. If the subject cannot achieve the previous values, the current maximum values are set as endpoints. If the previous values are achieved, the desired values are extended, and the new maximum values are increased for the next cycle.

3. Results and Discussion

The designed robot is equipped with only one motor, cost-effective, practical, and easy to use, which makes it an ideal option for in-home rehabilitation. The fact that it is automatically controlled makes it easier for the users to use it whenever they want. The system security is enhanced by this personalized control system. Based on the passive training and impedance data, the system develops the hand model, and the control flow is started.
Before starting, the patient should select a path to save the report file and enter the name and age. Note that these parameters are automatically stored in the corresponding database and will be imported later in the next exercises. The patient can update these parameters at any time.
The next step is to calibrate and drive the hand model by starting the first exercise. The system uses one-shot learning and must be calibrated for each person. Impedance values may vary depending on the muscle situation and physical characteristics of the user. From experimental observations, they change every time and do not always remain the same. Therefore, it is advisable to calibrate the system each time before starting the training. Each time the software is started, the calibration process must be repeated. This is to ensure that the system remains calibrated at the beginning of each session and provides more safety.
After finalizing the component measurements, the next thing is to start the exercise. By clicking on a button, the software starts the exercise. First, the software checks if there are values for the angle range. Using the impedance prediction and the current impedance data, it also checks if it is possible to apply less assistance force to the end effector. When patients can no longer move their hands, the system stops and sets that as the endpoint for the day. The same is performed for both sides from the center for each DOF. For existing patients, the values are compared with the previous results to look for improvements. For each additional trial, the system increases the values and checks if the user can move, just as the therapist does in the clinic. If the user is comfortable with these new values, it updates the sheet. The range of motion achieved and the assistance torque generated are stored to evaluate the degree of rehabilitation. In case of an emergency, the program can be stopped at any time by pressing the emergency stop button. This is an additional safety option for the user. In addition, for each DOF, the maximum angle is defined, beyond which the system cannot go. The ranges for flexion, extension, ulnar and radial deviation, pronation, and supination are defined as 85°, 80°, 30°, 20°, 90°, and 90°, respectively, and can be changed in the code.
The report is self-generated. It provides daily records of the user’s progress, giving physicians an overview of the improvement in the user’s health. As shown in Table 2 (name and age are removed because of privacy), it helps the physician to understand how the patient has been coping with the exercises of the intelligent wrist therapy robot. It is also consulted by the software to track the user’s previous limitations. The report is generated for each new user, and if the user has already used the system, the system adds each day’s limits.
Because this is the user’s private data, this system places the highest value on privacy and informed consent. It uses Google Cloud Platform for data storage and transfer, which follows strict security protocols. For secure data transfer between the device and the cloud, we use SSL/TLS encryption methods to ensure that patient data remain confidential and protected from unauthorized access. In addition, we use Google Cloud’s Identity and Access Management (IAM) features to control who has access to different types of data and to ensure that only authorized personnel can enter the application and perform tests.
To maintain ethical standards, our system also requires user consent at every crucial step where data are collected or transferred. This ensures that users know exactly how their data will be used, stored and protected, in line with best practice for informed consent.
To predict the impedance–position relationship of the hand, a direct comparison between position and impedance is made, and a pattern between impedance and position is observed. The behavioral diagram is shown in Figure 8.
The pattern between impedance and position shown in Figure 8 is the raw data available directly from the Arduino microcontroller. These values are generally clustered and contain high sensor errors. To achieve higher accuracy and better measurements, slope-based filtering is used to eliminate noise. As can be seen in Figure 9, there is a pattern between position and impedance. This pattern is a relationship between a mechanical quantity (position) and an electrical quantity (impedance). Since the two quantities come from two different areas, determining the relationship between them is complex. Using machine learning algorithms and a large data set, it is possible to establish a relationship and predict the impedance value based on healthy human behavior. Since the process of generating relationships is automated, the whole process can be easily reused for other purposes, e.g., to add additional exercises. This is helpful for the future development of the system.
Running the model with different degrees of polynomials, we find that using a fifth-degree polynomial minimizes the mean average error. The first experiment is to check the accuracy of the model by comparing the predicted and actual impedance. Note that the value of the impedance depends on the position of the electrodes, the temperature, the time of day and the condition of the body. After various trial and error methods, it is found that the electrodes must be placed about 6.5 cm below the wrist. Both electrodes must face the opposite side. In addition, the fit should be neither very tight nor very loose, and it should be comfortable while making firm contact with the skin. Since other conditions, such as temperature and body condition, cannot be controlled, it is advisable to fit the curve with the initial impedance values. The first 20 values are compared so that the actual impedance and the predicted impedance are on the same line. The time needed for this process is only a fraction of a second. Therefore, it does not interfere with our work. Figure 10 shows the measured and predicted impedance. As can be seen from the results, the predicted points are very close to the measured points. The test is performed several times at different times of the day and week to ensure the stability of the system. No change in prediction accuracy is observed, and the predictions give good results with an error of less than 2%.
The next test is to ensure that the system is able to shut down if the user applies too much force to the system. If the patient is in pain and cannot move his hand, it can be seen that the difference between the predicted and measured impedance slowly grows.
In such cases, the system is brought to a standstill. The program written for this research continuously monitors both the predicted and the actual impedance. If the impedance increases or if the impedance values differ from the predicted impedance, the system stops the entire process. To test the concept, an experiment is conducted to check the performance of the system where the degree of wrist movement is limited. Figure 11 illustrates this situation. When the movement is restricted after 260, there is a slow deviation between the predicted impedance and the impedance. The impedance value should be lower for a normal person. However, due to simulated uncertainty, a certain counterforce that restricts the movement of the motor causes the impedance value to increase. Once the system exceeds the limit, it shuts down to stop this process. This experiment is carried out several times to check the reliability of the system.
In order to test the controller’s ability to control position in relation to impedance, three different participants were tested with three different impedances as part of the robot training described. The aim of this experiment was to see if the system could behave differently depending on the impedance. Figure 12a–c represent the lowest impedance, the medium impedance, and the highest impedance, respectively, and they show the results of the training in the first minute for comparison.
As can be seen from the data, the movement with the lowest impedance within one minute covers a larger range of motion than the others, and the user has more ability to move his hand than others. In addition, the change and reaching of the target is smooth so as not to harm the users, and therefore the position increases gradually. Although there are some cases where the system returns to a previous state during movement, these are rare and have evolved due to impedance detection. The robot has not moved beyond the predefined angular limits for each DOF.
In order to test the ability of the controller to control the force applied to the hand as a function of different impedances, we tested it with two different impedances. The assumption is that the control system with a higher impedance should exert more force on the hands, as this is exactly what physiotherapists do. We also set a threshold for stopping the force so as not to harm people. Comparing the results of the force–torque sensor between these two impedances shows that as the impedance increases, the force and torque also increase (see the supplementary file for more details and the corresponding Figures S5 and S6 ).
We carried out various tests with two different impedances. As can be seen in Figure 13 as an average of the results, the forces increase with increasing impedance, e.g., at 7.5 s the force is 6.558 N at low impedance and 10.454 N at higher impedance, almost 4 N more and 37% more. Also, at 20 s, the force is 13.59 N at lower impedance and 19.16 N at higher impedance, almost 6 N more, an increase of 29%. On average, the force is increased by 33% when the impedance is doubled, which shows that the controller controlled the force well after detecting the impedance.
Traditional rehabilitation methods come with inherent limitations, such as the requirement for one-on-one sessions with healthcare providers and the absence of monitoring during unsupervised exercises. These drawbacks often compromise the effectiveness of the treatment and increase the risk of relapse. In contrast, our proposed robotic system aims to mitigate these issues by offering smart, adaptive guidance. This feature allows patients to engage in rehabilitation tasks independently, with the robot offering real-time feedback and making dynamic adjustments to the exercise parameters. Such adaptability ensures that patients are continuously challenged according to their individual progress.
To further enhance the system’s utility, a user-centered design approach was employed. We conducted a survey involving prospective end users to gather insights into their specific needs and preferences. These findings were integrated into the system’s design to make it not just easy to use but also more effective in meeting rehabilitation goals. This approach underscores our commitment to delivering a system that supersedes traditional methods not only in terms of efficiency but also in the quality of care provided.
Compared to similar controllers in the field of rehabilitation robotics, this system has some advantages. For example, there are some systems that use robust and adaptive control [29,30] which have made important contributions to the field. However, our approach is characterized by its adaptability and stability, which are mainly facilitated by the integration of artificial intelligence systems and self-correction mechanisms. Unlike traditional control architectures, our AI-driven model allows real-time adjustments based on complex tomography signals, providing a better understanding of muscle health and activity. This capability improves both the predictive accuracy and safety of the rehabilitation process. In addition, the system’s self-correction function adapts to the changing impedance of the patient’s hand, ensuring that the applied torque remains within a safe and effective range. Overall, these advances contribute to more personalized, robust and reliable rehabilitation.

4. Conclusions

Advancements in rehabilitation robotics have made significant progress in recent decades. Through the use of technical solutions, experts aim to facilitate the restoration of body functions. Given recent developments in artificial intelligence and tomography, it is necessary to combine these with rehabilitation. In this context, we propose here an automatic control system to control a rehabilitation robot for the wrist and forearm. A new protocol was proposed to determine the health status of the hand and the dynamic parameters of the human–robot interaction. Muscle stiffness during the course of rehabilitation treatment directly affects the torque produced by the patient. The suggested method acknowledges this constraint and incorporates a control mechanism that evaluates muscle stiffness levels and adjusts the estimated torque values in real time. To manage the robotic system and offer data storage and reporting capabilities, a human–machine interface was designed and implemented. Tests were conducted with different participants and showed encouraging results. The results indicate that the system can predict the relationship between impedance and position within an acceptable range and also control the position and force according to the user’s impedance.
One of the notable advantages of this system lies in its cost effectiveness. Utilizing a single motor to achieve three degrees of freedom not only simplifies the mechanical design but also significantly reduces the hardware costs. Furthermore, the system is optimized for home-based rehabilitation, eliminating the need for patients to make frequent, potentially costly visits to healthcare providers. This home-based approach also allows healthcare providers to manage multiple patients more efficiently, thereby reducing operational costs. The convenience of a home-based system additionally means that patients can engage in rehabilitation exercises at their own pace and on their own schedule, further adding to the system’s overall cost effectiveness and patient-centric design.

5. Future Work

The current study lays the foundation for a robust and adaptive control system for rehabilitation robots, but several avenues remain open for future research. One possible direction is to refine the regression model that estimates muscle state based on tomography signals, possibly incorporating other imaging techniques or biosensors to gain a more comprehensive understanding of muscle health and activity. Exploring the scalability of the system to other types of rehabilitation or even completely different medical applications could also be a promising way to expand the impact of this technology.
Although robustness and reliability were considered in the development of the system, it is important to identify potential real-world challenges that could affect its practical application. These include system maintenance requirements, technical issues and the need for regular software updates to meet changing rehabilitation needs. Furthermore, any healthcare technology is only truly tested through its actual application. Therefore, extensive usability testing with multiple patients and therapists is planned for future studies. This will provide invaluable insights into the usability and effectiveness of the system and will serve to further refine both the technical elements and the user interface.

6. Patents

Abbasimoshaei, Alireza, and Kern, Thorsten Alexander; “Rehabilitation Apparatus for wrist and forearm therapy”; International Publicational Number: WO 2022/048906 A1.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomimetics8050420/s1, Figure S1: A general view of the manufactured device in different movements; Figure S2: Diagram of the forearm and wrist model; Figure S3: Resulting torque estimation flowchart; Figure S4: Connection of sensor and Arduino; Figure S5: Corresponding forces and torque for lower impedance; Figure S6: Corresponding forces and torque for higher impedance.

Author Contributions

Conceptualization, A.A. and T.A.K.; Data curation, A.K.C.R.; Formal analysis, A.K.C.R.; Investigation, A.K.C.R. and A.A.; Methodology, A.A. and T.A.K.; Project administration, A.A. and T.A.K.; Software, A.K.C.R.; Supervision, T.A.K.; Validation, A.K.C.R. and A.A.; Writing—original draft, A.A.; Writing—review and editing, A.A. and T.A.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethics approval was obtained from Hamburg University of Technology with the title Testing of a wrist rehabilitation system on 9 August 2022.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data and code will be made available on request to the correspondent author’s email with appropriate justification.

Acknowledgments

We are very grateful to all IMEK institute staff to for helping us. Publishing fees supported by Funding Programme Open Access Publishing of Hamburg University of Technology (TUHH).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bouteraa, Y.; Ben Abdallah, I.; Alnowaiser, K.; Islam, M.R.; Ibrahim, A.; Gebali, F. Design and development of a smart IoT-based robotic solution for wrist rehabilitation. Micromachines 2022, 13, 973. [Google Scholar] [CrossRef] [PubMed]
  2. Feigin, V.L.; Brainin, M.; Norrving, B.; Martins, S.; Sacco, R.L.; Hacke, W.; Fisher, M.; Pandian, J.; Lindsay, P. World Stroke Organization (WSO): Global stroke fact sheet 2022. Int. J. Stroke 2022, 17, 18–29. [Google Scholar] [CrossRef] [PubMed]
  3. Chang, W.H.; Kim, Y.H. Robot-assisted therapy in stroke rehabilitation. J. Stroke 2013, 15, 174. [Google Scholar] [CrossRef] [PubMed]
  4. Dietz, V.; Fouad, K. Restoration of sensorimotor functions after spinal cord injury. Brain 2014, 137, 654–667. [Google Scholar] [CrossRef]
  5. Qian, Z.; Bi, Z. Recent Development of Rehabilitation Robots. Adv. Mech. Eng. 2015, 7, 563062. [Google Scholar] [CrossRef]
  6. AbbasiMoshaii, A.; Najafi, F. Design, evaluation and prototyping of a new robotic mechanism for ultrasound imaging. J. Comput. Appl. Mech. 2019, 50, 108–117. [Google Scholar]
  7. Mohebbi, A. Human-robot interaction in rehabilitation and assistance: A review. Curr. Robot. Rep. 2020, 1, 131–144. [Google Scholar] [CrossRef]
  8. Howard, A.; Brooks, D.; Brown, E.; Gebregiorgis, A.; Chen, Y.P. Non-contact versus contact-based sensing methodologies for in-home upper arm robotic rehabilitation. In Proceedings of the 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR), Seattle, WA, USA, 24–26 June 2013; pp. 1–6. [Google Scholar] [CrossRef]
  9. Shah, D.S.; Powers, J.P.; Tilton, L.G.; Kriegman, S.; Bongard, J.; Kramer-Bottiglio, R. A soft robot that adapts to environments through shape change. Nat. Mach. Intell. 2021, 3, 51–59. [Google Scholar] [CrossRef]
  10. Moshaii, A.A.; Masouleh, M.T.; Zarezadeh, E.; Farajzadeh, K. Static analysis of a 3-RRS and a 3-RSR Spherical Parallel Robots. In Proceedings of the 2015 3rd RSI international conference on robotics and mechatronics (ICROM), Tehran, Iran, 7–9 October 2015; pp. 800–804. [Google Scholar]
  11. Meng, Q.; Zhang, H.; Yu, H. An Internet of Things Framework Based on Upper Limb Rehabilitation Robots for Rehabilitation. In Advances in Intelligent Systems and Interactive Applications: Proceedings of the Advances in Intelligent, Interactive Systems and Applications; Xhafa, F., Patnaik, S., Tavana, M., Eds.; Springer: Cham, Switzerland, 2019; pp. 752–759. [Google Scholar]
  12. Payedimarri, A.B.; Ratti, M.; Rescinito, R.; Vanhaecht, K.; Panella, M. Effectiveness of Platform-Based Robot-Assisted Rehabilitation for Musculoskeletal or Neurologic Injuries: A Systematic Review. Bioengineering 2022, 9, 129. [Google Scholar] [CrossRef]
  13. Niestanak, V.D.; Moshaii, A.A.; Moghaddam, M.M. A new underactuated mechanism of hand tendon injury rehabilitation. In Proceedings of the 2017 5th RSI International Conference on Robotics and Mechatronics (ICRoM), Tehran, Iran, 25–27 October 2017; pp. 400–405. [Google Scholar]
  14. Burgar, C.G.; Lum, P.S.; Shor, P.C.; Van der Loos, H.M. Development of robots for rehabilitation therapy: The Palo Alto VA/Stanford experience. J. Rehabil. Res. Dev. 2000, 37, 663–674. [Google Scholar]
  15. Cai, S.; Li, G.; Su, E.; Wei, X.; Huang, S.; Ma, K.; Zheng, H.; Xie, L. Real-Time Detection of Compensatory Patterns in Patients With Stroke to Reduce Compensation During Robotic Rehabilitation Therapy. IEEE J. Biomed. Health Inform. 2020, 24, 2630–2638. [Google Scholar] [CrossRef] [PubMed]
  16. Rahim, K.N.K.A.; Elamvazuthi, I.; Vasant, P.; Ganesan, T. Robotic Assistive System: Development of a Model based on Artificial Intelligent Technique. In Robotic Systems: Concepts, Methodologies, Tools, and Applications; IGI Global: Hershey, PA, USA, 2020; pp. 1688–1720. [Google Scholar]
  17. Matheson Rittenhouse, D.; Abdullah, H.A.; John Runciman, R.; Basir, O. A neural network model for reconstructing EMG signals from eight shoulder muscles: Consequences for rehabilitation robotics and biofeedback. J. Biomech. 2006, 39, 1924–1932. [Google Scholar] [CrossRef] [PubMed]
  18. Guo, S.; Zhang, F.; Wei, W.; Zhao, F.; Wang, Y. Kinematic analysis of a novel exoskeleton finger rehabilitation robot for stroke patients. In Proceedings of the 2014 IEEE International Conference on Mechatronics and Automation, Tianjin, China, 3–6 August 2014; pp. 924–929. [Google Scholar] [CrossRef]
  19. Adler, A.; Holder, D. Electrical Impedance Tomography: Methods, History and Applications; CRC Press: Boca Raton, FL, USA, 2021. [Google Scholar]
  20. Frerichs, I.; Dargaville, P.A.; van Genderingen, H.; Morel, D.R.; Rimensberger, P.C. Lung volume recruitment after surfactant administration modifies spatial distribution of ventilation. Am. J. Respir. Crit. Care Med. 2006, 174, 772–779. [Google Scholar] [CrossRef] [PubMed]
  21. Gómez-Cortés, J.C.; Díaz-Carmona, J.J.; Padilla-Medina, J.A.; Calderon, A.E.; Gutiérrez, A.I.B.; Gutiérrez-López, M.; Prado-Olivarez, J. Electrical Impedance Tomography Technical Contributions for Detection and 3D Geometric Localization of Breast Tumors: A Systematic Review. Micromachines 2022, 13, 496. [Google Scholar] [CrossRef] [PubMed]
  22. Rezanejad Gatabi, Z.; Mirhoseini, M.; Khajeali, N.; Rezanezhad Gatabi, I.; Dabbaghianamiri, M.; Dorri, S. The accuracy of electrical impedance tomography for breast cancer detection: A systematic review and meta-analysis. Breast J. 2022, 2022, 8565490. [Google Scholar] [CrossRef] [PubMed]
  23. Ke, X.Y.; Hou, W.; Huang, Q.; Hou, X.; Bao, X.Y.; Kong, W.X.; Li, C.X.; Qiu, Y.Q.; Hu, S.Y.; Dong, L.H. Advances in electrical impedance tomography-based brain imaging. Mil. Med. Res. 2022, 9, 10. [Google Scholar] [CrossRef]
  24. Charles, S.K.; Hogan, N. Dynamics of wrist rotations. J. Biomech. 2011, 44, 614–621. [Google Scholar] [CrossRef]
  25. Peaden, A.W.; Charles, S.K. Dynamics of wrist and forearm rotations. J. Biomech. 2014, 47, 2779–2785. [Google Scholar] [CrossRef]
  26. De Leva, P. Adjustments to Zatsiorsky-Seluyanov’s segment inertia parameters. J. Biomech. 1996, 29, 1223–1230. [Google Scholar] [CrossRef]
  27. Luna, J.M.M.; Luna, A.M.; Fernández, R.E.H. Characterization and Differentiation between Olive Varieties through Electrical Impedance Spectroscopy, Neural Networks and IoT. Sensors 2020, 20, 5932. [Google Scholar] [CrossRef]
  28. Budoya, D.; Baptista, F. Signal Acquisition from Piezoelectric Transducers for Impedance-Based Damage Detection. Proceedings 2018, 2, 4894. [Google Scholar] [CrossRef]
  29. Wu, Q.; Xu, D.; Chen, B.; Wu, H. Integral fuzzy sliding mode impedance control of an upper extremity rehabilitation robot using time delay estimation. IEEE Access 2019, 7, 156513–156525. [Google Scholar] [CrossRef]
  30. Du, Y.; Wang, H.; Qiu, S.; Yao, W.; Xie, P.; Chen, X. An advanced adaptive control of lower limb rehabilitation robot. Front. Robot. AI 2018, 5, 116. [Google Scholar] [CrossRef] [PubMed]
Figure 1. (a) Flexion/extension wrist movement. (b) Ulnar/radial wrist movement. (c) Supination/pronation forearm movement.
Figure 1. (a) Flexion/extension wrist movement. (b) Ulnar/radial wrist movement. (c) Supination/pronation forearm movement.
Biomimetics 08 00420 g001
Figure 2. General view of the system.
Figure 2. General view of the system.
Biomimetics 08 00420 g002
Figure 4. Robot control architecture.
Figure 4. Robot control architecture.
Biomimetics 08 00420 g004
Figure 5. Sensor assembly from side and back views.
Figure 5. Sensor assembly from side and back views.
Biomimetics 08 00420 g005
Figure 6. Impedance analyzer system setup.
Figure 6. Impedance analyzer system setup.
Biomimetics 08 00420 g006
Figure 7. Operating system flow chart.
Figure 7. Operating system flow chart.
Biomimetics 08 00420 g007
Figure 8. Impedance variation across different positions before noise filtering.
Figure 8. Impedance variation across different positions before noise filtering.
Biomimetics 08 00420 g008
Figure 9. Impedance variation across different positions after noise filtering.
Figure 9. Impedance variation across different positions after noise filtering.
Biomimetics 08 00420 g009
Figure 10. Comparison of predicted impedance and impedance with respect to angle.
Figure 10. Comparison of predicted impedance and impedance with respect to angle.
Biomimetics 08 00420 g010
Figure 11. Region of uncertainty.
Figure 11. Region of uncertainty.
Biomimetics 08 00420 g011
Figure 12. Navigating the participant hand to the desired position. (a) Lowest impedance. (b) Medium impedance. (c) Highest impedance.
Figure 12. Navigating the participant hand to the desired position. (a) Lowest impedance. (b) Medium impedance. (c) Highest impedance.
Biomimetics 08 00420 g012
Figure 13. Average force comparison (blue is higher impedance and orange is lower impedance).
Figure 13. Average force comparison (blue is higher impedance and orange is lower impedance).
Biomimetics 08 00420 g013
Table 1. Main mechanical components.
Table 1. Main mechanical components.
Piece NameMaterialQuantity
Forearm holderPlastic1
Motor holderSteel2
MotorDynamixel motor1
Rotating plateAluminium1
Horizontal railAluminium1
Motor place regulatorAluminium1
Table 2. Patient exercise report.
Table 2. Patient exercise report.
NameAgeDateTimeRepetitionFlexionExtensionUlnarRadialSupinationPronation
2702202309:47:0010105532015
2702202321:16:006128542317
2802202308:56:008138752719
2802202318:34:00121510962919
2902202310:12:00316121283221
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Abbasimoshaei, A.; Chinnakkonda Ravi, A.K.; Kern, T.A. Development of a New Control System for a Rehabilitation Robot Using Electrical Impedance Tomography and Artificial Intelligence. Biomimetics 2023, 8, 420. https://doi.org/10.3390/biomimetics8050420

AMA Style

Abbasimoshaei A, Chinnakkonda Ravi AK, Kern TA. Development of a New Control System for a Rehabilitation Robot Using Electrical Impedance Tomography and Artificial Intelligence. Biomimetics. 2023; 8(5):420. https://doi.org/10.3390/biomimetics8050420

Chicago/Turabian Style

Abbasimoshaei, Alireza, Adithya Kumar Chinnakkonda Ravi, and Thorsten Alexander Kern. 2023. "Development of a New Control System for a Rehabilitation Robot Using Electrical Impedance Tomography and Artificial Intelligence" Biomimetics 8, no. 5: 420. https://doi.org/10.3390/biomimetics8050420

APA Style

Abbasimoshaei, A., Chinnakkonda Ravi, A. K., & Kern, T. A. (2023). Development of a New Control System for a Rehabilitation Robot Using Electrical Impedance Tomography and Artificial Intelligence. Biomimetics, 8(5), 420. https://doi.org/10.3390/biomimetics8050420

Article Metrics

Back to TopTop