Next Article in Journal
A Review on Soft Error Correcting Techniques of Aerospace-Grade Static RAM-Based Field-Programmable Gate Arrays
Next Article in Special Issue
Innovative Detection and Segmentation of Mobility Activities in Patients Living with Parkinson’s Disease Using a Single Ankle-Positioned Smartwatch
Previous Article in Journal
Object Detection and Information Perception by Fusing YOLO-SCG and Point Cloud Clustering
Previous Article in Special Issue
Between-Session Reliability of Field-Based Assessments of Isometric Neck Strength
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

User-Centered Evaluation of the Wearable Walker Lower Limb Exoskeleton; Preliminary Assessment Based on the Experience Protocol

by
Cristian Camardella
1,*,†,
Vittorio Lippi
2,3,†,
Francesco Porcini
1,
Giulia Bassani
1,
Lucia Lencioni
4,
Christoph Mauer
3,
Christian Haverkamp
2,
Carlo Alberto Avizzano
1,
Antonio Frisoli
1 and
Alessandro Filippeschi
1
1
Institute of Mechanical Intelligence and Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
2
Institute of Digitalization in Medicine, Faculty of Medicine and Medical Center—University of Freiburg, 79106 Freiburg, Germany
3
Clinic of Neurology and Neurophysiology, Medical Centre—University of Freiburg, Faculty of Medicine, University of Freiburg, Breisacher Straße 64, 79106 Freiburg im Breisgau, Germany
4
Wearable Robotics S.r.L., 56010 Pisa, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Sensors 2024, 24(16), 5358; https://doi.org/10.3390/s24165358
Submission received: 13 July 2024 / Revised: 10 August 2024 / Accepted: 16 August 2024 / Published: 19 August 2024
(This article belongs to the Collection Sensors for Gait, Human Movement Analysis, and Health Monitoring)

Abstract

:
Using lower limb exoskeletons provides potential advantages in terms of productivity and safety associated with reduced stress. However, complex issues in human–robot interactions are still open, such as the physiological effects of exoskeletons and the impact on the user’s subjective experience. In this work, an innovative exoskeleton, the Wearable Walker, is assessed using the EXPERIENCE benchmarking protocol from the EUROBENCH project. The Wearable Walker is a lower-limb exoskeleton that enhances human abilities, such as carrying loads. The device uses a unique control approach called Blend Control that provides smooth assistance torques. It operates two models simultaneously, one in the case in which the left foot is grounded and another for the grounded right foot. These models generate assistive torques combined to provide continuous and smooth overall assistance, preventing any abrupt changes in torque due to model switching. The EXPERIENCE protocol consists of walking on flat ground while gathering physiological signals, such as heart rate, its variability, respiration rate, and galvanic skin response, and completing a questionnaire. The test was performed with five healthy subjects. The scope of the present study is twofold: to evaluate the specific exoskeleton and its current control system to gain insight into possible improvements and to present a case study for a formal and replicable benchmarking of wearable robots.

1. Introduction

In recent years, lower limb exoskeletons (LLEs) have emerged as groundbreaking innovations, impacting society as both medical devices and assisting devices in industry and logistics.
In the medical field, these wearable robotic devices are designed to support the lower limbs, enabling users to stand, walk, and even regain a semblance of natural movement. The usefulness and adoption of lower limb exoskeletons have the potential to reshape the lives of millions, transcending physical limitations and ushering in a new era of mobility.
In the fast-paced world of industry and logistics, the adoption of lower limb exoskeletons is emerging as a transformative force, revolutionizing the way tasks are performed and redefining the capabilities of human workers. These wearable robotic devices, originally designed to aid individuals with mobility challenges, have found a unique niche in the industrial and logistics sectors, in which they have the potential to enhance productivity, reduce fatigue, and minimize the risk of work-related injuries. By supporting and redistributing the load and reducing the strain on the lower limbs and back, these devices can contribute to a significant decrease in musculoskeletal injuries, fostering a safer and healthier working environment.
The adoption of LLEs in both fields faces barriers related to the ergonomics of the devices, their ability to support productivity, and their cost [1,2,3]. The trade-off between LLE performance and cost has led to design simplifications, such as the reduction in degrees of freedom (DoFs) and actuated DoFs, which may impact the usability of the devices and limit the adoption of LLEs [4]. Therefore, the effects of such simplifications need a thorough evaluation to assess the benefits for the user as a first step towards adoption. In recent years, there have been many attempts to evaluate LLE, especially based on kinetic and physiological measures gathered both in the laboratory and in field experiments [5,6].
The EUROBENCH project has made a significant step towards standardization of exoskeleton assessment [7]. This project fostered the development of a benchmarking facility where LLEs can be evaluated using custom or preliminary validated experimental protocols. In fact, this project funded both the development of testing protocols and the evaluation of existing exoskeletons, thus allowing for a fair comparison of different platforms, which is of great value for the scientific community.
In the EXOSMOOTH project [8,9], we targeted the evaluation of the Wearable Walker LLE when using an innovative control strategy [10] for assisted walking while carrying loads. To this end, we opted for a psychophysiological assessment of our exoskeleton using the EXPERIENCE protocol [11,12,13]. This protocol is user-centered, as it ties the evaluation of the LLE to the user’s reactions to its use both in terms of physiological measures such as stress, fatigue, and attention and through a physiological assessment based on a questionnaire on functionality, acceptability, perceptibility, and usability.
This paper reports the preliminary results of this evaluation that show how the exoskeleton does not significantly increase stress on the user in assisted walking, that it is positively evaluated by users. At the same time, there is room for improvement in terms of changes in physiological parameters.

2. Materials and Methods

2.1. The Wearable Walker Exoskeleton

The Wearable Walker, depicted in Figure 1, stands as an innovative, powered lower limb exoskeleton designed to offer assistance to post-stroke injured patients in their daily activities while simultaneously enhancing human capabilities, particularly in load-carrying tasks. The exoskeleton has a rigid structure consisting of seven interconnected links, each featuring two active degrees of freedom (DoFs) per leg—specifically, hip and knee flexion/extension—and two non-actuated DoFs per leg—ankle flexion/extension and ankle inversion/eversion, with the latter remaining unsensorized.
The human–exoskeleton interfaces are placed at the pelvis/shoulders, the thighs, and the feet. The first allows the user to sustain the weight of the exoskeleton when assistance is not activated and constrains the back to follow the motion of the user’s pelvis. Interfaces at the thighs have two DoFs, one translational along the thigh link of the exoskeleton and a rotational one whose axis is aligned to the flexion axes of the exoskeleton (see Figure 1). This solution allows differently-sized users to wear and comfortably use the Wearable Walker. Finally, users can place their own shoes on the exoskeleton’s feet and tie them to the exoskeleton’s feet by means of belts. Therefore, users can raise their heels during the stance phase of gait, making walking more comfortable and avoiding the user’s perception that their feet are glued to the ground when they need to quit the stance phase.
Standing at a height of 110 cm, a width of 65 cm, and weighing 15 kg (excluding batteries), the Wearable Walker’s physical dimensions make it a versatile and robust device for diverse applications. Table 1 provides comprehensive details on link lengths and masses, contributing to a comprehensive understanding of the exoskeleton’s physical attributes.
Utilizing brushless torque motors, specifically, the RoboDrive Servo ILM 70 × 18 Robodrive GMBH, Seefeld, Germany, coupled with a tendon-driven transmission system comprising a screw and a pulley, each actuated joint experiences a remarkable reduction ratio of 1:73.3 and ensures high efficiency exceeding 90%. This direct motion performance makes efficiency in reverse motion high enough to guarantee good back driveability. The sensory capabilities of the Wearable Walker include Hall-effect sensors on each joint, along with encoders on every motor shaft. In addition, the four force sensor resistors in each shoe insole provide valuable feedback during weight-bearing activities. Moreover, four one-axis load cells are suitably positioned on the thigh interface of each leg, measuring interaction forces in the sagittal plane and perpendicular to the thighs. These forces represent the primary interactions between the exoskeleton and the user during straight walking, ensuring optimal support and adaptability. Signal acquisition and motor control are realized by two boards placed on each thigh, as shown in Figure 2. The exoskeleton’s backlink serves as the hub for essential components. Housing the power electronics group, it accommodates a 48 V, 14 Ah battery weighing 4.3 kg and a voltage conversion board. Meanwhile, the control unit comprises a computer operating Simulink Real-Time running at 5 KHz frequency and a Wi-Fi communication module. This sophisticated control unit establishes communication with the low-layer control module of each leg through the EtherCAT protocol, facilitating seamless coordination and synchronization. Figure 2 shows the communication blocks along with the computing units. Additionally, a host PC can remotely control the Simulink Real-Time PC through the Wi-Fi module, allowing for real-time adjustments and monitoring.

2.2. Control Strategy

There are three layers in the control strategy [10]. Based on two look-up tables—one based on joint velocities and the other on joint positions—the lowest layer compensates for friction and ripples. The middle layer makes the assumption that the exoskeleton can only be in one of two single-stance configurations: either right-foot or left-foot-grounded, or in a double-stance that combines the two single-stance configurations. Therefore, two kinematic models and related compensation models are applied for the two single-stance phases. Equation (1) provides the joint angle vectors for both the left-foot-grounded stance and the right-foot-grounded single stance, with reference to Figure 1:
q = q R H q R K q R A q L H q L K q L A T q L = q L A q L K q L H q R H q R K T q R = q R A q R K q R H q L H q L K T ,
where q , q L , and q R are vectors of joint variables suitably arranged to compute inertial, gravity, friction, and ripple compensations. This middle layer provides inertia and gravity compensations based on these kinematic models. Equation (2) reports the overall compensation for each single-stance model, which includes low-level control:
τ L = B L ( q L ) q ¨ L + G L ( q L ) + τ F ( q ˙ ) + τ r ( q ) τ R = B R ( q R ) q ¨ R + G R ( q R ) + τ F ( q ˙ ) + τ r ( q ) ,
where q ¨ L and q ¨ R are the joint acceleration vectors, B L and B R are the inertia matrices, G L and G R are the gravity vectors, and τ F and τ r are, respectively, the friction and the ripple compensation. Single-stance assistance, thanks to gait segmentation, is combined by means of high-level control (see Equation (2)) to build the final assistive torques τ provided to the user. Figure 2 shows the blocks that provide the ripple, friction, inertia, and gravity components of the assistive torques highlighted in red.

2.2.1. Gait Segmentation

The suggested method takes advantage of a classifier that produces a continuous gait phase class that ranges from + 1 (left-footed single stance) to 1 (right-footed single stance) based on a linear regression of the joint angles. Every new user requires training of the regressor, which depends on the user. As a result, a quick ( 2 ) training phase has been added, during which the user must perform the following tasks: (1) three full swings with the left leg (left-foot-grounded single stance); (2) three full swings with the right leg; and (3) walking on a treadmill at a variable speed of between one to three kilometers per hour using 0.5 km/h speed steps. In this phase, gait stages are labeled using sole pressures. With the help of labeled data, the linear regressor is trained to identify the subject gait phases by reducing the classification error. Therefore, the regression problem is framed as follows given the labeled data p ( t ) R T (where T is the number of samples in the training set) and the joint angles over time Q ( t ) R T × n (where n = 6 is the number of joints):
Y = a r g m i n Y R n Y Q ( t ) p ( t ) 2 .

2.2.2. Blend Control

To ensure a seamless aid transition between the gait phases, τ R and τ L can be blended based on the regression’s result Y. The suggested method blends the compensatory torques using two continuously varying gains between 0 and 1. Therefore, these two gains are defined as follows:
γ L ( q ) = 1 2 ( Y q + 1 ) [ 0 , 1 ] R γ R ( q ) = 1 γ L ( q ) ,
and the overall assistance is given as in Equation (5):
τ = γ L ( q ) τ L + γ R ( q ) τ R τ = γ L ( q ) ( B L ( q L ) q ¨ L + G L ( q L ) ) + γ R ( q ) ( B R ( q R ) q ¨ R + G R ( q R ) ) + τ F ( q ˙ ) + τ r ( q ) .
The total assistance is continuous since the modulation coefficients γ L and γ R are continuous. This ensures seamless support regardless of the gait phase shift. Unlike smoothed finite state machine-based controls, this method ensures that the assistance is always consistent with the gait phase, even when changes occur. It is anticipated that this will increase transparency and reduce interaction pressures. Blend Control is the term used to describe this support technique [10].

2.3. Experimental Protocol

2.3.1. The EXPERIENCE Sub-Project

The EXPERIENCE sub-project aims to provide developers of lower limb exoskeletons and clinical experimenters with a benchmarking method capable of catching the USP of end users by using a newly developed multi-factor questionnaire called the EXPERIENCE Questionnaire (EQ), as well as algorithms to extract psychophysiological indicators based on physiological data. The main outcomes of the sub-project include benchmarking software for the user-centered assessment of exoskeleton-assisted overground and treadmill-based walking, divided into two modules:
  • Module 1: Based on the newly developed multi-factor questionnaire;
  • Module 2: Algorithms to extract psychophysiological indicators starting from the physiological measures gathered as described in the following paragraph.

2.3.2. Physiological Measures

The EXPERIENCE protocol requires the sensors to be used to gather physiological measures [13]. Those included in the protocol are the galvanic skin response (GSR), heart rate (HR), heart rate variability (HRV), and respiration rate (RR), which are the physiological performance indicators (PIs). These were monitored using two commercially available devices: the ZephyrBioModule 3 sensor from Medtronic (Minneapolis, MN, USA), which employs a chest belt to measure RR and electrocardiogram (ECG), and the Shimmer sensor, which captures GSR via electrodes positioned on the index and middle fingers. The ZephyrBioModule 3 sensor provided insights into respiratory patterns and cardiac activity, while the Shimmer sensor allowed for precise monitoring of GSR, reflecting sympathetic nervous system activity.

2.3.3. Participants

Five subjects have been enrolled in this study (4 males, 1 female, aged 32.2 ± 6.98 years, 180.4 ± 7.77 cm height), attending the experiments at the exoskeleton benchmarking facility of Los Madronos Hospital in Brunete, Madrid, supported by the EUROBENCH European project. Before starting the experiment, all subjects signed the informed consent given by the experimenter. This study has been approved by the Scuola Superiore Sant’Anna and the CSIC ethical committees.

2.3.4. Protocol

The EXPERIENCE experimental protocol for each assessment session is based on the step reported below. The experimenter has to:
  • Place the two physiological sensors onto the subject’s body:
    (a)
    ZephyrBioModule 3 sensor, connected to a Zephyr™ band featuring ECG and breathing sensors, aligning conductive ECG sensors with the center of the chest and the breathing sensor with the left side of the thorax, slightly moistening the pad surfaces with water to promote conductivity;
    (b)
    Shimmer GSR sensor (Dublin, Ireland), attached to the patient’s wrist using the adjustable strap. The electrodes must be placed on the back of the index and middle finger of the non-dominant hand.
  • Start data collection software and start recording of physiological data.
  • Ask the subject to sit with eyes closed and let her/him relax.
  • Mark the beginning of the recording of the seated baseline on the data collection software and mark the stop when finished. Time duration of recording is 4 min and has to be measured by a chronometer.
  • Place the exoskeleton onto the subject’s body and let it relax.
  • Flag the start of the recording of the standing baseline on the data collection software and flag the stop when finished.
  • Start the robot-assisted walking session and wait until a steady-state condition is reached. The steady-state condition is reached when assistance parameters are not changed anymore and the subject is walking comfortably without any major change.
  • Flag the start of the recording of the walking condition on the data collection software and flag the stop when finished. Time duration of recording is 16 min and has to be measured by a chronometer.
  • Stop the walking session and stop data collection software.
  • Remove physiological sensors and the exoskeleton.
  • Start the questionnaire compilation (see Section 2.4).

2.4. Questionnaire

The EUROBENCH benchmarking team created the multifactorial EQ to evaluate the lower limb exoskeleton in situations involving overground and treadmill rehabilitation. Thanks to psychological theories on technology acceptance and usability quality models in the literature, factors that are appropriate for evaluating user experience when using assistive lower limb exoskeletons and rehabilitation during usage have been identified. Four factors (usability, acceptability, perceptibility, and functionality) comprise the 16 sub-factors that we found (Table 1). There are 132 items in total on the questionnaire. A seven-point Likert-type scale, ranging from 1 for “I strongly disagree” to 7 for “I strongly agree”, must be used to assess each question. A new reversed score of 7 + 1 5 = 3 is mapped for the reversed item “The exoskeleton is useless”, which has a score of 5. Other items have their scores adjusted as well. In order to assess the user’s consistency in assigning scores to items that are highly similar, the EQ has a control sub-scale called the consistency scale. Control items—rephrased versions of previously administered items—are concealed inside the EQ in order to achieve this goal. Similar item scores can be compared, and differences between the scores may suggest that the subjects’ responses are not entirely reliable. The EUROBENCH benchmarking team provided the EXPERIENCE questionnaire software, which was used to gather data.

Questionnaire PIs

The adopted questionnaire allowed us to obtain 4 PIs:
  • Usability, which is defined as how effectively, efficiently, and satisfactorily users can use the exoskeleton to achieve specific goals.
  • Acceptability, which refers to the users’ perception of the exoskeleton and their willingness to incorporate it into daily life.
  • Perceptibility, which measures the emotional and perceptual impact of using the exoskeleton and its effect on quality of life. A high value indicates a positive influence.
  • Functionality, which assesses how the user perceives the exoskeleton in terms of ease of learning, flexibility of interaction, reliability, and workload.
The calculation of PIs is based on three-level scoring ([12,13]):
s s = 1 N i k = 1 N i i s k f s = 2 N s ( N s 1 ) k = 1 N s w k s s k ,
with N i being the total number of items belonging to each sub-factor, N s the total number of sub-factors belonging to each factor, and N f the total number of factors. The weights w k are derived from the comparison between pairs of sub-factors (pairwise comparison) administered to the subject under testing. Sub-factors are sorted based on the number of collected preferences so that the weights are consequently assigned. The f s formula is used to calculate PIs.
The computation of the user’s consistency is based on the difference between the scores assigned to two similar items (the original item included in the EQ and the control rephrased item hidden within it). This difference will be indicated as control item discrepancy. A total of 16 control items has been included. An item and its control are considered to be scored in a consistent way if the control item discrepancy is in the range [ 1 , 1 ] . A higher control item discrepancy causes a proportional decrease in the total consistency score (maximum 100 % ).

2.5. Psychophysiological PIs

The following are the four psychophysiological PIs:
  • Stress is characterized as a condition of mental or emotional tension brought on by unfavorable events. A high PI score suggests that using a robot can be stressful.
  • Energy means the quantity of energy required to perform bodily tasks. A high PI number suggests that using a robot involves a lot of work.
  • Attention describes the level of conscious and ongoing user involvement in the work. A high value for this PI suggests that using a robot demands careful attention.
  • Fatigue is distress typically caused by the muscles in the body becoming too tired to do a task. A high PI score suggests that the robot use induces fatigue.
The ECG data were processed to derive the power distribution in the low frequency (LF) band (0.04–0.15 Hz). The GSR signal was split into two parts: the skin conductance response (SCR), which is an event-dependent, phasic, and highly responsive parameter, and the skin conductance level (SCL), which is the tonic level in the absence of any specific environmental event. For the purpose of extracting the four PI indicators of stress, fatigue, energy expenditure, and attention, a fuzzy logic approach method was used ([12,13]). Only the last 5 min of the recording were taken into account, and the physiological signals from the walking phase were normalized in relation to the information gathered during the sitting phase. The six inputs (HR, RMSSD, RR, SCR, SCL, and LF) and four outputs (PIs) were used in the fuzzy logic technique. The membership functions were created for each physiological signal by accounting for the total number of occurrences in all of the data that were gathered. Specifically, three levels (low, medium, and high) were introduced for the model’s inputs and outputs. The IF/THEN rules were developed using physiological signal variation trends that were discovered through a thorough review of the scientific literature. In order to estimate the four PIs, these algorithms integrate all of the physiological data that were provided.

3. Results

The analysis of the proposed PIs resulted in three main results concerning the analysis of the physiological signals as reported in Figure 3, the psychophysiological metrics in Figure 4, and the questionnaire answers plotted in Figure 5. The physiological measures showed no differences between the SIT and SIT EXO phases for HR, RR, and HRV, while it showed a reduction in the GSR measure from 630 ms to 185 ms. Instead, between the SIT EXO and WALK phases, an increase in HR (from 80 bpm to 118 bpm) and RR (from 19 bpm to 31 bpm) occurred, while GSR and HRV did not show any significant variation.
Regarding the psychophysiological PIs, levels of stress and attention do not vary during the execution of the task (equal to, respectively, 0.48 and 0.47 ), while fatigue and energy increase halfway through the experiment and drop in the end. As a last result, the exoskeleton received moderately positive feedback for all factors, with the best scores in acceptability (mean μ = 5.19 and STD σ = 1.31 ) and perceptibility ( μ = 5.25 , σ = 1.07 ). Usability seems to be the most critical aspect, ranking slightly above the average ( μ = 4.59 , σ = 1.06 ) while functionality lies halfway between them ( μ = 4.94 , σ = 0.99 ).

4. Discussion and Conclusions

The benchmarking platform allowed us to assess the exoskeleton’s performance from different points of view. In particular, within the EXPERIENCE protocol, subjects were able to complete the circuit with the exoskeleton, carrying an overall weight equal to 7 kg on their back (e.g., battery weight). The presence of the exoskeleton does not significantly alter the physiological measurements when in a seated position, while a substantial increase in the heart rate and respiration rate occurs during walking, as it appears from Figure 3. Comparing this increase with standard load-carrying activities without exoskeletons, the heart rate, heart rate variability, and respiration rate are comparable with findings in [14,15,16] and moderately higher than walking without carrying loads [17], thus suggesting room for improvement in the current version of the exoskeleton by adding assistance at the ankle joint.
Regarding psychophysiological metrics shown in Figure 4, the exoskeleton does not affect either the stress or the attention of the user, meaning that no mental workload occurs while wearing the exoskeleton. This result pushes forward the actual possibility of using robotic systems in load-carrying operative conditions. Subject 1 shows higher differences in terms of fatigue, energy, HRV, and GSR compared to other subjects. Since all metrics depend on the performed measurements, these are also strongly correlated with the emotional state of the subject, becoming very subjective and, thus, very susceptible to differences among subjects. Given the low sample size of tested subjects, these differences already reflect those of a potentially wider population and are of higher statistical interest. In the literature, the mental workload of using robots and exoskeletons has often been linked to an increase in physiological measures such as heart rate and heart rate variability, or to a decrease in galvanic skin response [18]. However, in the case of analyses in which a physical activity is included, there is no significant correlation between these measures and a potential mental workload given the overlapping behavior of these metrics in these contexts. Instead, fatigue and energy expenditure occur after reaching a steady state during walking, coherently linked to the increase in physiological measures as aforementioned. Questionnaire answers reported in Figure 5 and Section 3, although subjective, revealed positive feedback, on average, on all four PIs, especially on the acceptability and perceptibility ones. Usability was scored less, on average, given the absence of useful DoFs (e.g., hip abduction/adduction or ankle lateral/medial rotation) on the exoskeleton, which affected the gait pattern.
In conclusion, the benchmarking platform successfully assessed the performance of the Wearable Walker lower limb exoskeleton, revealing the efficacy of the control strategy and a low mental workload, but also showing that further improvements from the assistive and constructive design point of view should be carried out.
Future research will involve testing an actuated ankle to explore advanced control possibilities and study balance control, as described in [19]. A reduced number of actuated joints in a lower limb exoskeleton decreases the device’s cost, making it more marketable. In fact, most existing exoskeletons do not include ankle actuation. However, studies on human and humanoid posture control and balance have emphasized the significance of ankle torque for standing [20,21,22,23]. Comparing configurations with and without ankle actuation could clarify the ankle joint’s role and inspire the development of self-balancing exoskeletons or those that assist with balance. The ability to switch smoothly between two controllers is an important feature of the Blend Control (Section 2.2). This will benefit from future improvements in the identification of the exoskeleton state, such as those reported in [9,24,25,26].

Author Contributions

Conceptualization, A.F. (Alessandro Filippeschi), C.C., F.P. and V.L.; methodology, A.F. (Alessandro Filippeschi), C.C., F.P. and V.L.; software, A.F. (Alessandro Filippeschi), C.C., F.P. and G.B.; validation, A.F. (Alessandro Filippeschi), C.C., F.P. and V.L.; formal analysis, C.C., V.L. and C.H.; investigation, C.C., V.L. and C.H.; resources, V.L., A.F. (Alessandro Filippeschi), C.M., L.L., C.A.A. and A.F. (Antonio Frisoli); data curation, C.C., C.H., G.B. and V.L.; writing—original draft preparation, C.C., A.F. (Alessandro Filippeschi) and F.P.; writing—review and editing, A.F. (Alessandro Filippeschi), V.L., C.H., C.M., A.F. (Antonio Frisoli) and C.A.A.; supervision, C.C., V.L., F.P. and A.F. (Alessandro Filippeschi); project administration, V.L., A.F. (Alessandro Filippeschi) L.L.; funding acquisition, A.F. (Alessandro Filippeschi), V.L., C.C. and F.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the European Commission through the European Project EUROBENCH—Grant No. 779963 and the support of the BRIEF “Biorobotics Research and Innovation Engineering Facilities” project (Project identification code IR0000036) funded under the National Recovery and Resilience Plan (NRRP), Mission 4 Component 2 Investment 3.1 of Italian Ministry of University and Research funded by the European Union—NextGenerationEU.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Joint Ethics Committee of Scuola Superiore Sant’Anna and Scuola Normale Superiore (protocol code 10/2019 approved on 14 October 2019).

Informed Consent Statement

Informed consent was obtained from all participants involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not yet publicly available at the time of writing, but they will be.

Conflicts of Interest

Author Lucia Lencioni was employed by the company Wearable Robotics S.r.L. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Moyon, A.; Poirson, E.; Petiot, J.F. Development of an acceptance model for occupational exoskeletons and application for a passive upper limb device. IISE Trans. Occup. Ergon. Hum. Factors 2019, 7, 291–301. [Google Scholar] [CrossRef]
  2. Schwerha, D.J.; McNamara, N.; Nussbaum, M.A.; Kim, S. Adoption potential of occupational exoskeletons in diverse enterprises engaged in manufacturing tasks. Int. J. Ind. Ergon. 2021, 82, 103103. [Google Scholar] [CrossRef]
  3. Mahmud, D.; Bennett, S.T.; Zhu, Z.; Adamczyk, P.G.; Wehner, M.; Veeramani, D.; Dai, F. Identifying facilitators, barriers, and potential solutions of adopting exoskeletons and exosuits in construction workplaces. Sensors 2022, 22, 9987. [Google Scholar] [CrossRef] [PubMed]
  4. Gonsalves, N.; Akanmu, A.; Shojaei, A.; Agee, P. Factors influencing the adoption of passive exoskeletons in the construction industry: Industry perspectives. Int. J. Ind. Ergon. 2024, 100, 103549. [Google Scholar] [CrossRef]
  5. De Bock, S.; Ghillebert, J.; Govaerts, R.; Tassignon, B.; Rodriguez-Guerrero, C.; Crea, S.; Veneman, J.; Geeroms, J.; Meeusen, R.; De Pauw, K. Benchmarking occupational exoskeletons: An evidence mapping systematic review. Appl. Ergon. 2022, 98, 103582. [Google Scholar] [CrossRef] [PubMed]
  6. Pinto-Fernandez, D.; Torricelli, D.; del Carmen Sanchez-Villamanan, M.; Aller, F.; Mombaur, K.; Conti, R.; Vitiello, N.; Moreno, J.C.; Pons, J.L. Performance evaluation of lower limb exoskeletons: A systematic review. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 1573–1583. [Google Scholar] [CrossRef] [PubMed]
  7. Torricelli, D.; Pons, J.L. Eurobench: Preparing robots for the real world. In Proceedings of the Wearable Robotics: Challenges and Trends: Proceedings of the 4th International Symposium on Wearable Robotics, WeRob2018, Pisa, Italy, 16–20 October 2018; Springer: Berlin/Heidelberg, Germany, 2019; pp. 375–378. [Google Scholar]
  8. Lippi, V.; Filippeschi, A.; Camardella, C.; Porcini, F.; Maurer, C.; Lencioni, L. EXOSMOOTH: Test of Innovative EXOskeleton Control for SMOOTH Assistance, With and Without Ankle Actuation. In Proceedings of the 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Sapporo, Japan, 7–10 March 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 890–894. [Google Scholar]
  9. Lippi, V.; Camardella, C.; Filippeschi, A.; Porcini, F. Identification of Gait Phases with Neural Networks for Smooth Transparent Control of a Lower Limb Exoskeleton. In Proceedings of the 18th International Conference on Informatics in Control, Automation and Robotics ICINCO, Paris, France, 6–8 July 2021; SciTePress: Setúbal, Portugal, 2021; pp. 171–178. [Google Scholar] [CrossRef]
  10. Camardella, C.; Porcini, F.; Filippeschi, A.; Marcheschi, S.; Solazzi, M.; Frisoli, A. Gait phases blended control for enhancing transparency on lower-limb exoskeletons. IEEE Robot. Autom. Lett. 2021, 6, 5453–5460. [Google Scholar] [CrossRef]
  11. Rodrigues-Carvalho, C.; Fernández-García, M.; Pinto-Fernández, D.; Sanz-Morere, C.; Barroso, F.O.; Borromeo, S.; Rodríguez-Sánchez, C.; Moreno, J.C.; Del-Ama, A.J. Benchmarking the effects on human–exoskeleton interaction of trajectory, admittance and EMG-triggered exoskeleton movement control. Sensors 2023, 23, 791. [Google Scholar] [CrossRef] [PubMed]
  12. Pisotta, I.; Tagliamonte, N.; Bigioni, A.; Tamburella, F.; Lorusso, M.; Bentivoglio, F.; Pecoraro, I.; Argentieri, P.; Marri, F.; Zollo, L.; et al. Pilot testing of a new questionnaire for the assessment of user experience during exoskeleton-assisted walking. In Proceedings of the 5th International Conference on Neurorehabilitation (ICNR2020), Online, 13–16 October 2020; Springer: Berlin/Heidelberg, Germany, 2022; pp. 195–199. [Google Scholar]
  13. Pecoraro, I.; Tagliamonte, N.L.; Tamantini, C.; Cordella, F.; Bentivoglio, F.; Pisotta, I.; Bigioni, A.; Tamburella, F.; Lorusso, M.; Argentieri, P.; et al. Psychophysiological Assessment of Exoskeleton-Assisted Treadmill Walking. In Converging Clinical and Engineering Research on Neurorehabilitation IV; Torricelli, D., Akay, M., Pons, J.L., Eds.; Springer International Publishing: Cham, Switzerland, 2022; pp. 201–205. [Google Scholar]
  14. Smolander, J.; Ajoviita, M.; Juuti, T.; Nummela, A.; Rusko, H. Estimating oxygen consumption from heart rate and heart rate variability without individual calibration. Clin. Physiol. Funct. Imaging 2011, 31, 266–271. [Google Scholar] [CrossRef] [PubMed]
  15. Evan’s, O.; Zgrntn, Y.; Faria, M.; Monod, H. Physiological responses to load holding and load carriage. Ergonomics 1983, 26, 161–171. [Google Scholar] [CrossRef] [PubMed]
  16. Holewijn, M. Physiological strain due to load carrying. Eur. J. Appl. Physiol. Occup. Physiol. 1990, 61, 237–245. [Google Scholar] [CrossRef] [PubMed]
  17. Murray, M.; Spurr, G.; Sepic, S.; Gardner, G.; Mollinger, L. Treadmill vs. floor walking: Kinematics, electromyogram, and heart rate. J. Appl. Physiol. 1985, 59, 87–91. [Google Scholar] [CrossRef] [PubMed]
  18. Marchand, C.; De Graaf, J.B.; Jarrassé, N. Measuring mental workload in assistive wearable devices: A review. J. Neuroeng. Rehabil. 2021, 18, 160. [Google Scholar] [CrossRef] [PubMed]
  19. Lippi, V.; Mergner, T. A challenge: Support of standing balance in assistive robotic devices. Appl. Sci. 2020, 10, 5240. [Google Scholar] [CrossRef]
  20. Peterka, R. Sensorimotor integration in human postural control. J. Neurophysiol. 2002, 88, 1097–1118. [Google Scholar] [CrossRef] [PubMed]
  21. Mergner, T. A neurological view on reactive human stance control. Annu. Rev. Control 2010, 34, 77–198. [Google Scholar] [CrossRef]
  22. Lippi, V.; Mergner, T. Human-derived disturbance estimation and compensation (dec) method lends itself to a modular sensorimotor control in a humanoid robot. Front. Neurorobot. 2017, 11, 49. [Google Scholar] [CrossRef] [PubMed]
  23. Lippi, V.; Mergner, T.; Szumowski, M.; Zurawska, M.S.; Zielińska, T. Human-Inspired Humanoid Balancing and Posture Control in Frontal Plane. In ROMANSY, 21-Robot Design, Dynamics and Control, Proceedings of the 21st CISM-IFToMM Symposium, Udine, Italy, 20–23 June 2016; Springer: Berlin/Heidelberg, Germany, 2016; Volume 569, pp. 285–292. [Google Scholar]
  24. Lhoste, C.; Küçüktabak, E.B.; Vianello, L.; Amato, L.; Short, M.R.; Lynch, K.; Pons, J.L. Deep-Learning Estimation of Weight Distribution Using Joint Kinematics for Lower-Limb Exoskeleton Control. arXiv 2024, arXiv:2402.04180. [Google Scholar] [CrossRef]
  25. Hua, Y.; Fan, J.; Liu, G.; Zhang, X.; Lai, M.; Li, M.; Zheng, T.; Zhang, G.; Zhao, J.; Zhu, Y. A Novel Weight-Bearing Lower Limb Exoskeleton Based on Motion Intention Prediction and Locomotion State Identification. IEEE Access 2019, 7, 37620–37638. [Google Scholar] [CrossRef]
  26. Liu, Y.; Chen, C.; Wang, Z.; Tian, Y.; Wang, S.; Xiao, Y.; Yang, F.; Wu, X. Continuous Locomotion Mode and Task Identification for an Assistive Exoskeleton Based on Neuromuscular–Mechanical Fusion. Bioengineering 2024, 11, 150. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The Wearable Walker lower limb exoskeleton along with the sensing devices used for the experiment. The CAD models show the kinematic variables and the detail of the two degrees of freedom that the thigh harness has with regards to the exoskeleton’s thigh link.
Figure 1. The Wearable Walker lower limb exoskeleton along with the sensing devices used for the experiment. The CAD models show the kinematic variables and the detail of the two degrees of freedom that the thigh harness has with regards to the exoskeleton’s thigh link.
Sensors 24 05358 g001
Figure 2. Electronics, computing units, and assistance computation architecture of the Wearable Walker lower limb exoskeleton. In the bottom right scheme, red blocks highlight the components of assistive torques reported in Equation (2).
Figure 2. Electronics, computing units, and assistance computation architecture of the Wearable Walker lower limb exoskeleton. In the bottom right scheme, red blocks highlight the components of assistive torques reported in Equation (2).
Sensors 24 05358 g002
Figure 3. Scores of the physiological PIs of the EXPERIENCE protocol for each volunteer as a function of time. Each color corresponds to one volunteer. The three protocol phases, i.e., SIT, SIT EXO, and WALK are plotted together and marked in the figures.
Figure 3. Scores of the physiological PIs of the EXPERIENCE protocol for each volunteer as a function of time. Each color corresponds to one volunteer. The three protocol phases, i.e., SIT, SIT EXO, and WALK are plotted together and marked in the figures.
Sensors 24 05358 g003
Figure 4. Scores for the psychophysiological performance indicators (PIs) of the EXPERIENCE protocol for each volunteer. Each point on the x-axis represents an average of a 1-minute recording. Curves show the evolution in time of such PIs.
Figure 4. Scores for the psychophysiological performance indicators (PIs) of the EXPERIENCE protocol for each volunteer. Each point on the x-axis represents an average of a 1-minute recording. Curves show the evolution in time of such PIs.
Sensors 24 05358 g004
Figure 5. Distribution of answers to the questionnaire items. Bars report the average score and the whiskers their standard deviation.
Figure 5. Distribution of answers to the questionnaire items. Bars report the average score and the whiskers their standard deviation.
Sensors 24 05358 g005
Table 1. Mass and geometry information for the Wearable Walker. Lengths that are referred to include backlink width, thigh, and shank joint-to-joint axis distances, as well as ankle height to the foot ground contact plane.
Table 1. Mass and geometry information for the Wearable Walker. Lengths that are referred to include backlink width, thigh, and shank joint-to-joint axis distances, as well as ankle height to the foot ground contact plane.
LinkBackThighShankFoot
Length [m]0.4740.4070.4020.095
Mass [m]1.2–84.12.90.2
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Camardella, C.; Lippi, V.; Porcini, F.; Bassani, G.; Lencioni, L.; Mauer, C.; Haverkamp, C.; Avizzano, C.A.; Frisoli, A.; Filippeschi, A. User-Centered Evaluation of the Wearable Walker Lower Limb Exoskeleton; Preliminary Assessment Based on the Experience Protocol. Sensors 2024, 24, 5358. https://doi.org/10.3390/s24165358

AMA Style

Camardella C, Lippi V, Porcini F, Bassani G, Lencioni L, Mauer C, Haverkamp C, Avizzano CA, Frisoli A, Filippeschi A. User-Centered Evaluation of the Wearable Walker Lower Limb Exoskeleton; Preliminary Assessment Based on the Experience Protocol. Sensors. 2024; 24(16):5358. https://doi.org/10.3390/s24165358

Chicago/Turabian Style

Camardella, Cristian, Vittorio Lippi, Francesco Porcini, Giulia Bassani, Lucia Lencioni, Christoph Mauer, Christian Haverkamp, Carlo Alberto Avizzano, Antonio Frisoli, and Alessandro Filippeschi. 2024. "User-Centered Evaluation of the Wearable Walker Lower Limb Exoskeleton; Preliminary Assessment Based on the Experience Protocol" Sensors 24, no. 16: 5358. https://doi.org/10.3390/s24165358

APA Style

Camardella, C., Lippi, V., Porcini, F., Bassani, G., Lencioni, L., Mauer, C., Haverkamp, C., Avizzano, C. A., Frisoli, A., & Filippeschi, A. (2024). User-Centered Evaluation of the Wearable Walker Lower Limb Exoskeleton; Preliminary Assessment Based on the Experience Protocol. Sensors, 24(16), 5358. https://doi.org/10.3390/s24165358

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop