Next Article in Journal
Machine Learning on Prediction of Relative Physical Activity Intensity Using Medical Radar Sensor and 3D Accelerometer
Next Article in Special Issue
A System to Track Stent Location in the Human Body by Fusing Magnetometer and Accelerometer Measurements
Previous Article in Journal
Transfer Learning in Trajectory Decoding: Sensor or Source Space?
Previous Article in Special Issue
Mass-Manufacturable 3D Magnetic Force Sensor for Robotic Grasping and Slip Detection
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Pilot Study: Magnetic Motion Analysis for Swallowing Detection Using MEMS Cantilever Actuators

by
Johannes Hoffmann
1,†,
Sebastian Roldan-Vasco
2,3,†,
Karolin Krüger
1,†,
Florian Niekiel
4,
Clint Hansen
5,
Walter Maetzler
5,
Juan Rafael Orozco-Arroyave
2,6 and
Gerhard Schmidt
1,*
1
Department of Electrical and Information Engineering, Faculty of Engineering, Kiel University, 24118 Kiel, Germany
2
GITA Lab, Faculty of Engineering, Universidad de Antioquia, Medellín 050010, Colombia
3
Faculty of Engineering, Instituto Tecnológico Metropolitano, Medellín 050536, Colombia
4
Fraunhofer Institute for Silicon Technology ISIT, 25524 Itzehoe, Germany
5
Department of Neurology, Kiel University, 24118 Kiel, Germany
6
Pattern Recognition Lab, Friedrich-Alexander-Universität, 91054 Erlangen, Germany
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Sensors 2023, 23(7), 3594; https://doi.org/10.3390/s23073594
Submission received: 24 February 2023 / Revised: 22 March 2023 / Accepted: 28 March 2023 / Published: 30 March 2023
(This article belongs to the Special Issue Magnetic Sensor and Its Applications)

Abstract

:
The swallowing process involves complex muscle coordination mechanisms. When alterations in such mechanisms are produced by neurological conditions or diseases, a swallowing disorder known as dysphagia occurs. The instrumental evaluation of dysphagia is currently performed by invasive and experience-dependent techniques. Otherwise, non-invasive magnetic methods have proven to be suitable for various biomedical applications and might also be applicable for an objective swallowing assessment. In this pilot study, we performed a novel approach for deglutition evaluation based on active magnetic motion sensing with permanent magnet cantilever actuators. During the intake of liquids with different consistency, we recorded magnetic signals of relative movements between a stationary sensor and a body-worn actuator on the cricoid cartilage. Our results indicate the detection capability of swallowing-related movements in terms of a characteristic pattern. Consequently, the proposed technique offers the potential for dysphagia screening and biofeedback-based therapies.

1. Introduction

The normal swallowing process involves the activation of more than 30 pairs of muscles to intake food, liquids, and saliva: a process mediated by central pattern generators within the brain stem. This process is characterized by a well-defined sequence of phases, i.e., pre-oral and oral, pharyngeal, and esophageal. Functional or structural alterations can produce swallowing dysfunction, also known as dysphagia, which can produce, for example, malnutrition, dehydration, and aspiration of the meal to the airway [1,2]. Dysphagia is a syndrome produced by a wide spectrum of diseases and conditions with especially high incidence and prevalence in elderly people suffering from neurological diseases, such as Parkinson´s disease, multiple sclerosis, muscular dystrophy, and dementia [2,3].
The instrumental diagnosis of dysphagia is performed by two techniques: videofluoroscopy and fiberendoscopy. These reference methods for dysphagia diagnosis are associated with unwanted side effects and complications [4]. For example, videofluoroscopy implies X-ray exposure with collateral risk of induced cancers [5], and fiberendoscopy is an invasive assessment where the endoscope is introduced to the larynx, which is uncomfortable and prone to gagging, vomiting, and more rarely, complications such as laryngospasms [6]. Furthermore, both techniques lack standardized protocols and scoring systems, which make them relatively subjective and expert-dependent [7]. These limitations have motivated the search for non-invasive and objective strategies to diagnose and screen swallowing disorders [8], such as biosignal-based approaches.
Accelerometers have been used experimentally to establish differences between normal and abnormal swallows from features extracted considering different domains (time, frequency, time-frequency, and nonlinear dynamics) [9,10]. These analyses have been performed using statistical comparisons, machine learning, and deep learning models [9,11,12]. Such studies suggest that the vibration analysis can help to estimate the duration of different swallowing-related events accurately, e.g., the opening and closure of the upper esophageal sphincter [13]. The CA is intended to describe swallowing from a mechanical point of view, but it has been routinely acquired in combination with microphone sounds. The latter allows the analysis of swallowing in an acoustic way, and information collected from both sources are complementary and not interchangeable [14]. Such an acoustical dimension of swallowing has also been explored with digital stethoscopes, but the low-pass effect of the diaphragm limits the spectral analysis to frequencies below 1 kHz [15]. On the other hand, speech–language pathologists widely use the perceptual evaluation of voice quality during clinical swallow examinations because it gives valuable clues regarding swallowing malfunctioning [16,17]. Even though speech production and swallowing are strongly linked at anatomical and physiological levels [18,19,20], few studies have addressed this association. Although significant statistical differences have been found between features extracted from speech in healthy individuals and dysphagic patients [21], the results have not yet been standardized. Additionally, the association between the voice changes perceived by the pathologists and the variations observed in different computed features remains unclear.
Several studies have explored the use of surface electromyography for dysphagia evaluation and biofeedback, based on electrophysiological information [22,23,24]. Nevertheless, the majority of these studies are mostly descriptive and focused on differences in amplitude and duration of normal/abnormal swallows, with some exceptions related to the use of automatic algorithms for detection of onset and specific swallowing phases [25,26,27,28,29,30]. Other sensors have been tested to detect swallows, such as bioimpedance, electromyography [25,28], nasal airflow [31,32], mechanomyography [27,32], and piezoelectric sensors, which all have shown the capability of swallow detection and dysphagia evaluation [33,34].
Nevertheless, none of the above sensors and biosignals have been successfully implemented in clinical routine, mainly due to the lack of standardization, validation, and limitations related to the evaluation of clinical aspects that reference methods allow to assess. As a result, the evaluation of new types of sensors for swallowing evaluation and biofeedback is still an open research field.
Magnetic sensors are applied for motion sensing in inertial measurement units (IMUs) by detecting a rotation in the geomagnetic field [35,36]. This method can be transferred to arbitrary sources such as permanent magnets, which enable application-specific motion-sensing solutions (such as tongue tracking [37]). However, full reconstruction of position and orientation in the 3D space requires a multitude of sensors and actuators to avoid ambiguity [38,39,40]. Derived metrics, such as fundamental frequencies or relative changes in position (for a temporarily fixed orientation), might still be obtained in a more limited setup [41]. Such setups with multiple actuators require a separation of signals during motion with multiplexing schemes (i.e., by frequency, time, or spread code). Corresponding sensors might be selected based on the available bandwidth and frequency-dependent magnetic noise density. Potential candidates for motion-related biomedical applications include various types of well-established magnetometers such as fluxgate sensors [42], magnetoresistive (MR) sensors [43], and magnetoimpedance (MI) sensors [44], as well as more experimental magnetoelectric (ME) sensors [45]. While coils can be used as magnetic actuators with arbitrary signals, they suffer from high power consumption due to copper resistance, which is detrimental for most wearable applications. Oscillating cantilever actuators with permanent magnets offer a potential alternative for the generation of AC fields [46]. Recent research indicates significant energy/range benefits of cantilever actuators in multiple fields, such as communication [47] or magnetic excitation [48]. Consequently, microelectromechanical systems (MEMS) cantilever actuators seem especially promising for biomedical applications due to the small form factor (wearable, array-capable). Therefore, the goal of this work is to analyze the suitability of MEMS for non-invasive and quantitative swallowing evaluation in terms of a novel magnetic approach for dysphagia screening.

2. Materials and Methods

2.1. Cantilever Actuators

The proposed setup uses MEMS, which were originally designed as magnetic field sensors. Each device consists of a cantilever (one-side clamp to a substrate, length: 1.5 to 2 m m ) with a 4 × 4 array of permanent magnets (wafer level integrated). More information on these, including a detailed schematic, can be found in [46]. In the sensor role, magnetic field gradients cause a proportional force (torque in consequence) which results in an oscillation of the cantilever. A piezoelectric layer transforms the mechanical stress into charge, which is then amplified and read out. The mechanical system corresponds to a resonator with a frequency range of 1 to 2 k Hz and a quality factor of a few hundred for the devices selected for the subsequently described experiments (see Section 2.2 for details).
The inverse operation scheme (actuation instead of sensing) employs the integrated permanent magnets as a source of a magnetic field. In the stationary case, a dipole vector field is assumed with the magnetic moment oriented in the negative z direction (Figure 1a).
The red arrow tips indicate the direction and absolute value (logarithmic size) of the corresponding magnetic flux density in the x-z plane. An inverse magnetic moment (e.g., reversed magnet) yields the same absolute field value with inverse direction (blue tips). The dipole approximation is also commonly used for other field sources, such as cylindric coils, which can be fed by a sinusoidal current to generate an equivalently shaped field where the amplitude switches periodically between the indicated directions.
In a similar way, the cantilever actuator might be driven by feeding an alternating voltage to the electrodes. Consequently, mechanical stress caused by the piezoelectric layer results in an oscillation of the cantilever (and the attached magnets). This oscillation is assumed to be mainly a tilt around the y-axis by low single-digit degrees. For a sinusoidal rotational movement with an exemplary peak value of ±1 ° , the DC magnetic field from the stationary case is superimposed by a weak magnetic AC field (Figure 1b), whose dipole-like shape is oriented perpendicular to the DC field and the axis of rotation. This AC component was computed for visualization by subtracting the DC field (0 ° tilt) from the values obtained for the extremal points (±1 ° tilt). The resulting values and directions for both positive and negative half-wave are again indicated by red and blue arrow tips. For a maximum ±1 ° tilt, the AC field exhibits an amplitude like a dipole with 1.8% magnitude of the DC field.
For practical purposes, excitation at the resonance frequency was chosen to maximize the flux density of the alternating field. As a uniaxial magnetic sensor is used, the orientation of the sensor towards the actuator also constrains the achievable magnetic flux density in the experiments.
The complete actuator system (Figure 1c) consists of a printed circuit board (PCB) with the cantilever element, which is applied in a protective box made out of 3D-printed material (ABS) with a connector for the excitation signal.

2.2. Measurement Setup

For our magnetic motion analysis, the movement during the swallowing process was captured by attaching one or more magnetic sources on the throat and detecting the emitted signal using magnetic field sensors. The measurement setup comprised up to two magnetic sources and a uniaxial magnetic field sensor as depicted in Figure 2a. The actuators were powered by an arbitrary waveform generator (Tektronix AFG 31022) with sine signals of different peak-to-peak voltages V a / b at their respective resonance frequencies f res , a / b . Actuator A ( f res , a = 1397 Hz , V a = 20 Vpp) was used for all single channel experiments. Actuator B ( f res , b = 1039 Hz , V b = 2 Vpp) was only employed as a secondary source for the subsequent dual actuator experiment and is therefore displayed with a dashed line in Figure 2a.
A commercial magnetoimpedance (MI) sensor (Aichi Steel MI-CB-1DJ) was used, which claims detection capability of n T -range magnetic fields with an equivalent magnetic noise density below 100 pT / Hz between 0.1 and 10 k Hz , a sensitivity of 5 V / μ T , and a 3 d B -bandwidth of 10 k Hz . Analog to digital conversion of sensor signals was performed at a sample rate of 25.6   k Hz by a 24 bit voltage input card (NI 9239 + NI cDAQ-9174 chassis) with an input range of ±10 V . The device was connected to a measurement PC, where further processing steps were applied in real time (see Section 2.4). The sensor itself was supplied by a single-channel DC voltage source (Korad KWR103) at +15 V . All components were connected by coaxial BNC cables.

2.3. Data Acquisition

The MI sensor was secured on an adjustable aluminum rack adapted to the subject’s height (Figure 2c). Besides the sensor, two spacers were adapted to maintain the neck in an upright position, aiming to capture the swallowing movements as naturally as possible and to reduce motion artifacts. A synchronized camera was used to record the movement of the throat as a reference for swallowing detection. One actuator was placed in a protective box attached to the subject’s neck at the level of the cricoid cartilage (Actuator A in Figure 2b). This point is recommended to acquire sound and vibration-related signals [49,50], especially for analysis of the pharyngeal phase (the larynx elevation pulls this cartilage up and forward [51]). The subjects observed real-time feedback of the signal in terms of an on-screen reference line (dashed line in Figure 3c) in order to maintain the basal signal level close to such a reference line. This feedback helped to maintain a similar position and distance between the actuator and the MI sensor to obtain reproducible and comparable measurements.
Table 1 shows specifications of three healthy subjects who performed this experiment. The measurement protocol consisted of three different swallowing tasks: dry swallows (saliva), 20 mL of water, and 20 mL of mild yogurt (fat: 1.5%, density: 1.027 g/mL). Each subject conducted each task 3 times (9 trials per subject, 27 trials overall). These swallowing tasks are routinely performed in the clinical bedside swallow examinations [52], and they have differential muscle activation patterns in terms of duration and amplitude [53]. The volumes were selected according to the “dysphagia limit” in healthy individuals found by Aydogdu et al. [24], i.e., the value above which piecemeal deglutition appears (20 mL).
We also performed an extension of this experiment to determine the regularity of the measures provided by actuators placed in different positions of the neck. We placed an additional actuator centered underneath the lower jaw on the suprahyoid muscles (Actuator B in Figure 2b). In this additional experiment, only the intake of 20 mL of water (6 trials) was assessed in one healthy subject (female, 24 years old). The muscles of the evaluated region participate in the tongue and jaw stabilization during the oral phase [51] and in the pharyngeal one for larynx and hyoid bone elevation to protect the airway [54]. The Actuator A was again used to align the instantaneous signal and the reference line.

2.4. Pre-Processing

Generally, the aggregated sensor output signal for our scenario contained up to two (dual actuator setup) desired signal components as well as undesired signals (e.g., power hum or thermal noise). For further analysis steps, the desired components were extracted. The applied processing chain was based on Hoffmann et al. [41] with a different parametrization due to the chosen sensors and actuator types. As the display of the reference line during the experiment required a feedback mechanism, a slightly simplified real-time implementation of the following processing chain was used. Results for presentation in this paper were processed offline with zero-phase filters.
Figure 3 shows the fundamental processing steps which start with the raw digitized sensor voltage signal from the data acquisition card. This signal was located around the sensor DC offset (single-end voltage supply) and was also affected by magnetic signals induced by motion in the geomagnetic field (Figure 3a). A Butterworth highpass filter (2nd order, 800 Hz ) was applied to reject low-frequency noise. Afterward, undesired power net hum (fundamental frequency and harmonics) was suppressed by an IIR comb filter (512th order, 3 Hz bandwidth), which corresponds to a notch spacing of 50 Hz for a sample rate of 25.6   k Hz . Spectral input and output signals for both processing steps are displayed in Figure 3b.
The resulting voltage signal was then converted to the equivalent magnetic signal. As the employed MI sensor features an almost constant frequency-dependent sensitivity curve in the region of interest, a division by the conversion factor of 5 V / μ T was sufficient, and no further equalizing was required.
Depending on the number of actuators used, the signal was forwarded to one or two separate paths where 2nd order Butterworth bandpass filters were applied with cutoff frequencies centered at ±200 Hz around the desired excitation frequency.
The final noise reduction step was performed by a matched filter in a correlator realization (complex demodulation with subsequent integration). The integration time was empirically set to 100 m s which yields a bandwidth of 10 Hz for the resulting signal. The phase was dropped, as only the magnitude was of interest here. Figure 3c visualizes this fundamental acquisition process where the subject tries to converge the demodulated signal (Actuator A) towards the reference line. The subject induced swallowing once the match between them was produced.

2.5. Segmentation and Detrending

After data preprocessing, the swallowing events in the signal were segmented by selecting a window of ±1.5 s centered in the local maximum of the signal while swallowing (Figure 3d). For all 27 swallowing events with 1 actuator, an offset removal was conducted by using highpass filtering according to [55] (filter order of twice the sample rate). The separation of the swallowing events for the dual actuator experiment was conducted by choosing the maximum of the same signal produced by Actuator A. The trend removal was performed separately for both signals in the same manner as for the single mode.

2.6. Signal Characterization

Features in time, frequency, and time-frequency domains were extracted from each signal. The root mean square (RMS) and variance (VAR) were computed in the time domain. The mean frequency (MNF), median frequency (MDF), mean power (MNP), and peak frequency (PKF) were obtained in the frequency domain. Table 2 shows the mathematical formulations according to Phinyomark et al. [56]. Additionally, the frequencies where the spectrum drops 3 dB below the reference line were computed, denoted as f low and f high . The difference between them, i.e., the power bandwidth (BW) was also extracted.
Moreover, we performed a wavelet decomposition in the time–frequency domain. Wavelet-based features have been extracted from accelerometry, sound, and surface electromyography signals for the detection of swallowing-related events, characterization of healthy and non-healthy swallows, and detection of swallowing phases, among others [9,57,58,59]. In this way, we computed the energy of the approximation and decomposition coefficients. We selected the db3 mother wavelet ad hoc, with four decomposition levels. Table 2 shows mathematical formulae.
Correlation matrices were used to quantify similarities between individual swallowing signals. Therefore, the power-normalized cross correlation for all available signal pairs was computed. The maximum value of each resulting correlation signal was displayed at its corresponding position in a 2D matrix plot. The results for a total of 27 swallowing events for the single actuator experiment (3 subjects, 3 tasks, 3 trials) were grouped per swallowing task and subject. In an equivalent approach, a second correlation matrix for Subject “b” was computed to compare the nine swallowing events for this subject (from the first experiment) with the additional six (from the dual actuator experiment).

3. Experiments and Results

3.1. Visual Inspection

For all results of the three participants, the swallowing process was clearly detectable in the measured motion signals. Furthermore, repetitive visual patterns were observable, which can be seen in Figure 4 and Figure 5, where all trials with one actuator for Subject “b” are depicted. In theory, each subject reached the reference signal before starting the swallowing movement and did not perform more movements than desired.
In practice, movement-related artifacts were produced, and matching the signal and the reference line was quite difficult. Therefore, all signals were demeaned using the first 50 m s as a reference for better visual comparison and subsequent alignment between all measurements. A maximum amplitude between 0.25 and 1.8   n T indicated swallowing activity, which matched the time when the movement of the throat was observable in the video. The duration of the entire swallowing process differed between 80 and 200 m s and was partially masked by movement artifacts. To characterize the measured signals and to distinguish between the swallowing process of different subjects, the peak-to-peak amplitude, as well as the pulse width, were calculated. This feature was defined by choosing half of the amplitude as a reference for the duration calculation. Each subject showed subtle individual characteristics in the signal and visual similarities for all three swallowing tasks (saliva, water, and yogurt). Figure 6 shows subject-specific prototype signals created by averaging the three tasks performed per participant. Note that each subject retrieved prototype signals with different properties, i.e., there was a subject-dependent behavior.
From the second experiment with the dual actuator setup (Subject “b”, six additional trials of water intake), we evaluated the consistency between data provided by both actuators (Figure 7). The swallowing pattern can be further validated: for all nine swallowing trials for Actuator A, a pulse width of 33.68   m s with a standard deviation of 1.00   m s occurred. The mean amplitude was 0.79 ± 0.28  n T . For the assessed subject, the amplitude exhibited a clear difference between swallowing tasks: 0.35 ± 0.07   n T for saliva and 1.49 ± 0.23   n T for yogurt. These results are also visible in Figure 5. Otherwise, consistent measures were found in data from Actuator B, despite the sixth trial which behaves as an outlier.

3.2. Signal Characterization

The swallowing-related signals exhibited the highest power in low spectral components (below 10 Hz). The average mean frequency was 0.86 ± 0.23 Hz, and the median frequency was 0.48 ± 0.31 Hz. Moreover, the signals were very smooth, so the classical spectral analysis is not helpful to characterize the collected signals.
Figure 8 shows an example of the magnitude scalogram and the spectrogram of a dry swallow in the single actuator experiment for Subject “a”. The actuator output is highlighted in red for both scalogram (Figure 8a) and spectrogram (Figure 8b). The color bar shows the power spectral density (PSD). Despite the low-frequency vibration produced during swallowing, the power increase during the precise moment of swallowing is noticeable. Furthermore, there is a slight increase in the frequency components. This result was observed in all trials and swallowing tasks, as well as for the single and dual actuator experiments. Thus, our setup was capable of detecting variations produced by swallowing under different consistencies.
We performed an analysis to evaluate the inter-task variability; Table 3 provides features that may be suitable to detect differences between boluses. Moreover, Table 4 illustrates the variations between cantilevers in the additional experiment with the dual actuator setup.

3.3. Correlation Matrix

Figure 9 compares all nine trials (three per subject) for each swallowing task (saliva, water, yogurt) of the single actuator experiment, with each other based on the maximum of the power-normalized cross correlation ( ρ ). For a single bolus, 3 × 3 clusters with ρ > 0.8 for a subject indicate high similarity between all three trials. These can be found individually for saliva and water (both “b”), yogurt (“b”, “c”) as well as between water and yogurt (also “b”). Clusters with at least 5 entries within a 3 × 3 matrix ( ρ > 0.8 ) exist for saliva (“c”), water (“a”, “c”, and “a” vs. “b”), and yogurt (“a” vs. “b”).
Figure 9b displays the same data grouped per subject to assess subject-specific similarity beyond the swallowing task. It again highlights the correlation between water and yogurt for Subject “b” as well as some similarities between Subjects “a” and “b”. It also shows a consistently higher correlation for “b” in comparison to “a” and “c”.
Figure 10 results from the same methodology regarding the correlation matrix exclusively for all available signals of Subject “b”. In addition to the nine trials from the single actuator experiment, it also incorporates six trials (water only) from the dual actuator experiment. Apart from the previously described clusters for Subject “b” (saliva, water, yogurt, water vs. yogurt), there is a very large cluster for all except for the first trial of the dual actuator experiment in water. However, a similarity between the water trials for both experiments (single and dual) is not observed.

4. Discussion

In this paper, we evaluated the swallowing detection capability of a MI sensor with single and dual actuators. Results showed the suitability of the proposed sensor. However, the results shown in Figure 4 depend on the ability of the person to keep the position during signal acquisition because of the high susceptibility to movements. The average standard deviation of the pulse width for all subjects for almost all swallowing processes was about 11%. The calculation of the defined pulse width feature was not possible for all measurements: for instance, head movements at the end of the swallowing process produce differently shaped and highly asymmetrical deglutition-related lobes. Thus, it was not possible to calculate the pulse width for 3 of the 27 measurements in total. For further discussion, the mean over three swallowing attempts and the overall mean were used, as displayed in Figure 5 for Subject “b”. Even though the quality of matching of the reference line was different for all subjects, a distinct difference between swallowing of different consistencies was visible at least for Subjects “b” and “c”. In general, the amplitudes clearly differed between swallowing tasks. However, no pattern for the differentiation of the swallowing tasks by amplitude could be found. From the prototype signals depicted in Figure 6 it can be seen, that Subjects “a” and “c” had similar peak-to-peak amplitudes of nearly 0.5   n T , but clearly differed in duration with 27 and 19 m s . The signal of Subject “b” had a much higher amplitude of nearly 1.1   n T and in addition the highest duration of 34 m s . While the signals of Subjects “a” and “b” were nearly symmetric and Gaussian-like, the swallowing signal of Subject “c” exhibited a non-symmetric curve with a second small peak right before the main lobe. These individual-specific properties seem to appear with every swallowing trial.
Bearing in mind that the trials included in this pilot study avoid the generalization of results, we performed a general analysis of the behavior of the features per swallowing task to overcome this limitation (Table 3). The feature-related values shown in Table 3 suggest a differential pattern of the magnetic signals measured in the three swallowing tasks for the single actuator setup. The frequency-domain features (MNF, MDF, PKF, f low , f high , BW) were higher for water than for saliva and yogurt, which exhibited similar behavior; however, the RMS was lower for water, similar to MNP, E a , and E d 4 .
The RMS extracted from the MI sensor shows higher values for saliva and yogurt than for water. This is consistent with the electromyography-related literature since saliva shows a shorter duration but higher amplitude than water and is comparable to thick liquids [53]. Furthermore, the fact that amplitude is higher for thick liquid than for thin liquids is also consistent with the swallowing biomechanics [60], and it has also been reported in patients with mild dysphagia [61]. In healthy individuals, thick liquids demand more effort than thin ones, and effortful swallows have more amplitude variance than non-effortful swallows [13]. In this way, we evidenced that VAR was higher for saliva and yogurt than for water.
Like RMS and VAR, saliva and yogurt produced similar values in MNF, MDF, PKF, f low , MNP, and E a . This is noticeable because the volume of water and yogurt was the same, i.e., 20 mL. Thus, preliminary results suggest that the proposed setup could be suitable to characterize the swallowing for different consistencies, in this case, thin vs. thick liquids. MNF, MDF, PKF, f low , f high , and BW were higher for water, which agrees with the literature: Youmans and Stierwalt [62] found that swallowing of thin liquids produced higher spectral components. However, we cannot compare the obtained values because the observed ranges are very different from the characteristic bandwidth obtained with other signals. For instance, we found that BW < 1 Hz, but in swallowing sounds, the frequencies are between 400 and 1000 Hz, the bandwidth with accelerometers is below 300 Hz, or the main spectral components in surface electromyography ranges mainly between 90 and 250 Hz [13,63,64,65]. Nevertheless, these findings must be handled with care and cannot lead to definite conclusions because the measurement bandwidth of our setup is limited to 10 Hz .
In our initial hypothesis, we assumed a characteristic pattern per swallowing task, which would result in a high correlation (Figure 9a). While the results for Subject “b” per swallowing task generally show a high correlation, findings for Subjects “a” and “c” were not conclusive. The resemblance between the single and dual actuator experiments of Subject “b” (water, Figure 10) was limited. Comparison of the patterns themselves (time signal) shows an overall similarity in signal shape within tasks with variations in amplitude (Figure 4). As the main cause for this behavior, we assume differences in the relative position between the actuator and sensor are caused by changes in seating position, head posture, and actuator placement. While the applied reference line method assures a common DC offset (starting point) for the magnetic signal, it can only partly assure a repeatable start position and orientation in 3D space.
From the signals of the second actuator, the swallowing process was not as visible as for the signal of the first one, and we were not able to determine a characteristic pattern. A possible cause could be the placement of the second actuator which could be chosen differently. However, this measurement setup was mostly conducted to prove the general concept of separating both actuator signals in a frequency-division multiple access (FDMA) scheme.
Table 4 shows that features in time (RMS, VAR) are quite similar for both actuators, but frequency domain features actually differ. Despite the high standard deviation in both actuators and the low-frequency values, results suggest that MNF, MDF, PKF, and f low were higher in Actuator A than in B. This observation disagrees with the literature which establishes that suprahyoid frequency components are higher than infrahyoid ones [66,67]. However, it is important to note that despite the actuator’s placement overlapping spatially with the infra- and suprahyoid muscles, it is not possible to establish a direct correlation between electrophysiological activity measured by electromyography and the variations of the magnetic field produced by swallowing-related movements. To the best of our knowledge, this is the first study in which an MI sensor is used to detect the swallowing function, so the reported results cannot be compared with the literature directly. The most related study is the one performed by Monaco et al. [68] in which the authors used the change of the magnetic flux of a kinesiograph to detect the mandibular movement during swallowing. This movement is related to the activation of the suprahyoid muscle group, in the same place as our Actuator B in the dual-sensor experiment. However, the kinesiographic measurements were intended to describe mandibular movements, which are not of interest in the current work. Thus, the closest relation could be made between Actuator A in single and dual actuator setups and the patterns observed in the accelerometry-based cervical auscultation. Even though the accelerometer was placed at the same point to measure the movement of the cricoid cartilage [69], accelerometry discriminates between axes, especially anterior–posterior and superior–inferior movements, but our setup captures magnetic variations produced by changes of the relative position between the actuator and the MI sensor. So, both approaches provide different information, and the results in terms of characterization are not comparable. This opens an opportunity to research the characterization of the magnetic signals from MI sensors in healthy populations and its comparison with patients with swallowing disorders.
Generally, the applied setup might be improved in several ways. For instance, the attachment of the body-worn actuators and corresponding wiring with adhesive tape limited the ability for a robust measurement routine due to weight and soft-tissue artifacts. On the other hand, a fully wearable solution as desired for home assessment would also require body-worn sensors and a battery-powered platform for signal generation and processing. We are currently working on a necklace-based setup (Figure 11) to achieve this goal. The application of energy-efficient cantilever actuators instead of coils might be also be beneficial in such a scenario.
The measurements of Actuator A show sufficient accordance between single and dual actuator experiments (cf. Figure 4 and Figure 7) based on visual inspection. Therefore, we conclude that the simultaneous operation of multiple actuators by FDMA is feasible, which paves the way for more complex operation schemes. Multiple actuators might be employed in several anatomical regions for a comprehensive assessment (in combination with physiological/clinical variables). Detailed mapping of the whole throat area (array approach) might also be beneficial to capture spatial variations with high resolution. Lack of reproducibility might be overcome by defining a more accurate reference position or rejecting movement artifacts (based on multiple actuators or sensors). Furthermore, the use of triaxial magnetic sensors and actuators might be considered, which could enable the reconstruction of unambiguous position and orientation signals instead of magnetic signals.
Finally, validation with the reference methods, e.g., videofluoroscopy, must be performed in order to establish underlying relationships between changes in the signal detected by the MI sensor and physiological movements observed during the swallowing. The advantage of our setup is that the actuators are placed in positions that allow the lateral visualization of the swallowing during the videofluoroscopy. Further studies must address questions such as: are there MI signal-related differences between healthy and dysphagic patients? How significant are the differences between consistencies and volumes? Is it possible to differentiate swallows by gender? Such questions may also be more easily addressed through increased database sizes.

5. Conclusions

In this work, we proposed the use of a novel magnetic setup to assess the swallowing process based on a magnetoimpedance sensor and body-worn cantilevers actuators. This proof-of-concept shows that the proposed setup is capable of detecting swallows from different consistencies, i.e., thin liquid, thick liquid, and saliva. We performed a visual inspection, signal characterization (time, frequency, and time–frequency), and correlation analysis to highlight (and prospectively discriminate) swallows per bolus type. There was a characteristic pattern of the amplitude according to the consistency; yogurt achieved greater amplitude than water, which retrieved greater amplitude than saliva. We found that amplitude-based measures increased clearly during the bolus intake, and there was also an energy increase observed in the time–frequency domain during swallowing regardless of the consistency. In the dual actuator experiment, we successfully applied a secondary actuator to demonstrate the potential for setup improvements such as an increased spatial resolution. We obtained similar time domain features for both actuators, but different frequency domain ones, and a lack of characteristic patterns in correlation plots, suggesting that multiple actuators provide complementary information. Although further validations should be performed, the preliminary results indicate suitability as a non-invasive and quantitative method for dysphagia screening and bio-feedback for diagnosis and therapy.

Author Contributions

Conceptualization, J.H., S.R.-V., K.K., F.N. and G.S.; methodology, J.H., S.R.-V., K.K., J.R.O.-A. and G.S.; software, J.H., S.R.-V. and K.K.; validation, J.H., S.R.-V. and K.K.; formal analysis, J.H., S.R.-V., K.K. and F.N.; investigation, J.H., S.R.-V., K.K. and F.N.; resources, J.H. and F.N.; data curation, J.H., S.R.-V. and K.K.; writing—original draft preparation, J.H., S.R.-V. and K.K.; writing—review and editing, J.H., S.R.-V., K.K., F.N., C.H., W.M., J.R.O.-A. and G.S.; visualization, J.H., S.R.-V., K.K. and F.N.; supervision, F.N., W.M., J.R.O.-A. and G.S.; project administration, C.H., W.M., J.R.O.-A. and G.S.; funding acquisition, C.H., W.M., J.R.O.-A. and G.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG) through project B9 of the Collaborative Research Centre CRC 1261 “Magnetoelectric Sensors: From Composite Materials to Biomagnetic Diagnostics”. This work has been also supported by the Regional Joint CA number R+D+i projects (G8+1, Medellín, Colombia), research project # PE2020-9.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the medical faculty of the Christian-Albrechts-Universität zu Kiel (A122/20).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Result data is available online as part of the Kiel-Medellín Magnetic Swallowing Assessment Database. https://biomagnetic-sensing.de/index.php/data-bases/datasets/magnetic-swallowing-database, accessed on 27 March 2023.

Acknowledgments

The authors would like to thank Torben Dankwort and Jacob Reusch for support with the cantilever actuators, Lars Thormählen for wire bonding, and Eric Elzenheimer for MI sensor handling/characterization.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

The following abbreviations are used in this manuscript:
MEMSMicroElectroMechanical Systems
ISITInstitute for Silicon Technology
CACervical Auscultation
IMUInertial Measurement Unit
MRMagnetoResistive
MIMagnetoImpedance
MEMagnetoElectric
PCBPrinted Circuit Board
ABSAcrylonitrile Butadiene Styrene
DCDirect Current
BNCBayonet Neill–Concelman
IIRInfinite Impulse Response
RMSRoot Mean Square
VARVariance
MNFMean Frequency
MDFMeDian Frequency
MNPMeaN Power
PKFPeak Frequency
BWBandWidth
PSDPower Spectral Density
CRCCollaborative Research Center

References

  1. Wirth, R.; Dziewas, R.; Beck, A.M.; Clavé, P.; Hamdy, S.; Heppner, H.J.; Langmore, S.; Leischker, A.H.; Martino, R.; Pluschinski, P.; et al. Oropharyngeal dysphagia in older persons–From pathophysiology to adequate intervention: A review and summary of an international expert meeting. Clin. Interv. Aging 2016, 11, 189. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Pfeiffer, R.F. Neurogenic dysphagia. In Bradley’s Neurology in Clinical Practice, 7th ed.; Daroff, R.B., Jankovic, J., Mazziotta, J.C., Pomeroy, S.L., Eds.; Elsevier Health Sciences: Amsterdam, The Netherlands, 2016; pp. 148–157.e2. [Google Scholar]
  3. Warnecke, T.; Labeit, B.; Schroeder, J.; Reckels, A.; Ahring, S.; Lapa, S.; Claus, I.; Muhle, P.; Suntrup-Krueger, S.; Dziewas, R. Neurogenic dysphagia: Systematic review and proposal of a classification system. Neurology 2021, 96, e876–e889. [Google Scholar] [CrossRef] [PubMed]
  4. Giraldo-Cadavid, L.F.; Gutiérrez-Achury, A.M.; Ruales-Suárez, K.; Rengifo-Varona, M.L.; Barros, C.; Posada, A.; Romero, C.; Galvis, A.M. Validation of the Spanish Version of the Eating Assessment Tool-10 (EAT-10 spa) in Colombia. A Blinded Prospective Cohort Study. Dysphagia 2016, 31, 398–406. [Google Scholar] [CrossRef]
  5. Earl, V.J.; Badawy, M.K. Radiation exposure to staff and patient during videofluoroscopic swallowing studies and recommended protection strategies. Dysphagia 2019, 34, 290–297. [Google Scholar] [CrossRef] [PubMed]
  6. Nacci, A.; Ursino, F.; La Vela, R.; Matteucci, F.; Mallardi, V.; Fattori, B. Fiberoptic endoscopic evaluation of swallowing (FEES): Proposal for informed consent. Acta Otorhinolaryngol. Ital. 2008, 28, 206. [Google Scholar] [PubMed]
  7. Langmore, S.E. Evaluation of oropharyngeal dysphagia: Which diagnostic tool is superior? Curr. Opin. Otolaryngol. Head Neck Surg. 2003, 11, 485–489. [Google Scholar] [CrossRef]
  8. Zoratto, D.; Chau, T.; Steele, C. Hyolaryngeal excursion as the physiological source of swallowing accelerometry signals. Physiol. Meas. 2010, 31, 843. [Google Scholar] [CrossRef]
  9. Lee, J.; Steele, C.; Chau, T. Time and time–frequency characterization of dual-axis swallowing accelerometry signals. Physiol. Meas. 2008, 29, 1105. [Google Scholar] [CrossRef]
  10. Dudik, J.M.; Kurosu, A.; Coyle, J.L.; Sejdić, E. A statistical analysis of cervical auscultation signals from adults with unsafe airway protection. J. Neuroeng. Rehabil. 2016, 13, 7. [Google Scholar] [CrossRef] [Green Version]
  11. Nikjoo, M.S.; Steele, C.M.; Sejdić, E.; Chau, T. Automatic discrimination between safe and unsafe swallowing using a reputation-based classifier. Biomed. Eng. Online 2011, 10, 100. [Google Scholar] [CrossRef] [Green Version]
  12. Mao, S.; Sabry, A.; Khalifa, Y.; Coyle, J.L.; Sejdic, E. Estimation of laryngeal closure duration during swallowing without invasive X-rays. Future Gener. Comput. Syst. 2021, 115, 610–618. [Google Scholar] [CrossRef]
  13. Donohue, C.; Khalifa, Y.; Mao, S.; Perera, S.; Sejdić, E.; Coyle, J.L. Characterizing Swallows From People With Neurodegenerative Diseases Using High-Resolution Cervical Auscultation Signals and Temporal and Spatial Swallow Kinematic Measurements. J. Speech Lang. Hear. Res. 2021, 64, 3416–3431. [Google Scholar] [CrossRef] [PubMed]
  14. Movahedi, F.; Kurosu, A.; Coyle, J.L.; Perera, S.; Sejdić, E. A comparison between swallowing sounds and vibrations in patients with dysphagia. Comput. Methods Programs Biomed. 2017, 144, 179–187. [Google Scholar] [CrossRef] [PubMed]
  15. Hamlet, S.; Penney, D.G.; Formolo, J. Stethoscope acoustics and cervical auscultation of swallowing. Dysphagia 1994, 9, 63–68. [Google Scholar] [CrossRef] [PubMed]
  16. Waito, A.; Bailey, G.L.; Molfenter, S.M.; Zoratto, D.C.; Steele, C.M. Voice-quality abnormalities as a sign of dysphagia: Validation against acoustic and videofluoroscopic data. Dysphagia 2011, 26, 125–134. [Google Scholar] [CrossRef]
  17. Hassan, H.E.; Aboloyoun, A.I. The value of bedside tests in dysphagia evaluation. Egypt. J. Ear Nose Throat Allied Sci. 2014, 15, 197–203. [Google Scholar] [CrossRef] [Green Version]
  18. Santos, K.W.d.; Scheeren, B.; Maciel, A.C.; Cassol, M. Vocal variability post swallowing in individuals with and without oropharyngeal dysphagia. Int. Arch. Otorhinolaryngol. 2015, 19, 61–66. [Google Scholar]
  19. Farneti, D. Voice and dysphagia. In Dysphagia; Springer: Cham, Switzerland, 2017; pp. 257–274. [Google Scholar]
  20. Miles, J.; Johnston, D.L.; Friary, A. Effect of Lee Silverman Voice Treatment (LSVT LOUD) on swallowing and cough in Parkinson’s disease: A pilot study. Neurol Sci. 2017, 383, 180–187. [Google Scholar] [CrossRef]
  21. Roldan-Vasco, S.; Orozco-Duque, A.; Suarez-Escudero, J.C.; Orozco-Arroyave, J.R. Machine learning based analysis of speech dimensions in functional oropharyngeal dysphagia. Comput. Methods Programs Biomed. 2021, 208, 106248. [Google Scholar] [CrossRef]
  22. Vaiman, M. Standardization of surface electromyography utilized to evaluate patients with dysphagia. Head Face Med. 2007, 3, 7. [Google Scholar] [CrossRef] [Green Version]
  23. Vaiman, M.; Eviatar, E. Surface electromyography as a screening method for evaluation of dysphagia and odynophagia. Head Face Med. 2009, 5, 11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Aydogdu, I.; Kiylioglu, N.; Tarlaci, S.; Tanriverdi, Z.; Alpaydin, S.; Acarer, A.; Baysal, L.; Arpaci, E.; Yuceyar, N.; Secil, Y.; et al. Diagnostic value of “dysphagia limit” for neurogenic dysphagia: 17 years of experience in 1278 adults. Clin. Neurophysiol. 2015, 126, 634–643. [Google Scholar] [CrossRef] [PubMed]
  25. Schultheiss, C.; Schauer, T.; Nahrstaedt, H.; Seidl, R.O. Automated detection and evaluation of swallowing using a combined EMG/bioimpedance measurement system. Sci. World J. 2014, 2014, 405471. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Zhu, M.; Yu, B.; Yang, W.; Jiang, Y.; Lu, L.; Huang, Z.; Chen, S.; Li, G. Evaluation of normal swallowing functions by using dynamic high-density surface electromyography maps. Biomed. Eng. Online 2017, 16, 18. [Google Scholar] [CrossRef] [Green Version]
  27. Constantinescu, G.; Hodgetts, W.; Scott, D.; Kuffel, K.; King, B.; Brodt, C.; Rieger, J. Electromyography and mechanomyography signals during swallowing in healthy adults and head and neck cancer survivors. Dysphagia 2017, 32, 90–103. [Google Scholar] [CrossRef]
  28. Riebold, B.; Nahrstaedt, H.; Schauer, T.; Seidl, R.O. Self-adapting Classification System for Swallow Intention Detection in Dysphagia Therapy. Curr. Dir. Biomed. Eng. 2019, 5, 49–52. [Google Scholar] [CrossRef]
  29. Roldan-Vasco, S.; Restrepo-Agudelo, S.; Valencia-Martinez, Y.; Orozco-Duque, A. Automatic detection of oral and pharyngeal phases in swallowing using classification algorithms and multichannel EMG. J. Electromyogr. Kinesiol. 2018, 43, 193–200. [Google Scholar] [CrossRef]
  30. Suzuki, M.; Sasaki, M.; Kamata, K.; Nakayama, A.; Shibamoto, I.; Tamada, Y. Swallowing pattern classification method using multichannel surface EMG signals of suprahyoid and infrahyoid muscles. Adv. Biomed. Eng. 2020, 9, 10–20. [Google Scholar] [CrossRef] [Green Version]
  31. Inoue, K.; Yoshioka, M.; Yagi, N.; Nagami, S.; Oku, Y. Using machine learning and a combination of respiratory flow, laryngeal motion, and swallowing sounds to classify safe and unsafe swallowing. IEEE Trans. Biomed. Eng. 2018, 65, 2529–2541. [Google Scholar] [CrossRef]
  32. Lee, J.; Steele, C.M.; Chau, T. Swallow segmentation with artificial neural networks and multi-sensor fusion. Med. Eng. Phys. 2009, 31, 1049–1055. [Google Scholar] [CrossRef]
  33. Ertekin, C.; Aydoğdu, I.; Yüceyar, N. Piecemeal deglutition and dysphagia limit in normal subjects and in patients with swallowing disorders. J. Neurol. Neurosurg. Psychiatry 1996, 61, 491–496. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Kalantarian, H.; Alshurafa, N.; Le, T.; Sarrafzadeh, M. Monitoring eating habits using a piezoelectric sensor-based necklace. Comput. Biol. Med. 2015, 58, 46–55. [Google Scholar] [CrossRef] [PubMed]
  35. Sabatini, A.M. Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing. IEEE Trans. Biomed. Eng. 2006, 53, 1346–1356. [Google Scholar] [CrossRef] [PubMed]
  36. Yun, X.; Calusdian, E.; Bachmann, R.; McGhee, R.B. Estimation of Human Foot Motion During Normal Walking Using Inertial and Magnetic Sensor Measurements. IEEE Trans. Instrum. Meas. 2012, 61, 2059–2072. [Google Scholar] [CrossRef]
  37. Cheng, C.; Huo, X.; Ghovanloo, M. Towards a magnetic localization system for 3-D tracking of tongue movements in speech-language therapy. In Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 3–6 September 2009; pp. 563–566. [Google Scholar] [CrossRef] [Green Version]
  38. Hu, C.; Song, S.; Wang, X.; Meng, M.; Li, B. A Novel Positioning and Orientation System Based on Three-Axis Magnetic Coils. IEEE Trans. Magn. 2012, 48, 2211–2219. [Google Scholar] [CrossRef]
  39. Bald, C.; Schmidt, G. Processing Chain for Localization of Magnetoelectric Sensors in Real Time. Sensors 2021, 21, 5675. [Google Scholar] [CrossRef]
  40. Hoffmann, H.; Hansen, C.; Maetzler, W.; Schmidt, G. A Concept for 6D Motion Sensing with Magnetoelectric Sensors. Curr. Dir. Biomed. Eng. 2022, 8, 451–454. [Google Scholar] [CrossRef]
  41. Hoffmann, J.; Elzenheimer, E.; Bald, C.; Hansen, C.; Maetzler, W.; Schmidt, G. Active Magnetoelectric Motion Sensing: Examining Performance Metrics with an Experimental Setup. Sensors 2021, 21, 8000. [Google Scholar] [CrossRef]
  42. Kaluza, F.; Grüger, A.; Grüger, H. New and future applications of fluxgate sensors. Sens. Actuators A Phys. 2003, 106, 48–51. [Google Scholar] [CrossRef]
  43. Jogschies, L.; Klaas, D.; Kruppe, R.; Rittinger, J.; Taptimthong, P.; Wienecke, A.; Rissing, L.; Wurz, M. Recent Developments of Magnetoresistive Sensors for Industrial Applications. Sensors 2015, 15, 28665–28689. [Google Scholar] [CrossRef] [Green Version]
  44. Wang, T.; Zhou, Y.; Lei, C.; Luo, J.; Xie, S.; Pu, H. Magnetic impedance biosensor: A review. Biosens. Bioelectron. 2017, 90, 418–435. [Google Scholar] [CrossRef] [PubMed]
  45. Elzenheimer, E.; Bald, C.; Engelhardt, E.; Hoffmann, J.; Hayes, P.; Arbustini, J.; Bahr, A.; Quandt, E.; Höft, M.; Schmidt, G. Quantitative Evaluation for Magnetoelectric Sensor Systems in Biomagnetic Diagnostics. Sensors 2022, 22, 1018. [Google Scholar] [CrossRef] [PubMed]
  46. Niekiel, F.; Su, J.; Bodduluri, M.T.; Lisec, T.; Blohm, L.; Pieper, I.; Wagner, B.; Lofink, F. Highly sensitive MEMS magnetic field sensors with integrated powder-based permanent magnets. Sens. Actuators A Phys. 2019, 297, 111560. [Google Scholar] [CrossRef]
  47. Dong, C.; He, Y.; Li, M.; Tu, C.; Chu, Z.; Liang, X.; Chen, H.; Wei, Y.; Zaeimbashi, M.; Wang, X.; et al. A Portable Very Low Frequency (VLF) Communication System Based on Acoustically Actuated Magnetoelectric Antennas. IEEE Antennas Wirel. Propag. Lett. 2020, 19, 398–402. [Google Scholar] [CrossRef]
  48. Arbustini, J.; Muñoz, J.; Wang, H.; Elzenheimer, E.; Hoffmann, H.; Thormählen, L.; Hayes, P.; Niekiel, F.; Heidari, H.; Höft, M.; et al. MEMS Magnetic Field Source for Frequency Conversion Approaches for ME Sensors. Curr. Dir. Biomed. Eng. 2022, 8, 309–312. [Google Scholar] [CrossRef]
  49. Moriniére, S.; Boiron, M.; Alison, D.; Makris, P.; Beutter, P. Origin of the sound components during pharyngeal swallowing in normal subjects. Dysphagia 2008, 23, 267–273. [Google Scholar] [CrossRef]
  50. Dudik, J.M.; Coyle, J.L.; Sejdić, E. Dysphagia screening: Contributions of cervical auscultation signals and modern signal-processing techniques. IEEE Trans.-Hum.-Mach. Syst. 2015, 45, 465–477. [Google Scholar] [CrossRef] [Green Version]
  51. Shaw, S.M.; Martino, R. The normal swallow: Muscular and neurophysiological control. Otolaryngol. Clin. N. Am. 2013, 46, 937–956. [Google Scholar] [CrossRef]
  52. Sampaio, M.; Argolo, N.; Melo, A.; Nóbrega, A.C. Wet voice as a sign of penetration/aspiration in Parkinson’s disease: Does testing material matter? Dysphagia 2014, 29, 610–615. [Google Scholar] [CrossRef]
  53. van den Engel-Hoek, L.; de Groot, I.J.; Esser, E.; Gorissen, B.; Hendriks, J.C.; de Swart, B.J.; Geurts, A.C. Biomechanical events of swallowing are determined more by bolus consistency than by age or gender. Physiol. Behav. 2012, 106, 285–290. [Google Scholar] [CrossRef]
  54. Walton, J.; Silva, P. Physiology of swallowing. Surgery 2018, 36, 529–534. [Google Scholar]
  55. Schmidt, G.; Bald, C.; Kreisel, J. Removal of Signal Trends. Available online: https://dss-kiel.de/index.php/teaching/red-main/red-trend-removal (accessed on 27 December 2022).
  56. Phinyomark, A.; Phukpattaranont, P.; Limsakul, C. Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 2012, 39, 7420–7431. [Google Scholar] [CrossRef]
  57. Dudik, J.M.; Jestrović, I.; Luan, B.; Coyle, J.L.; Sejdić, E. A comparative analysis of swallowing accelerometry and sounds during saliva swallows. Biomed. Eng. Online 2015, 14, 15. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  58. Roldan-Vasco, S.; Perez-Giraldo, E.; Orozco-Duque, A. Continuous wavelet transform for muscle activity detection in surface EMG signals during swallowing. In Proceedings of the Workshop on Engineering Applications, Medellín, Colombia, 17–19 October 2018; Springer: Cham, Switzerland, 2018; pp. 245–255. [Google Scholar]
  59. Roldán-Vasco, S.; Pérez-Giraldo, E.; Orozco-Duque, A. Scalogram-energy based segmentation of surface electromyography signals from swallowing related muscles. Comput. Methods Programs Biomed. 2020, 194, 105480. [Google Scholar] [CrossRef]
  60. Watts, C.R.; Kelly, B. The effect of bolus consistency and sex on electrophysiological measures of hyolaryngeal muscle activity during swallowing. Dysphagia 2015, 30, 551–557. [Google Scholar] [CrossRef]
  61. Nakao, Y.; Onishi, H.; Haji, T.; Shiromoto, O.; Saito, S.; Nanto, T.; Uchiyama, Y.; Domen, K. Impact of Thickened Liquids on Laryngeal Movement Velocity in Patients with Dysphagia. Dysphagia 2022, 37, 207–215. [Google Scholar] [CrossRef]
  62. Youmans, S.R.; Stierwalt, J.A. Normal swallowing acoustics across age, gender, bolus viscosity, and bolus volume. Dysphagia 2011, 26, 374–384. [Google Scholar] [CrossRef]
  63. Taniwaki, M.; Kohyama, K. Fast Fourier transform analysis of sounds made while swallowing various foods. J. Acoust. Soc. Am. 2012, 132, 2478–2482. [Google Scholar] [CrossRef]
  64. Dudik, J.M.; Jestrović, I.; Luan, B.; Coyle, J.L.; Sejdić, E. Characteristics of dry chin-tuck swallowing vibrations and sounds. IEEE Trans. Biomed. Eng. 2015, 62, 2456–2464. [Google Scholar] [CrossRef] [Green Version]
  65. Restrepo-Agudelo, S.; Roldan-Vasco, S.; Ramirez-Arbelaez, L.; Cadavid-Arboleda, S.; Perez-Giraldo, E.; Orozco-Duque, A. Improving surface EMG burst detection in infrahyoid muscles during swallowing using digital filters and discrete wavelet analysis. J. Electromyogr. Kinesiol. 2017, 35, 8. [Google Scholar] [CrossRef]
  66. Sunada, Y.; Magara, J.; Tsujimura, T.; Ono, K.; Inoue, M. Endurance measurement of hyoid muscle activity and hyoid-laryngeal position during tongue lift movement. J. Oral Rehabil. 2020, 47, 967–976. [Google Scholar] [CrossRef]
  67. Koshi, N.; Magara, J.; Sakai, S.; Tsujimura, T.; Ono, K.; Inoue, M. Properties of hyoid muscle contraction during tongue lift measurement. J. Oral Rehabil. 2020, 47, 332–338. [Google Scholar] [CrossRef] [PubMed]
  68. Monaco, A.; Cattaneo, R.; Spadaro, A.; Giannoni, M. Surface electromyography pattern of human swallowing. BMC Oral Health 2008, 8, 11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  69. Khalifa, Y.; Coyle, J.L.; Sejdić, E. Non-invasive identification of swallows via deep learning in high resolution cervical auscultation recordings. Sci. Rep. 2020, 10, 13. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Overview of the principle and the physical setup of the cantilever actuator system.
Figure 1. Overview of the principle and the physical setup of the cantilever actuator system.
Sensors 23 03594 g001
Figure 2. Overview of the experimental setup for magnetic swallowing assessment.
Figure 2. Overview of the experimental setup for magnetic swallowing assessment.
Sensors 23 03594 g002
Figure 3. Functional overview of the signal enhancement pipeline.
Figure 3. Functional overview of the signal enhancement pipeline.
Sensors 23 03594 g003
Figure 4. Example signals of all swallowing trials with different liquids for Subject “b”.
Figure 4. Example signals of all swallowing trials with different liquids for Subject “b”.
Sensors 23 03594 g004
Figure 5. Example of the average signals for each swallowing task of Subject “b”.
Figure 5. Example of the average signals for each swallowing task of Subject “b”.
Sensors 23 03594 g005
Figure 6. Prototype swallowing signal for each subject.
Figure 6. Prototype swallowing signal for each subject.
Sensors 23 03594 g006
Figure 7. Signals of both actuators for six swallowing attempts with water.
Figure 7. Signals of both actuators for six swallowing attempts with water.
Sensors 23 03594 g007
Figure 8. Spectral examples of the saliva-related signal in the single actuator experiment.
Figure 8. Spectral examples of the saliva-related signal in the single actuator experiment.
Sensors 23 03594 g008
Figure 9. Normalized cross-correlation for each of the 27 trials grouped by different categories.
Figure 9. Normalized cross-correlation for each of the 27 trials grouped by different categories.
Sensors 23 03594 g009
Figure 10. Normalized cross-correlation for both experiments with Subject “b” only.
Figure 10. Normalized cross-correlation for both experiments with Subject “b” only.
Sensors 23 03594 g010
Figure 11. Concept of a wearable necklace setup.
Figure 11. Concept of a wearable necklace setup.
Sensors 23 03594 g011
Table 1. Demographic data of participants.
Table 1. Demographic data of participants.
SubjectSexAge
aMale36
bFemale24
cMale50
Table 2. Mathematical formulations of features.
Table 2. Mathematical formulations of features.
FeatureEquationFeatureEquation
VAR 1 N 1 i = 1 N x i 2 RMS 1 N i = 1 N x i 2
MNP 1 M j = 1 M P ( f j ) MNF j = 1 M f j P ( f j ) / j = 1 M P ( f j )
MDF j = 1 M D F P ( f j ) = 1 2 j = 1 M P ( f j ) PKF argmax f { P ( f ) }
E a i { c A ( i ) } 2 E d j i { c D j ( i ) } 2
xi: i-th sample of the signal; N: length of the signal; M: length of the power spectral density (PSD); P(fj): PSD evaluated at the j-th frequency fj; cA(i) and cDj(i): i-th sample of the approximation and j-th detail coefficients, respectively.
Table 3. Features grouped per swallowing task for the single actuator experiment. Values provided in mean ± standard deviation. Domains are separated by grey lines.
Table 3. Features grouped per swallowing task for the single actuator experiment. Values provided in mean ± standard deviation. Domains are separated by grey lines.
FeatureSalivaWaterYogurt
Amplitude (nT)0.67 ± 0.080.66 ± 0.130.85 ± 0.13
Pulse width (s)0.28 ± 0.010.26 ± 0.030.29 ± 0.04
RMS (nT)0.28 ± 0.180.19 ± 0.070.30 ± 0.08
VAR (nT2)0.10 ± 0.120.04 ± 0.030.09 ± 0.05
MNF (Hz)0.83 ± 0.201.03 ± 0.180.73 ± 0.13
MDF (Hz)0.56 ± 0.210.85 ± 0.250.47 ± 0.16
PKF (Hz)0.43 ± 0.290.67 ± 0.380.33 ± 0.10
f low (Hz)0.24 ± 0.050.34 ± 0.160.24 ± 0.05
f high (Hz)0.73 ± 0.341.08 ± 0.510.51 ± 0.08
BW (Hz)0.50 ± 0.310.73 ± 0.470.27 ± 0.08
MNP (nT2Hz−1)0.06 ± 0.070.02 ± 0.020.06 ± 0.03
E a (dB)12.68 ± 5.499.93 ± 3.6114.57 ± 2.23
E d 4 (dB)−7.78 ± 5.04−7.69 ± 4.44−5.97 ± 3.58
Table 4. Features obtained in the dual actuator experiment with water for Subject “b”. Values provided in mean ± standard deviation. Domains are separated by grey lines.
Table 4. Features obtained in the dual actuator experiment with water for Subject “b”. Values provided in mean ± standard deviation. Domains are separated by grey lines.
FeatureActuator AActuator B
RMS (nT)0.21 ± 0.050.23 ± 0.13
VAR (nT2)0.05 ± 0.020.06 ± 0.07
MNF (Hz)1.00 ± 0.240.64 ± 0.23
MDF (Hz)0.74 ± 0.300.38 ± 0.21
PKF (Hz)0.42 ± 0.290.33 ± 0.24
f low (Hz)0.31 ± 0.180.21 ± 0.13
f high (Hz)0.60 ± 0.320.56 ± 0.19
BW (Hz)0.30 ± 0.170.35 ± 0.13
MNP (nT2Hz−1)0.03 ± 0.010.04 ± 0.05
E a (dB)11.35 ± 2.1511.78 ± 4.76
E d 4 (dB)−7.78 ± 1.45−11.20 ± 3.42
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hoffmann, J.; Roldan-Vasco, S.; Krüger, K.; Niekiel, F.; Hansen, C.; Maetzler, W.; Orozco-Arroyave, J.R.; Schmidt, G. Pilot Study: Magnetic Motion Analysis for Swallowing Detection Using MEMS Cantilever Actuators. Sensors 2023, 23, 3594. https://doi.org/10.3390/s23073594

AMA Style

Hoffmann J, Roldan-Vasco S, Krüger K, Niekiel F, Hansen C, Maetzler W, Orozco-Arroyave JR, Schmidt G. Pilot Study: Magnetic Motion Analysis for Swallowing Detection Using MEMS Cantilever Actuators. Sensors. 2023; 23(7):3594. https://doi.org/10.3390/s23073594

Chicago/Turabian Style

Hoffmann, Johannes, Sebastian Roldan-Vasco, Karolin Krüger, Florian Niekiel, Clint Hansen, Walter Maetzler, Juan Rafael Orozco-Arroyave, and Gerhard Schmidt. 2023. "Pilot Study: Magnetic Motion Analysis for Swallowing Detection Using MEMS Cantilever Actuators" Sensors 23, no. 7: 3594. https://doi.org/10.3390/s23073594

APA Style

Hoffmann, J., Roldan-Vasco, S., Krüger, K., Niekiel, F., Hansen, C., Maetzler, W., Orozco-Arroyave, J. R., & Schmidt, G. (2023). Pilot Study: Magnetic Motion Analysis for Swallowing Detection Using MEMS Cantilever Actuators. Sensors, 23(7), 3594. https://doi.org/10.3390/s23073594

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop