Next Article in Journal
AIE-YOLO: Auxiliary Information Enhanced YOLO for Small Object Detection
Next Article in Special Issue
Design and Haemodynamic Analysis of a Novel Anchoring System for Central Venous Pressure Measurement
Previous Article in Journal
Short-Term Solar Irradiance Prediction Based on Adaptive Extreme Learning Machine and Weather Data
Previous Article in Special Issue
Attention Detection by Heartbeat and Respiratory Features from Radio-Frequency Sensor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Toward an Automatic Assessment of Cognitive Dysfunction in Relapsing–Remitting Multiple Sclerosis Patients Using Eye Movement Analysis

by
Cecilia E. García Cena
1,
David Gómez-Andrés
2,*,
Irene Pulido-Valdeolivas
3,
Victoria Galán Sánchez-Seco
4,
Angela Domingo-Santos
5,
Sara Moreno-García
6 and
Julián Benito-León
6,7,8
1
Escuela Técnica Superior de Ingeniería y Diseño Industrial, Centre for Automation and Robotics, ETSIDI-CAR, Universidad Politécnica de Madrid, 28012 Madrid, Spain
2
Child Neurology Unit, Hospital Universitari Vall d’Hebron, Vall d’Hebron Research Institute (VHIR), Euro-NMD and ERN-RND, 08035 Barcelona, Spain
3
Anatomy, Histology and Neuroscience Department, Universidad Autónoma de Madrid, 28049 Madrid, Spain
4
Department of Neurology, University Hospital “Virgen de la Salud”, 45004 Toledo, Spain
5
Department of Neurology, “La Mancha Centro” General Hospital, Alcázar de San Juan, 13600 Ciudad Real, Spain
6
Department of Neurology, University Hospital “12 de Octubre”, 28041 Madrid, Spain
7
Centro de Investigación Biomédica en Red sobre Enfermedades Neurodegenerativas (CIBERNED), 28029 Madrid, Spain
8
Department of Medicine, Complutense University, 28040 Madrid, Spain
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(21), 8220; https://doi.org/10.3390/s22218220
Submission received: 15 September 2022 / Revised: 13 October 2022 / Accepted: 22 October 2022 / Published: 27 October 2022
(This article belongs to the Special Issue Monitoring Technologies in Healthcare Applications)

Abstract

:
Despite the importance of cognitive function in multiple sclerosis, it is poorly represented in the Expanded Disability Status Scale (EDSS), the commonly used clinical measure to assess disability, suggesting that an analysis of eye movement, which is generated by an extensive and well-coordinated functional network that is engaged in cognitive function, could have the potential to extend and complement this more conventional measure. We aimed to measure the eye movement of a case series of MS patients with relapsing–remitting MS to assess their cognitive status using a conventional gaze tracker. A total of 41 relapsing–remitting MS patients and 43 age-matched healthy controls were recruited for this study. Overall, we could not find a clear common pattern in the eye motor abnormalities. Vertical eye movement was more impaired in MS patients than horizontal movement. Increased latencies were found in the prosaccades and reflexive saccades of antisaccade tests. The smooth pursuit was impaired with more corrections (backup and catchup movements, p < 0.01 ). No correlation was found between eye movement variables and EDSS or disease duration. Despite significant alterations in the behavior of the eye movements in MS patients, which are compatible with altered cognitive status, there is no common pattern of these alterations. We interpret this as a consequence of the patchy, heterogeneous distribution of white matter involvement in MS that provokes multiple combinations of impairment at different points in the different networks involved in eye motor control. Further studies are therefore required.

1. Introduction

Multiple sclerosis (MS) is a chronic inflammatory demyelinating disease with severe implications for its sufferers’ health-related quality of life [1,2]. Patients with MS and their families must adjust to new lifestyle changes and restrictions due to the wide range of signs and symptoms [3,4]. Eye movement abnormalities are frequent among the plethora of motor and non-motor features of MS [5]. These abnormalities can be categorized into two. The first comprises gross eye abnormalities discovered during a routine neurological examination; these include loss of visual acuity and reduction in visual fields, ocular misalignment, different types of abnormal nystagmus, impaired vestibular–ocular response, and ocular motor palsy [5]. These anomalies may result from direct injuries in the cranial nerves, brainstem, and cerebellar circuits that directly regulate eye movement [5]. The second is the possibility of MS subtly interfering with the complex network that supervises eye movement and involves multiple cortical areas and subcortical structures [5]. MS can disrupt the synchronization of neural circuits that connect ocular centers in frontal areas such as the frontal eye fields, supplementary frontal eye fields, dorsolateral prefrontal cortex, and anterior cingulate cortex to those in the posterior parietal cortex [5]. Two examples of this in MS are the dysfunctional attentional control of eye movement in response to distractions [6] and impaired attention interfering with memory-guided saccades [7]. The assessment of eye movements may be a powerful tool for analyzing cognitive changes in MS, acting as a surrogate measure of performance that complements more traditional measures.
In the lives of patients with MS, cognitive dysfunction throws a long shadow. The prevalence of cognitive dysfunction in MS ranges from 40% to 70% [8,9]. The most commonly affected cognitive domains are learning, memory, attention, information processing speed, visuospatial abilities, and executive function [8,9]. Cognitively impaired MS patients are more likely to be unemployed and have constraints in social activities and family responsibilities than patients with equal levels of physical disability [10]. The most commonly validated neuropsychological batteries used to assess cognitive dysfunction in MS are Rao’s Brief Repeatable Battery of Neuropsychological Tests [11] and the Minimal Assessment of Cognitive Function in Multiple Sclerosis [12]. These batteries are complex, time consuming, and require trained specialists to perform the test. Therefore, the assessment of the cognitive impairment in these patients is not extended to clinical settings. Furthermore, despite the importance of cognitive function in MS, it is poorly represented in the Expanded Disability Status Scale (EDSS) [13], which is the commonly used clinical measure to assess disability, suggesting that an analysis of eye movement, which is generated by an extensive and well-coordinated functional network that is engaged in cognitive function, could have the potential to extend and complement this more conventional measure.
Over the last ten years, the measurement of eye movement using video-oculography has increased due to the accuracy of the gaze position computed from image processing [14]. However, in the case of MS, there is no consensus on which visual tests should be applied. Previous analyses of eye movement in MS have not been completed automatically, i.e., with standard paradigms easy to apply (not only for research purposes) that diminished the required degree of expertise [15,16].
We aimed to measure the eye movement of a case series of MS patients with relapsing–remitting MS to assess their cognitive status and find a pattern that allows reaching a consensus on which eye visual tests should be completed to automatize the process. We compared the findings with those obtained from healthy volunteers in the same range of age. It would be a step toward the automatic analysis of the eye movements in MS needed in a clinical setting.
This article is organized as follows. Section 2 describes the materials used and methods followed to accomplish this study. Section 3 presents the main results found after the data analysis, while the discussion is described in Section 4. The future steps and main conclusions are summarized in Section 5.

2. Materials and Methods

2.1. Participants

From April 2018 to May 2018, 41 relapsing–remitting MS patients were recruited from the MS Clinics at the University Hospital “12 de Octubre” (Madrid, Spain). Patients had clinically confirmed MS according to 2017 revised McDonald criteria [17] and were stable (no relapses) at the study time. Four neurologists (VFS, ADS, SMG, and JBL) with MS expertise conducted the clinical examination using the EDSS to rate the severity of the disease (range = 0–10), [13]. Exclusion criteria were as follows: institutionalized at the observation time, ophthalmological diseases that affected visual acuity despite lens correction, major serious acute or chronic comorbidities, and neurological (other than MS) or psychiatric diseases, including dementia or major depressive disorder.
Forty-three age-matched healthy controls were recruited from the relatives or acquaintances of the study researchers [18]. None of the controls were related to any of the MS patients in the study. In addition, none of them had any known neurological or psychiatric conditions, and no one had a personal history of ophthalmological diseases that, despite lens correction, compromised visual acuity.
In Table 1, the most relevant demographic data of the healthy controls and the MS patients are presented.
In order to guarantee the reproducibility of the data, we used an available and certified gaze-tracker, [19]. The ethical standards committees on human testing at the University Hospital “12 de Octubre” approved all procedures (Madrid). All participants were given oral and written information about the study and signed an informed consent document.

2.2. Description of the Eye Movement Tests

A saccadic movement, also known as a “saccade,” is a rapid, jerky eye movement that directs the gaze to a new location and redistributes the region of high visual acuity centered on the fovea [20]. Saccades are voluntary movements but are generally produced with highly automated routines. This section describes the materials used and the method developed to assess the eye movements under binocular vision but with a monocular measurement on the dominant eye. For further information on the neurological aspects of eye movements, the reader is referred to [21].
All participants conducted the visually guided saccades, antisaccades, and smooth pursuit tests in horizontal and vertical axes. The stimulus was a green dot with a 2 cm diameter, and the background color was black. Vertical and horizontal eye movements were recorded under gap representation of the visual stimulus.
The gaze tracker consists of a conventional screen where visual stimuli are deployed according to the test (see next sections). The screen is located at 60 cm from a chin rest used to avoid head movements. The eye movement test lasts approximately 10 min. In order to guarantee the accuracy of the measurement, a new calibration was completed every two tests.

2.2.1. Visual Guided Saccade Test

In Figure 1, a scheme of a visually guided saccade is presented. Although this representation is on the horizontal axis, the same values are computed vertically.
The stimulus appears in the center of the screen during 1500 ms and randomly jumps to the right and left (horizontal test) or up and down (vertical test). The instruction to perform this test was “Look at the green dot”. In Table 2, the saccade test is described.
Definition 1.
Centrifugal latency is the time ( t ( t ) ) elapsed between the change of the stimulus ( t s t i m u l u s ) and the first eye movements performed by the volunteer in response to the stimulus change ( t g a z e ). In order to detect this change, the velocity of the movement is computed. We computed it by (1). In the measure of latency variable (ms), the express saccades (saccadic movement with latency between 80 and 130 ms) were discarded.
t ( t ) = t g a z e t s t i m u l u s
Definition 2.
Centripetal latency is the time ( t c ) elapsed between the change of the stimulus ( t s t c e n t r e ) toward the screen center and the first eye movements performed by the volunteer in response to the stimulus change ( t g a z e ). This latency is computed by (2).
t c ( t ) = t g a z e t s t c e n t r e
According to [18,22,23,24], t c ( t ) < t ( t ) in healthy volunteers.
Definition 3.
The gain (3) of the saccade is computed by the ratio between stimulus amplitude ( A m p s t i m u l u s ) and gaze amplitude ( A m p g a z e ).
G a i n = A m p g a z e A m p s t i m u l u s
In previous work, [18], the authors had demonstrated that the accuracy of the saccadic movement is a significant value to evaluate brain aging.

2.2.2. Antisaccade Test

Figure 2 describes the main parameters measured in the antisaccade test, in which the volunteer must perform a movement in the opposite direction of the stimulus. Table 3 summarizes the main parameters of the test. The instruction to perform this test was: “Look toward the opposite direction to the green dot”.
An antisaccade is correct if the volunteer performs a saccade movement opposite to the stimulus. In order to measure the latency of the antisaccade, we used (1).
When the subject performs a movement in the direction of the stimulus and then corrects the gaze to the opposite side, this saccade is called “reflexive”. The latency and the duration of the reflexive saccade are indicative of the reaction time of the neural inhibitory pathway [25].
If the reflexive saccade’s duration and the eye movement’s amplitude are higher than 0.5 of the stimulus’s amplitude and duration, then it is counted as a reflexive saccade. In another case, it is a non-identified eye movement. The value of 0.5 was settled practically.
When the subject performs a movement in the direction of the stimulus and does not correct the gaze to the opposite side, this saccade is classified as an error. When the subject performs a movement that does not follow a clear paradigm (prosaccade, reflexive, express, antisaccade), we classified this as an erratic antisaccade.
Other variables such as the error rate, corrected saccades, successful, anticipatory, and erratic antisaccades are measured. Figure 3 shows a flow chart describing how we compute these values. If the gaze and stimulus direction are the same, it is a reflexive saccade, and the latency and duration are computed. In the case of a reflexive saccade, we compute two parameters:
Definition 4.
The Latency of Reflexive Saccade (ms) ( t r e f ) is the time elapsed from the detection of the eye moving toward the opposite side ( t g a z e A ) and the time of the stimulus change ( t s t i m u l u s ). It is computed by (4). See Figure 2.
t r e f ( t ) = t g a z e A t s t i m u l u s
Definition 5.
The duration of reflexive saccades, t r e f , (ms), is computed by (5), and it is the difference between the time at which the subject fixes the gaze on the stimulus ( t i n i F I X ) and the time in which the gaze starts the movement to the opposite direction ( t e n d F I X ):
t r e f ( t ) = t e n d F I X t i n i F I X
In the case the gaze and stimulus direction are opposite, it is a correct antisaccade movement, and latency, dysmetria, and gain are computed using (1)–(3), and this eye movement is counted as a success antisaccade. In Figure 3, a flow chart to compute the successful antisaccade eye movement is presented.

2.2.3. Smooth Pursuit Test

Figure 4 describes the smooth pursuit test paradigm. The volunteer must perform a movement following the stimulus. Table 4 summarizes the main parameters of the test. The instruction to perform this test was “Follow the green dot.”
To correctly understand the smooth pursuit test, it is essential to take into account the following concepts: Catch-up, Back-up and Square wave jerks.
Definition 6.
Catch-up is a saccadic movement in the direction of the smooth pursuit due to the lack of capacity to keep up with the velocity of the dot. The volunteer tries to catch up with the stimulus with a speed saccade.
Definition 7.
Back-up is a saccadic movement in the opposite direction of the smooth pursuit because the participant’s gaze is advanced in comparison with the stimulus.
Definition 8.
Square wave jerks are defined as two saccades with an amplitude between 0.2 and 5 grades and in opposites directions. The differences between the directions must be within the interval 90° < θ < 270°.
Definition 9.
Gain in smooth pursuit test ( G a i n s p ) is a parameter that measures the capability of doing the test. According to [26], we computed it by (6). If G a i n s p > 1 , the eye movement is faster than stimulus movement. If G a i n s p < 1 , then the eye movement is slowest.
G a i n s p = 1 n i = 1 n V e l g a z e i V e l s t i m u l u s i
where n is the total number of frames, while i is the current frame where the velocities are computed.
Definition 10.
Time of pursuit is a parameter that measure the effective time that the subject is following the stimulus without intrusive saccades [26].

3. Results

3.1. Data Analysis Methods

To compare eye movement parameters between healthy controls and MS patients, we adjusted multiple linear regression models (7) that predicted eye movement parameters ( Y i ) according to the presence of disease ( X d i s e a s e ) controlling the effect of age ( X a g e ). Coefficient β 1 i represents the change in the eye movement parameter i attributable to MS ( X d i s e a s e = 1 ) in comparison to control group ( X d i s e a s e = 0 ) controlled by the effect of increasing one year of age ( β 2 i ). β 0 i represents the intercept of the multivariate regression, and ϵ is the error.
Y i = β 0 i + β 1 i X d i s e a s e + β 2 i X a g e + ϵ
Moreover, we aim to explore the relationships between the selected eye movement parameters and disease duration ( X d u r a t i o n ), controlling the effect of age using multiple linear regression (8). Coefficients β 1 i and β 2 i represent the change in the eye movement parameter i of having an additional year of MS duration.
Y i = β 0 i + β 1 i X d u r a t i o n + β 2 i X a g e + ϵ
Finally, the partial Spearman’s correlation for EDSS and the selected eye movement parameters controlling the age effect were computed. We used percentile bootstrap for 95 % confidence interval calculation of the correlation coefficient.
In order to represent how the different abnormalities seen in the eye movement parameters correlate with each other in MS, we have used a heat map. We used hierarchical clustering to classify both patients and parameters. In both cases, we used the average as the link criteria. In the case of patients, we have used Gower’s distance with the aim of decreasing the impact of different distributed parameters. Furthermore, we have used a parameter based on Spearman’s correlation coefficient: see Equation (9) in which we defined the distance between variable i and j.
d i j = 1 | ρ i j |
A color scale was used based on Z-score standardization (according to the healthy subjects’ mean and standard deviation) to represent each patient’s parameters. Equation (10) shows the Z-score for the patient p in variable k. Since some parameters do not have a normal distribution, we first transform the data of the reference subjects in a normal distribution using a suite of normalizing transformations [27].
Z k p = ( k p m e a n ( K h e a l t h y ) ) / s d ( K h e a l t h y )

3.2. Comparison between Healthy Controls and MS Patients

Figure 5, Figure 6 and Figure 7 show the distribution of the selected parameters described in Section 2 for both groups. These parameters were selected based on the analysis presented in Figure 8. Although there was a tendency for increased latencies in the case of visually guided saccades (both centripetal and centrifugal saccades), a subgroup of MS patients had the latency (horizontal and vertical) increased compared with controls. The accuracy of the saccadic movement was worse in MS patients than in controls. While the control group had a gain near 1, there were MS patients who had hypometric and hypermetric saccades. According to the distribution of this parameter in Figure 5, MS patients tended to have hypometric vertical saccades. Figure 6 shows the antisaccade test distribution. The vertical and horizontal latencies of reflexive saccades were increased in MS patients, which was mainly due to the increased duration of reflexive saccades. There was also a tendency for decreased percentages of correct saccades with more anticipatory saccades and a relative increase in the return latency. Parameters in the smooth pursuit test (see Figure 7) were those who showed more abnormalities. On the horizontal axis, MS patients showed more backup saccades; on the vertical axis, they had decreased gain, more catch-up saccades, and decreased pursuit time. It is important to highlight that these changes were controlled for the age effect.
When comparing the p-values given in Figure 8 and Figure 9, MS patients showed more alteration in the vertical direction. Moreover, there was no significant correlation between the EDSS total score, eye movement parameters, and disease duration. The gain at horizontal visually guides saccades showed a significant association with disease duration. The percentage of errors at horizontal and vertical saccades had a statistically significant coefficient, but bootstrap intervals were negatives. Patients with higher EDSS total scores exhibited a significantly increased return latency in horizontal antisaccades with less corrected saccades and a tendency to have less successful antisaccades. Moreover, an increased latency in the horizontal movement was observed in the smooth pursuit.
Finally, we studied the multivariate distribution of the abnormalities found in the group of patients with MS. This result is represented in Figure 10. Significantly, there was no identifiable pattern in the patients, and eye movement parameters show poor correlations between them.

4. Discussion

Eye movement parameters are considered precise, low-cost, functionally related biomarkers for clinical monitoring MS [28]. In our study, we have demonstrated the plausibility of a quasi-automatic system for measuring eye movement performance in a relatively large group of MS patients. The oculomotor system seems particularly useful in the study of motor control and cognitive function due to several reasons: (a) well-known neural basis in primates, (b) well-known neuroimaging correlates, and (c) easy and robust parameters to assess each movement paradigm [25]. The development of accessible, simple, functional biomarkers is particularly relevant in MS, in which biomarkers are mainly structural; available functional biomarkers only monitor walking or dexterity performance and show a limited sensitivity to change [29]. In addition, cognitive status evaluation remains challenging in routine clinical settings and research [30].
We have used several paradigms to assess ocular motor performance. Visually guided saccades are the simplest ones. Although we did not find a significant difference in most parameters, we detected a tendency in a subgroup of patients with values beyond the limits of normality, which were defined by the healthy control group. Increased latencies may reflect a prolonged processing time related to attentional problems [31,32,33]. In addition, some patients had inaccurate saccadic movements, which may indicate problems in motor control due to problems in the cerebellum and cerebellar-dependent circuits [34].
In contrast to visually guided saccades, which are generated in response to external cues and require a more simple sensorimotor implementation, antisaccades are a volitional paradigm in which movement is far more dependent on cognitively complex responses and requires the recruitment of higher-order control processes (inhibition, spatial memory, and analysis of contextual cues) [21,25,35]. We found an increased time to correction in reflexive antisaccades and in the duration of reflexive saccades, which may also indicate damage in frontal circuits depending on frontal eye field [36]. A wide distribution of values exists for these parameters in healthy subjects, which hampers interpretation in patients with MS. Anticipatory saccades tend to be increased in MS patients. Again, there is a subgroup of patients with a clear increment, which may reflect a problem in networks involving basal ganglia [37,38,39,40]. The mean percentages of successful or corrected saccades in MS patients were similar to healthy controls.
In visually guided saccades and antisaccades, the centripetal saccades’ latency tended to increase compared to healthy subjects. These saccades have an exogenous component but are facilitated by an endogenous component [41]. The ability of MS patients to include this previous information and prepare the response field of saccadic movement generators seems to be impaired, which fits with the relationship between cognitive problems and eye motor abnormalities in MS patients.
Significantly, we found important abnormalities in the values of smooth pursuit. Latency showed similar values, indicating that the initiation of this type of eye movement was relatively preserved. In contrast to latency, which showed similar values to healthy control, the parameters related to the quality of motor control during the pursuit were or tended to be altered except for gain. Abnormalities in smooth pursuit occur in various conditions [42,43,44]. This reflects an impairment of a complex system involving the middle temporal cortical visual area, dorsolateral pontine nuclei, and cerebellum [45].
Interestingly, we could not find a clear common pattern in the eye motor abnormalities. Eye movement parameters were also poorly correlated between them. We interpret this as a consequence of the patchy, heterogeneous distribution of white matter involvement in MS that provokes multiple combinations of impairment at different points in the different networks involved in eye motor control [46]. This also has a direct consequence in assessing eye movement disorders in patients with MS, as we will need several tasks to cover the different functional domains.
Although some previous work in the literature reports the alteration in eye movements in MS disease, most of them lack technical details related to the measurement technique and how the parameters were computed. Even so, there is a consensus on the impairment of eye movements in these patients. In [47], a cohort of 163 MS patients with MRI was recruited. The authors concluded that ocular movement alterations are frequent in patients with stable (no relapses) MS. At least 68.1 % of patients showed at least one eye movement abnormality. The most frequent eye movement alterations were impaired smooth pursuit 42.3 % , saccadic dysmetria 41.7 % , and latency in saccades 14.7 % . The results of recording eye movement to 50 MS patients with nystagmus were presented in [48]. The authors used EyeLink at 250 Hz. The main finding was that the pendular nystagmus seen in MS patients was mainly disconjugated, and that this disconjugacy was related to the amplitude and not the frequency of nystagmus. Moreover, other oculomotor abnormalities were observed in most MS patients, although their presence was unrelated to the MS severity or stage.
Impaired saccadic eye movements were related to the functional connectivity of the oculomotor network and clinical performance in MS in [49]. The authors measured the eye movements using Eyelink 1000 Plus. Off-line analysis was performed in Matlab, and the results were the average value of the right and left eyes. The main finding was that pro-saccadic latency was strongly associated with disability scores and cognitive dysfunction.
In [50], thirty-three MS patients and twenty-five matched healthy control subjects were included in a study of eye movements. The Symbol Digit Modalities Test (SDMT) was implemented for both groups. That study aimed to determine the association between eye movements and performance on the SDMT. The authors concluded that cognitive-mediated eye movements help elucidate the processing speed challenges confronted by MS patients, which can potentially help inform new cognitive rehabilitation strategies.
Eye tracking has been used to screen for abnormal visuospatial behavior in MS [51]. Ref. [52] designed an ocular working memory task in which participants were instructed to recall the positions of numerical stimuli on a screen while being recorded by an eye tracker. The results showed higher error rates in the MS group, with more working memory errors made by patients farther along in the disease course, which was in line with previous studies [52,53,54]. In [55], the authors conducted a battery of unpredictable, predictable, and endogenously cued visually guided saccade tasks on MS patients. Participants were asked to look directly at the center of a green target cross and then pursue the target as it moved horizontally across the screen while ignoring a visual distractor. Saccadic latency and absolute position error were measured. Compared with a healthy group, MS patients exhibited increased saccadic latency [6,7,51,56], worse fixation, and more prosaccade errors. These results demonstrated eye-tracking’s diagnostic and prognostic potential to assess cognitive function and disease severity in MS [7].
Abnormalities in the vertical plane were more common than in the horizontal one. This is a common observation in other disorders and highlights the relevance of exploring the vertical axis (or others). The reader is referred to [57] for a comprehensive review.
We are aware that this study has several limitations. The most important is the sample size. The high variability in MS eye motor performance and low sample size increase the uncertainty regarding the effect size of the differences or relationships. In particular, negative results are complicated to interpret. We, however, considered that the sample size was enough to detect robust differences between patients and controls in cognitive domains that are affected by MS [8,9]. Notwithstanding, these findings should be taken cautiously until they are replicated in larger, independent data sets. Second, we recruited a group of MS patients who were seen in a clinic; as a result, our results may not apply to MS patients in the general population. Therefore, we acknowledge the need to replicate these findings in an unselected patient population-based survey. Another important idea to cover in further studies is the joint evaluation of outcomes coming from the afferent (e.g., low-contrast vision quality or optical coherence tomography) and the efferent visual system (eye motor abnormalities. Finally, the participants did not complete a neuropsychological battery that would have provided additional insight into the origins of differences in eye movements between MS patients and healthy controls.

5. Conclusions

This article presents a systematic procedure to assess the cognitive dysfunction in a group or patient with relapsing–remitting multiple sclerosis. We have proposed to use an alternative technique: that is, to measure eye movements. Although we implemented a specific test battery under a systematic procedure, we demonstrated that patients had alterations in eye movement behavior compared with healthy controls. However, we were not able to define a common pattern among patients. A subgroup of patients showed similar behavior. However, we could not define a pattern even for this subgroup. This finding is coherent with the disease characterization: the disease of a thousand faces. Further studies are therefore required.

Author Contributions

Conceptualization: C.E.G.C., I.P.-V., D.G.-A. and J.B.-L. Data curation: C.E.G.C. and D.G.-A. Formal analysis: C.E.G.C. and D.G.-A. Investigation: V.G.S.-S., A.D.-S., S.M.-G. and J.B.-L. Vizualization: C.E.G.C. and D.G.-A. Writing—original draft: C.E.G.C., D.G.-A. and J.B.-L. Writing—review and editing: All authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially funding by RoboCity2030-DIH-CM Madrid Robotics Digital 366 Innovation Hub (Robotica aplicada a la mejora de la calidad de vida de los ciudadanos, Fase IV; 367 S2018/NMT-4331), funded by Comunidad de Madrid and cofunded by Structural Funds of the EU and partially funding by Universidad Politécnica de Madrid, Cooperation area. J. Benito-León is supported by the National Institutes of Health, Bethesda, MD, USA (NINDS R01 NS39422), the European Commission (grant ICT-2011-287739, NeuroTREMOR), the Ministry of Economy and Competitiveness (grant RTC-2015-3967-1, NetMD—platform for the tracking of movement disorder), and the Spanish Health Research Agency (grant FIS PI12/01602 and grant FIS PI16/00451).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Hospital Universitario 12 de Octubre (protocol code 17/035) on 31 January 2017.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available for researchers upon reasonable request.

Conflicts of Interest

Irene Pulido-Valdeolivas has received travel reimbursement from Roche Spain, Novartis and Genzyme-Sanofi, and she is a founder and holds stock in Aura Robotics SL. She is an employee at UCB Pharma since July 2020, and all the work in this paper is based on her previous work at Universidad Autónoma de Madrid. David Gómez Andrés has received honoraria as an advisor from Biogen and Lupin Neuroscience and as a speaker from Biogen, PTC, and Shire. He has also received travel reimbursement from Roche, PTC, Shire and Laboratorios Rubio. He was a founder and holds stock in Aura Robotics SL. He is/was an investigator in clinical trials founded by Pfizer, Biogen, Avexis, Roche, Fibrogen and Santhera.

Abbreviations

The following abbreviations are used in this manuscript:
MSMultiple Sclerosis
EDSSExpanded Disability Status Scale

References

  1. Benito-León, J.; Morales, J.; Rivera-Navarro, J.; Mitchell, A. A review about the impact of multiple sclerosis on health-related quality of life. Disabil. Rehabil. 2003, 25, 1291–1303. [Google Scholar] [CrossRef]
  2. Mitchell, A.; Benito-León, J.; González, J.; Rivera-Navarro, J. Quality of life and its assessment in multiple sclerosis: Integrating physical and psychological components of wellbeing. Lancet. Neurol. 2005, 4, 556–566. [Google Scholar] [CrossRef]
  3. Morales-Gonzáles, J.; Benito-León, J.; Rivera-Navarro, J.; Mitchell, A. A systematic approach to analyse health-related quality of life in multiple sclerosis: The GEDMA study. Mult. Scler. 2004, 10, 47–54. [Google Scholar] [CrossRef]
  4. Rivera-Navarro, J.; Benito-León, J.; Oreja-Guevara, C.; Pardo, J.; Dib, W.; Orts, E.; Belló, M. Burden and health-related quality of life of Spanish caregivers of persons with multiple sclerosis. Mult. Scler. 2009, 15, 1347–1355. [Google Scholar] [CrossRef] [PubMed]
  5. Serra, A.; Chisari, C.G.; Matta, M. Eye movement abnormalities in multiple sclerosis: Pathogenesis, modeling, and treatment. Front. Neurol. 2018, 9, 1664–2295. [Google Scholar] [CrossRef] [PubMed]
  6. Fielding, J.; Kilpatrick, T.; Millist, L.; White, O. Antisaccade performance in patients with multiple sclerosis. Cortex 2009, 45, 900–903. [Google Scholar] [CrossRef]
  7. Fielding, J.; Kilpatrick, T.; Millist, L.; White, O. Control of visually guided saccades in multiple sclerosis: Disruption to higher-order processes. Neuropsychologia 2009, 47, 1647–1653. [Google Scholar] [CrossRef]
  8. Olazarán, J.; Cruz, I.; Benito-León, J.; Morales, J.M.; Duque, P.; Rivera-Navarro, J. Cognitive dysfunction in multiple sclerosis: Methods and prevalence from the GEDMA Study. Eur. Neurol. 2009, 61, 87–93. [Google Scholar] [CrossRef]
  9. Julian, L.J. Cognitive functioning in multiple sclerosis. Neurol. Clin. 2011, 29, 507–525. [Google Scholar] [CrossRef]
  10. Rao, S.M.; Leo, G.J.; Ellington, L.; Nauertz, T.; Bernardin, L.; Unverzagt, F. Cognitive dysfunction in multiple sclerosis. II. Impact on employment and social functioning. Neurology 1991, 41, 692–696. [Google Scholar] [CrossRef]
  11. Rao, S.M.; Reingold, S.C.; Ron, M.A.; Lyon-Caen, O.; Comi, G. Workshop on Neurobehavioral Disorders in Multiple Sclerosis. Arch. Neurol. 1992, 50, 658–662. [Google Scholar] [CrossRef] [PubMed]
  12. Rao, S.M.; Reingold, S.C.; Ron, M.A.; Lyon-Caen, O.; Comi, G. Minimal neuropsychological assessment of MS patients: A consensus approach. Arch. Neurol. 2002, 16, 381–397. [Google Scholar]
  13. Kurtzke, J.F. Rating neurologic impairment in multiple sclerosis: An expanded disability status scale (EDSS). Neurology 1983, 33, 1444–1452. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Larrazabal, A.J.; Cena, C.G.; Martínez, C.E. Video-oculography eye tracking towards clinical applications: A review. Comput. Biol. Med. 2019, 108, 57–66. [Google Scholar] [CrossRef] [PubMed]
  15. Sheehy, C.K.; Beaudry-Richard, A.; Bensinger, E.; Theis, J.; Green, A.J. Methods to assess ocular motor dysfunction in multiple sclerosis. J. Neuro-Ophthalmol. 2018, 38, 488–493. [Google Scholar] [CrossRef]
  16. Fielding, J.; Clough, M.; Beh, S.; Millist, L.; Sears, D.; Frohman, A.N.; Lizak, N.; Lim, J.; Kolbe, S.; Rennaker, R.L.; et al. Ocular motor signatures of cognitive dysfunction in multiple sclerosis. Nat. Rev. Neurol. 2015, 11, 637–645. [Google Scholar] [CrossRef]
  17. Thompson, A.J.; Banwell, B.L.; Barkhof, F.; Carroll, W.M.; Coetzee, T.; Comi, G.; Correale, J.; Fazekas, F.; Filippi, M.; Freedman, M.S.; et al. Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Neurology 2018, 17, 162–173. [Google Scholar] [CrossRef]
  18. García Cena, C.E.; Gómez Andrés, D.; Pulido Valdeolivas, I. Measurement and analysis of eye movements performance to predict healthy brain aging. IEEE Access 2020, 8, 87201–87213. [Google Scholar] [CrossRef]
  19. García Cena, C.E.; Gómez Andrés, D.; Pulido Valdeolivas, I.; Acebrón López, R.; Espinoza Gómez, R.; Ramos Vázquez, S. Device for Synchronized Measure of Ocular and Cephalic Movements. European Patent EP3241488A1, 8 November 2017. [Google Scholar]
  20. Findlay, J.M.; Walker, R. A model of saccade generation based on parallel processing and competitive inhibition. Behav. Brain Sci. 1999, 22, 661–674. [Google Scholar] [CrossRef]
  21. Leigh, R.J.; Zee, D. The Neurology of Eye Movements, 5th ed.; Contemporary Neurology Series; Oxford University Press: Oxford, UK, 2015. [Google Scholar]
  22. Jernajczyk, W.; Sobańska, A.; Czerwosz, L.; Szatkowska, E. The influence of age and gender on the latency of eye movement in healthy humans. J. Physiol. Pharmacol. 2005, 56, 93–100. [Google Scholar]
  23. Ettinger, U.; Antonova, E.; Crawford, T.J.; Mitterschiffthaler, M.T.; Goswani, S.; Sharma, T.; Kumari, V. Structural neural correlates of prosaccade and antisaccade eye movements in healthy humans. NeuroImage 2005, 24, 487–494. [Google Scholar] [CrossRef] [PubMed]
  24. Jóhannesson, Ó.I.; Tagu, J.; Kristjánsson, Á. Asymmetries of the visual system and their influence on visual performance and oculomotor dynamics. Eur. J. Neurosci. 2018, 48, 3426–3445. [Google Scholar] [CrossRef] [PubMed]
  25. McDowell, J.E.; Dyckman, K.A.; Austin, B.P.; Clementz, B.A. Neurophysiology and neuroanatomy of reflexive and volitional saccades: Evidence from studies of humans. Brain Cogn. 2008, 68, 255–270. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Montagnese, S.; Gordon, H.M.; Jackson, C.; Smith, J.; Tognella, P.; Jethwa, N.; Sherratt, R.M.; Morgan, M.Y. Disruption of smooth pursuit eye movements in cirrhosis: Relationship to hepatic encephalopathy and its treatment. Hepatology 2005, 42, 772–781. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Peterson, R.A. Finding Optimal Normalizing Transformations via bestNormalize. R Journal 2021, 13, 310–329. [Google Scholar] [CrossRef]
  28. Graves, J.S.; Oertel, F.C.; Van der Walt, A.; Collorone, S.; Sotirchos, E.S.; Pihl-Jensen, G.; Albrecht, P.; Yeh, E.A.; Saidha, S.; Frederiksen, J.; et al. Leveraging Visual Outcome Measures to Advance Therapy Development in Neuroimmunologic Disorders. Neurol. Neuroimmunol. Neuroinflamm. 2022, 9, 1–17. [Google Scholar] [CrossRef]
  29. Pardo, G.; Coates, S.; Okuda, D.T. Outcome measures assisting treatment optimization in multiple sclerosis. J. Neurol. 2021, 269, 1–16. [Google Scholar] [CrossRef]
  30. Meca-Lallana, V.; Gascón-Giménez, F.; Ginestal-López, R.C.; Higueras, Y.; Téllez-Lara, N.; Carreres-Polo, J.; Eichau-Madueño, S.; Romero-Imbroda, J.; Vidal-Jordana, Á.; Pérez-Miralles, F. Cognitive impairment in multiple sclerosis: Diagnosis and monitoring. Neurol. Sci. 2021, 42, 5183–5193. [Google Scholar] [CrossRef]
  31. Wolf, C.; Lappe, M. Vision as oculomotor reward: Cognitive contributions to the dynamic control of saccadic eye movements. Cogn. Neurodyn. 2021, 15, 547–568. [Google Scholar] [CrossRef]
  32. Wong, O.W.; Chan, A.Y.; Wong, A.; Lau, C.K.; Yeung, J.H.; Mok, V.C.; Lam, L.C.; Chan, S. Eye movement parameters and cognitive functions in Parkinson’s disease patients without dementia. Park. Relat. Disord. 2018, 52, 43–48. [Google Scholar] [CrossRef] [PubMed]
  33. Opwonya, J.; Doan, D.N.T.; Kim, S.G.; Kim, J.I.; Ku, B.; Kim, S.; Park, S.; Kim, J.U. Saccadic Eye Movement in Mild Cognitive Impairment and Alzheimer’s Disease: A Systematic Review and Meta-Analysis. Neuropsychol. Rev. 2021, 32, 193–227. [Google Scholar] [CrossRef] [PubMed]
  34. Edwards, E.M.; Fritz, N.E.; Therrien, A.S. Cerebellar Dysfunction in Multiple Sclerosis: Considerations for Research and Rehabilitation Therapy. Neurorehabilit. Neural Repair 2022, 36, 103–106. [Google Scholar] [CrossRef] [PubMed]
  35. Hutton, S.B.; Ettinger, U. The antisaccade task as a research tool in psychopathology: A critical review. Psychophysiology 2006, 43, 302–313. [Google Scholar] [CrossRef] [Green Version]
  36. Leigh, R.J.; Kennard, C. Using saccades as a research tool in the clinical neurosciences. Brain 2004, 127, 460–477. [Google Scholar] [CrossRef]
  37. Spengler, D.; Trillenberg, P.; Sprenger, A.; Nagel, M.; Kordon, A.; Junghanns, K.; Heide, W.; Arolt, V.; Hohagen, F.; Lencer, R. Evidence from increased anticipation of predictive saccades for a dysfunction of fronto-striatal circuits in obsessive–compulsive disorder. Psychiatry Res. 2006, 143, 77–88. [Google Scholar] [CrossRef] [PubMed]
  38. Coe, B.C.; Trappenberg, T.; Munoz, D.P. Modeling saccadic action selection: Cortical and basal ganglia signals coalesce in the superior colliculus. Front. Syst. Neurosci. 2019, 13, 3. [Google Scholar] [CrossRef] [PubMed]
  39. Hikosaka, O.; Takikawa, Y.; Kawagoe, R. Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements. Physiol. Rev. 2000, 80, 954–978. [Google Scholar] [CrossRef] [Green Version]
  40. Hikosaka, O. Basal ganglia mechanisms of reward-oriented eye movement. Ann. N. Y. Acad. Sci. 2007, 1104, 229–249. [Google Scholar] [CrossRef] [Green Version]
  41. Sumner, P. Determinants of saccade latency. Oxf. Handb. Eye Mov. 2011, 1104, 413–424. [Google Scholar]
  42. Frei, K. Abnormalities of smooth pursuit in Parkinson’s disease: A systematic review. Clin. Park. Relat. Disord. 2021, 4, 100085. [Google Scholar] [CrossRef] [PubMed]
  43. Morita, K.; Miura, K.; Kasai, K.; Hashimoto, R. Eye movement characteristics in schizophrenia: A recent update with clinical implications. Neuropsychopharmacol. Rep. 2020, 40, 2–9. [Google Scholar] [CrossRef] [Green Version]
  44. Shemesh, A.A.; Zee, D.S. Eye movement disorders and the cerebellum. J. Clin. Neurophysiol. 2019, 36, 405. [Google Scholar] [CrossRef]
  45. Robinson, D.A. The neurophysiology of pursuit. Prog. Brain Res. 2022, 267, 423–435. [Google Scholar]
  46. Roura, E.; Maclair, G.; Andorrà, M.; Juanals, F.; Pulido-Valdeolivas, I.; Saiz, A.; Blanco, Y.; Sepulveda, M.; Llufriu, S.; Martínez-Heras, E.; et al. Cortical fractal dimension predicts disability worsening in Multiple Sclerosis patients. Neuroimage Clin. 2021, 30, 102653. [Google Scholar] [CrossRef] [PubMed]
  47. Weinstock-Guttman, B.; Servillo, G.; Renard, D.; Taieb, G.; Labauge, P.; Bastide, S.; Zorzon, M.; Castelnovo, G. TBedside Tested Ocular Motor Disorders in Multiple Sclerosis Patients. Mult. Scler. Int. 2014, 2014, 1–4. [Google Scholar]
  48. Kumar, W.A.; Constantinescu, C.S.; Proudlock, F.A.; Thomas, M.G.; McLean, R.J.; Gottlob, I. Analysis of Eye Movement Recordings in Multiple Sclerosis. Investig. Ophthalmol. and Vis. Sci. 2010, 51, 2542–2552. [Google Scholar]
  49. Bijvank, J.N.; Strijbis, E.; Nauta, I.; Kulik, S.; Balk, L.; Stam, C.; Hillebrand, A.; Geurts, J.; Uitdehaag, B.; van Rijn, L.; et al. Impaired saccadic eye movements in multiple sclerosis are related to altered functional connectivity of the oculomotor brain network. Neuroimage Clin. 2021, 32, 102848. [Google Scholar] [CrossRef] [PubMed]
  50. Pavisian, B.; Patel, V.; Feinstein, A. Cognitive mediated eye movements during the SDMT reveal the challenges with processing speed faced by people with MS. BMC Neurol. 2019, 19, 1–7. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Fielding, J.; Kilpatrick, T.; Millist, L.; Clough, M.; White, O. Longitudinal Assessment of Antisaccades in Patients with Multiple Sclerosis. PLoS ONE 2012, 7, e30475. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Clough, M.; Mitchell, L.; Millist, L.; Lizak, N.; Beh, S.; Frohman, T.C.; Frohman, E.M.; White, O.B.; Fielding, J. Ocular motor measures of cognitive dysfunction in multiple sclerosis II: Working memory. J. Neurol. 2015, 262, 1138–1147. [Google Scholar] [CrossRef]
  53. Bräu, H.; Ulrich, G.; Kriebitzsch, R.; Baum, K. Quantifying functional deficits in patients with multiple sclerosis using a computer-assisted. EEG-EMG Zeitschrift fur Elektroenzephalographie Elektromyographie und Verwandte Gebiete 1989, 20, 84–87. [Google Scholar] [PubMed]
  54. De Santi, L.; Lanzafame, P.; Spano, B.; D’Aleo, G.; Bramanti, A.; Bramanti, P.; Marino, S. Pursuit ocular movements in multiple sclerosis: A video-based eye-tracking study. Neurol. Sci. 2011, 32, 67–71. [Google Scholar] [CrossRef] [PubMed]
  55. Fielding, J.; Kilpatrick, T.; Millist, L.; White, O. Multiple sclerosis: Cognition and saccadic eye movements. J. Neurol. Sci. 2009, 277, 32–36. [Google Scholar] [CrossRef] [PubMed]
  56. Nygaard, G.O.; Sigrid, A.; Harbo, H.F.; Laeng, B.; Sowa, P.; Damangir, S.; Nilsen, K.B.; Etholm, L.; Tønnesen, S.; Kerty, E.; et al. Eye and hand motor interactions with the Symbol Digit Modalities Test in early multiple sclerosis. Mult. Scler. Relat. Disord. 2015, 4, 585–589. [Google Scholar] [CrossRef] [Green Version]
  57. Anderson, T.; MacAskill, M. Eye movements in patients with neurodegenerative disorders. Nat. Rev. Neurol. 2013, 9, 74–85. [Google Scholar] [CrossRef]
Figure 1. Main parameters measured in visually guided saccade test.
Figure 1. Main parameters measured in visually guided saccade test.
Sensors 22 08220 g001
Figure 2. Antisaccade test.
Figure 2. Antisaccade test.
Sensors 22 08220 g002
Figure 3. Flow chart to compute success rate in antisaccade test.
Figure 3. Flow chart to compute success rate in antisaccade test.
Sensors 22 08220 g003
Figure 4. Smooth pursuit test.
Figure 4. Smooth pursuit test.
Sensors 22 08220 g004
Figure 5. Visually guided saccade test results. Distribution of selected parameters in horizontal (left) and vertical (right) saccades for healthy volunteers and multiple sclerosis patients.
Figure 5. Visually guided saccade test results. Distribution of selected parameters in horizontal (left) and vertical (right) saccades for healthy volunteers and multiple sclerosis patients.
Sensors 22 08220 g005
Figure 6. Results for the antisaccade task. Distribution of selected parameters in healthy volunteers and multiple sclerosis patients.
Figure 6. Results for the antisaccade task. Distribution of selected parameters in healthy volunteers and multiple sclerosis patients.
Sensors 22 08220 g006
Figure 7. Results for the smooth pursuit task. Distribution of selected parameters in healthy volunteers and multiple sclerosis patients.
Figure 7. Results for the smooth pursuit task. Distribution of selected parameters in healthy volunteers and multiple sclerosis patients.
Sensors 22 08220 g007
Figure 8. Differences between healthy subjects and multiple sclerosis patients. Significance p-values < 0.05.
Figure 8. Differences between healthy subjects and multiple sclerosis patients. Significance p-values < 0.05.
Sensors 22 08220 g008
Figure 9. Correlation results between EDSS total score, disease duration, and eye movement parameters. Significance p-value < 0.05.
Figure 9. Correlation results between EDSS total score, disease duration, and eye movement parameters. Significance p-value < 0.05.
Sensors 22 08220 g009
Figure 10. Heat map that shows the distribution of the eye motor abnormalities in patients with MS. Every value for each included parameter (column) is shown for each patient (rows) according to its Z-score value calculated with data from healthy reference subjects. Patients are ordered according to a hierarchical clustering based on Gower’s distance, whose result is represented in the dendrogram at the left part of the figure. Parameters are ordered according to a hierarchical clustering based on Spearman’s rho correlation coefficient, whose result is shown in the upper dendrogram. The average Spearman’s rho value is indicated at the right of the dendrogram. Notice the lack of clear patterns.
Figure 10. Heat map that shows the distribution of the eye motor abnormalities in patients with MS. Every value for each included parameter (column) is shown for each patient (rows) according to its Z-score value calculated with data from healthy reference subjects. Patients are ordered according to a hierarchical clustering based on Gower’s distance, whose result is represented in the dendrogram at the left part of the figure. Parameters are ordered according to a hierarchical clustering based on Spearman’s rho correlation coefficient, whose result is shown in the upper dendrogram. The average Spearman’s rho value is indicated at the right of the dendrogram. Notice the lack of clear patterns.
Sensors 22 08220 g010
Table 1. Demographic Data. Healthy Controls and Multiple Sclerosis Patients.
Table 1. Demographic Data. Healthy Controls and Multiple Sclerosis Patients.
GroupSample SizeAgeEDSSAge at DiagnosisDisease Duration
Controls43 33.58 ± 9.47
Patients41 38.69 ± 7.50 0.76 ± 1.13 30.45 ± 8.33 9.43 ± 7.13
Table 2. Default parameters for visual guide saccades test.
Table 2. Default parameters for visual guide saccades test.
ModeVisual Field (°)Duration (s)Repetitions
Horizontal5, 10, 203622
Vertical5, 122412
Table 3. Default parameters for antisaccades test.
Table 3. Default parameters for antisaccades test.
ModeVisual Field (°)Duration (s)Repetitions
Horizontal5, 10, 203622
Vertical5, 122412
Table 4. Default parameters for smooth pursuit test.
Table 4. Default parameters for smooth pursuit test.
ModeDuration (s)Repetitions
Horizontal83
Vertical83
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

García Cena, C.E.; Gómez-Andrés, D.; Pulido-Valdeolivas, I.; Sánchez-Seco, V.G.; Domingo-Santos, A.; Moreno-García, S.; Benito-León, J. Toward an Automatic Assessment of Cognitive Dysfunction in Relapsing–Remitting Multiple Sclerosis Patients Using Eye Movement Analysis. Sensors 2022, 22, 8220. https://doi.org/10.3390/s22218220

AMA Style

García Cena CE, Gómez-Andrés D, Pulido-Valdeolivas I, Sánchez-Seco VG, Domingo-Santos A, Moreno-García S, Benito-León J. Toward an Automatic Assessment of Cognitive Dysfunction in Relapsing–Remitting Multiple Sclerosis Patients Using Eye Movement Analysis. Sensors. 2022; 22(21):8220. https://doi.org/10.3390/s22218220

Chicago/Turabian Style

García Cena, Cecilia E., David Gómez-Andrés, Irene Pulido-Valdeolivas, Victoria Galán Sánchez-Seco, Angela Domingo-Santos, Sara Moreno-García, and Julián Benito-León. 2022. "Toward an Automatic Assessment of Cognitive Dysfunction in Relapsing–Remitting Multiple Sclerosis Patients Using Eye Movement Analysis" Sensors 22, no. 21: 8220. https://doi.org/10.3390/s22218220

APA Style

García Cena, C. E., Gómez-Andrés, D., Pulido-Valdeolivas, I., Sánchez-Seco, V. G., Domingo-Santos, A., Moreno-García, S., & Benito-León, J. (2022). Toward an Automatic Assessment of Cognitive Dysfunction in Relapsing–Remitting Multiple Sclerosis Patients Using Eye Movement Analysis. Sensors, 22(21), 8220. https://doi.org/10.3390/s22218220

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop