Next Article in Journal
PD-L1 Expression Correlated with p53 Expression in Pediatric Glioblastoma Multiforme
Next Article in Special Issue
Identification of Breathing Patterns through EEG Signal Analysis Using Machine Learning
Previous Article in Journal
Interpersonal Motor Interactions Shape Multisensory Representations of the Peripersonal Space
Previous Article in Special Issue
Individual Alpha Peak Frequency, an Important Biomarker for Live Z-Score Training Neurofeedback in Adolescents with Learning Disabilities
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy

by
Frank J. van Schalkwijk
1,
Walter R. Gruber
2,
Laurie A. Miller
3,4,
Eugen Trinka
1 and
Yvonne Höller
1,5,*
1
Christian Doppler Medical Centre and Centre for Cognitive Neuroscience, Department of Neurology, Paracelsus Medical University, 5020 Salzburg, Austria
2
Centre for Cognitive Neuroscience (CCNS), Department of Psychology, University of Salzburg, 5020 Salzburg, Austria
3
Institute of Clinical Neurosciences, Royal Prince Alfred Hospital and Central Medical School, University of Sydney, Camperdown, Sydney, NSW 2050, Australia
4
ARC Centre of Excellence in Cognition and Its Disorders, University of Sydney, Camperdown, Sydney, NSW 2006, Australia
5
Faculty of Psychology, University of Akureyri, 600 Akureyri, Iceland
*
Author to whom correspondence should be addressed.
Brain Sci. 2021, 11(2), 261; https://doi.org/10.3390/brainsci11020261
Submission received: 11 January 2021 / Revised: 8 February 2021 / Accepted: 16 February 2021 / Published: 19 February 2021
(This article belongs to the Special Issue Quantitative EEG and Cognitive Neuroscience)

Abstract

:
Memory complaints are frequently reported by patients with epilepsy and are associated with seizure occurrence. Yet, the direct effects of seizures on memory retention are difficult to assess given their unpredictability. Furthermore, previous investigations have predominantly assessed declarative memory. This study evaluated within-subject effects of seizure occurrence on retention and consolidation of a procedural motor sequence learning task in patients with epilepsy undergoing continuous monitoring for five consecutive days. Of the total sample of patients considered for analyses (N = 53, Mage = 32.92 ± 13.80 y, range = 18–66 y; 43% male), 15 patients experienced seizures and were used for within-patient analyses. Within-patient contrasts showed general improvements over seizure-free (day + night) and seizure-affected retention periods. Yet, exploratory within-subject contrasts for patients diagnosed with temporal lobe epilepsy (n = 10) showed that only seizure-free retention periods resulted in significant improvements, as no performance changes were observed following seizure-affected retention. These results indicate general performance improvements and offline consolidation of procedural memory during the day and night. Furthermore, these results suggest the relevance of healthy temporal lobe functioning for successful consolidation of procedural information, as well as the importance of seizure control for effective retention and consolidation of procedural memory.

1. Introduction

Problems with memory retention are frequently observed in and reported by patients with epilepsy [1,2], and can considerably affect their overall quality of life [3,4]. Despite the observation that initial assessment of memory performance following learning sometimes shows no differences between patients with epilepsy and healthy participants, long-term memory retention (that is, over hours or days) is often much worse for patients for both semantic and visual material [5,6,7,8]. This long-term forgetting is frequently observed in patients with temporal lobe epilepsy [9,10] and considered more likely to affect the retention of declarative, hippocampus-dependent memory modalities (that is, semantic and episodic memory modalities) compared to procedural memory, which can be considered to be more hippocampus independent [11,12,13]. Yet, recent studies have shown that the consolidation of procedural motor sequence tasks also involves the hippocampus as well as the striatum [14,15] (for a review on procedural memory consolidation, see [16,17]). Furthermore, Schapiro and colleagues have shown that the hippocampus is crucial for the consolidation of a newly learned task without it being involved in the initial acquisition [18]. They evaluated memory performance for a motor sequence task in both hippocampal amnesic patients and matched controls. While performance during the learning session was similar between patients and controls, they found that offline consolidation after a period of sleep resulted in improved performance during memory recall for the control participants only, as no significant performance changes were observed for the patient group. The authors argue that the sequence aspect of the procedural task can be consolidated by the hippocampus, thus resulting in performance improvements in healthy controls [16,19]. Crucially, such hippocampal functioning is limited or lacking in amnesic patients diagnosed with hippocampal damage, which would explain the lack of a performance gain as observed in healthy controls.
Considering the importance of hippocampal functioning for memory consolidation [20,21], any electrophysiological interference can be detrimental for memory retention and performance [22,23]. With the medial temporal lobe being a predilection site for epilepsy, the potential for such interference with hippocampal functioning is high. Consequently, it is believed that electrophysiological interference of hippocampal functioning in the form of epileptiform activity can be detrimental for memory consolidation processes; therefore leading to worsened performance in this patient population [24,25]. In support of this theory, memory retention has been negatively associated with the occurrence of epileptiform activity (i.e., seizures and epileptic discharges), as their onset following learning resulted in poorer retention and recollection of declarative information [5,6,26,27,28,29]. The question is whether seizure occurrence has a similar detrimental effect on the retention and consolidation of procedural memory.
Although the effects of epileptiform activity on declarative memory performance are frequently studied in patients with epilepsy (for example, [5,6,7,8,26,30,31]), the effects on procedural memory performance are relatively understudied in this patient population. One of the few studies that investigated procedural memory performance in this patient population was conducted by Long and colleagues, who contrasted performance on a motor sequence learning task between patients with epilepsy and healthy adults [32]. Results showed that, although baseline performance was similar between patients and controls, performance improvements from learning to recall were stronger for the healthy controls as compared to the patients. This contrast in performance improvements between patients and healthy controls is similar to results observed in hippocampal amnesic patients [18]. Unfortunately, this study did not directly look at the relation between seizure occurrence and memory retention. Importantly, these results indicate that it is not the initial acquisition of motor sequence tasks that is affected in these patient populations, but rather the subsequent consolidation processes that involve the medial temporal lobe structures and specifically the hippocampus.
Taken together, these findings illustrate the detrimental effects of epileptiform activity on memory consolidation as well as the relevance of healthy hippocampal functioning for both declarative and procedural memory consolidation. Furthermore, these results suggest that epileptiform activity may negatively affect hippocampal functioning related to memory consolidation of procedural motor sequence learning; potentially preventing any offline performance gains as seen in healthy participants. Yet, a direct link between procedural memory performance changes and epileptiform activity is lacking from the current literature.
The ability to directly study the effects of a seizure on memory retention in an experimental setting is challenging considering the unpredictability of a seizure occurrence. Consequently, many studies evaluated memory retention following learning after a short (30 min) and long-term (12 h, 24 h, 72 h, or 7 days) retention period, and conducted between-patient contrasts based on the presence or absence of seizures during the retention period. Yet, the within-patient contrasts are of highest interest to study the effects of seizures on memory retention and performance, as the high between-subject variability can be problematic confounds for between-subject analyses (for example, age, epilepsy type, hippocampal atrophy, age of epilepsy onset, as well as the type, number, and dosage of antiepileptic medication).
The current study aimed to make within-subject evaluations of the effects of seizure occurrence on memory retention and performance changes. Specifically, within-subject contrasts were conducted to determine the effect of seizure occurrence during the retention period separating learning and recall on procedural memory performance. We hypothesized that memory retention and performance changes for procedural memory would be negatively affected by seizure-affected retention periods, whereas offline gains in performance from learning to recall were expected in seizure-free retention periods as observed in healthy participants.

2. Materials and Methods

2.1. Patients

A total of 106 consecutive patients were recruited for this study; all of whom underwent continuous monitoring for five consecutive days (Monday-Friday) for diagnostic purposes in the Epilepsy Monitoring Unit (EMU) of the Department of Neurology, Christian Doppler Medical Center, Salzburg, Austria. Patients were excluded from further analyses based on pilot participation (n = 21), lack of a clear epilepsy diagnosis (n = 17), left-hand preference (n = 7), or incomplete behavioral data (n = 1). To ensure that our analyses were not influenced by either incomprehension or an inability to perform our procedural memory task, sessions were excluded when no clear learning performance was observed at the end of each learning session (accuracy ≤ 50% or speed ≤ 5), which led to the exclusion of 7 patients. The final sample consisted of 53 right-handed patients who were diagnosed with epilepsy by specialized neurologists.

2.2. Study Protocol

Patients arrived at the EMU on Monday morning, after which they were fully briefed on the study, provided written informed consent, and were screened for depression and chronotype (see Supplementary Materials for additional screening details). The study protocol started on Monday evening and lasted until Thursday evening, with sessions taking place during the morning (07:00–09:00) and evening (18:00–20:00); therefore there were seven sessions in total (Figure 1). The current study was part of a larger investigation that aimed to evaluate the effect of seizures on the consolidation of procedural, semantic, and episodic memory. Therefore patients were trained and evaluated on (1) procedural memory, (2) verbal memory, and (3) visuospatial memory for each session (for details on visuospatial memory, see [33,34]). Learning performance for the procedural memory task was determined at the end of the learning session (average of last three trials), whereas learning performance on verbal and visuospatial memory was evaluated through immediate recall. Delayed recall performance was evaluated for all tasks at the start of the subsequent session, after which patients were once again trained and evaluated on a new version for each task (for details see Supplementary Figure S1). This paradigm was repeated until the last session, during which patients only had to recall the information acquired during the previous session. The study protocol was approved by the Ethics Commission Salzburg (E/1755).

2.3. Instruments

2.3.1. Epilepsy Monitoring

The EMU consists of four beds that are situated in one room for simultaneous observation of four patients through video and electroencephalography recordings (EEG; Micromed Brain-Quick System). Continuous 24 h monitoring was conducted by medical staff situated in an adjacent room. Daily rhythm was roughly standardized for all patients, with specific time ranges for lights on (06:30–07:00), breakfast (07:00–07:30), lunch (11:30), dinner (16:30), and lights off (22:00–00:00).

2.3.2. Procedural Memory-Motor Sequence Learning Task

Patients were trained and evaluated on procedural memory performance using a fingertapping task [35] (Figure 2). Patients were instructed to continuously type a specific five-element sequence made of four numbers (sequences used: 1–4–2–3–1, 4–1–3–2–4, 3–2–1–4–3, 2–1–3–4–2, 1–2–4–3–1, and 4–3–1–2–4) as quickly and accurately as possible with their non-dominant left hand. Four keyboard keys were assigned to the four numbers that had to be typed using index-to-little fingers, respectively. Both learning and recall sessions always displayed the desired sequence in the center of the screen and did not provide feedback regarding performance. Each trial lasted 30 sec during which the patient was encouraged to repeatedly type the sequence as quickly and accurately as possible. Trials were separated by an inter-trial interval (ITI) of 30 sec. The learning sessions consisted of 12 trials whereas recall sessions consisted of 4 trials. Performance was evaluated based on speed (number of completed sequences per trial), triplets (number of correct 3-element inputs belonging to the desired sequence (i.e., for sequence 1–4–2–3–1, triplets are 1–4–2, 4–2–3, 2–3–1, 3–1–1, and 1–1–4), and accuracy (percentage of elements belonging to correct sequences relative to total keystrokes per trial). For analyses, learning and recall performances were determined by averaging the last three trials of their respective session. Performance changes (recall-learning) were calculated for each performance measure.

2.4. Analyses

Seizures were identified, marked, and classified as “tonic-clonic” seizures or “other” by trained medical staff. Behavioral data were processed using Matlab v9.5 (R2018b; Natick, MA, USA) and R v3.5.1. Statistical comparisons were conducted using IBM SPSS Statistics v22 (Armonk, NY, USA) and R v3.5.1. Potential confounding factors such as age, time of day, task difficulty, and day within the paradigm were initially investigated. Behavioral performance was contrasted based on the type of retention interval (daytime vs. nighttime) and the occurrence of seizures during retention. Note that nights during which sleep deprivation was applied were excluded from analyses. Within-patient contrasts were conducted for subsamples extracted from the final sample of patients (N = 53) depending on the contrasts in question (that is, seizure-free versus seizure-affected retention periods; seizure-free daytime versus nighttime retention periods). Behavioral performance was averaged per patient for learning and recall sessions respective to their retention period. Main and interaction effects were investigated using 2 × 2 (TIME × CONDITION) repeated-measures analyses of variance (ANOVAs) using the “RM” function from the “MANOVA.RM” package [36] using 10,000 iterations by the parametric bootstrap approach. This approach is recommended considering we conducted both within- and between-subjects design characterized by low as well as unequal sample sizes, respectively. Within-patient contrasts were conducted using Wilcoxon signed rank tests that were corrected for multiple comparisons using the Bonferroni-Holm procedure for the number of tests conducted. Effect size estimates and 95% confidence intervals (CI) were calculated in R using the “effsize” package [37]. Results reported mean ± standard deviation unless otherwise specified.

3. Results

3.1. Patient Demographics and Baseline Descriptive

The final sample consisted of 53 right-handed patients (Mage = 32.92 ± 13.80 y, range = 18–66 y; 43% male). Of these 53 patients, 17 patients (32%) experienced one or more seizures during monitoring (daytime seizures only, n = 6; nighttime seizures only, n = 7; daytime and nighttime seizures, n = 4). Patients’ descriptive information is displayed in Table 1. Further patient details regarding epilepsy diagnosis, localization, lateralization, and medication are reported in Supplementary Table S1.

3.2. Confounding Factors

Potential confounding factors such as age, task difficulty, learning effect, and circadian effects were evaluated. As the main focus of this study lies on the relative change in performance from learning to delayed recall conditions within patients, and therefore does not specifically account for these factors (for a more detailed discussion, see Supplementary Materials). Patients’ medication usage was tailored to individual requirements and therefore varied strongly (see Supplementary Table S1). To increase the occurrence of epileptiform activity during the monitoring, medication was tapered in 60% of patients. Tapering was implemented based on the individual patient history and consequently varied between patients. Analyses therefore did not take medication or its dosage into account.

3.3. Seizure Occurrence

A subset of patients (n = 17) experienced one or more seizures during their stay in the EMU. Of these, behavioral data for both seizure-free and seizure-affected retention periods were available from 15 patients for within-subject analyses. Retention periods were classified based on the presence or absence of seizures (seizure-free daytime retention (nsessions = 219, n = 52); seizure-free nighttime retention (nsessions=215, n=53); seizure-affected daytime retention (nsessions = 12, n = 10); and seizure-affected nighttime retention (nsessions = 16, n = 11)).

3.4. Behavioral Within-Subject Contrasts

3.4.1. Seizure-Free vs. Seizure-Affected Retention Periods

Within-patient contrasts were conducted to compare retention periods with and without seizures (n = 15). Performance for each category of retention period (that is, with or without seizures) was averaged per patient for learning and recall sessions. We conducted separate 2 × 2 repeated-measures ANOVAs (TIME × CONDITION) to evaluate performance changes for speed, triplets, and accuracy. Results showed a main effect of time for speed (F1,14 = 4.844, p = 0.042, η G 2 = 0.017), whereas no main effect of condition (F1,14 = 2.493, p = 0.134), nor an interaction effect was observed (F1,14 = 0.302, p = 0.593). Similarly, triplets showed a main effect of time (F1,14 = 5.743, p = 0.029, η G 2 = 0.017) and a nonsignificant trending main effect of condition (F1,14 = 3.187, p = 0.092), whereas no interaction effect was observed (F1,14 = 0.613, p = 0.441). For accuracy, no main effects nor an interaction effect were observed (all p ≥ 0.646). Additional direct contrasts are reported (Table 2). Both learning and recall performance scores were similar when retention periods with and without seizures were compared. When investigating performance changes from learning to recall, retention periods without seizures resulted in a significant performance improvement for speed (d = −0.951, 95% CI (−1.740, −0.162]) and a trending improvement for triplets (d = −0.954, 95% CI (−1.743, −0.165)). In contrast, no changes were observed for any performance measure following retention periods with seizures. Crucially, fatigue did not differ within the seizure-free condition between learning (3.61 ± 1.77) and recall sessions (3.68 ± 1.53; Z = −0.746, p = 0.46), nor within the seizure-affected condition between learning (4.45 ± 2.27) and recall sessions (4.33 ± 2.16; Z = −0.140, p = 0.89), nor were there any differences in fatigue between the seizure-free and seizure-affected conditions during learning (Z = −1.399, p = 0.16) and recall (Z = −1.190, p = 0.23).

3.4.2. Seizure-Free Day vs. Seizure-Free Night

Retention periods of days and nights without seizures were contrasted within patients (n = 42). Performance for each category of retention period (that is, daytime or nighttime) was averaged per patient for learning and recall sessions. We again conducted separate 2 × 2 repeated-measures ANOVAs (TIME × CONDITION) for speed, triplets, and accuracy. For speed, we found a main effect of time (F1,41 = 9.677, p = 0.003, η G 2 = 0.007) and a nonsignificant trend of condition (F1,41 = 3.490, p = 0.066, η G 2 = 0.003), whereas no significant interaction was observed (F1,41 = 0.009, p = 0.928). Similarly, triplets showed a main effect of time (F1,41 = 14.520, p < 0.001, η G 2 = 0.01), whereas no effect of condition (F1,41 = 2.587, p = 0.118) nor an interaction effect was observed (F1,41 = 0.007, p = 0.931). Finally, no main nor interaction effects were observed for accuracy (all p ≥ 0.280). Additional direct contrasts are reported (Table 3; Figure 3). Contrasting performance for each condition showed no difference between seizure-free daytime and nighttime retention periods for any performance measure. When investigating specific performance changes from learning to recall, seizure-free days showed a trend towards improved performance for triplets (d = −0.469, 95% CI (−0.910, -0.029)), whereas seizure-free nights showed improvements in performance that were significant for triplets (d = −0.453, 95% CI (−0.892, −0.013)) and trending for speed (d = −0.344, 95% CI (−0.781, 0.094)). Importantly, contrasting performance changes from learning to recall between seizure-free days versus seizure-free nights showed no significant differences. Also, self-reported indications of fatigue did not differ within the seizure-free day condition between learning (3.52 ± 2.28) and recall sessions (3.40 ± 1.80; Z = −0.083, p = 0.93), while the seizure-free night condition showed a trend towards slightly lower fatigue for learning in the evening (3.17 ± 1.67) compared to recall the subsequent morning (3.74 ± 2.14; Z = −1.919, p = 0.06). Crucially, no differences in fatigue was observed between the seizure-free day and night conditions during learning (Z = −1.057, p = 0.29) and recall (Z = −0.747, p = 0.46).

3.5. Exploratory Within-Subject Contrasts in Patients with Temporal Lobe Epilepsy

Considering that patients with temporal lobe epilepsy showed significantly worse long-term memory retention [9,10] as well as lower performance changes on procedural memory as compared to healthy controls [32], we conducted an exploratory within-subjects contrast specifically for those patients who experienced seizures during the paradigm and were diagnosed with epilepsy originating from the temporal lobe (n = 10; see Supplementary Table S1). As with the previous contrasts, we found main effects of time for the speed (F1,9 = 5.448, p = 0.020, η G 2 = 0.010) and triplets (F1,9 = 6.156, p = 0.013, η G 2 = 0.010) variables, whereas no main effects were observed of condition (all p ≥ 0.368). Yet, we observed significant interaction effects (TIME × CONDITION) for speed (F1,9 = 8.017, p = 0.021, η G 2 = 0.007) as well as triplets (F1,9 = 9.772, p = 0.015, η G 2 = 0.006) (Figure 4). Post hoc tests revealed that the seizure-free retention periods resulted in higher improvements of performance for speed (1.937 ± 1.238; p = 0.020) and triplets (9.855 ± 7.653; p = 0.012) as compared to the seizure-affected retention periods (0.178 ± 2.122 and 1.141 ± 8.859, respectively). No significant main or interaction effects were observed for accuracy (all p ≥ 0.495).

3.6. Between-Subjects Contrasts

We conducted additional 2 × 2 repeated-measures ANOVAs (TIME × GROUP), contrasting patients who experienced seizures (n = 15) with those who did not (n=36). Note that we again contrasted average patient performance between groups on sessions that did not involve the occurrence of a seizure. As with the within-subjects contrasts, we found main effects of time for the variables speed (F1,49 = 15.456, p < 0.001, η G 2 = 0.006) and triplets (F1,49 = 17.984, p < 0.001, η G 2 = 0.008), whereas no main effect of group nor any interaction effects were observed (all p ≥ 0.091).

4. Discussion

4.1. General Discussion

This study investigated the direct effects of seizures on procedural memory performance in patients with epilepsy. Our results showed that patients were able to significantly improve their performance on a procedural motor sequence learning task despite the lack of additional training. Importantly, no within-subject differences were observed in performance improvements depending on whether patients experienced a seizure or not during the retention period separating learning and recall (n = 15). However, an exploratory within-subject contrast specifically for patients diagnosed with temporal lobe epilepsy (n = 10) showed that performance improvements were significantly better after a seizure-free retention period as compared to a seizure-affected retention period. Furthermore, we observed no differences between performance changes following a period of daytime wakefulness or nighttime sleep; suggesting that the acquired information can be consolidated during both retention periods, thus resulting in performance improvements during recall.
The lack of a general effect of seizure occurrence on procedural memory performance is striking given the results of prior studies on the negative effects of epileptiform activity on declarative memory consolidation [5,29,38]. Yet, the exploratory within-subject contrast, which was specific for patients diagnosed with temporal lobe epilepsy, did illustrate the negative effects of seizure occurrence on procedural memory performance by preventing offline performance improvements. Specifically, the lack of procedural performance changes following a seizure is a result directly in line with previous findings [18,32] and suggests the importance of healthy temporal lobe functioning for procedural memory consolidation. Importantly, it should be noted that none of the within-patient contrasts showed a main effect of condition. In other words, these results do not support the statement that seizure occurrence is detrimental for procedural memory performance, but rather illustrate how seizure occurrence following learning can be detrimental for potential performance gains through offline consolidation during the subsequent retention period. Yet, we must stress the exploratory nature of this within-subject contrast as well as the low sample size and associated effect sizes. The within-patient contrast on seizure-free retention periods during the day and night suggests that offline improvements in procedural memory consolidation can occur during both time points, whereas previous studies specifically emphasize the importance of nighttime sleep for procedural memory consolidation, as demonstrated in healthy participants [16] and patients with epilepsy [39,40]. Importantly, some patients reported taking daytime naps in the afternoon as a result of their restricted mobility within the EMU (that is, bed restricted and limited in their actions and movements). Thus, it is possible that this daytime improvement is a result of sleep during the daytime retention period, but could also be a simple lack of daytime distractions inherent to the restricted mobility within the EMU. Although a direct within-patient contrast between daytime wake and daytime nap retention periods had insufficient power to draw statistical conclusions, the benefit of a daytime nap for the consolidation of procedural motor sequence learning has been established for healthy participants [16,41,42], and may be a way to foster memory consolidation in patients with epilepsy to ameliorate memory problems [5], thus aiming to improve their overall quality of life [3,4].

4.2. Limitations

Despite the use of an elaborate paradigm to evaluate the effects of seizures on procedural memory consolidation, the current study must acknowledge several limitations. First and foremost, we acknowledge the limits of the low sample size, which is a direct result of the unpredictability of seizure occurrence. Second, although the EMU offers the opportunity to conduct a long-term study in patients with epilepsy, it is not the ideal experimental environment (for example, noise and interference from other patients, medical staff, and hospital activities). Third, while the occurrence of seizures was promoted through tapering of medication, this was not implemented for all patients. Furthermore, tapering of medication could potentially have affected cognitive performance [43]. In addition, the specific (combination of) medication and its dosage varied between patients and could not be controlled or standardized. Fourth, the negative effect of interictal epileptiform discharges (IEDs) was not investigated in the current study, but is a topic of high relevance in the context of memory retention and cognitive performance [44,45]. Fifth, post-ictal fatigue frequently resulted in the (temporary) withdrawal from the study, leading to a loss of data and a relatively low number of samples that could be used for within-subject analyses. This also forced us to omit any further investigations that differentiated between patients based on their seizure type. Sixth, the three memory tasks might potentially have interfered with each other [46]. For this reason the tasks were kept in a consistent non-randomized order for all patients. Seventh and last, a detailed study on the interplay between epilepsy, memory consolidation, and sleep is of high relevance [24,25]. Specifically, previous research has indicated that epileptiform discharges may result in an alteration of both sleep architecture [47,48,49] and sleep microstructures [22,24,50], which is likely to underlie some of the memory problems in patients with epilepsy [24,25,51,52]. Unfortunately, such a direct within-patient contrast was not possible given the low number of patients who experienced seizures during the night (n = 11). Despite these limitations, we would like to stress that this study, through its continuous 5-day recording time, had the unique opportunity to evaluate performance changes on procedural memory following a seizure.

5. Conclusions

Our study shows that procedural memory performance generally improved following daytime and nighttime retention periods, as well as following retention periods that were seizure-free or seizure-affected. Yet, specific contrasts for patients diagnosed with temporal lobe epilepsy showed that improvements for procedural memory performance only occurred during seizure-free retention periods, whereas no performance changes were observed following seizure-affected retention periods. These findings suggest the relevance of healthy temporal lobe functioning for the consolidation of procedural information. These results contribute to previous observations on the negative effect of seizures on memory retention and stress the relevance of seizure control for the benefit of memory retention in patients with epilepsy.

Supplementary Materials

The following are available online at https://www.mdpi.com/2076-3425/11/2/261/s1, Figure S1: Study protocol—extended, Figure S2: Evaluating the effect of age as a potential confounding factor on behavioral performance, Figure S3: Evaluation of task difficulty for each fingertapping sequence, Figure S4: Behavioral performance contrasted between morning and evening learning sessions, Table S1: Patient overview.

Author Contributions

Conceptualization, E.T. and Y.H.; methodology, Y.H. and F.J.v.S.; software, Y.H. and F.J.v.S.; validation, Y.H. and F.J.v.S.; formal analysis, F.J.v.S., W.R.G., and Y.H.; investigation, F.J.v.S., W.R.G., and Y.H.; resources, E.T. and Y.H.; data curation, F.J.v.S., W.R.G., and Y.H.; writing—original draft preparation, F.J.v.S.; writing—review and editing, F.J.v.S., W.R.G., L.A.M., E.T., and Y.H.; visualization, F.J.v.S.; supervision, E.T. and Y.H.; project administration, Y.H.; funding acquisition, Y.H. All authors have read and agreed to the published version of the manuscript.

Funding

F.J. van Schalkwijk was supported by the Doctoral College “Imaging the Mind” (FWF; W1233-G17) and Paracelsus Medical University (PMU-FFF; A-16/02/021-HÖL). Y. Höller was supported by the Austrian Science Fund (FWF; T 798-B27) and the Research Fund of Paracelsus Medical University (PMU-FFF; A-16/02/021-HÖL).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Commission Salzburg (415-E/1755/24-2018; 30.03.2015).

Informed Consent Statement

Written informed consent was obtained from all patients involved in the study.

Data Availability Statement

Data is available on request due to restrictions (for example, privacy or ethical). The data presented in this study are available on request from the corresponding author.

Acknowledgments

We would like to thank all patients that took part in the present study. We thank our colleagues from the EMU of the Christian Doppler Klinik as well as all involved students for their assistance.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Tramoni-Negre, E.; Lambert, I.; Bartolomei, F.; Felician, O. Long-term memory deficits in temporal lobe epilepsy. Rev. Neurol. 2017, 173, 490–497. [Google Scholar] [CrossRef] [PubMed]
  2. McAuley, J.W.; Elliott, J.O.; Patankar, S.; Hart, S.; Long, L.; Moore, J.L.; Shneker, B.F. Comparing patients’ and practitioners’ views on epilepsy concerns: A call to address memory concerns. Epilepsy Behav. 2010, 19, 580–583. [Google Scholar] [CrossRef]
  3. Giovagnoli, A.R.; Avanzini, G. Quality of life and memory performance in patients with temporal lobe epilepsy. Acta Neurol. Scand. 2000, 101, 295–300. [Google Scholar] [CrossRef]
  4. Langfitt, J.T.; Westerveld, M.; Hamberger, M.J.; Walczak, T.S.; Cicchetti, D.V.; Berg, A.T.; Vickrey, B.G.; Barr, W.B.; Sperling, M.R.; Masur, D.; et al. Worsening of quality of life after epilepsy surgery: Effect of seizures and memory decline. Neurology 2007, 68, 1988–1994. [Google Scholar] [CrossRef]
  5. Fitzgerald, Z.; Thayer, Z.; Mohamed, A.; Miller, L.A. Examining factors related to accelerated long-term forgetting in epilepsy using ambulatory EEG monitoring. Epilepsia 2013, 54, 819–827. [Google Scholar] [CrossRef] [PubMed]
  6. Wilkinson, H.; Holdstock, J.S.; Baker, G.; Herbert, A.; Clague, F.; Downes, J.J. Long-term accelerated forgetting of verbal and non-verbal information in temporal lobe epilepsy. Cortex 2012, 48, 317–332. [Google Scholar] [CrossRef]
  7. Mameniskiene, R.; Jatuzis, D.; Kaubrys, G.; Budrys, V. The decay of memory between delayed and long-term recall in patients with temporal lobe epilepsy. Epilepsy Behav. 2006, 8, 278–288. [Google Scholar] [CrossRef] [PubMed]
  8. Butler, C.R.; Zeman, A.Z. Recent insights into the impairment of memory in epilepsy: Transient epileptic amnesia, accelerated long-term forgetting and remote memory impairment. Brain 2008, 131 (Pt 9), 2243–2263. [Google Scholar] [CrossRef] [Green Version]
  9. Delaney, R.C.; Rosen, A.J.; Mattson, R.H.; Novelly, R.A. Memory function in focal epilepsy: A comparison of non-surgical, unilateral temporal lobe and frontal lobe samples. Cortex 1980, 16, 103–117. [Google Scholar] [CrossRef]
  10. Muhlert, N.; Grunewald, R.A.; Hunkin, N.M.; Reuber, M.; Howell, S.; Reynders, H.; Isaac, C.L. Accelerated long-term forgetting in temporal lobe but not idiopathic generalised epilepsy. Neuropsychologia 2011, 49, 2417–2426. [Google Scholar] [CrossRef]
  11. Scoville, W.B.; Milner, B. Loss of Recent Memory after Bilateral Hippocampal Lesions. J. Neurol. Neurosurg. Psychiatry 1957, 20, 11–21. [Google Scholar] [CrossRef] [Green Version]
  12. Milner, B. Disorders of learning and memory after temporal lobe lesions in man. Clin. Neurosurg. 1972, 19, 421–446. [Google Scholar] [CrossRef] [PubMed]
  13. Squire, L.R. Declarative and nondeclarative memory: Multiple brain systems supporting learning and memory. J. Cogn. Neurosci. 1992, 4, 232–243. [Google Scholar] [CrossRef] [PubMed]
  14. Albouy, G.; Sterpenich, V.; Balteau, E.; Vandewalle, G.; Desseilles, M.; Dang-Vu, T.; Darsaud, A.; Ruby, P.; Luppi, P.H.; Degueldre, C.; et al. Both the hippocampus and striatum are involved in consolidation of motor sequence memory. Neuron 2008, 58, 261–272. [Google Scholar] [CrossRef] [PubMed]
  15. Albouy, G.; King, B.R.; Maquet, P.; Doyon, J. Hippocampus and striatum: Dynamics and interaction during acquisition and sleep-related motor sequence memory consolidation. Hippocampus 2013, 23, 985–1004. [Google Scholar] [CrossRef]
  16. King, B.R.; Hoedlmoser, K.; Hirschauer, F.; Dolfen, N.; Albouy, G. Sleeping on the motor engram: The multifaceted nature of sleep-related motor memory consolidation. Neurosci. Biobehav. Rev. 2017, 80, 1–22. [Google Scholar] [CrossRef]
  17. Doyon, J.; Gabitov, E.; Vahdat, S.; Lungu, O.; Boutin, A. Current issues related to motor sequence learning in humans. Curr. Opin. Behav. Sci. 2018, 20, 89–97. [Google Scholar] [CrossRef]
  18. Schapiro, A.C.; Reid, A.G.; Morgan, A.; Manoach, D.S.; Verfaellie, M.; Stickgold, R. The hippocampus is necessary for the consolidation of a task that does not require the hippocampus for initial learning. Hippocampus 2019, 29, 1091–1100. [Google Scholar] [CrossRef]
  19. Albouy, G.; Fogel, S.; King, B.R.; Laventure, S.; Benali, H.; Karni, A.; Carrier, J.; Robertson, E.M.; Doyon, J. Maintaining vs. enhancing motor sequence memories: Respective roles of striatal and hippocampal systems. Neuroimage 2015, 108, 423–434. [Google Scholar] [CrossRef] [PubMed]
  20. Fernandez-Ruiz, A.; Oliva, A.; Fermino de Oliveira, E.; Rocha-Almeida, F.; Tingley, D.; Buzsaki, G. Long-duration hippocampal sharp wave ripples improve memory. Science 2019, 364, 1082–1086. [Google Scholar] [CrossRef] [PubMed]
  21. Gelinas, J. Ripples for memory retrieval in humans. Science 2019, 363, 927–928. [Google Scholar] [CrossRef] [PubMed]
  22. Gelinas, J.N.; Khodagholy, D.; Thesen, T.; Devinsky, O.; Buzsaki, G. Interictal epileptiform discharges induce hippocampal-cortical coupling in temporal lobe epilepsy. Nat. Med. 2016, 22, 641–648. [Google Scholar] [CrossRef] [Green Version]
  23. Girardeau, G.; Benchenane, K.; Wiener, S.I.; Buzsaki, G.; Zugaro, M.B. Selective suppression of hippocampal ripples impairs spatial memory. Nat. Neurosci. 2009, 12, 1222–1223. [Google Scholar] [CrossRef] [PubMed]
  24. Halász, P.; Bódizs, R.; Ujma, P.P.; Fabo, D.; Szucs, A. Strong relationship between NREM sleep, epilepsy and plastic functions—A conceptual review on the neurophysiology background. Epilepsy Res. 2019, 150, 95–105. [Google Scholar] [CrossRef]
  25. Halász, P.; Ujma, P.P.; Fabo, D.; Bódizs, R.; Szucs, A. Epilepsy as a derailment of sleep plastic functions may cause chronic cognitive impairment—A theoretical review. Sleep Med. Rev. 2019, 45, 31–41. [Google Scholar] [CrossRef] [PubMed]
  26. Helmstaedter, C. Effects of chronic epilepsy on declarative memory systems. Prog. Brain Res. 2002, 135, 439–453. [Google Scholar] [CrossRef]
  27. Ricci, M.; Mohamed, A.; Savage, G.; Boserio, J.; Miller, L.A. The impact of epileptiform abnormalities and hippocampal lesions on retention of recent autobiographical experiences: Adding insult to injury? Neuropsychologia 2015, 66, 259–266. [Google Scholar] [CrossRef]
  28. Jokeit, H.; Daamen, M.; Zang, H.; Janszky, J.; Ebner, A. Seizures accelerate forgetting in patients with left-sided temporal lobe epilepsy. Neurology 2001, 57, 125–126. [Google Scholar] [CrossRef] [PubMed]
  29. Horak, P.C.; Meisenhelter, S.; Song, Y.; Testorf, M.E.; Kahana, M.J.; Viles, W.D.; Bujarski, K.A.; Connolly, A.C.; Robbins, A.A.; Sperling, M.R.; et al. Interictal epileptiform discharges impair word recall in multiple brain areas. Epilepsia 2017, 58, 373–380. [Google Scholar] [CrossRef] [Green Version]
  30. Ricci, M.; Mohamed, A.; Savage, G.; Miller, L.A. Disruption of learning and long-term retention of prose passages in patients with focal epilepsy. Epilepsy Behav. 2015, 51, 104–111. [Google Scholar] [CrossRef]
  31. van Schalkwijk, F.J.; Ricci, M.; Nikpour, A.; Miller, L.A. The impact of sleep characteristics and epilepsy variables on memory performance in patients with focal seizures. Epilepsy Behav. 2018, 87, 152–158. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Long, J.; Feng, Y.; Liao, H.; Zhou, Q.; Urbin, M.A. Motor Sequence Learning Is Associated With Hippocampal Subfield Volume in Humans With Medial Temporal Lobe Epilepsy. Front. Hum. Neurosci. 2018, 12, 367. [Google Scholar] [CrossRef] [Green Version]
  33. Höller, Y.; Höhn, C.; Schwimmbeck, F.; Plancher, G.; Trinka, E. Effects of Antiepileptic Drug Tapering on Episodic Memory as Measured by Virtual Reality Tests. Front. Neurol. 2020, 11, 93. [Google Scholar] [CrossRef] [PubMed]
  34. Höller, Y.; Höhn, C.; Schwimmbeck, F.; Plancher, G.; Trinka, E. A virtual reality paradigm to assess episodic memory: Validation-dataset for six parallel versions and a structured behavioral assessment. Data Brief 2020, 29, 105279. [Google Scholar] [CrossRef]
  35. Walker, M.P.; Brakefield, T.; Morgan, A.; Hobson, J.A.; Stickgold, R. Practice with sleep makes perfect: Sleep-dependent motor skill learning. Neuron 2002, 35, 205–211. [Google Scholar] [CrossRef] [Green Version]
  36. Friedrich, S.; Konietschke, F.; Pauly, M. MANOVA.RM: Resampling-Based Analysis of Multivariate Data and Repeated Measures Designs; R-Package Version 0.4.2. 2020. Available online: https://github.com/smn74/MANOVA.RM (accessed on 1 February 2021).
  37. Torchiano, M. Efficient Effect Size Computation; R-Package Version 0.8.0. 2017. Available online: https://github.com/mtorchiano/effsize/ (accessed on 8 September 2020).
  38. Ung, H.; Cazares, C.; Nanivadekar, A.; Kini, L.; Wagenaar, J.; Becker, D.; Krieger, A.; Lucas, T.; Litt, B.; Davis, K.A. Interictal epileptiform activity outside the seizure onset zone impacts cognition. Brain 2017, 140, 2157–2168. [Google Scholar] [CrossRef] [Green Version]
  39. Deak, M.C.; Stickgold, R.; Pietras, A.C.; Nelson, A.P.; Bubrick, E.J. The role of sleep in forgetting in temporal lobe epilepsy: A pilot study. Epilepsy Behav. 2011, 21, 462–466. [Google Scholar] [CrossRef] [Green Version]
  40. Moroni, F.; Nobili, L.; Curcio, G.; De Carli, F.; Tempesta, D.; Marzano, C.; De Gennaro, L.; Mai, R.; Francione, S.; Lo Russo, G.; et al. Procedural learning and sleep hippocampal low frequencies in humans. Neuroimage 2008, 42, 911–918. [Google Scholar] [CrossRef]
  41. Nishida, M.; Walker, M.P. Daytime naps, motor memory consolidation and regionally specific sleep spindles. PLoS ONE 2007, 2, e341. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Doyon, J.; Korman, M.; Morin, A.; Dostie, V.; Hadj Tahar, A.; Benali, H.; Karni, A.; Ungerleider, L.G.; Carrier, J. Contribution of night and day sleep vs. simple passage of time to the consolidation of motor sequence and visuomotor adaptation learning. Exp. Brain Res. 2009, 195, 15–26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Motamedi, G.K.; Meador, K.J. Antiepileptic drugs and memory. Epilepsy Behav. 2004, 5, 435–439. [Google Scholar] [CrossRef] [PubMed]
  44. Dinkelacker, V.; Xin, X.; Baulac, M.; Samson, S.; Dupont, S. Interictal epileptic discharge correlates with global and frontal cognitive dysfunction in temporal lobe epilepsy. Epilepsy Behav. 2016, 62, 197–203. [Google Scholar] [CrossRef]
  45. Faught, E.; Karakis, I.; Drane, D.L. The Impact of Interictal Discharges on Performance. Curr. Neurol. Neurosci. Rep. 2018, 18, 88. [Google Scholar] [CrossRef]
  46. Brown, R.M.; Robertson, E.M. Inducing motor skill improvements with a declarative task. Nat. Neurosci. 2007, 10, 148–149. [Google Scholar] [CrossRef] [Green Version]
  47. Bazil, C.W.; Castro, L.H.; Walczak, T.S. Reduction of rapid eye movement sleep by diurnal and nocturnal seizures in temporal lobe epilepsy. Arch. Neurol. 2000, 57, 363–368. [Google Scholar] [CrossRef]
  48. Maganti, R.; Sheth, R.D.; Hermann, B.P.; Weber, S.; Gidal, B.E.; Fine, J. Sleep architecture in children with idiopathic generalized epilepsy. Epilepsia 2005, 46, 104–109. [Google Scholar] [CrossRef]
  49. Bazil, C.W. Nocturnal seizures and the effects of anticonvulsants on sleep. Curr. Neurol. Neurosci. Rep. 2008, 8, 149–154. [Google Scholar] [CrossRef] [PubMed]
  50. Clemens, B.; Menes, A. Sleep spindle asymmetry in epileptic patients. Clin. Neurophysiol. 2000, 111, 2155–2159. [Google Scholar] [CrossRef]
  51. Höller, Y.; Trinka, E. Is There a Relation between EEG-Slow Waves and Memory Dysfunction in Epilepsy? A Critical Appraisal. Front. Hum. Neurosci. 2015, 9, 341. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Lambert, I.; Tramoni-Negre, E.; Lagarde, S.; Roehri, N.; Giusiano, B.; Trebuchon-Da Fonseca, A.; Carron, R.; Benar, C.G.; Felician, O.; Bartolomei, F. Hippocampal Interictal Spikes during Sleep Impact Long-Term Memory Consolidation. Ann. Neurol. 2020, 87, 976–987. [Google Scholar] [CrossRef]
Figure 1. Visual representation of the study protocol. The figure illustrates the study protocol specifically for the procedural memory task (for an overview of the full study protocol including verbal and visuospatial memory tasks, see Supplementary Figure S1). The first session took place on Monday evening and included a learning session of the procedural memory task. All subsequent sessions except for Thursday evening included delayed recall of the previously learned task version and the learning of a new task version.
Figure 1. Visual representation of the study protocol. The figure illustrates the study protocol specifically for the procedural memory task (for an overview of the full study protocol including verbal and visuospatial memory tasks, see Supplementary Figure S1). The first session took place on Monday evening and included a learning session of the procedural memory task. All subsequent sessions except for Thursday evening included delayed recall of the previously learned task version and the learning of a new task version.
Brainsci 11 00261 g001
Figure 2. Visualization of the procedural memory task. (A) Participants used their non-dominant left hand to type the desired sequence. Each finger was assigned to a specific keyboard key that represented a number of the desired sequence. (B) Participants were shown a specific 5-element sequence on a screen and were instructed to type the desired sequence as frequently and accurately as possible for each trial (30 s) over the course of 12 trials; each trial was separated by an inter-trial interval (ITI) of 30 s. Subsequent delayed recall consisted of only four trials.
Figure 2. Visualization of the procedural memory task. (A) Participants used their non-dominant left hand to type the desired sequence. Each finger was assigned to a specific keyboard key that represented a number of the desired sequence. (B) Participants were shown a specific 5-element sequence on a screen and were instructed to type the desired sequence as frequently and accurately as possible for each trial (30 s) over the course of 12 trials; each trial was separated by an inter-trial interval (ITI) of 30 s. Subsequent delayed recall consisted of only four trials.
Brainsci 11 00261 g002
Figure 3. Evaluating performance (changes) following a seizure-free day and seizure-free night (M ± SE). Note that error bars have been corrected to represent within-subject variability. Contrasting performance between learning and recall sessions following a seizure-free day or night showed significant improvements for (A) speed and (B) triplets, whereas no changes were observed for (C) accuracy. Importantly, the performance changes from learning to recall were similar for seizure-free days and nights for speed, triplets, and accuracy. + p < 0.100; * p < 0.050.
Figure 3. Evaluating performance (changes) following a seizure-free day and seizure-free night (M ± SE). Note that error bars have been corrected to represent within-subject variability. Contrasting performance between learning and recall sessions following a seizure-free day or night showed significant improvements for (A) speed and (B) triplets, whereas no changes were observed for (C) accuracy. Importantly, the performance changes from learning to recall were similar for seizure-free days and nights for speed, triplets, and accuracy. + p < 0.100; * p < 0.050.
Brainsci 11 00261 g003
Figure 4. Exploratory within-subject contrasts (n = 10) following a seizure-free and seizure-affected retention period for patients with temporal lobe epilepsy (M ± SE). Note that error bars have been corrected to represent within-subject variability. Contrasting performance between learning and recall sessions following a seizure-free or seizure-affected retention period (AC) showed performance improvements from learning to recall for speed and triplets. Furthermore, performance improvements were higher for a seizure-free as compared to a seizure-affected retention period. * p < 0.050; ** p < 0.001.
Figure 4. Exploratory within-subject contrasts (n = 10) following a seizure-free and seizure-affected retention period for patients with temporal lobe epilepsy (M ± SE). Note that error bars have been corrected to represent within-subject variability. Contrasting performance between learning and recall sessions following a seizure-free or seizure-affected retention period (AC) showed performance improvements from learning to recall for speed and triplets. Furthermore, performance improvements were higher for a seizure-free as compared to a seizure-affected retention period. * p < 0.050; ** p < 0.001.
Brainsci 11 00261 g004
Table 1. Descriptive information on demographic and epilepsy.
Table 1. Descriptive information on demographic and epilepsy.
Demographics
    Age (M ± SD)32.92 ± 13.80
    Gender (M/F)23/30
Epilepsy characteristics
Epilepsy Type
    Focal43
    Generalized10
Location
    Frontal8
    Temporal14
    Occipital2
    Bifrontal2
    Fronto-central1
    Fronto-temporal5
    Fronto-centro-parietal1
    Temporo-mesial3
    Parieto-occipital1
    Unclear16
Lateralization
    Left20
    Right12
    Bilateral8
    Unclear13
Table 2. Within-patient performance changes evaluated for retention periods based on the absence or presence of seizures (n = 15).
Table 2. Within-patient performance changes evaluated for retention periods based on the absence or presence of seizures (n = 15).
LearningRecall
Speed M ± SDM ± SDZp
Seizure-free retention 14.61 ± 5.1416.10 ± 5.43−2.8970.048 *
Seizure-affected retention 15.65 ± 3.8416.66 ± 5.29−0.8161.000
Z−1.619−1.108
p0.9541.000
Triplets
Seizure-free retention 76.66 ± 27.3884.78 ± 28.17−2.8110.055 +
Seizure-affected retention 82.42 ± 20.3687.48 ± 26.36−0.9091.000
Z−1.675−1.221
p0.9401.000
Accuracy
Seizure-free retention 88.21 ± 7.1487.16 ± 6.56−0.4261.000
Seizure-affected retention 87.35 ± 6.2887.44 ± 5.22−0.0851.000
Z−0.628−0.199
p1.0001.000
Note: p-values were corrected for multiple comparisons using the Bonferroni–Holm procedure (for all comparisons (n = 12)). + p < 0.100; * p < 0.050.
Table 3. Within-patient performance changes evaluated for retention periods that included Scheme 42.
Table 3. Within-patient performance changes evaluated for retention periods that included Scheme 42.
LearningRecall
Speed M ± SDM ± SDZp
Seizure-free retention 13.18 ± 4.7714.03 ± 5.50−2.0930.324
Seizure-affected retention 13.77 ± 4.5514.58 ± 5.67−2.7320.066 +
Z−1.663−1.309
p0.6720.905
Triplets
Seizure-free retention 69.35 ± 24.1074.53 ± 28.20−2.6510.080 +
Seizure-affected retention 71.75 ± 23.2376.75 ± 28.03−3.2820.012 *
Z−1.200−1.575
p0.9050.690
Accuracy
Seizure-free retention 85.47 ± 7.9684.42 ± 9.95−0.3131.000
Seizure-affected retention 86.86 ± 8.1285.50 ± 11.77−0.0251.000
Z−1.901−1.338
p0.4560.905
Note: p-values were corrected for multiple comparisons using the Bonferroni–Holm procedure (for all comparisons (n = 12)). For visualization of the data, see Figure 4. + p < 0.100; * p < 0.050.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

van Schalkwijk, F.J.; Gruber, W.R.; Miller, L.A.; Trinka, E.; Höller, Y. Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy. Brain Sci. 2021, 11, 261. https://doi.org/10.3390/brainsci11020261

AMA Style

van Schalkwijk FJ, Gruber WR, Miller LA, Trinka E, Höller Y. Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy. Brain Sciences. 2021; 11(2):261. https://doi.org/10.3390/brainsci11020261

Chicago/Turabian Style

van Schalkwijk, Frank J., Walter R. Gruber, Laurie A. Miller, Eugen Trinka, and Yvonne Höller. 2021. "Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy" Brain Sciences 11, no. 2: 261. https://doi.org/10.3390/brainsci11020261

APA Style

van Schalkwijk, F. J., Gruber, W. R., Miller, L. A., Trinka, E., & Höller, Y. (2021). Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy. Brain Sciences, 11(2), 261. https://doi.org/10.3390/brainsci11020261

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop