Next Article in Journal
Achievable Information Rates for Probabilistic Amplitude Shaping: An Alternative Approach via Random Sign-Coding Arguments
Next Article in Special Issue
Assessing Complexity in Physiological Systems through Biomedical Signals Analysis
Previous Article in Journal
Network Analysis of Multivariate Transfer Entropy of Cryptocurrencies in Times of Turbulence
Previous Article in Special Issue
Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

fNIRS Complexity Analysis for the Assessment of Motor Imagery and Mental Arithmetic Tasks

1
Bioengineering and Robotics Research Center E Piaggio, Università di Pisa, 56123 Pisa, Italy
2
Department of Information Engineering, Università di Pisa, 56123 Pisa, Italy
*
Author to whom correspondence should be addressed.
Entropy 2020, 22(7), 761; https://doi.org/10.3390/e22070761
Submission received: 10 June 2020 / Revised: 7 July 2020 / Accepted: 8 July 2020 / Published: 11 July 2020

Abstract

:
Conventional methods for analyzing functional near-infrared spectroscopy (fNIRS) signals primarily focus on characterizing linear dynamics of the underlying metabolic processes. Nevertheless, linear analysis may underrepresent the true physiological processes that fully characterizes the complex and nonlinear metabolic activity sustaining brain function. Although there have been recent attempts to characterize nonlinearities in fNIRS signals in various experimental protocols, to our knowledge there has yet to be a study that evaluates the utility of complex characterizations of fNIRS in comparison to standard methods, such as the mean value of hemoglobin. Thus, the aim of this study was to investigate the entropy of hemoglobin concentration time series obtained from fNIRS signals and perform a comparitive analysis with standard mean hemoglobin analysis of functional activation. Publicly available data from 29 subjects performing motor imagery and mental arithmetics tasks were exploited for the purpose of this study. The experimental results show that entropy analysis on fNIRS signals may potentially uncover meaningful activation areas that enrich and complement the set identified through a traditional linear analysis.

1. Introduction

Functional near-infrared spectroscopy (fNIRS) is a noninvasive technique that has found success in analyzing brain function through the lens of metabolic processes and neurovascular coupling [1,2]. Common methods found in the literature analyze fNIRS signals with the assumption that an underlying linear system generated their time series [3]. Though these approaches may find success in some domains, linearity is an ideal assumption when investigating brain physiology. In fact, many physiological systems exhibit nonlinear behavior, meaning there can be further interaction between variables in a system beyond a superposition effect while also having dynamics that the system sub-components may not show. Beyond nonlinearity, physiological systems may exhibit complex dynamics as a result of feedback loops that arise from homeostasis regulation with consequent extreme sensitivity to the system state condition [4,5,6].
Prior literature has shown that nonlinearities are particularly present in the brain and its related metabolic processes. Functional magnetic resonance imaging (fMRI) and fNIRS data were demonstrated to follow a nonlinear saturating impulse response model [7], and physiological models of cerebral blood flow dynamics include complex feedback loops between ion channels, metabolism, energy demand, and oxygenation [8]. Furthermore, dynamics of the intrinsic parameters, such as the electrophysiological process that drives neurovascular coupling, also exhibit nonlinear and complex behavior [9,10].
Such nonlinearities found in metabolic processes imply that standard linear models and metrics quantifying linear dynamics defined in the time and frequency domains may potentially underrepresent the physiological processes sustaining functional activity. To this end, entropy can be a powerful tool to characterize a system’s regularity or complexity [11]. When applied to the topology of attractors describing a dynamical system in phase space, entropy leads to a robust estimation of regularity of state space evolution, also known as the Kolmogorov–Sinai metric [12]. By exploiting Takens’ theorem and the concept of characterizing an attractor through its topological entropy, several algorithms have been developed to find a value that converges to the Kolmogorov–Sinai entropy metric for regularity. Such algorithms include sample entropy (SampEn) [13] and fuzzy entropy (FuzzyEn) [14], which are able to characterize a system’s regularity at a single time scale level [15]. On the other hand, metrics, such as distribution entropy (DistEn) [16], have been shown to provide complexity estimates of the system under study.
While entropy analysis has been a widely investigated tool for studying electrophysiological signals, there is a dearth of studies regarding entropy applied to metabolic processes, as observed in fNIRS signals. Permutation entropy, i.e., entropy of a time series from an ordinal transform on the continuous data [17,18], has been exploited by Gu et al. to investigate the complexity of fNIRS signals in children affected by attention deficit disorder during working memory tasks [19]. Furthermore, Jin et al. investigated permutation entropy to analyze differences in experts and novices solving science problems [20]. Studying frontal cortex fNIRS signals, SampEn was suggested as a biomarker for Alzheimer’s disease diagnosis [21,22,23], and Angsuwatanakul et al. [24] investigated the effects of working memory experiments on SampEn estimated from fNIRS series. Also, though applied as an information theoretic approach to investigate linear effects in fNIRS rather than analyze topological entropy in phase space, differential entropy has been investigated in Keshmeri et al. as a biomarker that preserves variational information in the assessment of working memory [25,26].
Although there is literature for entropy applied to fNIRS signals, there has yet to be an analysis of its regularity and complexity during standard cognitive load tests, such as motor imagery and mental arithmetics. Besides, previous studies using entropy were not performed using a time stamped controlled block design protocol. Thus, it is not yet clear how well entropy as an estimate works when activity is controlled in time. Furthermore, a comparison with standard methods deserves scrutiny. To overcome these oversights, this study aims to uncover SampEn, FuzzyEn, and DistEn estimates of hemoglobin, deoxyhemoglobin, and total hemoglobin in mental arithmetics and motor imagery experiments in order to perform a comparison with traditional methods in fNIRS signals analysis. Concretely, we hypothesize that by considering nonlinear and complex characterizations of metabolic processed observed in fNIRS signals, more information, as expressed by cortical activity correlates, can be gleaned regarding physiological and psychophysiological phenomena than what can be considered using only linear analyses. For the purpose of this study, we used an open access dataset provided by Shin et al. [27], whose details on methodology and results follow below.

2. Materials and Methods

2.1. Block Design

The dataset used in this study is openly available and fully described in [27]. Briefly, twenty-nine subjects (aged 28.5 ± 3.7, 15 females) were involved in the experiment. Left and right hand motor imagery constituted one set of trials performed, and the other set of trials were baseline and mental arithmetics. There were three trials of each of the aforementioned experiments per subject. fNIRS and electroencephalography (EEG) series were acquired simultaneously during the whole duration of the experiment using 30 EEG channels and 36 fNIRS channels, and the sampling rate for fNIRS signals was 10 Hz. The 36 fNIRS channels were resolved from a set of 14 sources to 16 detectors matching as illustrated in Figure 1.
The experimental protocol began with a 60 s rest, after which subjects were presented an instruction (either a “←” or “→” for motor imagery experiments, and either a “-” or an arithmetic task in comparing baseline vs mental arithmetic) on the screen telling them which task were to be performed. Afterwards, the individual performed the task for 10 s, with a subsequent 15 s rest before the next task. After 20 repetitions of these instructions and tasks, a 60 s ending rest was performed. Mental arithmetic/baseline trials were performed independently from motor imagery trials.

2.2. Hemoglobin Extraction from fNIRS Signals

In continuous wave fNIRS acquisitions, light radiations from two different wavelengths are used to create a system of equations that can resolve hemoglobin content. These wavelengths are generally chosen to be in the range of the physiological window where water and hemoglobin absorption is particularly low (650 nm to 1350 nm). To this extent, the “modified Beer–Lambert law” provides a mathematical expression relating absorption measured with a detector and the concentration of a chromophore as seen in Equation (1) [28]:
μ a ( λ , t ) = l o g ( I o ( λ ) I ( λ , t ) ) = i = 0 n c i ( t ) ϵ i ( λ ) ρ D P F + G
where μ a is the absorption coefficient at a given wavelength λ and time t, I o is incident light intensity, I is the detected intensity that changes with time, c are the chromophore concentrations of interest, ρ is the separation between a light source and detector, DPF is the correction factor for a best estimate of a light path through a tissue, and G is the loss of light due to scattering. In a continuous wave setting, differential concentrations Δ c , related by differential absorption Δ μ a , are the parameters that are analyzed in the fNIRS signals. This allows for a significant simplification of the expression above when assuming that scattering loss is a constant in time, yielding differential concentrations that can be resolved through a simple linear system of equations given multiple wavelengths, as seen in Equation (2):
Δ μ a ( λ , t ) = l o g ( I b ( λ ) I ( λ , t ) ) = i = 0 n Δ c i ( t ) ϵ i ( λ ) ρ D P F
where I b is the intensity detected at a baseline of interest.
From the modified Beer–Lambert law, the differential concentration of deoxyhemoglobin can be retrieved by choosing two wavelengths on opposing sides of the isobestic point of the absorption spectra of oxyhemoglobin and deoxyhemoglobin and solving a linear system of equations. In the methods of Shin et al., 760 nm and 850 nm were used as wavelengths. In this study, an evaluation on such differential concentrations as well as total Hb during activity will be performed.

2.3. fNIRS Data Preprocessing

Figure 2 shows an overview of the preprocessing pipeline. The signal was transformed from optical densities into Hb and HbO using the modified Beer–Lambert law. For the modified Beer–Lambert law, the first 60 s were considered as a baseline, corresponding to the resting state. A first Butterworth lowpass filter with a cutoff frequency at 0.6 Hz and filter order 6 was applied to fNIRS data to highlight the hemodynamic response. This was considered as 0.6 Hz is the upper end of cut-off frequencies used in literature [29]. This is significant for preserving the full dynamics of hemoglobin, including the high frequency components, which can uniquely affect the topology of the attractor in phase space and render different estimates of entropy. In hand, we must accept the risk of physiological phenomena, such as Mayer waves, contaminating the entropy estimates. A second band-pass filter with cutoffs 0.8 Hz and 2 Hz and filter order 6 was used to capture pulsatile dynamics of hemoglobin [30]. Afterwards, a wavelet filtering approach was used to further reduce noise, particularly related to motion artifacts, in the oxy- and deoxyhemoglobin signals [31]. This wavelet filtering approach works by decomposing the time series into nine levels using a daubechies five mother wavelet, subsequently thresholding detail coefficients that have low probability (p < 0.1) given the detail coefficients are sampled from a normal distribution. After the wavelet filter, the time series were separated into epochs representing blocks of activity. Each channel at each activity block was differentially referenced to the mean of the previous 5 s of said channel. The data was then further processed to extract features such as entropy and mean values of hemoglobin.

2.4. Entropy Analysis

The entropy metrics SampEn, FuzzyEn, and DistEn were extracted as regularity and complexity characterizations of fNIRS data. For each fNIRS signal (Hb, HbO, and total hemoglobin) and for the multivariate embedding derived from a concatenation of the Hb and HbO embedding, the optimal time delay was chosen as the first zero of the autocorrelation while the optimal embedding dimension was found using the false nearest neighbours algorithm [32].
To create the embeddings, we started from a time series x(t) of N samples. Having determined the time lag τ and embedding dimension m, the states X t m of the reconstructed attractor can be represented in vector form as follows:
X t m = { x ( t ) , x ( t + τ ) , x ( t + ( m 1 ) τ ) }
When reconstructing an attractor using several variables, i.e., the concatenated attractor (Concat), the above expression is modified in the following way:
X t m = { x ( t ) , x ( t + τ ) , x ( t + ( m 1 ) τ ) , y ( t ) , y ( t + τ ) , y ( t + ( m 1 ) τ ) }
From the reconstructed attractor, entropy estimates may be computed. For SampEn, the estimate can be obtained, as follows:
S a m p E n = l o g ( i = 1 , i j N m 1 N m 1 number   of | X i m + 1 X j m + 1 | < R i = 1 , i j N m 1 N m 1 number   of | X i m X j m | < R )
where R refers to a user set deviance of states to binarize the distance metric. In this study, it is set to 0.2 σ x , a setting widely used in previous studies with theoretical justifications, where σ x is the standard deviation of the considered time series [33,34].
FuzzyEn uses a fuzzy membership function instead of the heaviside function to calculate the correlation integral. In this study, we employed an exponential function, as follows:
ϕ m = 1 N m i = 1 N m 1 N m 1 j = 1 , j i N m e ( | X i m X j m | ) K R
The value of K was set to 2. Afterwards, FuzzyEn can be derived as the ratio between the above fuzzy function with the result of a fuzzy function of an order greater [35].
F u z z y E n = l o g ( ϕ m + 1 ϕ m )
DistEn is less dependent on parameter selection in comparison to FuzzyEn and SampEn, given that the parameter R is no longer required. A histogram is constructed from the distance matrix, and the Shannon entropy of the empirical probability density function is computed. To make the algorithm faster, we extracted the upper triangle of the distance matrix, as it should be symmetrical, meaning that lower triangle contains redundant information. Additionally, the diagonal is removed from the entropy estimate as it should be a zero vector when considering that the self-similar distance is zero. Bin size was estimated by using Scott’s method [36].

2.5. Statistical Analysis

A bootstrapped third moment test was performed with linear time series surrogate samples generated by an amplitude adjusted Fourier transform of the original time series and phase scrambling in order to test the null hypothesis that the original time series was generated from a linear system [37]. Two-hundred surrogate series were generated in order to determine a p-value, with the third moment calculated for τ = 1 lag as illustrated in the following equation [38].
t c 3 ( τ ) = < x k · x k + τ · x k + 2 τ >
The percentage of significant time series for each channel and each parameter, either Hb, HbO, or total Hb, are shown in the results. Significance is determined using an α = 0.05 .
After ascertaining nonlinearity, further non-parametric tests were performed on entropy and mean hemoglobin results when considering the non-Gaussian distribution of the metrics. Friedman non-parametric statistical tests for paired data were performed in order to determine whether repetitions of activities in each trial were significantly different. Afterwards, a Friedman test was applied using a median summary statistic over trials to compare significant cortical areas of activation between the four tasks (i.e., baseline, mental arithmetic, left hand, and right hand motor imagery). Multiple comparison tests were then performed between pairs of tasks using Wilcoxon signed rank tests for paired data, and the statistical significance was set to 0.05 when considering a Bonferroni correction rule over the four different activity comparisons.
Group-wise and channel-wise multiple comparison results for each metric are displayed using both p-value topographic maps and topographic maps displaying Δ value differences between tasks for a given metric. Cortical regions in the topographic maps that are not covered by the optodes, as seen in Figure 1, are inferred using a bilinear interpolation.

3. Results

3.1. Nonlinearity Test

As illustrated in Figure 3, an analysis of the third moment for each time series in Hb, HbO, and total hemoglobin demonstrates that the majority of time series exhibits nonlinear behavior, rejecting the null hypothesis that a linear system generated the time series.

3.2. Analysis of Repetitions within Tasks

Through the Friedman statistical test on repetitions, it can be seen by Table 1 that we were able to accept the null hypothesis that there were no significant differences between the repetitions for either mental arithmetic, left hand imagery, right hand imagery, or baseline when using any of the statistics of mean, SampEn, or DistEn over any set of hemoglobin time series representation. On the other hand, we could reject the null hypothesis for the FuzzyEn comparisons in the case of using total hemoglobin time series and the multivariate topology reconstructed from both oxyhemoglobin and deoxyhemoglobin.
Given this result, subsequent post-hoc analyses focused on mean estimates, SampEn, and DistEn for each time series. Furthermore, when considering that the repetitions of these metrics did not show significant differences, the median value of each estimate over repetitions was used as a summary statistics for further inter-subject analyses.

3.3. Between-Task Statistical Analysis

Cortical areas with significant statistical differences between baseline, mental arithmetic, right hand, and left hand motor imagery tasks according to a Friedman test analysis on mean, SampEn and DistEn analyses can be seen in Figure 4. Estimates on the oxyhemoglobin signal showed overlapping areas of significance between mean estimate and both entropy estimates in the occipital regions. On the other hand, DistEn estimates on deoxyhemoglobin signal had significant changes between tasks over the somatosensory cortex that were not exhibited in the mean estimate. For the total hemoglobin signal, both SampEn and DistEn unraveled further information that mean estimates could not, where DistEn exhibited significant changes in the occipital area, and SampEn exhibited changes in the parietal area. In the concatenated topology, DistEn and SampEn exhibited different subsets of cortical activations.

3.4. Multiple Comparison Analysis

Figure 5 shows cortical areas that were associated with significant statistical differences between mental arithmetic activity and baseline activity for a given estimate according to Wilcoxon non-parametric tests. When analyzing oxyhemoglobin, SampEn displayed regions in the occipital cortex that were not highlighted by the mean estimates; DistEn did not seem to add further information. From deoxyhemoglobin signal analysis, DistEn uncovered significant changes over the left occipital region that were unobserved in the mean estimate analysis; SampEn did not seem to add new information. On total hemoglobin, significant changes between tasks were found in the right occipital cortex from DistEn, which were unobserved in mean estimates. From the concatenated signal, DistEn displayed information in the parietal cortex that was unobserved by previous analysis. From visual inspection on Figure 5, it seemed that mental arithmetic activity was generally associated with higher mean and a lower irregularity and complexity levels than baseline.
Further Wilcoxon tests were performed to show cortical areas that were associated with a significant statistical difference between left hand motor imagery and baseline for a given estimate, as seen in Figure 6. When analyzing oxyhemoglobin, both DistEn and SampEn showed significant changes between tasks over a larger region than the mean estimate, especially in the right occipital cortex. Furthermore, deoxyhemoglobin activity in the left temporal and sensorimotor cortices was highlighted by both entropies. A total hemoglobin analysis confirmed that DistEn and SampEn highlight further changes that were not seen in a mean estimate analysis. With visual inspection on Figure 6, it appeared that SampEn inversely mapped mean estimate changes over the the frontal, motor, and parietal regions for the oxyhemoglobin signals. For deoxyhemoglobin, higher mean estimates over the right hemisphere were associated with left hand motor imagery activity. SampEn increased over the frontal areas during left hand motor imagery tasks with respect to baseline with no changes over the posterior areas. Changes in total hemoglobin signal seemed similar to oxyhemoglobin.
From Figure 7, another set of Wilcoxon non-parameteric test results can be seen, showing cortical areas that were associated with a significant statistical difference between right hand motor imagery and baseline for a given estimate. While mean estimates were associated with few significant changes between tasks, SampEn and DistEn showed significant differences over several areas, especially in a oxyhemoglobin and total hemoglobin analysis. Particularly, in a oxyhemoglobin analysis, DistEn showed significant changes over the frontal, right, and left occipital areas, which were complemented by further changes over parietal cortices by SampEn. For deoxyhemoglobin signal, complementary parietal activity appeared in DistEn while SampEn changes were a subset of the mean estimates. In the case of total hemoglobin, changes over the sensorimotor and parietal cortices were found using SampEn, while DistEn and mean estimates did not show significant changes between tasks.
Using further visual inspection analysis on Figure 7, the trend appears to be that higher mean, SampEn, and DistEn values over the frontal areas were more associated with right hand motor imagery activity, whereas higher estimate values over the posterior areas were associated with baseline activity. In the case of deoxyhemoglobin, higher mean estimates over the right hemisphere were associated with right hand motor imagery activity. SampEn increased over the frontal areas during right hand motor imagery tasks with respect to baseline with no changes over the central posterior areas. Changes in total hemoglobin signal seemed similar to oxyhemoglobin ones.
Figure 8 shows cortical areas that were associated with a significant statistical difference between right hand and left hand motor imagery for a given estimate according to Wilcoxon non-parametric tests. Complementary left occipital activity was uncovered by DistEn for oxyhemoglobin, while a deoxyhemoglobin analysis using SampEn uncovered unique parietal activity changes between tasks. In the case of total hemoglobin, larger parietal changes were found in DistEn than the mean estimate, while SampEn exhibited changes in the right temporal regions. Visual inspection analysis on Figure 8 shows a trend of left hand motor imagery activity being associated with higher mean, irregularity and complexity levels than right hand motor imagery activity over the frontal areas, while an opposite trend seemed to be observed over the posterior regions. Particularly, changes over the frontal cortex in mean estimates seemed similar to SampEn differences in oxyhemoglobin, while they appeared to be inversely distributed in DistEn. In deoxyhemoglobin, no differences between left and right hand motor images seemed to occur over the posterior regions in SampEn, whereas DistEn appeared to show similar differences as mean estimates.

4. Discussion

We investigated changes in fNIRS entropy during mental arithmetics and motor imagery tasks and compared the results with fNIRS standard analysis metrics. Our aim was to test whether entropy analysis could unravel changes in cortical areas that may not be highlighted while using traditional methods that analyze the signal in the time domain. Particularly, we assessed statistical differences in fNIRS signal entropy in four different tasks (baseline, mental arithmetic, right hand, and left hand motor imagery), and compared different entropy metrics—specifically SampEn, FuzzyEn, and DistEn—together with mean value estimates of hemoglobin, deoxyhemoglobin, and total hemoglobin.
Previous studies used entropy estimates in protocols of long time windows with unspecified timing of events in the signal, as in the case of cognitive capacity analysis in Alzheimer’s [21,22,23]. Nevertheless, regularity and complexity analyses of fNIRS signals during standard cognitive load tests, such as motor imagery and mental arithmetics, were not investigated to the best of our knowledge.
Through a test of nonlinearity, we were able to ascertain that the majority of the considered time series demonstrated nonlinear behavior. Nonlinearity testing was necessary for validating whether quantifying the extent of nonlinear behavior could be a value of interest in the analysis of functional activity. To that extent, our analysis corroborated studies performed in the past, such as the evidence demonstrated in Khoa et al., where they performed similar nonlinearity tests [38].
Our study showed that FuzzyEn applied to total hemoglobin and the concatenated attractor from the open dataset demonstrated significant differences between task repetitions (see Table 1); therefore, only SampEn and DistEn were retained for further analyses on fNIRS regularity and complexity at a task level. In fact, this result allowed for subsequent comparison analyses between the four tasks to be performed using a median summary statistic for entropy and the mean estimates over the repetitions rather than considering each repetition independently.
Over the general set of results, complementary areas of functional activity were found in both SampEn and DistEn when compared to mean estimates, as demonstrated in Figure 5, Figure 6, Figure 7 and Figure 8. For example, in the comparison between mental arithmetics and baseline activities in Figure 5, SampEn was able to uncover particular parietal activity in oxyhemoglobin that mean estimates, using any of the three hemoglobin concentrations (Hb, HbO, THb), were unable to resolve. Furthermore, it appears that both entropy estimates are more sensitive to temporal cortex activity, as seen in Figure 6 and Figure 7, when analyzing motor imagery tasks compared to baseline.
Previous studies highlighted hemodynamic changes during mental arithmetic tasks primarily over the bilateral intraparietal, inferior temporal, and dorsal prefontal sites [39,40]. SampEn and DistEn were both successful in recovering those activity areas as demonstrated in Figure 5. Particularly, SampEn applied to oxyhemoglobin showed changes over parietal structures while deoxyhemoglobin revealed changes over frontal cortical sites. With DistEn, the concatenated series displayed changes over both parietal, frontal, and temporal activity. However, the mean estimates were not able to uncover the parietal cortex changes, but instead were only sensitive to frontal cortex and temporal cortex activity. In the case of mental arithmetics, these results suggest that entropy estimates may be more sensitive to cortical hemodynamic changes than mean estimates given the sample size available. This may be due to the additional quantification of nonlinear and complex dynamics provided by entropy analysis. Where linear effects subside or may not be as significant, nonlinear, and complex behavior may still persist. This could be explained by models that demonstrate short term stimuli resulting in nonlinear behavior in the hemodynamic response [7]. Speculatively, stimuli may become less frequent or last for shorter durations when a subject experiences fatigue from a protocol or has become habituated.
In light of motor imagery tasks, Figure 8 demonstrates that we were able to find activity areas in the expected sensorimotor cortex while using either entropy or mean estimate analysis. Explicitly, both DistEn applied to deoxyhemoglobin and SampEn applied to the concatenated attractor unraveled these expected changes. Furthermore, we observed a lateralization effect in DistEn applied to oxyhemoglobin and the concatenated attractor, as well as SampEn applied to oxyhemoglobin. These results are in accordance with previous findings [41]. This suggests the presence of complementary information supplied by regularity and complexity analysis on fNIRS series. In light of these significant results, it is important to mention that a bilinear spatial interpolation was performed on the topographic maps as mentioned in Section 2.5, thus there could be errors in drawing the true cortical location of activity. It would be important to use a higher density fNIRS cap in future experiments in order to better pinpoint the true cortical location of a specific activity.
The success of entropy estimates in unraveling complementary areas was particularly surprising when considering that the experiments studied here were tailored to leverage strong activations that arise from a saturating superposition effect, i.e., linear superposition. As mentioned above, it is possible that short-term stimuli were introduced when either the subject became habituated or fatigued. Furthermore, there may also be significant oscillatory behaviors that contribute to the observed nonlinearities observed in the hemodynamic signal that mean value analysis can not detect. For example, changes in pulsatility in the microvessels that arise from cardiac pulses and physical properties of the microvessels may nonlinearly affect the oxygen extraction from the capillaries to the tissue [10].
As has been mentioned in the introduction, biological systems exhibit a vast array of feedback and compensatory loops in order to regulate homeostatic behavior at a neurolobiological level [4,5,6]. This knowledge brings light to the significance of the study we have presented in leveraging the information in phase space that this complex system projects in the fNIRS time series. However, a clear limitation of the study is that it is purely exploratory, rather than explanatory for the neurobiological activity that underlies the complex system the entropy estimates assess. Nonetheless, this study holds a beacon for future research to investigate the intrinsic complex neurobiological correlates that comprise activity in mental arithmetic and motor imagery tasks.
A natural extension of this study in the future can be to apply fNIRS regularity and complexity analysis to block-free paradigms, such as a clock drawing test [42], or tests that stimulate more complex dynamics related to emotional response [43,44,45]. Because SampEn was not applied using a multiscale algorithm, future studies can also investigate fNIRS dynamic activity while using a multiscale entropy analysis. Such sophisticated methodology may further highlight complex changes that may be induced by activity on different time scales, such as cardiac pulsatility, arterial blood pressure induced mayer waves, or other nonlinearities driving the hemodynamic response [10,46,47]. Furthermore, in future studies, a dataset using an fNIRS system that includes short source-detector separation channels can be analyzed to regress out artifacts due to skin-blood flow induced changes in the fNIRS signals.

5. Conclusions

A novel investigation into the analysis of entropy in metabolic processes measured by fNIRS on controlled block design experimental protocols was presented in this study. We conclude that entropy may uncover areas that yield neuronal correlates and that agree with traditional methods of analyzing neuronal correlates while also providing novel complementary areas not seen in mean estimates. Furthermore, entropy estimates seemed to exhibit greater sensitivity with sample size to activity than mean estimates in mental arithmetics. These results shed light on not only the validity, but also the efficacy of using entropy to investigate functional neural activations.

Author Contributions

A.G. processed and analyzed the data under the supervision of G.V. and M.N.; Writing of the original draft was performed by A.G.; All authors reviewed and revised the final manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

The research leading to these results has received partial funding from the European Commission—Horizon 2020 Program under grant agreement n 813234 of the project “RHUMBO” and by the Italian Ministry of Education and Research (MIUR) in the framework of the CrossLab project (Departments of Excellence).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Strangman, G.; Culver, J.P.; Thompson, J.H.; Boas, D.A. A Quantitative Comparison of Simultaneous BOLD fMRI and NIRS Recordings during Functional Brain Activation. NeuroImage 2002, 17, 719–731. [Google Scholar] [CrossRef] [PubMed]
  2. Jobsis, F. Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. Science 1977, 198, 1264–1267. [Google Scholar] [CrossRef] [PubMed]
  3. Naseer, N.; Hong, K.S. fNIRS-based brain-computer interfaces: A review. Front. Hum. Neurosci. 2015, 9, 3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Goldberger, A.L.; Peng, C.K.; Lipsitz, L.A. What is physiologic complexity and how does it change with aging and disease? Neurobiol. Aging 2002, 23, 23–26. [Google Scholar] [CrossRef]
  5. Marmarelis, V.Z. Nonlinear Dynamic Modeling of Physiological Systems; John Wiley & Sons: Hoboken, NJ, USA, 2004; Volume 10. [Google Scholar]
  6. Sunagawa, K.; Kawada, T.; Nakahara, T. Dynamic nonlinear vago-sympathetic interaction in regulating heart rate. Heart Vessel. 1998, 13, 157–174. [Google Scholar] [CrossRef]
  7. Toyoda, H.; Kashikura, K.; Okada, T.; Nakashita, S.; Honda, M.; Yonekura, Y.; Kawaguchi, H.; Maki, A.; Sadato, N. Source of nonlinearity of the BOLD response revealed by simultaneous fMRI and NIRS. NeuroImage 2008, 39, 997–1013. [Google Scholar] [CrossRef]
  8. Banaji, M.; Tachtsidis, I.; Delpy, D.; Baigent, S. A physiological model of cerebral blood flow control. Math. Biosci. 2005, 194, 125–173. [Google Scholar] [CrossRef]
  9. Jeong, J. EEG dynamics in patients with Alzheimer’s disease. Clin. Neurophysiol. 2004, 115, 1490–1505. [Google Scholar] [CrossRef]
  10. Friston, K.J. Book Review: Brain Function, Nonlinear Coupling, and Neuronal Transients. Neuroscientist 2001, 7, 406–418. [Google Scholar] [CrossRef]
  11. Elbert, T.; Ray, W.J.; Kowalik, Z.J.; Skinner, J.E.; Graf, K.E.; Birbaumer, N. Chaos and physiology: Deterministic chaos in excitable cell assemblies. Physiol. Rev. 1994, 74, 1–47. [Google Scholar] [CrossRef]
  12. Sinaĭ, Y.G. On the Notion of Entropy of a Dynamical System. Dokl. Russ. Acad. Sci. 1959, 124, 768–771. [Google Scholar]
  13. Richman, J.S.; Moorman, J.R. Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Heart Circ. Physiol. 2000, 278, H2039–H2049. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Chen, W.; Wang, Z.; Xie, H.; Yu, W. Characterization of Surface EMG Signal Based on Fuzzy Entropy. IEEE Trans. Neural Syst. Rehabil. Eng. 2007, 15, 266–272. [Google Scholar] [CrossRef] [PubMed]
  15. Costa, M.; Goldberger, A.L.; Peng, C.K. Multiscale entropy analysis of biological signals. Phys. Rev. E 2005, 71, 021906. [Google Scholar] [CrossRef] [Green Version]
  16. Li, P.; Liu, C.; Li, K.; Zheng, D.; Liu, C.; Hou, Y. Assessing the complexity of short-term heartbeat interval series by distribution entropy. Med. Biol. Eng. Comput. 2015, 53, 77–87. [Google Scholar] [CrossRef]
  17. Bandt, C.; Keller, G.; Pompe, B. Entropy of interval maps via permutations. Nonlinearity 2002, 15, 1595–1602. [Google Scholar] [CrossRef]
  18. Bandt, C.; Shiha, F. Order Patterns in Time Series. J. Time Ser. Anal. 2007, 28, 646–665. [Google Scholar] [CrossRef]
  19. Gu, Y.; Miao, S.; Han, J.; Zeng, K.; Ouyang, G.; Yang, J.; Li, X. Complexity analysis of fNIRS signals in ADHD children during working memory task. Sci. Rep. 2017, 7, 829. [Google Scholar] [CrossRef] [Green Version]
  20. Jin, L.; Jia, H.; Li, H.; Yu, D. Differences in brain signal complexity between experts and novices when solving conceptual science problem: A functional near-infrared spectroscopy study. Neurosci. Lett. 2019, 699, 172–176. [Google Scholar] [CrossRef] [PubMed]
  21. Perpetuini, D.; Chiarelli, A.M.; Cardone, D.; Filippini, C.; Bucco, R.; Zito, M.; Merla, A. Complexity of Frontal Cortex fNIRS Can Support Alzheimer Disease Diagnosis in Memory and Visuo-Spatial Tests. Entropy 2019, 21, 26. [Google Scholar] [CrossRef] [Green Version]
  22. Perpetuini, D.; Bucco, R.; Zito, M.; Merla, A. Study of memory deficit in Alzheimer’s disease by means of complexity analysis of fNIRS signal. Neurophotonics 2018, 5, 011010. [Google Scholar] [CrossRef] [PubMed]
  23. Li, X.; Zhu, Z.; Zhao, W.; Sun, Y.; Wen, D.; Xie, Y.; Liu, X.; Niu, H.; Han, Y. Decreased resting-state brain signal complexity in patients with mild cognitive impairment and Alzheimer’s disease: A multi-scale entropy analysis. Biomed. Opt. Express 2018, 9, 1916–1929. [Google Scholar] [CrossRef] [Green Version]
  24. Angsuwatanakul, T.; Iramina, K.; Kaewkamnerdpong, B. Brain complexity analysis of functional near infrared spectroscopy for working memory study. In Proceedings of the 2015 8th Biomedical Engineering International Conference (BMEiCON), Pattaya, Thailand, 25–27 November 2015; pp. 1–5. [Google Scholar] [CrossRef]
  25. Keshmiri, S.; Sumioka, H.; Yamazaki, R.; Ishiguro, H. Differential Entropy Preserves Variational Information of Near-Infrared Spectroscopy Time Series Associated With Working Memory. Front. Neuroinform. 2018, 12, 33. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Keshmiri, S.; Sumioka, H.; Okubo, M.; Ishiguro, H. An Information-Theoretic Approach to Quantitative Analysis of the Correspondence Between Skin Blood Flow and Functional Near-Infrared Spectroscopy Measurement in Prefrontal Cortex Activity. Front. Neurosci. 2019, 13, 79. [Google Scholar] [CrossRef] [Green Version]
  27. Shin, J.; von Lühmann, A.; Blankertz, B.; Kim, D.; Jeong, J.; Hwang, H.; Müller, K. Open Access Dataset for EEG+NIRS Single-Trial Classification. IEEE Trans. Neural Syst. Rehabil. Eng. 2017, 25, 1735–1745. [Google Scholar] [CrossRef] [PubMed]
  28. Villringer, A.; Chance, B. Non-invasive optical spectroscopy and imaging of human brain function. Trends Neurosci. 1997, 20, 435–442. [Google Scholar] [CrossRef]
  29. Pinti, P.; Scholkmann, F.; Hamilton, A.; Burgess, P.; Tachtsidis, I. Current Status and Issues Regarding Pre-processing of fNIRS Neuroimaging Data: An Investigation of Diverse Signal Filtering Methods Within a General Linear Model Framework. Front. Hum. Neurosci. 2019, 12, 505. [Google Scholar] [CrossRef] [Green Version]
  30. Strangman, G.; Boas, D.A.; Sutton, J.P. Non-invasive neuroimaging using near-infrared light. Biol. Psychiatry 2002, 52, 679–693. [Google Scholar] [CrossRef]
  31. Molavi, B.; Dumont, G.A. Wavelet-based motion artifact removal for functional near-infrared spectroscopy. Physiol. Meas. 2012, 33, 259–270. [Google Scholar] [CrossRef]
  32. Abarbanel, H.D.I.; Brown, R.; Sidorowich, J.J.; Tsimring, L.S. The analysis of observed chaotic data in physical systems. Rev. Mod. Phys. 1993, 65, 1331–1392. [Google Scholar] [CrossRef] [Green Version]
  33. Delgado-Bonal, A.; Marshak, A. Approximate Entropy and Sample Entropy: A Comprehensive Tutorial. Entropy 2019, 21, 541. [Google Scholar] [CrossRef] [Green Version]
  34. Lake, D.E.; Richman, J.S.; Griffin, M.P.; Moorman, J.R. Sample entropy analysis of neonatal heart rate variability. Am. J. Physiol. Regul. Integr. Comp. Physiol. 2002, 283, R789–R797. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Azami, H.; Escudero, J. Refined composite multivariate generalized multiscale fuzzy entropy: A tool for complexity analysis of multichannel signals. Phys. A Stat. Mech. Its Appl. 2017, 465, 261–276. [Google Scholar] [CrossRef] [Green Version]
  36. Scott, D.W. On optimal and data-based histograms. Biometrika 1979, 66, 605–610. [Google Scholar] [CrossRef]
  37. Barnett, A.G.; Wolff, R.C. A time-domain test for some types of nonlinearity. IEEE Trans. Signal Process. 2005, 53, 26–33. [Google Scholar] [CrossRef] [Green Version]
  38. Khoa, T.Q.D.; Thang, H.M.; Nakagawa, M. Testing for nonlinearity in functional near-infrared spectroscopy of brain activities by surrogate data methods. J. Physiol. Sci. JPS 2008, 58, 47–52. [Google Scholar] [CrossRef] [Green Version]
  39. Amalric, M.; Dehaene, S. Origins of the brain networks for advanced mathematics in expert mathematicians. Proc. Natl. Acad. Sci. USA 2016, 113, 4909–4917. [Google Scholar] [CrossRef] [Green Version]
  40. Soltanlou, M.; Sitnikova, M.A.; Nuerk, H.C.; Dresler, T. Applications of Functional Near-Infrared Spectroscopy (fNIRS) in Studying Cognitive Development: The Case of Mathematics and Language. Front. Psychol. 2018, 9, 277. [Google Scholar] [CrossRef]
  41. Fazli, S.; Mehnert, J.; Steinbrink, J.; Curio, G.; Villringer, A.; Müller, K.R.; Blankertz, B. Enhanced performance by a hybrid NIRS-EEG brain computer interface. NeuroImage 2012, 59, 519–529. [Google Scholar] [CrossRef]
  42. Agrell, B.; Dehlin, O. The clock-drawing test. Age Ageing 1998, 27, 399–403. [Google Scholar] [CrossRef]
  43. Nardelli, M.; Greco, A.; Danzi, O.P.; Perlini, C.; Tedeschi, F.; Scilingo, E.P.; Del Piccolo, L.; Valenza, G. Cardiovascular assessment of supportive doctor-patient communication using multi-scale and multi-lag analysis of heartbeat dynamics. Med. Biol. Eng. Comput. 2019, 57, 123–134. [Google Scholar] [CrossRef]
  44. Li, X.; Song, D.; Zhang, P.; Zhang, Y.; Hou, Y.; Hu, B. Exploring EEG Features in Cross-Subject Emotion Recognition. Front. Neurosci. 2018, 12, 162. [Google Scholar] [CrossRef] [Green Version]
  45. Hu, X.; Yu, J.; Song, M.; Yu, C.; Wang, F.; Sun, P.; Wang, D.; Zhang, D. EEG Correlates of Ten Positive Emotions. Front. Hum. Neurosci. 2017, 11, 26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Buckner, R.L. Event-related fMRI and the hemodynamic response. Hum. Brain Mapp. 1998, 6, 373–377. [Google Scholar] [CrossRef]
  47. Zhang, Y.; Brooks, D.H.; Franceschini, M.A.; Boas, D.A. Eigenvector-based spatial filtering for reduction of physiological interference in diffuse optical imaging. J. Biomed. Opt. 2005, 10, 011014. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Position of the Optodes. Positions labeled with “D” refer to detectors while positions labeled with “S” are sources. The lines demonstrate coupling between sources and detectors.
Figure 1. Position of the Optodes. Positions labeled with “D” refer to detectors while positions labeled with “S” are sources. The lines demonstrate coupling between sources and detectors.
Entropy 22 00761 g001
Figure 2. Pipeline for processing functional near-infrared spectroscopy (fNIRS) data.
Figure 2. Pipeline for processing functional near-infrared spectroscopy (fNIRS) data.
Entropy 22 00761 g002
Figure 3. Topographic maps from channel-wise third moment tests displaying the fraction of time series from each channel having statistical significance, where the colorbar indicates the value of the fraction.
Figure 3. Topographic maps from channel-wise third moment tests displaying the fraction of time series from each channel having statistical significance, where the colorbar indicates the value of the fraction.
Entropy 22 00761 g003
Figure 4. p-value topographic maps from channel-wise Friedman tests displaying significant statistical differences between all tasks in the experimental protocol (baseline, mental arithmetic, right hand, and left hand motor imagery). Y (green) areas indicate where we could reject the null hypothesis that activity was the same in all the tasks, whereas N (white) areas indicate where we could not reject the null hypothesis.
Figure 4. p-value topographic maps from channel-wise Friedman tests displaying significant statistical differences between all tasks in the experimental protocol (baseline, mental arithmetic, right hand, and left hand motor imagery). Y (green) areas indicate where we could reject the null hypothesis that activity was the same in all the tasks, whereas N (white) areas indicate where we could not reject the null hypothesis.
Entropy 22 00761 g004
Figure 5. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between mental arithmetic activity and baseline activity. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between baseline (B) and mental arithmetic (M) tasks, with red indicating higher values for mental arithmetic than baseline and blue indicating lower values for mental arithmetic as compared to baseline.
Figure 5. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between mental arithmetic activity and baseline activity. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between baseline (B) and mental arithmetic (M) tasks, with red indicating higher values for mental arithmetic than baseline and blue indicating lower values for mental arithmetic as compared to baseline.
Entropy 22 00761 g005
Figure 6. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between left hand imagery activity and baseline activity. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between baseline (B) and left hand imagery (L) tasks, with red indicating higher values for left hand imagery vs baseline and blue indicating lower values for left hand imagery vs baseline.
Figure 6. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between left hand imagery activity and baseline activity. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between baseline (B) and left hand imagery (L) tasks, with red indicating higher values for left hand imagery vs baseline and blue indicating lower values for left hand imagery vs baseline.
Entropy 22 00761 g006
Figure 7. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between right hand imagery activity and baseline activity. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between baseline (B) and right hand imagery (R) tasks, with red indicating higher values for right hand imagery vs baseline and blue indicating lower values for right hand imagery vs baseline.
Figure 7. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between right hand imagery activity and baseline activity. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between baseline (B) and right hand imagery (R) tasks, with red indicating higher values for right hand imagery vs baseline and blue indicating lower values for right hand imagery vs baseline.
Entropy 22 00761 g007
Figure 8. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between left hand imagery and right hand imagery activities. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between left hand imagery (L) and right hand imagery (R) tasks, with red indicating higher values for right hand imagery than left hand imagery and blule indicating lower values for right hand imagery than left hand imagery.
Figure 8. p-value topographic maps from channel-wise Wilcoxon non-parametric tests displaying significant statistical differences between left hand imagery and right hand imagery activities. Y (green) areas indicate statistically significant changes between tasks, whereas N indicates non-significant changes. The colormap topoplots display estimate differences between left hand imagery (L) and right hand imagery (R) tasks, with red indicating higher values for right hand imagery than left hand imagery and blule indicating lower values for right hand imagery than left hand imagery.
Entropy 22 00761 g008
Table 1. Table of statistical power p-values from the Friedman analysis. p-values are bonferroni corrected. * denotes that using an alpha of 0.01 we must reject the null hypothesis that there were no significant variations between repetitions. This particularly occurs for FuzzyEn in the total and the concatenated case for deoxyhemoglobin.
Table 1. Table of statistical power p-values from the Friedman analysis. p-values are bonferroni corrected. * denotes that using an alpha of 0.01 we must reject the null hypothesis that there were no significant variations between repetitions. This particularly occurs for FuzzyEn in the total and the concatenated case for deoxyhemoglobin.
MetricMental ArithmeticLeft Hand ImageryRight Hand ImageryBaseline
HbO0.17350.11470.03310.7383
Hb0.08700.08410.17350.0039
Total Hb0.03310.24490.09650.0501
S a m p E n H b O 0.06100.14140.09760.1375
S a m p E n H b 0.08910.28440.01010.0262
S a m p E n T o t a l 0.20130.25280.05010.0554
S a m p E n c o n c a t 0.04080.11470.01060.1735
F u z z y E n H b O 0.09340.00230.05010.0219
F u z z y E n H b 0.01450.01060.05560.0408
* F u z z y E n T o t a l 0.07080.00510.02430.0243
* F u z z y E n c o n c a t 0.02190.00780.17350.0078
D i s t E n H b O 0.66580.17350.11470.1619
D i s t E n H b 0.12720.01150.07090.2209
D i s t E n T o t a l 0.08710.05010.14110.0874
D i s t E n c o n c a t 0.04080.16190.01180.0408

Share and Cite

MDPI and ACS Style

Ghouse, A.; Nardelli, M.; Valenza, G. fNIRS Complexity Analysis for the Assessment of Motor Imagery and Mental Arithmetic Tasks. Entropy 2020, 22, 761. https://doi.org/10.3390/e22070761

AMA Style

Ghouse A, Nardelli M, Valenza G. fNIRS Complexity Analysis for the Assessment of Motor Imagery and Mental Arithmetic Tasks. Entropy. 2020; 22(7):761. https://doi.org/10.3390/e22070761

Chicago/Turabian Style

Ghouse, Ameer, Mimma Nardelli, and Gaetano Valenza. 2020. "fNIRS Complexity Analysis for the Assessment of Motor Imagery and Mental Arithmetic Tasks" Entropy 22, no. 7: 761. https://doi.org/10.3390/e22070761

APA Style

Ghouse, A., Nardelli, M., & Valenza, G. (2020). fNIRS Complexity Analysis for the Assessment of Motor Imagery and Mental Arithmetic Tasks. Entropy, 22(7), 761. https://doi.org/10.3390/e22070761

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop