Next Article in Journal
Changing the Geometry of Representations: α-Embeddings for NLP Tasks
Next Article in Special Issue
Empirical Mode Decomposition-Derived Entropy Features Are Beneficial to Distinguish Elderly People with a Falling History on a Force Plate Signal
Previous Article in Journal
Study of Wound Healing Dynamics by Single Pseudo-Particle Tracking in Phase Contrast Images Acquired in Time-Lapse
Previous Article in Special Issue
On Entropy of Probability Integral Transformed Time Series
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Conditional Entropy: A Potential Digital Marker for Stress

Advanced Telecommunications Research Institute International (ATR), Kyoto 619-0237, Japan
Entropy 2021, 23(3), 286; https://doi.org/10.3390/e23030286
Submission received: 27 January 2021 / Revised: 20 February 2021 / Accepted: 23 February 2021 / Published: 26 February 2021
(This article belongs to the Special Issue Entropy in Biomedical Applications)

Abstract

:
Recent decades have witnessed a substantial progress in the utilization of brain activity for the identification of stress digital markers. In particular, the success of entropic measures for this purpose is very appealing, considering (1) their suitability for capturing both linear and non-linear characteristics of brain activity recordings and (2) their direct association with the brain signal variability. These findings rely on external stimuli to induce the brain stress response. On the other hand, research suggests that the use of different types of experimentally induced psychological and physical stressors could potentially yield differential impacts on the brain response to stress and therefore should be dissociated from more general patterns. The present study takes a step toward addressing this issue by introducing conditional entropy (CE) as a potential electroencephalography (EEG)-based resting-state digital marker of stress. For this purpose, we use the resting-state multi-channel EEG recordings of 20 individuals whose responses to stress-related questionnaires show significantly higher and lower level of stress. Through the application of representational similarity analysis (RSA) and K-nearest-neighbor (KNN) classification, we verify the potential that the use of CE can offer to the solution concept of finding an effective digital marker for stress.

1. Introduction

Stress depletes our capacity for reasoning [1,2,3] via strengthening the memories of stressful experiences [4,5,6] and reinforcing the state of fearful arousal that urges the need for rapid defense mechanisms [7,8,9]. With its far reaching impact [10], it is not only a major underlying cause of many emotional disorders [11], but also one of the top leading causes of death in the human population [12]. It is apparent that finding effective diagnostic markers for stress can significantly improve our ability for the intervention and treatment of stress-related mental health problems that affect over 400 million individuals globally [13].
Recent decades have witnessed a substantial progress in the identification of stress markers through the utilization of measurable bodily responses [14,15,16,17,18,19,20,21,22,23]. For instance, Smets et al. [24] used individuals’ demographics, baseline psychological information, and five consecutive days of free-living physiological and contextual measurements to derive a digital phenotype that could predict their high depression, anxiety, and stress scores. In the same vein, Jacobson and colleagues [25] utilized actigraphy data from healthy individuals on the one hand and patients with major depressive and bipolar disorders on the other hand to report a high prediction accuracy (89.0%) on patients’ status. Their results also suggested that actigraphy data may establish reliable measures for predicting changes in patients’ symptoms across a two-week period.
Considering the ample evidence of the negative impact of stress on large-scale brain networks [26,27], the utilization of brain activity presents a unique opportunity for the identification of effective stress markers [28,29]. For example, Zhang et al. [30] used pre- and post-stress functional magnetic resonance imaging (fMRI) scans to devise a data-driven discriminative spatial linear filtering. They reported a high (>75.0%) pre- versus post-stress state prediction accuracy. Their data-driven approach also confirmed the involvement of the default mode network (DMN) and the salient-network (SN) in the brain stress response [31,32,33]. However, the use of fMRI limits the applicability of their approach in more naturalistic settings. The search for effective brain-based stress markers can undoubtedly benefit from the use of EEG, given its relative ease-of-use, portability, and potentials for the study and analysis of brain function [34,35,36,37].
A growing number of EEG-based studies have provided promising results on the utility of this technology for the solution concept of a digital marker for stress. For example, Peng et al. [38] used EEG recordings from human subjects with high versus moderate stress symptoms. They showed that the brain activity of the individuals with high chronic stress was associated with higher left prefrontal power. However, their observations were limited by the fact that they solely focused on EEG recordings from three prefrontal sites (Fp1, Fp2, and Fpz). Minguillon et al. [39] conducted a study based on stress and relaxation periods on six healthy subjects who performed the Montreal Imaging Stress Task (MIST). They observed correlations between prefrontal relative gamma power (RG) and the expected stress level and with the heart rate (HR). They also observed that RG showed a higher discriminative power than alpha asymmetry, theta, alpha, beta, and gamma power in prefrontal cortex (PFC). Using the mental arithmetic (MA) task with three different levels of difficulty, Al-Shargie and colleagues [40] showed that there were significant differences in EEG response between the control and stress conditions. They further utilized multi-class support vector machine (SVM) and reported a high stress level classification accuracy (94.79%). Jebelli et al. [41] proposed a real-time EEG-based stress classification approach based on the online multitask learning (OMTL) paradigm [42]. They reported high stress prediction accuracy on two datasets: a publicly available dataset of EEG and peripheral physiological signals of 32 participants who watched 40 one-minute long excerpts of music videos (DEAP [43], 71.14%) and a dataset from three real construction sites [44] (77.61%).
Entropic measures have also manifested as a robust feature for the study and analysis of the individuals’ mental states [45,46,47,48]. For example, Zheng and Lu [49] showed that the use of entropy for EEG-based emotion classification outperformed such feature spaces as differential asymmetry (DASM), rational asymmetry (RASM), and power spectral density (PSD). García-Martínez et al. [50] used DEAP to compare the utility of sample entropy (SE), quadratic SE (QSE), and distribution entropy (DE) for calm versus distressed mental state discrimination. They found that QSE was able to identify distress with high accuracy (≈70.0%), which was further improved (≈80.0%) using tree-based classification. Martínez-Rodrigo and colleagues [51] applied delayed permutation entropy (DPE) (an extension of amplitude-aware permutation entropy (AAPE) [52]) and permutation min-entropy (PME) [53] on the DEAP dataset for EEG-based distress recognition. Their results indicated that calmness was associated with higher entropy values than distress. García-Martínez et al. [54] studied the use of conditional entropy (CEn) and its correction (CCEn) for the classification of calm versus distress. They reported ≈65.0% discriminative power of CCEn, which was similar and complementary to the previous results based on QSE [50]. The use of CCEn and QSE in their study also suggested a synchronization between opposite frontal and parietal brain regions in both hemispheres in which an increase in distress was associated with an increase in irregular activity in left frontal and right parietal areas.
The overview of the literature on the use of brain activity for the identification of a stress marker shows a substantial progress in this direction. In particular, the use of entropic measures [50,51,54] is very appealing, considering (1) their suitability for capturing both linear and non-linear characteristics of EEG time series [55] and (2) their direct correspondence with brain signal variability [47,56,57,58,59,60,61]. At the same time, these findings rely on external stimuli to induce the brain stress response. In this respect, Van Oort et al. [27] observed that the use of different types of experimentally induced psychological and physical stressors by most previous studies could potentially yield differential impacts on the brain response to stress. They further asserted that such variations must be dissociated from more (potentially) general patterns.
The present study takes a step toward addressing this issue by introducing conditional entropy (CE) as a potential EEG-based resting-state digital marker of stress. For this purpose, we use the resting-state EEG recordings of human subjects from the Max Planck Institute Leipzig Mind-Brain-Body Dataset [62]. The participants in this study did not perform any stress-related task and only completed the Multidimensional Mood State (MDBF) questionnaire [63] prior to their resting-state EEG recordings (five-point Likert scale, from one (not at all) to five (very much) [62]).
The contribution of the present study is twofold. First, we extend the previous research that was based on brain stress response to psychological and physical stressors to the case of resting-state brain activity. In so doing, we show that CE highlights the effect of stress on the brain’s frontoparietal network [64], which plays a pivotal role in self-referential processing [65], emotion [66], and social cognition [67]. Second, we show that CE presents an effective EEG-based resting-state digital marker for quantification of the brain’s distributed response to stress.
The remainder of this article is organized as follows. Section 2 provides details on the dataset, resting-state EEG recordings, and their pre-processing. Section 3 summarizes the analysis steps adapted in the present study. Section 4 presents the results. A discussion along with the limitations and future direction of the present study are presented in Section 5 and Section 6.

2. Materials and Methods

2.1. Dataset

In the present study, we used the Max Planck Institute Leipzig Mind-Brain-Body Dataset [62]. It is comprised of 227 participants in two age groups: the younger group (153 participants, 45 females, age: mean (M) = 25.1, median (Mdn) = 24.0, standard deviation (SD) = 3.1) and the older group (74 participants, 37 females, age: Mdn = 67.0, M = 67.6, SD = 4.7). The individuals in this dataset underwent a comprehensive set of neurophysiological (from fMRI and EEG to cardiovascular measures, blood samples, urine drug tests, etc.) and psychological tests (including 6 cognitive tests and 21 questionnaires on personality traits and tendencies, eating, addictive and emotional behavior, etc.). The resting-state EEG recordings were acquired from 216 (age: M = 38.61, Mdn = 30.0, SD = 20.14) out of 227 participants. It is this subset of 216 individuals that was used in the present study.

2.2. EEG Acquisition

The sixty-two-channel resting-state EEG recordings (61 scalp and a VEOGelectrode below the right eye) were arranged according to the 10–20 extended localization system (also known as the 10–10 system [68]) and referenced to FCz. The EEG signals were bandpass filtered between 0.015 Hz and 1 kHz and further digitized at a 2500 Hz sampling rate. Each EEG session, per participant, was comprised of 16 blocks with two resting-state settings: eyes-closed (EC) and eyes-open (EO). Each EC and EO setting consisted of 8 blocks with a 60 s duration, per block. Every participant completed these two resting-state EEG recordings. For every participant, the EEG recording session started with EC.

2.3. EEG Pre-Processing

The raw EEG was first down-sampled from 2500 Hz to 250 Hz and subsequently bandpass filtered within 1–45 Hz using an eight-order Butterworth filter (i.e., four orders in both directions to minimize zero-crossing distortions by low-frequency drifts [69]). The data were then split into EC and EO, each comprised of eight 60 s blocks. For each of these blocks, the EEG channels were visually inspected, and the channels that were affected by such issues as frequent jumps/shifts in voltage and/or poor signal quality were rejected. Furthermore, data intervals that contained extreme peak-to-peak deflections or large bursts of high-frequency activity were also removed (identified through visual inspection). Next, the dimensionality of the data (i.e., the EEGs’ channel-dimension) was reduced by performing principal component analysis (PCA) and keeping PCs (≥30) that explained 95.0% of the variance. This step was then followed by independent component analysis (ICA) on the temporal (i.e., the EEG channels’ data points) dimension of the data using the Infomax (runica) algorithm (step size: 0.00065 l o g ( n u m b e r o f c h a n n e l s ) , annealing policy: when the weight change > 0.000001, the learning rate was multiplied by 0.98, the stopping criterion maximum number of iterations was 512, or the weight change < 0.000001). Subsequently, components that reflected eye movement, eye blink, or heartbeat-related artifacts were removed. Retained independent components for the EO (M = 19.70, range = 9.0–30.0) and EC (M = 21.40, range = 14.0–28.0) conditions were then back-projected to the sensor space for further analysis. These analyses were performed using EEGLAB [70] (Version 14.1.1b) for MATLAB (Delorme and Makeig, 2004).
In the present study, we used participants’ EC trials. In addition to the above pre-processing steps, we also detrended (using MATLAB 2016a’s inbuilt detrend function) the EEG signals, per participant, per channel, prior to any further computation and analysis.

2.4. Choice of Individuals with High and Low Stress Responses

We used individuals’ responses to “neuroticism” from the big-five of personality (also known as the five-factor model (FFM) [71]), “worries” and “tension” from the Perceived Stress Questionnaire (PSQ) [72], and the State-Trait Anxiety Inventory (STAI-G-X2) [73] to systematically identify those whose responses to these questionnaires indicated a significantly higher and lower level of stress.
We found that 40 participants (i.e., out of 216 that were included in the present study; Section 2.1) missed at least one of these responses. Therefore, we discarded these 40 participants. This brought the total number of individuals that were included in our study to 176.
For these participants, we determined the 95.0% confidence interval of their responses to each of FFM’s “neuroticism”, PSQ’s “worries” and “tension”, and STAI-G-X2’s “state-trait anxiety” (Appendix A, Table A1). We then marked those participants, per item, whose responses to all of four items were strictly below the lower bound of the respective item-wise CI (i.e., p < 0.025). Similarly, we identified those individuals whose responses were strictly above the upper bound of these items’ CI. We labeled these participants as LOW (14 participants) and HIGH
Further investigation of these groups indicated that there were only one older male (age range, 60–65) in the HIGH and one older male (age range, 70–75) in the LOW groups. Additionally, we also observed that there was only one younger female (age range, 30–35) in the LOW group. Therefore, we decided to discard the older participants and the female participants from our further analyses. This resulted in discarding 4 participants from the LOW group (one older male, one younger female, and two older females). After this step, the total number of participants in the LOW group became 10 (age range: Mdn = 20–25, M = 28–33, SD = 14.38–14.38). In the case of the HIGH group, we discarded seven younger females and one older male, bringing the total number to 18.
We balanced the number of individuals in the HIGH and LOW groups as follows. First, we formed a 1 × 4 questionnaire-response vector (one entry per neuroticism, worries, tension, and STAI trait anxiety) for each participant in the HIGH group. To account for the varying scale among these items, we z-score normalized these vectors and then computed their all-pair Euclidean distances. Last, we chose 10 participants from the HIGH group whose Euclidean distances between their questionnaire-response vectors were smallest (age range: Mdn = 20–25, M = 21–26, SD = 2.11–2.11).

2.5. EEG Channels’ Inclusion

The pre-processing steps that were applied on the EEG recordings’ channel dimension (i.e., PCA pre-processing step; Section 2.3) resulted in missing EEG channels in the case of some of the participants. To balance the EEG channels for all participants, we therefore checked for the EEG channels that were common among all 20 individuals in the HIGH and LOW groups. We found (Figure 1) that 53 EEG channels were commonly available in all participants’ pre-processed EEG. These channels were FP2, AF7, AF3, AFZ, AF4, AF8, C5, C3, C1, Cz, C2, C4, C6, CP5, CP3, CP1, CPZ, CP2, CP4, F5, F3, FZ, F1, F2, F4, F6, F8, FT7, FC5, FC3, FC1, FC2, FC4, FC6, FT8, P7, P5, P3, P1, PZ, P2, P4, P6, P8, PO9, PO7, POZ, PO3, PO4, PO8, and O1, OZ, O2.

2.6. Conditional Entropy Computation

Let X and Y represent two EEG channels. The conditional entropy (CE) of X given Y, represented as H(X|Y), is computed as [74]:
H ( X | Y ) = y Y p ( x ) H ( X | Y = y ) = y Y x X p ( x , y ) l o g ( p ( x | y ) )
CE quantifies the amount of uncertainty that remains about X (i.e., its information content) when Y is known/observed. Equivalently, the CE of X given Y can be computed based on the relation between the amount of information that is shared by X and Y (i.e., their mutual information (MI)) and X’s entropy [74]:
M I ( X ; Y ) = H ( X ) H ( X | Y ) H ( X | Y ) = H ( X ) M I ( X ; Y )
where H(X) and MI(X;Y) are the X’s entropy and the mutual information between X and Y.
We used Equation (2) to compute the expected CE for each EEG recording (53 channels), per participant in the HIGH and LOW groups. Specifically, for each EEG channel c i , i = 1 , , 53 , we computed its expected CE as:
C E ( c i ) = 1 N j H ( c i | c j ) , j = 1 , , N , j i
where N = 53 is the number of EEG channels (Figure 1). Therefore, C E ( c i ) in Equation (3) quantifies the average information content in EEG channel c i after all its pairwise conditional entropy values with respect to the remaining EEG channels (i.e., all information in c i that could be explained by observing c j , j = 1 , N , j i channels) are accounted for.

3. Analysis

First, we performed representational similarity analysis (RSA) [75,76] with Pearson correlation as the similarity distance on the HIGH and LOW groups. For this test, each participant was represented by a 1 × 53 vector whose entries corresponded to the CE values of their EEG recordings. To determine whether the CE vectors could distinguish between the HIGH and LOW groups, we then used these vectors and applied the KNN classifier with one-holdout on them. This resulted in 20 rounds of KNN classification in which every participant was held-out as a test once, and KNN was trained on the remaining 19 participants’ data.
Next, we investigated the contribution of each EEG channel to the classification of the HIGH and LOW groups. For this purpose, we performed permutation importance [77] on the KNN classifier. We then recalculated the RSA and KNN results from the first step using the reduced number of channels based on permutation importance outcome. We used scikit-learn [78] for KNN and permutation importance (i.e., “permutation_importance”). RSA analyses were carried out in MATLAB.
We computed CE values using the Python version of JIDT [79]. With regard to CE computation, there is a crucial point that deserves further explanation. While computing the CE, it is possible to opt for parametric approaches, thereby bypassing the estimation of the joint and conditional probabilities in Equation (1) and instead utilizing available analytical forms. For instance, assuming X and Y are Gaussian random variables, then one could make use of H ( X ) = 0.5 × log ( 2 π e σ X 2 ) [74] (p. 244), H ( Y ) = 0.5 × log ( 2 π e σ Y 2 ) , and M I ( X , Y ) = 0.5 × log ( 1 ρ 2 ) [74] (p. 252) (where σ X 2 and σ Y 2 are the X and Y respective variance and ρ 2 denotes their correlation) to compute their CE. However, such an approach would inevitably require an assumption about the shape of the underlying probability densities of the random variables under consideration (e.g., the Gaussianity of X and Y in the above example) [80]. To avoid imposing such a constraint/assumption on our data, we opted for non-parametric estimation of the CE [79]. When using such non-parametric estimators, a crucial step is to verify whether the observed non-zero estimates are due to such issues as limited data and/or non-stationarity that could be present in time series. Therefore, it is important to ensure that the observed non-zero entropy values are indeed significant through the application of the permutation test on the surrogate data during their computation [55]. We achieved this objective through the “null distribution and statistical significance” functionality that is available in JIDT [79] using 100 rounds of permutation tests (computeSignificance(100) in JIDT).

4. Results

Figure 2 shows the grand average topographic map of the HIGH and LOW groups’ CE values. The computed CEs for the LOW group highlight the brain’s frontoparietal network. On the other hand, these values appear to be dispersed in the case of the HIGH group.
Pairwise RSA with Pearson correlation similarity distance indicated that (Figure 3A) the HIGH and LOW groups were associated with two distinct clusters. We observed significant correlations within the HIGH (r: M = 0.6011, SD = 0.2220, Mdn = 0.6429, p: M = 0.0307, SD = 0.1896, Mdn = 0.0222) and LOW (r: M = 0.6269, SD = 0.1697, Mdn = 0.6198, p: M = 0.0109, SD = 0.0322, Mdn = 0.0005) groups with a non-significant correlation between the HIGH and LOW groups (r: M = −0.0374, SD = 0.1849, Mdn = −0.0529, p: M = 0.4751, SD = 0.2611, Mdn = 0.4728). Figure 3B shows the distribution of Pearson’s “r” for within the HIGH, within the LOW, and the HIGH versus LOW groups.
Using KNN with one-holdout cross-validation, we were able to correctly predict every individuals’ membership in the HIGH and LOW groups.
Figure 4 shows the result of permutation importance on KNN. This test identified 27 channels whose contributions were important for the HIGH versus LOW groups’ classification. These channels were located in the frontal (Fp2, AF4, AFz, F1, Fz, F3, F5, F6), frontotemporal (FT7), central (C2, C6, Cz), centroparietal (CP1, CP3, CP4, CP5, CPz), parietal (P2, P3, P4, P5, P6, P7), parieto-occipital (PO3, PO4, POz), and occipital (O2) cortical regions. We also observed that 10 out these 27 channels had their importance > the average importance calculated by the permutation importance test (M = 0.0369, CI 95.0 % = [0.0227 0.0534]). These channels were in the frontal (AF4, F1, F6, Fz), centroparietal (CP3, CPz), parietal (P2, P3, P7), and occipital (O2) cortical regions.
Pairwise RSA with Pearson correlation similarity distance on these 10 channels (Figure 5A) resulted in improved distinction between the HIGH and LOW groups’ clusters. We observed significant correlations within the HIGH (r: M = 0.6971, SD = 0.2203, Mdn = 0.7416, p: M = 0.0184, SD = 0.0830, Mdn = 0.0003) and LOW (r: M = 0.7889, SD = 0.1180, Mdn = 0.8005, p: M = 0.0241, SD = 0.0313, Mdn = 0.0095) groups. Although the use of these channels increased the anti-correlation between the HIGH and LOW groups (r: M = −0.3393, SD = 0.1863, Mdn = −0.3504, p: M = 0.4139, SD = 0.2642, Mdn = 0.3551), it remained non-significant. Figure 5B shows the distribution of Pearson’s r for within the HIGH, within the LOW, and the HIGH versus LOW groups.
Interestingly, these 10 channels were sufficient for KNN with one-holdout cross-validation to correctly predict every individuals’ membership in the HIGH and LOW groups.

5. Discussion

The present study took a preliminary step toward the identification of an EEG-based resting-state digital marker for stress. In so doing, it utilized multi-channel, eye-closed, resting-state EEG recordings of 20 individuals who were chosen from a pool of 216 participants from the Max Planck Institute Leipzig Mind-Brain-Body Dataset [62]. These 20 individuals were those whose responses to “neuroticism” (FFM [71]), “worries” and “tension” (PSQ [72]), and the State-Trait Anxiety Inventory (STAI-G-X2 [73]) indicated a significantly higher and lower level of stress (10 individuals, per the HIGH and LOW groups), compared to all other participants.
The computed conditional entropy (CE) for EEG channels appeared to highlight the brain’s frontoparietal network [64]. This network, which is considered to form a domain-general network [81,82], plays a pivotal role in various brain functions [83,84]: from self-referential processing [65] and emotion [66] to social cognition [67], decision making [85], and working memory [86]. Therefore, it seems plausible to construe the observed sparsity of CEs pertinent to the components of this network in the HIGH group to highlight the potential impact of stress on their overall brain cognitive ability for handling various personal and social life events [11,87]. This interpretation gives further evidence from the finding that indicates the dampening effect of stress on higher level cognitive functions [31,33]. Moreover, the distribution of computed CEs appeared to identify the cortical components of the default mode network (DMN) [88,89,90]. This observation was interesting, considering the involvement of this network in the brain’s stress response [27,64,91,92].
The CE also appeared to be an effective EEG-based marker for stress. It not only captured the potential correlation among the members of the same stress group, but also showed a reliable specificity for distinguishing between individuals from the HIGH versus LOW groups. These observations presented further insight for the underlying relation between the entropic measures on the one hand and the brain signal variability on the other hand [56,57,58,59,60,61]. They also provided further evidence for recent findings [47] that showed that information from cortical entropy profiles could effectively predict diverse facets of human subjects’ cognitive ability.
Zhang et al. [30] also presented a high classification accuracy of pre- versus post-stress using the resting-state functional connectivity of healthy individuals. The present results extended their study to the case of EEG, thereby providing an alternative to the limited applicability of fMRI in more naturalistic settings. They also showed the potential of the CE as a reliable marker for detecting the effect of stress on brain function in the absence of any explicit stressors.
From a broader perspective, our results posit the use of the CE as a potential EEG-based diagnostic marker of the stress. For instance, the CE can help identify the individuals that are at higher risk of stress-related neuropsychological disorders. Subsequently, it may also prove useful for tracking the effect of stress-related treatments on these patients through quantification of the changes in the pattern of cortical information processing in comparison with healthy individuals.

6. Limitations and Future Direction

The present study did not include female participants due to their limited number in the final selected HIGH and LOW groups’ members. Lighthall et al. [93] and Seo et al. [94] showed the differential effect of participants’ gender on the brain response to stress. This necessitates further investigation of our findings in settings in which both male and female (as well as more gender-diverse individuals) are included. Similarly, the present study excluded older adults since their limited number (i.e., one individual in each of the LOW and HIGH stress groups) was not sufficient to verify whether the observed results were due to stress or the effect of aging on reduced complexity and information processing capacity of the brain [95,96]. As a result, it is crucial to consider the sample population that was comprised of older people, as well as adolescents [2,91] to draw more informed conclusions on the change in cortical information processing in response to stress.
Our approach to selecting the individuals for the present study primarily focused on those participants whose responses formed the two extremes of the stress spectrum, i.e., the HIGH and LOW groups. This meant that we were not able to verify whether the differences in the CEs were due to the significantly different mindsets of the HIGH versus LOW groups (as far as their subjective responses to the questionnaires were concerned) or it rather captured a substantial change in the brain functions whose gradual effect could be traced along the stress-effect spectrum. Considering the findings that identified the individuals’ subjective ratings to best predict their distress across a variety of self-reported measures [97], future research can broaden the scope of the present study to the case in which individuals with broader stress responses are included. This, in turn, can allow for more informed conclusions on the generalizability of the observed differences between the HIGH and LOW stress groups to a more inclusive scenario in which a wider range of stress responses is considered. Such studies can benefit from the application of advanced clustering algorithms such as the successive geometrical transformations model (SGTM) neural-like structure [98,99,100] that show promising results for medical images’ pre-processing, classification, and recognition.
Pairwise computation and analysis of information-theoretic measures in a system with multiple interacting processes are subject to several shortcomings (Wibral et al. [55], pp. 24–25). These observations demonstrate the need for surpassing the bivariate formulation (i.e., pairwise correspondences, as presented in the present study) of such entropic measures as the conditional entropy, thereby studying the brain information processing in light of all its interacting components. Although there is no constraint that would limit the extension of the bivariate case to the case of multivariate analysis of the brain information processing, the exponential growth in computational cost associated with such multivariate analyses confines their application to more practical and affordable scenarios such as the study of binary circuits [101] and neural cultures [102]. On the other hand, the on-going efforts and progress for devising efficient tools for such multivariate analyses of brain function [103] bring hope for their possibilities in the future.

Funding

This work was supported by the Japan Society for the Promotion of Science (JSPS) KAKENHI Grant Number JP19K20746.

Institutional Review Board Statement

This study was carried out in accordance with the recommendations of the Ethical Committee of the Advanced Telecommunications Research Institute International (ATR) (approval code: 19-501-4).

Informed Consent Statement

Not applicable.

Data Availability Statement

Data related to the present study is available at http://fcon_1000.projects.nitrc.org/indi/retro/MPI.html, accessed on 25 February 2021 and [62].

Conflicts of Interest

The author declares no conflict of interest. The funder had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; nor in the decision to publish the results.

Appendix A. Descriptive Statistics of Participants’ Responses to Each of FFM’s Neuroticism, PSQ’s Worries and Tension, and STAI-G-X2’s State-Trait Anxiety

Table A1. The mean (M), standard deviation (SD), 95.0% confidence interval (CI 95.0 % ), and minimum and maximum score of participants’ responses to neuroticism (NEOFFI), worries and tension (Perceived Stress Questionnaire (PSQ)), and the State-Trait Anxiety Inventory’s trait anxiety (STAI-G-X2).
Table A1. The mean (M), standard deviation (SD), 95.0% confidence interval (CI 95.0 % ), and minimum and maximum score of participants’ responses to neuroticism (NEOFFI), worries and tension (Perceived Stress Questionnaire (PSQ)), and the State-Trait Anxiety Inventory’s trait anxiety (STAI-G-X2).
QuestionnaireMSDCI 95.0 % MinimumMaximum
NEOFFI Neuroticism1.530.54[1.44 1.63]0.172.92
PSQ Worries29.1816.49[26.39 32.30]6.6786.67
PSQ Tension31.4817.8[28.52 34.81]6.6793.33
STAI Trait Anxiety31.4817.80[28.58 34.75]6.6793.33

References

  1. Qin, S.; Hermans, E.J.; van Marle, H.J.; Luo, J.; Fernández, G. Acute psychological stress reduces working memory-related activity in the dorsolateral prefrontal cortex. Biol. Psychiatry 2009, 66, 25–32. [Google Scholar] [CrossRef] [PubMed]
  2. Miller, A.B.; Prinstein, M.J. Adolescent suicide as a failure of acute stress response systems. Annu. Rev. Clin. Psychol. 2019, 15, 425–450. [Google Scholar] [CrossRef]
  3. Arnsten, A.F. Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 2009, 10, 410–422. [Google Scholar] [CrossRef] [PubMed]
  4. Joëls, M.; Pu, Z.; Wiegert, O.; Oitzl, M.S.; Krugers, H.J. Learning under stress: How does it work? Trends Cogn. Sci. 2006, 10, 152–158. [Google Scholar] [CrossRef]
  5. Cahill, L.; Prins, B.; Weber, M.; McGaugh, J.L. β-Adrenergic activation and memory for emotional events. Nature 1994, 371, 702–704. [Google Scholar] [CrossRef] [PubMed]
  6. Roozendaal, B.; McEwen, B.S.; Chattarji, S. Stress, memory and the amygdala. Nat. Rev. Neurosci. 2009, 10, 423–433. [Google Scholar] [CrossRef]
  7. De Kloet, E.R.; Joëls, M.; Holsboer, F. Stress and the brain: From adaptation to disease. Nat. Rev. Neurosci. 2005, 6, 463–475. [Google Scholar] [CrossRef]
  8. Van Marle, H.J.; Hermans, E.J.; Qin, S.; Fernández, G. From specificity to sensitivity: How acute stress affects amygdala processing of biologically salient stimuli. Biol. Psychiatry 2009, 66, 649–655. [Google Scholar] [CrossRef] [PubMed]
  9. Panksepp, J. Affective Neuroscience: The Foundations of Human and Animal Emotions; Oxford University Press, Inc.: New York, NY, USA, 2005. [Google Scholar]
  10. Halfon, N.; Larson, K.; Lu, M.; Tullis, E.; Russ, S. Lifecourse health development: Past, present and future. Matern. Child Health J. 2014, 18, 344–365. [Google Scholar] [CrossRef] [Green Version]
  11. Tozzi, L.; Stavel, B.; Holt-Gosselin, B.; Chesnut, M.; Chang, S.E.; Choi, D.; Shiner, M.L.; Wu, H.; Lerma-Usabiaga, G.; Sporns, O.; et al. The human connectome project for disordered emotional states: Protocol and rationale for a research domain criteria study of brain connectivity in young adult anxiety and depression. NeuroImage 2020, 214, 116715. [Google Scholar] [CrossRef]
  12. Cohen, S.; Janicki-Deverts, D.; Miller, G.E. Psychological stress and disease. J. Am. Med. Assoc. 2007, 298, 1685–1687. [Google Scholar] [CrossRef] [PubMed]
  13. Whiteford, H.A.; Degenhardt, L.; Rehm, J.; Baxter, A.J.; Ferrari, A.J.; Erskine, H.E.; Charlson, F.J.; Norman, R.E.; Flaxman, A.D.; Johns, N.; et al. Global burden of disease attributable to mental and substance use disorders: Findings from the Global Burden of Disease Study 2010. Lancet 2013, 382, 1575–1586. [Google Scholar] [CrossRef]
  14. Alberdi, A.; Aztiria, A.; Basarab, A. Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review. J. Biomed. Inform. 2016, 59, 49–75. [Google Scholar] [CrossRef] [PubMed]
  15. Lovallo, W.R. Stress & Health: Biological and Psychological Interactions; Sage Publications: London, UK, 2005. [Google Scholar]
  16. Sharma, N.; Gedeon, T. Objective measures, sensors and computational techniques for stress recognition and classification: A survey. Comput. Methods Programs Biomed. 2012, 108, 1287–1301. [Google Scholar] [CrossRef]
  17. Healey, J.A.; Picard, R.W. Detecting stress during real-world dring tasks using physiological sensors. IEEE Trans. Intell. Transp. Syst. 2005, 6, 156–166. [Google Scholar] [CrossRef] [Green Version]
  18. Muaremi, A.; Arnrich, B.; Tröster, G. Towards measuring stress with smartphones and wearable devices during workday and sleep. Bionanoscience 2013, 3, 172–183. [Google Scholar] [CrossRef] [Green Version]
  19. Hovsepian, K.; Al’Absi, M.; Ertin, E.; Kamarck, T.; Nakajima, M.; Kumar, S. Stress: Towards a gold standard for continuous stress assessment in the mobile environment. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Osaka, Japan, 7–11 September 2015; pp. 493–504. [Google Scholar]
  20. Da Silva, A.W.; Huckins, J.F.; Wang, R.; Wang, W.; Wagner, D.D.; Campbell, A.T. Correlates of stress in the college environment uncovered by the application of penalized generalized estimating equations to mobile sensing data. JMIR mHealth uHealth 2019, 7, e12084. [Google Scholar] [CrossRef] [Green Version]
  21. Ben-Zeev, D.; Scherer, E.A.; Wang, R.; Xie, H.; Campbell, A.T. Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. Psychiatr. Rehabil. J. 2019, 38, 218–226. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Fraccaro, P.; Beukenhorst, A.; Sperrin, M.; Harper, S.; Palmier-Claus, J.; Lewis, S.; van der Veer, S.N.; Peek, N. Digital biomarkers from geolocation data in bipolar disorder and schizophrenia: A systematic review. J. Am. Med. Inform. Assoc. 2019, 26, 1412–1420. [Google Scholar] [CrossRef]
  23. Rezaii, N.; Walker, E.; Wolff, P. A machine learning approach to predicting psychosis using semantic density and latent content analysis. NPJ Schizophr. 2019, 5, 1–12. [Google Scholar] [CrossRef] [Green Version]
  24. Smets, E.; Velazquez, E.R.; Schiavone, G.; Chakroun, I.; D’Hondt, E.; de Raedt, W.; Cornelis, J.; Janssens, O.; van Hoecke, S.; Claes, S.; et al. Large-scale wearable data reveal digital phenotypes for daily-life stress detection. NPJ Digit. Med. 2018, 1, 1–10. [Google Scholar] [CrossRef] [PubMed]
  25. Jacobson, N.C.; Weingarden, H.; Wilhelm, S. Digital biomarkers of mood disorders and symptom change. NPJ Digit. Med. 2019, 2, 1–3. [Google Scholar] [CrossRef] [Green Version]
  26. Bressler, S.L. Large-scale cortical networks and cognition. Brain Res. Rev. 1995, 20, 288–304. [Google Scholar] [CrossRef]
  27. Van Oort, J.; Tendolkar, I.; Hermans, E.J.; Mulders, P.C.; Beckmann, C.F.; Schene, A.H.; Fernández, G.; van Eijndhoven, P.F. How the brain connects in response to acute stress: A review at the human brain systems level. Neurosci. Biobehav. Rev. 2017, 83, 281–297. [Google Scholar] [CrossRef]
  28. Al-Nafjan, A.; Hosny, M.; Al-Ohali, Y.; Al-Wabil, A. Review and classification of emotion recognition based on EEG brain-computer interface system research: A systematic review. Appl. Sci. 2017, 7, 1239. [Google Scholar] [CrossRef] [Green Version]
  29. Martínez-Rodrigo, A.; Garcxixa-Martxixnez, B.; Alcaraz, R.; González, P.; Fernxaxndez-Caballero, A. Multiscale entropy analysis for recognition of visually elicited negative stress from EEG recordings. Int. J. Neural Syst. 2019, 29, 1850038. [Google Scholar] [CrossRef]
  30. Zhang, W.; Llera, A.; Hashemi, M.M.; Kaldewaij, R.; Koch, S.B.; Beckmann, C.F.; Klumpers, F.; Roelofs, K. Discriminating stress from rest based on resting?state connectivity of the human brain: A supervised machine learning study. Hum. Brain Mapp. 2020, 36, 12083–12094. [Google Scholar] [CrossRef] [Green Version]
  31. Hermans, E.J.; Henckens, M.J.; Joëls, M.; Fernández, G. Dynamic adaptation of large-scale brain networks in response to acute stressors. Trends Neurosci. 2014, 37, 304–314. [Google Scholar] [CrossRef]
  32. Hermans, E.J.; van Marle, H.J.; Ossewaarde, L.; Henckens, M.J.; Qin, S.; van Kesteren, M.T.; Schoots, V.C.; Cousijn, H.; Rijpkema, M.; Oostenveld, R.; et al. Stress-related noradrenergic activity prompts large-scale neural network reconfiguration. Science 2011, 334, 1151–1153. [Google Scholar] [CrossRef]
  33. Menon, V. Large-scale brain networks and psychopathology: A unifying triple network model. Trends Cogn. Sci. 2011, 15, 483–506. [Google Scholar] [CrossRef] [PubMed]
  34. Pan, J.; Xie, Q.; Huang, H.; He, Y.; Sun, Y.; Yu, R.; Li, Y. Emotion-related consciousness detection in patients with disorders of consciousness through an EEG-based BCI system. Front. Hum. Neurosci. 2018, 12, 198. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Huang, H.; Xie, Q.; Pan, J.; He, Y.; Wen, Z.; Yu, R.; Li, Y. An EEG-based brain computer interface for emotion recognition and its application in patients with Disorder of Consciousness. IEEE Trans. Affect. Comput. 2019, 2901456. [Google Scholar] [CrossRef]
  36. Charles, F.; de Castro Martins, C.; Cavazza, M. Prefrontal asymmetry BCI neurofeedback datasets. Front. Neurosci. 2020, 14, 601402. [Google Scholar] [CrossRef]
  37. McFarland, D.; Wolpaw, J.R. EEG-based brain-computer interfaces. Curr. Opin. Biomed. Eng. 2017, 4, 194–200. [Google Scholar] [CrossRef] [PubMed]
  38. Peng, H.; Hu, B.; Zheng, F.; Fan, D.; Zhao, W.; Chen, X.; Yang, Y.; Cai, Q. A method of identifying chronic stress by EEG. Pers. Ubiquitous Comput. 2013, 17, 1341–1347. [Google Scholar] [CrossRef]
  39. Minguillon, J.; Lopez-Gordo, M.A.; Pelayo, F. Stress assessment by prefrontal relative gamma. Front. Comput. Neurosci. 2016, 10, 101. [Google Scholar] [CrossRef] [Green Version]
  40. Al-Shargie, F.; Tang, T.B.; Badruddin, N.; Kiguchi, M. Towards multilevel mental stress assessment using SVM with ECOC: An EEG approach. Med. Biol. Eng. Comput. 2018, 56, 125–136. [Google Scholar] [CrossRef] [PubMed]
  41. Jebelli, H.; Khalili, M.M.; Lee, S. A Continuously Updated, Computationally Efficient Stress Recognition Framework Using Electroencephalogram (EEG) by Applying Online Multitask Learning Algorithms (OMTL). IEEE J. Biomed. Health Inform. 2018, 23, 1928–1939. [Google Scholar] [CrossRef]
  42. Saha, A.; Rai, P.; DaumÃ, H.; Venkatasubramanian, S. Online learning of multiple tasks and their relationships. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 11–13 April 2011; pp. 643–651. [Google Scholar]
  43. Koelstra, S.; Muhl, C.; Soleymani, M.; Lee, J.S.; Yazdani, A.; Ebrahimi, T.; Pun, T.; Nijholt, A.; Patras, I. DEAP: A database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 2011, 3, 18–31. [Google Scholar] [CrossRef] [Green Version]
  44. Jebelli, H.; Hwang, S.; Lee, S. EEG-based workers’ stress recognition at construction sites. Autom. Constr. 2018, 93, 315–324. [Google Scholar] [CrossRef]
  45. Carhart-Harris, R.L.; Leech, R.; Hellyer, P.J.; Shanahan, M.; Feilding, A.; Tagliazucchi, E.; Chialvo, D.R.; Nutt, D. The entropic brain: A theory of conscious states informed by neuroimaging research with psychedelic drugs. Front. Hum. Neurosci. 2014, 8, 20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Carhart-Harris, R.L. The entropic brain-revisited. Neuropharmacology 2018, 142, 167–178. [Google Scholar] [CrossRef]
  47. Liu, M.; Liu, X.; Hildebrandt, A.; Zhou, C. Individual cortical entropy profile: Test-retest reliability, predictive power for cognitive ability, and neuroanatomical foundation. Cereb. Cortex Commun. 2020, 1, tgaa015. [Google Scholar] [CrossRef]
  48. Keshmiri, S. Entropy and the Brain: An Overview. Entropy 2020, 22, 917. [Google Scholar] [CrossRef] [PubMed]
  49. Zheng, W.L.; Lu, B.L. Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Ment. Dev. 2015, 7, 162–175. [Google Scholar] [CrossRef]
  50. García-Martínez, B.; Martínez-Rodrigo, A.; Zangroniz-Cantabrana, R.; Pastor-Garcia, J.M.; Alcaraz, R. Application of entropy-based metrics to identify emotional distress from electroencephalographic recordings. Entropy 2016, 18, 221. [Google Scholar] [CrossRef]
  51. Martínez-Rodrigo, A.; Garcxixa-Martxixnez, B.; Zunino, L.; Alcaraz, R.; Fernández-Caballero, A. Multi-lag analysis of symbolic entropies on EEG recordings for distress recognition. Front. Neuroinform. 2019, 13, 40. [Google Scholar] [CrossRef] [Green Version]
  52. Fadlallah, B.; Chen, B.; Keil, A.; Principe, J. Weighted-permutation entropy: A complexity measure for time series incorporating amplitude information. Phys. Rev. E 2013, 87, 022911. [Google Scholar] [CrossRef] [Green Version]
  53. Zunino, L.; Olivares, F.; Rosso, O.A. Permutation min-entropy: An improved quantifier for unveiling subtle temporal correlations. EPL Europhys. Lett. 2015, 109, 10005. [Google Scholar] [CrossRef]
  54. García-Martxixnez, B.; Martxixnez-Rodrigo, A.; Fernandez-Caballero, A.; Moncho-Bogani, J.; Alcaraz, R. Nonlinear predictability analysis of brain dynamics for automatic recognition of negative stress. Neural Comput. Appl. 2020, 32, 13221–13231. [Google Scholar] [CrossRef]
  55. Wibral, M.; Vicente, R.; Lindner, D. Directed Information Measures in Neuroscience, Understanding Complex Systems; Wibral, M., Vicente, R., Lizier, J.T., Eds.; Springer: Berlin/Heidelberg, Germany, 2014. [Google Scholar]
  56. Zhang, Y.C. Complexity and 1/f noise. A phase space approach. J. Phys. I 1991, 1, 971–977. [Google Scholar] [CrossRef]
  57. Haruna, T.; Nakajima, K. Permutation complexity via duality between values and orderings. Phys. D Nonlinear Phenom. 2011, 240, 1370–1377. [Google Scholar] [CrossRef] [Green Version]
  58. Barnett, L.; Bossomaier, T. Transfer entropy as a log-likelihood ratio. Phys. Rev. Lett. 2013, 109, 0138105. [Google Scholar] [CrossRef] [Green Version]
  59. Gao, J.; Hu, J.; Liu, F.; Cao, Y. Multiscale entropy analysis of biological signals: A fundamental bi-scaling law. Front. Comput. Neurosci. 2015, 9, 64. [Google Scholar] [CrossRef] [Green Version]
  60. Keshmiri, S.; Sumioka, H.; Okubo, M.; Ishiguro, H. An Information-Theoretic Approach to Quantitative Analysis of the Correspondence Between Skin Blood Flow and Functional Near-Infrared Spectroscopy Measurement in Prefrontal Cortex Activity. Front. Neurosci. 2018, 13, 79. [Google Scholar] [CrossRef] [Green Version]
  61. Keshmiri, S.; Sumioka, H.; Yamazaki, R.; Ishiguro, H. Differential Entropy Preserves Variational Information of Near-Infrared Spectroscopy Time Series Associated with Working Memory. Front. Neuroinform. 2018, 12, 33. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Babayan, A.; Erbey, M.; Kumral, D.; Reinelt, J.D.; Reiter, A.M.; Röbbig, J.; Schaare, H.L.; Uhlig, M.; Anwander, A.; Bazin, P.L.; et al. A mind-brain-body dataset of MRI, EEG, cognition, emotion, and peripheral physiology in young and old adults. Sci. Data 2019, 6, 180308. [Google Scholar] [CrossRef]
  63. Steyer, R.; Schwenkmezger, P.; Notz, P.; Eid, M. Der Mehrdimensionale Befindlichkeitsfragebogen; Hogrefe: Göttingen, Germany, 1997. [Google Scholar]
  64. Van Oort, J.; Kohn, N.; Vrijsen, J.N.; Collard, R.; Duyser, F.A.; Brolsma, S.C.A.; Fernandez, G.; Schene, A.H.; Tendolkar, I.; van Eijndhoven, P.F. Absence of default mode downregulation in response to a mild psychological stressor marks stress-vulnerability across diverse psychiatric disorders. Neuroimage Clin. 2020, 25, 102176. [Google Scholar] [CrossRef]
  65. Northoff, G. Is emotion regulation self-regulation? Trends Cogn. Sci. 2006, 9, 408–409. [Google Scholar] [CrossRef] [PubMed]
  66. Lindquist, K.A.; Wager, T.D.; Kober, H.; Bliss-Moreau, E.; Barrett, L.F. The brain basis of emotion: A meta-analytic review. Behav. Brain Sci. 2012, 35, 121–143. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  67. Forbes, C.E.; Grafman, J. The role of the human prefrontal cortex in social cognition and moral judgment. Annu. Rev. Neurosci. 2010, 33, 299–324. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Oostenveld, R.; Praamstra, P. The five percent electrode system for high-resolution EEG and ERP measurements. Clin. Neurophysiol. 2001, 112, 713–719. [Google Scholar] [CrossRef]
  69. Schaworonkow, N.; Nikulin, V.V. Spatial neuronal synchronization and the waveform of oscillations: Implications for EEG and MEG. PLoS Comput. Biol. 2019, 15, e1007055. [Google Scholar] [CrossRef] [Green Version]
  70. Delorme, A.; Makeig, S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics. J. Neurosci. Methods 2004, 134, 9–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  71. Goldberg, L.R. An alternative “description of personality”: The big-five factor structure. J. Personal. Soc. Psychol. 1990, 59, 1216–1229. [Google Scholar] [CrossRef]
  72. Levenstein, S.; Prantera, C.; Varvo, V.; Scribano, M.L.; Berto, E.; Luzi, C.; Andreoli, A. Development of the Perceived Stress Questionnaire: A new tool for psychosomatic research. J. Psychosom. Res. 1993, 37, 19–32. [Google Scholar] [CrossRef]
  73. Spielberger, C.D.; Gorsuch, R.L.; Luschene, R.E. Manual for the State-Trait Anxiety Inventory. Manual for the State-Trait Anxiety Inventory; Consulting Psychologists Press: Mountain View, CA, USA, 1970. [Google Scholar]
  74. Cover, T.M.; Thomas, J.A. Elements of Information Theory, 2nd ed.; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2006. [Google Scholar]
  75. Kriegeskorte, N.; Mur, M.; Bandettini, P.A. Representational similarity analysis-connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2008, 2, 4. [Google Scholar] [CrossRef] [Green Version]
  76. Kriegeskorte, N.; Kievit, R.A. Representational geometry: Integrating cognition, computation, and the brain. Trends Cogn. Sci. 2013, 17, 401–412. [Google Scholar] [CrossRef] [Green Version]
  77. Breiman, L. Random forest. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  78. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  79. Lizier, J.T. JIDT: An information-theoretic toolkit for studying the dynamics of complex systems. Front. Robot. AI 2014, 1, 11. [Google Scholar] [CrossRef] [Green Version]
  80. Xiong, W.; Faes, L.; Ivanov, P.C. Entropy measures, entropy estimators, and their performance in quantifying complex dynamics: Effects of artifacts, nonstationarity, and long-range correlations. Phys. Rev. E 2017, 95, 062114. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  81. Dosenbach, N.U.; Visscher, K.M.; Palmer, E.D.; Miezin, F.M.; Wenger, K.K.; Kang, H.C.; Burgund, E.D.; Grimes, A.L.; Schlaggar, B.L.; Petersen, S.E. A core system for the implementation of task sets. Neuron 2006, 50, 799–812. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  82. Van Snellenberg, J.X.; Wager, T.D. Cognitive and motivational functions of the human prefrontal cortex. In Luria’s Legacy in the 21st Century; Goldberg, E., Bougakov, D., Eds.; Oxford University Press: New York, NY, USA, 2009. [Google Scholar]
  83. Yamashita, M.; Yoshihara, Y.; Hashimoto, R.; Yahata, N.; Ichikawa, N.; Sakai, Y. A prediction model of working memory across health and psychiatric disease using whole-brain functional connectivity. ELife 2018, 7, e38844. [Google Scholar] [CrossRef]
  84. Avery, E.W.; Yoo, K.; Rosenberg, M.D.; Greene, A.S.; Gao, S.; Na, D.L.; Scheinost, D.; Constable, T.R.; Chun, M.M. Distributed Patterns of Functional Connectivity Predict Working Memory Performance in Novel Healthy and Memory-impaired Individuals. J. Cogn. Neurosci. 2019, 7, 1–15. [Google Scholar] [CrossRef] [PubMed]
  85. Krain, A.L.; Wilson, A.M.; Arbuckle, R.; Castellanos, F.X.; Milham, M.P. Distinct neural mechanisms of risk and ambiguity: A meta-analysis of decisionmaking. NeuroImage 2006, 32, 477–484. [Google Scholar] [CrossRef]
  86. Owen, A.M.; McMillan, K.; Laird, A.R.; Bullmore, E. N-Back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Hum. Brain Mapp. 2005, 25, 46–59. [Google Scholar] [CrossRef] [Green Version]
  87. Arias, J.A.; Williams, C.; Raghvani, R.; Aghajani, M.; Baez, S.; Belzung, C.; Booij, L.; Busatto, G.; Chiarella, J.; Fu, C.H.; et al. The Neuroscience of Sadness: A Multidisciplinary Synthesis and Collaborative Review for the Human Affectome Project. Neurosci. Biobehav. Rev. 2020, 111, 199–228. [Google Scholar] [CrossRef]
  88. Raichle, M.E.; MacLeod, A.M.; Snyder, A.Z.; Powers, W.J.; Gusnard, D.A.; Shulman, G.L. A default mode of brain function. Proc. Natl. Acad. Sci. USA 2001, 98, 676–682. [Google Scholar] [CrossRef] [Green Version]
  89. Buckner, R.L.; Andrews-Hanna, J.R.; Schacter, D.L. The brain’s default network: Anatomy, function, and relevance to disease. Ann. N. Y. Acad. Sci. Year Cogn. Neurosci. 2008, 1124, 1–38. [Google Scholar] [CrossRef] [Green Version]
  90. Andrews-Hanna, J.R. The brain’s default network and its adaptive role in internal mentation. Neuroscientist 2012, 18, 251–270. [Google Scholar] [CrossRef]
  91. Viard, A.; Mutlu, J.; Chanraud, S.; Guenolé, F.; Egler, P.J.; Gérardin, P.; Baleyte, J.M.; Dayan, J.; Eustache, F.; Guillery-Girard, B. Altered default mode network connectivity in adolescents with post-traumatic stress disorder. NeuroImage Clin. 2019, 22, 101731. [Google Scholar] [CrossRef]
  92. Zhang, W.; Hashemi, M.M.; Kaldewaij, R.; Koch, S.B.; Beckmann, C.; Klumpers, F.; Roelofs, K. Acute stress alters the ’default’ brain processing. NeuroImage 2019, 189, 870–877. [Google Scholar] [CrossRef]
  93. Lighthall, N.R.; Sakaki, M.; Vasunilashorn, S.; Nga, L.; Somayajula, S.; Chen, E.Y.; Samii, N.; Mather, M. Gender differences in reward-related decision processing under stress. Soc. Cogn. Affect. Neurosci. 2012, 74, 476–484. [Google Scholar] [CrossRef] [Green Version]
  94. Seo, D.; Jia, Z.; Lacadie, C.M.; Tsou, K.A.; Bergquist, K.; Sinha, R. Sex differences in neural responses to stress and alcohol context cues. Hum. Brain Mapp. 2011, 32, 1998–2013. [Google Scholar] [CrossRef] [Green Version]
  95. Goldberger, A.L.; Peng, C.K.; Lipsitz, L.A. What is physiologic complexity and how does it change with aging and disease? Neurobiol. Aging 2002, 23, 23–26. [Google Scholar] [CrossRef]
  96. Damoiseaux, J.S.; Beckmann, C.F.; Arigita, E.S.; Barkhof, F.; Scheltens, P.; Stam, C.J.; Smith, S.M.; Rombouts, S.A.R.B. Reduced resting-state brain activity in the “default network” in normal aging. Cereb. Cortex 2008, 18, 1856–1864. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  97. MacDuffie, K.E.; Knodt, A.R.; Radtke, S.R.; Strauman, T.J.; Hariri, A.R. Self-rated amygdala activity: An auto-biological index of affective distress. Personal. Neurosci. 2019, 2, e1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  98. Tkachenko, R.; Izonin, I. Model and principles for the implementation of neural-like structures based on geometric data transformations. In Proceedings of the International Conference on Computer Science, Engineering and Education Applications, Hohhot, China, 22–24 October 2018; pp. 578–587. [Google Scholar]
  99. Khavalko, V.; Tsmots, I.; Kostyniuk, A.; Strauss, C. Classification and Recognition of Medical Images Based on the SGTM Neuroparadigm; IDDM: Lviv, Ukraine, 2019; pp. 234–245. [Google Scholar]
  100. Mohd Jamaludin, S.Z.; Mohd Kasihmuddin, M.S.; Md Ismail, A.I.; Mansor, M.; Md Basir, M.F. Energy Based Logic Mining Analysis with Hopfield Neural Network for Recruitment Evaluation. Entropy 2021, 23, 40. [Google Scholar] [CrossRef] [PubMed]
  101. Griffith, V.; Koch, C. Quantifying synergistic mutual information. Guided Self-Organization: Inception; Springer: Berlin/Heidelberg, Germany, 2014; pp. 150–190. [Google Scholar]
  102. Wibral, M.; Finn, C.; Wollstadt, P.; Lizier, J.T.; Priesemann, V. Quantifying information modification in developing neural networks via partial information decomposition. Entropy 2017, 19, 494. [Google Scholar] [CrossRef] [Green Version]
  103. Wollstadt, P.; Lizier, J.T.; Vicente, R.; Finn, C.; Martinez-Zarzuela, M.; Mediano, P.; Novelli, L.; Wibral, M. IDTxl: The Information Dynamics Toolkit xl: A Python package for the efficient analysis of multivariate information dynamics in networks. J. Open Source Softw. 2019, 4, 494. [Google Scholar] [CrossRef]
Figure 1. Fifty-three EEG channels (circled in red) that were commonly available in all participants’ pre-processed EEG recordings. These channels were FP2, AF7, AF3, AFZ, AF4, AF8, C5, C3, C1, Cz, C2, C4, C6, CP5, CP3, CP1, CPZ, CP2, CP4, F5, F3, FZ, F1, F2, F4, F6, F8, FT7, FC5, FC3, FC1, FC2, FC4, FC6, FT8, P7, P5, P3, P1, PZ, P2, P4, P6, P8, PO9, PO7, POZ, PO3, PO4, PO8, and O1, OZ, O2.
Figure 1. Fifty-three EEG channels (circled in red) that were commonly available in all participants’ pre-processed EEG recordings. These channels were FP2, AF7, AF3, AFZ, AF4, AF8, C5, C3, C1, Cz, C2, C4, C6, CP5, CP3, CP1, CPZ, CP2, CP4, F5, F3, FZ, F1, F2, F4, F6, F8, FT7, FC5, FC3, FC1, FC2, FC4, FC6, FT8, P7, P5, P3, P1, PZ, P2, P4, P6, P8, PO9, PO7, POZ, PO3, PO4, PO8, and O1, OZ, O2.
Entropy 23 00286 g001
Figure 2. Grand average topographic maps of the HIGH and LOW groups’ conditional entropy (CE) values. This figure highlights the activation of the default mode network’s (DMN) frontoparietal component in the LOW group, which appears impaired in the LOW group. The CE values are scaled using the “StandardScaler()” function from Python scikit-learn [78].
Figure 2. Grand average topographic maps of the HIGH and LOW groups’ conditional entropy (CE) values. This figure highlights the activation of the default mode network’s (DMN) frontoparietal component in the LOW group, which appears impaired in the LOW group. The CE values are scaled using the “StandardScaler()” function from Python scikit-learn [78].
Entropy 23 00286 g002
Figure 3. (A) Representational similarity analysis (RSA) using Pearson correlation. HH and LL refer to within-group HIGH and within LOW comparison. RSA comparison between the HIGH and LOW groups is identified by HL and LH. (B) Distribution of Pearson’s “r” within the HIGH, within the LOW, and between the HIGH and LOW groups.
Figure 3. (A) Representational similarity analysis (RSA) using Pearson correlation. HH and LL refer to within-group HIGH and within LOW comparison. RSA comparison between the HIGH and LOW groups is identified by HL and LH. (B) Distribution of Pearson’s “r” within the HIGH, within the LOW, and between the HIGH and LOW groups.
Entropy 23 00286 g003
Figure 4. Permutation importance on KNN identified 27 channels. These channels were: AF4, AFz, C2, C6, CP1, CP3, CP4, CP5, CPz, Cz, F1, F3, F5, F6, FT7, Fp2, Fz, O2, P2, P3, P4, P5, P6, P7, and PO3, PO4, POz. Green and red horizontal lines mark the mean and 95.0% confidence interval (CI) for permutation importance values (M = 0.0369, CI 95.0 % = [0.0227 0.0534]). In this figure, channels whose importance are > average are in the frontal (AF4, F1, F6, Fz), centroparietal (CP3, CPz), parietal (P2, P3, P7), and occipital (O2) cortical regions.
Figure 4. Permutation importance on KNN identified 27 channels. These channels were: AF4, AFz, C2, C6, CP1, CP3, CP4, CP5, CPz, Cz, F1, F3, F5, F6, FT7, Fp2, Fz, O2, P2, P3, P4, P5, P6, P7, and PO3, PO4, POz. Green and red horizontal lines mark the mean and 95.0% confidence interval (CI) for permutation importance values (M = 0.0369, CI 95.0 % = [0.0227 0.0534]). In this figure, channels whose importance are > average are in the frontal (AF4, F1, F6, Fz), centroparietal (CP3, CPz), parietal (P2, P3, P7), and occipital (O2) cortical regions.
Entropy 23 00286 g004
Figure 5. Representational similarity analysis (RSA) based on channels whose permutation importance was above average (Figure 4, M = 0.0369). (A) HH and LL refer to within the HIGH and within the LOW groups’ comparison. RSA comparison between the HIGH and LOW groups is identified by HL and LH. (B) Distribution of Pearson’s r within the HIGH, within the LOW, and between the HIGH and LOW groups.
Figure 5. Representational similarity analysis (RSA) based on channels whose permutation importance was above average (Figure 4, M = 0.0369). (A) HH and LL refer to within the HIGH and within the LOW groups’ comparison. RSA comparison between the HIGH and LOW groups is identified by HL and LH. (B) Distribution of Pearson’s r within the HIGH, within the LOW, and between the HIGH and LOW groups.
Entropy 23 00286 g005
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Keshmiri, S. Conditional Entropy: A Potential Digital Marker for Stress. Entropy 2021, 23, 286. https://doi.org/10.3390/e23030286

AMA Style

Keshmiri S. Conditional Entropy: A Potential Digital Marker for Stress. Entropy. 2021; 23(3):286. https://doi.org/10.3390/e23030286

Chicago/Turabian Style

Keshmiri, Soheil. 2021. "Conditional Entropy: A Potential Digital Marker for Stress" Entropy 23, no. 3: 286. https://doi.org/10.3390/e23030286

APA Style

Keshmiri, S. (2021). Conditional Entropy: A Potential Digital Marker for Stress. Entropy, 23(3), 286. https://doi.org/10.3390/e23030286

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop