Next Article in Journal
Fibonacci Wavelet Method for the Solution of the Non-Linear Hunter–Saxton Equation
Next Article in Special Issue
Detrending Moving Average, Power Spectral Density, and Coherence: Three EEG-Based Methods to Assess Emotion Irradiation during Facial Perception
Previous Article in Journal
Cytokines, Chemokines, Insulin and Haematological Indices in Type 2 Diabetic Male Sprague Dawley Rats Infected with Trichinella zimbabwensis
Previous Article in Special Issue
Promise for Personalized Diagnosis? Assessing the Precision of Wireless Consumer-Grade Electroencephalography across Mental States
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Perspective

Decoding of Processing Preferences from Language Paradigms by Means of EEG-ERP Methodology: Risk Markers of Cognitive Vulnerability for Depression and Protective Indicators of Well-Being? Cerebral Correlates and Mechanisms

Applied Emotion and Motivation Psychology, Ulm University, 89081 Ulm, Germany
Appl. Sci. 2022, 12(15), 7740; https://doi.org/10.3390/app12157740
Submission received: 6 June 2022 / Revised: 21 July 2022 / Accepted: 22 July 2022 / Published: 1 August 2022

Abstract

:
Depression is a frequent mental affective disorder. Cognitive vulnerability models propose two major cognitive risk factors that favor the onset and severity of depressive symptoms. These include a pronounced self-focus, as well as a negative emotional processing bias. According to two-process models of cognitive vulnerability, these two risk factors are not independent from each other, but affect information processing already at an early perceptual processing level. Simultaneously, a processing advantage for self-related positive information including better memory for positive than negative information has been associated with mental health and well-being. This perspective paper introduces a research framework that discusses how EEG-ERP methodology can serve as a standardized tool for the decoding of negative and positive processing biases and their potential use as risk markers of cognitive vulnerability for depression, on the one hand, and as protective indicators of well-being, on the other hand. Previous results from EEG-ERP studies investigating the time-course of self-referential emotional processing are introduced, summarized, and discussed with respect to the specificity of depression-related processing and the importance of EEG-ERP-based experimental testing for well-being and the prevention and treatment of depressive disorders.

1. Introduction

Affective disorders such as depression are among the most common mental disorders in Western industrialized societies, and are on the rise worldwide. According to the WHO (World Health Organization), already more than 300 million people worldwide currently suffer from a depressive disorder [1]. The lifetime prevalence is 16–20% for both sexes [1]. The onset of major depressive disorder is early in life, starting during adolescence, and affecting emerging adults, if untreated, during their whole lifespan [2]. Due to its high prevalence, as well as due to its multifactorial negative consequences for mental and physical health, the prevention of depressive symptoms is of outstanding clinical and health economic importance [1]. Indeed, depressive disorder affects the whole person—the body, the brain, and the mind—and related affective, motivational, and cognitive processing [3].
Regarding emotional processing, depressed individuals are found to sustain attention to negative stimuli, have difficulties in the inhibition of negative information, and, compared to non-depressed individuals, recall negative information better than positive information, e.g., [4,5]. These processing biases, described in the literature as negativity bias, have been repeatedly reported in studies investigating acute or remitted depressed individuals. Moreover, the negativity bias has been confirmed in vulnerable individuals, i.e., individuals at risk of depression e.g., see [4,5,6,7,8,9]. According to cognitive vulnerability models, two major cognitive risk factors can be identified that promote the occurrence and severity of depressive symptoms and the development of depressive symptoms prior to a clinical diagnosis of major depressive disorder [10]. These cognitive risk factors include an increased self-focus and a negative emotional processing bias [10,11]. Thus, according to cognitive vulnerability models, for the diagnostic decision of whether processing preferences for negative stimuli are specific risk markers of depressive symptoms, it is essential to determine whether these processing biases occur in reference to one’s own self. Theoretically, a pronounced self-reference or self-focus, negative self-schemas, and negative attitudes towards the self are among the core characteristics of a depressive personality structure, and they are important causal disease factors characterizing depressed thinking in cognitive theories of depression [12,13]. Accordingly, cognitive vulnerability models of depression (for an overview, see [10]) assume that the aforementioned cognitive biases exist prior to the onset of depressive disorders. Moreover, it is assumed that both self-referential and emotional processing are linked in depressive disorders—specifically, it is assumed that a focus on the self, including a negative view of the self, biases information processing towards negative information [10].
In line with two-process models of information processing, cognitive vulnerability models distinguish between a fast, predominantly associative, implicit, stimulus-driven (bottom-up) processing mode and a temporally slower, reflective, and cognitively elaborate and controlled (top-down) processing mode. Both the associative and the controlled processing modes can occur during stimulus processing in a serial sequence. Any type of stimulus appraisal occurring spontaneously can be assumed to be related to the fast and associative processing level. Reflective and cognitively controlled stimulus processing, including more elaborate processing of the information, can be assumed to follow associative processing and to occur, in particular, when a task demands it, the context requires information to be elaborated and appraised in-depth, or when responses triggered by emotional stimuli have to be actively and cognitively regulated (an overview is given in [10]). As illustrated in Figure 1, according to cognitive vulnerability models, in this information processing cascade, self-reference acts as a processing filter that can bias emotion processing already at early stages of associative information processing. Moreover, it can trigger more elaborate and reflective self-related negative information processing at later stages of cognitive controlled information processing. When viewed from the perspective of information processing, according to these models, depressive vulnerability results from the interaction between self-related and emotional processing occurring at early processing stages, and the processing biases resulting from this interaction are considered the main characteristics, or risk markers, of depressive vulnerability. Therefore, individuals in whom an interaction between self-related and negative emotional processing and, consequently, a self-negativity bias can be observed should be particularly vulnerable to the experience of depressive symptoms compared to individuals not displaying self-referential negative processing. Following cognitive vulnerability models, this self-negativity bias should be best empirically observed during experimental task conditions that (a) favor self-referential associative stimulus processing (e.g., spontaneous processing or passive viewing), (b) require cognitively reflective or cognitive-controlled processing of self-related emotional content, and (c) use stimulus material that varies in emotional content and self-reference.

2. Decoding Processing Preferences by Means of EEG Methodology

Methodologically, non-invasive electroencephalography (EEG) and the analysis of event-related brain potentials (ERPs) from the electroencephalogram (EEG) are ideally suited neurophysiological techniques to unravel the processing biases of cognitive vulnerability and determine how these biases unfold over the time course of information processing. EEG methodology allows precise insights into the time course of stimulus- and information processing and their task- and mood-related changes. The latency, as well as the amplitude modulation of early and late ERPs in response to the averaged stimulus response recorded in different task contexts allow differentiated conclusions about the different stimulus and information processing stages from stimulus perception to more in-depth processing [14]. In contrast to behavioral methods, EEG methodology allows the investigation of stimulus processing and its time course even in designs in which no behavioral responses are required and no tasks are given other than to, e.g., read, watch, or listen to the stimulus presentation. EEG methods therefore might be ideally suited to study bottom-up processing without the confounding influence of task-related factors, while at the same time allowing for comparisons between spontaneous (no task) and task-related stimulus processing. Moreover, in event-related stimulus designs, a number of event-related brain potentials can be elicited that, depending on the stimulus and processing specificities, have been shown to be reliable markers of, e.g., perceptual, cognitive, semantic, sensorimotor, or affective processing [14].
Regarding emotional processing, as exemplified in Figure 2, the processing of emotional and neutral stimuli can elicit the modulation of early and late event-related brain potentials (ERPs). For example, in an EEG-ERP experiment with emotional and neutral stimuli, the amplitude amplification of early event-related potentials such as the EPN (early posterior negativity) has often been observed, irrespective of the type of stimuli presented, whether it is words or pictures of emotionally evocative scenes [15,16,17]. Due to its almost obligatory elicitation across many study designs (passive viewing tasks, fast stimulus presentations, or selective attentive stimulus processing), the EPN has been suggested to be a prominent neural marker of early stimulus-driven processing of high-arousing stimulus content of motivational salience [15,16,17]. Therefore, in the EEG, a larger EPN amplitude modulation during the processing of stimuli of negative content, compared to stimuli of positive or neutral content, would argue for a rapid, spontaneous, and bottom-up driven allocation of visual attention to negative stimulus information that, according to the two-process models mentioned above, occurs at fast—and probably still associative—levels of information processing.
In addition, the amplitude modulation of temporally later ERP components such as the N400 ERP component, typically elicited by lexical stimuli (but also found to be elicited by non-lexical stimuli such as faces), can indicate semantic processing due to facilitated lexical access [18], facilitated activation of long-term memory representation [19], or contextual integration of the stimuli [20]. Contextual integration can be established either experimentally by a sentence context [20], a specific task context, or an internal context such as the current mood and affective state of the participant [21,22,23]. Therefore, N400 modulation by negative or positive stimuli compared to neutral stimuli occurring approximately 400 ms after stimulus presentation during spontaneous stimulus processing tasks could suggest mood-dependent processing of negative or positive content [22], with mood acting as a context for stimulus integration and mood-incongruent stimuli being processed differently from mood-congruent stimuli under mood induction (e.g., [21]). Last, but not least, the enhanced amplitude modulations of late ERP components such as the LPP (late positive potential) have been assumed to be associated with deeper processing of the content of negative or positive stimuli (e.g., [22,23,24]). LPP modulation may therefore indicate a sustained attentional focus for certain information of relevance for the person. Moreover, its modulation has been shown to indicate cognitively controlled emotion processing in a number of emotion regulation studies that used implicit and explicit strategies of stimulus reappraisal or emotion suppression (e.g., [24,25]).

3. Research Gaps

Despite of the prominence of cognitive vulnerability models and the popularity of non-invasive EEG methodology, so far, the literature lacks studies that systematically investigate the time course of emotional processing and its interaction with self-referential processing in line with cognitive vulnerability models in controlled experimental laboratory settings in cognitively vulnerable individuals at risk of depression, with healthy, cognitively non-vulnerable individuals as controls. Investigating the hypothesis of cognitively vulnerable models by means of EEG-ERP methods requires appropriate experimental paradigms that allow to experimentally manipulate the self-reference and the emotionality/the emotional significance of the stimuli independently from, as well as in combination with, each other to induce and trigger self-referential as well as emotional processing at the stage of associative stimulus processing in a bottom-up fashion without any influence from higher-order, task-induced self-referential or emotional processing. This seems crucial to test the early interactions between self-reference and emotion processing postulated by cognitive vulnerability models to occur during implicit associative processing conditions compared to cognitively controlled reflective processing conditions (see Figure 1).
So far, experimental paradigms that investigated the interaction between emotion and self-referential processing in healthy controls and depressive subjects have almost exclusively induced self-referential processing explicitly via task instructions. In particular, paradigms such as the Self-Referent Encoding Task (SRET [26]) have been used, e.g., [26,27,28,29]. In this paradigm, participants are exposed to positive and negative personality traits and asked to judge which of the trait words describe them best. Afterwards, the participants are often asked to recall the words presented. The results of several studies suggest that words that have been judged to describe the self and are thus considered to be congruent with the person’s own self-views are also better remembered e.g., [30], with healthy subjects differing from depressive subjects in their performance [26,27,28,29]. Studies recording EEG-ERP parameters during the SRET in healthy individuals and in individuals suffering from current or remittent depressive disorder [31,32,33] have found differential processing of positive and negative trait words as a function of group (healthy participants vs. participants with current or remitted depression) during later stages of stimulus processing [31,32,33,34]. Temporally earlier processing differences in the time window of early ERPs as a function of group (healthy participants vs. participants with current or remitted depression) have been reported only occasionally in the SRET [33]. Given that in the SRET, self-reference is induced via task instructions, there is a search for tasks and paradigms that allow the independent experimental manipulation of the dimensions of self-reference and emotion based on stimuli instead of task to assess not only the reflective aspects of self-referential processing, but also the associative and stimulus-driven effects of self-referential processing on emotion processing, independent from, as well as in comparison with, task-induced affordances and cognitive demands.
Experimental paradigms that allow both, the independent experimental manipulation and the joint assessment of the effects of the self-referentiality and the emotionality elicited by a stimulus are paradigms such as the so-called ‘HisMine’ paradigm [for an overview see below or the Supplementary Materials]. In its non-affective form, the HisMine paradigm consists of singular and plural first-person pronouns (1PP: I, my), second-person pronouns (2PP: you, yours), and third-person pronouns (3PP: he/she, hers, his), addressing the self as the subject or object of self-experience, e.g., [35,36,37]. In its affective form (e.g., [38,39]), self- and/or other-referential possessive pronouns (“my”/“his/her”) are combined with nouns that vary in emotionality (positive, negative, and neutral) and are matched on the two emotional dimensions of valence and arousal. In addition, the stimuli are matched on several linguistic dimensions such as word length, or word frequency, or concreteness. The nouns chosen can describe positive and negative emotions (e.g., fear, anger, or happiness), emotion-inducing objects and events (e.g., gun, failure, money, or love), or neutral states or objects rated by normative study samples as neither positive nor negative in valence and low in emotional arousal (e.g., furniture, books, etc.). The nouns can be paired with 1PP, 2PP, or 3PP possessive pronouns to make reference to the reader’s own emotions or to the emotions of a third person. In addition, nouns paired with articles instead of pronouns can serve as controls, and the effects triggered by self- and other-referential pronouns on emotion processing triggered by the nouns can be compared to a control condition of non-referential emotional and neutral content. Thus, in summary and in contrast to the SRET paradigm, the stimuli used in the HisMine paradigm can capture a broad range of concepts and emotional feeling states. This may—with respect to cognitive vulnerability models—allow a comprehensive insight into depression-related emotional processing biases. Instructions in the HisMine paradigm can vary from passive viewing and reading to spontaneous emotional evaluation (to trigger associative processing) to active attentive and cognitively controlled processing of the stimuli (to trigger elaborate processing). In combination with EEG methodology, this allows a reliable investigation of the time course and the neural sources of implicit stimulus-driven and task-related explicit self-referential emotional processing. Moreover, when pronouns are paired with non-verbal stimuli (e.g., faces [25]), the specificity of self-referential processing can be explored across and between emotion modalities (verbal and non-verbal). While the HisMine paradigm is conceptualized to investigate the behavioral, subjective, and neuronal correlates of self-referential emotional processing at the word–phrase level, similar approaches for the study of self-referential and emotional processing at the sentence level have been recently suggested (e.g., [40,41,42]).
The approaches using pronoun–noun phrases or sentences in combination with EEG methodology might be interesting for the investigation of cognitive vulnerability. At the same time, these paradigms might have the capacity to provide insight into what characterizes “normal” and healthy information processing in terms of emotion and self-referential processing. Akin to a negativity bias, a processing advantage for self-related positive information including better memory for positive than negative information has often been observed, especially in association with the above-mentioned SRET self-reference task [30]. The brain regions correlated with self-referential processing in the SRET are well known from several imaging studies (e.g., [43,44]). Nevertheless, the understanding of the time course of these biases as assessed by EEG methodology in combination with self-report methods of mental health and subjective well-being is still scarce. Assessing ERP correlates during pronoun–noun processing (e.g., HisMine paradigm) or at the sentence level might provide solutions to this: At the phrase or the sentence level, the temporal dynamics of processing preferences for self-referential negative and self-referential positive stimuli can be investigated in the same paradigm and, therefore, unravel the risk markers of cognitive vulnerability for depression and the predictive markers of well-being. In the following sections, the results from previous studies investigating the correlates and, specifically, the time course of self-referential emotional processing within the HisMine paradigm will be briefly reviewed, summarized, and discussed with respect to their importance for future studies investigating EEG-ERP-based experimental testing for the prevention, intervention, and treatment of depressive disorders and the promotion of well-being.

4. Exploring the Time Course of Stimulus-Driven, Self-Referential, and Emotional Processing by Means of EEG-ERPs

4.1. EEG Indicators of Healthy Self-Referential Emotional Processing

Using the methodological benefits of electroencephalography (EEG), a number of studies have already explored when, i.e., at which processing stages during reading, self-referential vs. other-referential pronouns are differentiated from each other [35,36,37], as well as at which processing stages self-referential and other referential pronoun–noun pairs referring to the reader’s own emotions or to the emotions of a third person are distinguished from each other and from article–noun pairs having no personal reference or having a neutral meaning [38,39]. In addition, using functional magnetic imaging it was also explored whether brain regions belonging to the emotion, self, and reading networks are involved in these discriminatory processes [45]. In the studies with self-referential and other referential pronoun–noun pairs, the nouns (positive, negative, and neutral) were paired with possessive pronouns (my or his) or articles (the) (e.g., my fear vs. his fear vs. the fear, etc.). The possessive pronouns and articles were either shown together with the nouns without any temporal delay between pronouns and nouns (SOA = 0 ms) [39] or were presented, for example, as primes with a stimulus onset asynchrony (SOA) of 600 ms preceding the presentation of the nouns to investigate and control for expectancy effects induced by the presentation of the pronouns [38]. In neither of these studies was there an explicit self-referential processing task given to the readers; rather, the task in these studies was to silently read the presented words. This was followed by a spontaneous free recall task and a subjective evaluation task (rating task) in which the participants rated the words in terms of valence and emotion intensity (arousal). During reading and in the EEG, early and late event-related potentials (ERPs) were analyzed as cortical indicators of the time course of information processing, and ERP source estimations were used to explore the brain structures involved in the modulation of these ERPs [39]. In addition, changes in the activity of certain brain regions during reading were explored by functional magnetic resonance imaging using whole brain analysis [45]. In the EEG-ERP studies using the affective HisMine paradigm, an interaction of the two factors on which the word pairs could vary, namely, the “emotionality” of a word pair (carried by the nouns) and the “reference” (elicited by the pronouns vs. articles) occurred in the time window of the late positive potential (LPP). The LPP modulation was elicited approximately 500 ms after the stimulus onset and was most pronounced over the centro-parietal electrodes during passive reading of the words. Comparing the processing of self-referential pronoun–noun pairs against the processing of other referential pronoun–noun pairs or article–noun pairs without personal reference revealed a stronger cortical processing of self-referential positive words (self-positivity bias) in the time window of the LPP [38]. The source estimates of the LPP modulation patterns revealed significant activation in the brain structures involved in autobiographical memory functions and in self-referential processing, which are part of the so-called self-referential processing network, i.e., the cortical midline structures (CMS) or the default mode network [46,47]. The stronger cortical processing of self-referential positive words coincided with a better recall performance in the subsequent memory test in which the participants recalled emotional words spontaneously and significantly better than neutral words, especially when they were self-referential and possessed a positive meaning [39]. In addition, analysis of the ratings obtained after the EEG session showed that participants rated emotional words higher in valence and arousal when during reading, the nouns were related to the own person (self-referential) than when the nouns were related to others (other referential), and rated self-referential positive nouns higher in arousal compared to when positive nouns had no person reference (article–noun pairs) [39]. This more in-depth processing of positive concepts, specifically when perceived as self-referential in healthy participants, accords well with the results from the more explicit self-referential processing tasks in the SRET studies (see Section 3 in this manuscript). This self-positivity has received proof from a number of behavioral studies in which healthy participants in the HisMine paradigm were asked to affectively judge the words as positive, negative, or neutral based on their gut feelings e.g., [48,49,50], for an overview see the Supplementary Materials. Across these behavioral valence–judgment studies, healthy participants had significantly more valence–congruent judgments for positive words than for negative or neutral words, specifically when these were linguistically made self-referential by the pronoun pairings. The results fit with theoretical assumptions of a self-positivity bias among healthy subjects. This self-positivity bias might stem from positive self-views and overall positive self-concepts [51,52], that in healthy subjects, even if sometimes too positive and optimistic, characterizes positive self-attribution in the service of well-being and mood-regulation. The experimentally observed self-positivity bias in the EEG studies thus suggests a spontaneously deeper encoding of self-referential emotional pronoun–noun stimuli during reading (LPP), as well as better memory-related recall and a faster valence-congruent appraisal, of these stimuli that is in line with these theoretical assumptions of positive self-attribution in the service of well-being.
The observations of differential processing of positive vs. negative self vs. other vs. no person-referential pronoun–noun stimuli as indicators of healthy and normal processing receive further support from recent EEG-ERP and fMRI studies from other laboratories investigating the interaction between self-referential and emotional information processing via sentences. In these studies, pronouns and emotional words are embedded in a sentence context e.g., [40,41,42].
When evaluated across studies, the findings from the EEG studies thus far support the notion that in healthy subjects, the impact of self-referential processing on the processing of emotional information first occurs at stages of information processing at which perceptual information is processed, lexical information is accessed, and information is elaborated in relation to subjective experiences stored in memory. Indeed, as graphically illustrated in Figure 3, in healthy participants, a cascade of processing steps seems to precede and occur in parallel prior to the self-positivity bias. Temporally earlier interaction effects of self-referential stimuli on the processing of emotional stimuli may, in healthy subjects, be restricted to a few occasions, including highly accessible information or top-down attentive processing. In support of a cascade of processing steps preceding the self-positivity bias, the results from an fMRI study [45] suggest that in healthy subjects, significant activity changes in at least three brain region of interests in trials in which the positive content of nouns and self-reference of first-person possessive pronouns are combined, including activity changes in the MPFC regions involved in self-referential processing, the left and right (anterior) insular cortex as a region of the salience network [53] and a relay or hub at the interface of cognition, emotion, and the body (interoception), and the amygdala as a significant emotion and relevance detector [54].

4.2. EEG Indicators of Cognitive Vulnerable Self-Referential Emotional Processing

In summary, the EEG results in healthy subjects summarized in Section 4.1. provide indirect support for the assumptions that in tasks with no explicit self-referential instruction, temporally earlier interactions between self-referential and emotion processing at early stages of stimulus-driven associative processing could indeed be electrophysiological markers specific to individuals experiencing depressive symptoms or individuals prone to or at risk of or already suffering from depressive disorders. The first evidence for a self-negativity bias in the processing of pronouns and nouns as a marker of depressive symptoms was found in the EEG-ERP studies in which pronouns were used as primes for the nouns and processing of self-referential pronoun–noun pairs was compared with the processing of article noun pairs [38]. The participants’ depressive symptoms were assessed via self-report standardized assessment tools, allowing assumptions about the presence of depressive symptoms and their severity of actual depressive symptoms (the BDI inventory [55]). The results showed that a deeper cortical processing (LPP) of self-referential negative rather than positive emotional words (self-negativity bias) is positively correlated with the degree of self-reported depressive symptoms. In addition, and in line with cognitive vulnerability models, this self-negativity bias started at temporally earlier processing stages—the processing of self-referential, prime- x emotional target pairs elicited a pronounced N400 potential whose amplitudes, akin to the modulation of the LPP, showed depression-congruent modulation yielding smaller N400 amplitudes for self-referential negative emotional words.
Further, though yet preliminary, evidence for even earlier temporal influences, as theoretically predicted by cognitive vulnerability models, is provided by studies investigating the EEG-ERP modulation patterns elicited during the affective HisMine paradigm in depressed and medicated individuals (with a current diagnosis of major depressive disorder) and healthy controls [56]. The HisMine paradigm was presented in multiple runs comprising passive reading/viewing conditions and conditions with instructions to pay attention to or ignore the self-referential word pairs. The first preliminary analysis of the EEG data provided in [56] suggests that depressed subjects, in contrast to the healthy control subjects, show a processing bias for negative self-referential words in the EEG which is already present during the silent reading in early time windows that started during the N100 modulation, and especially while modulating the amplitudes of the EPN Supplementary Materials [56]. In the study design, self-reference was induced by second-person possessive pronouns instead of first-person possessive pronouns. These results complement the findings from SRET studies in depressed and non-depressed participant samples, showing that besides significant group differences in the time window of elaborate processing (LPP), there are early ERP processing differences between groups. As a marker of risk of depression, more recently, early processing biases towards self-referential negative information have been shown to continue into the remission of the disorder, being still observed in remitted depressed participants [57]. The hypothesis of an early self-negativity bias in the processing of self-referential emotional content as EEG-ERP markers of depressed vulnerability is currently further evaluated and extended in a research project comprising a series of EEG-ERP studies [58]. In the studies, EEG-ERP modulation patterns are assessed in samples of healthy subjects, who, prior to study participation, were preselected into groups of depression-prone individuals vs. individuals not prone to depression, according to clinical screening and assessment tools [58].

4.3. Studying Self-Referential Emotional Processing Biases as Markers of Cognitive Vulnerability and Well-Being by Means of Language-Dependent EEG Paradigms: Potential Limitations and Advantages

The investigation of emotional and self-referential processing by means of linguistic stimuli and language paradigms might be considered a limitation or a restriction. The reservation might stem from classical theoretical definitions of emotions that define emotions from an evolutionary, biological perspective and that consider emotion processing as being largely independent from language processing; specifically, emotion perception is suggested to be primarily driven by non-linguistic physical features of stimuli that the brain, due to its biological significance, is attuned to respond to with heightened attention and the preparation of bodily preparation for fight or flight and approach or consumption (for an overview, [59,60]). While there is no doubt that emotional stimuli, be it words, pictures, or faces, can elicit similar early ERP modulation in a number of task contexts (for an overview, see [61,62]), there is also no doubt that modality- and stimulus-specific processing effects between verbal and non-verbal emotional stimuli might, nevertheless, exist. Regarding depression and its cognitive vulnerability, a particular interest in the use of language paradigms to study emotion and the self might stem from three theoretical grounds: first, to examine the theoretically assumed “errors” in cognition and self-reflection in the schemata of depressed vs. non-depressed individuals; second, to determine, in line with modern theoretical accounts of embodiment and embodied cognition, how cognitive biases are influenced by sensory and motor information among cognitively vulnerable individuals at risk of depression vs. among individuals already suffering from depressive disorders vs. healthy controls; and third, given that depression, being an affective disorder that includes mood changes, to investigate psychophysiological, neurophysiological, and neurobiological changes to determine how cognitive and bodily processes might interact while participants are construing meaning from language stimuli that might trigger feelings and subjective experience relating to one’s own person.
Methodologically, an important limitation of the EEG-ERP technique with regard to its application as a diagnostic tool is its reliability and power at the individual level. However, unless the focus is on the group level, results from the EEG-ERP analysis could be used as an additional testing option, in addition to self-report diagnostic questionnaires, to distinguish between individuals at risk and those without risk of mental health conditions, specifically when EEG-ERP analysis is combined with an experimental and theoretically driven task or paradigm, such as those proposed in this perspective paper. Regarding clinical disorders, previous studies have already provided promising results for such an approach. Using EEG-ERP analysis, amongst others, in combination with more advanced preprocessing and analysis tools, or in combination with a mixed methodological analysis based on time- and frequency measures, has shown to obtain good results in, for example, attention-deficit/hyperactivity disorder (ADHD) or the prediction of Alzheimer’s disease (e.g., [63,64]) or major depressive disorder, e.g., [65]. Regarding depressive disorders, EEG analyses based on time–frequency analysis and/or independent-component-based event-related synchronisation/desynchronisation analysis, as reviewed and suggested in [66], would be interesting methodological approaches to be combined in future studies with paradigms investigating alterations in self-referential emotional processing in individuals with and without the risk of depressive disorders.

5. Questions for the Future

Depressive disorder is not one disease: all disease and disorder-related changes in mood, as well as in self-reference and affective processing can, as outlined in this manuscript, theoretically manifest as biases in the processing of self-referential positive and negative information well prior to onset of the disorder. EEG and, specifically, EEG-ERP methodology are currently pursued as means that, if combined with an experimental paradigm, could help unravel the mechanisms of processing preferences and their clinical relevance as traits or state markers of the risk of mental health conditions such as depression. Although preliminary evidence has already been accumulated, future studies should principally replicate and extend the current evidence with a focus on the following guiding questions:
(1)
At which stages of stimulus processing does an interaction between self-referential and emotional processing occur? Can the preliminary findings, illustrated in this manuscript, be replicated in larger cohorts of both, cognitively vulnerable and already depressed individuals vs. healthy controls?
(2)
To what degree can processing preferences for self-related negative and positive stimuli, respectively, be influenced by self-related attentive and cognitively controlled processing, and which of these influences are specific for depression and its risk?
(3)
Is self-negativity bias the only marker of cognitive vulnerability, or is a self-negativity bias accompanied by a reduced self-positivity bias as well (see Figure 4)?
(4)
Do the observed electrophysiological ERP correlates of the processing preferences for self-related negative or positive stimuli prove to be temporally stable markers of subjective well-being and cognitive vulnerability?
(5)
Do the results vary across languages, and do they also apply to a bilingual/multilingual context?
Importantly, question 5 is receiving increasing attention in a global society in which bilingual and multilingual psychotherapy is becoming more and more prevalent. Recent research, including EEG-ERP studies, has observed a weaker emotional reactivity to negative language content in the second language than in the first, with results being further modulated by mood, proficiency, and language use, e.g., [67,68]. Future projects and studies that focus on questions (1)–(5), respectively, will fill an important gap between the understanding of processing preferences, their electrophysiological dynamics, and their psychological and clinical significance as depressive vulnerability indicators and markers of subjective well-being. Based on this evidence, experimental tests could then be developed with which depression-associated processing biases as well as indicators of well-being could be detected by means of EEG-ERP measurements and used for depression monitoring and improvement in well-being in the context of health prevention, intervention, and therapy.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/app12157740/s1.

Funding

This research was funded by the German Research Foundation (DFG), HE5880/7-1 granted to C.H.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The author declares no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Available online: https://www.who.int/en/news-room/fact-sheets/detail/depression (accessed on 5 June 2022).
  2. Solmi, M.; Radua, J.; Olivola, M.; Croce, E.; Soardo, L.; Salazar de Pablo, G.; Il Shin, J.; Kirkbride, J.B.; Jones, P.; Kim, J.H.; et al. Age at onset of mental disorders worldwide: Large-scale meta-analysis of 192 epidemiological studies. Mol. Psychiatry 2022, 27, 281–295. [Google Scholar] [CrossRef] [PubMed]
  3. Kalia, M. Neurobiological basis of depression: An update. Metabolism 2005, 54, 24–27. [Google Scholar] [CrossRef] [PubMed]
  4. Foland-Ross, L.C.; Gotlib, I.H. Cognitive and neural aspects of information processing in major depressive disorder: An integrative perspective. Front. Psychol. 2012, 3, 489. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Gotlib, I.H.; Joormann, J. Cognition and depression: Current status and future directions. Annu. Rev. Clin. Psychol. 2010, 6, 285–312. [Google Scholar] [CrossRef] [Green Version]
  6. Connolly, S.L.; Abramson, L.Y.; Alloy, L.B. Information processing biases concurrently and prospectively predict depressive symptoms in adolescents: Evidence from a self-referent encoding task. Cogn. Emot. 2016, 30, 550–560. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Gordon, E.; Barnett, K.J.; Cooper, N.J.; Tran, N.; Williams, L.M. An “integrative neuroscience” platform: Application to profiles of negativity and positivity bias. J. Integr. Neurosci. 2008, 7, 345–366. [Google Scholar] [CrossRef] [PubMed]
  8. Rude, S.S.; Durham-Fowler, J.A.; Baum, E.S.; Rooney, S.B.; Maestas, K.L. Self-report and Cognitive Processing Measures of Depressive Thinking Predict Subsequent Major Depressive Disorder. Cogn. Ther. Res. 2010, 34, 107–115. [Google Scholar] [CrossRef]
  9. Watters, A.J.; Williams, L.M. Negative biases and risk for depression; integrating self-report and emotion task markers. Depress. Anxiety 2011, 28, 703–718. [Google Scholar] [CrossRef] [PubMed]
  10. Beevers, C.G. Cognitive vulnerability to depression: A dual process model. Clin. Psychol. Rev. 2005, 25, 975–1002. [Google Scholar] [CrossRef]
  11. Fossati, P. Is major depression a cognitive disorder? Rev. Neurol. 2018, 174, 212–215. [Google Scholar] [CrossRef]
  12. Beck, A.T. Depression: Causes and Treatment; University of Pennsylvania Press: Philadelphia, PA, USA, 1967. [Google Scholar]
  13. Beck, A.T.; Epstein, N.; Harrison, R. Cognitions, attitudes and personality dimensions in depression. Br. J. Cogn. Psychother. 1983, 1, 1–16. [Google Scholar]
  14. Luck, S.J. An Introduction to the Event-Related Potential Technique; MIT Press: Cambridge, MA, USA, 2014. [Google Scholar]
  15. Schupp, H.T.; Junghöfer, M.; Weike, A.I.; Hamm, A.O. Attention and emotion: An ERP analysis of facilitated emotional stimulus processing. Neuroreport 2003, 14, 1107–1110. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Kissler, J.; Herbert, C.; Peyk, P.; Junghofer, M. Buzzwords: Early cortical responses to emotional words during reading. Psychol. Sci. 2007, 18, 475–480. [Google Scholar] [CrossRef]
  17. Herbert, C.; Junghofer, M.; Kissler, J. Event related potentials to emotional adjectives during reading. Psychophysiology 2008, 45, 487–498. [Google Scholar] [CrossRef] [PubMed]
  18. Lau, E.F.; Phillips, C.; Poeppel, D. A cortical network for semantics: (de)constructing the N400. Nat. Rev. Neurosci. 2008, 9, 920–933. [Google Scholar] [CrossRef] [PubMed]
  19. Kutas, M.; Federmeier, K.D. Electrophysiology reveals semantic memory use in language comprehension. Trends Cogn. Sci. 2000, 4, 463–470. [Google Scholar] [CrossRef]
  20. Kutas, M.; Hillyard, S.A. Reading senseless sentences: Brain potentials reflect semantic incongruity. Science 1980, 207, 203–205. [Google Scholar] [CrossRef] [PubMed]
  21. Kiefer, M.; Schuch, S.; Schenck, W.; Fiedler, K. Mood states modulate activity in semantic brain areas during emotional word encoding. Cereb. Cortex 2007, 17, 1516–1530. [Google Scholar] [CrossRef] [Green Version]
  22. Herbert, C.; Kissler, J.; Junghöfer, M.; Peyk, P.; Rockstroh, B. Processing of emotional adjectives: Evidence from startle EMG and ERPs. Psychophysiology 2006, 43, 197–206. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Ferrari, V.; Codispoti, M.; Cardinale, R.; Bradley, M.M. Directed and motivated attention during processing of natural scenes. J. Cogn. Neurosci. 2008, 20, 1753–1761. [Google Scholar] [CrossRef] [PubMed]
  24. Hajcak, G.; Dunning, J.P.; Foti, D. Motivated and controlled attention to emotion: Time-course of the late positive potential. Clin. Neurophysiol. 2009, 120, 505–510. [Google Scholar] [CrossRef] [PubMed]
  25. Herbert, C.; Sfaerlea, A.; Blumenthal, T. Your emotion or mine: Labeling feelings alters emotional face perception—An ERP study on automatic and intentional affect labeling. Front. Hum. Neurosci. 2013, 7, 378. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Kuiper, N.A.; Derry, P.A. Depressed and nondepressed content self-reference in mild depressives. J. Pers. 1982, 50, 67–80. [Google Scholar] [CrossRef]
  27. Alloy, L.B.; Abramson, L.Y.; Murray, L.A.; Whitehouse, W.G.; Hogan, M.E. Self-referent information-processing in individuals at high and low cognitive risk for depression. Cogn. Emot. 1997, 11, 539–568. [Google Scholar] [CrossRef]
  28. Dozois, D.J.; Dobson, K.S. Information processing and cognitive organization in unipolar depression: Specificity and comorbidity issues. J. Abnorm. Psychol. 2001, 110, 236. [Google Scholar] [CrossRef] [PubMed]
  29. Dobson, K.S.; Shaw, B.F. Specificity and stability of self-referent encoding in clinical depression. J. Abnorm. Psychol. 1987, 96, 34–40. [Google Scholar] [CrossRef]
  30. Matt, G.E.; Vázquez, C.; Campbell, W.K. Mood-congruent recall of affectively toned stimuli: A meta-analytic review. Clin. Psychol. Rev. 1992, 12, 227–255. [Google Scholar] [CrossRef]
  31. Watson, L.A.; Dritschel, B.; Obonsawin, M.C.; Jentzsch, I. Seeing yourself in a positive light: Brain correlates of the self-positivity bias. Brain Res. 2007, 1152, 106–110. [Google Scholar] [CrossRef] [PubMed]
  32. Allison, G.O.; Kamath, R.A.; Carrillo, V.; Alqueza, K.L.; Pagliaccio, D.; Slavich, G.M.; Shankman, S.A.; Auerbach, R.P. Self-referential Processing in Remitted Depression: An Event-Related Potential Study. Biol. Psychiatry Glob. Open Sci. 2021. [Google Scholar] [CrossRef]
  33. Shestyuk, A.Y.; Deldin, P.J. Automatic and strategic representation of the self in major depression: Trait and state abnormalities. Am. J. Psychiatry 2010, 167, 536–544. [Google Scholar] [CrossRef]
  34. Dainer-Best, J.; Trujillo, L.T.; Schnyer, D.M.; Beevers, C.G. Sustained engagement of attention is associated with increased negative self-referent processing in major depressive disorder. Biol. Psychol. 2017, 129, 231–241. [Google Scholar] [CrossRef]
  35. Blume, C.; Herbert, C. The HisMine-Paradigm: A new paradigm to investigate self-awareness employing pronouns. Soc. Neurosci. 2014, 9, 289–299. [Google Scholar] [CrossRef] [PubMed]
  36. Herbert, C.; Blume, C.; Northoff, G. Can we distinguish an “I” and “ME” during listening?—An event-related EEG study on the processing of first and second person personal and possessive pronouns. Self Identity 2016, 15, 120–138. [Google Scholar] [CrossRef]
  37. Herbert, C.; Northoff, G.; Hautzinger, M. Depressive Symptome, kardiale Regulation und kortikale Verarbeitung bei Leistungssportlern. Dtsch. Z. Sportmed. 2016, 2016, 293–300. [Google Scholar] [CrossRef]
  38. Herbert, C.; Pauli, P.; Herbert, B.M. Self-reference modulates the processing of emotional stimuli in the absence of explicit self-referential appraisal instructions. Soc. Cogn. Affect. Neurosci. 2011, 6, 653–661. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Herbert, C.; Herbert, B.M.; Ethofer, T.; Pauli, P. His or mine? The time course of self-other discrimination in emotion processing. Soc. Neurosci. 2011, 6, 277–288. [Google Scholar] [CrossRef] [PubMed]
  40. Fields, E.C.; Kuperberg, G.R. Dynamic Effects of Self-Relevance and Task on the Neural Processing of Emotional Words in Context. Front. Psychol. 2015, 6, 2003. [Google Scholar] [CrossRef] [Green Version]
  41. Fields, E.C.; Kuperberg, G.R. Loving yourself more than your neighbor: ERPs reveal online effects of a self-positivity bias. Soc. Cogn. Affect. Neurosci. 2015, 10, 1202–1209. [Google Scholar] [CrossRef] [Green Version]
  42. Fields, E.C.; Weber, K.; Stillerman, B.; Delaney-Busch, N.; Kuperberg, G.R. Functional MRI reveals evidence of a self-positivity bias in the medial prefrontal cortex during the comprehension of social vignettes. Soc. Cogn. Affect. Neurosci. 2019, 14, 613–621. [Google Scholar] [CrossRef]
  43. Northoff, G.; Heinzel, A.; de Greck, M.; Bermpohl, F.; Dobrowolny, H.; Panksepp, J. Self-referential processing in our brain—A meta-analysis of imaging studies on the self. NeuroImage 2006, 31, 440–457. [Google Scholar] [CrossRef]
  44. Lemogne, C.; Delaveau, P.; Freton, M.; Guionnet, S.; Fossati, P. Medial prefrontal cortex and the self in major depression. J. Affect. Disord. 2012, 136, e1–e11. [Google Scholar] [CrossRef] [PubMed]
  45. Herbert, C.; Herbert, B.M.; Pauli, P. Emotional self-reference: Brain structures involved in the processing of words describing one’s own emotions. Neuropsychologia 2011, 49, 2947–2956. [Google Scholar] [CrossRef] [PubMed]
  46. Northoff, G.; Bermpohl, F. Cortical midline structures and the self. Trends Cogn. Sci. 2004, 8, 102–107. [Google Scholar] [CrossRef] [PubMed]
  47. Qin, P.; Northoff, G. How is our self related to midline regions and the default-mode network? NeuroImage 2011, 57, 1221–1233. [Google Scholar] [CrossRef] [PubMed]
  48. Weis, P.P.; Herbert, C. Bodily Reactions to Emotional Words Referring to Own versus Other People’s Emotions. Front. Psychol. 2017, 8, 1277. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Meixner, F.; Herbert, C. Whose emotion is it? Measuring self-other discrimination in romantic relationships during an emotional evaluation paradigm. PLoS ONE 2018, 13, e0204106. [Google Scholar] [CrossRef]
  50. Herbert, C.; Hesse, K.; Wildgruber, D. Emotion and self in psychotic disorders: Behavioral evidence from an emotional evaluation task using verbal stimuli varying in emotional valence and self-reference. J. Behav. Ther. Exp. Psychiatry 2018, 58, 86–96. [Google Scholar] [CrossRef]
  51. Diener, E.; Napa-Scollon, C.K.; Oishi, S.; Dzokoto, V.; Suh, E.M. Positivity and the Construction of Life Satisfaction Judgments: Global Happiness is not the Sum of its Parts. J. Happiness Stud. 2000, 1, 159–176. [Google Scholar] [CrossRef]
  52. Caprara, G.V.; Eisenberg, N.; Alessandri, G. Positivity: The Dispositional Basis of Happiness. J. Happiness Stud. 2017, 18, 353–371. [Google Scholar] [CrossRef]
  53. Uddin, L.Q. Salience processing and insular cortical function and dysfunction. Nat. Rev. Neurosci. 2015, 16, 55–61. [Google Scholar] [CrossRef]
  54. Sander, D.; Grafman, J.; Zalla, T. The human amygdala: An evolved system for relevance detection. Rev. Neurosci. 2003, 14, 303–316. [Google Scholar] [CrossRef] [PubMed]
  55. BDI-II—Beck-Depressions-Inventar Revision—Hogrefe Verlag. Available online: https://www.testzentrale.de/shop/beck-depressions-inventar.html (accessed on 5 June 2022).
  56. Herbert, C.; Ostermair, J.; Herbst, S.; Pauli, P.; Reif, A.; Fallgatter, A.; Herrman, M. It’s Yours! The Negativity Bias in Major Depressive Disorder is Self-Specific: Evidence from Event-Related Brain Potential Studies; DGPPN; German Society for Psychiatry and Psychotherapy, Psychosomatics and Neurology: Berlin, Germany, 2014. [Google Scholar]
  57. Auerbach, R.P.; Stanton, C.H.; Proudfit, G.H.; Pizzagalli, D.A. Self-referential processing in depressed adolescents: A high-density event-related potential study. J. Abnorm. Psychol. 2015, 124, 233–245. [Google Scholar] [CrossRef] [PubMed]
  58. Herbert, C. Processing Preferences for Self-Related Emotional Words as Markers of Cognitive Vulnerability and Well-Being—Cerebral and Behavioral Correlates and Mechanisms. Project Funded by the German Research Foundation (DFG). 2019–2023. Available online: https://gepris.dfg.de/gepris/projekt/415209420 (accessed on 5 June 2022).
  59. Cosmides, L.; Tooby, J. Evolutionary psychology and the emotions. In Handbook of Emotions, 2nd ed.; Lewis, M., Haviland-Jones, J.M., Eds.; Guilford: New York, NY, USA, 2000; pp. 91–115. [Google Scholar]
  60. Lang, P.J. Emotion and motivation: Toward consensus definitions and a common research purpose. Emot. Rev. 2010, 2, 229–233. [Google Scholar] [CrossRef]
  61. Kissler, J.; Assadollahi, R.; Herbert, C. Emotional and semantic networks in visual word processing: Insights from ERP studies. In Understanding Emotions; Elsevier: Amsterdam, The Netherlands, 2006; pp. 147–183. ISBN 0079-6123. [Google Scholar]
  62. Herbert, C.; Ethofer, T.; Fallgatter, A.J.; Walla, P.; Northoff, G. The Janus face of language: Where are the emotions in words and where are the words in emotions? Front. Psychol. 2018, 9, 650. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Jahanshahloo, H.R.; Shamsi, M.; Ghasemi, E.; Kouhi, A. Automated and ERP-Based Diagnosis of Attention-Deficit Hyperactivity Disorder in Children. J. Med. Signals Sens. 2017, 7, 26–32. [Google Scholar] [CrossRef]
  64. Chapman, R.M.; Nowlis, G.H.; McCrary, J.W.; Chapman, J.A.; Sandoval, T.C.; Guillily, M.D.; Gardner, M.N.; Reilly, L.A. Brain event-related potentials: Diagnosing early-stage Alzheimer’s disease. Neurobiol. Aging 2007, 28, 194–201. [Google Scholar] [CrossRef] [Green Version]
  65. Mumtaz, W.; Malik, A.S.; Yasin, M.A.M.; Xia, L. Review on EEG and ERP predictive biomarkers for major depressive disorder. Biomed. Signal Process. Control 2015, 22, 85–98. [Google Scholar] [CrossRef]
  66. De Aguiar Neto, F.S.; Rosa, J.L.G. Depression biomarkers using non-invasive EEG: A review. Neurosci. Biobehav. Rev. 2019, 105, 83–93. [Google Scholar] [CrossRef]
  67. Wu, Y.J.; Thierry, G. How reading in a second language protects your heart. J. Neurosci. 2012, 32, 6485–6489. [Google Scholar] [CrossRef] [Green Version]
  68. Jończyk, R.; Korolczuk, I.; Balatsou, E.; Thierry, G. Erratum to: Keep calm and carry on: Electrophysiological evaluation of emotional anticipation in the second language. Soc. Cogn. Affect. Neurosci. 2021, 16, 642. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Information processing according to cognitive vulnerability models of depression. For further details, please see text and e.g., [10].
Figure 1. Information processing according to cognitive vulnerability models of depression. For further details, please see text and e.g., [10].
Applsci 12 07740 g001
Figure 2. Temporal processing in the EEG as exemplified by the modulation of event-related brain potentials (ERPs).
Figure 2. Temporal processing in the EEG as exemplified by the modulation of event-related brain potentials (ERPs).
Applsci 12 07740 g002
Figure 3. Cascade of processing steps preceding and underlying the self-positivity bias during reading of self-referential and other-referential pronoun-noun and non-referential article-noun pairs according to the results from [39].
Figure 3. Cascade of processing steps preceding and underlying the self-positivity bias during reading of self-referential and other-referential pronoun-noun and non-referential article-noun pairs according to the results from [39].
Applsci 12 07740 g003
Figure 4. Extended cognitive vulnerability model (EEG cortical processing).
Figure 4. Extended cognitive vulnerability model (EEG cortical processing).
Applsci 12 07740 g004
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Herbert, C. Decoding of Processing Preferences from Language Paradigms by Means of EEG-ERP Methodology: Risk Markers of Cognitive Vulnerability for Depression and Protective Indicators of Well-Being? Cerebral Correlates and Mechanisms. Appl. Sci. 2022, 12, 7740. https://doi.org/10.3390/app12157740

AMA Style

Herbert C. Decoding of Processing Preferences from Language Paradigms by Means of EEG-ERP Methodology: Risk Markers of Cognitive Vulnerability for Depression and Protective Indicators of Well-Being? Cerebral Correlates and Mechanisms. Applied Sciences. 2022; 12(15):7740. https://doi.org/10.3390/app12157740

Chicago/Turabian Style

Herbert, Cornelia. 2022. "Decoding of Processing Preferences from Language Paradigms by Means of EEG-ERP Methodology: Risk Markers of Cognitive Vulnerability for Depression and Protective Indicators of Well-Being? Cerebral Correlates and Mechanisms" Applied Sciences 12, no. 15: 7740. https://doi.org/10.3390/app12157740

APA Style

Herbert, C. (2022). Decoding of Processing Preferences from Language Paradigms by Means of EEG-ERP Methodology: Risk Markers of Cognitive Vulnerability for Depression and Protective Indicators of Well-Being? Cerebral Correlates and Mechanisms. Applied Sciences, 12(15), 7740. https://doi.org/10.3390/app12157740

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop