Next Article in Journal
Sound and Silence: The Effects of Environmental Conditions on State Boredom in an Online Study during the COVID-19 Pandemic
Next Article in Special Issue
The Importance of Positive Psychological Factors among People Living with HIV: A Comparative Study
Previous Article in Journal
Photo Activity on Social Networking Sites and Body Dissatisfaction: The Roles of Thin-Ideal Internalization and Body Appreciation
Previous Article in Special Issue
Mediating Effect of Psychological Process Variables on the Relationship between Dysfunctional Coping and Psychopathologies: A Comparative Study on Psychopathologies during COVID-19
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Behavioral Sciences
Volume 12
Issue 8
10.3390/bs12080281
behavsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adaptation of an Emotional Stroop Test for Screening of Suicidal Ideation in Portugal

by
Graça Esgalhado
1,2,
Henrique Pereira
1,3,* and
Patricia Silva
1
1
Department of Psychology and Education, Faculty of Social and Human Sciences, University of Beira Interior, Pólo IV, Estrada do Sineiro, s/n, 6200-209 Covilhã, Portugal
2
Institute of Cognitive Psychology, Human and Social Development (IPCDHS), 3000-115 Coimbra, Portugal
3
Research Centre in Sports Sciences, Health Sciences and Human Development (CIDESD), 5001-801 Vila Real, Portugal
*
Author to whom correspondence should be addressed.
Behav. Sci. 2022, 12(8), 281; https://doi.org/10.3390/bs12080281
Submission received: 11 July 2022 / Revised: 7 August 2022 / Accepted: 9 August 2022 / Published: 12 August 2022
(This article belongs to the Special Issue Clinical Psychology Research and Public Health)
Browse Figures
Versions Notes

Abstract

:
Cognitive instruments, especially those with emotional components, may be useful to address the limitations of self-report scales commonly used to assess suicidal ideation. The aim of this study was to develop an emotional Stroop test for screening suicidal ideation in Portugal. The project was developed in five phases using different samples for each phase. The first two phases were focused on the formulation of the potential words that would compose the slides. For this purpose, five biology teachers (neutral slide) and five mental health professionals (positive and negative slides) were invited to help choose the words that were most representative for each slide. The third phase validated the words defined in the previous phase. In this phase, 300 university students participated (Mage = 21.66; SD = 3.67; 68% female). They rated the words on a Likert scale in terms of their frequency of use, familiarity, level of understanding, and degree of image evocation. In the fourth phase, the researchers developed the complete version of the test, which consists of three slides with neutral, positive, and negative emotional stimuli, consecutively. Finally, in the fifth phase, we validated the final version of the test through a comparative study between a clinical group and a non-clinical group, each one composed by 50 participants (Mage = 32; SD = 9.70; 55% female). Results indicated that the clinical group demonstrated significantly higher scores for depression and suicidal ideation and lower scores for the three Stroop tasks. Words related to negative emotions were strongly correlated with suicidal ideation. Finally, the three Stroop slides explained 74.1% of the variance in suicidal ideation. These findings suggest that this test can be a viable complementary measure in the psychological assessment of suicide ideation, and intervention in the field of suicide prevention in Portugal.

1. Introduction

Suicide is a complex phenomenon which is classified by the World Health Organization as a serious public health concern, since 800,000 people die due to suicide every year [1]. The occurrence of suicide involves multidimensional determinants, such as biological and genetic, psychological, psychiatric, social, and environmental factors [2], with suicidal ideation being one of the main predictors of suicide attempt [3,4]. The relationship between psychological factors and suicidal ideation is complex but involves perceived burdensomeness and internal entrapment, as well as feelings of defeat, external entrapment, and thwarted belonginess [5]. Suicidal ideation is a relatively recurrent and stressful experience, given that about 10% of people have had some type of suicidal thoughts throughout the life cycle [6]. However, anticipating this type of event is not easy, as the psychological assessment of suicidal ideation involves cognitive, emotional, and behavioral measures before the occurrence of suicidal thoughts [7]. Factors such as gender (women have greater suicidal ideation than men) [8], rumination and cognitive inflexibility [9], and previous suicidal ideation and attempt experiences [10] seem to be important predictors of the occurrence of suicidal ideation.
Suicidal ideation refers to a vast set of cognitions, emotions, and behaviors associated with the thought of ending life, often associated with ideas, intentions, motivations, and plans to carry out suicide [11]. Since the assessment of suicidal ideation depends on self-report, several difficulties arise in the operationalization of this assessment, as people tend not to manifest their intentions [12] and tend to deliberately deny or hide their thoughts to avoid interventions or hospitalizations [13]. This reinforces the importance of developing viable alternatives to assess suicidal ideation, namely through the assessment of cognitive and emotional functioning.
The Stroop task [14] is a well-known cognitive task to assess the attentional processing of simultaneous information in the context of selective attention, cognitive set shifting, and inhibition of responses [15,16]. In the original version of the color-word Stroop task (CW-Stroop) [17], three slides are presented. The first slide contains words of the colors “blue”, “green”, “red”, and “yellow” printed in black. The second slide contains rectangles printed in blue, green, red, or yellow (“color-naming” condition). The third slide shows the same words as the first slide printed in an incongruous color (for example, the word “green” printed in blue). Hence, Stroop interference allows the assessment of attentional capacity and bias.
The Emotional Stroop Test introduces changes to the CW-Stroop by replacing colored words with neutral and emotional stimuli (for example, the word “death” printed in blue compared to a neutral word of the same color) [18]. In individuals without psychopathology, the Emotional Stroop Test does not cause attentional bias. However, in individuals with psychopathology, it is common to observe some kind of attentional bias, interpreted as threatening [19]. Several studies have analyzed Stroop interference in patients with anxiety and depression disorders [20,21], post-traumatic stress [22], and suicidal behavior [8,23].
Therefore, this work aims to develop methodological procedures in order to contribute to the evaluation of the Emotional Stroop Test for the detection of suicide ideation as a measure of suicidal risk. Unlike most previous studies that focus on clinical populations [24,25], this study focuses on associating the Stroop task to assess differences in attentional functioning when compared to specific levels of suicide ideation in clinical and non-clinical populations in Portugal. We propose that individuals that report higher levels of suicide ideation will present more difficulties in attentional control, hence being at a higher risk of suicide, because they are unable to inhibit negative thoughts and direct attention toward task-relevant information. In contrast, participants with lower levels of suicide ideation will be able to control attentional functioning and are thus less likely to focus on negative thoughts. Hence, we predict that participants with more suicide ideation will show more difficulties inhibiting negative words.

2. Materials and Methods

This study took place in four phases: (1) obtaining the words for the neutral slide, (2) obtaining the words for the positive and negative slides, (3) word validation, (4) formulation of the Emotional Stroop Test, and (5) validation of the Emotional Stroop Test by comparing a clinical and a non-clinical group. For each phase, different samples were used. We explain ahead each phase with greater detail.

2.1. Phase 1—Words for the Neutral Slide

To carry out the first phase of the investigation, we used five Biology teachers from a school in the municipality of Covilhã, Portugal to become formal judges. All teachers had a university degree in biology as a minimum educational qualification. As this task had a similar structure to the classic Stroop test, the neutral slide consisted of non-activating words. We chose words belonging to the “fruits” category. For the selection of these words, the Portuguese lexicon was used, and 48 words were withdrawn from the search. An authorization was requested to apply the questionnaire to the school principal in order to allow the participation of selected judges who were present with the words and were asked to classify them as belonging or not to the fruit category. The list of the 48 words belonging to the fruit category is presented in Table 1.
Of these 48 words, 10 were selected to be included in the slide. The choice criterion was due to the fact that the ten words were classified by all the judges as belonging to the fruit category and taking into account the four colors to be used in the Emotional Stroop—yellow, red, blue, and green—the chosen words have the same number of syllables (in Portuguese) of the color in which they were be printed (highlighted in Table 1).

2.2. Phase 2—Words for the Positive and Negative Slides

To carry out the second phase of the investigation, an intentional sample was used, consisting of five specialists in the field of mental health. Of these five specialists, three were clinical psychologists, one was a psychiatrist, and last one was child psychiatrist. For the construction of the positive slide and negative slides—a bibliographic research was developed on words associated with the issue in question (suicide ideation) and the stage of the life cycle in which the participant was at. Seventy-four words were presented to the specialists’ panel, who were then asked to classify the words on a Likert-type scale with values ranging from −2 (very negative words) to +2 (very positive words). Other words that the judges considered pertinent could be added to the initial list.
Of the initial 74 words, only 20 were selected. Ten were classified as positive and ten were classified as negative. Each ten words were chosen in accordance with an obtained common score by the five judges of above 60%—i.e., the words were validated by the five judges when their agreement was common for at least three of them. In addition to this criterion, and similar to the neutral blade, the number of syllables that the words have in Portuguese was also taken into account, such that the chosen words had the same number of syllables corresponding to the number of syllables as the color of the words in the which they were printed (Table 2).

2.3. Phase 3—Word Validation

In this phase we used a convenience sample of 300 university students who attended the University of Beira Interior in Portugal. The mean age was 21.66 (SD = 3.67), 68% were female, and 32% were male. Of this 300, 5% studied architecture, 14.7% sociology, 23.3% sports Science, 30.7% psychology, 8.7% marketing and 17.7% medicine.
After obtaining the three sets of words, a protocol consisting of five pages was elaborated. The first page contained a brief explanation of the study, as well as instructions. The second page contained sociodemographic information. The remaining pages presented a brief explanation of the task that was being asked, and three tables with words in which the participants should comment. The protocol application took place in a classroom of the university facilities after informed consent was obtained. Anonymity and confidentiality were guaranteed. This sample assessed the three sets of words stimuli—neutral, negative, and positive—on a Likert-type scale, ranging from 1 (nothing) to 4 (very) in relation to the “Frequency of Use”, (if they were used in everyday life) to “Familiarity” (if they were more or less familiar), to “Level of Understanding” (if their meaning was understood), and to the “Degree of Image Evocation” (if it was easy or difficult to mental visualize the image corresponding to the word). A total of 51% of participants considered all the words frequent, familiar, understandable, and evocable.

2.4. Phase 4—Formulation of the Emotional Stroop Test for Screening of Suicide Ideation

In this phase, we started to create the Stroop test for screening of suicide ideation. Like all Stroop procedures, whether classic or emotional, each slide was printed in A4 format (21 × 30 cm). Each slide contained 100 elements distributed over five columns of 20 elements. All words were randomly distributed, and the same word was not allowed to appear twice in a row in the same column, just as the same color was not allowed to appear twice in a row. The words that made up the three slides of the Emotional Stroop Test for suicide ideation are presented in Table 3.
Figure 1, Figure 2 and Figure 3 are excerpts from the Emotional Stroop Test for screening of suicide ideation in Portuguese. The first slide printed the ten neutral words in colored ink—blue, yellow, green, and red (Figure 1).
The second slide contained the words that were classified as positive, also printed in color. Figure 2 shows an excerpt of that slide.
The third slide contained the words that were classified as negative, also printed in color. Figure 3 shows an excerpt of that slide.

2.5. Phase 5—The Final Study: The Emotional Stroop Test for Screening of Suicide Ideation and The Suicide Ideation Questionnaire

In this final step, we used 100 participants divided into two groups: clinical (n = 50) and non-clinical (n = 50). In the clinical group, the presence of depressive symptoms was defined as an inclusion criterion, assessed through the Beck Depression Inventory [26], and the exclusion criterion was the presence of other diagnosis. In the non-clinical group, the presence of a psychopathological symptoms was used as an exclusion criterion. Participants were aged between 20 and 59 years, with an average age of 32 years (SD = 9.70). With regard to gender distribution, 55 subjects (55%) were female and 45 (45%) were male. Regarding marital status, 67% of participants were single, 30% married, and 3% divorced. A total of 27% of participants were students, 16% were unemployed, 8% were nurses, 6% were operational assistants, 5% were engineers and managers, 4% were social workers, and teachers, 3% were sociologists, 2% were psychologists, and 1% were entrepreneurs. Regarding education, 48% had a university degree, 35% had secondary diploma, and 7% had basic school diploma. Homogeneity tests were used to test similarity between the clinical and non-clinical groups for sociodemographic characteristics. The only main difference was having or not having clinical symptomatology for depression.
A sociodemographic questionnaire was used to characterize the participants on age, gender, professional status, education, and a self-assessment item to detect the presence of psychic comorbidities.
The prevalence of suicidal thoughts and cognitions was assessed using the Suicidal Ideation Questionnaire (SIQ). This instrument is a Portuguese version of the Suicide Ideation Questionnaire, originally created by Davis [27] and translated and adapted to Portuguese [28]. The SIQ allows analyzing the severity of suicidal thoughts in adolescents and adults, and assesses a hierarchy of thoughts related to suicide, which oscillate between little and very serious. It consists of 30 items on a Likert-type scale, ranging from “I never thought” to “I always thought”, in a growing trend of severity. For evaluation purposes, each item is rated from 0 to 6, respectively. The total scores can range from 0 to 180. In the Portuguese version, a score of 23.04 was defined as the average for the population (SD = 25.65). A Cronbach’s alpha coefficient of 0.96 was obtained in the present study, indicating excellent reliability for the SIQ.
The clinical sample was collected from the psychiatric department of a local general hospital. After obtaining a formal consent to access to patients from the ethics committee, the sociodemographic questionnaire, the Emotional Stroop Test created in this study, the Beck Depression Inventory, and the Suicidal Ideation Questionnaire were used to collect data. All ethical principles of anonymity and confidentiality were guaranteed. The non-clinical sample was collected via formal and informal community contacts using the snowball technique to collect participants’ responses to the same measures.
Immediately before applying the set of instruments, a quick detection of any deficiencies in color perception (for example, achromatism, or dichromatism) was performed by presenting color squares (yellow, green, blue, and red) and asking participants to identify the respective colors. Subsequently, some indications and instructions were given in order to ensure the understanding and proper performance of the Emotional Stroop Task by naming the color in which the word was printed aloud as quickly as possible, while ignoring its meaning, in 45 s. The BDI and the SIQ were also applied. Throughout the sample collection procedure, a face-to-face approach was used. Participants needed, on average, 10 to 20 min to answer the questionnaires and requested little support in clarifying any items.

2.6. Data Analyses

Quantitative results were analyzed using IBM SPPS Statistics, Version 27.0. After data cleaning, descriptive statistics, including frequencies, means, and standard deviations were established. In order to compare differences between samples, t-student tests were conducted. Finally, correlational and linear regression analyses were also performed.

3. Results

A normal distribution was found for all variables under study after conducting the Kolmogorov–Smirnov test. Regarding depression symptoms, participants from the non-clinical group scored significantly lower than participants from the clinical group, Mnon-clinical = 3.06, SD = 2.54, and Mclinical = 43.88, SD = 11.97, respectively [t(98) = −23.57; p < 0.001)]. Regarding suicide ideation, participants from the non-clinical group scored significantly lower than participants from the clinical group, Mnon-clinical = 2.22, SD = 3.12, and Mclinical = 83.46, SD = 19.97, respectively [t(98) = −28.41; p < 0.001)] (Table 4).
For the Emotional Stroop Test for screening of suicide ideation, a comparative analysis between non-clinical and clinical groups was performed for all three types of slides with neutral, positive, and negative words, assessing the number of correct words evoked. Results shown in Table 5 indicate that significant differences were obtained for all three conditions (p < 0.001). Non-clinical participants scored higher for all three conditions.
A correlational analysis between the number of negative words on slide three (negative words) and levels of suicide ideation. A very strong, negative, and significant association was found (r = −0.840; p < 0.001). Table 6 describes these correlations.
Finally, simple logistic regression was performed to assess the predictive value of neutral, positive, and negative words in suicide ideation. As shown in Table 7, the model was found to be significant, and indicates that the Stroop slides explain 74.1% of the variance in suicide ideation levels, with greater contribution from the negative words (slide 3).

4. Discussion

The present study sought to develop an Emotional Stroop Test as a suicidal risk measure for the Portuguese population. The test aims to assess differences in attentional functioning when compared to specific levels of suicide ideation. We hypothesized that people with higher levels of suicidal ideation performed worse on the Stroop task. There were then four phases of test formulation in Portuguese and one phase for the validation of the test through the application of the final questionnaire to a clinical sample (n = 50) compared to a non-clinical sample (n = 50). The clinical sample had higher scores for depression and suicidal ideation and lower scores for correct answers on the 3 slides of the Stroop task. Suicidal ideation was strongly correlated with negative words, which in turn contributed to a greater explanation of the variance in levels of suicidal ideation. All results were significant.
Our findings corroborate previous studies that demonstrated that the Emotional Stroop Test is an important tool for the assessment of suicidal ideation, as it fills gaps in commonly used self-report scales [10,29,30]. In fact, this test will be beneficial for the field of psychological assessment in Portugal, as it considers specific criteria and characteristics related to suicidal ideation that other measures are not prepared to assess. This is due to the fact that this test can measure how well a person can use their ability to control their automatic reactions to words or images, which is called the “Stroop effect” [14,18]. From the use of words with positive, negative, and neutral emotional stimuli, it is possible to assess attention bias, response inhibition, and cognitive flexibility—variables that are related to a person’s emotions and affective states and have already been widely related to suicidal behavior [31,32,33].
In fact, the Stroop paradigm has been used to demonstrate attentional bias in different clinical populations. Studies with these populations have shown that participants have longer reaction times when exposed to stimuli associated with their dysfunctional behavior; that is, they tend to name the color of words related to their problems, or emotionally relevant stimuli, more slowly than those with neutral emotional valence. It is also verified in different investigations with the Emotional Stroop Test, that the scores obtained in the three slides by the control group are higher than those of the clinical group. We can infer that participants in the clinical group may have a psychological impairment that influences their performance, possibly with implications for a decrease in the speed of response processing, which explains why they also score less on the neutral slide than participants in the control group. However, it is in the negative slide, as would be expected, that these differences are accentuated, which corroborates the results of different versions of the Emotional Stroop Test that use the scores in the negative slide as an indicator of the interference of the meaning of the words in the execution of the requested task, the naming of the color in which they are written.
There are also operational aspects that support our tool as a useful measure for the assessment of suicidal ideation. The main one is related to the application time. This test can be used as a quick and easy way to detect suicidal tendencies (participants needed, on average, 10 to 20 min to complete the entire protocol). In addition, this type of test is especially effective for assessing these tendencies in people who would not normally present/respond to a suicide assessment [34,35], or for those who might have response biases on the self-report scales, such as people of clinical populations [10,36,37]. Hence, this is a useful and practical test in clinical settings since its application is easy and quick, providing immediate screening clues for suicidal ideation. In addition, our protocol can be administered in a variety of settings, including psychiatric hospitals, private practices, and schools, which increases the tool’s reach in suicide screening.
The information obtained through this Emotional Stroop Test can be used by mental health professionals to assist in the assessment and monitoring of a person’s or group’s suicide risk, which would allow them to direct people with suicidal ideation to appropriate services and determine which prevention measures need to be taken. In fact, different types of treatment can be more or less effective depending on whether or not the person is conscious of the suicidal ideation and what the level of suicidal ideation is [38], which can be verified through the Emotional Stroop Test. Psychology researchers can also benefit from this tool to study suicidal ideation in different populations. With a neuropsychological dimension, this test can be useful to complement analyzes with regard to assessments, comparisons and discovery of patterns and potential risk groups. This is also the case when a differential diagnosis between impulsive behaviors associated with attention deficit with hyperactivity disorder (ADHD) and impulsive behaviors associated with depression, because the Emotional Stroop Test is sensitive to attentional biases caused by negative words related to each disorder.
In addition, we need to understand our test from a public health perspective. In Portugal, around 3 people die every day from intentional self-harm (suicide) [39]. In 2017, suicide represented a loss of about 15 potential years of life [39]. In addition, the country is the first in the European Union with more people to suffer from chronic depression, which has a direct connection with suicidal ideation [40]. According to the Lusa Agency and the National Authority for Medicines and Health Products (Infarmed), the sale of antidepressants has also increased considerably in recent years, reaching an increase of almost 100% between 2010 and 2019 [41]. For these reasons, the prevention of suicidal behavior through population screening and the implementation of intervention strategies should be identified as a public health priority [1], which demonstrates the relevance of this study in the context of public health in the country.
However, despite being an innovative work and with important contributions, this study has its limitations. The first one is related to the validation of the protocol for specific populations. Although our sample had a heterogeneous distribution, the final study was carried out with a diverse audience (different ages, academic degrees, socioeconomic status, etc.), which may have influenced our results. Future studies could benefit from the validation of this test for specific populations (adolescents, elderly people, people from minority groups, among others) and for larger and more representative samples. Validation studies are important to determine whether a psychological test can be used safely, which will contribute to the construction of knowledge on this test in Portugal.
Another limitation is related to the need to understand the colors to perform the test. In this case, those who have difficulties in identifying colors are excluded. This also applies to people with language difficulties or diminished cognitive abilities, who should not be evaluated using this test. For these people, we recommend the use of other assessment measures with a neuropsychological basis and others, which are able to complement the suicide risk assessment with more precision [37]. Finally, this test was based on computer slides and considers the importance of innovation present also in the area of psychological assessment. Future studies could verify the feasibility and relevance of using a mobile application version of this test, which would facilitate its application by professionals who do not have access to a computer at the time of the assessment [42,43].

5. Conclusions

We believe that assessing a person’s attentional functioning is fundamental for suicide screening, given that individuals with suicidal ideations have greater difficulties in inhibiting their impulses than healthy individuals. In this sense, this study sought to present the development and feasibility of an Emotional Stroop Test for screening for suicidal ideation in a clinical and non-clinical sample of the Portuguese population. We describe several advantages of our study, as well as important implications for academic, clinical, and public health practice in the country. We also emphasize the importance of identifying suicidal ideation before any suicide attempt, in order to contribute to the promotion of effective actions for each case. Finally, we discuss the main limitations and future directions for research with this tool. We conclude that this Emotional Stroop Test will be beneficial for the area of psychological assessment in Portugal with a focus on cognitive functions, since the test measures selective attention, executive functions, cognitive flexibility, inhibition, and the attention biases than can appears in case of psychopathology. This test can be included in neuropsychological assessment tools that do not depend on self-harm self-report questionnaires and be an important resource to assess suicidal ideation and assist in suicide prevention in people of Portuguese language.

Author Contributions

Conceptualization, G.E.; methodology, H.P.; software, H.P.; validation, G.E., H.P. and P.S.; formal analysis, H.P.; investigation, G.E.; resources, G.E.; data curation, G.E.; writing—original draft preparation, G.E., H.P. and P.S; writing—review and editing, G.E., H.P. and P.S.; supervision, G.E.; project administration, G.E. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of the University of Beira Interior (Portugal).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available upon request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Suicide. Available online: https://www.who.int/news-room/fact-sheets/detail/suicide (accessed on 6 June 2022).
  2. Turecki, G.; Brent, D.A.; Gunnell, D.; O’Connor, R.C.; Oquendo, M.A.; Pirkis, J.; Stanley, B.H. Suicide and suicide risk. Nat. Rev. Dis. Primers 2019, 5, 74. [Google Scholar] [CrossRef] [PubMed]
  3. Baghani, E.; Fata, L.; Salehi, M.; Hasani, F. Prediction of Suicide Ideation Based on the Attentional Bias in Clinical and Non-clinical Populations. IJPCP 2020, 26, 76–101. [Google Scholar] [CrossRef]
  4. King, C.A.; Jiang, Q.; Czyz, E.K.; Kerr, D.R. Suicidal ideation of psychiatrically hospitalized adolescents has one-year predictive validity for suicide attempts in girls only. J. Abnorm. Child Psychol. 2014, 42, 467–477. [Google Scholar] [CrossRef]
  5. De Beurs, D.; Fried, E.I.; Wetherall, K.; Cleare, S.; O’Connor, D.B.; Ferguson, E.; O’Carroll, R.E.; O’Connor, R.C. Exploring the psychology of suicidal ideation: A theory driven network analysis. Behav. Res. Ther. 2019, 120, 103419. [Google Scholar] [CrossRef]
  6. Nock, M.K.; Borges, G.; Bromet, E.J.; Cha, C.B.; Kessler, R.C.; Lee, S. Suicide and suicidal behaviors. Epidemiol. Rev. 2008, 30, 133–154. [Google Scholar] [CrossRef]
  7. Franklin, J.C.; Ribeiro, J.D.; Fox, K.R.; Bentley, K.H.; Kleiman, E.M.; Huang, X.; Musacchio, K.M.; Jaroszewski, A.C.; Chang, B.P.; Nock, M.K. Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychol. Bull. 2017, 143, 187–232. [Google Scholar] [CrossRef] [PubMed]
  8. Chung, Y.; Jeglic, E.L. Use of the Modified Emotional Stroop Task to Detect Suicidality in College Population. Suicide Life-Threat. Behav. 2016, 46, 55–66. [Google Scholar] [CrossRef] [PubMed]
  9. Miranda, R.; Valderrama, J.; Tsypes, A.; Gadol, E.; Gallagher, M. Cognitive inflexibility and suicidal ideation: Mediating role of brooding and hopelessness. Psychiatry Res. 2013, 210, 174–181. [Google Scholar] [CrossRef]
  10. Cha, C.B.; Najmi, S.; Park, J.M.; Finn, C.T.; Nock, M.K. Attentional bias toward suicide-related stimuli predicts suicidal behavior. J. Abnorm. Psychol. 2010, 119, 616–622. [Google Scholar] [CrossRef]
  11. Thompson, C.; Ong, E.L.C. The Association Between Suicidal Behavior, Attentional Control, and Frontal Asymmetry. Front. Psychiatry 2018, 9, 79. [Google Scholar] [CrossRef]
  12. Mann, J.J.; Currier, D. A review of prospective studies of biologic predictors of suicidal behavior in mood disorders. Arch. Suicide Res. 2007, 11, 3–16. [Google Scholar] [CrossRef] [PubMed]
  13. Mann, J.J.; Currier, D.; Stanley, B.; Oquendo, M.A.; Amsel, L.V.; Ellis, S.P. Can biological tests assist prediction of suicide in mood disorders? Int. J. Neuropsychopharmacol. 2006, 9, 465–474. [Google Scholar] [CrossRef] [PubMed]
  14. Stroop, J.R. Studies of Interference in Serial Verbal Reactions. J. Exp. Psychol. 1935, 18, 643–662. [Google Scholar] [CrossRef]
  15. MacLeod, C.M. Half a century of research on the Stroop effect: An integrative review. Psychol. Bull. 1991, 109, 163–203. [Google Scholar] [CrossRef] [PubMed]
  16. Stein, M.B.; Kennedy, C.M.; Twamley, E.W. Neuropsychological Function in Female Victims of Intimate Partner Violence with and without posttraumatic stress disorder. Biol. Psychiatry 2002, 52, 1079–1088. [Google Scholar] [CrossRef]
  17. Golden, C.J.; Freshwater, S.M. Stroop Color and Word Test: A Manual for Clinical and Experimantal Uses; Skoelting: Chicago, IL, USA, 1978. [Google Scholar]
  18. Williams, J.M.; Mathews, A.; MacLeod, C. The emotional Stroop task and psychopathology. Psychol. Bull. 1996, 120, 3–24. [Google Scholar] [CrossRef]
  19. El Khoury-Malhame, M.; Reynaud, E.; Soriano, A.; Michael, K.; Salgado-Pineda, P.; Zendjidjian, X.; Gellato, C.; Eric, F.; Lefebvre, M.N.; Rouby, F.; et al. Amygdala activity correlates with attentional bias in PTSD. Neuropsychologia 2011, 49, 1969–1973. [Google Scholar] [CrossRef]
  20. Bar-Haim, Y.; Lamy, D.; Pergamin, L.; Bakermans-Kranenburg, M.J.; van Ijzendoorn, M.H. Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychol. Bull. 2007, 133, 1–24. [Google Scholar] [CrossRef]
  21. Epp, A.M.; Dobson, K.S.; Dozois, D.J.; Frewen, P.A. A systematic meta-analysis of the Stroop task in depression. Clin. Psychol. Rev. 2012, 32, 316–328. [Google Scholar] [CrossRef]
  22. Joyal, M.; Wensing, T.; Levasseur-Moreau, J.; Leblond, J.T.; Sack, A.; Fecteau, S. Characterizing emotional Stroop interference in posttraumatic stress disorder, major depression and anxiety disorders: A systematic review and meta-analysis. PLoS ONE 2019, 14, e0214998. [Google Scholar] [CrossRef]
  23. Cha, C.B.; Najmi, S.; Amir, N.; Matthews, J.D.; Deming, C.A.; Glenn, J.J.; Calixte, R.M.; Harris, J.A.; Nock, M.K. Testing the Efficacy of Attention Bias Modification for Suicidal Thoughts: Findings From Two Experiments. Arch. Suicide Res. 2017, 21, 33–51. [Google Scholar] [CrossRef] [PubMed]
  24. Palmer, C.J. Suicide attempt history, self-esteem, and suicide risk in a sample of 116 depressed voluntary inpatients. Psychol. Rep. 2004, 95, 2–4. [Google Scholar] [CrossRef]
  25. Klonsky, E.D.; May, A.M. Differentiating suicide attempters from suicide ideators: A critical frontier for suicidology research. Suicide Life-Threat. Behav. 2014, 44, 1–5. [Google Scholar] [CrossRef] [PubMed]
  26. Campos, R.; Gonçalves, B. The Portuguese Version of the Beck Depression Inventory-II (BDI-II). Eur. J. Psychol. Assess. 2011, 27, 258–264. [Google Scholar] [CrossRef]
  27. Davis, J.M. Suicidal Ideation Questionnaire. J. Psychoeducat. Assess. 1992, 10, 298–301. [Google Scholar] [CrossRef]
  28. Ferreira, J.A.; Castela, M.C. Questionário da Ideação Suicida (QIS). In Testes e Provas Psicológicas em Portugal; Simões, M.R., Gonçalves, M.M., Almeida, L.S., Eds.; Sistemas Humanos e Organizacionais, Lda.: Braga, Portugal, 1999; Volume 2, pp. 123–130. [Google Scholar]
  29. Chung, Y.; Jeglic, E.L. Detecting Suicide Risk Among College Students: A Test of the Predictive Validity of the Modified Emotional Stroop Task. Suicide Life-Threat. Behav. 2017, 47, 398–409. [Google Scholar] [CrossRef]
  30. Tavakoli, P.; Jerome, E.; Boafo, A.; Campbell, K. Attentional Bias Deficits in Adolescent Suicide Attempters During an Emotional Stroop Task: An ERP Study. Front Psychiatry 2021, 12, 1695. [Google Scholar] [CrossRef]
  31. Interian, A.; Myers, C.E.; Chesin, M.S.; Kline, A.; Hill, L.S.; King, A.R.; Miller, R.; Latorre, M.; Gara, M.A.; Stanley, B.H.; et al. Towards the objective assessment of suicidal states: Some neurocognitive deficits may be temporally related to suicide attempt. Psychiatry Res. 2020, 287, 112624. [Google Scholar] [CrossRef]
  32. Richard-Devantoy, S.; Ding, Y.; Lepage, M.; Turecki, G.; Jollant, F. Cognitive inhibition in depression and suicidal behavior: A neuroimaging study. Psychol. Med. 2016, 46, 933–944. [Google Scholar] [CrossRef]
  33. Harfmann, E.J.; Rhyner, K.T.; Ingram, R.E. Cognitive inhibition and attentional biases in the affective go/no-go performance of depressed, suicidal populations. J. Affect. Disord. 2019, 1, 228–233. [Google Scholar] [CrossRef]
  34. Busch, K.A.; Fawcett, J.; Jacobs, D.G. Clinical correlates of inpatient suicide. J. Clin. Psychiatry 2003, 64, 14–19. [Google Scholar] [CrossRef] [PubMed]
  35. Hom, M.A.; Stanley, I.H.; Junior-Joiner, T.E. Evaluating factors and interventions that influence help-seeking and mental health service utilization among suicidal individuals: A review of the literature. Clin. Psychol. Rev. 2015, 40, 28–39. [Google Scholar] [CrossRef] [PubMed]
  36. Nock, M.K.; Park, J.M.; Finn, C.T.; Deliberto, T.L.; Dour, H.J.; Banaji, M.R. Measuring the suicidal mind: Implicit cognition predicts suicidal behavior. Psychol. Sci. 2010, 21, 511–517. [Google Scholar] [CrossRef] [PubMed]
  37. Moreno, M.; Gutiérrez-Rojas, L.; Porras-Segovia, A. Implicit Cognition Tests for the Assessment of Suicide Risk: A Systematic Review. Curr. Psychiatry Rep. 2022, 24, 141–159. [Google Scholar] [CrossRef] [PubMed]
  38. Rudd, M.D.; Joiner, T.; Rajab, H.M. Treating Suicidal Behavior: An Effective, Time-limited Approach; The Guilford Press: New York, NY, USA, 2001. [Google Scholar]
  39. Instituto Nacional de Estatística. Taxa de Mortalidade por Lesões Autoprovocadas Intencionalmente (Suicídio) por 100.000 Habitantes (N.º). Available online: https://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ine_indicadores&indOcorrCod=0003736&contexto=bd&selTab=tab2 (accessed on 6 June 2022).
  40. Eurostat. 7.2% of People in the EU Suffer from Chronic Depression. Available online: https://ec.europa.eu/eurostat/en/web/products-eurostat-news/-/edn-20210910-1 (accessed on 6 June 2022).
  41. Autoridade Nacional do Medicamento e Produtos de Saúde. Evolução da pandemia em Portugal. Available online: https://www.infarmed.pt/documents/15786/3552218/Infarmed+Not%C3%ADcias+n%C2%BA+71+julho+2020/0bd46c6f-7515-1865-f8bf-c95c3e56df60?version=1.2 (accessed on 6 June 2022).
  42. Baucom, B.R.; Georgiou, P.; Bryan, C.J.; Garland, E.L.; Leifker, F.; May, A.; Wong, A.; Narayanan, S.S. The promise and the challenge of technology-facilitated methods for assessing behavioral and cognitive markers of risk for suicide among US Army National Guard Personnel. Int. J. Environ. Res. Public Health 2017, 14, 361. [Google Scholar] [CrossRef] [PubMed]
  43. Meliá, R.; Francis, K.; Hickey, E.; Bogue, J.; Duggan, J.; O’Sullivan, M.; Young, K. Mobile Health Technology Interventions for Suicide Prevention: Systematic Review. JMIR mHealth uHealth 2020, 8, 1. [Google Scholar] [CrossRef]
Behavsci 12 00281 g001 550
Figure 1. The ten neutral words.
Figure 1. The ten neutral words.
Behavsci 12 00281 g001
Behavsci 12 00281 g002 550
Figure 2. The ten positive words.
Figure 2. The ten positive words.
Behavsci 12 00281 g002
Behavsci 12 00281 g003 550
Figure 3. The ten negative words.
Figure 3. The ten negative words.
Behavsci 12 00281 g003
Table
Table 1. Neutral words presented to the specialists’ panel.
Table 1. Neutral words presented to the specialists’ panel.
Fruits
FigBlackberryPersimmonMedlar
CherryBlueberryRaspberryApple
PomegranateCurrantNectarinePear
DateStrawberryPinionBanana
GrapeOlivePeanutMelon
LimeGuavaPistachioWatermelon
LemonLycheeCashewSloe
CiderPineappleRaisinsOrange
TangerineWalnut MangoPlumQuince
GrapefruitPapayaApricotPeach
AvocadoCoconutChestnutAlmond
Passion FruitKiwiHazelnutArbutus
Note: Words belonging to the Fruit category, to integrate the neutral slide are highlighted in black.
Table
Table 2. Positive and negative words presented to the specialists’ panel.
Table 2. Positive and negative words presented to the specialists’ panel.
Words
CryLifeDepressionQualitiesLossSuccess
SunBurdenHelpJoyChangeVictory
WealthTryAcheConflictAlcoholTestament
DeathMourningCharmAnguishBeautySurvive
AdolescenceWealthUnemploymentAffableDevelopmentRejection
CrisisLoveLonelinessAggressivenessPraiseParasuicide
FarewellAppealSalvationEmploymentFriendshipAnxiety
DrugsPassingLaughterSexualitySadnessConfusion
ColorHealthHopeEndRecreationIdentity
WeaponSeparationDiseaseHumorSelf-harmDefects
HappinessTransformationHangingGrowthSacrificeYouth
IsolationPillsStruggleImpulsivityCommunicationHopelessness
SufferingSuicide
Note: Words belonging to the positive and negative categories to integrate the correspondent slides, are highlighted in black.
Table
Table 3. Neutral, positive, and negative words.
Table 3. Neutral, positive, and negative words.
Neutral BladePositive BladeNegative Blade
TangerineLoveDeath
BananaJoyFarewell
KiwiVictoryMourning
WatermelonHealthDepression
OrangeLifePassing
AppleLaughterLoss
GrapeSuccessSadness
CherryWealthWeapon
LemonHappyDisease
PearLeisureAnguish
Table
Table 4. Depression and suicide ideation scores by non-clinical and clinical groups.
Table 4. Depression and suicide ideation scores by non-clinical and clinical groups.
VariableGroupnM (SD)t (df)pCohen’s d
DepressionNon-Clinical503.06 (2.54)−23.57 (98)0.000 *81.240
Clinical5043.88 (11.97)
Suicide IdeationNon-Clinical502.22 (3.12)−28.41 (98)0.000 *40.820
Clinical5083.46 (19.97)
* p < 0.001.
Table
Table 5. Results for neutral, positive, and negative words scores by non-clinical and clinical groups.
Table 5. Results for neutral, positive, and negative words scores by non-clinical and clinical groups.
VariableGroupnM (SD)t (df)pCohen’s d
Neutral wordsNon-Clinical5060.64 (9.41)5.92 (98)0.000 *−9.280
Clinical5051.56 (5.84)
Positive wordsNon-Clinical5064.34 (7.53)−11.61 (98)0.000 *−15.740
Clinical5048.60 (5.93)
Negative wordsNon-Clinical5066.32 (7.59)14.64 (98)0.000 *−20.460
Clinical5045.86 (6.32)
* p < 0.001.
Table
Table 6. Correlation Matrix.
Table 6. Correlation Matrix.
1234
1. Suicide Ideation-
2. Slide 1 (Neutral) −0.558 ** -
3. Slide 2 (Positive)−0.773 **0.844 **-
4. Slide 3 (Negative)−0.840 **0.801 **0.952 **-
** p < 0.001.
Table
Table 7. Simple linear regression analysis predicting the suicide ideation.
Table 7. Simple linear regression analysis predicting the suicide ideation.
VariableBSE Bβ
Slide 1 (Neutral)1.5150.4610.318 *
Slide 2 (Positive)0.0130.7900.003
Slide 3 (Negative)−3.8240.593−1.098 **
R20.741
F91.728 *
* p < 0.05; ** p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Esgalhado, G.; Pereira, H.; Silva, P. Adaptation of an Emotional Stroop Test for Screening of Suicidal Ideation in Portugal. Behav. Sci. 2022, 12, 281. https://doi.org/10.3390/bs12080281

AMA Style

Esgalhado G, Pereira H, Silva P. Adaptation of an Emotional Stroop Test for Screening of Suicidal Ideation in Portugal. Behavioral Sciences. 2022; 12(8):281. https://doi.org/10.3390/bs12080281

Chicago/Turabian Style

Esgalhado, Graça, Henrique Pereira, and Patricia Silva. 2022. "Adaptation of an Emotional Stroop Test for Screening of Suicidal Ideation in Portugal" Behavioral Sciences 12, no. 8: 281. https://doi.org/10.3390/bs12080281

APA Style

Esgalhado, G., Pereira, H., & Silva, P. (2022). Adaptation of an Emotional Stroop Test for Screening of Suicidal Ideation in Portugal. Behavioral Sciences, 12(8), 281. https://doi.org/10.3390/bs12080281

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop