Next Article in Journal
Process Evaluation of “The Hygienic Family” Intervention: A Community-Based Water, Sanitation, and Hygiene Project in Rural Malawi
Next Article in Special Issue
A Data-Driven Optimized Mechanism for Improving Online Collaborative Learning: Taking Cognitive Load into Account
Previous Article in Journal
Occurrence and Fate of Triclosan and Triclocarban in Selected Wastewater Systems across Durban Metropolis, KwaZulu-Natal, South Africa
Previous Article in Special Issue
Validation of an Academic Self-Attribution Questionnaire for Primary and Secondary School Students: Implications of Gender and Grade
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 11
10.3390/ijerph19116770
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Psychometric Analysis and Contribution to the Evaluation of the Exams-Related Emotions Scale in Primary and Secondary School Students

by
Ana Isabel Obregón-Cuesta
1,
Luis Alberto Mínguez-Mínguez
2,*,
Benito León-del-Barco
3,
Santiago Mendo-Lázaro
3,
Jessica Fernández-Solana
4,
Josefa González-Santos
4 and
Jerónimo J. González-Bernal
4
1
Department of Mathematics and Computing, University of Burgos, 09001 Burgos, Spain
2
Department of Education Sciences, University of Burgos, 09001 Burgos, Spain
3
Department of Psychology and Anthropology, University of Extremadura, 10071 Caceres, Spain
4
Department of Health Sciences, University of Burgos, 09001 Burgos, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(11), 6770; https://doi.org/10.3390/ijerph19116770
Submission received: 3 May 2022 / Revised: 23 May 2022 / Accepted: 28 May 2022 / Published: 1 June 2022
(This article belongs to the Special Issue Teaching and Learning Process: Psychological Variables in Education, New Applied Technologies and Physical Activity)
Review Reports Versions Notes

Abstract

:
The objective of this research was to perform a construct validity, and a psychometric analysis of the Exams-related Emotions Scale (EES), analyze the differences in their scores regarding gender and academic year in primary and secondary education student, as well as study the relationship between emotions and academic performance. During the construction and analysis of the psychometric characteristics of the scale, an Exploratory Factor Analysis (EFA) and a Confirmatory Factor Analysis (CFA) were performed. To test EES scores based on gender and school year, the T-Student test for independent samples and ANOVA were used, respectively. To verify the relationship between the scores of the different types of emotions and academic performance, the Pearson correlation test was performed. A total of 562 students belonging to the 5th (n = 228) and 6th (n = 186) primary school year and the 1st (n = 134) and 2nd (n = 94) secondary school year participated in the research. Age between 10 and 15 years old (mean = 11.66, standard deviation = 1.206) both males (50.5%) and females (49.5%). The results offered support for the three-factor structure. The analysis of invariance with respect to gender showed that the factor structure was invariant. Boys scored higher on the positive emotions factor and lower scores on anxiety than girls. Regarding school year, negative emotions and anxiety related to exams increase in the secondary courses compared to Primary while for positive emotions it is primary school students who obtain higher scores. The correlation coefficient between negative emotions (as well as anxiety) and school performance is negative whereas the correlation coefficient between positive emotions and academic performance is positive. EES scale is an instrument with scientific rigor and with adequate reliability and validity to be able to know the emotions that primary and secondary school students suffer when they are subjected to evaluation processes in the academic context.

1. Introduction

Various investigations contemplate the situation in which students find themselves when they are subjected to an evaluation test or an exam. Facing a situation like this is a complex process in which various cognitive and behavioral strategies are involved with the sole purpose of managing the demands, both internal and external, that are placed an individual [1,2,3].
Most students, when they are at exam time, tend to experience high anxiety, which can also have a negative impact on academic performance and their health [4,5,6,7]. In Spain it is estimated that between 15 and 25% of primary and secondary school students have high levels of anxiety before an exam. Confirmed, likewise, in the study of Hernández [8] where the presence of anxiety before an exam, and possible need for specialized help, in 20.84% of a sample of 28,559 students from 16 Spanish universities is highlighted [8,9].
Anxiety can be described as an emotional manifestation with a multicausal origin. This can be triggered by the negative perception of an event, where the person focuses on the possible harmful consequences. Likewise, it can have negative repercussions on the individual, cause a probable academic failure, decrease the self-confidence and motivation of the student, generate a fear of criticism, and in some cases even the abandonment of the subject or complete academic year; being able to interfere with cognitive processes and interpersonal relationships [2,9,10,11,12,13,14]. Anxiety about an exam is manifested through a series of negative emotional reactions that constitute a serious problem, due to the great impact it has on performance, as well as the high percentage of students who suffer from it. It is very important to detect school failure due to this circumstance, and not to problems related to learning [4,9,15].
The relationship between anxiety and student performance has been a major research objective in recent years, but minimal attention has been paid to other emotions. Throughout the twentieth century, studies have been carried out in which emotions are related to exams, and to academic failure or success, although these are very few and far between [16,17]. The emotions felt by students are of great importance for the short- and long-term development of learning processes, the genesis of interest and the acquisition of knowledge. The emotions suffered by students are multiple and very varied, with a lack of research in all those, both positive and negative, different from anxiety [16,17].
According to the Three-Dimensional Theory of Anxiety, the emotional reactions that occur can be observed on three levels; subjective cognitive (experience), physiological (bodily changes) and motor (observable behaviors). These manifest, for example, in feelings of discomfort, worry, negative thoughts, increased heart and respiratory rate, muscle tension, hyperactivity or crying, among others [9,18].
It is known that in the face of both a negative and positive emotion, a series of strategies are generated at the cognitive level to regulate them. These strategies of a cognitive nature are called cognitive emotion regulation strategies (CERS). CERS can help modulate an emotional response to a stressful situation through a cognitive approach to emotional information received by the person [2,19,20].
Emotional regulation can be defined as the intrinsic and extrinsic processes that are responsible for evaluating and modifying emotional reactions, whether positive or negative, with the aim of fulfilling a personal goal [2,20,21,22,23]; and that is undoubtedly related to emotional intelligence [2,19]. Emotional intelligence has been described as an important factor in achieving academic success. It is directly linked to the control of emotions, the management of frustration, academic performance, and emotional flexibility among others. Therefore, it is concluded that the deficit in emotional intelligence skills can have a special impact on students [19,24,25].
To detect existing deficits in the students’ emotional regulation when undergoing an exam, reliable and valid assessment instruments aimed at specific groups are required. Considering the great relevance of this aspect in the educational context, the main objective proposed is to perform a construct validity, and a psychometric analysis of the Exams-related Emotions Scale (EES) in a sample of primary and secondary school students. Thus, we propose the following hypotheses: (1) the EES is a tool with scientific rigor and adequate validity and reliability to assess the emotions experienced by students in primary and secondary education when taking exams; (2) there are differences in the emotions experienced around the exams according to gender (with boys experimenting higher positive emotions and lower anxiety than girls) and school year (increasing negative emotions an anxiety with years); (3) Negative emotions and anxiety negatively affect academic performance, while positive emotions positively affect it.

2. Materials and Methods

2.1. Participants

The sample consisted of 562 students of Compulsory Primary Education (EPO) and Compulsory Secondary Education (ESO), aged between 10 and 15 years (Mean = 11.66; Standard Deviation = 1.21). Distributed in 284 subjects belonged to the male gender (50.5%) and 278 to the female (49.5%). EPO students (n = 334) were fifth (n = 228) and sixth (n = 186), and ESO students (n = 148) were in the first (n = 134) and second year (n = 94). The sample was collected from 5 different centers, public (n = 4) and private (n = 1), in the Autonomous Community of Castilla y León.
The selection of the sample was made by conglomerates.

2.2. Instruments

Exams-Related Emotions Scale (EES)

This scale was designed with the aim of evaluating the emotions that students experience when taking exams. The scale consists of 31 items in Likert format with five intervals in numerical form from 1 (Never) to 5 (Always). The items were intended to adequately show the most relevant contents of the construct to be evaluated (Supplementary Materials).
In this sense, the scale evaluates both positive and negative emotions associated with the different moments (before, during and after) of the performance of a test or exam [17,26]. Emotions such as hope, enjoyment, pride, anger, anxiety, shame, or hopelessness. Traditional assessment has considered only anxiety as an emotion in test situations. With the EES scale the evaluation of emotions is extended by also taking into account motivational components and analyzing other emotions experienced by students, both positive and negative, in environments of academic achievement [16].

2.3. Procedure

Following the ethical guidance of the American Psychological Association regarding consent, confidentiality and anonymity in the responses, the directors of the educational centers were first contacted and explained the objectives of the research.
Once the collaboration was accepted, the participants were contacted in the classrooms, and after obtaining the informed consent, they proceeded to fill in the scales. Its completion was anonymous, guaranteeing the confidentiality of the data obtained and its exclusive use for research purposes. The administration of the scales was carried out during school hours, offering the pertinent instructions. The anonymous nature of the investigation was emphasized. The questionnaires were completed individually in a suitable environment and without distractions. The process of completing the questionnaires lasted approximately 15 min.
No data was lost as the data was collected using an online form in which all responses are mandatory.
No questionnaire was rejected.
All the students of the grades selected by the principals were included in the research. No boy or girl was excluded based on their culture, language, religion, race, disability, sexual orientation, ethnicity, gender or age.
The Bioethics Committee of the University of Burgos approved the research, (Reference UBU 032/2021), respecting all the requirements established in the Declaration of Helsinki of 1975.

2.4. Data Analysis

Initially, for the construction and analysis of the psychometric characteristics of the scales, an exploratory factor analysis (EFA) was performed. Once the EFA was performed, the factorial structure found was confirmed by means of a confirmatory factor analysis (CFA). The reliability of the scale factors was calculated through Cronbach’s alpha, Composite Reliability coefficients, McDonald’s Omega and Extracted Mean Variance. The EFA was carried out using the SPSS-21 program; and for the AFC the AMOS-21 program was used.
To compare the scores obtained in the EES according to gender, the parametric independent samples T test was used, while the analysis according to the academic year was carried out using the one-factor ANOVA test. To study the correlation between the different scores of the emotions obtained with the EES scale and school performance, the Pearson test was performed. A statistical significance value of p < 0.05 was established using SPSS version 25 software (IBM-Inc., Chicago, IL, USA).

3. Results

The original sample (n = 562) was divided into two randomly extracted subsamples (n1 = 276 and n2 = 276). The first (n1) was used to perform the EFA and the second (n2) as a validation sample in the CFA. Both subsamples were equivalent as a function of gender, χ2(1) = 0.359, p = 0.549, and age, t (560) = 0.285, p = 0.776

3.1. Exploratory Factor Analysis of the Exam Emotions Scale (EES)

The sample adequacy measure (KMO = 0.828) and Bartlett’s sphericity test (χ2 = 1826.282(66), p < 0.001) justified the factor analysis. Using Kaiser’s rule [27] eigenvalues greater than the unit and the extraction method of main components with oblimin rotation, a solution of three factors was obtained (Table 1) that together explained 53.6% of the variance.
In the case of oblique rotations, we start from the assumption of correlation between the new factors. Obllimin rotation has been used as it allows to establish hierarchical relationships between the factors.
The first factor, “Negative Emotions” (12 items) explained 35.4% of the variance and collected information about the negative emotions that are experienced when performing an exam, emotions such as shame, hopelessness, or anger. Some items examples of this factor: “Before the exam I get depressed because I feel that I do not have much hope of passing the exam”; “During the exam I get angry”; “After the exam I feel embarrassed.” The second factor “Positive Emotions” (12 items) explained 12.2% of the variance, and collected information about the positive emotions experienced when performing an exam: hope, pride, enjoyment... Some items: “Before the exam I am so proud of how I prepared that I want to start the exam right now”; “During the exam I am happy to be able to face the exam”; “After the exam I am brimming with enthusiasm.” The third factor “Anxiety” (7 items) explained 6% of the variance and collected information related to anxiety before the exams. “When the exam begins, my heart begins to accelerate”; “During the exam I am very nervous”; “During the exam I am worried about whether I will pass the exam.”
Cronbach’s alpha of factors 1 (α = 0.915), 2 (α = 0.892) and 3 (α = 0.866) demonstrated good internal consistency.

3.2. Confirmatory Factor Analysis

The CFA of the Exams-related Emotions Scale is performed with the second subsample (n2 = 272). It is intended to confirm the structure of three factors found in the AFE and if these are related or independent.
Using the maximum likelihood method and taking into account some of the most commonly used adjustment indices (χ2, χ2/g.l, CFI, TLI, RMSEA y SRMR), four models (M) of emotions related to exams are tested: M1: Three related factors; M2: Two related factors that brings together the first two factors and one independent (Anxiety); Two related factors that bring together factors two and three, and one independent (Positive Emotions); M4 Three independent factors. For optimal adjustment the χ2 must acquire non-significant values (p > 0.05) [28], el χ2/g.l, is considered acceptable when it is less than 5 [29], values higher than 0.90 of the incremental indices (CFI and TLI) and ≥ 0.08 of the RMSEA [30], and the SRMR [31], are considered acceptable.
All models (Table 2) have a significant chi-square value (p < 0.05). Models 2 and 4 are discarded, since the values of significant chi square (p < 0.05) and the CFI, TL, RMSEA and SRMR indices do not present suitable values. The CFI, TLI indices of models 1 and 3 have values equal to or greater than 0.90, with model 1 being the one that presents a better fit, with a value of χ2/g.l, lower and higher indices of adjustment CFI and TLI and values less than 0.07 of the RMSEA and SRMR indicators (Table 2).
The t-values (range 6.55 to 13.09) of the non-standardized regression coefficients of model 1 are statistically significant. The range of standardized coefficients of factor one EP (0.487–0.814), two (0.548–0.813) and three (0.573–0.815), show that the indicators are consistent for the measurement of constructs, these being clearly related (Table 3).
Standardized coefficients of the three factors of emotions before the exams.

3.3. Gender-Invariant Analysis

Next, a multigroup analysis is performed to determine if the model of three related factors is gender invariant (146 females and 126 males). The comparison shows no differences p < 0.05 in the chi-square value between the different models and the values found in the ΔCFI in the unrestricted model with differences of less than 0.01 of the CFI indices between the four models (Table 4), indicate that the factorial loads of the questionnaire are equivalent for girls and boys.
The coefficients of Average Variance Extracted (AVE) and Composite Reliability (CR) indicate that the model of three related factors presents sufficient evidence of reliability (F1 [4 items]: AVE = 0.519. CR = 0.896; F2 [4 items]: AVE = 0.524, CR = 0.813; F3 [7 items]: AVE = 0.477, CR = 0.863.)

3.4. Analysis of the EES by Gender

The results of the inferential analysis showed statistically significant differences in positive emotions and anxiety based on gender, but not in negative emotions (Table 5). More specifically, male participants scored higher on the positive emotions factor (p = 0.008) and lower scores on anxiety (p < 0.001).

3.5. Analysis of the EES According to the School Year

Statistically significant differences were found depending on the academic year in all factors (Table 6). In general, negative emotions related to exams increase in the Secondary courses compared to Primary. As for positive emotions, the opposite occurs, and it is primary school students who obtain higher scores. Finally, regarding anxiety, the same pattern is repeated as with negative emotions, with older Secondary students obtaining higher scores than Primary students.
The data were subjected to the Bonferroni post hoc test to check between which groups the differences detected in the ANOVA test are established. In the negative emotions factor, the main differences are established between 1st year of Secondary with 5th grade of Primary (I-J = 3.68233; p = 0.019) and with 6th of Primary (I-J = 5.26007; p < 0.001). Also, between 2nd year of Secondary and 6th of Primary (I-J = 5.18211; p < 0.001). Regarding the positive emotions factor, significant differences were observed between the means of scores of 1st of Secondary with 5th of Primary (I-J = −4.16226; p = 0.001) and with 6th of Primary (I-J = −5.27219; p < 0.001). Likewise, among the means of scores of 2nd year of Secondary with 5th of Primary (I-J = −5.59129; p < 0.001) and with 6th of Primary (I-J = −6.70121; p < 0.001). Finally, in relation to the third factor anxiety, the differences are established between 1st of Secondary and 6th of Primary (I-J = 2.80067; p = 0.003).

3.6. Analysis of the EES According to the School Performance

Statistically significant correlation is observed (Table 7) between all types of emotions and academic performance. The correlation coefficient between negative emotions and school performance is negative, indicating that, the higher the negative emotions, the lower the performance or average grade (r560 = −0.406; p < 0.001). The same happens with anxiety, the greater the anxiety, the lower the performance or average grade. (r560 = −0.212 p < 0.001). In contrast, the correlation coefficient between positive emotions and academic performance is positive, indicating that, the higher the positive emotions, the higher the performance or average grade. (r560 = 0.385; p < 0.001).

4. Discussion

The main objective of this study was to perform a construct validity, and a psychometric analysis of a questionnaire to evaluate the emotions felt by students in primary and secondary education when they are faced with an evaluation situation or exam. The relevance of the study lies in the need to develop an instrument for this specific population in the educational context, since academic performance can be affected by the manifestation of a series of negative emotional reactions to exams, such as the appearance of anxiety [9,10,14,25]; this circumstance may lead to school failure, interference in cognitive processes and interpersonal relationships [4,21,32].
The results of the exploratory and confirmatory factor analysis performed showed a good factor structure, internal consistency, and validity of the instrument. In addition, the EES is gender invariant, so it is an appropriate instrument for the evaluation of exam-related emotions in primary and secondary education students.
To date, there is no specific instrument that evaluates emotions in the face of the examinations suffered by children and adolescents in primary and secondary education in the Spanish school context, with the importance of emotional regulation in these stages of development [33,34].
There are several scales that measure stress, anxiety, or emotional regulation, and that have been used in many cases in the academic context but focused mainly on university-level students. It can be found the Pre-Examination Anxiety and Uncertainty Coping Scale (COPEAU) [5]; Academic Stress Inventory (IEA), validated in Spain and designed specifically for the evaluation of academic stress in university students [9]; Questionnaire of emotional regulation for children and adolescents (ERQ-CA), validated in the Spanish population in the school context between 10 and 19 years [35,36]; Depression Anxiety Stress Scale (DASS-21) [37]; Scale of Cognitive Anxiety against exams (S-CTAS), Spanish version in university students [7,38,39]; Inventory of exam anxiety (TAI), validated in Spanish and adapted to university students [40]; Inventory of anxiety against the exams-state (STAI), version in Spanish with very good validity to measure anxiety before the exams in university students [41,42]; and Westside Test Anxiety Scale [43].
Likewise, it should be noted that the main contribution of this project is that it allows the valid and reliable evaluation of emotions before the exams in the educational context of primary and secondary education, in order to intervene and improve variables such as hope, joy, anxiety, pride, anger, shame or hopelessness when the student faces a situation of academic evaluation [17].
It is important to highlight Pekrun’s Theory of Value of Controlling Emotions [44,45], as it indicates that emotions and values related to achievement can influence students’ learning processes and academic performance [17,46]. In turn, the expression of different emotions is directly related to the academic self-concept of each student; defined academic self-concept as the self-perception of the general capacity in a specific field through personal experience and interpretation of the environment [46].
In previous research conducted with samples of students from both the university level and from secondary and primary education, a statistically significant relationship was found between the level of anxiety and emotions with the situation of facing an exam [9,35,47,48,49]. In addition, a review with meta-analysis allows to clarify that between the ages of 11 and 14, students show a greater negative relationship between anxiety about exams and academic performance compared to upper secondary and university courses [49].
Regarding the second objective raised in the research, based on the analysis of the differences between gender, regarding the development of emotions before the exams, the results show that there are statistically significant differences in terms of positive emotions and anxiety depending on gender, but not with respect to negative emotions. Male students scored higher on positive emotions and lower scores on anxiety. These results coincide with those obtained in the study by Álvarez et al. [9], in which it also finds significant differences in terms of gender, with the female gender having the highest score in anxiety indexes and negative emotions, despite having a higher level of resources to face them. At the same time, in another study where these same results are also obtained, better academic results are evidenced in the female gender compared to the male gender [7]. In the study of Gao et al. [37] Higher levels of depressive symptoms in males are also evident.
In regard to the academic year, statistically significant results were also found, in such a way that negative exam-related emotions increase as the course is higher [50]. In the same way, anxiety increases in secondary courses compared to primary as can be corroborated in recent research [49]. Positive emotions on the other hand are predominant in primary education students with respect to those in secondary education. The change of school year and the transition from primary to secondary school has been a topic of interest for many years for people in the school environment and for researchers, as it represents a change of great importance for the lives of students. It has been observed that school year change is usually well tolerated by most students but that their happiness and well-being clearly decreases when transitioning to secondary school [51,52,53].
At the same time, a strong relationship has been observed between the decrease in academic performance and the school transition period according to the literature, although there is still no causal relationship between them [54]. The drop in academic performance may also be due to declining self-concept, motivation, social and emotional difficulties, and the increasingly competitive environment when faced with higher courses [55].
The results show a statistically significant relationship between anxiety and negative emotions with respect to academic performance, showing a negative correlation, as in the study by Jordan, JA et al. [56] where it mentions a negative correlation between stress and academic performance; which can be explained by the hypothesis of cognitive damping [57].

Limitations

The statistically significant differences between gender and the academic year, in terms of emotions related to exams, highlight the importance of carrying out an evaluation that highlights the emotional difficulties that each student suffers when undergoing an exam, in order to intervene effectively and that this does not negatively affect their academic performance [4,7]. Therefore, the EES facilitates a correct evaluation of the emotions related to the exams in the context of primary and secondary education. But although the EES presents sufficient reliability and validity, it also presents a series of limitations regarding the difficulty of generalizing the results to other population groups, which compromises the external validity (population and ecological) of the questionnaire, as well as the difficulty of establishing convergent and discriminant validity evidence. Therefore, the replication and expansion of the study would allow the possibility of establishing new evidence of discriminant and convergent validity.

5. Conclusions

The present study demonstrates the psychometric properties of EES scale to assess the exam-related emotions of primary and secondary school students. Therefore, this research provides an instrument with scientific rigor and with adequate reliability and validity to be able to know the emotions that primary and secondary school students suffer when they are subjected to evaluation processes in the academic context. Likewise, the statistically significant differences found in the research, in terms of emotions and academic performance of students, as well as in gender and academic year, provide current information, relevant for the application of interventions aimed at preventing negative emotions and anxiety related to exams from negatively impacting on academic performance and leading to school failure.
However, future researchers should analyze the EES factor structure with different student populations, with the aim of improving the tool. In addition, future studies should analyze the structure of invariance with respect to other variables like region, County, center size or type of center (e.g., private, public or concerted).

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19116770/s1.

Author Contributions

Conceptualization, A.I.O.-C., B.L.-d.-B., S.M.-L., L.A.M.-M. and J.J.G.-B.; methodology, A.I.O.-C., J.F.-S., B.L.-d.-B. and S.M.-L.; software, J.F.-S., B.L.-d.-B. and S.M.-L.; validation, J.F.-S., B.L.-d.-B., S.M.-L. and J.J.G.-B.; formal analysis, J.F.-S., B.L.-d.-B. and S.M.-L.; investigation, A.I.O.-C., J.F.-S., B.L.-d.-B., S.M.-L. and J.J.G.-B.; resources, A.I.O.-C., B.L.-d.-B., S.M.-L. and J.J.G.-B.; data curation, J.F.-S., B.L.-d.-B. and S.M.-L.; writing—original draft preparation, J.F.-S.; writing—review and editing, J.F.-S.; visualization, J.F.-S., L.A.M.-M. and J.G.-S.; supervision, B.L.-d.-B., S.M.-L. and J.J.G.-B.; project administration, A.I.O.-C., B.L.-d.-B., S.M.-L. and J.J.G.-B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the University of Burgos (UBU 032/2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Heredia, D.; Piemontesi, S.; Furlan, L.; Pérez, E. Adaptación de la Escala de Afrontamiento ante la ansiedad e incertidumbre pre-examen: (COPEAU). Aval. Psicol. 2008, 7, 1–9. [Google Scholar]
  2. Dominguez-Lara, S. Influencia de la inteligencia emocional y personalidad en las estrategias cognitivas de regulación emocional en la desaprobación de exámenes en estudiantes de psicología. Cultura 2018, 32, 225–259. [Google Scholar] [CrossRef]
  3. Aysan, F.; Thompson, D.; Hamarat, E. Test anxiety, coping strategies, and perceived health in a group of high school students: A Turkish sample. J. Genet. Psychol. 2001, 162, 402–411. [Google Scholar] [CrossRef]
  4. Bausela Herreras, E. Ansiedad ante los exámenes: Evaluación e intervención psicopedagógica. Rev. Venez. Educ. 2005, 9, 553–557. [Google Scholar]
  5. Dominguez-Lara, S.A.; Merino-Soto, C. Versión breve de la Escala de afrontamiento ante la ansiedad e incertidumbre preexamen (COPEAU) en universitarios peruanos. Educ. Médica 2018, 19, 67–72. [Google Scholar] [CrossRef]
  6. Junaid, M.A.L.; Auf, A.I.; Shaikh, K.; Khan, N.; Abdelrahim, S.A. Correlation between Academic Performance and Anxiety in Medical Students of Majmaah University—KSA. J. Pak. Med. Assoc. 2020, 70, 865–868. [Google Scholar] [CrossRef]
  7. Dubuc, M.-M.; Aubertin-Leheudre, M.; Karelis, A. Gender Differences in Academic Performance of High School Students: The Relationship with Cardiorespiratory Fitness, Muscle Endurance, and Test Anxiety. Int. J. Prev. Med. 2020, 11, 201. [Google Scholar]
  8. Hernández, J. Ansiedad ante los exámenes: Una evaluación de sus manifestaciones en los estudiantes universitarios españoles. Education 2005, 1, 13–18. [Google Scholar]
  9. Álvarez Hernández, J.; Aguilar Parra, J.; Lorenzo Torrecillas, J. La Ansiedad ante los Exámenes en Estudiantes Universitarios: Relaciones con variables personales y académicas—Dialnet. Electron. J. Res. Educ. Psychol. 2012, 10, 333–354. [Google Scholar] [CrossRef]
  10. Roman Miranda de Reynoso, P. Relación Entre la Autoeficacia Académica, la Ansiedad Ante los Exámenes y el Cansancio Emocional en Estudiantes del Instituto del sur Arequipa; Universidad Nacional de San Agustín de Arequipa: Arequipa, Peru, 2019. [Google Scholar]
  11. Ann Mary, R.; Marslin, G.; Franklin, G.; Sheeba, C.J. Test anxiety levels of board exam going students in Tamil Nadu, India. Biomed. Res. Int. 2014, 2014, 578323. [Google Scholar] [CrossRef] [PubMed]
  12. Torrano, R.; Ortigosa, J.M.; Riquelme, A.; Méndez, F.J.; López-Pina, J.A. Test Anxiety in Adolescent Students: Different Responses According to the Components of Anxiety as a Function of Sociodemographic and Academic Variables. Front Psychol. 2020, 11, 612270. [Google Scholar] [CrossRef] [PubMed]
  13. Balogun, A.G.; Balogun, S.K.; Onyencho, C.V. Test Anxiety and Academic Performance among Undergraduates: The Moderating Role of Achievement Motivation. Span J. Psychol. 2017, 20, E14. [Google Scholar] [CrossRef] [PubMed]
  14. Martínez Bermúdez, R.; Rojas Puris, L. Ansiedad frente a exámenes en adolescentes. Cuando el estilo de socialización parental es un factor relacionado—Dialnet. Rev. Investig. Casos. Salud. 2018, 3, 40–48. [Google Scholar] [CrossRef]
  15. Liu, Y.; Pan, H.; Yang, R.; Wang, X.; Rao, J.; Zhang, X.; Pan, C. The relationship between test anxiety and emotion regulation: The mediating effect of psychological resilience. Ann. Gen. Psychiatry 2021, 20, 40. [Google Scholar] [CrossRef] [PubMed]
  16. Pekrun, R. Progress and open problems in educational emotion research. Learn Instr. 2005, 15, 497–506. [Google Scholar] [CrossRef]
  17. Pekrun, R.; Goetz, T.; Perry, R.P.; Kramer, K.; Hochstadt, M.; Molfenter, S. Beyond test anxiety: Development and validation of the test emotions questionnaire (TEQ). Anxiety Stress Coping 2004, 17, 287–316. [Google Scholar] [CrossRef]
  18. Martínez Monteagudo, M.; Inglés, C.; Cano Vindel, A.; García Fernández, J. Estado actual de la investigación sobre la teoría tridimensional de la ansiedad de Lang. Ansiedad Estrés 2012, 18, 201–219. [Google Scholar]
  19. Domínguez Lara, S. Inteligencia emocional y estrategias cognitivas de regulación emocional en universitarios de Lima: Un análisis preliminar. Rev. Hosp. Psiquiátrico Habana 2016, 13, 5. [Google Scholar]
  20. Ándres, L.; Rodríguez Espínola, S.; Rodríguez Cáceres, M. Estrategias cognitivas de regulación emocional y síntomas de depresión en estudiantes universitarios: Diferencias por género y tipo de carrera. Resultados preliminares |Andrés| Revista Akadèmeia. Akadèmia 2017, 16, 113–130. [Google Scholar]
  21. Domínguez Lara, S. Influencia de las estrategias cognitivas de regulación emocional sobre la ansiedad y depresión en universitarios: Análisis preliminar. Rev. Salud Uninorte 2017, 33, 315–321. [Google Scholar] [CrossRef]
  22. Huang, D.Q. Characteristics of college students’ cognitive emotion regulation strategies and its pedagogical implications. Zhonghua Liu Xing Bing Xue Za Zhi 2020, 41, 1151–1154. [Google Scholar]
  23. Domínguez Lara, S.; Medrano, L. Propiedades psicométricas del cuestionario de regulación cognitiva de la emociones (CERQ) en estudiantes universitarios de lima. Psychol. Av. Discip. 2016, 10, 53–67. [Google Scholar] [CrossRef] [Green Version]
  24. MacCann, C.; Jiang, Y.; Brown, L.E.R.; Double, K.S.; Bucich, M.; Minbashian, A. Emotional intelligence predicts academic performance: A meta-analysis. Psychol. Bull. 2020, 146, 150–186. [Google Scholar] [CrossRef]
  25. Páez Cala, M.; Castaño Castrillón, J. Inteligencia emocional y rendimiento académico en estudiantes universitarios. Psicol. Caribe 2015, 32, 268–285. [Google Scholar] [CrossRef]
  26. Pekrun, R.; Goetz, T.; Titz, W.; Perry, R.P. Academic Emotions in Students’ Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research. Educ. Psychol. 2002, 37, 91–105. [Google Scholar] [CrossRef]
  27. Kaiser, H.F. The Application of Electronic Computers to Factor Analysis. Educ. Psychol. Meas. 1960, 20, 141–151. [Google Scholar] [CrossRef]
  28. Jöreskog, K.G.; Sörbom, D. LISREL 7 User’s Reference Guide; SPSS Publications: Chicago, IL, USA, 1989. [Google Scholar]
  29. Bentler, P.M. Comparative fit indexes in structural models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef] [PubMed]
  30. Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 136–162. [Google Scholar]
  31. Hu, L.-t.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  32. Megreya, A.M.; Latzman, R.D.; Al-Attiyah, A.A.; Alrashidi, M. The Robustness of the Nine-Factor Structure of the Cognitive Emotion Regulation Questionnaire across Four Arabic-Speaking Middle Eastern Countries. J. Cross Cult. Psychol. 2016, 47, 875–890. [Google Scholar] [CrossRef]
  33. Van Den Heuvel, M.W.H.; Stikkelbroek, Y.A.J.; Bodden, D.H.M.; Van Baar, A.L. Coping with stressful life events: Cognitive emotion regulation profiles and depressive symptoms in adolescents. Dev. Psychopathol. 2020, 32, 985–995. [Google Scholar] [CrossRef] [Green Version]
  34. Garnefski, N.; Kraaij, V. Specificity of relations between adolescents’ cognitive emotion regulation strategies and symptoms of depression and anxiety. Cogn. Emot. 2018, 32, 1401–1408. [Google Scholar] [CrossRef] [Green Version]
  35. Usán Supervía, P.; Quílez Robres, A. Emotional Regulation and Academic Performance in the Academic Context: The Mediating Role of Self-Efficacy in Secondary Education Students. Int. J. Environ. Res. Public Health 2021, 18, 5715. [Google Scholar] [CrossRef] [PubMed]
  36. Navarro, J.; Vara, M.D.; Cebolla, A.; Baños Rivera, R.M. UMH: Validación psicométrica del cuestionario de regulación emocional (ERQ-CA) en población adolescente española. Rev. Psicol. Clínica Niños Adolesc. 2018, 5, 9–15. [Google Scholar] [CrossRef]
  37. Gao, W.; Ping, S.; Liu, X. Gender differences in depression, anxiety, and stress among college students: A longitudinal study from China. J. Affect. Disord. 2020, 263, 292–300. [Google Scholar] [CrossRef] [PubMed]
  38. Stefan, A.; Berchtold, C.M.; Angstwurm, M. Translation of a scale measuring cognitive test anxiety (G-CTAS) and its psychometric examination among medical students in Germany. GMS J. Med. Educ. 2020, 37, Doc50. [Google Scholar] [PubMed]
  39. Furlan, L.; Pérez, E.; Moyano, M.; Cassady, J. Propiedades psicométricas y estandarización de la Escala de Ansiedad Cognitiva frente a los Exámenes a la población universitaria argentina. Rev. Evaluar. 2010, 10, 22–31. [Google Scholar] [CrossRef]
  40. Kurt, A.; Balci, S.; Kose, D. Test anxiety levels and related factors: Students preparing for university exams—PubMed. J. Pak. Med. Assoc. 2014, 64, 1235–1239. [Google Scholar]
  41. Fernández-Castillo, A.; Caurcel, M.J. State test-anxiety, selective attention and concentration in university students. Int. J. Psychol. 2015, 50, 265–271. [Google Scholar] [CrossRef]
  42. Guillén Riquelme, A. Validación de la Adaptación Española del State-Trait Anxiety Inventory en Diferentes Muestras Españolas; Editorial de la Universidad de Granada: Granada, Spain, 2014. [Google Scholar]
  43. Desai, M.; Pandit, U.; Nerurkar, A.; Verma, C.; Gandhi, S. Test anxiety and procrastination in physiotherapy students. J. Educ. Health Promot. 2021, 10, 132. [Google Scholar]
  44. Pekrun, R. The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice. Educ. Psychol. Rev. 2006, 18, 315–341. [Google Scholar] [CrossRef]
  45. Pekrun, R.; Frenzel, A.C.; Goetz, T.; Perry, R.P. The Control-Value Theory of Achievement Emotions: An Integrative Approach to Emotions in Education. Emot. Educ. 2007, 13–36. [Google Scholar]
  46. Lazarides, R.; Raufelder, D. Control-value theory in the context of teaching: Does teaching quality moderate relations between academic self-concept and achievement emotions? Br. J. Educ. Psychol. 2021, 91, 127–147. [Google Scholar] [CrossRef] [PubMed]
  47. Amaral, S. Estrés Académico en Estudiantes Universitarios: El Caso de la Ansiedad ante Exámenes; Universidad Nacional de Mar del Plata: Mar del Plata, Argentina, 2018. [Google Scholar]
  48. Porras, M.M.; Ortega, F.H.; Porras, M.M.; Ortega, F.H. Procrastinación, ansiedad ante los exámenes y rendimiento académico en estudiantes universitarios. Interdiscip. Rev. Psicol. Ciencias Afines 2021, 38, 243–258. [Google Scholar] [CrossRef]
  49. Von der Embse, N.; Jester, D.; Roy, D.; Post, J. Test anxiety effects, predictors, and correlates: A 30-year meta-analytic review. J. Affect. Disord. 2018, 227, 483–493. [Google Scholar] [CrossRef] [PubMed]
  50. Freire, C.; Ferradás, M.; Fernández Cerviño, S.; Barca Enríquez, E. Ansiedad ante los exámenes en estudiantes de educación primaria: Diferencias en función del curso y del género. Publ. Fac. Educ. Humanid. Campus Melilla 2019, 49, 151–168. [Google Scholar]
  51. Ashton, R. Improving the transfer to secondary school: How every child’s voice can matter. Dialnet. Support Learn 2008, 23, 176–182. [Google Scholar] [CrossRef]
  52. Chedzoy, S.M.; Burden, R.L. Making the Move: Assessing Student Attitudes to Primary-Secondary School Transfer. Res. Educ. 2005, 74, 22–35. [Google Scholar] [CrossRef]
  53. Bagnall, C.L. Talking about School Transition (TaST): An emotional centred intervention to support children over primary-secondary school transition. Pastor. Care Educ. 2020, 38, 116–137. [Google Scholar] [CrossRef]
  54. Bloyce, J.; Frederickson, N. Intervening to improve the transfer to secondary school. Educ. Psychol. Pract. 2012, 28, 1–18. [Google Scholar] [CrossRef]
  55. Topping, K. Primary–secondary transition: Differences between teachers’ and children’s perceptions. Improv. Sch. 2011, 14, 268–285. [Google Scholar] [CrossRef]
  56. Jordan, J.A.; McRorie, M.; Ewing, C. Gender differences in the role of emotional intelligence during the primary–secondary school transition. Emot. Behav. Difficulties 2010, 15, 37–47. [Google Scholar] [CrossRef]
  57. Perkins, A.M.; Corr, P.J. Cognitive ability as a buffer to neuroticism: Churchill’s secret weapon? Pers. Individ. Differ. 2006, 40, 39–51. [Google Scholar] [CrossRef]
Table
Table 1. Exploratory factor analysis of the “Exams-related Emotions Scale (EES)”.
Table 1. Exploratory factor analysis of the “Exams-related Emotions Scale (EES)”.
ComponentCommunalities
123
After the exam I feel embarrassed.0.795 0.653
During the exam I feel embarrassed.0.795 0.635
Before the exam I would prefer not to take the exam because I have lost all hope.0.766 0.642
During the exam I begin to think that no matter how hard I try, I will never pass the exam.0.760 0.643
I’m embarrassed by my notes.0.748 0.565
During the exam I feel so resigned that I have no energy.0.743 0.608
During the exam I am embarrassed how badly I prepared.0.742 0.557
During the exam, I feel like dropping out.0.734 0.609
Before the exam I get depressed because I feel like I don’t have much hope of passing the exam.0.711 0.636
When I get a bad grade I wish I didn’t have to look my teacher in the face again.0.665 0.455
During the exam I get angry.0.573 0.341
During the exam it seems to me that the questions are unfair.0.457 0.211
During the exam I think I can be proud of my knowledge.130.804 0.648
After the exam I am very satisfied with myself.140.762 0.601
During the exam I am very confident.150.760 0.611
During the exam I am happy to be able to take the exam.160.760 0.579
During the exam, as I hope to pass I am motivated to try hard. 0.742 0.558
After the exam I am brimming with enthusiasm.180.738 0.562
Before the exam, as I enjoy preparing for exams I am motivated to do more than necessary.190.695 0.493
Before the exam I am so proud of how I prepared that I want to start the exam right now.200.692 0.486
Before the exam I think optimistically about the exam.210.649 0.439
After the exam I feel very relieved.220.612 0.441
After the exam I can finally breathe easy again.230.491 0.417
After the examination the nerves in the stomach disappear.240.463 0.267
As I begin the exam my heart begins to accelerate.25 −0.7760.610
During the exam I am very nervous.26 −0.7960.679
Before the exam I feel nervous and restless.27 −0.7630.600
During the exam my hands tremble.28 −0.7080.548
Before the exam I am worried if I will have studied enough.29 −0.6600.444
During the exam I am worried about whether I will pass the exam.30 −0.6370.453
Before the exam I get so nervous that I wish I could miss the exam.31 −0.6230.545
Extraction Method: Principal Component Analysis
Rotation method: Oblimin with Kaiser normalization
Table
Table 2. Goodness of fit indices of models of emotion in exams proposed.
Table 2. Goodness of fit indices of models of emotion in exams proposed.
Modelsχ2CMIN/DFCFITLIRMSEASRMR
M13 related factorsp < 0.0011.9110.9130.9040.0580.063
M22 related factors 1 independent (Anxiety)p < 0.0012.3040.8750.8630.0690.177
M32 related factors 1 independent (positive emotions)p < 0.0012.1200.9000.9010.0690.169
M43 independent factorsp < 0.0012.4380.8630.8490.0730.226
Note: CMIN = chi-square ratio over degrees of freedom; CFI = comparative adjustment index; TLI = Tucker-Lewis index; RMSEA = mean square error of approximation; SRMR = standardized residual mean square root.
Table
Table 3. Factorial loads of three Related Factors Model of the Exams-related Emotions Scale (EES).
Table 3. Factorial loads of three Related Factors Model of the Exams-related Emotions Scale (EES).
F1 Negative EmotionsF2 Positive EmotionsF3 Anxiety
ItemEmotionEstimateItemEmotionEstimateItemItemEstimate
1Shame40.69313Pride20.81425Anxiety60.691
2Shame20.73414Pride30.70226Anxiety40.815
3Hopelessness20.81315Hope20.72927Anxiety40.716
4Hopelessness30.81216Enjoy20.72128Anxiety70.682
5Shame50.71717Hope30.75229Anxiety20.596
6Hopelessness50.75218Enjoy30.65230Anxiety50.573
7Shame30.66219Enjoy10.59531Anxiety30.732
8Hopelessness40.72720Pride10.603
9Hopelessness10.79221Hope10.616
10Shame60.63922Relief10.534
11Anger10.59323Relief30.487
12Enfado20.54824Relief20.521
Table
Table 4. Multigroup analysis of invariance by gender.
Table 4. Multigroup analysis of invariance by gender.
Modelsχ2g.lχ2/g.lΔχ2pΔglCFITLISRMRRMSEA
Model 11540.1268441.825---0.8900.8800.0880.046
Model 21547.0138721.7746.8871.000280.8940.8860.0890.044
Model 31549.1388781.7649.0121.000340.8940.8880.0940.044
Model 41569.7539181.71029.6261.000740.8970.8960.0970.042
Model 1 = No restrictions. Model 2 = Measurement weights. Model 3 = Structural covariances. Model 4 = Measurement residues.
Table
Table 5. Independent samples t-Test between EES and gender results.
Table 5. Independent samples t-Test between EES and gender results.
EESGenderIndependent Samples t-Test
Male
(n = 284)		Female
(n = 278)
MSDMSDtp Value (Bilateral)
Negative Emotions23.6910.1925.1611.01−1.6360.102
Positive Emotions42.819.3540.659.762.6800.008
Anxiety20.747.2123.996.80−5.5020.000
Note: EEs = Exams-related Emotions Scale.
Table
Table 6. Results of the ANOVA test between the EES and the academic year.
Table 6. Results of the ANOVA test between the EES and the academic year.
CourseNMeanStandard DeviationFSig.
(Bilateral)
Negative Emotions5º EPO14823.4610.629.2010.000
6º EPO18621.8810.14
1º ESO13427.1410.82
2º ESO9427.069.90
Positive Emotions5º EPO14843.309.6316.0560.000
6º EPO18644.418.90
1º ESO13439.149.14
2º ESO9437.719.29
Anxiety5º EPO14822.457.134.7210.002
6º EPO18620.877.32
1º ESO13423.677.04
2º ESO9423.246.80
Table
Table 7. Pearson Test Results.
Table 7. Pearson Test Results.
Academic Performance
(Average Grade)		p
Negative Emotions−0.406<0.001
Positive Emotions0.385<0.001
Anxiety−0.212<0.001
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Obregón-Cuesta, A.I.; Mínguez-Mínguez, L.A.; León-del-Barco, B.; Mendo-Lázaro, S.; Fernández-Solana, J.; González-Santos, J.; González-Bernal, J.J. Psychometric Analysis and Contribution to the Evaluation of the Exams-Related Emotions Scale in Primary and Secondary School Students. Int. J. Environ. Res. Public Health 2022, 19, 6770. https://doi.org/10.3390/ijerph19116770

AMA Style

Obregón-Cuesta AI, Mínguez-Mínguez LA, León-del-Barco B, Mendo-Lázaro S, Fernández-Solana J, González-Santos J, González-Bernal JJ. Psychometric Analysis and Contribution to the Evaluation of the Exams-Related Emotions Scale in Primary and Secondary School Students. International Journal of Environmental Research and Public Health. 2022; 19(11):6770. https://doi.org/10.3390/ijerph19116770

Chicago/Turabian Style

Obregón-Cuesta, Ana Isabel, Luis Alberto Mínguez-Mínguez, Benito León-del-Barco, Santiago Mendo-Lázaro, Jessica Fernández-Solana, Josefa González-Santos, and Jerónimo J. González-Bernal. 2022. "Psychometric Analysis and Contribution to the Evaluation of the Exams-Related Emotions Scale in Primary and Secondary School Students" International Journal of Environmental Research and Public Health 19, no. 11: 6770. https://doi.org/10.3390/ijerph19116770

APA Style

Obregón-Cuesta, A. I., Mínguez-Mínguez, L. A., León-del-Barco, B., Mendo-Lázaro, S., Fernández-Solana, J., González-Santos, J., & González-Bernal, J. J. (2022). Psychometric Analysis and Contribution to the Evaluation of the Exams-Related Emotions Scale in Primary and Secondary School Students. International Journal of Environmental Research and Public Health, 19(11), 6770. https://doi.org/10.3390/ijerph19116770

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop