Next Article in Journal
Spanish Adaptation of the Experiential Approach Scale (EAS)
Next Article in Special Issue
Academic Performance during the COVID-19 Pandemic and Its Relationship with Demographic Factors and Alcohol Consumption in College Students
Previous Article in Journal
COVID-19 Vaccine Hesitancy and Psychosocial Effects of the COVID-19 Pandemic among Health-Science Students of Lithuania–A National Cross-Sectional Online Survey
Previous Article in Special Issue
When in Doubt … Career Indecision, Mental Wellbeing, and Consultation-Seeking Behaviour—A Qualitative Interview Study among Students and Counsellors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Romanian Version of the Toronto Empathy Questionnaire (TEQ) among Undergraduate Medical Students

by
Sorin Ursoniu
1,
Costela Lacrimioara Serban
1,
Catalina Giurgi-Oncu
2,
Ioana Alexandra Rivis
3,
Adina Bucur
1,*,
Ana-Cristina Bredicean
2,4 and
Ion Papava
2
1
Department of Functional Sciences, Discipline of Public Health, Center for Translational Research and Systems Medicine, “Victor Babeș” University of Medicine and Pharmacy, 300041 Timișoara, Romania
2
Department of Neuroscience, Discipline of Psychiatry, Center for Cognitive Research in Neuropsychiatric Pathology (NeuroPsy-Cog), “Victor Babeș” University of Medicine and Pharmacy, 300041 Timișoara, Romania
3
Department of Neuroscience, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania
4
Psychiatry Compartment, “Dr. Victor Popescu” Emergency Military Clinical Hospital, 300080 Timișoara, Romania
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(24), 12871; https://doi.org/10.3390/ijerph182412871
Submission received: 30 October 2021 / Revised: 1 December 2021 / Accepted: 5 December 2021 / Published: 7 December 2021
(This article belongs to the Special Issue University Students' Health and Academic Achievement)

Abstract

:
Medical professionals require adequate abilities to identify others’ emotions and express personal emotions. We aimed to determine the validity and reliability of an empathy measuring tool in medical students for this study. We employed Spreng’s Toronto Empathy Questionnaire (TEQ) as a starting point for this validation. The process was performed in several steps, including an English-Romanian-English translation and a focus group meeting to establish each question’s degree of understandability and usability, with minor improvements of wording in each step. We checked internal and external consistency in a pilot group (n = 67). For construct and convergent validity, we used a sample of 649 students. The overall internal and external reliability performed well, with Cronbach’s alpha = 0.727 and respective ICC = 0.776. The principal component analysis resulted in 3 components: prosocial helping behavior, inappropriate sensitivity, dismissive attitude. Component 1 includes positively worded questions, and components 2 and 3 include negatively worded questions. Women had significantly higher scores than men in convergent validity, but we did not highlight any differences for other demographic factors. The Romanian version of the TEQ is a reliable and valid tool to measure empathy among undergraduate medical students that may be further used in subsequent research.

1. Introduction

Communication forms the basis of interconnection, indispensable for the survival of humankind, allowing for a satisfying physical, mental and social life [1], albeit through verbal, visual, tactile, or, more recently, artificial methods. In our current multifaceted and interconnected society, dominated by many different types of struggles, effective, adequate, and easy communication is essential. To this aim, we must think about what makes for an effective style of communication to benefit everyday interrelationships, especially when it comes to healthcare and the training of future health professionals. As a multidimensional and essential trait of adequate human connections, empathy has been at the forefront of psychological research since the end of the nineteenth century [2]. Concerning its etymology, the term empathy represents the English translation (Edward Titchener, 1909) of the concept of “Einfühlung’’ that was first coined in German by Robert Vischerin 1873 [3], meaning a “feeling into” referring to the psychological mechanism of perspective-taking, namely of projecting oneself into another body or environment and the associated feelings [4]. The skill of perspective-taking, of correctly identifying what other beings are feeling, understanding, and expressing those sentiments, is considered essential for adequate interpersonal communication and maintaining relationships.
Excessive use of social networking causes a decrease in the ability to develop and maintain adequate human interactions, as well as a reduction in the ability to identify the emotions and thoughts of another person (Theory of Mind), and a decrease in the expression of our own emotions (alexithymia) [5]. Medical professionals require the ability to identify emotions (ToM) and express personal emotions (alexithymia); having these skills may determine appropriate empathy levels towards a suffering person. Consequently, constant social media users may show lower levels of empathy as opposed to those who have not constantly been exposed to different imagery and other people’s actions [6].
Empathy represents the ability to attribute mental states to other beings and respond appropriately to them [7], deeming it essential for the successful development and maintenance of social bonds.
Empathy is the basis for positive human interaction and consists of two aspects, namely the affective and cognitive components. The affective component helps us in our emotional responses to others, while the cognitive component entails a rational understanding of another person’s emotional state [8].
There are three types of empathy: cognitive, emotional, and “nurturant” or compassionate empathy [9,10]. Cognitive empathy helps us understand what others are going through, without making their burdens our own [11]. Emotional empathy makes us feel what other people are feeling, while compassionate empathy makes us take action and help the other person deal with their problem. Cognitive empathy is essential in developing the other two, while emotional empathy is not needed in developing compassionate empathy [12]. When dealing with patients, cognitive empathy is valued, therefore the term “clinical empathy” has been established to better describe that doctor-patient relationship [13]. Clinical empathy comprises and goes beyond understanding the patients point of view and feelings, to communicating and making sure that the perceived feelings/situations are accurate and finally, taking action to help the patient [14]. “Nurturant” empathy is characterized by the fact that the medical professional is supportive to the patient, providing total security and attention [15].
Empathy determines an altruistic behavior to help others when suffering, which is an essential human trait that we aim to develop in medical students. The medical profession is often described as burdensome, given that there are long working hours, high pressure, and stress. Therefore, burnout represents a real threat amongst medical professionals, often determined by compassion fatigue, which is in close relation to empathy [16]. The patient-doctor relationship is reliant on empathy, as it helps build trust, enforces better communication between the two, cultivating a safe environment in order to evaluate possibilities and make the best medical decisions [17,18]. Having a doctor with high levels of empathy has been proven to determine a decrease in stress levels in patients, diminish anxiety, depression and improve the prognosis [19,20].
Empathy contributes to establishing a relationship based on trust between the healthcare professional and the patient, enhancing treatment adherence, diagnostic accuracy, and patient satisfaction [21,22]. Having an empathic doctor does not only benefit the patient but the healthcare worker himself, as well. Treatment adherence and patient satisfaction increase job satisfaction and reduce the feeling of burnout [23,24].
The Toronto empathy questionnaire (TEQ), developed by Spreng et al. [1], is a unidimensional, brief, and valid instrument for the assessment of empathy. TEQ comprises 16 items represented by questions. Answers must be chosen from the following options: Never = 0; Rarely = 1; Sometimes = 2; Often = 3; Always = 4. Item responses are scored according to the following scale for positively worded items: 1, 3, 5, 6, 8, 9, 13, 16. The following negatively worded items are reverse scored: 2, 4, 7, 10, 11, 12, 14, 15. Total scores represent the sum of all items [1].
Considering the highly significant role played by empathy in the context of a sanogenic therapeutic alliance, benefitting the service-users and health professionals alike [25] we sought to examine this ability in a sample of undergraduate medical students, with a view of contributing to the existing international body of literature dedicated to this area of research interest, as well as suggesting helpful development strategies that could be included in the medical curricula.
More, specifically, this study aimed to determine the validity and reliability of TEQ among undergraduate medical students in Romania to be further used in subsequent research.
This work is part of a larger project, with a purpose to identify the connection between the use of social networking and individual Theory of Mind (ToM), alexithymia, and empathy levels of students of the Faculty of General Medicine of the “Victor Babes” University of Medicine and Pharmacy Timisoara, Romania, to raise awareness about this new type of addiction.

2. Materials and Methods

2.1. Preliminary Preparations

This study was approved by the Research Ethics Committee of the “Victor Babes” University of Medicine and Pharmacy Timisoara, Romania (No. 15/20.03.2020). All subjects included in this study provided informed consent before participation.
To proceed with the validation of the Romanian version of the Toronto Empathy Questionnaire, written permission for use and validation was requested and received from the authors (Prof. Nathan Spreng, McGill University, Montreal, QC, Canada, documents available upon reasonable request). The Toronto Empathy Questionnaire (TEQ) validation was performed in several steps (Figure 1).

2.2. Methods, Techniques, and Instruments

The first step consisted of translating the questionnaire validated in English by Spreng et al. [1] to Romanian. The translation was made by an International English Language Testing System (IELTS) certified psychiatrist, with work experience in both clinical and academic settings in the United Kingdom. The questionnaire was subsequently translated back into English by a second psychiatrist, which also benefits from proficient English language skills. The original English version was then compared with the backward-translated version. Minor corrections were made to the Romanian version. The pretest of the questionnaire was performed on ten volunteers working in a panel and represented the second validation step, which aimed to provide a clear and easy understanding of each question. This method was similar to the one employed by other research groups validating assessment scales for the Romanian population [26].
The panel work resulted in some minor improvements in the wording of certain questions. The Romanian version of the Toronto Empathy Questionnaire (TEQ) is presented in Appendix A.
The third step represented the internal and external reliability analysis, conducted on 67 undergraduate medical students from the “Victor Babes” University of Medicine and Pharmacy Timisoara, Romania, who were tested and then re-tested 21 days after the first round. Cronbach’s alpha reliability coefficient was determined for the main parts of the questionnaire. The external consistency (or test-retest) was assessed with the intraclass correlation coefficient.

2.3. Research Population and Sample

Next, in step 4, the students of the 4th, 5th, and 6th year General Medicine section of Victor Babes University of Medicine and Pharmacy, Timisoara, Romania, were invited to participate in a survey. The data were collected from March to May 2021. The first section of the questionnaire included the introduction of the survey and a consent form. Besides specific empathy questions, the questionnaire contained demographic questions, such as gender, year of study, and students’ average grades. A Google Play application (android and iOS) or a desktop version on a web platform was developed to help students complete the questionnaire. To ensure total anonymity, a series of alphanumeric codes have been generated so that each student receives a random cipher, which allows him/her to access the test. In addition to this application, a desktop version on a web platform (https://timsonet.ro, accessed on 1 November 2021) was also made available.

2.4. Data Processing

A computerized database was created using the Stata program version 16.1 (StataCorp, College Station, TX, USA). The results are presented as absolute and relative frequencies. Continuous variables are presented as mean and standard deviation (SD) or medians and interquartile ranges (IQR). A p-value < 0.05 was considered statistically significant. The psychometric properties of the Romanian TEQ were examined in terms of its validity, reliability, and goodness of fit using structural equation modeling. For Cronbach’s alpha level > 0.7 was considered acceptable. The test-retest reliability was assessed using theintraclass correlation coefficient (ICC), with a value ≥ 0.3 considered as acceptable. Principal component analysis (PCA) was conducted using all 16 questions of the TEQ, with the orthogonal rotation (varimax). Kaiser-Meyer-Olkin (KMO) coefficient (>0.7) and the Bartlett Sphericity test (p > 0.05) were used to test the suitability of the data for conducting PCA. For confirmatory factor analysis (CFA), the Tucker Lewis index (>0.9), Comparative Fit Index (>0.9), Root Mean Square Error of Approximation (<0.08), and Standardized Root Mean Square Residual (<0.08) were used to assess the model fit.

3. Results

Internal and external reliability were calculated overall and for positively and negatively worded items separately, in step 3. Table 1 includes the values of Cronbach’s alpha as a measure of internal reliability and the interclass correlation coefficient as a measure of external reliability. All measures exceeded the 0.7 thresholds, except for the Cronbach’s alpha on negative items, which equals 0.443.
Descriptive statistics for each question for the test-retest time points are presented in Table 2.
In step 4, when the questionnaire was applied to the populational sample of n = 649 students, the total score had a median of 49, with an interquartile range of 7. Median (interquartile range) scores for positively and negatively worded items were 24 (5), respectively 25 (5). Female students obtained significantly higher scores than male students, with a medium effect size for total scores and positively worded items and a small to medium effect size for negatively worded items. For other demographic factors taken into consideration (age category, year of study, and last year’s final grade), no significant differences were discovered (Table 3).
The Kaiser-Meyer-Olkin (KMO = 0.790) verified the sampling adequacy for the analysis, and Bartlett’s test of sphericity (p < 0.001) indicated the correlations between items were sufficiently large for PCA. Four components had eigenvalues over Kaiser’s criterion of 1 (Figure 2), but only the first three were kept, which explained 34.2% of the variance in combination. The scree plot and the eigenvalues are presented in Figure 2. The factor loadings after varimax rotation and the percentage of explained variance are presented in Table 4, along with the eigenvalues for the rotated component matrix. Using the threshold of 0.3 for factor loadings, the items that cluster on the same components suggest that component 1, which includes questions 3, 5, 6, 13, 16, represents empathic concern/pro-social helping behavior, component 2 which includes questions 2, 4, 10, 12 represents indifference/inappropriate sensitivity, component 3 which includes questions 7, 11, 14, 15 represents disregard/dismissive attitude. Component 1 includes positively worded questions, and components 2 and 3 include negatively worded questions. Questions 1, 8, and 9 are not included in either component.
Figure 3 presents the structural equation modeling (SEM) for the three components that include 13 questions. R square for the equation level for the goodness of fit is 0.91. Confirmatory factor analysis acknowledged that the 3-factor model had satisfactory levels for Comparative fit index (0.749) and Tucker-Lewis index (0.699), Root Mean Square Error of Approximation (0.069), and Standardized Root Mean Square Residual (0.09).

4. Discussion

For a future doctor, medicine implies scientific knowledge, but also empathy—an essential emotional experience. The main goal of our profession is to treat the ailing, by empathic, not just medical care. When one feels that the medical professional understands their condition and problems, they will feel more comfortable in any given medical situation. Currently, there is no validated tool to collect empathy data for medical students in Romania, to the best of our knowledge. The present study aimed to validate and adapt the Toronto Empathy Questionnaire, initially developed by Spreng et al., to the Romanian language [1].
Our study introduces TEQ to measure the empathy levels in the Romanian population by examining its psychometric properties through a test-retest method and by using a focus group. The internal reliability of this test reported by other countries, as shown by the value of α, was 0.85 in Canada [1], 0.72 in Greece [27], 0.71 in a French study on general practitioners [28]. Therefore, our data suggest the excellent reliability of TEQ, with a Cronbach’s alpha of 0.727.
Similarly, external reliability, measured by ICC in our study, was 0.776, similar to reports from China (0.78) [8] and the Czech Republic (0.84) [29] for the same instrument.

4.1. Components of the Confirmatory Analysis

The first component, represented by prosocial behavior comprises 5 items (3, 5, 6, 13, 16) that express a preoccupation toward the rights, feelings, and welfare of others. All the actions destined to benefit one or more people, other than self-help, recomforting, cooperation—are part of the prosocial behaviors category. Motivations that underlie this behavior can be selfish (improving self-image), have reciprocal benefits (doing something nice for someone else, in order for them to do the same for you) or for altruistic reasons (acting on something out of empathy).
The second component consisted of inappropriate sensitivity and grouped 4 items (2, 4, 10, 12), which represent a lack of emotional response. Innately, being happy for someone else or understanding their upset are indispensable abilities for the development and progress of a strong and healthy social rapport. The medical profession requires the presence of this component to establish an adequate doctor-patient therapeutic relationship.
The third component that resulted from our study is represented by a dismissive attitude and comprises a further 4 items (7, 11, 14, 15). This component is characterized by a lack of acceptance and of understanding the emotions or problems experienced by others. Rejection and disinterest regarding other people’s difficulties constitute an issue, especially when it comes to doctors, whose main roles are to identify issues and problem-solve. While different levels of empathy were obtained in various studies across the world, it is commonly agreed that healthcare professionals should have the ability to adopt their patients’ perspectives and be compassionate. A study developed in France determined that clinical experience was not proportional to the practitioner’s level of empathy [28]. Recently, in a cross-sectional study among GPs in Denmark [30], empathy did not differ with age or years of practice, but with personal characteristics such as employment outside the clinic and consideration of physician-patient relationship and interaction with colleagues.

4.2. Differences Regarding the Undergraduate Year of Study Participants

Although others have found higher levels of empathy in students graduating medical school (6th year) as compared to students entering medical studies (1st year) [31], our study that included senior years of medical school (4th to 6th year) did not find a difference of empathy. One explanation is that sensitization to others was taught in the fundamental disciplines included in the first half of the medical curriculum. Another research developed in Turkey [32] investigated whether the values of TEQ varied amongst medical students as a result of their year of study and specific characteristics. The results showed that TEQ scores increased progressively until the fourth year, although not statistically significant, and then decreased. Also, the same study that included 300 students determined a statistically significant difference in TEQ scores between genders, as women showed higher scores. The same conclusion was started by a team of researchers in Malaysia [33] that studied empathy levels amongst medical students, where the female students scored higher on the TEQ than the male participants, but there were no significant differences determined by the year of study. In a study investigating empathy, a Serbian team of researchers [34] included some 178 first-year medical students and 185 senior medical students. The mean score on the TEQ was 45.23 ± 7.02, and the levels of empathy did not differ between the senior and first-year students.
Pohontschet al. [35] have found through a semi-structured interview that the development and expression of empathy were related to integrating patient contact early on in the curriculum and focusing more on teaching adequate communication and interaction behaviors.

4.3. Differences Regarding the Gender of Study Participants

In our study, women have obtained significantly higher scores overall, but also in positive and negative worded questions. As already discussed above, this result was not a constant finding, though most of the reports acknowledge women with higher empathy [29,33,34]. Schulte-Ruther et al. [36] suggested that women and men rely on different strategies when assessing their own emotions in response to other people, with women enhancing reliance on the human mirror neuron system and men on the theory of mind associated areas.
Our findings are consistent with other recent publications that supported a 3-factor structure [8,37], though the structure of the components is different. Other authors haveobtained a one-dimensional structure, by excluding especially questions containing double negation [29,32,37].

4.4. Excluded Questions

In current validation, the statistics associated with confirmatory factor analysis show a satisfactory confirmation of the model according to the literature [38,39] and to similar models constructed from TEQ [8]. For the Romanian version of TEQ, questions 1, 8, 9 were not included in either of the components nor in the structural equation model. Questions 1, 8, and 9 contributed to latent components retained in the analysis, with factor loadings smaller than the threshold of 0.3. Each of them contributed to other latent components that were not retained in the final analysis due to Kaiser’s criteria. Although these questions are contributing to the questionnaire, their influence is minimal for the 3 components retained in this validation. The structural equation modeling, which tests the relationship between the retained latent variables and the retained observed variables contributing to them, showed an adequate model fitting with values of the Tucker Lewis index, Comparative Fit Index, Root Mean Square Error of Approximation, and Standardized Root Mean Square Residual in the ranges requested by the developers of the technique [40].
Question 1 was also excluded from other validations of TEQ [29] and the reason behind exclusion might be that question 1 is the only item exploring emotional sharing. In the Chinese validation of TEQ, questions 8 and 9 formed a distinct component named by Xu et al. “negative empathy” [8].
According to Eisenberget al. [41], empathy is the driver for prosocial behavior. In a longitudinal follow-up, Eisenberg et al. [42] have shown that prosocial disposition in adulthood was related to empathy and prosocial behavior at much younger ages.
The motivation behind our study was triggered by the following questions, keeping in mind that a medical career takes years to develop: why does an evaluation of empathy matter? Why does a validated empathy scale for the Romanian population matter? These issues must be addressed by keeping in mind the extensive knowledge base that is built during university studies, subsequent residency training, postgraduate courses, which have been practiced for years, or practical skills achieved through laboratory work, in operating rooms, or by interacting with thousands of patients—these represent essential abilities that are required in the practice of all medical doctors. At the same time, skills such as communication, empathy, persuasion, the ability to adapt and work as part of a team, are just as valuable. The evaluation of empathy, alongside other abilities, should be made at the start of the medical career, for Academics involved in the teaching and training of students to be better able to develop these skills, since we know that the higher placement a person achieves in their career, the more that these personality dimensions tend to matter. Besides, the future professional development of students, faculty members are also involved in supporting their mental health and wellbeing, which is imperative, since there are various studies that have posited that empathy tends to wax and wane throughout years of strenuous medical training [43,44]. In view of this, there should be a larger focus on the counseling services that exist in medical universities, to be better able to offer individualized, tailored psychological interventions, decreasing the stigma of mental health problems in young people, with a focus on the ever-increasing risk of suicide and addictive behaviors among students, or by offering social skills training for specific issues [45].

5. Conclusions

Our study reported that the TEQ is a valuable and reliable instrument for an accurate evaluation of the empathy levels of Romanian medical students. The results from this validation study are not dissimilar to other published TEQ translations, by supporting a three-component questionnaire, with the following items: prosocial helping behavior, inappropriate sensitivity, dismissive attitude. This study has several limitations. First, the representativeness of the sample is a limitation since a convenience sample was used. The TEQ was not explicitly designed to assess the empathy of medical university students, representing a young, healthy, and highly educated population. This could influence the evaluation of their empathy, and it may potentially limit the generalizability of the results. Also, we used a self-completed questionnaire, and the answers might be affected by response bias. Another limitation was that we did not evaluate the convergent validity of the instrument. Future studies are needed to test the questionnaire among various populations further to produce more valid results.
We encourage the use of the TEQ in future studies to further test the empathy levels of medical students/medical professionals from other Romanian universities, as a means to reliably measure the need for tailored interventions that would address medical staff burnout and would, inherently, improve patient care and overall quality of health services.

Author Contributions

Conceptualization, S.U. and A.-C.B.; methodology, S.U., C.L.S., A.B. and A.-C.B.; formal analysis, S.U. and C.L.S.; investigation, S.U., C.L.S., C.G.-O., I.A.R., A.B. and I.P.; writing—original draft preparation, S.U., C.L.S., C.G.-O., I.A.R., A.B., I.P. and A.-C.B.; writing—review and editing, A.-C.B.; project administration, S.U. All authors have read and agreed to the published version of the manuscript.

Funding

This research has been supported by an internal grant of Victor Babes University of Medicine and Pharmacy Timisoara, contract number 3EXP/1219/30.01.2020.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Research Ethics Committee of the “Victor Babes” University of Medicine and Pharmacy Timisoara, Romania (No. 15/20.03.2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

Vă rugăm să citiți cu atenție fiecare declarație de mai jos și săevaluați cât de des văsimțiți sau acționați în modul descris. Încercuiți răspunsul pe formularul de răspuns. Nu există răspunsuri corecte sau greșite sau întrebări capcană. Vă rugăm să răspundeți la fiecare întrebare cât de sincer puteți.
Table A1. Romanian Version of Toronto Empathy Questionnaire (TEQ).
Table A1. Romanian Version of Toronto Empathy Questionnaire (TEQ).
NiciodatăRarUneoriAdeseaÎntotdeauna
1.Când cineva se simte entuziasmat, tind să mă entuziasmez și eu.
2.Nenorocirile altora nu mă afectează prea mult.
3.Mă supără să văd că cineva este tratat fără respect.
4.Rămân neafectat/ă, atunci când cineva apropiat este fericit.
5.Îmi place să îi fac pe ceilalți să se simtă mai bine.
6.Am sentimente tandre și de preocupare față de oamenii mai puțin norocoși decât mine.
7.Când un prieten începe să vorbească despre problemele sale, încerc să orientez conversația către altceva.
8.Îmi dau seama când ceilalți sunt triști, chiar și atunci când nu spun nimic.
9.Constat că sunt „în ton” cu dispozițiile altora.
10.Nu simt compasiune pentru persoanele care își cauzează singure boli grave.
11.Devin iritat când plânge cineva.
12.Nu mă interesează cu adevărat ce simt alți oameni.
13.Am un puternic impuls de a ajuta, atunci când văd pe cineva supărat.
14.Când văd că cineva este tratat nedrept, nu simt foarte multă compasiune pentru el.
15.Mi se pare o prostie ca oamenii să plângă de fericire.
16.Când văd că se profită de pe urma cuiva, am un sentiment protector față de acea persoană.
Note: Permission to use the Romanian version of TEQ is granted for educational purposes, only upon request.

References

  1. Spreng, R.N.; McKinnon, M.C.; Mar, R.A.; Levine, B. The Toronto Empathy Questionnaire: Scale development and initial validation of a factor-analytic solution to multiple empathy measures. J. Personal. Assess 2009, 91, 62–71. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Debes, R. From Einfühlung to empathy. Simpathy in early phenomenology and psychology. In Sympathy: A History; Schliesser, E., Ed.; Oxford University Press: New York, NY, USA, 2015; pp. 286–322. [Google Scholar]
  3. Vischer, R. On the Optical Sense of Form: A Contribution to Aesthetics. In Empathy, Form, and Space: Problems in German Aesthetics, 1873–1893 Mallgrave, H.F., Ikonomou, E., Eds.; Getty Center for the History of Art and the Humanities: Santa Monica, CA, USA, 1994; pp. 89–123. [Google Scholar]
  4. Ganczarek, J.; Hünefeldt, T.; Olivetti Belardinelli, M. From “Einfühlung” to empathy: Exploring the relationship between aesthetic and interpersonal experience. Cogn. Process. 2018, 19, 141–145. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Musetti, A.; Cattivelli, R.; Giacobbi, M.; Zuglian, P.; Ceccarini, M.; Capelli, F.; Pietrabissa, G.; Castelnuovo, G. Challenges in Internet Addiction Disorder: Is a Diagnosis Feasible or Not? Front. Psychol. 2016, 7, 842. [Google Scholar] [CrossRef] [Green Version]
  6. Hahn, L. Television Consumption and Empathy: A Connection? Master’s Thesis, Kent State University, Kent, OH, USA, 2013. [Google Scholar]
  7. Baron-Cohen, S.; Wheelwright, S. The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J. Autism Dev. Disord. 2004, 34, 163–175. [Google Scholar] [CrossRef] [PubMed]
  8. Xu, R.H.; Wong, E.L.; Lu, S.Y.; Zhou, L.M.; Chang, J.H.; Wang, D. Validation of the Toronto Empathy Questionnaire (TEQ) among Medical Students in China: Analyses Using Three Psychometric Methods. Front. Psychol. 2020, 11, 810. [Google Scholar] [CrossRef]
  9. Bachelor, A. How clients perceive therapist empathy: A content analysis of “received” empathy. Psychother. Theory Res. Pract. Train. 1988, 25, 227–240. [Google Scholar] [CrossRef]
  10. Wynn, R.; Wynn, M. Empathy as an interactionally achieved phenomenon in psychotherapy: Characteristics of some conversational resources. J. Pragmat. 2006, 38, 1385–1397. [Google Scholar] [CrossRef]
  11. Carver, E.J.; Hughes, J.R. The significance of empathy. In Empathy in the Helping Relationship; MacKay, R.C., Hughes, J.R., Carver, E.J., Eds.; Springer Publishing Company: Berlin/Heidelberg, Germany, 1990; pp. 13–27. [Google Scholar]
  12. Ekman, P. Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life; Times Books/Henry Holt and Co.: New York, NY, USA, 2003; pp. 172–190. [Google Scholar]
  13. Mercer, S.W.; Reynolds, W.J. Empathy and quality of care. Br. J. Gen. Pract. 2002, 52, S9–S12. [Google Scholar] [PubMed]
  14. Hojat, M. (Ed.) A Definition and Key Features of Empathy in Patient Care. In Empathy in Health Professions Education and Patient Care; Springer International Publishing: Cham, Switzerland, 2016; pp. 71–81. [Google Scholar]
  15. Williams, J.; Stickley, T. Empathy and nurse education. Nurse Educ. Today 2010, 30, 752–755. [Google Scholar] [CrossRef] [PubMed]
  16. Duarte, J.; Pinto-Gouveia, J. Empathy and feelings of guilt experienced by nurses: A cross-sectional study of their role in burnout and compassion fatigue symptoms. Appl. Nurs. Res. 2017, 35, 42–47. [Google Scholar] [CrossRef] [Green Version]
  17. Ong, L.M.; de Haes, J.C.; Hoos, A.M.; Lammes, F.B. Doctor-patient communication: A review of the literature. Soc. Sci. Med. 1995, 40, 903–918. [Google Scholar] [CrossRef]
  18. Stewart, M.; Brown, J.B.; Boon, H.; Galajda, J.; Meredith, L.; Sangster, M. Evidence on patient-doctor communication. Cancer Prev. Control 1999, 3, 25–30. [Google Scholar]
  19. Lorié, Á.; Reinero, D.A.; Phillips, M.; Zhang, L.; Riess, H. Culture and nonverbal expressions of empathy in clinical settings: A systematic review. Patient Educ. Couns. 2017, 100, 411–424. [Google Scholar] [CrossRef] [PubMed]
  20. Hemmerdinger, J.M.; Stoddart, S.D.; Lilford, R.J. A systematic review of tests of empathy in medicine. BMC Med. Educ. 2007, 7, 24. [Google Scholar] [CrossRef] [Green Version]
  21. McWhinney, I.R.; Freeman, T. Doctor–Patient Communication. In Textbook of Family Medicine; McWhinney, I.R., Freeman, T., Eds.; Oxford University Press: New York, NY, USA, 2009; pp. 115–140. [Google Scholar]
  22. Riess, H. The Science of Empathy. J. Patient Exp. 2017, 4, 74–77. [Google Scholar] [CrossRef]
  23. Dambha-Miller, H.; Feldman, A.L.; Kinmonth, A.L.; Griffin, S.J. Association Between Primary Care Practitioner Empathy and Risk of Cardiovascular Events and All-Cause Mortality among Patients With Type 2 Diabetes: A Population-Based Prospective Cohort Study. Ann. Fam. Med. 2019, 17, 311–318. [Google Scholar] [CrossRef] [Green Version]
  24. Yuguero Torres, O.; Esquerda Aresté, M.; Marsal Mora, J.R.; Soler-González, J. Association between Sick Leave Prescribing Practices and Physician Burnout and Empathy. PLoS ONE 2015, 10, e0133379. [Google Scholar] [CrossRef] [PubMed]
  25. Altmann, T.; Roth, M. The risk of empathy: Longitudinal associations between empathy and burnout. Psychol. Health 2020, 36, 1441–1460. [Google Scholar] [CrossRef] [PubMed]
  26. Roman, N.; Miclaus, R.; Repanovici, A.; Nicolau, C. Equal Opportunities for Stroke Survivors’ Rehabilitation: A Study on the Validity of the Upper Extremity Fugl-Meyer Assessment Scale Translated and Adapted into Romanian. Medicina 2020, 56, 409. [Google Scholar] [CrossRef] [PubMed]
  27. Kourmousi, N.; Amanaki, E.; Tzavara, C.; Merakou, K.; Barbouni, A.; Koutras, V. The Toronto Empathy Questionnaire: Reliability and Validity in a Nationwide Sample of Greek Teachers. Soc. Sci. 2017, 6, 62. [Google Scholar] [CrossRef] [Green Version]
  28. Lelorain, S.; Sultan, S.; Zenasni, F.; Catu-Pinault, A.; Jaury, P.; Boujut, E.; Rigal, L. Empathic concern and professional characteristics associated with clinical empathy in French general practitioners. Eur. J. Gen. Pract. 2013, 19, 23–28. [Google Scholar] [CrossRef]
  29. Novak, L.; Malinakova, K.; Mikoska, P.; van Dijk, J.P.; Dechterenko, F.; Ptacek, R.; Tavel, P. Psychometric Analysis of the Czech Version of the Toronto Empathy Questionnaire. Int. J. Environ. Res. Public Health 2021, 18, 5343. [Google Scholar] [CrossRef] [PubMed]
  30. Charles, J.A.; Ahnfeldt-Mollerup, P.; Søndergaard, J.; Kristensen, T. Empathy Variation in General Practice: A Survey among General Practitioners in Denmark. Int. J. Environ. Res. Public Health 2018, 15, 433. [Google Scholar] [CrossRef] [Green Version]
  31. Magalhães, E.; Salgueira, A.P.; Costa, P.; Costa, M.J. Empathy in senior year and first year medical students: A cross-sectional study. BMC Med. Educ. 2011, 11, 52. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Akgün, Ö.; Akdeniz, M.; Kavukcu, E.; Avcı, H.H. Medical Students’ Empathy Level Differences by Medical Year, Gender, and Specialty Interest in Akdeniz University. J. Med. Educ. Curric. Dev. 2020, 7. [Google Scholar] [CrossRef] [PubMed]
  33. Haque, M.; Sa, B.; Majumder, M.A.A.; Islam, M.Z.; Othman, N.; Lutfi, S.; Kibria, G.M.; Salam, A.; Ismail, M.H.; Abdullah, S.L. Empathy among undergraduate medical students: A cross-sectional study in one Malaysian public medical school. Ann. Afr. Med. 2018, 17, 183–188. [Google Scholar] [CrossRef] [PubMed]
  34. Pantovic, M.; Dunjic-Kostic, B.; Gligoric, M.; Lačković, M.; Damjanovic, A.; Ivković, M. Empathy predicting career choice in future physicians. Engrami 2015, 37, 37–48. [Google Scholar] [CrossRef]
  35. Pohontsch, N.J.; Stark, A.; Ehrhardt, M.; Kötter, T.; Scherer, M. Influences on students’ empathy in medical education: An exploratory interview study with medical students in their third and last year. BMC Med. Educ. 2018, 18, 231. [Google Scholar] [CrossRef] [Green Version]
  36. Schulte-Rüther, M.; Markowitsch, H.J.; Shah, N.J.; Fink, G.R.; Piefke, M. Gender differences in brain networks supporting empathy. NeuroImage 2008, 42, 393–403. [Google Scholar] [CrossRef] [PubMed]
  37. Yeo, S.; Kim, K.-J. A validation study of the Korean version of the Toronto empathy questionnaire for the measurement of medical students’ empathy. BMC Med. Educ. 2021, 21, 119. [Google Scholar] [CrossRef]
  38. Bentler, P.M. Comparative fit indexes in structural models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef] [PubMed]
  39. Browne, M.W.; Cudeck, R. Alternative ways of assessing model fit. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 136–162. [Google Scholar]
  40. Beran, T.N.; Violato, C. Structural equation modeling in medical research: A primer. BMC Res. Notes 2010, 3, 267. [Google Scholar] [CrossRef] [Green Version]
  41. Eisenberg, N.; Eggum, N.D.; Di Giunta, L. Empathy-related Responding: Associations with Prosocial Behavior, Aggression, and Intergroup Relations. Soc. Issues Policy Rev. 2010, 4, 143–180. [Google Scholar] [CrossRef] [PubMed]
  42. Eisenberg, N.; Guthrie, I.K.; Cumberland, A.; Murphy, B.C.; Shepard, S.A.; Zhou, Q.; Carlo, G. Prosocial development in early adulthood: A longitudinal study. J. Personal. Soc. Psychol. 2002, 82, 993–1006. [Google Scholar] [CrossRef] [PubMed]
  43. Ferreira-Valente, A.; Monteiro, J.S.; Barbosa, R.M.; Salgueira, A.; Costa, P.; Costa, M.J. Clarifying changes in student empathy throughout medical school: A scoping review. Adv. Health Sci. Educ. 2017, 22, 1293–1313. [Google Scholar] [CrossRef]
  44. Smith, K.E.; Norman, G.J.; Decety, J. The complexity of empathy during medical school training: Evidence for positive changes. Med. Educ. 2017, 51, 1146–1159. [Google Scholar] [CrossRef] [PubMed]
  45. Popa, C.; Predatu, R. The effect of an integrative CBT/REBT intervention in improving emotional functioning and emotional stability in Romanian medical students. J. Evid.-Based Psychother. 2019, 19, 59–71. [Google Scholar] [CrossRef]
Figure 1. Flow diagram for the steps undertaken for validity testing of Toronto Empathy Questionnaire among Undergraduate Medical Students.
Figure 1. Flow diagram for the steps undertaken for validity testing of Toronto Empathy Questionnaire among Undergraduate Medical Students.
Ijerph 18 12871 g001
Figure 2. Scree plot of eigenvalues (95% confidence interval) after PCA.
Figure 2. Scree plot of eigenvalues (95% confidence interval) after PCA.
Ijerph 18 12871 g002
Figure 3. The confirmatory factor analysis of the Romanian version of TEQ with a 3-factor structure. Legend: numbers on the double-headed arrows represent the covariance between components, numbers on the single-headed arrows represent the standardized factor loadings. the components are: component1 = pro-social helping behavior, indifference, component2 = inappropriate sensitivity, component3 = dismissive attitude.
Figure 3. The confirmatory factor analysis of the Romanian version of TEQ with a 3-factor structure. Legend: numbers on the double-headed arrows represent the covariance between components, numbers on the single-headed arrows represent the standardized factor loadings. the components are: component1 = pro-social helping behavior, indifference, component2 = inappropriate sensitivity, component3 = dismissive attitude.
Ijerph 18 12871 g003
Table 1. Internal and external reliability (n = 67).
Table 1. Internal and external reliability (n = 67).
No. of ItemsCronbach’s AlphaICC (Test-Retest)
Overall160.7270.776
Positively worded items80.7450.728
Negatively worded items80.4430.742
Table 2. Descriptive statistics for the TEQ items (test-retest) (n = 67).
Table 2. Descriptive statistics for the TEQ items (test-retest) (n = 67).
ItemMean1 ± SD1Median1 (Lower-Upper Quartile)Mean2 ± SD2Median2 (Lower-Upper Quartile)
1. When someone else is feeling excited, I tend to get excited too.2.91 ± 0.733 (2–3)3.01 ± 0.753 (3–4)
2 *. Other people’s misfortunes do not disturb me a great deal.1.52 ± 0.991 (1–2)1.39 ± 0.941 (1–2)
3. It upsets me to see someone being treated disrespectfully.3.62 ± 0.624 (3–4)3.57 ± 0.634 (3–4)
4 *. I remain unaffected when someone close to me is happy.0.81 ± 0.821 (0–1)0.76 ± 0.921 (0–1)
5. I enjoy making other people feel better.3.58 ± 0.524 (3–4)3.49 ± 0.564 (3–4)
6. I have tender, concerned feelings for people less fortunate than me.2.79 ± 0.893 (2–3)2.89 ± 0.723 (2–3)
7 *. When a friend starts to talk about his\her problems, I try to steer the conversation towards something else.0.55 ± 0.740 (0–1)0.58 ± 0.700 (0–1)
8. I can tell when others are sad even when they do not say anything.3.25 ± 0.613 (3–4)3.15 ± 0.663 (3–4)
9. I find that I am “in tune” with other people’s moods.2.24 ± 0.762 (2–3)2.27 ± 0.772 (2–3)
10 *. I do not feel sympathy for people who cause their own serious illnesses.1.33 ± 1.051 (1–2)1.18 ± 0.981 (0–2)
11 *. I become irritated when someone cries.0.91 ± 0.951 (0–1)1.04 ± 1.001 (0–2)
12 *. I am not really interested in how other people feel.0.73 ± 0.931 (0–1)0.85 ± 1.061 (0–1)
13. I get a strong urge to help when I see someone who is upset.3.30 ± 0.723 (3–4)3.24 ± 0.743 (3–4)
14 *. When I see someone being treated unfairly, I do not feel very much pity for them.0.85 ± 1.181 (0–1)1.00 ± 1.181 (0–1)
15 *. I find it silly for people to cry out of happiness.0.28 ± 0.710 (0–0)0.39 ± 0.830 (0–0)
16. When I see someone being taken advantage of, I feel kind of protective towards him\her3.15 ± 0.783 (3–4)3.06 ± 0.623 (3–3)
Note: * Items are reversed. SD = standard deviation.
Table 3. Total, positive, and negative total scores per demographic factors (n = 649).
Table 3. Total, positive, and negative total scores per demographic factors (n = 649).
Demographic FactorsOverall Positively Worded ItemsNegatively Worded Items
TEQ total score49.0 (45.0–52.0)24.0 (22.0–27.0)25.0 (22.0–27.0)
GenderM46.0 (42.0–48.0)23.0 (20.0–24.0)23.0 (21.0–25.0)
F50.0 (46.0–53.0)25.0 (23.0–27.0)25.0 (23.0–27.0)
p-value *p < 0.001p < 0.001p < 0.001
Age category21–22 years48.0 (45.0- 52.0)24.0 (22.0- 26.0)24.0 (22.0–27.0)
23–24 years50.0 (46.0–52.5)25.0 (23.0–27.0)25.0 (23.0–27.0)
25+ years49.0 (46.0–52.0)24.5 (22.0–27.0)25.0 (22.0–27.0)
p-value *0.0950.1830.112
Year of study448.0 (45.0–52.0)24.0 (22.0–27.0)24.0 (22.0–27.0)
549.0 (46.0–53.0)25.0 (22.0–27.0)25.0 (22.0–27.0)
649.0 (46.0–52.0)24.5 (22.0–26.0)25.0 (23.0–27.0)
p-value *0.6370.4780.960
Last year’s final grade7 or below48.0 (44.0–52.0)24.0 (22.0- 27.0)25.0 (23.0–27.0)
8 or above49.0 (45.0- 52.0)24.0 (22.0–27.0)25.0 (22.0–27.0)
p-value *0.6370.4780.960
* Mann-Whitney test.
Table 4. Factor loading for the three components after varimax rotation.
Table 4. Factor loading for the three components after varimax rotation.
Variable Comp1Comp2 Comp3
1. When someone else is feeling excited, I tend to get excited too.0.1403−0.17040.0725
2 *. Other people’s misfortunes do not disturb me a great deal.−0.01480.4837−0.2192
3. It upsets me to see someone being treated disrespectfully.0.4692−0.0438−0.0722
4 *. I remain unaffected when someone close to me is happy.0.09110.30100.0719
5. I enjoy making other people feel better.0.43670.04320.1634
6. I have tender, concerned feelings for people less fortunate than me.0.4026−0.09280.0200
7 *. When a friend starts to talk about his\her problems, I try to steer the conversation towards something else.0.0563−0.01700.3607
8. I can tell when others are sad even when they do not say anything.0.07240.3633−0.4426
9. I find that I am “in tune” with other people’s moods.0.02900.0687−0.0681
10 *. I do not feel sympathy for people who cause their own serious illnesses.0.00310.49470.0839
11 *. I become irritated when someone cries.0.0215−0.03130.4777
12 *. I am not really interested in how other people feel.−0.03480.41510.2161
13. I get a strong urge to help when I see someone who is upset.0.48200.06530.0212
14 *. When I see someone being treated unfairly, I do not feel very much pity for them.−0.04440.19520.4116
15 *. I find it silly for people to cry out of happiness.−0.01850.18960.3406
16. When I see someone being taken advantage of, I feel kind of protective towards him\her0.39150.0248−0.1034
Eigenvalues2.31.631.53
Percentage of variance14.410.29.6
alpha 0.6680.4350.389
Note: * Items are reversed.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ursoniu, S.; Serban, C.L.; Giurgi-Oncu, C.; Rivis, I.A.; Bucur, A.; Bredicean, A.-C.; Papava, I. Validation of the Romanian Version of the Toronto Empathy Questionnaire (TEQ) among Undergraduate Medical Students. Int. J. Environ. Res. Public Health 2021, 18, 12871. https://doi.org/10.3390/ijerph182412871

AMA Style

Ursoniu S, Serban CL, Giurgi-Oncu C, Rivis IA, Bucur A, Bredicean A-C, Papava I. Validation of the Romanian Version of the Toronto Empathy Questionnaire (TEQ) among Undergraduate Medical Students. International Journal of Environmental Research and Public Health. 2021; 18(24):12871. https://doi.org/10.3390/ijerph182412871

Chicago/Turabian Style

Ursoniu, Sorin, Costela Lacrimioara Serban, Catalina Giurgi-Oncu, Ioana Alexandra Rivis, Adina Bucur, Ana-Cristina Bredicean, and Ion Papava. 2021. "Validation of the Romanian Version of the Toronto Empathy Questionnaire (TEQ) among Undergraduate Medical Students" International Journal of Environmental Research and Public Health 18, no. 24: 12871. https://doi.org/10.3390/ijerph182412871

APA Style

Ursoniu, S., Serban, C. L., Giurgi-Oncu, C., Rivis, I. A., Bucur, A., Bredicean, A. -C., & Papava, I. (2021). Validation of the Romanian Version of the Toronto Empathy Questionnaire (TEQ) among Undergraduate Medical Students. International Journal of Environmental Research and Public Health, 18(24), 12871. https://doi.org/10.3390/ijerph182412871

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop