1. Introduction
Universities around the world have been ardently innovating learning and teaching through digital technology, such as intelligent tutoring systems, virtual learning environments, mobile computing devices, and artificial intelligence-powered applications [
1,
2,
3]. The various forms of learning that are facilitated by digital technology are broadly called technology-enhanced learning (TEL) [
4]. The reasons behind institutional commitments in TEL are related to the potential benefits of TEL, for instance, increasing student engagement and achievement, enabling more flexibility in learning and teaching, and enlarging access to quality resources [
5,
6].
However, TEL often involves changes in established learning and teaching practice and requires stronger self-regulation and time management abilities, thus incurring changed expectations of university students [
2]. Eventually, those who are not used to TEL may experience technostress, which, in the context of this study, is defined as a maladaptation problem caused by individuals’ incapability to cope with the demands of technology and changing requirements associated with the use of technology in their work in a healthy manner [
1,
7,
8]. As the potentials of digital technology are determined by the way in which it is used, it makes little sense to discuss technology without the pedagogy revolving around it [
5]. Therefore, technostress in the field of education is related to not only technical issues but pedagogical issues, in particular.
Technostress can lead to a variety of negative consequences to individuals’ psychological and physiological health, for instance, frustration, anxiety, and fatigue [
9,
10]. It can further adversely affect their work, such as causing concentration problems, biasing their judgements of digital technology, and decreasing work performance [
11,
12]. Students with high technostress may reduce their involvement in TEL and even quit TEL entirely [
2,
13]. As such, the issue of technostress is subject to due attention from educational practitioners in higher education.
Previous research on technostress mainly focused on employees in the workplace [
14,
15] and a limited amount of research attention has also been given to the teacher population, for instance, secondary teachers [
9,
11] and academics in higher education [
10]. However, there has been a dearth of studies investigating technostress experienced by university students who are often the main users of digital technology in higher education, which has been continually shaped and reshaped by digital technology [
4,
13].
Therefore, to preserve university students’ wellbeing and refine future implementation of TEL in higher education, this study aimed to investigate how technostress affects students’ learning in TEL. The stressor-strain-outcome (SSO) model was used for this purpose as it provides a parsimonious theoretical framework to explain how the maladaptation to TEL predisposes university students to strain and consequently causes outcomes for their learning.
In addition, as prior studies [
16,
17] diverge on the mediating effect of gender on technostress and its impact on individuals’ life and work, this study will continue the exploration of this topic to further examine the relationship between demographics and technostress. As the participants in this study mainly came from two disciplines (social sciences: Psychology and educational science; engineering and natural sciences: Material science, electric engineering, and computer science), it will be helpful for future improvement decisions of TEL by examining how students from different disciplines may differ in their experience of technostress. Finally, based on our knowledge of the research context, we found that some TEL courses were compulsory while others were not. As individuals tend to behave differently based on their willingness to join activities [
18], examining how students’ willingness to join TEL may affect their technostress will inform future implementation of TEL in different courses. Therefore, this study aims to address the following research questions:
- (1)
How does technostress affect students’ learning in TEL via burnout?
- (2)
How do factors such as gender, disciplines, and willingness to join TEL moderate the relationships among technostress, burnout, and students’ learning in TEL?
The remainder of this paper is organized in the following ways.
Section 2 presents the theoretical framework in which prior studies on technostress, the SSO model, and the proposed research model of this study are given.
Section 3 focuses on the methodology where the participants, the research context, the instrument, and the technique for data analysis are presented. Afterwards,
Section 4 reports the research findings, which are discussed in
Section 5 along with the contributions, implications, and limitations. This study is concluded in
Section 6.
3. Methodology
3.1. Participants and Research Context
The data were collected from students of three large public universities (the focal university hereafter) in northern China. The universities were similar in size, student demographics, and rankings in academic strength. As female students far outnumbered males in the focal universities, we approached the administrative offices in the universities for help in obtaining participants with a more balanced gender distribution. Among the 950 participants we approached using convenience sampling, valid responses from 796 of them were attained with their informed consent, among whom there were 381 males and 415 females with the age ranging from 18 to 23 years. There were 334 of them studying social sciences and 462 studying engineering and natural sciences. Most of the participants (568 students) indicated that they joined TEL willingly while 228 participants indicated that they joined TEL against their willingness.
The focal universities had been supportive of the implementation of TEL by making favorable policies and setting up special funds for it. For instance, faculty who intended to make small private online courses would be fully subsidized. Those who were experimenting with a flipped classroom would get more credit in yearly performance appraisals. Some TEL were implemented from the institutional level, for example, by introducing massive open online courses (MOOCs) to their curricula and assigning credit to them. Others were carried out by different departments and faculty based on their actual needs. For instance, vendors specializing in application development collaborated with faculty to transform their traditional courses to flipped classroom. Mobile learning was also quite popular thanks to the ubiquity of smartphones. Nevertheless, despite the benign intentions on the part of the universities to use digital technology to increase students’ engagement and achievement, there are often mismatches between universities’ expectations and students’ reactions [
2].
3.2. Focus Group Interviews
To contextualize the hypotheses and adapt the survey items in this study as well as to flesh out the quantitative findings, focus group interviews were conducted as they offered an efficient way of gaining in-depth insights into students’ positive and maladaptive experiences of TEL [
37]. Forty-one students were selected using purposive sampling, with 10 students from electronic engineering, physics, and psychology each and 11 students from educational sciences. Each focus group interview was conducted with 5 to 6 students and lasted approximately 30 min. To counteract potential disadvantages of focus group interviews, such as biased results due to dominant group members, responses were cross-checked across individuals within a group and between groups. Focus group interviews were semi-structured and were organized around questions such as: How is your experience with TEL? What are your perceptions of the five technostress creators, if there are any? The interviews were audio-recorded and transcribed and were analyzed with Excel spreadsheets.
The interview transcripts were analyzed by relating them back and forth to the hypotheses and survey items with the objective of contextualizing and adapting them to the current study. In doing so, we sought to underline how technostress may arise when the students from different disciplines engage in TEL in which the use of digital technology and changed learning requirements challenge students’ established learning practice and compel them to spend more time and effort to adapt to the challenges, thereby imposing increasing levels of stresses on the students. Most students indeed supported the implementation of TEL in their universities as they perceived that TEL benefited them substantially. However, many of them also pointed out the problems in TEL, which can be conceptualized in terms of technostress.
For instance, TEL increased the complexity of students’ work and slowed down their learning progress. Echoing previous studies such as Selwyn [
2], some students we interviewed complained that the learning resources in TEL did not have consistent designs. Some courses in the learning management system (LMS) were designed with such a bewildering labyrinth of headings or were filled with so many materials that it made it very difficult for students to look for information relevant to their work. There were also students complaining about the poorly designed LMS itself, where the catalogues of functions were very convoluted for the students to navigate through. As a result, they had to spend more time on performing learning tasks online than completing equivalent tasks offline. All these issues tended to increase the difficulty levels of students’ work in TEL, further adding to their stresses. Consequently, their learning agency, persistence in TEL, and self-regulation might be compromised [
8,
38].
In addition, to flesh out the quantitative results, thematic analysis was also used. The interview transcripts were coded using the quantitative findings as a starting list of codes by following the analysis procedures suggested by Creswell [
39]. However, it was possible that not all quantitative findings would be related to the interview transcripts as the focus group interviews were conducted before statistical modeling. Representative quotations from the focus group interviews were selected to highlight and elaborate on some key findings from statistical modeling. Throughout the process of qualitative analyses, researchers reiteratively analyzed and discussed the data until all disagreements were settled.
3.3. Instrumentation
The survey instrument consists of three sections, including stressors (techno-overload (four items), techno-invasion (four items), techno-complexity (five items), techno-insecurity (four items), and techno-uncertainty (five items)), strain (burnout (six items)), and negative outcomes for learning performance (self-regulation (six items), learning agency (four items), and persistence in TEL (five items)). The items of the constructs were rated on a five-point Likert scale where 0 = strongly disagree and 4 = strongly agree. The survey was developed through several iterative refinements before it was administered to all participants. The original survey adapted from previous studies was first reviewed by three experts in the field of TEL, who critiqued the survey items for validity. Then the improved version of the survey was trailed by 10 student participants to test their understanding of the items. Those causing possible confusions were further refined. Considering that the survey was in English, we used a back-translation procedure to minimize differences between the English and Chinese versions.
Specifically, the five technostress creators were adapted from Ragu-Nathan et al. [
17] and Fuglseth and Sørebø [
29]. The Cronbach’s alpha values of the five technostress creators were reported to range from 0.77 to 0.87. The items for each technostress creator were essentially negatively worded. For instance, to indicate techno-uncertainty, we have items such as “I am uncertain about the usefulness of technology-enhanced learning”; to indicate techno-invasion, we have items such as “I have less free time due to the implementation of technology-enhanced learning”. Burnout was adapted from Kristensen et al. [
30], including items such as “I feel overwhelmed due to technology-enhanced learning”. The Cronbach’s alpha value was reported to be 0.87. The construct of self-regulation was adapted from Barnard et al. [
23]. Sample items included “I set clear goals in technology-enhanced learning”. The reported Cronbach’s alpha value was 0.78. Learning agency was adapted from Kearney et al. [
32], with a reported Cronbach’s alpha value of approximately 0.78. Sample items included “I am active in participating in technology-enhanced learning”. Finally, the items measuring persistence in TEL were adapted from Wu and Chen [
35], with a reported Cronbach’s alpha value of 0.94. Sample items contained “I persist in completing technology-enhanced courses that I have registered for”. As the items of the five technostress creators and burnout showed strong negative connotations while the remaining three constructs were positively worded, to align the scoring of all items, the item scoring of self-regulation, learning agency, and persistence in TEL were reversed [
40].
3.4. Analysis of Survey Data
The survey data of this study were analyzed using the partial least squares structural equation modeling (PLS-SEM), which is a variance-based SEM [
41]. It is prediction-oriented and exploratory in essence with the aim of maximizing the variance explained for dependent variables. Compared with the covariance-based SEM, which is confirmatory and theory-oriented, PLS-SEM does not require big sample sizes and multivariate normality assumption, and avoids the issues of factor indeterminacy and non-convergence [
42]. As the present study sought to explore how technostress creators could predict students’ TEL via burnout, PLS-SEM fitted the purpose of this study. According to Hair et al. [
43], a two-step analytical procedure was adopted, with the measurement model being examined first followed by the structural model. Subsequently, group comparisons were conducted to explore how the relationships among technostress, burnout, and students’ learning in TEL were affected by the students of different genders, disciplines, and willingness to join TEL.
4. Results
4.1. Validating the Measures
To establish the quality of the measures in the current study, an initial round of reliability checks and confirmatory factor analysis (CFA) was performed. Following that, common method bias was examined. In the end, the proposed technostress model was tested through PLS-SEM using the PLS-SEM package [
44].
In the initial round of reliability analysis, the Cronbach’s alpha values of all the variables were as follows: Techno-overload (0.93), techno-invasion (0.91), techno-complexity (0.93), techno-insecurity (0.85), techno-uncertainty (0.94), burnout (0.95), self-regulation (0.93), learning agency (0.93), and persistence (0.93), all exceeding 0.70 and hence indicating high reliability. According to Cangur and Ercan [
45] and Hooper et al. [
46], the CFA was assessed based on the following criteria: (a) 2.0 ≤ the normed chi-square (χ
2/df) ≤ 5.0; (b) the comparative fit index (CFI) ≥ 0.90; (c) normed fit index (NFI) ≥ 0.90; (d) standardized root mean square residual (SRMR) < 0.05, and (e) root mean square error of approximation (RMSEA) ≤ 0.08. In this study, the outcomes from the confirmatory factor analysis suggest satisfactory model fit, with χ
2 = 3580.94,
p < 0.001, χ
2/df = 3.46, CFI = 0.94, NFI = 0.91, SRMR = 0.03, and RMSEA = 0.06.
Harman’s single-factor analysis [
47] was used to detect potential common method variance, which could negatively affect the finding of the study. When all indicators were loaded onto one factor, the total variance for the single factor was 18.82%, which was lower than 50%, implying a low possibility of committing common method bias. Subsequently, PLS-SEM was used to compute the proposed technostress model. Two items in technostress-complexity and one item in technostress-insecurity were removed due to low discriminant validity. Eventually, the measurement model demonstrated strong reliability and validity (see
Table 1 and
Table 2).
4.2. Structural Model
The path coefficients in the technostress model, the endogenous factors’ explanatory power (
R2), and the global goodness-of-fit (GoF) value were used to assess the structural model. With regard to the path coefficients, the bootstrapping method was applied to further validate them because PLS-SEM is not based on distributional assumption and thus parametric techniques are not appropriate [
44,
48].
Table 3 demonstrates the bootstrapping validation outcomes, which are visualized in
Figure 2. The outcomes are generally in line with the SSO model and support the association between technostress and learners’ negative responses in TEL. Specifically, techno-complexity, techno-insecurity, and techno-uncertainty were positively associated with burnout while techno-overload and techno-invasion were not. Therefore, Hypotheses 3–5 were substantiated while Hypotheses 1 and 2 were not. In addition, as hypothesized, the negative associations between burnout and students’ self-regulation, learning agency, and persistence in TEL were significant, thus, substantiating Hypotheses 6–8.
The
R2 values of the endogenous variables are often used as important criteria to determine the structural models’ quality because of the aim of PLS-SEM, which is to maximize the variance accounted for in endogenous variables [
49]. In this study, the
R2 values of burnout, self-regulation, learning agency, and persistence in TEL are 0.47, 0.21, 0.10, and 0.12 (see
Figure 2), respectively, indicating medium-to-large effect sizes [
50].
In addition, according to the global GoF proposed by Tenenhaus et al. [
51], values of 0.10, 0.25, and 0.36 represent a small, medium, and large fit, respectively. The technostress model in this study generated a GoF value of 0.42, implying a good fit of the technostress model with the data.
4.3. Group Comparisons in Terms of Genders, Academic Disciplines, and Willingness to Join TELL
To explore whether gender, academic disciplines, and willingness to join TEL make a difference in the associations between technostress creators and students’ outcomes in TEL, multiple group comparisons were performed by comparing differences at the path coefficients of the technostress model [
44,
48].
The whole dataset was split into different sub-datasets according to gender, academic disciplines, and willingness to join TEL. Then the bootstrap t-test method was conducted to examine potential differences in terms of the path coefficients among different variables between sub-datasets.
4.3.1. Gender Differences in the Technostress Model
Table 4 indicates that there are significant differences between male and female students in terms of (a) the path coefficient of burnout on self-regulation in TEL,
t (794) = 2.59,
p < 0.01, (b) the path coefficient of burnout on learning agency in TEL,
t (794) = 2.45,
p < 0.01, and (c) the path coefficient of burnout on persistence in TEL,
t (794) = 2.50,
p < 0.01. The differences imply that burnout may cause a more significant negative influence on male students’ self-regulation, learning agency, and persistence in TEL than females.
4.3.2. Differences Based on Students’ Academic Disciplines
As shown in
Table 5, there is a significant difference between students from social sciences and engineering and natural sciences in respect to the path coefficient of techno-complexity on burnout in TEL,
t (794) = 1.94,
p < 0.05, implying that techno-complexity may cause more burnout for students from social sciences than those from engineering and natural sciences.
4.3.3. Differences Based on Willingness to Join TEL
Table 6 show that there are significant differences between students who joined TEL willingly and unwillingly in terms of the path coefficients of burnout on self-regulation (
t (794) = 2.94,
p < 0.01), learning agency (
t (794) = 3.75,
p < 0.001), and persistence in TEL (
t (794) = 4.12,
p < 0.001). This suggests that burnout may lead to a stronger negative influence on students who participate in TEL unwillingly than those who did so willingly.
4.4. Relating Qualitative Findings to Statistical Modelling
By relating the qualitative findings to statistical modeling, we hoped to gain an in-depth understanding of the emergence of technostress in TEL and its impacts on learners’ wellbeing and performance. Overall, the qualitative analyses of the focus group interviews largely corroborated the statistical modelling, excerpt for the group comparison outcomes, which were not easily discernible from interviews.
As many courses were using mobile LMSs to support blended learning, techno-overload and techno-invasion had become quite common in students’ daily lives. Nonetheless, the interviewed participants did not seem to feel frustrated towards these issues. One participant, for instance, stated:
I have five courses using YuKeTang (a mobile LMS). It seems to push notifications to me after whatever the instructors have done on it, for instance, uploading new learning materials, making course announcements, and even making a slight adjustment to course materials. As a result, I normally receive dozens of notifications every day, including weekends. Some notifications require me to respond immediately or within a short time frame, regardless of whether I am taking a different course or having meals at that time. At first, I find them very annoying. But now, I have already gotten used to them. (Student 2 with a Psychology major).
This phenomenon was usual for the participants who were taking several blended learning courses and largely bore out the statistical findings of insignificant negative effects of techno-overload and techno-invasion on students’ academic performance and wellbeing.
Techno-insecurity was mainly manifested in scenarios where students were forced to change their learning habits and felt stressed and insecure to adapt to new ones. As indicated by a student majoring in educational sciences but taking a math course, “math is already very difficult for me. But our instructor insists on using YuKeTang for assignments. Typing the formulas in computers is killing me…why not stay with paper-based assignments where I can freely scribble…” Even though YuKeTang facilitated quick feedback and flexibility in learning, the student did not seem to appreciate the advantages. Techno-complexity has been described in
Section 3.2 when contextualizing the hypotheses of this study. As the hypothesized positive relationship between techno-complexity and burnout was substantiated, we will not elaborate on this hypothesis here to avoid redundancy.
Techno-uncertainty emerged when students were uncertain about what exactly TEL expected from them. The feelings of uncertainty toward TEL might lead students to self-doubt and feel strained. The experience of techno-uncertainty and consequent burnout seemed to be particularly frequent among the students taking recorded online courses. The focus group interviews offered a deeper understanding of this phenomenon, as evinced by a student majoring in electronic engineering:
I am in the top five percent of my class. However, I often feel at a loss when it comes to online courses as I do not perceive clear course instructions. The learning objectives in the (online) courses are blurry and confusing. (Student 4 with an electronic engineering major).
Another student experienced similar challenges:
In face-to-face courses, our instructors usually reiterate their course requirements now and then and guide us on how to develop proper learning strategies. But online instructors only focus on presenting content knowledge… I often end up feeling disoriented and demotivated. (Student 1 majoring in physics).
An immediate consequence of techno-uncertainty was decreased engagement, which can be conceived as reduced self-regulation, agency, and persistence in TEL. As opined by a student majoring in psychology, “we simply want to pass the courses rather than obtaining the highest scores…”
5. Discussion
This study aimed to investigate the issue of technostress among students in higher education through the lens of the SSO model. Most hypotheses were substantiated and thus largely support the effectiveness of the SSO model in explaining how technostress creators may lead to negative impacts on students’ outcomes in TEL. The results related to six out of the eight hypotheses (Hypotheses 3–8), provided further evidence-based support to the finding of prior studies about the consequences of technostress for individuals’ work and life [
10,
13,
37].
The result that techno-overload was not significantly related to burnout (Hypothesis 1) seems to be unreasonable at first sight. Nevertheless, to a certain extent, it seems to be resonant with Hung et al. [
21], who found that techno-overload actually improved individuals’ performance at work. This could be because even though TEL may require more investment of time and effort than conventional pedagogy, it provides convenience and quality resources for students, thereby likely counteracting the strain caused by overload. The result that techno-invasion was not greatly associated with burnout (Hypothesis 2) may be because that the participants in this study were full-time students mostly living inside the campuses, which also provide residential education. For them, campus life is often a mix of formal education in classrooms and informal education in private spaces. Therefore, they may have been used to the blurred boundary between TEL and their private lives.
Nevertheless, the findings in this study are quite different from Qi [
22], which found that the academic use of mobile devices did not cause technostress. The reason may be that in Qi’s study, mobile devices were only used as media to deliver learning and teaching resources. There was almost no sign of pedagogical interventions related to mobile devices. The structure of learning and teaching was not reshaped by the integration of mobile devices. In other words, mobile devices were not used in a way that challenged students’ established learning habits. However, TEL, such as blended learning and accredited MOOCs in the focal universities, may have already challenged or changed students’ learning practice, consequently causing varying levels of technostress for students.
Burnout had stronger negative relationships with self-regulation, learning agency, and persistence in TEL for male students than females. This finding corroborates Ragu-Nathan et al. [
17] who found that males experienced greater technostress and suffered from more consequences of technostress than females. This may be related to the characteristics of Chinese university students, among whom female students often demonstrate more positive attitudes toward learning than males and are more adaptive to changes caused by the integration of technology in learning [
52]. Consequently, burnout caused by technostress in TEL may have relatively lower negative effects on females than males.
Burnout had greater negative associations with self-regulation, learning agency, and persistence in TEL for students joining TEL unwillingly than those who did so willingly. This result is largely in line with previous studies such as Sumiyana and Sriwidharmanely [
18], which found that activities that are against students’ willingness may cause more adverse effects for students than those aligned with their willingness. When technology is used for serious purposes and compulsory for students, the entertaining side of technology may lose its luster and the coercive characteristic of TEL may disrupt students’ agency and internal control over their behaviors, eventually distancing students from persisted engagement in TEL.
Techno-complexity, among the five technostress creators, was more strongly associated with burnout for students in social sciences than those in engineering and natural sciences. It is quite challenging to give this finding a convincing explanation. Different academic disciplines have different training paradigms. Students in each discipline tend to develop their own patterns of reasoning and understanding and consequently, perceptions of their learning environments, which are closely linked to the characteristics and structures of their knowledge domains [
53]. Students with a science and engineering background tend to express significantly stronger preferences for a logical learning style, which emphasizes logic and reasoning, than those with a social science background [
54]. Therefore, they may be more proficient in dealing with complexity in learning environments than those in social sciences. As a result, the association between techno-complexity and burnout in TEL may not be as strong for them as for the students in social sciences. However, this argument should not be interpreted with a derogatory connotation because each academic discipline has its own merits and we are not seeking to argue which way of training is superior.
5.1. Contributions
This study may contribute to current research and practice on technostress, which are often not discussed to an extant in institutional and scholastic efforts toward digitalized education, in the following ways. First, by conceptualizing problems (e.g., overload, physical/psychological strains, and disrupted routine practices) associated with the implementation of TEL in higher education in terms of the idea of technostress, this study provides a new perspective to understanding the imbalanced interplay between students and the implementation of TEL and therefore, suggests alternative solutions to the implementation problems that go beyond introducing newer and/or more advanced technology, for instance, setting clear expectations and requirements of TEL and aligning them with students’ capabilities.
Second, this study has demonstrated the suitability and effectiveness of the SSO model in unravelling how technostress may affect university students in TEL, thus contributing to the advancement of theories for investigating technostress in higher education. Third, this study contributes to the limited but emerging stream of research on possible downsides associated with the integration of technology in higher education. By examining how technostress creators in TEL impact university students’ learning through the SSO framework, the present study provides evidence-based arguments for more future scholastic and practical efforts to tackle this issue and also informs future implementation decisions related to TEL.
Finally, the group comparisons based on gender, academic disciplines, and willingness to join TEL contribute new insights into how the effects of technostress on university students’ learning in TEL may vary based on these factors, thereby enriching our knowledge of the functioning of technostress and subsequently, inspiring the development of targeted countermeasures against this issue. For instance, instead of mandating TEL for all students, universities may consider allowing students more choices regarding course solutions or more forms of TEL so as to appeal to their learning habits and preferences and decrease the chance of suffering technostress.
5.2. Implications
The current study carries the following implications for educators, administrators, and students in higher education. First, the findings of the negative associations between technostress and students’ learning in TEL underscore the importance of adopting a more practical and realistic, instead of idealistic and aspirational, expectations of and perspectives on the integration of technology in higher education for educational practitioners with an interest in using technology to transform learning and teaching.
Second, the technostress creators examined in this study are not related to technical issues in essence. Instead, they were mostly caused by insufficient skills of adapting to TEL or lack of pedagogical designs with regard to the integration of technology in the classroom. Thus, university commitments toward improving the digital literacy of students and educators need to address not only technical skills but also pedagogical skills in the use of technology for learning and teaching, in particular. In doing so, educators in higher education can design and implement TEL in a way that is more suitable to students’ needs and capabilities. As a result, students can manage to adapt to TEL in a healthier manner. The balance between TEL’s requirements and students’ capabilities will maximally eradicate the source of technostress [
9].
Third, institutional efforts seeking successful implementation of TEL are advised to take into consideration the mediation factors such as gender, academic disciplines, and willingness to join TEL, instead of taking a one-size-fits-all approach. For instance, considering that male students and those who are compelled to join TEL are more likely to experience burnout caused by technostress, greater efforts are suggested to guide these students in adapting to TEL. Furthermore, universities are advised to allow students more flexibility and power to determine their engagement into TEL, instead of pushing the agenda of digitalized education mainly for the sake of institutional interests [
2].
5.3. Limitations and Future Research
Nevertheless, the interpretation of the findings of this study should consider the following limitations. First, although the issue of technostress was contextualized in the implementation of TEL in this study, data were collected at a given point. Therefore, causal relationships among technostress creators and strain and psychological outcomes cannot be obtained. Longitudinal studies are suggested to further validate the findings of this study to achieve causal relationships. Second, cultural differences may exist among students from different universities and cultures in their perceptions of technostress and potential negative effects of technostress on students’ psychological and behavioral responses. More follow-up studies are needed to examine the generalizability of this study’s findings. Third, this study only included self-reported measures and did not consider actual learning outcomes or objectively observed learning-related behaviors. Future studies may consider validating the research findings by collecting these types of data. Fourth, although the technostress creators examined in this study are typical and have been reported in many previous studies, they are not exhaustive. As such, future research may consider exploring more types of technostress creators related to the use of technology in higher education so as to provide a more comprehensive understanding of how they affect university students’ learning. Fifth, informed but also constrained by the SSO model, this study did not fully consider all possible relationships among technostress creators, strain, and outcomes. Thus, future studies are suggested to further explore the relationships among these variables (and/or their variants) while considering alternative theories so as to gain a better understanding of technostress and its consequences for learners’ wellbeing and performance in TEL.