1. Introduction
The COVID-19 pandemic has affected higher education institutions (HEIs) in their activities in order to promote the protection of their lecturers, staff, and students in a public health emergency. The institutions had no alternative but to cancel all face-to-face lectures, including labs and other learning experiences, and to determine that lecturers completely switch the courses to emergency online learning, reducing contacts and thereby preventing the spread of the virus.
This teaching model that many call “emergency remote teaching” [
1], includes the use of totally remote teaching solutions, mediated by the internet, to ensure activities that would otherwise be taught in a face-to-face form, returning to this format once the crisis or emergency is overcome [
1]. The followed model seems similar to the online learning that has been stated by Anderson [
2], referring to a teaching and learning type in which: (1) the student and the lecturer are at physical distance; (2) student–content, student–lecturer and student–student interactions are mediated by technology; and (3) some type of support is provided [
2].
In the COVID-19 context, higher education lecturers were challenged by the need for the adoption of online learning practices, for which the majority were not prepared [
3], and there were no indications that they were interested in using it [
4]. The faculty members had to prepare and teach their lectures from home, with all the practical and technical challenges that this entails, and often without adequate technical support [
1]. In addition to the lack of required online specific pedagogical competences, it is generally agreed that in a normal situation, the challenge to effectively transfer what is taught in a face-to-face classroom to an online version remains a problem [
3]. Most of these lecturers, who normally develop their activities face-to-face, do not reveal an interest in online learning (only about 30% to 35% consider this option) [
4,
5]. This position is caused by the lack of motivation and incentives resulting from various obstacles that can be summarized as technological readiness [
6,
7,
8], absence of organizational incentive to compensate for extra work [
9,
10], and the prejudices related to the value of online teaching [
5,
11,
12].
In a normal situation, the most relevant motivations for adopting online learning are related to the concern of reaching new audiences, diversifying the HEI’s offer, and contributing to the management of organizational change and the positioning of the HEI´s offer in the context of online education [
9,
11,
12,
13].
In the emergency caused by COVID-19, lecturers needed, overnight, to use tools with which they felt comfortable [
14]. Face-to-face lecturers thus needed to develop online teaching activities in order to avoid the collapse of the teaching and learning process. In this situation, lecturers adopted emergency remote teaching that. as stated by Hodges [
1] (p. 6), “is a temporary shift of instructional delivery to an alternate delivery mode due to crisis circumstances”. Emergency online teaching is different from all other situations in which online teaching and learning activities are planned by lecturers who have online teaching skills. For many of these lecturers with little or no experience in online teaching, the option was to transport the typical activities they developed for face-to-face teaching to the online environment and, gradually, introduce activities that would allow more meaningful learning [
15]. Despite the skills and support limitations, lecturers have a positive sentiment about emergency online learning [
16,
17].
The present investigation focuses on the motivations of lecturers with no, or little, experience in online teaching. Without any other option, these lecturers were required to adopt emergency online teaching. In order to address this great challenge, lecturers changed their attitude towards online education, their favorite activities, and technological experience. This study aims to investigate whether these feelings and skills affect online teaching sentiment. It aims to understand how lecturers perceive the impact of this experience on students’ learning, on their teaching activity, and in the development of HEI online learning strategy.
The document is organized into six sections: the present section, which introduces the research topic, the motivation, and the aim; the following section, which presents the conceptual model and hypothesis for the research; the methodology is then described, followed by the sections of the obtained results, its discussion, and final remarks in the conclusions.
3. Methodology
3.1. Participants
The participants (n = 65) were lecturers form a Portuguese private HEI. This HEI has a total of 98 lecturers that were invited to participate in the questionnaire. The link to questionnaire was sent to everyone through e-mail message, along with an introduction about the research objectives.
3.2. Data Colletion
The data were collected through online surveys from April to May 2020. The aggregated response rate was 79%, and the final sample consisted of 66% of the reference population. From 98 potential respondents, 78 questionnaires were answered by respondents, of which 13 were rejected because of missing values.
3.3. Lecturers’ Personal Information/Demographic Data
In the total of sample of lecturers, the percentage of females was 40%, while that of males was 60%. A total of 1.5% of lecturers were up to 29 years of age, 13.8% from 30 to 39 years of age, 46.2% between 40 to 49 years of age, 21.5% between 50 to 59 years of age, and 16.9% were 60 years of age or older. In terms of the academic qualifications of the lecturers, 23.1% of participants held bachelor’s degrees, 33.8% held master’s degrees, and 43.1% held a doctoral degree. The teaching experience shows that 18.5% had up to 4 years, 20% had from 5 to 9 years, 24.6% had 10 to 19 years of experience, and 36.9% disclosed 20 or more years of experience.
3.4. Survey Instrument and Structure
The questionnaire consisted of six sections. The first section intended to characterize the respondents. In the second section, respondents were asked about their attitude toward online teaching and learning with a 5-point Likert scale (1—lower; 2—sometimes lower; 3—no significant differences; 4—sometimes higher; 5—higher). The third section was to evaluate the degree of preference/satisfaction with the online activities. A 10-point end defined scale with ratings from null (1) to high (10) was chosen, in order to produce increased sensitivity of the measurement instrument [
34]. In the fourth section, respondents were asked to self-assess their technology skills. A 4-point Likert scale was adopted (1—none; 2—up to 3 years; 3—from 3 to 6 years; 4—more than 6 years).
The fifth section of the questionnaire survey presents three open questions about the impact of emergency online teaching and learning in the present and in the future of (1) student´s learning, (2) teaching activities, and (3) online learning and teaching in HEI strategy. These questions are intended to collect data for sentiment analysis about online learning and teaching.
Table 1 presents the constructs of each section and the sources which inspired them.
3.5. Pilot Study for the Questionnaire
A pilot study was conducted to check the reliability of the questionnaire items. The sample size was set based on 20% of the aggregated sample size of this study (98 lecturers) and thus adhered strictly to the research criteria. Cronbach’s alpha test was utilized for the computation of internal reliability [
40] through IBM SPSS Statistics v26, in order to judge the outcomes of the pilot study. A value of 0.7 was taken to be an acceptable value for the reliability coefficient, considering the model for social science research [
41,
42,
43]. The appropriate findings are shown in
Table 2.
3.6. Sentiment Analysis
The fifth section of the questionnaire presents three open questions about the impact of emergency online teaching and learning in the future of (1) student´s learning, (2) teaching activities, and (3) online learning and teaching in HEI strategy. These questions are intended to collect data for sentiment analysis towards online learning and teaching.
There are many applications and enhancements on sentiment analysis algorithms that have been proposed in the last few years [
33]. For this work the OpLexicon 3.0 was used. It is a sentiment lexicon for the Portuguese language, built using multiple sources of information, and has four categories of words: verbs, adjectives, hashtag, and emoticons. The lexicon is constituted of around 32,000 polarized words classified by their morphological category and annotated with positive (1), negative (−1), and neutral (0) polarities [
30,
38].
The sentiment analysis was developed in R [
44] following the following steps represented in
Figure 2: (1) the words are extracted from each answer of the open questions in the questionnaire; (2) verification of whether the word is present in the OpLexicon and determination of the polarity; (3) the sum of the polarity of the word in the answer is determined; and the final step is (4) to convert the sum of polarity to a Likert scale.
The conversion to a Likert scale was based in the following Algorithm 1, where each answer is processed after the determination of the cut points (median values) used to convert to a scale aligned with the other questions of the survey:
Algorithm 1 Likert Calculation |
1: Input: polarity of the open questions |
2: Output: likert values for open questions |
3: Begin: likertCalculation |
4: assign median(negative answer polarity) to mNegSent |
5: assign median(positive answer polarity) to mPosSent |
6: assign 0 to answerPolarity |
7: for each answer do |
8: if answerPolarity <= mNegSent then |
9: answerLikertScale = 1 |
10: else if answerPolarity > mNegSent and answerPolarity < 0 |
11: answerLikertScale = 2 |
12: else if answerPolarity = 0 |
13: answerLikertScale = 3 |
14: else if answerPolarity <= mPosSent and answerPolarity > 0 |
15: answerLikertScale = 4 |
16: else if answerPolarity > mPosSent and answerPolarity > 0 |
17: answerLikertScale = 5 |
18: End: likertCalculation |
As an example, considering the opinion “I consider that my adaptation was made in a smooth way”, the next step is the processing of each word: “I (1) consider (2) that (3) my (4) adaptation (5) was (6) made (7) in (8) a (9) smooth (10) way (11)”. To determine the polarity of each word, OpLexicon 3.0 was used. In the example given, only the word “smooth” (10) returns value 1 (positive polarity) from OpLexicon; all the other words do not have an associated polarity, returning “word is not present in dataset”. The algebraic sum of the returned values is 1. Consequently, this answer would get a polarity value of 1. After performing this step, an algorithm is developed following the “Likert calculation”, calculating the median of the negative and positive words in each question: (1) negative values less or equal to the negative values median were assigned one, (2) negative values less than zero and greater than median were assigned two, (3) 0 (neutral) was assigned three, (4) positive values and less than positive median were assigned four, and positive values greater than positive mean wrtr assigned five. The null values were replaced by 0 representing the absence of an answer.
3.7. SPSS and SmartPLS 3
The demographic data was evaluated with the aid of IBM SPSS Statistics v26. SmartPLS 3 software was used with a graphical user-interface to estimate the PLS-SEM models [
45]. This tool can cope with smaller sample size (<100), non-normal data, exploratory research for the same effect size and model complexity, and it can more easily specify formative constructs [
46,
47].
3.8. Adjustment Quality for the SEM Model
The following fit measures were considered to assess the adjustment quality of the model:
Loadings. For a well-fitting model, path loadings should be above 0.70 and “indicator with a measurement loading in the 0.40 to 0.70 range should be dropped if dropping it improves composite reliability” [
46] (p. 103). Having tested this option, the conditions were not met, and the items were not dropped.
Variance inflation factor (VIF). Indicates multicollinearity. In a well-fitting model, the structural VIF coefficients should not be higher than 5 [
48].
Cronbach Alpha (CA). George and Mallery [
49] suggest the following scale: >0.90 “Excellent”, >0.80 “Good”, 0.70 “Acceptable”, >0.60 “Questionable”, >0.50 “Poor” and <0.50 “Unacceptable”.
Composite reliability (CR). Values between 0.70 and 0.90 are considered satisfactory [
46].
R-square. Results above the cut-offs 0.67, 0.33, and 0.19 to be “substantial”, “moderate”, and “weak”, respectively [
46].
Average variance extracted (AVE). Greater than 0.50 means that the model converges with a satisfactory result (AVE > 0.50) [
50].
Discriminant validity (DV). The square roots of the AVEs should be greater than the correlations of the constructs [
51].
F-square. Values of 0.02 represents a “small” effect, 0.15 represents a “medium” effect, and 0.35 represents a “high” effect size [
46].
Finally, evaluating the predictive validity or Stone–Geisser indicator for the accuracy of the adjusted model. Q
2 > 0 implies the model has predictive relevance [
46,
52] (
Table 6).
5. Discussion
A questionnaire was conducted with the participation of 66% (n = 65) of all lecturers (98) for a Portuguese private HEI who developed their activities in an emergency online teaching environment. The study examined their attitude toward online teaching, what online activities they most value, and investigated whether technological experience influences these attitude and preferences. The opinions of these lecturers in relation to emergency online teaching, namely their impact on students’ learning, their professional development, and the development of HEI strategy was also examined. Finally, a conceptual model was proposed and tested to assess the effect of attitudes, activities, and technological experience on online teaching sentiment. In the following points, the results obtained in relation to the previous literature are discussed.
5.1. Attitude toward Online Teaching
The results showed that lecturers have a positive attitude towards emergency online teaching, showing an identical availability to face-to-face teaching. This conclusion coincides with other studies conducted in an emergency online teaching that show that lecturers report more on the advantages of distance education [
53]. This is reinforced by the results obtained in the analysis of the impact of online teaching sentiment on teaching and students’ learning.
Based on this conclusion, at least in an emergency situation, lecturers do not question the value of online teaching. Although this is not the same type of education, these conclusions are more positive than the results obtained in a normal situation when questioning face-to-face lectures about their availability and acceptance of online teaching [
5,
11].
5.2. Preferred Activities
The most preferred activities of lecturers (“online sessions”, “oral presentations”, and “written assignments”) confirm the García-Peñalvo et al. study [
15] and reveal that lecturers relied on the “tools” they dominated and only later did they begin to use resources more adjusted to online teaching and learning. This strategy is confirmed by Rapanta et al. [
14], who state that many non-specialist online lecturers have chosen to focus on materials/resources that they would use anyway to teach the course content, regardless of whether they are face-to-face or online.
Despite the difficulties related to the emergency online teaching that cannot be compared with “normal” online teaching, some of the options found can be problematized. However, as concluded by Spoel et al. [
54], there was the attempt to provide students with the basic ingredients for learning (online lectures, group activities, discussion forums, etc.) that reveal concern with diversification, thus seeking to correspond to the different student learning profiles [
22,
23].
This adaptability seems to confirm Anderson in that “an excellent e-teacher is an excellent teacher” [
2] (p.360), possessing pedagogical skills that allow them to understand the teaching process, in order to be able to make the best use of the range of activities they have at their disposal.
5.3. Technological Experience
Pre-pandemic studies [
7,
8,
10] show that technological readiness can be a factor that conditions the participation of lecturers in online teaching. Although these conclusions cannot be directly transposed to emergency online education, results show that the participants in this study had technological experience in some of the tools for the development of online activities.
5.4. Sentiment Analysis
Lecturers have a positive or neutral sentiment about the impact of emergency online learning on students’ learning. These findings are similar to others, where it was concluded that lecturers expressed a favorable opinion about the students’ academic performance during the COVID-19 pandemic outbreak [
16,
17]. The findings of this study are slightly more positive than the results reported by Tartavulea et al. [
55], which concluded that emergency online teaching has an overall moderate positive impact on the educational process, albeit the overall effectiveness of the online educational experience is perceived to be lower than in the case of face-to-face teaching.
Likewise, lecturers expressed a neutral or positive sentiment regarding the impact of emergency online teaching on their professional activity. In addition to showing high availability for online teaching, lecturers do not refer to the eventual need for compensation for the required additional work caused by transposition of face-to-face to emergency online teaching, as studies about online teaching reveal [
9].
Lecturers thus seem to prefer to take advantage of the professional development opportunity that the situation offers [
4]. These conclusions reveal a positive stance that HEIs that intend to invest in online teaching strategies cannot miss. Studies carried out in a pandemic situation have not focused on this aspect, so it is not possible to make comparisons with similar situations. Despite this, there is pre-pandemic literature that shows that lecturers do not consider online teaching as having a positive impact on their careers [
4,
13].
The results verified in the sentiment analysis about the impact of emergency online teaching for the future development of the HEI are in line with other studies which were carried out outside the emergency context, and where the contribution to organizational change and positioning of the HEI offer are the aspects most frequently pointed out by lecturers on the adoption online teaching [
9,
11,
12,
13]. The extra time and effort invested by lecturers in emergency online teaching can explain the positive perception regarding the impact on HEI strategy [
54].
5.5. Conceptual Model
The results of the conceptual model test show that the model has well-fitting conditions. In relation to each of the tested hypotheses it is concluded that five of the six hypotheses have been confirmed (
Table 12). The obtained values show that the effect of POA and EXT on OTS, and TEX on POA are strong (>0.35), while the effects of OTA and TEX on POA are moderate (>0.15) [
56].
5.6. Limitations
Some limitations of the present study must be highlighted. First, the study was carried out in an institution with 98 lecturers, of which 66% submitted valid responses (no missing data). The sample size (n = 65) represents the HEI population, but with all respondents belonging to a single HEI, the study does not allow generalizing the results for Portuguese HEIs.
Another limitation of the study is the fact that the results are based on the respondents’ perceptions, which may cause a bias. Although it was clarified that the survey results would only be used for the purposes of the survey, respondents may be tempted to choose the “correct” answer or the more socially desired answer, thus being vulnerable to distortions [
42].
The way in which the transition from face-to-face to the emergency online teaching was carried out may justify why lecturers expressed a greater degree of preference for lectures (online sessions). This preference, by itself, could indicate that they merely transposed the “bad” face-to-face practices to the online environment, namely the face-to-face expository sessions. However, despite this greater preference, there is a significant degree of adherence to other activities, namely oral presentations, written assignments (in group), discussion forums, and chat. The diversity and characteristics of these activities can enhance student–lecturer or student–student interaction, leaving good indications about teaching and learning process [
2].
The conditions available were certainly not the same in all institutions, just as they are not the same in the face-to-face context. These differences may have affected, to a greater or lesser extent, the quality of the solutions adopted and should be considered as a moderating factor when extending the study to other HEIs.
6. Conclusions
After the emergency online teaching experiences related to COVID-19 pandemic situation, lecturers acquired an experience that will mark their teaching life forever. As the storm passes and face-to-face classes are resumed in a normal environment, HEIs can expect less resistance and more enthusiasm for online teaching from their lecturers [
3,
4]. So that this enthusiasm does not fade away, it will be necessary to support the training of lecturers by providing them with the skills and competences they require to act in the context of online education. Hybrid approaches integrating online teaching with face-to-face activities can represent a significant improvement when many studies reveal that online education constitutes a key factor for the development of HEIs [
4].
This work only reflects the perspective of the lecturers. In parallel, another study is being carried out that will reflect the students’ perspective and that will allow a comparison between the two perspectives to be established.
Further research, ideally expanding the sample size with participation of lecturers from different HEIs, is required to verify whether the proposed model continues to maintain theoretical validity. In the same way, this extension will allow confirmation of the findings.