The results of this research are collected, considering the results obtained in the survey by questionnaire and the survey by interview.
4.1. Survey by Questionnaire
Regarding the degree of satisfaction of teachers regarding the use of the Microsoft 365 platform, the results reveal that—regarding the level of competence in the use of Microsoft 365 education—most of the responding teachers (75.3%) consider that their level is not beginner, but medium (63.4%) or advanced (11.9%), and that they have not undergone adequate training for the use of this platform. The issue of training, specifically in relation to the lack of specific training for the use of distance learning platforms, is in concordance with the national results presented in other studies [
2,
3,
33,
34]. The teachers who received training in this area did so mainly during the period of confinement in which distance learning was used. 30% had training before the confinement, 66.7% during the period of confinement, and only 3.3% after this period. In fact, the results show that in the context of the pandemic, the teachers had not had specific training for a teaching context such as this, i.e., they had no training to respond to such a challenging circumstance for the entire school community. In such an adverse and emergency context, there is a clear need to create the conditions and structures that can respond to an adequate teacher training program. In line with Moreira and Schlemmer [
35], we argue that the demands of the “new normal” show the imperative need to adjust to a complex reality where the multicultural, multidisciplinary, and multidimensional character is evident.
From the analysis of the participants’ answers, we can see that when teachers needed help using the Microsoft 365 platform, 32.7% turned to someone in the school support structure, 30.7% looked for information on YouTube, 27.7% stated that they had the support of a colleague, and only 8.9% revealed that they had resorted to the help of the ICT coordinator of their school group. These results are in consonance with the study by Marôco [
3], where 74% of the teachers stated that they had not appealed to the support of formal, institutional networks (ICT Coordinator of the School), and 90% of the respondents stated that they had not requested any help from specialized technical services or even consultants external to the school. In the same line, Escola [
33] noted that the fact that teachers had not received initial or continuing training on distance learning platforms had not stopped them from continuing their teaching activities even when they were confined. Teachers kept in contact with students by using informal groups, social networks, colleagues, friends, or even family members. This context also helped the dialogue and collaboration between teachers [
33].
From the point of view of the time when the teachers started using the Microsoft 365 platform, it can be seen from
Figure 1 that most of the teachers participating in this study (42 respondents) only started using Microsoft 365 at the beginning of the confinement period imposed by COVID-19.
From the analysis of the data in
Figure 2, the Microsoft 365 applications that teachers use the most are Teams, “synchronous interaction tool” [
14], Word, Forms, Outlook, and PowerPoint. Skype is the tool that reaped the least use from the teachers who participated in the study.
The question about the advantages of using Microsoft 365 in education provided a set of data presented in
Table 2 and worth reflecting on. Note that each participant could choose more than one option. For 26.3% of the teachers, the use of Microsoft 365 allows for proper management of classes and individual students, through the Notepad, a tool that allows for scheduling of activities, notes, communications with students or parents, among others. 21.2% of the teachers consider that the platform simplifies the organization of teaching and learning materials, and a very close percentage of teachers (19.2%) argue that it facilitates communication with students and promotes greater contact with them. 16.2% think that it allows additional learning material to be made available to students. Security issues attracted the attention of 15.1% of the teachers, who are convinced that the platform provides greater security for both teachers and students, since only registered teachers and students can access class content. A very small percentage of teachers (2%) consider that Microsoft 365 offers a suitable environment for conducting online tests or quizzes.
A very relevant fact is that, with the end of the confinement and the return to face-to-face teaching, even if maintaining security measures and physical distance, digital platforms continued to be used, although at a lower level. It is important not to forget that, according to the results of Marôco’s study [
3], 35% of the teachers surveyed declared that they had never used a distance learning platform, (Moodle, Classroom, MSTeams, or any other) [
34]. This study reinforces precisely this perception of ours (Cf.
Table 3), since more than half of the responding teachers—equivalent to 45.6%—continued to use Microsoft 365 to support or complement face-to-face teaching (supplementary material is made available online for teaching or study); 27.2% use it for classes in mixed format, hybrid teaching (in some cases there are teaching units that are organized online); and 20.8% used it to contact parents. Only 6.4% use it to support and clarify students’ doubts and to contact students and other teachers. Once more, we recall that each participant could choose more than one option.
The results obtained are in line with the results of some national research. Ribeirinha and Silva [
2] consider that teaching in the future will tend to be hybrid, where we will be able to observe distance learning tools being integrated into teachers’ teaching practices; in the research of Marôco [
3] it is clear the intention to continue to use it in the future in a mixed regime. The interviews conducted with some of the teachers who responded to this questionnaire survey, already in the year 2022, confirm the continuity in the use of the Microsoft 365 platform.
It should be noted that teachers who responded to the questionnaire survey stated they use other platforms in addition to Microsoft 365. In fact, the data in
Table 4 show that 14.2% of teachers also used Google Classroom, 19.1% used Leya’s Aula Digital, 28.4% used Porto Editora’s Virtual School, and 38.3% of teachers used Zoom/Colibri. This latter platform is very popular with Portuguese teachers. As we have mentioned before, each participant could choose more than one option.
As time goes by and despite the return to face-to-face teaching, the idea that the use of platforms will remain [
2,
31,
32] is being consolidated. Regarding the question about the progression in the use of Microsoft 365 since the time it was implemented, it is perhaps important underlining very relevant data: only 1% of respondents reported making a lesser use of Microsoft 365 and, 66.3% of respondents state that they increasingly use this platform. Only 32.7% claim to make a similar use to the one they did in the initial period of the pandemic (
Figure 3).
These results corroborate those of the study by Ribeirinha and Silva [
2] who argue that, due to the needs imposed by the pandemic, we would see a reinforcement of the use of distance learning resources. The position of Cabero-Almenara [
11], although referring to the Spanish educational context, considers that the pandemic led to profound transformations in the educational system, making it possible to observe the passage from a model centered on the transmission of information, with the emphasis on the face-to-face dimension, to a model strongly centered and mediated by technologies.
Concerning the possibilities offered by the Microsoft 365 platform, we can say that the satisfaction level of participants is very high. In fact, more than three four of the teachers (78.2%) are satisfied with what they can do with the platform. Teachers are of the opinion that the platform provides schools, teachers, and students with the resources they need to continue learning in a remote learning context, as shown in
Figure 4. Only 3% are very dissatisfied.
To understand more clearly the degree of teachers’ satisfaction about the dimensions:
Intuitiveness and way of organizing materials on the platform; quickness/speed of learning the interface and way of navigating; assessment tools (tests, questionnaires, …); help/Guidance Tools; collaborative features (sharing files and other resources; agenda, calendar, …); communication features with other teachers from the same educational community; communication features with students; access to the educational contents of the course (materials format, e.g., flash, html, pdf); integration with mobile communication devices (e.g., tablet, mobile phone); integration with other collaborative applications (e.g., online whiteboards, forums, …), we present
Table 5,
Table 6,
Table 7 and
Table 8. To evaluate the degree of teachers’ satisfaction regarding the different dimensions of Microsoft 365, a five-level Likert scale was used with the correspondence: 1—very dissatisfying; 2—unsatisfying; 3—indifferent; 4—satisfactory; and 5—excellent.
Almost 10% of respondents considered Microsoft 365 an excellent platform with respect to the intuitiveness and organization of the materials on the platform, and 78.2% were satisfied with the platform in this dimension. Only 4.0% are unsatisfied or very unsatisfied. Regarding the speed/celerity of learning of the interface and form of navigation, four out of five teachers (79.2%) mentioned that they are satisfied and only 3% state that they are dissatisfied. About two-thirds of the respondents (65.3%) are satisfied with the assessment tools as well as the help and guidance tools (
Table 6). However, if we look at the results where the question “What was the biggest educational advantage of Microsoft 365” was answered, a residual percentage considered that this platform provides a suitable environment for conducting online tests or quizzes. The study of Marôco [
3] also indicated the difficulties revealed by teachers in the use of distance learning platforms for assessment tasks: 14% of the respondents reported experiencing difficulties in using software/digital applications to carry out the assessment.
The data in
Table 7 illustrates a very positive perception of Microsoft 365’s features in the collaborative, communication, and communication dimensions, both between teachers and between teachers and students. “Satisfactory” and “excellent” together aggregate 95% of the respondents, which shows the teachers’ very positive representation of these features.
Regarding the question about teacher satisfaction regarding the educational content of the subject, only 3% of teachers say they are dissatisfied; for 17.8% they reveal that it is indifferent, and the majority confirms that they are satisfied as shown in
Table 8. About the integration of mobile communication devices, whether tablet or mobile phone, most teachers (78.2%) say they are satisfied. With identical values (71.29%) of teachers considered the integration of Microsoft 365 with other collaborative applications (e.g., online whiteboards, forums, among others) as “satisfactory” or “excellent”.
The data on teachers’ level of satisfaction—given the results from the answers to the previous questions—helps explain that 60.4% of teachers said they would probably recommend Microsoft 365 to a friend and 35.6% would do so without doubt or hesitation. Only 4.0% are unlikely to recommend the Microsoft 365 platform to a friend.
4.2. Survey by Interview
The interview results are presented following the eight dimensions considered: (a) identification elements, (b) Microsoft 365 use context, (c) resources domain, (d) objectives for use, (e) description of practice, (f) difficulties experienced, (g) results, and (h) future prospects.
All translations of the interviewees’ answers were made by the authors.
- (a)
Identification Elements
Regarding Professional experience, we found a considerable variation for each of the subjects. The minimum length of service is three years, and the maximum is 32 years of service. Regarding contractual situation and professional stability, only one of the interviewees has a fixed-term contract with the state. Most interviewees have an indefinite labor contract with the state. From the point of view of the analysis of the results, this data is very relevant since through it we can see that the situation of these professionals confers considerable professional stability to the interviewed teachers.
Concerning Academic training, four of the interviewees hold a bachelor’s degree, and the remaining ones hold a master’s degree. One of the respondents has a Ph.D. and another is still studying for a Ph.D.
- (b)
Microsoft 365 Use Context
All interviewees confirm their ability and competence to install Microsoft 365 on both computer and mobile devices, making use of it to support their teaching practice. What is at issue here is the technical competence to work with the hardware. The ability to perform software installation falls under this category.
Regarding the media for using the platform, all respondents mention that they use Microsoft 365 from various devices, giving as an example the school computer, laptop, tablet, or mobile phone.
E3 highlights the importance of using Microsoft 365 from mobile devices, highlighting the dimensions of interactivity and ubiquity. The comfort of use regardless of space and support facilitates ubiquitous learning. The mastery of devices allows for the development of digital skills that are facilitators of students’ learning. In this regard, teacher E3 says:
“Yes. I installed it because it is easy and practical. It is practical because sometimes we must attend a department meeting and we still go on a trip, and we can attend the meeting. When the student has a question and puts it in the chat, I can answer it even though I am not at home and so solve the problem quickly to the student.” (E3)
Concerning the full use of the Microsoft 365 features, all interview respondents confirm a very extensive use of them. The answers clearly fall within the domain of teachers’ digital competences. The teachers’ perception of the usability of the Microsoft 365 features is explored. Referring to the full use of the features E3 states:
“I use the ones I think are useful for my work as a teacher.” (E3)
To the question regarding the production of innovative resources based on Microsoft 365 tools/applications all interviewees replied in the affirmative.
E3 answers:
“Yes, without a doubt. I launch assignments to be developed by students in Word, I create Quizzes in Forms, I organize and process data in Excel and PowerPoint.…” (E3)
Regarding training in the use of Microsoft 365, none of the interviewees revealed having received specific training in its use.
In this respect, E3 says:
“No, because I didn’t have the opportunity. I would like to because I would like to improve my performance.” (E3)
However, the reasons given to justify this absence relate to the fact that there was no opportunity before the actual need arose, from the closure of schools in March 2020 and the requirement to maintain the teaching activity in distance learning. It is very revealing to recall that Portuguese teachers were invited to use distance learning platforms as soon as the period of confinement began. Remote emergency teaching required the use of the platform by teachers and students; however, no training had been provided. The need for remote emergency teaching imposed the use, regardless of whether there had been training in the use of the platform.
In all interviewees, there is a clear recognition of the importance of training in the use of Microsoft 365. While on the one hand they recognize the relevance of training in teaching practice, on the other they draw attention to specific aspects that need to be addressed in the training domain. The respondents identified some tools that, in their opinion, needed improvement, be it OneNote, Excel, or network management software, among others.
Some interviewees’ responses addressed the importance of training in the use of Microsoft 365:
“I think it is always important to have training, because we always learn and the sharing of experiences that usually occurs is very important. In the case of 365 I think it is essential to improve the mastery of OneNote which is a tool with a lot of potential and which many still don’t use and can be a good alternative to the daily notebook.” (E2)
“If you do not have previous relevant experience, you should carry out general training in productivity tools such as Excel and file management on the network.” (E4)
“Yes. I think it is very important because we need to use it more and more with the students and we need to master its use to use it.” (E1)
- (c)
Resource Domain
Regarding the mastery of the resource all respondents confirmed having Microsoft 365 installed on their school computer, personal computer, tablet, or their own mobile phone.
Considering its functionalities, all respondents consider that they know all the functionalities.
Regarding preferences for any of the tools, we found some variability in the answers:
“In the day to day, I use many tools: Word, Excel, Outlook, Forms, SharePoint, Teams, OneDrive, among others.” (E1)
“OneDrive because I can put all the documents and access them anywhere. SharePoint is a document sharing tool where we can always add something which is good for those who work in collaboration and in group… Teams, word, excel….” (E8)
- (d)
Objectives for Use
As for the objectives for the use of Microsoft 365, the purposes centered on the bureaucratic activities that teachers develop linked to the students are indicated.
Some answers:
“To give synchronous lessons through Teams e.g., to share information with students, to propose activity to students, to receive assignments, to assess students through quizzes e.g., to communicate with students and parents.…” (E3)
“Streamline/simplify daily tasks and promote greater communication and interaction with students and work colleagues.” (E4)
With regard to the tools that respondents use most with their students, Teems was identified:
“Sharing materials, tutorial guidance of students, to communicate with them and parents/careers.” (E1)
Other responses:
“Teams, Word, Excel, Outlook, Forms.” (E3)
“Teams for communicating with students and answering questions; Microsoft OneNote—for filing information, carrying out work, monitoring and giving feedback; Forms for formative assessment.” (E2)
“Microsoft OneNote—To archive information, carry out work, monitor and give feedback.” (E4)
When analyzing the interviews, using the qualitative analysis software NVivo, regarding the dimension “objectives for use” of Microsoft 365 and its functionalities we obtained the following results which can be seen in
Figure 5.
From the analysis of
Figure 5, the emphasis on communication, sharing and cooperation provided by the use of Microsoft 365 is quite evident.
- (e)
Description of the Practice
Regarding their practice as Microsoft 365 users, the interviewees stated that the platform fulfilled the following functions: as a basic user to produce simple documents for daily and mandatory use; as an advanced user to produce, store, and share information documents and resources; receive documents and information; receive and change information or resources for sharing; receive and change information or resources for personal use; develop innovative and different pedagogical resources for students all interviewees stated that they positively fulfilled these dimensions.
Concerning the dimension of specific moments when Microsoft 365 is used, the interviewees did not consider that a specific moment could be established for the use of Microsoft 365. In some cases, the interviewees referred that it is used at the beginning of the lesson, it is used for the organization of contents at different moments of the lesson or even to perform assessment moments. The situations of isolation and the consequent need to communicate with isolated students also dictated different moments for the use of Microsoft 365.
E1 said:
“No. I use it when I consider it important and essential. Of course, when I have sick students at home, so I necessarily use 365 for synchronous and asynchronous lessons.” (E3)
All interviewees considered that since they started using Microsoft 365 their practice has become easier, there has been a simplification. E3 and E4 stated in this regard:
“Undoubtedly more streamlined. I have everything more organized.” (E3)
“The work is more simplified but requires some preparation time that is easily recovered in the monitoring and feedback processes.” (E4)
Regarding the methodologies used, there is a consensus among the interviewees about the need to use active methodologies with Microsoft 365. They all state that they use active methodologies in their practice. As stated by E2, E3, and E4:
“No doubt active methodologies.” (E2)
“Active methodologies because my students are protagonists. The teaching process does not happen without their intervention and participation. Students don’t just sit and listen, taking notes. They debate, criticize, do. They help build knowledge together with the teacher and with their colleagues. Hybrid teaching methodologies are conceptions that make use of the technological possibilities of current times. Among them is the flipped classroom, which as the name says, reverses the whole traditional classroom logic. In it, learning begins at home rather than at school. The student does his own research on the internet and online materials about previously passed themes, and arrives in class with knowledge in his baggage, which is then debated with teachers and colleagues. This method allows for the optimization of class time, which is then used to deepen the knowledge on the subject and answer questions. After class, the student can still do more learning with multimedia resources that can be made available by the teacher.” (E3)
“Active methodologies, namely project-based learning, Design Thinking, and STEAM methodology. To create a stimulating and motivating environment that allows working on several skills simultaneously.” (E4)
Concerning the question “Considers your practice with Microsoft 365 to be good practice”, all the teachers interviewed maintained that they had good practice, although it was naturally subject to improvement processes (E5, E7, and E8). We can see the options that legitimize teachers’ assessment from the descriptions:
“A good practice is one that leads the student to achieve essential learning, and as my practice has led them down that path then it is a good practice. So, I use it to get them to look for information, to get them curious and that to me is good practice.” (E1)
“It’s a good pedagogical practice because I provide information and materials for the student to work on at the time, he/she thinks is best. In addition, as I can clear up doubts by chat, video conference or call, the student feels more accompanied.” (E2)
“Microsoft 365 allows me to perform active and flipped classroom methodologies, so I think it’s a good practice.” (E3)
“It is a good pedagogical practice because it allows planning and designing a strategy to reach an end. In a dynamic/interactive way the student autonomously, or accompanied, travels the defined path to achieve an objective/competence.” (E4)
- (f)
Difficulties Experienced
Regarding the difficulties they experienced and the options to overcome them were similar. On the one hand, they warned about the difficulties of using Microsoft 365 due to lack of training and the support strategies that centered on seeking help not so much in the schools’ support structures, but mainly seeking help from colleagues or even YouTube tutorials. We transcribe the statements of E1:
“Watching videos on YouTube or asking colleagues.” (E1)
This practice is confirmed by Marôco’s study [
3]. Although institutions have provided support structures for teachers, focusing on the ICT coordinator for this function, most teachers sought help in informal groups on social networks, with colleagues from the institution or outside the institution, in YouTube tutorials.
E2 mentions the lack of digital literacy of parents and students, to be able to consistently support the teachers’ effort to ensure teaching activities in distance learning context. Faced with difficulty, interviewee E2 explains what the strategy was chosen to overcome the lack of literacy: “I seek to increase the digital literacy of students and parents with short webinars.” (E2)
Within the framework of the difficulties pointed out, the obvious lack of conditions for distance activities also merited negative comment, with the lack of quality of the network being a constant. The issues of digital divide became more evident during the pandemic period. The scarcity of equipment, the lack of Internet access, the lack of network quality in educational institutions, or low network quality in inland areas are effective dimensions of the digital divide. E3’s statements attest to these difficulties when he says:
“Sometimes it is the internet network failure.” (E3)
And E4:
“Security policies instituted by the institution that condition the sharing and easy transport of documents. And access difficulties in case of deficient internet networks. To overcome the difficulties, the options are to resort to local storage units and use offline applications.” (E4)
About the difficulties experienced by participants while using Microsoft 365, the content analysis provided by NVivo generated the following responses (
Figure 6).
- (g)
Results
When asked about the results obtained, the interviewees argued that students achieve better results and in less time with the use of this tool. Interviewee E2 is less categorical or at least retains some caution on the issue of obtaining better results in less time, although he leans towards this perception:
“I haven’t used 365 for that long to say for sure if I need more or less time, but it seems to me that less time, as it is a platform with a lot of potential and very intuitive.” (E2)
Regarding the changes in learning resulting from a more systematic use of Microsoft 365 with students, these seem evident. Increased autonomy (E1, E2), possibility to participate in online working groups, where the teacher guides, shares information, monitors and provides feedback (E1, E7, E8).
About changes in teachers’ work, E1 said: “sharing of strategies and resources is highlighted.” (E1)
The interviewees considered that the use of Microsoft 365 did not change the concept of teacher (E1, E2, E3, E4, E5, E6, E7, E8), but in the case of E1, it ensured a deepening of the concept of teacher. The traditional vision of the educational action was largely overcome by teachers when they assumed the centrality of the student in the learning processes, when they privileged learning over teaching, when they bet on the student as the builder of his/her own learning, using digital media as mediators in the communication processes. As teachers who stood out for their practice in the use of digital media, the answers confirm the deepening of the concept of teaching and teacher (E1).
E6 states that the use of Microsoft 365 “has not changed my belief of what it is to be a teacher, but it has improved it” (E6); and that the increased use of the platform “made me use more digital resources to teach the lessons, allowing me to organize the lessons in a less traditional way” (E6).
Regarding the level of usefulness of Microsoft 365, on a scale where 1 was not at all useful and 5 was very relevant, the answers were mostly between 4 and 5, with the majority at 5. Only E1 scored 4.
- (h)
Future Perspectives
In relation to the questions focusing on future perspectives on the continuity of a practice where the use of Microsoft 365 is integrated, all interviewees were unanimous in stating their intention to continue using this platform. At the same time, they expressed the expectation that some changes would be introduced—in a word, improvements allowing “facilitating and saving work” for the teacher and “allowing for pedagogical differentiation” (E1).
Within the framework of future perspectives, we also highlight the issue of digital literacy. The pandemic issue brought to the agenda the issue of literacy not only of teachers, but also of students.
E3 answers “I hope students will be more active and improve their digital literacy” (E3).
Regarding the ideal practice for using Microsoft 365 the interviewees highlighted some dimensions such as promoting students’ autonomy, developing communication skills among peers and between students and teachers, facilitating students’ learning. We transcribe some of the positions of the interviewees:
Some answers:
“One that promotes more autonomy, improves communication between students and teachers and teachers and students, facilitates the teacher’s work and enhances students’ learning.” (E2).
“It would be one that allows all teachers and students to make learning.” (E3).
“The development of greater autonomy and transversal skills.” (E4).