1. Introduction
Competency-based veterinary education is an academic innovation implemented in Europe to ensure that graduates meet their professional and social needs [
1]. The focus on student-centered learning and teaching outcomes offers a series of benefits to students, institutions, and society. However, the establishment of a shared, comprehensive, competency-based framework in veterinary education is under constant review. Currently, areas of innovation (research into teaching and learning) in veterinary education focus on assessment tool validation, developing new learning resources to support different learning styles, and evaluating the effectiveness of technology in the acquisition of the required professional competencies.
Recent years have witnessed an explosive growth in the use of educational technology in veterinary education in order to foster an active learning environment. The practical element of cytology and histology (CH), which aims to teach learners to identify different cells, tissues, and organs, has traditionally been undertaken using glass slides and an optical microscope (OM), with the use of web-based resources being limited to static images. Students often complained that they could only examine the histological slides during practical sessions, which, in their opinion, did not given them enough time to acquire sufficient histological interpretation skills. To address this, and to improve the teaching of histology and pathology, over the last five years, several veterinary faculties have begun integrating virtual microscopy (VM) into their study programs [
2,
3,
4]. The teaching challenges brought about by the COVID-19 crisis, particularly the necessity of an abrupt switch to remote teaching [
5], have highlighted the important role of VM in imparting practical skills in medical histology and pathology education [
6,
7,
8].
Our research aims to assess the quality of histology teaching and the lockdown-adapted student evaluation process that was developed during the COVID-19 pandemic, with a particular focus on VM as a key tool for practical teaching. Our original approach is based on comparing the methodologies used in the 2018–2019 course (traditional face-to-face—presential—learning and evaluation) and 2019–2020 course (some face-to-face and some online lockdown-adapted learning and online lockdown-adapted evaluation). To achieve our aim, we analyzed student outcomes with respect to the acquisition of the required competencies in CH by Veterinary Medicine undergraduate students at the University of León (León, Spain). The specific aims of the present study were (i) to describe the lockdown-adapted teaching and learning methodology developed in response to the COVID-19 pandemic that affected the 2019–2020 student cohort, (ii) to assess their efficacy by means of a comparison of student outcomes between the 2019–2020 cohort and the 2018–2019 cohort that received the traditional face-to-face course, (iii) to evaluate the potential weaknesses of the online methodology (teaching and evaluation), and (iv) to assess the students’ level of satisfaction after using VM as either a complementary or main tool for practical training, during, respectively, the traditional face-to-face course and the lock-down-adapted course.
2. Materials and Methods
2.1. Overview of Cytology and Histology at the University of León
CH is a mandatory subject that is taught in the second semester (from February to July) of the first year of the Degree of Veterinary Medicine at the University of León (León, Spain). The course covers the morphological study of healthy cells (cytology), and the association among cells to form tissues (histology), as well as organs and systems (microscopic anatomy). CH carries a total of six European credits (ECTS), for which the final score is calculated as follows: 27% theory, 55% practical knowledges, 10% supervised work, 4% online tests to be scored and 4% attendance.
Pre-COVID, the students would complete 45 h of laboratory sessions, where they gain practical training in histological techniques (1 h), histology (16 h), and microscopic anatomy (28 h) (
Table 1).
Each laboratory session on Histology and Microscopic Anatomy (2 h/session) consisted of an explanation by the lecturer and subsequent visualization by the students (approximately 45 min) of a set of the corresponding histological slides using a single-headed OM. Any questions brought up by students would also be answered by the lecturer in the practical part of the session. In the 2018–2019 academic year, VM was introduced as a complementary tool to improve teaching and provide students with continuous access to microscopy samples for study. Students could contact their lecturers via email or meet face-to-face throughout the course.
In Spain, the COVID-19 lockdown started on 14 March 2020. At this point, the cytology and histology sections of the course had already been taught, meaning that the main impact was seen during the Microscopic Anatomy section of the course. Teaching was immediately adapted to the new situation with the provision of online resources including pre-recorded lectures and VM on Moodle (
Table 1). The Moodle platform is a free and open-source learning platform that educational institutions use to deliver courses and learning material to students. Moodle stands for “Modular Object-Oriented Dynamic Learning Environment”, and is distributed under the GNU General Public License. The platform has different tools, including: generating data such as online logs (i.e., views and messages), the participation of students in different activities and conducting surveys. The pre-recorded lectures followed a similar pattern to face-to-face classroom teaching, containing an explanation of theoretical concepts linking to applied histology using relevant images of organ tissues. VM became the key tool for practical training, totally replacing the use of conventional microscopy in the laboratory. Students’ problems were solved via email.
2.2. Preparation of Virtual Microscopy Slides
Histological slides from different tissues and organs were scanned at 400× magnification using the whole-slide scanning facility on an Olympus BX51® (Olympus, Osaka, Japan) light microscopy. This system created high-resolution digital images of tissue sections, and these “virtual slides” could then be distributed to students through the Unileon network using hyperlinks available through the Moodle platform. Students could use Adobe Flash Player to view the virtual slides, which could be studied with 1.5× to 40× magnification.
An explanatory video was made available on the Moodle platform to train students in the use of VM for the examination of histological slides. Students could access the virtual slides any day and at any time from any computer connected to the Internet. Any problems that were encountered were solved by communication with lecturers via email.
2.3. Study Design and Participants
This quasi-experimental study was carried out using a corpus of students completing the CH course as part of their degree in Veterinary Medicine. The outcomes for two cohorts were compared: those who studied the course in 2018–2019 and received traditional face-to-face teaching with presential evaluation (n = 113) and those who studied the course in 2019–2020 and initially experienced face-to-face teaching followed by a period of online teaching and fully online evaluation (n = 114).
Lockdown-adapted teaching and student evaluation methods were compared with those used in traditional (face-to-face) course (
Table 1 and
Table 2). Both traditional and lockdown-adapted courses were taught by the same lecturers.
Our two student cohorts were non-random samples of convenience; thus, their homogeneity is not guaranteed. In this way, the results reported here must be interpreted strictly within the limits of this study.
2.4. Methods for Evaluating Students’ Acquisition of Required Competencies
Traditional student evaluation methods in CH included two written theory exams, both comprising short-answer questions, one assessing understanding of tissue components and the other assessing understanding of organ components (
Table 2). Practical knowledge was assessed by two further written exams: (1) one in the classroom concerning the identification of cells, tissues (
Table 2, image a), and organs (
Table 2, image b) using projected static microscopic images, and (2) a second one in the laboratory concerning the identification and description of organs by examining histological slides under an OM (
Table 2, image c).
During the COVID-19 lockdown, assessment followed the same four exam formats as before; however, rather than taking place in-person, exams were completed online on Moodle (
Table 2, images d–f). The online assessment procedure was designed to prevent communication between students and minimize opportunities to consult external sources of assistance. Measures included: (a) dividing students into random groups that accessed the exam within a 1-min interval of each other, with the students being told to which group they belonged immediately before the exam started; (b) giving each group a different exam; (c) establishing the optimal time limit for completing each exam as the time taken for the lecturer to complete it multiplied by 1.5; (d) randomizing question order on every exam so that no groups had exactly the same exam; (e) designing the exam so that there were two pages, with half the questions on each, and when students moved from one page to the next they were unable to go back to the previous page; and (f) giving penalty marks for incorrect answers.
In addition, both pre-pandemic and lockdown cohorts took four online self-assessment tests: one concerning cells, one about tissues, and two on organs. Correct answers were provided as feedback.
In the pre-pandemic course, attendance represented 4% of students’ final score and, during lockdown, this component was replaced by giving students the opportunity to complete a number of voluntary, self-assessed, non-scored online tests. Tests consisted of 4–5 questions on the topics covered by the pre-recorded lectures that were made available during lockdown. The tests were available for a limited time (5 days), and correct answers were provided as feedback once the questionnaire was closed. Students were able to email the lecturer responsible for each topic to resolve any problems. Figure 1 shows the Moodle activity recorded for the CH course in both the time leading up to and after the COVID-19 lockdown. The schedule of main activities is also indicated, and both student and lecturer activity is given in terms of the total number of logs onto the Moodle platform throughout the period of interest.
2.5. Criteria for Evaluating Students’ Acquired Knowledge
The following parameters were used to identify differences in learning outcomes between the traditional and the lockdown-adapted courses:
Monitoring scores obtained in the theoretical exams (presential exams versus online Moodle exams). Students could score from 0 to 12 points out of a total of 100 points in the cytology and histology examination, and from 0 to 15 points out of a total of 100 points in microscopic anatomy.
Monitoring scores obtained in the practical exams involving static images (presential exams versus online Moodle exams). Students could score from 0 to 15 points out of 100 in cytology and histology, and from 0 to 25 points out of 100 in microscopic anatomy.
Monitoring scores obtained in the practical exams involving microscope use to identify and describe organs (presential exams using OM versus online exams using VM). Here, students could score from 0 to 15 points out of a total of 100 points.
Final scores for the whole course adjusted to a 10-point scale, where 0 corresponded to the lowest score obtained in a given cohort. A further scaled score was obtained by grouping the 10-point scale into 4 categories, as follows: <5 for “fail”; 5 to 6.9 for “pass”; 7 to 8.9 for “good”; and ≥9 for “merit” (Real Decreto 1125/2003) [
9].
2.6. Student Satisfaction Survey
Student perceptions of the use of VM in both the traditional pre-COVID course and the lockdown-adapted course were surveyed using a specially designed questionnaire on the Moodle platform. The questionnaire was voluntary and remained open for two months (June–July) after teaching was completed. The questionnaire comprised several items, evaluated on either a four-level scale (“strongly agree”, “agree”, “neutral”, and “disagree”) or a two-level scale (“yes” and “no”) and also included a “free comment” section (see Table 3 in the Results section).
2.7. Statistical Study
Inferential statistical analysis was used to compare student scores obtained from the traditional (2018–2019) and lockdown-adapted (2019–2020) evaluation procedures. The Kolmogorov–Smirnov test was used to assess the normality of quantitative variables and, because data were found to not follow a normal distribution, comparisons between cohorts were completed using the non-parametric Mann–Whitney U test. Results were expressed in terms of the median and interquartile range. To compare the percentage pass rates and qualitative score rates of students on each course, a Chi-square test or Fisher’s exact test were used, as appropriate. Statistical significance was established for p ≤ 0.05 (two-tailed), and differences where p < 0.10 were described as tendencies. Statistical analysis was conducted using SPSS software version 26 (SPSS Inc., Armonk, NY, USA: IBM Corp) for Windows. All data for this study were anonymized and treated confidentially according to the EU Data Protection Directive 95/46/EC. Before the study could be completed, a positive evaluation by the Ethics Committee of the University of León was obtained (reference number ETICA-ULE-031-2019).
4. Discussion
In this study, we both assess and compare, for the first time, the theoretical and practical knowledge acquired by veterinary medicine students on cytology and histology, through a description of methodologies used prior to (traditional course) and during (lockdown-adapted course) the COVID-19 lockdown. The COVID-19 pandemic, and particularly the associated lockdown, gave rise to important changes in every sector, including education. At universities across the world, students and lecturers suddenly found themselves locked in their homes and unsure as to how they should go on with their academic activities. Teaching and learning had to continue, so lecturers were required to quickly adapt their traditional presential teaching methods and evaluation processes to the emerging remote methodology [
5]. A lack of both experience and digital competence among many lecturers generated an atmosphere of uncertainty, and lecturers faced a huge responsibility in choosing the best didactic and assessment methods to ensure students’ successful academic achievement [
10,
11]. Furthermore, the changes in methodology that were required to adapt teaching and learning to the new pandemic situation also had significant psychological and academic impacts on students. This is perhaps because, although most students belong to a generation who consider themselves digital natives, their expertise is mostly focused on the social aspects of information and communication technology (ICT), and not all students have sufficient digital competence for academic purposes. Indeed, the definition of “digital competence” is the ability to make confident, critical, and creative use of ICT to achieve goals in a suite of areas including not only inclusion and/or participation in society but also work, employability, learning, and leisure [
12]. In this regard, the adapted methodology was also useful for the students’ acquisition of transversal competencies such as the use of ICT to improve learning.
The results of this study, which were based on the experiences of veterinary medicine students on the CH course, suggest that student outcomes were not negatively affected by the lockdown-adapted methodology that was implemented to cope with the COVID-19 crisis. In fact, academic outcomes for the 2019–2020 student cohort were improved compared to those obtained by the previous cohort, who experienced the traditional, face-to-face course methodology. However, it is interesting to assess the impact on the teaching–learning that each of the various resources used during lockdown may have had, and their students’ ability to acquire the required competencies in CH. Online learning has come to stay, and will continue to be a major part of many university activities; thus, this assessment is necessary to identify potential weaknesses in new methodologies to improve online provisions in university teaching.
A particularly interesting finding in this study concerns students’ acquisition of theoretical knowledge. The pass rates for exams 1 and 2 (theoretical exams on cells and tissues, and organs, respectively) showed very different trends when comparing the face-to-face and online versions. The pass rates for the face-to-face and online versions of exam 1 were very similar (exam 1a (face-to-face): 80.6% versus exam 1b (online): 79.1%), while, for exam 2, the online exam pass rate (exam 2b: 89.0%) was significantly higher than that for its face-to-face version (exam 2a: 69.8%). One factor that may explain this difference is the teaching received by the two student cohorts for the examined material. Specifically, both student cohorts received presential teaching for the material examined in exams 1a and 1b, whereas the material examined in exam 2b (highest pass rate) was taught online. These results indicate that student outcomes are linked not only to assessment methods, but also to teaching methods [
5,
10].
Our results suggest that the good academic results we saw in 2019–2020 were partly due to the use of VM during the COVID-19 lockdown. During lockdown, the VM tool became the main resource, used not only for teaching and learning but also for student evaluation, since conventional OM was not available. In brief, VM involves the use of imaging software to examine the digitized optical microscope slides created using specialized slide scanners. VM software allows the user to navigate, change magnification, focus, and mark areas of interest on the slides. Several studies have shown that students obtained better learning outcomes when they were able to use VM rather than just OM [
6,
13,
14,
15], proving the usefulness of this technology for teaching and learning [
3,
4,
8]. However, its helpfulness as part of student evaluation, at least in the format employed in this study (i.e., as part of online exams in Moodle), is not clear from our results. Of particular concern is that the significant difference in the pass rate for students taking the face-to-face and online formats of exam 5 (87.6% and 100%, respectively) might not reflect the real level of knowledge acquired by some students. This questionnaire involved embedded digital images and essay-style questions where students were required to write free-text descriptions of the organ structures displayed and, during the manual marking of this exam, lecturers noted that exactly the same descriptions and the same mistakes appeared in different exams. This suggests that students may have prepared their answers in advance and then copied and pasted them into the Moodle answer box. In this instance, a change from essay-style questions to a more controlled format could perhaps reduce this vulnerability. Despite this weakness, identified in the evaluation process, the usefulness of VM as a key tool to the acquisition of histology skills cannot be underemphasized; it was a well-used resource for students throughout lockdown and particularly during the exam period.
There are several elements that may have made online teaching more productive for the students in our study. In addition to the use of VM mentioned above, another set of resources was the pre-recorded lectures used as a substitute for classroom teaching. These were not used at all in the traditional, pre-COVID course (2018–2019), nor were they part of the teaching for cells and tissue theory during the pandemic course (2019–2020). A key advantage of the pre-recorded lectures was that they were available over a long period of time for students to watch whenever they wished, and this flexibility may have helped many students with time management. The online self-assessment tests included after each pre-recorded lecture, set, as explained, to stand in for class attendance, encouraged students to maintain a consistent workload.
The conclusion that face-to-face versus online methodologies lead to different academic outcomes for students is further supported by the overall course pass rate as well as the numerical and qualitative scores obtained by our two student cohorts. Overall course pass rate, and the numerical and qualitative scores, suggest that students achieved better academic results for the lockdown-adapted course, and this improvement could be attributed to the introduction of new teaching resources, particularly VM, pre-recorded lectures, and the online self-assessment tests provided for each topic.
However, it is worth stressing that it is important to consider the weakness detected in the online methodology for student evaluation. These problems can, of course, be extended to the many other exams conducted online during the lockdown and include, on the one hand, the possibility that some students will have accessed material to help solve exam questions and may have communicated among themselves, and on the other hand, the difficulty of ensuring the true identity of the person carrying out a given examination. Our results suggest that, in the CH course, lecturers’ efforts to avoid the problems outlined were not sufficient and, as a result, there are remaining issues with evaluation that require attention. Indeed, the ongoing use of online methods to assess students in CH is contingent on the development of more robust forms of assessment and methods for the identification of students. Among the strategies that might be introduced, we would suggest a greater variety of test types and, for student identification, the use of facial recognition tools (e-proctoring). This latter method is still under debate due to the current data protection legislation (Ley Orgánica 3/2018; Reglamento (UE) 2018/1725 del Parlamento Europeo y del Consejo, de 23 de octubre de 2018) [
16].
We need to deepen our understanding of students’ perceptions of educational innovations such as those discussed in this work so that they can be improved using students’ suggestions and opinions [
17]. In this study, we used a questionnaire to survey students’ opinions of VM and results revealed our students had a good perception of VM, as did the students surveyed in several other studies [
4,
14]. As in other institutions, our decision to replace conventional optical microscopy with VM was made out of necessity due to the lockdown requirements during the COVID-19 pandemic [
8]. Students from both our cohorts (2018–2019 and 2019–2020) generally gave positive feedback about VM, with many expressing the view that VM was easy to use and a helpful tool in teaching practical skills for CH. Nevertheless, a high percentage of students in the 2019–2020 cohort believed that VM should not ever totally replace conventional microscopy. This is an interesting finding, as this group experienced both the use of VM as a complement to OM before the lockdown and moved to using only VM after the lockdown. The many advantages of using this emerging technology for educational purposes have been described in the previous literature [
15], and they include remote access, an improved educational experience, and the guarantee of equal and consistent slide quality for all students. A particular advantage of VM is that this technology allows for unrestricted access to the material—slides are available for examination anytime, and from anywhere—which gives students the ability to better organize their study time [
18]. It is also easy to maintain, provides students with clearer images, and, furthermore, enables collaborative learning (many students can view the same image at once), which may help students better retain theorical concepts of morphology and structure. In practice, however, students may feel uncomfortable if they are not given the opportunity to use conventional OM at some point in their course. In addition, at the beginning of their training, students will find some structures hard to identify [
19]; therefore, it is important that lecturers are on hand to use their histology expertise to assist students in the interpretation of virtual images. It should also be noted that adjustment to new technologies takes time, and individual users will have different rates of adaptation—some slower than others—to new methodologies. VM can also present some disadvantages since it requires significant initial financial investment by the institution.
Finally, the role of lecturers in the learning process must not be underestimated. Lecturers play a key role in stimulating students’ interest and creating an environment in which students’ desire to learn is driven by a wish to acquire the knowledge and skills necessary for their professional future rather than just to pass the exam. This motivation is more easily fostered in a presential teaching environment than in online modalities and this is a point that will be addressed by the lecturers’ working groups. Unfortunately, our study was not designed to investigate how students perceived the role of their lecturers during the lockdown; nevertheless, the available channels of communication were well-used: message logs show continuous communication throughout lockdown, with a peak during the exam period.