Next Article in Journal
Bronchoalveolar Lavage Cytology in Severe Equine Asthma: Cytocentrifugated versus Sediment Smear Preparations
Next Article in Special Issue
Using Machine Learning in Veterinary Medical Education: An Introduction for Veterinary Medicine Educators
Previous Article in Journal
Diagnostic Imaging of Diseases Affecting the Guttural Pouch
Previous Article in Special Issue
Are They Thinking Differently? The Perceptions and Differences in Medical Disputes between Veterinarians and Clients
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Evaluation of a High-Fidelity Simulation Model and Video Instruction Used to Teach Canine Dental Skills to Pre-Clinical Veterinary Students

1
Department of Clinical Sciences, Ross University School of Veterinary Medicine, Basseterre P.O. Box 334, Saint Kitts and Nevis
2
Centre for Applied One Health Research and Policy Advice, City University of Hong Kong, 31 To Yuen Street, Kowloon, Hong Kong SAR 999077, China
3
Pet Dental Center, 9250 Corkscrew, STE 18, Estero, FL 33928, USA
4
Texas Tech University School of Veterinary Medicine, 7671 Evans Dr., Amarillo, TX 79106, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Vet. Sci. 2023, 10(8), 526; https://doi.org/10.3390/vetsci10080526
Submission received: 23 July 2023 / Revised: 10 August 2023 / Accepted: 11 August 2023 / Published: 16 August 2023
(This article belongs to the Special Issue Veterinary Medical Education: Challenges and Perspectives)

Abstract

:

Simple Summary

Dental disease is the most diagnosed disease in small-animal general practice and has a significant impact on the health and welfare of patients. Despite the prevalence of dental disease, there is a recognized gap between the dental skill training veterinary students receive and the expectations of employers regarding the competencies of new graduates in this field. Furthermore, there is a lack of published research reporting on veterinary dental skill training. This study evaluates the models and videos used to teach canine dental core skills. Dental skill acquisition and confidence were found to be higher in students who were trained using models rather than videos. However, there was no significant difference in perceptions related to small-animal dentistry between students trained using the different modalities. The authors recommend using both models and videos to train veterinary students in order to optimize skill acquisition in this field. The conclusions drawn from this research can be used to improve student training so that new graduates may enter the profession better prepared to demonstrate these skills.

Abstract

In recent years, there has been an increased focus on the teaching of small-animal dentistry to veterinary students in order to address the recognized gap between dental skill training and the expectations of employers regarding the competencies of new graduates in this field. In this study, third-year veterinary students were trained in three canine dental core skills using either a high-fidelity model (Group A) or video instruction (Group B). An objective structured clinical examination was used to assess skill acquisition and questionnaires were distributed in order to assess student confidence and perceptions related to small-animal dentistry practice and related skills before and after the training. All results were compared between the two groups. Group A outperformed Group B in skill acquisition (p < 0.001) and there was greater improvement in skill confidence for Group A than Group B (p < 0.001). There was no statistical difference in perceptions related to small-animal dentistry between the two groups after the training (p ≥ 0.1). Group A rated their training experience more highly than Group B (p < 0.001). Although dental skill acquisition shows greater improvement when training is provided by models rather than video instruction, a blended approach to teaching dental skills is likely to be the best approach to optimizing dental skill acquisition.

1. Introduction

Periodontitis is the most frequently diagnosed disease in small-animal medicine [1], affecting over 87 percent of dogs over two years of age [2]. This is a disease that can cause bacteremia and which has been linked to several systemic diseases [3,4,5]. Pain associated with periodontitis and other dental diseases is well established in human patients and is one of the most common reasons patients seek dental treatment [6]. However, animals rarely display overt signs of oral pain associated with mild-to-moderate dental disease [7]. The lack of clinical signs in small-animal patients leads to dental disease progression and compromises health and welfare without the knowledge of even the most attentive of owners [7]. Therefore, the provision of dental services i.e., the prevention, diagnosis, and treatment of periodontitis and other dental diseases, is a paramount responsibility of the primary-care veterinary practitioner [8].
Unequivocally, small-animal dentistry knowledge and skills are highly sought by employers and are considered day-one competencies [8,9]. Small-animal practitioners have recognized the importance of new graduates having skills in dental prophylaxis, tooth extraction, and routine periodontal treatment [10]. New graduates are expected to perform these skills on an average of once per week with proficiency and minimal supervision [10]. However, the current curricula specific to veterinary dental education appear insufficient and limited. Specifically, a large survey of veterinary schools across the USA and the Caribbean found that, in pre-clinical years (years 1–3), small-animal veterinary dentistry was only taught as core course content in 30 percent of veterinary schools, and only as an elective in 23 percent of schools, while 17 percent of schools did not include it in the curriculum [8]. Furthermore, the same study reported that veterinary schools offered a mode of only one to four hours of lecture- and laboratory-based instruction, further illustrating the limited dentistry training opportunities provided to pre-clinical veterinary students [8]. The time students spend practicing dental skills in their clinical year (year 4) was unclear [8].
In recognizing the gap that exists between veterinary dental service demands and skills and in ensuring the adequacy of the small-animal dentistry skills of new graduates, there has been an increased focus in recent years on the teaching of small-animal dentistry to veterinary students. Outside of the lecture-based teaching of canine dentistry, the hands-on, deliberate practice of dental skills is fundamental to ensure graduates are practice-ready in this field [8,9]. In 2020, the teaching of dentistry was acknowledged as a requirement by the American Veterinary Medical Association (AVMA) [11]; this was further supported by the recommendations given by the World Small Animal Veterinary Association (WSAVA) [12].
To bridge the gap in dental skill instruction, models can be utilized to facilitate the acquisition of essential skills, such as those used to teach teeth cleaning skills, be they high-fidelity, mid-fidelity or low-fidelity [13]. Evidence supports the use of simulation as an essential part of modern medical curricula. Simulations are used to facilitate the acquisition of essential clinical skills and competencies through repetition and feedback within currently accepted learning theory frameworks. Mannequins have been used in human dental simulation training since the 1960s [14]. More recently, 3D-printed model teeth manufactured for use in simulation were found to be realistic and cost-effective [15]. A recent publication assessed student perceptions of four different modalities used to teach anatomy: natural teeth, 3D-printed teeth, a 3D virtual model and augmented reality (AR) [16]. The results showed that the natural teeth were of the highest educational value, the 3D-printed teeth were the easiest to use, and the AR model was the most interesting. However, the AR model scored the lowest rating for ease of use and educational value [16]. The paper concluded that there are limitations associated with AR, but that it is an area of significant ongoing development with potential for use in future dental training [16]. This example underscores that, in order to understand the benefits of models, validation of their use is essential, regardless of the level of fidelity, before their implementation in a curriculum.
As advances are made in simulation development, the impact on trainee skill acquisition, or competency, must also be studied in order to provide an understanding of training outcomes. The assessment of competency is essential from both an educational and a financial perspective when the costs associated with model development and the management of simulation laboratories are considered. The human dental field is far more advanced than the veterinary field, with the use of haptic and virtual reality (VR) simulations having transformed the modern dental world [17]. While recognizing that additional studies are needed to further evaluate the use of VR systems in dental skill acquisition, it is important to acknowledge that VR simulators can collect, summarize and analyze all of an operator’s work to provide an objective assessment with real-time feedback, and that this assessment can be considered to be more appropriate than human expert assessment [17]. However, faculty feedback provides insight into weaknesses in student technique and provides context to procedural errors; more studies are needed to further evaluate the use of VR systems used in dental skill acquisition [18,19].
In contrast to the human field, the use of only a small number of dental models has been validated in veterinary medical education. A rudimentary model has been found to be an effective way of teaching dental cleaning when compared to the use of video instruction [20]. This same study also reported that all participating students agreed that training on a model would be beneficial to their skill acquisition and that all those who learnt using the model acknowledged improvements in their confidence [20]. In 2021, a study compared the use of three modes in teaching and practicing dental cleaning [13]. This study found that low-fidelity models are as effective as mid-fidelity and high-fidelity models for teaching cleaning. However, students were more accepting of the higher-fidelity models in the study [13]. Although low-fidelity models performed well in terms of instruction, experts recommended the use of higher-fidelity models for skill assessment [13]. In 2022, a published study investigated the use of 3D models to teach scaling and dental charting and found that students gained more confidence if models were used in advance of a cadaver laboratory [21].
There is no uniformity in how useful alternate fidelity simulation modalities are in terms of ensuring skill acquisition. As with veterinary dental skills, the positive effectiveness of low-fidelity models has been reported for veterinary surgical skills [22,23] and in human dentistry [24]. The appropriate validation and assessment of the use of veterinary models is essential; this is especially true in the field of small-animal veterinary dentistry, given the minimal available literature on this subject.
The aim of this study was to evaluate the use of a high-fidelity model (HFM) and video instruction to teach three canine dental core skills to pre-clinical veterinary students: radiographic positioning; cleaning (scaling and polishing); and extractions. Students’ skill acquisition was assessed using an objective standardized clinical examination (OSCE) and students’ performance was compared between the two groups. Questionnaires were utilized to assess potential changes in the confidence of the students and their perceptions related to small-animal dentistry before and after receiving the training. The results were compared between the two groups. We adopted the hypothesis that students who practiced skills using different modalities, whether HFM or video instruction, would perform differently in the OSCE and have differing levels of confidence when applying skills. A secondary hypothesis was that exposing students to a novel modality, i.e., HFMs, would change their perception of and interest in small-animal dentistry.

2. Materials and Methods

This study was conducted at the Ross University School of Veterinary Medicine (RUSVM), an American Veterinary Medical Association (AVMA)-accredited international veterinary school that provides an intensive pre-clinical course of seven semesters over two years and four months. RUSVM students complete their one year (three semesters) of clinical training at an affiliated AVMA-accredited veterinary school.
At the time this study was conducted, small-animal dentistry instruction at RUSVM was delivered in (i) eight hours of didactic lectures in semester five, (ii) a one-hour self-directed online laboratory in semester six, and (iii) a three-hour elective canine live-animal laboratory in semester seven. The didactic lectures covered the pathology, diagnosis, treatment and prevention of common dental diseases and the core skills of radiology, cleaning, and extractions. The online laboratory focused on instrument identification and use, as well as the charting, and recognition and grading of pathology. The live-animal elective included dental radiography interpretation, probing, charting, and cleaning, with students performing supragingival and subgingival scaling and the polishing of all teeth in one quadrant of a dog’s mouth.
Students in semester seven (third year) were invited to participate in this study. Participants were excluded if they were certified veterinary technicians (CVTs) (or international equivalent qualification) or if they had already participated in the seventh-semester elective live-animal laboratory. The study was conducted between January 2020 and January 2021 with three cohorts of students, with each cohort drawn from a different seventh semester. Over the duration of the three cohorts, 105 students enrolled in this study. An administrative colleague independent of the study applied the RAND formula in Microsoft Excel™ to a list of participating students for each cohort to randomly assign them into one of two instructional groups: one group trained using HFMs in a laboratory setting (group A), n = 52, and one group trained via video instruction (group B), n = 53. All study participants completed a written consent form. This study was approved by RUSVM’s Institutional Review Board (IRB), protocol number: 19-03-XP.
The primary author developed a concise skill sheet, which was reviewed and approved by a Diplomate of the American Veterinary Dental College (AVDC) (fourth author). The skill sheet described (i) dental anatomy; (ii) equipment, instruments, and consumables; (iii) personal protective equipment (PPE); and (iv) the three skill sets: radiographic positioning, cleaning (scaling and polishing), and extractions. All participating students within each cohort received a copy of a skill sheet by email on the same day, providing them with a resource to complement their training. The skill sheet was used as the script in the video instruction and HFM laboratories and participants were encouraged to read it as many times as they preferred prior to watching the video or attending the HFM laboratory, as well as in advance of the OSCE. Additionally, the skill sheet was sent to the video instruction group in an email with a link to the video; these students were also informed that they could watch the video as many times as they felt appropriate. The HFM laboratories took place within one to four days of sending the skill sheet. All participants completed a dental skills OSCE two weeks after the HFM laboratories.
The 38 min video included a canine skull to present anatomy and a cadaverous head to demonstrate the skills, describing each element as they were presented or performed (Figure 1).
The HFMs used in this study were made of silicone, plastic, and rubber. They were manufactured by Veterinary Simulators Industries Limited (VSI) (Figure 2). The HFMs had lips that could be reflected, as well as a tongue, an epiglottis, an esophagus, and a trachea. The maxillae and mandibles could be replaced with simulated teeth, bone, and soft rubber gingiva. The HFMs were provided with an arm and clamp that could be employed to secure the model to a tabletop, but these were not used in this study.
At the time the study was conducted, three sets of jaws were available for use to teach different skillsets. (i) One set was used to teach scaling and polishing that included simulated calculus painted onto the teeth. Once dry, an ultrasonic scaler could be used to remove the simulated calculus as in a live patient. (ii) A second set with radiodense teeth was used to teach radiographic positioning (Figure 3). (iii) A third set was used to teach extractions, which included a simulated periodontal ligament. These techniques were used to perform gingival flap creation, alveolar bone removal, tooth elevation and tooth extraction (Figure 4). Components were colored in a realistic fashion to allow for the identification of different simulated tissues.
This study asked three veterinarians to provide face validation for the models prior to their use in laboratories. We asked two diplomates of AVDC (one of them being the fourth author) and an experienced primary care clinician with an interest in small-animal veterinary dentistry (fifth author) to participate. They identified that the teeth of the radiology models had poor contrast. In response, VSI improved the contrast of the models. A subsequent assessment by the same veterinarians identified that the improved models included a variety of teeth that were found not to be strictly anatomically correct, and that some tooth roots had hollow appearances. However, the models were deemed to be appropriate for use in teaching radiographic positioning. In conclusion, the models were deemed to be appropriate for use to practice cleaning, radiographic positioning, and extraction skills, and were considered especially useful for learning instrument-handling skills and gaining familiarity with oral anatomy.
One veterinarian (first author), one CVT (sixth author) and one certified veterinary technologist (seventh author) facilitated the training in the HFM laboratory and used the same script as that used in the video to present and guide the students through the skills. No additional information was provided to the students. All equipment, instruments and consumables used in the video were identical to those used in all laboratories and assessments. The HFM laboratories were delivered over three one-hour stations, one for each skill set: radiographic positioning; cleaning (scaling and polishing); and extraction. Small groups of students, n = 3–4, rotated through the stations. The HFM laboratories engaged students in performing the skills under supervision, receiving in-the-moment trainer feedback. The trainers in the HFM laboratories were the same individuals who developed the video and they were consistent in the delivery of content through all laboratories and cohorts.
Skill acquisition was assessed using a five-station, 13-item OSCE, and skills were assessed using a five-point Likert scale checklist: 1: below expectations, 2: novice, 3: advanced beginner, 4: competent, 5: proficient (Appendix A.1). The rubric was developed by the primary author and reviewed by the third author, who had significant experience in OSCE design, as well as by a diplomate of AVDC (fourth author). All stations were allocated 5 min to complete the tasks, with a 30 s inter-station change set aside.
Veterinarians and CVTs (or international equivalent) who were independent of the study rated student performance. Rater recruitment required individuals to have a minimum of five years of professional small-animal practice experience. Limited rater availability required the recruitment of raters of varied small-animal dental experience. Raters were provided with detailed guidance about their station and checklist prior to the start of the OSCE. Students were randomly scheduled for their OSCE times using Excel™ and raters were blinded to the training each student had received.
Participating students completed online pre-training and post-OSCE questionnaires to assess their dental skill confidence and their perceptions related to small-animal dentistry (Appendix A.2 and Appendix A.3). The questionnaires consisted of 10 questions and required input on the basis of five-point Likert-scale response categories (e.g., not at all confident, slightly confident, somewhat confident, moderately confident, extremely confident). The pre-training questionnaire was completed before any training took place and before the skill sheet was shared. Pre-training questionnaires also included two binary response exclusion questions regarding participant qualifications and participation in the semester seven live-animal laboratory, as discussed earlier. The post-OSCE questionnaire included a Likert-scale response question regarding students’ opinions of the training they had received and an open-ended question asking students to provide feedback on the experience of the training they had received. Questionnaire answers were anonymous and collected through the Qualtrics online survey tool to ensure data protection.
All descriptive statistics include median and interquartile ranges. The Wilcoxon rank-sum test was used to compare each OSCE item score and the overall OSCE score between the two groups. Cronbach’s α was calculated in order to determine OSCE reliability. The impact of individual stations and items on the reliability of the OSCE was evaluated by comparing Cronbach’s α with or without each station or item.
To test the initial randomization, responses of the pre-training questionnaire were compared between the two groups using a Wilcoxon rank-sum test. The responses of the pre-training questionnaire were compared with the post-OSCE questionnaire using the Wilcoxon signed-rank test (paired by student) in order to determine if student confidence and perceptions improved throughout the study in both groups. Furthermore, the difference (subtraction) in the scores between pre-training and post-OSCE questionnaires was compared. In particular, we used the Wilcoxon rank-sum test to assess the level of change in confidence and perceptions between the two groups. Differences were considered significant for p value ≤ 0.05.

3. Results

Out of a total of 105 students, 52 attended the HFM laboratory, 53 completed the video instruction, and all 105 completed the OSCE. Student participation took place in January 2020 (n = 18); October 2020 (n = 21); and January 2021 (n = 66). There was no statistical difference in the baseline confidence or perceptions between the two groups before any training had taken place, p ≥ 0.2, confirming the random selection of groups (Appendix A.4).
Overall, group A outperformed group B, p < 0.001 (Table 1). Group A significantly outperformed group B for 7 of the 13 OSCE items. Group B did not outperform group A for any OSCE item. Station 4 reported that group A outperformed group B by the greatest degree, and Station 4 was the only station for which all items in a station produced a statistically significant difference in performance between the groups.
The OSCE had an overall reliability of α = 0.66 (95% confidence interval: 0.64–0.69) (Appendix A.5). Reliability varied significantly between stations, α = 0.003–0.59, and between raters, α = < 0–0.85 (Appendix A.5). Some items have more impact on reliability than others, and the overall OSCE reliability would increase, α > 0.66, if these items were removed from the analysis. This is true for all items in Station 1 and Item 1 in Station 3 (Appendix A.6).
A total of 84 students completed the pre-training and post-OSCE questionnaires, with 40 drawn from group A and 44 from group B. Group A had significantly greater confidence post-OSCE than pre-training in all six related questions, p < 0.001 (Appendix A.4). Group B had significantly greater confidence post-OSCE than pre-training in five of the six related questions, p ≤0.01 (Appendix A.4). There was no statistically significant improvement for any of the perception-related questions for either group, p ≥ 0.1 (Appendix A.4).
Group A had significantly greater improvements in confidence than the group B after the training and OSCE, with p < 0.001 for all related questions (Appendix A.4). In the post-OSCE questionnaire, group A rated their training experience to be better than group B’s, p < 0.001 (Appendix A.4). A total of 63 participants provided comments on their training experience in the post-OSCE questionnaire, n = 38 from group A, and n = 25 from group B. The primary author has summarized and purposely selected some of these comments in Table 2 to provide an overview of the students’ experience.

4. Discussion

To the authors’ knowledge, this is the first published work that studies veterinary dental radiographic positioning and tooth extraction skill acquisition. In this study, the use of the HFMs to teach dental skills was shown to be of significant benefit when compared to video instruction, with the HFM group outperforming the video instruction group in the OSCE. Both video instruction and HFM laboratories improved skill confidence. However, there was a significantly greater increase for the HFM laboratory group, and the HFMs were rated as being better resources than the video. Neither training experience significantly affected perceptions.
The positive impact of video resources on enhancing teaching and skill acquisition in human medical and dental education, as well as veterinary education, is widely reported [25,26,27,28,29], with the results of this study further supporting this. Although the HFM group outperformed the video instruction group in the OSCE, there was no statistical difference in improvement between the two groups for 6 of the 14 items. In total, 3 of these items were related to radiology skills, 2 items were related to cleaning, and 1 item was related to extractions. There are several possible explanations for the similarity in the acquisition of these skills between the two groups. Firstly, the complexity of these skills may have been such that the hands-on practice with HFM instruction was insignificant in terms of improving skill acquisition when compared to video instruction. Specifically, these skills could be considered easy to learn and can be taught through observation using video instruction. Secondly, students may have drawn from skills learnt elsewhere in the curriculum such as radiology laboratories and lectures, therefore bringing bias to the analysis. Thirdly, the potential of the HFMs may not have been realized due to an absence of the opportunity for deliberate practice, acknowledging that the use of deliberate practice in simulation-based medical education increases the success of clinical skill acquisition [30,31,32]. It is reasonable to surmise that the performance of the skills in question could have been influenced by the ease of developing an understanding via video instruction and the absence of opportunity for deliberate practice with the HFMs. The authors hypothesize that both video instructions and HFMs are valuable resources to teach dental veterinary skills and the level of difficulty can guide the approach. Varied teaching strategies can be employed to improve learning experiences, which is of particular interest to disciplines that may struggle to garner interest from students. A recent study investigated the use of a flipped classroom and peer-assisted learning to teach equine nutrition, a subject which most post-graduation veterinarians lack knowledge of and skills in [33]. Despite half of the students questioned in the study reporting to be uninterested in the subject matter, most expressed positive attitudes towards the teaching methods used [33]. Providing diverse learning opportunities has the potential to engage students with unpopular disciplines, which could raise the profile of under-resourced areas of study and ultimately improve animal welfare.
The results of the post-OSCE questionnaire report that there was no significant overall increase in practical experience for the video instruction group; this is to be expected, as these students were not provided with any practical experience. However, the video did significantly improve confidence for all specific skill sets, and the OSCE results supported the notion that the video had a positive impact on skill acquisition. Although the HFM lab experience was rated higher than the video instruction in terms of improving skill acquisition, the video was also favorably rated. This result aligns with other research reports that find the use of video resources to be beneficial in terms of improving preparedness for assessments and reducing stress [34]. Students were less accepting of the notion that video instruction increased confidence in comparison with their relationship to HFM. This was potentially due to: (i) Students not spending sufficient time watching the video or doing so with due attention. Indeed, students reported varied, consumption of videos with peak viewing one or two days before assessment [34]. (ii) The length of the video being 38 min, considering that videos longer than 6 min have been found to have poor student engagement [35]. (iii) An absence of feedback and expert supervision, which are important in skill acquisition [22,36].
In the future, the authors recommend a blended approach to veterinary dental skill training, whereby videos lasting a maximum of 6 min are used in conjunction with the HFMs. Blended learning has well-documented benefits in terms of clinical skills development in the human and veterinary fields [37,38]. The use of technology provides students with the flexibility, convenience, and independence required for an individualized approach to learning [37,38]. The videos can be shared in advance of labs, used in lectures, and used as a resource for study outside of the classroom and laboratory. Veterinary students have been found to use online resources to prepare for practical classes [39]; further work on how veterinary students use videos to supplement their dental skill training would be beneficial to efforts to guide their use.
The HFM group in this study reported a greater improvement in confidence post-OSCE than the video instruction group. Indeed, an increase in confidence with skills learned using HFMs over lower-fidelity models is well reported in medical education [39,40,41]. Feedback and individualized learning with the active participation of the trainee are also very important to the success of simulation skill labs and are accepted in improving outcomes [39,40]. When considering the outcomes of this study, it is reasonable to conclude that the greater increase in confidence for the HFM group can be attributed to both the fidelity of the models and the training group size, N = 3–4, which allows for students to receive real-time individualized feedback from both instructors and peers.
Neither training experience significantly affected perceptions. Students’ backgrounds and interests in career choice have been reported positive influences on the outcome of associated clinical skill acquisition [42]. If an interest in a chosen career path is associated with success in clinical skill acquisition, it could also reinforce perceptions of skills, hence the lack of significant change from pre-training to post-OSCE.
This study does not consider other knowledge and skills students may be gaining when using the HFMs such as anatomy, patient handling, and personal posture, and practicing skills with water and a tongue in the simulated patient’s mouth. Simulation enhances psychomotor skills and hand–eye coordination, which are especially important for surgery [43]. Some of these experiences are difficult to achieve with lower-fidelity models, which is another area worthy of future consideration and study. The classification of simulation model fidelity is subjective and encompasses an array of features [39,44]; when compared with other veterinary models documented in the published literature, the authors consider their classification as high to be reasonable and in agreement with another published study [13]. However, if they are compared with models used in the human field, this would not be the case [18]. The lack of a standardized method of classification of simulated models creates challenges when comparisons and validation are sought [39]. Further consideration should be given to standardizing the classification of model fidelity between and within professions.
The overall reliability of the OSCE would be considered low, indicating differences in rating between raters. Raters A and E were CVTs with considerable experience of small-animal dentistry practice, and rater B was a CVT with little experience of small-animal dentistry. No CVT raters had experience of OSCE rating. Raters C, F, G and H were veterinarians with considerable experience of small-animal dentistry practice and rater D was a veterinarian with no experience of small-animal dentistry practice. All veterinarian raters had experience of OSCE rating. Reliability as raters varied considerably between raters and stations. However, it is notable that the raters with α < 0 were the CVT and the veterinarian with no significant small-animal dentistry practice experience. The results suggest that CVTs and veterinarians can assess pre-clinical veterinary students’ dentistry skills with a similar degree of reliability, and similarly, that both CVTs and veterinarians should be recruited as raters based on sound clinical dentistry experience and be provided with robust training in advance of performing an OSCE. Furthermore, acknowledging that rubric wording is important and is reported to impact assessors and pass/fail decisions [45], validity could be improved by increasing expert input to OSCE station and rubric design, robust rater training, and running pilots of the OSCE and rubric. There is additionally value in analyzing the results of specialists, experienced practitioners and new graduates whose skills have been assessed using the OSCE and rubric and comparing them with student results [46,47]. With investment in OSCE and rubric design and by analyzing the assessment results of different groups, over time the items could be refined and the reliability of these assessments improved.
There are significant costs associated with the use of HFMs. Radiology jaw sets can be used with minimal wear over time but do eventually need replacement. The teeth of the models used for cleaning wear down after several uses and the cleaning procedures also cause wear to the model heads. Therefore, these models have a higher rate of turnover than radiology sets. The teeth of the extraction jaw sets cannot be replaced, each tooth is single-use, and extraction procedures cause wear to the model heads, meaning that judicious use of these models is warranted. In the HFM laboratories used for this study, each student extracted one incisor and one two-rooted tooth. The availability and storage of cadavers and other means of teaching, as well as budgets, will influence investment in the HFMs. Simulation models can only be as good as the educational environment in which they are used [44]. Therefore, these HFMs should be implemented into a curriculum with careful planning, and further assessment of their use is warranted. The models can also be used to teach nerve blocks and endotracheal intubation. Future positive validation of their use to teach these skills may influence laboratory investment.

5. Study Limitations

This study presents several limitations. Raters were assigned based on their availability. As such, there were limitations in maintaining rater–station continuity. Indeed, examiner cohorts are reported to have a significant and replicable influence on OSCE scores [48]. There are numerous possible factors that could be influencing the differences in rater assessment: rater experience of practicing small-animal dentistry, rater experience of assessing small-animal dentistry and rater experience of assessing the use of an OSCE. Additionally, numerous types of rater errors are recognized in medical assessments. Some of these errors are the most significant threats to assessment validity [49,50]. In the human dental field, rater training has been found to improve the inter-rater reliability of performance assessment, with rater training workshops and encouraging rater involvement with OSCE development used to facilitate these improvements [46,51]. Similarly, rater training has been recommended as a means to improve assessment validity in veterinary education [50]. Rater training could have been used in this study to improve reliability. However, rater impact is unlikely to have altered the results as they were blinded to the experimental group (HFM or video instruction) and participant order in the OSCE was randomly assigned.
Students in the video instruction group could not have been expected to safely use a high-speed handpiece in the OSCE as they had not received in-person training to ensure that each student fully understood the necessary health and safety requirements of this handpiece, thus limiting the assessment of associated extraction skills. Further assessment of the acquisition of extraction skills is necessary.

6. Conclusions

Students greatly appreciated the opportunity to learn on HFMs and core dental skill acquisition showed greater improvement when training was provided with HFMs than video instruction. The use of HFMs to teach dentistry skills did not change students’ preference for small-animal dentistry over video instruction. The authors recommend the use of small-group simulation laboratory learning in rotation to facilitate the acquisition of multiple skills, this can be carried out for large cohorts if planned well. The primary author also recommends using appropriately trained and experienced CVTs as instructors in some clinical skills. CVTs and veterinarians can assess pre-clinical veterinary students’ dentistry skills with a similar degree of reliability. CVTs and veterinarians should be recruited based on sound clinical dentistry experience. Further work to assess the use of HFMs in a blended learning course, in comparison to cadavers and lower-fidelity models, and the transferability of acquired skills to the live patient should be conducted. In the future, a dental skills course that includes the use of videos lasting no longer than 6 min, and models of varied fidelity, may achieve similar outcomes to a course using HFMs alone and be preferable from a budgetary standpoint.

Author Contributions

Conceptualization, J.F. and E.A.; methodology, J.F. and E.A.; validation, K.Y.-S.J., W.G. and N.A.; formal analysis, A.C.; investigation, J.F., D.S. and C.W.; resources, J.F., D.S. and C.W.; data curation, J.F., writing—original draft preparation, J.F.; writing—review and editing, A.C., K.Y.-S.J. and E.A.; visualization, J.F. and A.C.; supervision, E.A.; project administration, J.F.; funding acquisition, J.F. All authors have read and agreed to the published version of the manuscript.

Funding

Funding for this study was provided by an intramural grant from Ross University School of Veterinary Medicine, Center for Research and Innovation in Veterinary Medical Education, grant number 44001-2019.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of Ross University School of Veterinary Medicine (protocol code 19-03-XP, 26 July 2019).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data is contained within this article or Appendix A.

Acknowledgments

We thank Kevin Stepaniuk for his role in face validation of the HFMs; Juliette Bouillon, Renata de Rosayro, Louise Dowd, Stephanie Jackson, Kurt Roman, Olivia Shelley, Nigel Smith, Jemma Thorogood, and Matthew Valentine for their role as raters in the OSCEs; Alexandra Fontanetta, Damiana Gumiran, and Kaylin Stewart for assistance in OSCE management; Antoine Laws for his assistance in data collection; and Cleon Bradshaw and Kazzi Heath for their assistance in creating the video.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Appendix A.1. OSCE Rubric

Station One
Item 1: Put on the necessary personal protective equipment to obtain dental radiographs.
  • Does not choose a lead gown or a thyroid protector.
  • Chooses lead gown and thyroid protector but puts them on incorrectly with/without disposable gloves.
  • Chooses lead gown and thyroid protector and puts them on correctly. Does not choose disposable gloves.
  • Chooses lead gown, thyroid protector, and disposable gloves. Hesitates to put them on correctly.
  • Chooses a lead gown, thyroid protector and disposable gloves and puts them on correctly and confidently.
Item 2: Prepare the digital radiography sensor to obtain dental radiographs.
  • Does not choose the plastic sheath and/or the cohesive wrapping bandage tape and/or does not identify the sensor.
  • Correctly chooses plastic sheath and cohesive bandage but applies them in the wrong order.
  • Applies the plastic sheath and cohesive bandage in the correct order but poorly so that the sensor is insecurely or incompletely covered.
  • Correctly chooses a disposable plastic sheath and cohesive wrapping bandage tape. Applies them correctly but hesitantly.
  • Correctly chooses disposable plastic sheath and cohesive wrapping bandage tape. Confidently applies them to the radiography sensor with the wrap over the sheath so that the sensor is completely and securely covered.
Item 3: Place the canine head on the table and in the correct position to obtain a dental radiograph of the mandible. Indicate verbally to the examiner once you have completed this task.
  • The head is not placed in dorsal recumbency.
  • The head is placed in dorsal recumbency. The mandible is not parallel with the table because towels, or any other form of support, are not used.
  • The head is placed in dorsal recumbency. Towels, or other forms of support, are used to position the head, but the mandible is not parallel with the table.
  • The head is placed in dorsal recumbency. Towels or other forms of support are used to position the head. The mandible is parallel with the table. This is performed hesitantly.
  • The head is placed in dorsal recumbency. Towels or other forms of support are used to position the head. The mandible is parallel with the table. This is performed confidently.
Station Two
Item 1: Position the radiography sensor and the tube head of the radiograph generator to obtain a radiograph of the mandibular incisors at 45°. Indicate verbally to the examiner once you have completed the task.
  • The sensor is not placed against the crowns of the incisors and/or the X-ray tube is remote from the mandibular incisors.
  • The sensor is not in the correct orientation but is placed against the crowns of the incisors AND the tube is not placed at 45° but is directed at the mandibular incisors.
  • The sensor is not in the correct orientation but is placed against the crowns of the incisors OR the tube is not placed at 45° but is directed at the mandibular incisors.
  • The sensor is correctly placed and in the correct orientation but the student struggles to support it well and/or the X-ray tube is directed at the mandibular incisors at 45° but is touching the head.
  • The sensor is placed in the mouth, resting against the crowns of the mandibular incisors and lingual mucosa, in the correct orientation. The sensor is supported appropriately with gauze/bandage material/props. The X-ray tube is directed at the mandibular incisors, positioned at 45° and close to the mandible but not touching it.
Item 2: Position the radiography sensor and the tube head of the radiograph generator to obtain a radiograph of the mandibular premolar tooth 4 and molar tooth 1 in quadrant 3. Indicate verbally to the examiner once you have completed the task.
  • The sensor is not placed against the crowns of the correct teeth and/or the X-ray tube is remote from the correct teeth.
  • The sensor is not in the correct orientation but is placed against the crowns of the correct teeth AND the tube is not in parallel with the sensor but is directed at the correct teeth.
  • The sensor is not in the correct orientation but is placed against the crowns of the correct teeth OR the tube is not in parallel with the sensor but is directed at the correct teeth.
  • The sensor is correctly placed and in the correct orientation but the student struggles to support it well and/or the X-ray tube is directed in parallel to the sensor, but it is touching the head.
  • The sensor is placed in the mouth, resting against the crowns of the teeth and lingual mucosa in the correct orientation. The sensor is supported appropriately with gauze/bandage material/props. The X-ray tube is directed in parallel to the sensor; close to the mandible, but not touching it.
Station Three
Item 1: Put on the necessary personal protective equipment to perform a canine cleaning and polishing procedure.
  • Only chooses goggles OR only chooses a mask without visor OR only chooses gloves.
  • Chooses disposable gloves and a mask without visor or goggles.
  • Does not choose disposable gloves but does choose a mask with visor or a mask with goggles.
  • Chooses disposable gloves and a mask with visor or mask with goggles. Struggles to put them on correctly.
  • Chooses disposable gloves and a mask with visor or mask with goggles and puts them on correctly and confidently.
Item 2: Switch on the ultrasonic scaler machine and verify that it is working correctly.
  • Does not identify the correct machine and/or does not identify the correct handpiece.
  • Is unable to switch the machine on.
  • Does not apply the tip to a metal surface.
  • Does not identify the correct machine and/or the handpiece initially.
  • Confidently identifies the ultrasonic scaler machine and switches it on. Holds the handpiece in the dominant hand, pushes the metal ring on the handpiece to verify that water is flowing from the scaler tip and applies the tip to a metal surface to verify it’s working correctly.
Item 3: Switch on the air-driven dental unit and verify the three-in-one syringe handpiece is working correctly.
  • Does not identify the correct machine and/or does not identify the correct handpiece.
  • Is unable to switch the machine on.
  • Does not demonstrate water and air flow separately and together.
  • Does not identify the correct machine and/or handpiece initially.
  • Confidently identifies the air-driven dental unit and switches it on. Holds the three-in-one syringe in the dominant hand using a palm grip and verifies that it is operating correctly by pressing each of the two buttons separately and together to demonstrate water and air can be delivered at the appropriate pressure, whether separately or together.
Station Four
Item 1: All teeth in the cadaver head have had all tartar removed. Demonstrate a scaling procedure on the left mandibular canine tooth.
  • Fails to engage the metal ring and/or fails to identify the correct machine or handpiece.
  • Regardless of how the handpiece is held and what areas are de-scaled, the student uses the scaler for longer than 10 s on the tooth and/or does not move the scaler constantly.
  • Regardless of how the handpiece is held, the student does not de-scale all these areas: the buccal, mesial, distal aspects and subgingival area.
  • Does not use a modified pen grasp and/or uses excessive force and/or is not confident with the action.
  • Confidently holds the handpiece with a modified pen grasp. Uses a constant sweeping motion with a light touch to scale the tooth. Scales the buccal, mesial, and distal aspects of the tooth (lingual not essential) and the subgingival area. Does not keep the scaler in contact with the tooth for longer than 10 s.
Item 2: Assemble the polisher handpiece so that it is ready to use and then polish the left mandibular canine tooth.
  • Fails to identify the correct handpiece or fails to use the foot pedal.
  • Fails to attach a polishing head to the body of the handpiece and/or does not keep the cup in constant motion and/or does not polish the correct tooth.
  • Does not polish all these areas: buccal, mesial, distal aspects and subgingival area.
  • Does not use a modified pen grasp and/or uses excessive force and/or is not confident with the action. Does not identify the correct handpiece to start with and/or does not assemble the handpiece confidently.
  • Confidently identifies and assembles the polisher handpiece by attaching the polishing head. Applies paste to the head. Holds the handpiece with a modified pen grasp. Uses a light touch and keeps the cup in constant motion. Polishes the buccal, mesial, and distal aspects of the tooth (lingual not essential) and the subgingival area.
Station Five.
Item 1: Select the necessary instruments to perform an incisor extraction. Place on Card A.
  • Does not select an elevator AND does not select a scalpel blade.
  • Does not select an elevator OR does not select a scalpel blade.
  • Chooses an elevator over 3 mm and/or chooses a scalpel blade that is not a 15.
  • Does not choose a scalpel handle and/or chooses a 1 mm or 3 mm elevator.
  • Selects all the following: 15-scalpel blade, scalpel handle, 2 mm elevator.
Item 2: Select any elevator and use it to demonstrate how to hold this instrument correctly when in use.
  • Does not select an elevator.
  • Does not use a palm grasp.
  • The elevator is held in a palm grasp. The index finger is on the stem of the elevator but not close to the tip.
  • The elevator is held in a palm grasp. The index finger is on the stem of the elevator and close, but not at, the tip.
  • The elevator is held in a palm grasp. The index finger is on the stem of the elevator and close, but not at, the tip.
Item 3: Select the necessary instruments to perform a gingival flap, instruments for suturing are not necessary. Place on Card B.
  • Does not select a periosteal elevator AND does not select a scalpel blade.
  • Does not select a periosteal elevator OR does not select a scalpel blade.
  • Regardless of whether a scalpel handle is selected. Selects a periosteal elevator and a scalpel blade that is not a 15.
  • Does not select a scalpel handle.
  • Selects all the following: 15-scalpel blade, scalpel handle, periosteal elevator.
Item 4: Assemble the high-speed handpiece so that it is ready to remove alveolar bone from around a tooth root.
  • Does not select a bur AND does not select the correct handpiece.
  • Does not select a bur OR does not select the correct handpiece.
  • Is unable to insert any bur to the handpiece.
  • Does not select the correct bur but inserts a bur correctly and/or does not verify that the bur is secure.
  • Selects the high-speed handpiece and a #2 or #4 round bur and inserts the bur to the turbine correctly. Verifies that the bur is secure.

Appendix A.2. Pre-Training Questionnaire

Canine Dental Skills: Questionnaire A
This questionnaire includes 2 demographics questions, followed by 11 self-evaluation questions on dental clinical skills competencies. Questionnaire must be completed before any learning has started and before the distribution of any supporting documents.
  • Demographic questions:
  • Are you a certified/licensed/registered veterinary technician/technologist/nurse?
    • Yes
    • No
  • Have you completed the elective live animal dental lab in Ross University Veterinary Clinic (RUVC)?
    • Yes
    • No
If you have answered ‘Yes’ to either question 1 or 2 do not continue, you are excluded from this study.
  • Dental Skills Assessment:
  • How do you rate your level of practical experience of canine dentistry skills?
    • 1 = not at all experienced; 2 = slightly experienced; 3 = somewhat experienced; 4 = moderately experienced, 5 = extremely experienced.
  • How do you rate your confidence with regards to canine teeth polishing skills?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine teeth de-scaling skills?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine dental radiographic positioning skills?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine single-rooted tooth extractions?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine two-rooted tooth extractions?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your level of interest in canine dentistry skills?
    • 1 = not at all interested; 2 = slightly interested; 3 = neutral; 4 = interested; 5 = very interested.
  • How important do you think canine dentistry skills are to your pre-clinical learning?
    • 1 = not at all important; 2 = slightly important; 3 = neutral; 4 = important; 5 = very important.
  • How important do you think canine dentistry skills are to a new graduate?
    • 1 = not at all important; 2 = slightly important; 3 = neutral; 4 = important; 5 = very important.
  • How likely are you to pursue a career in veterinary dentistry?
    • 1 = extremely unlikely; 2 = unlikely; 3 = neutral; 4 = likely; 5 = extremely likely.
  • How likely are to pursue a career in small-animal practice?
    • 1 = extremely unlikely; 2 = unlikely; 3 = neutral; 4 = likely; 5 = extremely likely.

Appendix A.3. Post-OSCE Questionnaire

Canine Dental Skills: Questionnaire B
This questionnaire includes 14 self-evaluation questions on dental clinical skills competencies and your experience of the skills lab. This questionnaire must be completed once all training has been completed.
  • How do you rate your level of practical experience of canine dentistry skills?
    • 1 = not at all experienced; 2 = slightly experienced; 3 = somewhat experienced; 4 = moderately experienced; 5 = extremely experienced.
  • How do you rate your confidence with regards to canine teeth de-scaling skills?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine teeth polishing skills?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine dental radiographic positioning skills?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine single-rooted tooth extractions?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your confidence with regards to canine two-rooted tooth extractions?
    • 1 = not at all confident; 2 = slightly confident; 3 = somewhat confident; 4 = moderately confident; 5 = extremely confident.
  • How do you rate your level of interest in canine dentistry skills?
    • 1 = not at all interested; 2 = slightly interested; 3 = neutral; 4 = interested; 5 = very interested.
  • How important do you think canine dentistry skills are to your pre-clinical learning?
    • 1 = not at all important; 2 = slightly important; 3 = neutral; 4 = important; 5 = very important.
  • How important do you think canine dentistry skills are to a new graduate?
    • 1 = not at all important; 2 = slightly important; 3 = neutral; 4 = important; 5 = very important.
  • How useful do you think the lab was in improving the acquisition of canine dentistry
    • 1 = not at all useful; 2 = slightly useful; 3 = neutral; 4 = useful; 5 = very useful.
  • How likely are you to pursue a career in veterinary dentistry?
    • 1 = extremely unlikely; 2= unlikely; 3 = neutral; 4 = likely; 5 = extremely likely.
  • How likely are to pursue a career in small-animal practice?
    • 1 = extremely unlikely; 2= unlikely; 3 = neutral; 4 = likely; 5 = extremely likely.
  • Which dental laboratory did you participate in?
    • Videos.
    • High-fidelity models.
  • Please provide further details regarding your experience of the lab:

Appendix A.4. Questionnaire Statistical Analysis

Group A (HFM)Group B (Video Instruction)p Value Baseline between Groups 2p Value Evolution between Groups 2
BeforeAfterp Value 1BeforeAfterp Value 1
How do you rate your level of practical experience of canine dentistry skills?1
(1–2)
3
(2–4)
<0.001 *1
(1–2)
1.5
(1–2)
0.40.8<0.001 *
How do you rate your confidence with regards to canine teeth de-scaling skills?1
(1–1)
4
(3–4)
<0.001 *1
(1–2)
2
(1–3)
0.008 *0.4<0.001 *
How do you rate your confidence with regards to canine teeth polishing skills?1
(1–1)
4
(4–4.25)
<0.001 *1
(1–2)
2
(1.75–3)
<0.001 *0.4<0.001 *
How do you rate your confidence with regards
to canine dental radiographic positioning skills?
1
(1–2)
3
(2–3)
<0.001 *1
(1–2)
2
(1–2.25)
0.01 *0.7<0.001 *
How do you rate your confidence with regards to canine single-rooted tooth extractions?1
(1–1)
3
(2.75–4)
<0.001 *1
(1–1)
2
(1–2)
<0.001 *0.4<0.001 *
How do you rate your confidence with regards to canine two-rooted tooth extractions?1
(1–1)
3
(2–3)
<0.001 *1
(1–1)
1
(1–2)
0.01 *0.2<0.001 *
How do you rate your level of interest in canine dentistry skills?4
(4–4.25)
4
(3–5)
0.54
(3–5)
4
(3–4)
0.70.70.7
How important do you think canine dentistry skills are to your pre-clinical learning?5
(5–5)
5
(5–5)
0.25
(4.75–5)
5
(5–5)
0.60.80.7
How important do you think canine dentistry skills are to a new graduate?5
(5–5)
5
(5–5)
0.15
(5–5)
5
(5–5)
0.60.70.2
How likely are you to pursue a career in veterinary dentistry?3
(2–3)
3
(2.75–3)
0.43
(2–3)
3
(2–3)
0.90.70.7
How likely are to pursue a career in small-animal practice?5
(4–5)
5
(4–5)
0.85
(4–5)
5
(5–5)
10.60.4
How useful do you think the lab was in improving the acquisition of canine dentistry skills?5
(5–5)
3.5
(2–5)
-<0.001 *
1 Wilcoxon Signed-Rank Test (paired). 2 Wilcoxon Rank-Sum Test. * Statistically significant p values. N = 84.

Appendix A.5. Cronbach α by Station, Cohort and Rater

Cohort 1Cohort 2Cohort 3All Cohorts
Station 1 (3 Items)0.52 (Rater A)<0 (Rater B)0.03 (Mixed Raters)0.003
Station 2 (2 Items)0.51 (Rater C)0.51
Station 3 (3 Items)<0 (Rater D)0.24 (Mixed Raters)0.19
Station 4 (2 Items)0.63 (Rater E)0.85 (Rater F)0.47 (Mixed Raters)0.59
Station 5 (4 Items)0.59 (Rater G)0.55 (Rater H)0.56
All stations0.740.640.640.66
Cohort 1: January 2020, n = 18; Cohort 2: October 2020, n = 21; Cohort 3: January 2021, n = 66.

Appendix A.6. Sensitivity Analysis: Cronbach α Calculated without each Station or Item

Cronbach α
Station 10.69
Put on the necessary personal protective equipment to obtain dental radiographs.0.67
Prepare the digital radiography sensor to obtain dental radiographs.0.67
Place the canine head on the table and in the correct position to obtain a dental radiograph of the mandible. Indicate verbally to the examiner once you have completed this task.0.67
Station 20.62
Position the radiography sensor and the tube head of the radiograph generator to obtain a radiograph of the mandibular incisors at 45°. Indicate verbally to the examiner once you have completed the task.0.65
Position the radiography sensor and the tube head of the radiograph generator to obtain a radiograph of the mandibular premolar tooth 4 and molar tooth 1 in quadrant 3. Indicate verbally to the examiner once you have completed the task.0.62
Station 30.64
Put on the necessary personal protective equipment to perform a canine cleaning and polishing procedure.0.67
Switch on the ultrasonic scaler machine and verify that it is working correctly.0.62
Switch on the air-driven dental unit and verify the three-in-one syringe handpiece is working correctly.0.66
Station 40.58
All teeth in the cadaver head have had all tartar removed. Demonstrate a scaling procedure on the left mandibular canine tooth.0.63
Assemble the polisher handpiece so that it is ready to use and then polish the left mandibular canine tooth.0.62
Station 50.53
Select the necessary items to perform an incisor extraction. Place on Card A.0.66
Select any elevator and use it to demonstrate how to hold this tool correctly when in use.0.63
Select the necessary instruments to perform a gingival flap, instruments for suturing are not necessary. Place on Card B.0.65
Assemble the high-speed handpiece so that it is ready to remove alveolar bone from around a tooth root.0.61

References

  1. Niemiec, B.A. Periodontal disease. Top. Companion Anim. Med. 2008, 23, 72–80. [Google Scholar] [CrossRef]
  2. Wiggs, R.; Lobprise, H. Periodontology. In Veterinary Dentistry, Principles and Practice, 1st ed.; Wiggs, R., Lobprise, H., Eds.; Lippincott Raven: Philadelphia, PA, USA, 1997; pp. 186–231. [Google Scholar]
  3. Pereira dos Santos, J.D.; Cunha, E.; Nunes, T.; Tavares, L.; Oliveira, M. Relation between periodontal disease and systemic diseases in dogs. Res. Vet. Sci. 2019, 125, 136–140. [Google Scholar] [CrossRef] [PubMed]
  4. Glickman, L.T.; Glickman, N.W.; Moore, G.E.; Lund, E.M.; Lantz, G.C.; Pressler, B.M. Association between chronic azotemic kidney disease and the severity of periodontal disease in dogs. Prev. Vet. Med. 2011, 99, 193–200. [Google Scholar] [CrossRef]
  5. Glickman, L.T.; Glickman, N.W.; Moore, G.E.; Goldstein, G.S.; Lewis, H.B. Evaluation of the risk of endocarditis and other cardiovascular events on the basis of the severity of periodontal disease in dogs. J. Am. Vet. Med. Assoc. 2009, 234, 486–494. [Google Scholar] [CrossRef] [PubMed]
  6. Hargreaves, K.; Abbott, P.V. Drugs for pain management in dentistry. Aust. Dent. J. 2005, 50 (Suppl. S2), S14–S22. [Google Scholar] [CrossRef] [PubMed]
  7. Holmstrom, S.; Frost, P.; Eisner, E. Veterinary Dental Techniques for the Small Animal Practitioner, 2nd ed.; W. B. Saunders: Philadelphia, PA, USA, 1998; pp. 255–318. [Google Scholar]
  8. Anderson, J.G.; Goldstein, G.; Boudreaux, K.; Ilkiw, J.E. The State of Veterinary Dental Education in North America, Canada, and the Caribbean: A Descriptive Study. J. Vet. Med. Educ. 2017, 44, 358–363. [Google Scholar] [CrossRef] [PubMed]
  9. Clark, W.T.; Kane, L.; Arnold, P.K.; Robertson, I.D. Clinical skills and knowledge used by veterinary graduates during their first year in small animal practice. Aust. Vet. J. 2002, 80, 37–40. [Google Scholar] [CrossRef]
  10. Greenfield, C.L.; Johnson, A.L.; Schaeffer, D.J. Frequency of use of various procedures, skills, and areas of knowledge among veterinarians in private small animal exclusive or predominant practice and proficiency expected of new veterinary school graduates. J. Am. Vet. Med. Assoc. 2004, 224, 1780–1787. [Google Scholar] [CrossRef]
  11. Dentistry Now Required Part of Veterinary Curriculum. Available online: https://www.avma.org/javma-news/2020-11-01/dentistry-now-required-part-veterinary-curriculum (accessed on 24 June 2023).
  12. Niemiec, B.; Gawor, J.; Nemec, A.; Clarke, D.; McLeod, K.; Tutt, C.; Gioso, M.; Steagall, P.V.; Chandler, M.; Morgenegg, G.; et al. World Small Animal Veterinary Association Global Dental Guidelines. J. Small Anim. Pract. 2020, 61, 395–403. [Google Scholar] [CrossRef]
  13. Hunt, J.A.; Schmidt, P.; Perkins, J.; Newton, G.; Anderson, S.L. Comparison of Three Canine Models for Teaching Veterinary Dental Cleaning. J. Vet. Med. Educ. 2021, 48, 573–583. [Google Scholar] [CrossRef]
  14. Perry, S.; Bridges, S.M.; Burrow, M.F. A review of the use of simulation in dental education. Simul. Healthc. 2015, 10, 31–37. [Google Scholar] [CrossRef] [PubMed]
  15. Richter, M.; Peter, T.; Ruttermann, S.; Sader, R.; Seifert, L.B. 3D printed versus commercial models in undergraduate conservative dentistry training. Eur. J. Dent. Educ. 2022, 26, 643–651. [Google Scholar] [CrossRef]
  16. Mahrous, A.; Elgreatly, A.; Qian, F.; Schneider, G.B. A comparison of pre-clinical instructional technologies: Natural teeth, 3D models, 3D printing, and augmented reality. J. Dent. Educ. 2021, 85, 1795–1801. [Google Scholar] [CrossRef] [PubMed]
  17. Imran, E.; Adanir, N.; Khurshid, Z. Significance of Haptic and Virtual Reality Simulation (VRS) in the Dental Education: A Review of Literature. Appl. Sci. 2021, 11, 10196. [Google Scholar] [CrossRef]
  18. Li, Y.; Ye, H.; Ye, F.; Liu, Y.; Lv, L.; Zhang, P.; Zhang, X.; Zhou, Y. The Current Situation and Future Prospects of Simulators in Dental Education. J. Med. Internet Res. 2021, 23, e23635. [Google Scholar] [CrossRef]
  19. Plessas, A. Computerized Virtual Reality Simulation in Preclinical Dentistry: Can a Computerized Simulator Replace the Conventional Phantom Heads and Human Instruction? Simul. Healthc. 2017, 12, 332–338. [Google Scholar] [CrossRef]
  20. Lumbis, R.H.; Gregory, S.P.; Baillie, S. Evaluation of a dental model for training veterinary students. J. Vet. Med. Educ. 2012, 39, 128–135. [Google Scholar] [CrossRef]
  21. Goldschmidt, S.L.; Root Kustritz, M.V. Pilot Study Evaluating the Use of Typodonts (Dental Models) for Teaching Veterinary Dentistry as Part of the Core Veterinary Curriculum. J. Vet. Med. Educ. 2022, 49, 340–345. [Google Scholar] [CrossRef]
  22. Hunt, J.A.; Simons, M.C.; Anderson, S.L. If you build it, they will learn: A review of models in veterinary surgical education. Vet. Surg. 2022, 51, 52–61. [Google Scholar] [CrossRef]
  23. Read, E.K.; Vallevand, A.; Farrell, R.M. Evaluation of Veterinary Student Surgical Skills Preparation for Ovariohysterectomy Using Simulators: A Pilot Study. J. Vet. Med. Educ. 2016, 43, 190–213. [Google Scholar] [CrossRef]
  24. McAlpin, E.; Levine, M.; Brenner, C.; Opazo, C.; Bathini, S.; Choi, S.J.V.; Louisville, M.; Grandhi, U. Evaluating the effectiveness of a virtual reality simulation for preclinical local anaesthesia dental education. Eur. J. Dent. Educ. 2022. [Google Scholar] [CrossRef]
  25. Abd-Shukor, S.N.; Yahaya, N.; Tamil, A.M.; Botelho, M.G.; Ho, T.K. Effectiveness of enhanced video-based learning on removable partial denture module. Eur. J. Dent. Educ. 2021, 25, 744–752. [Google Scholar] [CrossRef]
  26. Fayaz, A.; Mazahery, A.; Hosseinzadeh, M.; Yazdanpanah, S. Video-based Learning Versus Traditional Method for Preclinical Course of Complete Denture Fabrication. J. Dent. 2015, 16 (Suppl. S1), 21–28. [Google Scholar]
  27. Jang, H.W.; Kim, K.-J. Use of online clinical videos for clinical skills training for medical students: Benefits and challenges. BMC Med. Educ. 2014, 14, 56. [Google Scholar] [CrossRef] [PubMed]
  28. Roshier, A.L.; Foster, N.; Jones, M.A. Veterinary students’ usage and perception of video teaching resources. BMC Med. Educ. 2011, 11, 1. [Google Scholar] [CrossRef] [PubMed]
  29. Thilakumara, I.P.; Jayasinghe, R.M.; Rasnayaka, S.K.; Jayasinghe, V.P.; Abeysundara, S. Effectiveness of Procedural Video Versus Live Demonstrations in Teaching Laboratory Techniques to Dental Students. J. Dent. Educ. 2018, 82, 898–904. [Google Scholar] [CrossRef]
  30. Higgins, D.; Hayes, M.J.; Taylor, J.A.; Wallace, J.P. How do we teach simulation-based dental education? Time for an evidence-based, best-practice framework. Eur. J. Dent. Educ. 2020, 24, 815–821. [Google Scholar] [CrossRef]
  31. McGaghie, W.C.; Issenberg, S.B.; Cohen, E.R.; Barsuk, J.H.; Wayne, D.B. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad. Med. 2011, 86, 706–711. [Google Scholar] [CrossRef]
  32. Scalese, R.J.; Issenberg, S.B. Effective use of simulations for the teaching and acquisition of veterinary professional and clinical skills. J. Vet. Med. Educ. 2005, 32, 461–467. [Google Scholar] [CrossRef]
  33. Muca, E.; Cavallini, D.; Raspa, F.; Bordin, C.; Valle, E. Integrating new learning methods into equine nutrition classrooms: The importance of students’ perceptions. J. Equine Vet. Sci. 2023, 126, 104537. [Google Scholar] [CrossRef]
  34. Botelho, M.; Gao, X.; Bhuyan, S.Y. Mixed-methods analysis of videoed expert-student dialogue supporting clinical competence assessments. Eur. J. Dent. Educ. 2020, 24, 398–406. [Google Scholar] [CrossRef] [PubMed]
  35. Guo, P.J.; Kim, J.; Rubin, R. (Eds.) How video production affects student engagement: An empirical study of MOOC videos. In Proceedings of the First ACM Conference on Learning@ Scale Conference, Atlanta, GA, USA, 4–5 March 2014; pp. 41–50. [Google Scholar] [CrossRef]
  36. Annandale, A.; Scheepers, E.; Fosgate, G.T. The Effect of an Ovariohysterectomy Model Practice on Surgical Times for Final-Year Veterinary Students’ First Live-Animal Ovariohysterectomies. J. Vet. Med. Educ. 2020, 47, 44–55. [Google Scholar] [CrossRef] [PubMed]
  37. Coyne, E.; Rands, H.; Frommolt, V.; Kain, V.; Plugge, M.; Mitchell, M. Investigation of blended learning video resources to teach health students clinical skills: An integrative review. Nurse Educ. Today 2018, 63, 101–107. [Google Scholar] [CrossRef] [PubMed]
  38. Kelly, R.F.; Mihm-Carmichael, M.; Hammond, J.A. Students’ Engagement in and Perceptions of Blended Learning in a Clinical Module in a Veterinary Degree Program. J. Vet. Med. Educ. 2021, 48, 181–195. [Google Scholar] [CrossRef]
  39. Cook, D.A.; Hamstra, S.J.; Brydges, R.; Zendejas, B.; Szostek, J.H.; Wang, A.T.; Erwin, P.J.; Hatala, R. Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis. Med. Teach. 2013, 35, e867–e898. [Google Scholar] [CrossRef]
  40. Issenberg, S.B.; McGaghie, W.C.; Petrusa, E.R.; Lee Gordon, D.; Scalese, R.J. Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Med. Teach. 2005, 27, 10–28. [Google Scholar] [CrossRef]
  41. Little, W.B.; Artemiou, E.; Conan, A.; Sparks, C. Computer Assisted Learning: Assessment of the Veterinary Virtual Anatomy Education Software IVALA. Vet. Sci. 2018, 5, 58. [Google Scholar] [CrossRef]
  42. Annandale, A.; Annandale, C.H.; Fosgate, G.T.; Holm, D.E. Training Method and Other Factors Affecting Student Accuracy in Bovine Pregnancy Diagnosis. J. Vet. Med. Educ. 2018, 45, 224–231. [Google Scholar] [CrossRef]
  43. Agha, R.A.; Fowler, A.J. The role and validity of surgical simulation. Int. Surg. 2015, 100, 350–357. [Google Scholar] [CrossRef]
  44. Maran, N.J.; Glavin, R.J. Low- to high-fidelity simulation-a continuum of medical education? Med. Educ. 2003, 37 (Suppl. S1), 22–28. [Google Scholar] [CrossRef]
  45. Homer, M.; Fuller, R.; Hallam, J.; Pell, G. Response to comments on: Shining a spotlight on scoring in the OSCE: Checklists and item weighting. Med. Teach. 2021, 43, 365–366. [Google Scholar] [CrossRef] [PubMed]
  46. Daniels, V.J.; Pugh, D. Twelve tips for developing an OSCE that measures what you want. Med. Teach. 2018, 40, 1208–1213. [Google Scholar] [CrossRef] [PubMed]
  47. Naeem, N.; van der Vleuten, C.; Alfaris, E.A. Faculty development on item writing substantially improves item quality. Adv. Health Sci. Educ. 2012, 17, 369–376. [Google Scholar] [CrossRef] [PubMed]
  48. Yeates, P.; Moult, A.; Cope, N.; McCray, G.; Xilas, E.; Lovelock, T.; Vaughan, N.; Daw, D.; Fuller, R.M.; McKinley, R.K. Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE). Acad. Med. 2021, 96, 1189–1196. [Google Scholar] [CrossRef]
  49. Royal, K.D.; Guskey, T.R. Does Mathematical Precision Ensure Valid Grades? What Every Veterinary Medical Educator Should Know. J. Vet. Med. Educ. 2015, 42, 242–244. [Google Scholar] [CrossRef] [PubMed]
  50. Royal, K.D.; Hecker, K.G. Rater Errors in Clinical Performance Assessments. J. Vet. Med. Educ. 2016, 43, 5–8. [Google Scholar] [CrossRef]
  51. Lin, C.-J.; Chang, J.Z.-C.; Hsu, T.-C.; Liu, Y.-J.; Yu, S.-H.; Tsai, S.S.-L.; Lai, E.H.-H.; Lin, C.-P. Correlation of rater training and reliability in performance assessment: Experience in a school of dentistry. J. Dent. Sci. 2013, 8, 256–260. [Google Scholar] [CrossRef]
Figure 1. Video Screenshot Demonstrating Polishing.
Figure 1. Video Screenshot Demonstrating Polishing.
Vetsci 10 00526 g001
Figure 2. Constituent Parts of the High-Fidelity Model (HFM): head, maxilla, mandible, and tongue.
Figure 2. Constituent Parts of the High-Fidelity Model (HFM): head, maxilla, mandible, and tongue.
Vetsci 10 00526 g002
Figure 3. Radiographs of the Maxillary Incisors of the HFM (left) and a Live Patient (right).
Figure 3. Radiographs of the Maxillary Incisors of the HFM (left) and a Live Patient (right).
Vetsci 10 00526 g003
Figure 4. HFM Mandible Demonstrating Gingival Flap and Surgical Extraction Technique.
Figure 4. HFM Mandible Demonstrating Gingival Flap and Surgical Extraction Technique.
Vetsci 10 00526 g004
Table 1. Comparison of OSCE Results Between Video Instruction and HFM Laboratory Groups.
Table 1. Comparison of OSCE Results Between Video Instruction and HFM Laboratory Groups.
Grade HFM Laboratory Group AGrade Video Instruction Group BWilcoxon Rank-Sum Test p Value
Median
(IQR)
Median
(IQR)
Overall OSCE (denominator = 100)80.6
(72.4–85.8)
67.1
(56.7–71.3)
<0.001 *
Station 1
Put on the necessary personal protective equipment to obtain dental radiographs.4
(3–4)
2
(2–4)
0.008 *
Prepare the digital radiography sensor to obtain dental radiographs.4
(2–4)
3
(2–4)
0.2
Place the canine head on the table and in the correct position to obtain a dental radiograph of the mandible. Indicate verbally to the examiner once you have completed this task.3
(1–4)
2
(1–4)
0.6
Station 2
Position the radiography sensor and the tube head of the radiograph generator to obtain a radiograph of the mandibular incisors at 45°. Indicate verbally to the examiner once you have completed the task.3
(2–4)
3
(2–4)
0.8
Position the radiography sensor and the tube head of the radiograph generator to obtain a radiograph of mandibular premolar tooth 4 and molar tooth 1 in quadrant 3. Indicate verbally to the examiner once you have completed the task.2
(1–3)
1
(1–2)
0.006 *
Station 3
Put on the necessary personal protective equipment to perform a canine cleaning and polishing procedure.4
(4–4)
4
(3–4)
0.3
Switch on the ultrasonic scaler machine and verify that it is working correctly.4
(2–4)
2
(2–3)
<0.001 *
Switch on the air-driven dental unit and verify the three-in-one syringe handpiece is working correctly.4
(4–4)
4
(4–4)
0.5
Station 4
All teeth in the cadaver head have had all tartar removed. Demonstrate a scaling procedure on the left mandibular canine tooth.3.5
(3–4)
2
(2–4)
0.001 *
Assemble the polisher handpiece so that it is ready for use and then polish the left mandibular canine tooth.4
(3–4)
3
(2–4)
0.003 *
Station 5
Select the necessary items to perform an incisor extraction. Place on Card A.3.5
(3–4)
3
(2–4)
0.052
Select any elevator and use it to demonstrate how to hold this tool correctly when in use.4
(4–4)
3
(2–4)
<0.001 *
Select the necessary instruments to perform a gingival flap—instruments for suturing are not necessary. Place on Card B.3
(1–4)
1
(1–3)
0.03 *
Assemble the high-speed handpiece so that it is ready to remove alveolar bone from around a tooth root.4
(3.75–4)
3
(1–3)
<0.001 *
IQR: interquartile range; grade for item: 1–5. * Statistically significant p values. Each item was scored using a five-point Likert scale checklist.
Table 2. Selection of Participant Comments.
Table 2. Selection of Participant Comments.
Comments from Group A
The high-fidelity models were really nice to learn on. I enjoyed getting the feel of how it is actually done on a live patient. I am amazed at what stuck with me after learning about it once for three hours two weeks ago.
As someone who has never been exposed to dentistry, I believe the lab helped me out a tremendous amount, I feel much more confident than I did prior to the in-person labs. I hope every vet student gets the chance to learn using the models, my confidence in dentistry has significantly improved after only one day of training.
I really enjoyed the models, I felt like it was a really good experience to feel and handle a model that’s similar to real life. The models were very helpful for getting a good understanding of accurate canine dental anatomy.
The high-fidelity models were extremely helpful for me because I could visualize and assess all procedures with all my senses. It was a great learning experience. I got very interested in dentistry because of the models.
Comments from Group B
Being assigned to the videos, I like the fact that I could review the material prior to the OSCE and rewatch them. However, I don’t think they are as helpful as a hands-on lab. There are many questions I wish I could have asked and even with watching the videos multiple times I don’t feel prepared to perform these skills on a live patient by myself.
I felt like I learned a lot watching the videos but not nearly as much as if I had done the lab in person. It’s hard to assess your understanding without being able to do something with direct instruction and immediate feedback.
I did not find the videos very helpful in learning how to perform the tasks demonstrated. However, I do feel that they would be a good to refer to after completing the lab on the models, should any questions come up after the lab.
Felt videos were good quality. However, online was able to slack off. There is also no feedback or possible corrections made to your skills with online videos and no live instructor.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Fairs, J.; Conan, A.; Yvorchuk-St. Jean, K.; Gingerich, W.; Abramo, N.; Stahl, D.; Walters, C.; Artemiou, E. The Evaluation of a High-Fidelity Simulation Model and Video Instruction Used to Teach Canine Dental Skills to Pre-Clinical Veterinary Students. Vet. Sci. 2023, 10, 526. https://doi.org/10.3390/vetsci10080526

AMA Style

Fairs J, Conan A, Yvorchuk-St. Jean K, Gingerich W, Abramo N, Stahl D, Walters C, Artemiou E. The Evaluation of a High-Fidelity Simulation Model and Video Instruction Used to Teach Canine Dental Skills to Pre-Clinical Veterinary Students. Veterinary Sciences. 2023; 10(8):526. https://doi.org/10.3390/vetsci10080526

Chicago/Turabian Style

Fairs, James, Anne Conan, Kathleen Yvorchuk-St. Jean, Wade Gingerich, Nicole Abramo, Diane Stahl, Carly Walters, and Elpida Artemiou. 2023. "The Evaluation of a High-Fidelity Simulation Model and Video Instruction Used to Teach Canine Dental Skills to Pre-Clinical Veterinary Students" Veterinary Sciences 10, no. 8: 526. https://doi.org/10.3390/vetsci10080526

APA Style

Fairs, J., Conan, A., Yvorchuk-St. Jean, K., Gingerich, W., Abramo, N., Stahl, D., Walters, C., & Artemiou, E. (2023). The Evaluation of a High-Fidelity Simulation Model and Video Instruction Used to Teach Canine Dental Skills to Pre-Clinical Veterinary Students. Veterinary Sciences, 10(8), 526. https://doi.org/10.3390/vetsci10080526

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop