Next Article in Journal
On Beamforming with the Single-Sideband Transform
Previous Article in Journal
Influence of the Initial Prestress Level on the Distribution of Regions of Dynamic Instability of Geiger Domes
Previous Article in Special Issue
Exploring the Efficacy of Mixed Reality versus Traditional Methods in Higher Education: A Comparative Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Virtual Reality Immersive Simulations for a Forensic Molecular Biology Course—A Quantitative Comparative Study

by
Ahmed Ewais
1,*,
Stylianos Mystakidis
2,
Walid Khalilia
3,
Shadi Diab
4,
Athanasios Christopoulos
5,
Said Khasib
6,
Baha Yahya
7 and
Ioannis Hatzilygeroudis
8
1
Computer Science Department, Arab American University, Jenin P.O. Box 240, Palestine
2
School of Natural Sciences, University of Patras, 26504 Rion, Greece
3
Department of Forensic Science, Al Istiqlal University, Jericho P.O. Box 10, Palestine
4
Department of International Learning, Al Quds Open University, Ramallah P.O. Box 1804, Palestine
5
Turku Research Institute for Learning Analytics, University of Turku, 20014 Turku, Finland
6
Department of Biology and Biotechnology, Arab American University, Jenin P.O. Box 240, Palestine
7
Department of Management Information System, Al Istiqlal University, Jericho P.O. Box 10, Palestine
8
Department of Computer Engineering & Informatics, University of Patras, 26504 Rion, Greece
*
Author to whom correspondence should be addressed.
Appl. Sci. 2024, 14(17), 7513; https://doi.org/10.3390/app14177513
Submission received: 8 July 2024 / Revised: 10 August 2024 / Accepted: 23 August 2024 / Published: 25 August 2024

Abstract

:
Molecular biology is a complex, abstract, subject that can be challenging for higher education students to comprehend. The current manuscript describes the design, implementation, and evaluation of two immersive VR simulations of a DNA lab and a crime scene investigation (CSI) for a forensic molecular biology course in the context of the “TESLA” Erasmus+ project. It illustrates the instructional design and technical aspects of the VR simulations’ development. The experimental study employed a comparative quantitative research design. The guiding research questions examined how instructional modalities (online vs. face-to-face) affect learners’ perceptions of VR-based training in higher education and the key factors influencing learners’ intention for their adoption. Forty-six (n = 46) undergraduate students completed a 17-item questionnaire, which served as the main data collection instrument. Results demonstrate that both online and face-to-face VR-based instruction can effectively convey core concepts, thus challenging the traditional notion that face-to-face interaction is inherently superior. Its implications underscore the potential of VR simulations to supplement or even substitute traditional teaching methods, particularly for complex science subjects.

1. Introduction

There are several challenges related to teaching and learning molecular biology. For instance, molecular biology topics and learning materials can be complex, abstract, and difficult for students to comprehend and visualize [1]. Furthermore, molecular biology topics can be considered as prerequisite knowledge in various disciplines such as biology and ecology, agriculture, medicine, philosophy, and ethics [1]. Therefore, there is a need for customizing the molecular biology curriculum to link it with physical sciences and other STEM (Science, Technology, Engineering and Mathematics) fields [2]. Among the different proposed solutions is to use immersive technologies, like Virtual Reality (VR), to engage students actively by using problem-solving techniques in realistic environments and simulated tasks [3].
The 3D Virtual Learning Environment (3DVLE) can be an effective tool for education, especially in applied sciences. Immersive applications in Virtual Reality (VR) empower teachers to expand students’ learning experience and address the limitations of traditional teaching methods [4]. VR is also an essential technology to use for teaching abstract topics and science concepts that are inherently difficult to teach in a classroom-based environment [5,6]. Furthermore, VR with its inherent affordances, can engage students in immersive learning experiences in which skills can be developed through experimentation and repetition, without restrictions, consequences, or limitations, as in the physical world [7].
In recent years, there have been significant advances in VR technology and there has been an increase in studies investigating the use of VR in learning and teaching [8,9,10]. Especially, multiuser, social-VR platforms, apart from domain-specific competences, enable also the development of transversal, horizontal skills across multiple knowledge domains such as communication, problem-solving and cooperation among all actors involved in education [11,12]. Its positive effects can be recorded both inside classrooms, in the physical world, as well as in online, distance learning, settings [12]. Therefore, researchers and scholars around the world considered this great potential of utilizing VR in different educational domains, especially after the COVID-19 pandemic due to the increased trend of using e-learning around the world [13].
Different studies investigated aspects related to usability and substantial issues related to using VR in relevant educational fields. Early efforts demonstrated the benefits of 3D virtual environments for biology education [14]. For instance, Reen et al. [15] noted that there is an immediate need to develop and implement immersive learning approaches in molecular biology to support sustainable development for university students and academic research careers. Mayne and Greena [16] documented a multidisciplinary experimental study in which a VR crime scene investigation (CSI) was implemented and evaluated by both undergraduate/postgraduate students and staff. They demonstrated that VR applications support learning of practical CSI skills. VR-based practical sessions have the potential to add value to molecular biology science courses, by offering a cost-effective and practical experience as well as the ability to work in isolation and in a variety of different scenarios. In a similar study, Manescu et al. [17] developed a 3D virtual learning platform for teaching molecular biology science. They concluded that the benefits presented by VR in education are interesting, especially in the context in which the COVID-19 pandemic forced large masses of students to be away from their usual attendance-based learning environment [17]. Khalilia et al. [18] implemented and examined interactive learning strategies and activities with a 3DVLE for teaching CSI. After undergraduate students tested it, the study concluded that VR is a helpful tool to practice modern learning strategies and skills in learning forensic science and CSI. Previous efforts by Ewais et al. [19] presented a case study for using VR in a human anatomy course. However, there is still a shortage of studies on the implementation of VR in biological science education and there is a need for more investigation.
In the context of Palestine, teaching and learning molecular biology face obstacles such as the lack of DNA analysis labs in most universities, the high costs associated with equipping molecular biology laboratories, and the real potential risks of students’ presence in the laboratories. In addition, the COVID-19 pandemic forced institutions towards online education. The COVID-19 pandemic has led to significant changes in the delivery of education globally, with online engagement and accelerated uptake of novel teaching and assessment modalities into majority practice within institutions [20]. Furthermore, the special geopolitical circumstances in Palestine and restrictions imposed by the limited mobility between Palestinian cities. To meet all these challenges, realistic scenarios in VR were incorporated into the biology curriculum by creating scenarios that simulate DNA analysis in a virtual learning environment.
In general, the educational use of VR in Palestine is still limited. As a step toward enriching research related to utilizing VR in educational context in Palestine, a team of researchers from several Palestinian and European universities, including the authors of this study, and participants to the Erasmus+ Capacity Building in Higher Education project called “Virtual Reality as innovative and immersive learning tools for HEIs in Palestine—TESLA”, have developed an instructional framework for using VR to teach STEM courses, including biology, physics, forensic, and molecular biology sciences. This framework describes course learning activities and evaluation results compared with conventional in-class teaching methods [21].
This paper’s objective is twofold. First, it reports on the collaborative efforts between pedagogical experts, VR scientists and developers to design, develop, and implement VR simulations for forensic molecular biology in partner universities. Second, it presents the obtained quantitative evaluation results related to the developed VR forensic module in terms of instructional quality and learners’ attitudes toward the use of VR forensic simulations, including the strong and the weak aspects identified in the developed VR scenarios.
The structure of the paper is as follows. Section 2 presents the development approach that was adopted by the project development team. Accordingly, the developed prototype is described. More details about the interaction and activities that can be performed by the students are explained. After that, the setup of the validation step, data consistency, and sampling adequacy are presented. Section 3 shows the results obtained from participants and the adopted data analysis approach to validate the effectiveness of the developed VR forensic module. Section 4 discusses the analyzed data and shows the implications of the study. Finally, Section 5 concludes the conducted research work and offers recommendations for future research.

2. Materials and Methods

2.1. VR Simulation Design and Development

To develop a forensic module in VR, a custom instructional design model towards deep meaningful learning was developed in the context of the TESLA project [22]. The proposed model was built on the grounds of Assure, TPACK, and Kirkpatrick’s models [23]. The 6-step Assure model served as an umbrella for the whole instructional design approach and development processes. The second adopted model, TPACK, was used for designing the pedagogical scenario and enhancing the interaction design of the learning materials such as 3D objects with their animation, videos, slides, etc. Finally, Kirkpatrick’s model was incorporated as an evaluation framework in the 6th step of the Assure model. Specifically, it was used for analyzing and evaluating the results of the training workshops for Palestinian instructors.
The project’s instructional design was specified and developed during different preparation and training workshops which included the following: (1) determining specific topics from the forensic molecular biology course, (2) defining pedagogical objectives and intended learning outcomes, and (3) determining the assessment methods. As such, a generic simulation scenario was defined to provide students with contemporary forensic methods in molecular biology. The scenario enabled students to explore virtual crime scenes, examine them professionally and collect biological forensic evidence. Also, students were able to critically analyze the gathered evidence in a DNA lab, draw conclusions, and synthesize a report to explain key findings of the investigated crime.
Based on the simulation design document that contained the scenario, the technical team of the project specified the technical development requirements. These requirements include different sections such as hardware specifications, software aspects and software development methodology. Hardware aspects are related to specifications for 3D application servers, web server, database servers, and networking hardware. The software aspects are related to outputs and tools for 3D content designing apps, generation and scripting languages, MySQL databases. The adopted methodology was Agile so that different stakeholders could participate together, give feedback, co-design, and co-develop the VR simulations in iterative phases [24].
The first step in the development is the analysis phase which presents functional and non-functional requirements, user and system requirements, data flow diagrams, use case diagrams and sequence diagrams. Next, in the design phase, sketches for scenes and 3D models, interactions and navigation paths inside the 3DVLE, sequences of student activities were specified. Learning materials such as documents, video lectures, illustrations, presentations, web resources, related links, open-source content on the Internet, research papers and discussion topics as well as assessment quizzes were produced for integration in the virtual world. Software tools such as Microsoft PowerPoint, Adobe Captivate 9 and Articulate Storyline 360, were used to develop these learning materials. Additional tools for designing the 2D and 3D contents were Blender 2.90, Sketchup 20, Adobe Photoshop 2020, Illustrator 24 and InDesign 15. Furthermore, the development team used C# in OpenSim (DivaDistro 9.0) with MySQL database for scripting interactions between objects and avatars and to set up the learning activities to be performed inside the 3DVLE.

2.2. Forensic Molecular Biology VR Prototype

The developed 3D virtual learning environment (3DVLE) consists of two areas: (1) a crime scene area and (2) a molecular biology lab area. The crime scene area has a courtyard with yellow striped tape around the scene from three sides as depicted in Figure 1. Also, the crime scene area has 3D components including a dead body, a police officer maintaining the crime scene and witnesses as non-player characters (NPCs). It contains also biological forensic evidence containing DNA molecules, such as bloodstains, cigarette butts, hair, and a bloody knife.
On the other hand, the molecular biology (DNA) lab has 3 rooms, each equipped with tools and equipment set on tables (Figure 2). These are (1) the biological evidence handling and DNA preparation extraction room, (2) the DNA amplification room, and (3) the data analysis and interpretation room. In each space, students are supposed to execute a list of predefined activities. Inside the lab, there is a laboratory manager wearing a lab coat. In addition, there are laboratory technicians in each lab wearing lab coats, gloves, and other safety equipment. The manager and technicians help students in conducting the experiments inside each room.

2.3. Simulation Scenario and Activities

Upon completing the simulated scenario, the intended learning outcomes for the students were as follows:
  • Identify forensic evidence (blood samples) in a crime scene.
  • Propose and apply appropriate evidence collection methods.
  • Handle effectively genomic DNA from the collected human bloodstains.
  • Perform diagnostic DNA profiling and analyzing tests using laboratory equipment.
  • Interpret diagnostic DNA analysis test results accurately.
  • Moreover, students will be able to develop the following transversal skills:
  • Ability to analyze and solve problems.
  • Ability to communicate and cooperate in professional settings.
Students visited the crime scene area synchronously at the beginning of a virtual field trip. The NPC assistant (course’s teacher) welcomes and encourages them to access or revisit essential information and guidelines to avoid damaging the evidence in the scene during their visit. After that, the students role-play by assuming the role of detective. Different questions are given to the students by the assistant NPC during the tour. Based on the answers to this diagnostic test, the students will be directed to either watch instructional videos for more explanations or will be admitted exploring and collecting evidence.
During the collection of evidence, different textual guidelines are offered to students such as cleaning the tools used for collecting evidence, avoiding contaminating swabs, wearing gloves, a mask, and eye protection while collecting biological evidence, and changing gloves frequently.
After collecting the evidence, the NPC assistant encourages the students to visit the DNA lab area. First, in the DNA extraction room and with the support from the laboratory manager and technicians, the students should isolate genomic DNA from the collected human blood samples, prepare the lysate procedure to bind the DNA to the magnetic beads, and so on. After that, the laboratory manager guides them to the DNA amplification room and asks them different questions to support the students in keeping different copies of DNA samples. More learning materials will be offered to the students who provide wrong answers to help them comprehend their mistakes and their knowledge gaps. Finally, by having enough copies of DNA to analyze, the students are guided to the data analyses room where they should perform electrophoresis properly. In addition, different forms of multimedia materials (including, text-based questions, slides, and videos) are displayed to help the students in completing their tasks.
Finally, based on students’ progress, individual reports are generated which are subsequently available to instructors. In each login session, the report includes the student’s ID, avatar name, login and logout time, total scores, number of correct and wrong answers in each quiz, and the completed learning materials (slides, audio, video, report) that have been viewed during the session.

2.4. Evaluation of the VR Forensic Module

The guiding research questions of this study were the following:
RQ1: How did instructional modalities (online vs. face-to-face) affect learners’ perceptions of Virtual Reality-based training in forensic molecular biology courses?
RQ2: What are the key factors influencing learners’ intention to adopt Virtual Reality-based training solutions in forensic molecular biology courses?
The evaluation was conducted inside both universities’ labs, equipped with computers and internet connection. The experiment took place during the laboratory session (1 h and 30 min) and included different steps as depicted in Figure 3. Participants in these the two groups (face-to-face and online) were selected and distributed randomly.
Safety instructions related to how to use hardware and tools and how to deal with the 3D forensic module were provided by the teacher to the students within 5 and 10 min, respectively. Afterwards (approximately for 60 min), the teacher asked students to start exploring the developed 3D forensic module which prompted them to collect evidence from the crime scene and analyze it in the DNA lab. Also, the students were asked to complete predefined tasks, and they were exposed to questions that urged them to brainstorm, think critically, and solve problems. Following completion of the training session, a link to the evaluation questionnaire was distributed. While filling in the questionnaire, the teacher left the computer room to avoid bias in the evaluation process. Also, it was explicitly mentioned that there are no correct or wrong answers so that students felt more relaxed and confident in answering the questions truthfully.
The online questionnaire was prepared by the quality assurance and quality control teams of the TESLA project. The questionnaire was divided into three parts and is provided in Appendix A. The first part presents questions that are related to demographic data, whereas the second part examines the quality of the developed 3D learning scenario. The third part represents attitudes toward the use of VR/3D in the learning forensic molecular biology courses. The questionnaire was completed by 46 students in 2 Palestinian universities, Al-Istiqlal and AAUP (Figure 4). Both groups performed the evaluation following the exact same steps in both modes. For instance, the face-to-face group executed the experiment while the teacher was present. During the online session, students performed the experiment while the teacher was available remotely as an avatar inside the virtual world. The teacher’s role in both sessions consisted of the following tasks: providing safety instructions, introducing the 3D forensic module, demonstrating how to use hardware and software tools, and offering technical or instructional support upon request. In both conditions, the teacher supports students so that all of them can navigate, communicate and cooperate inside the crime scene. This simulates the traditional forensic course.

3. Results

3.1. Data Analysis

The primary data were analyzed using the R programming language (v. 4.3.1). The dataset was inspected for missing or incomplete values [25] and none were found. Potential outliers were examined using both graphical (boxplots) and analytical (z-scores) methods with no significant issues requiring correction or exclusion [25]. The entire dataset is provided as Supplementary Material.
To determine the underlying constructs within the instrument, Exploratory Factor Analysis (EFA) (Table 1) was conducted [26]. Both the Kaiser criterion (eigenvalues > 1) and the scree plot supported a two-factor solution. The first factor, labeled “Perceived Quality of the Virtual Environment”, is characterized by high loadings on questions pertaining to the overall impression of the virtual classroom such as the quality of the 3D objects, animations, and texts. In a sense, this construct reflects users’ perceptions of the technical aspects and the aesthetic appeal of the 3D Virtual Learning Environment (3DVLE). The second factor, termed “Adoption Perception”, is primarily associated with items related to the learning experience itself. These include the role of the teacher and the degree to which the 3DVLE was perceived as interesting and useful for learning. It, therefore, captures users’ perceptions towards its wider adoption in education.
Following the EFA, a Confirmatory Factor Analysis (CFA) was conducted to verify the factors’ structure [26]. The results supported the two-factor solution with relatively high loadings for each construct (Table 2). The emergence of these factors indicates that users’ perceptions of the 3DVLE are multi-faceted, encompassing both the quality of the environment itself and the effectiveness of the learning experience within the environment. This is in line with the relevant literature [27,28] which suggests that a technologically advanced virtual environment alone does not ensure a successful learning experience; the pedagogical framework and its execution are equally critical.
Internal consistency reliability for each construct was assessed using Cronbach’s alpha (α). The reliability coefficient for Perceived Quality of the Virtual Environment (α = 0.77) indicates a good internal consistency, while the coefficient for Adoption Perception (α = 0.68), although slightly below the conventional threshold (α > 0.70), still suggests acceptable internal consistency [29]. The Shapiro–Wilk test for normality revealed significant deviations from normality for several variables, indicating the appropriateness of non-parametric tests for subsequent analyses [30]. Descriptive statistics, including means, standard deviations, and frequencies, were computed to summarize the data and assess key assumptions. Comparisons between groups were conducted using the Mann–Whitney U test for continuous variables and the chi-square test for categorical variables [31]. Spearman’s rank-order correlation coefficient (r) was calculated to investigate relationships between the constructs within the sample [31]. Where applicable, effect sizes (R2) were computed to gauge the practical significance of the observed correlations.

3.2. Findings

3.2.1. Demographics

The sample (Table 3 and Table 4) comprised predominantly male participants, with the online group having a slightly higher representation (69.57%) compared to the face-to-face group (60.87%). The gender distribution aligns with typical patterns observed in technology-related studies where male participants often outnumber females [32]. The age distribution was similar between the groups, with most participants aged between 18 and 23 years. The majority of participants in both groups fell within the 18–22 age range, with a slightly higher mean age observed in the face-to-face group (M = 20.96, SD = 1.97) compared to the online group (M = 20.65, SD = 2.21).
A notable difference, however, emerged in the participants’ experience with computer-based games with the participants of the online group considering themselves to be more experienced (advanced = 52.17%, experts = 34.78%) as opposed to their fellow students in the face-to-face group (intermediate = 39.13%, experts = 13.04%). Experience with Virtual Reality (VR) applications also differed between the groups. The face-to-face group had a more balanced distribution of experience levels (intermediate = 43.48%; advanced = 21.74%). On the contrary, the online group had a higher percentage of beginners (52.17%), indicating less overall familiarity. The disparities in experience suggest that each group brings different strengths to the table. The online group’s proficiency with computer-based games might make them more agile and effective in the 3DVLE which, in turn, could influence their engagement and performance in the instructional simulations. Conversely, the face-to-face group’s balanced experience with VR applications suggests that they may have a better foundational understanding of VR, making them potentially more adept at leveraging the educational aspects of the simulations. Therefore, when designing and implementing educational VR tools, it would be beneficial to consider these differing strengths, i.e., tailoring the VR simulations to accommodate both the gaming skills that participants may have and their foundational experience with VR. For instance, initial training sessions could be differentiated: one focusing on familiarizing students with the specific VR tools and another enhancing the VR interaction skills [33].
Interestingly, as illustrated in Table 5, despite the online group reporting more experience with computer-based games and less experience with VR (M = 2.95, SD = 0.82), they rated the virtual environment less favorably than the face-to-face group (M = 3.35, SD = 0.85). This discrepancy could be attributed to their higher expectations for VR quality stemming from their video game experience or their relative discomfort with the unfamiliar VR technology. However, both groups reported similar perceptions of the learning effectiveness of the VR simulations (Face-to-Face: M = 2.5, SD = 0.67; Online: M = 2.43, SD = 0.66) suggesting that despite the differences in user experience, the educational impact of the VR simulations was comparable.

3.2.2. Impact of Instructional Modalities on Learners’ Perceptions

The chi-square (Table 6) test did not reveal any statistically significant associations between participants’ background characteristics and instructional format. However, the near-significant result for computer game experience (p = 0.05) warrants further investigation, as it hints at a possible trend [34] that could be more apparent with a larger sample.
Accordingly, Mann–Whitney U tests (Table 7) were conducted to compare participants’ perceptions of the perceived quality and learning effectiveness of the intervention across the different instructional formats.
The analysis revealed a significant difference in how learners perceived the relevance of the educational content (U = 158.5, z = −2.48, p = 0.01) with participants in the face-to-face format rating the content as more ‘relevant’ and ‘accurate’ than those in the online format, thus highlighting the influence of instructional delivery on learners’ perceptions. This observation aligns with the existing literature suggesting that face-to-face interactions can foster greater engagement and knowledge retention, likely due to increased opportunities for real-time feedback and clarification [35].
In contrast, we found no significant differences between the two formats in learners’ perceptions of learning material quality (U = 198, z = −1.64, p = 0.1), including aspects such as visuals (U = 211.5, z = −1.26, p = 0.2), animations (U = 262, z = −0.05, p = 0.96), and text clarity (U = 234.5, z = −0.74, p = 0.46). On these grounds, it can be suggested that developers may have flexibility in how they prioritize these aspects across delivery methods. Similarly, we found no significant differences between formats in learners’ perceptions of the 3DVLE’s effectiveness in aiding topic comprehension (U = 189.5, z = −1.69, p = 0.09), skill development (U = 225, z = −0.98, p = 0.32), or stimulating learners’ interest in the subject matter (U = 243.5, z = −0.50, p = 0.62). We, therefore, hypothesize that the 3DVLE’s design and features, rather than the delivery mode, may be the primary factors influencing learners’ engagement and perceptions of its educational value.
Interestingly, participants in the face-to-face format reported a significantly more positive overall impression of their learning experience within the 3D virtual environment (U = 165, z = −2.33, p = 0.02) implying that, while the virtual environment itself is effective, the social context of face-to-face learning may contribute to a more positive and enriching overall experience. Lastly, we observed no significant differences between the groups in their perceptions regarding the necessity of teacher presence (U = 244, z = −0.50, p = 0.61), willingness to use a similar environment in the future (U = 252.5, z = −0.28, p = 0.77), or likelihood of recommending the approach to others (U = 236.5, z = −0.71, p = 0.47). This consistency across formats points to a general acceptance and potential for broader adoption of 3DVLEs in education by underscoring their versatility and potential to complement various instructional approaches.

3.2.3. Factors Influencing Learners’ Attitude toward VR-Based Simulations

The correlation analysis (Table 8) indicated that several factors significantly influence learners’ intention to adopt VR-based training simulations in forensic molecular biology courses. Notably, demographic factors did not show significant correlations with the key outcomes, implying that perceptions of VR learning effectiveness are relatively independent of these variables.
However, content relevance emerged as a critical factor, showing strong correlations with visual quality (r = 0.31, p < 0.05, R2 = 0.116), comprehension (r = 0.46, p < 0.01, R2 = 0.199), overall impression of learning in a 3D virtual environment (r = 0.56, p < 0.01, R2 = 0.292), overall immersive learning experience (r = 0.50, p < 0.01, R2 = 0.244), and future use (r = 0.30, p < 0.05, R2 = 0.079). This underscores the importance of relevant content in shaping learners’ overall perceptions and intentions regarding VR training.
Similarly, visual quality was positively correlated with the smoothness and realism of animations (r = 0.30, p < 0.05, R2 = 0.102), overall quality of learning materials (r = 0.47, p < 0.01, R2 = 0.221), and comprehension (r = 0.30, p < 0.05, R2 = 0.087), highlighting the role of high visual standards in enhancing the perceived realism and quality of learning materials. Animation realism also demonstrated significant correlations with the overall quality of learning materials (r = 0.32, p < 0.05, R2 = 0.164), overall impression of learning in a 3D virtual environment (r = 0.45, p < 0.01, R2 = 0.097), overall learning experience (r = 0.56, p < 0.01, R2 = 0.004), and future use (r = 0.44, p < 0.01, R2 = 0.023), suggesting that realistic animations are pivotal in fostering positive learner impressions and experiences, which in turn promote future use of VR training simulations.
Furthermore, the overall quality of learning materials was significantly correlated with the clarity and readability of texts (r = 0.33, p < 0.05, R2 = 0.054), overall impression (r = 0.49, p < 0.01, R2 = 0.188), and future use (r = 0.36, p < 0.05, R2 = 0.078), indicating that high-quality learning materials enhance learners’ perceptions and their intention to reuse VR simulations. Text clarity also showed significant correlations with overall impression (r = 0.20, p < 0.05, R2 = 0.043), development of new transversal skills (r = 0.33, p < 0.05, R2 = 0.009), and future use (r = 0.33, p < 0.05, R2 = 0.003), highlighting the importance of clear and concise text in improving learner understanding and positively impacting their overall impression and intention to continue using VR applications.
Additionally, the development of new transversal skills was strongly related to overall impression (r = 0.49, p < 0.01, R2 = 0.193), overall experience (r = 0.51, p < 0.01, R2 = 0.317), and future use (r = 0.41, p < 0.01, R2 = 0.204), emphasizing that horizontal skill development through VR interventions such as problem-solving and cooperation significantly influences the likelihood of continued use. Both overall impression and immersive learning experience were critical, with overall impression strongly correlated with future use (r = 0.36, p < 0.05, R2 = 0.128) and recommendation to other students (r = 0.43, p < 0.01, R2 = 0.160), while the overall immersive learning experience was correlated with future use (r = 0.41, p < 0.01, R2 = 0.175) and recommendation to other students (r = 0.47, p < 0.01, R2 = 0.081). This indicates that positive learner impressions and experiences are essential in promoting future engagement and recommendations.
Finally, although teacher presence showed a positive correlation with future use (r = 0.30, p = 0.05), it was not statistically significant, suggesting a potential trend where effective teacher presence may contribute to the intention to use VR training, though further research is needed.

4. Discussion and Conclusions

This research work has proposed a development approach for an immersive simulation module and investigated the use of the 3DVLE in forensic molecular biology course. The developed scenario for VR/3D forensic module enabled students to move as avatars, explore and navigate inside a 3D crime scene with guidance from their teachers inside the simulated environment, collect evidence, perform analysis inside the virtual molecular biology lab, view learning resources, and answer quizzes as assessment tool inside the virtual world.
The findings confirm the transformative potential of 3DVLEs in forensic molecular biology education by echoing recent research that highlights the efficacy of VR in various scientific disciplines [36]. Our findings demonstrate that both online and face-to-face VR-based instruction can effectively convey core concepts, thus challenging the traditional notion that face-to-face interaction is inherently superior; an outcome which is also in agreement with [37]. On these grounds it can be suggested that, with careful design and consideration of pedagogical principles, VR-based training can provide comparable educational benefits and may even surpass traditional methods in certain scientific contexts and subjects that are difficult or dangerous to replicate in physical classrooms.
The study also emphasizes the critical role of high-fidelity virtual environments in shaping learners’ perceptions towards VR-based learning. Specifically, content relevance, visual quality, and animation realism were identified as the most influential factors in learners’ overall experience and intention to reuse VR for training purposes. The aforementioned outcomes align with existing research that underscores the importance of multimedia elements in immersive experiences as a means of enhancing sense of presence [38]. Collectively, such attributes contribute to VR’s ability to foster motivation and engagement which, in turn, lead to improved performance on complex tasks and greater enjoyment of the learning process [39,40,41].
Furthermore, the experiential nature of VR facilitated the practical application of learned concepts and provided learners with opportunities to experiment and develop new horizontal skills. This aligns with the broader pedagogical shift towards active learning and experiential education [42], which prioritizes the provision of authentic contexts and encourages the development of transversal skills through simulated experiences that closely mimic the real-world conditions requiring collaboration to address complex problems [12,43].
Finally, although our study did not demonstrate a statistically significant effect of teacher presence on learners’ perceptions of VR, an emerging trend suggests that instructor–learner interaction might influence learners’ willingness to utilize VR in the future [44]. This observation requires further investigation to identify the optimal balance between independent exploration and guided instruction within VR environments [45,46].
The implications of the study extend beyond forensic molecular biology to the broader educational landscape. Firstly, the success of VR across both online and face-to-face modes underscores its potential to supplement or even substitute traditional teaching methods, particularly for complex subjects. This opens new avenues for learners who may encounter obstacles accessing or feel uncomfortable in physical labs or classrooms. Secondly, the study emphasizes the importance of incorporating high-quality visuals and animations in VR learning. Prioritizing these elements not only enhances immediate engagement but also fosters sustained interest in technology and its educational advantages. Thirdly, VR’s potential to facilitate skill development, by allowing learners to actively apply scientific concepts in the virtual environment, is crucial for both conceptual understanding and retention of complex information [47]. Lastly, while the expected impact of instructor presence was not confirmed, the observed trend suggests a promising avenue for future innovation. Integrating features like Intelligent Pedagogical Agents (IPAs) that offer personalized guidance could further elevate the VR educational experience [48].

5. Limitations and Future Work Recommendations

The study provides several insights but also comes with certain limitations. The sample size was relatively small, from two higher education institutions, and focused on a specific field, thus limiting the generalizability of the findings. Future research should involve larger, more diverse participant groups across different scientific disciplines to validate and extend these results. Another suggested research direction would be comparing the effects of an online immersive CSI module with a respective attendance-based lesson or unit. Additionally, the study did not assess the short- and long-term effects of VR training on knowledge retention and skill transfer. Longitudinal studies are needed to evaluate how well learning outcomes are maintained over time and to determine the ideal frequency and duration of VR training for lasting educational benefits. Further research could also explore (a) the effectiveness of VR in other scientific fields, such as chemistry, physics, and environmental science, as well as (b) the perceptions of teachers who use 3VLEs systematically for teaching and learning. To this end, personalizing the instructional approach to match individual learners’ needs and preferences should also be a focus for future investigations. Finally, future research could examine the sustainability of 3DVLEs in terms of their reusability and adaptability with easy-to-use authoring tools for updating the simulation with different scenarios and learning materials.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/app14177513/s1, Table S1: Full dataset.

Author Contributions

Conceptualization, A.E., S.D. and W.K.; methodology, A.E. and S.D.; software, W.K.; validation, A.E. and W.K.; formal analysis, S.D.; investigation, A.C.; resources, B.Y.; data curation, A.E. and S.M.; writing—original draft preparation, S.M. and A.C.; writing—review and editing, S.M. and I.H.; visualization, S.D.; supervision, A.E.; project administration, S.K.; funding acquisition, I.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the European Commission, grant number 585772-epp-1-2017-1ps-eppka2-cbhe-jp (project TESLA—Virtual Reality as an Innovative and Immersive Learning Tools for Higher Education Institutions in Palestine).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Ethics Committee of the University of Patras (protocol code 549 on 30 April 2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data used to support the findings of this study are available from the corresponding author upon request.

Acknowledgments

This paper reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein. Also, the authors thank all team members from all institutions involved in the project. The first author thanks Hamdi Helo and Mahmoud Nairat for their efforts during the development phase.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A. Data Collection Instrument

CategoryItem/DescriptionMeasurementResponses/Coding
Instructional Group1. In which format was your training course delivered?Dichotomous1: Face-to-Face, 2: Online
Background informationPlease indicate your gender.Nominal1: Male, 2: Female, 3: Prefer not to answer
Background informationPlease indicate your age group.Ordinal1: 18–20 years old, 2: 21–23 years old, 3: 24 years old and above
Background informationHow would you rate your experience with computer-based games?Likert scale1: No experience, 2: Beginner, 3: Intermediate, 4: Advanced, 5: Expert
Background informationHow would you rate your experience with 3D virtual environments?Likert scale1: No experience, 2: Beginner, 3: Intermediate, 4: Advanced, 5: Expert
Perceived Quality of the Virtual EnvironmentQ1. How would you rate the content of the scenario in terms of relevance and accuracy?Likert scale1: Very Poor, 2: Poor, 3: Fair, 4: Good, 5: Excellent
Perceived Quality of the Virtual EnvironmentQ2. How would you rate the visual quality of the 3D objects in the scenario?Likert scale1: Very Poor, 2: Poor, 3: Fair, 4: Good, 5: Excellent
Perceived Quality of the Virtual EnvironmentQ3. How would you rate the smoothness and realism of the animations in the scenario?Likert scale1: Very Poor, 2: Poor, 3: Fair, 4: Good, 5: Excellent
Perceived Quality of the Virtual EnvironmentQ4. How would you rate the overall quality of the learning materials in the scenario?Likert scale1: Very Poor, 2: Poor, 3: Fair, 4: Good, 5: Excellent
Perceived Quality of the Virtual EnvironmentQ5. How would you rate the clarity and readability of the texts in the scenario?Likert scale1: Very Poor, 2: Poor, 3: Fair, 4: Good, 5: Excellent
Perceived Quality of the Virtual EnvironmentQ6. To what extent did your activities in the 3D virtual environment help you understand the presented topics?Likert scale1: Not at all, 2: Very little, 3: Somewhat, 4: To a great extent
Perceived Quality of the Virtual EnvironmentQ7. Do you feel that this tool positively impacted your learning by helping you develop new transversal skills such as collaboration and problem-solving?Likert scale1: No, not really, 2: Neutral, 3: Yes, definitely
Perceived Quality of the Virtual EnvironmentQ8. What is your overall impression of learning in a 3D virtual environment?Likert scale1: Very negative, 2: Negative, 3: Neutral, 4: Positive, 5: Very positive
Perceived Quality of the Virtual EnvironmentQ9. How would you rate your overall immersive learning experience in the virtual environment?Likert scale1: Very uninteresting, 2: Uninteresting, 3: Neutral, 4: Interesting, 5: Very interesting
Adoption PerceptionQ10. To what extent do you believe teacher’s presence is necessary when undertaking learning activities in a virtual environment?Likert scale1: Not necessary at all, 2: Somewhat necessary, 3: Absolutely necessary
Adoption PerceptionQ11. Would you consider using a similar educational 3D Virtual Environment for future training?Likert scale1: No, not really, 2: Maybe, 3: Yes, definitely
Adoption PerceptionQ12. How likely are you to recommend this learning approach to other students?Likert scale1: Not likely at all, 2: Somewhat likely, 3: Very likely

References

  1. Tibell, L.A.E.; Rundgren, C.-J. Educational Challenges of Molecular Life Science: Characteristics and Implications for Education and Research. CBE—Life Sci. Educ. 2010, 9, 25–33. [Google Scholar] [CrossRef]
  2. Aikens, M.L. Meeting the Needs of A Changing Landscape: Advances and Challenges in Undergraduate Biology Education. Bull. Math. Biol. 2020, 82, 60. [Google Scholar] [CrossRef]
  3. Mystakidis, S.; Lympouridis, V. Designing Simulations in the Metaverse: A Blueprint for Experiential Immersive Learning Experiences. In Augmented and Virtual Reality in the Metaverse; Geroimenko, V., Ed.; Springer Nature: Cham, Switzerland, 2024; pp. 65–79. ISBN 978-3-031-57746-8. [Google Scholar]
  4. Okutsu, M.; DeLaurentis, D.; Brophy, S.; Lambert, J. Teaching an Aerospace Engineering Design Course via Virtual Worlds: A Comparative Assessment of Learning Outcomes. Comput. Educ. 2013, 60, 288–298. [Google Scholar] [CrossRef]
  5. Xie, T.; Li, Y.; Tang, Y. Effects of Using Immersive Virtual Reality for Science Education on Learning Outcomes: A Randomized Controlled Pilot Study. IEEE Trans. Learn. Technol. 2023, 16, 1045–1056. [Google Scholar] [CrossRef]
  6. Antonopoulos, P.; Fokides, E.; Koutromanos, G. Understanding Learning and Learning Experience in Immersive Virtual Reality. Technol. Knowl. Learn. 2024, 1–30. [Google Scholar] [CrossRef]
  7. Hamilton, D.; McKechnie, J.; Edgerton, E.; Wilson, C. Immersive Virtual Reality as a Pedagogical Tool in Education: A Systematic Literature Review of Quantitative Learning Outcomes and Experimental Design. J. Comput. Educ. 2021, 8, 1–32. [Google Scholar] [CrossRef]
  8. Hadjipanayi, C.; Christofi, M.; Banakou, D.; Michael-Grigoriou, D. Cultivating Empathy through Narratives in Virtual Reality: A Review. Pers. Ubiquitous Comput. 2024, 1–13. [Google Scholar] [CrossRef]
  9. Krassmann, A.L.; Melo, M.; Pinto, D.; Peixoto, B.; Bessa, M.; Bercht, M. What Is the Relationship between the Sense of Presence and Learning in Virtual Reality? A 24-Year Systematic Literature Review. PRESENCE Virtual Augment. Real. 2022, 28, 247–265. [Google Scholar] [CrossRef]
  10. Marougkas, A.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Virtual Reality in Education: A Review of Learning Theories, Approaches and Methodologies for the Last Decade. Electronics 2023, 12, 2832. [Google Scholar] [CrossRef]
  11. van der Meer, N.; van der Werf, V.; Brinkman, W.-P.; Specht, M. Virtual Reality and Collaborative Learning: A Systematic Literature Review. Front. Virtual Real. 2023, 4, 1159905. [Google Scholar] [CrossRef]
  12. Lee, J.; Kim, Y. Sustainable Educational Metaverse Content and System Based on Deep Learning for Enhancing Learner Immersion. Sustainability 2023, 15, 12663. [Google Scholar] [CrossRef]
  13. Ball, C.; Huang, K.-T.; Francis, J. Virtual Reality Adoption during the COVID-19 Pandemic: A Uses and Gratifications Perspective. Telemat. Inform. 2021, 65, 101728. [Google Scholar] [CrossRef]
  14. Mikropoulos, T.A.; Katsikis, A.; Nikolou, E.; Tsakalis, P. Virtual Environments in Biology Teaching. J. Biol. Educ. 2003, 37, 176–181. [Google Scholar] [CrossRef]
  15. Reen, F.J.; Jump, O.; McSharry, B.P.; Morgan, J.; Murphy, D.; O’Leary, N.; O’Mahony, B.; Scallan, M.; Supple, B. The Use of Virtual Reality in the Teaching of Challenging Concepts in Virology, Cell Culture and Molecular Biology. Front. Virtual Real. 2021, 2, 670909. [Google Scholar] [CrossRef]
  16. Mayne, R.; Green, H. Virtual Reality for Teaching and Learning in Crime Scene Investigation. Sci. Justice 2020, 60, 466–472. [Google Scholar] [CrossRef]
  17. Manescu (Paltanea), V.; Popovici, D.; Nemoianu, I.V.; Paltanea, G.; Dumitrana, B. Virtual Reality in Forensic Scenario Used in Higher Education Institutions in Palestine. In Proceedings of the INTED2021 Proceedings, Online, 8–9 March 2021; pp. 1214–1219. [Google Scholar]
  18. Khalilia, W.M.; Gombar, M.; Palkova, Z.; Palko, M.; Valicek, J.; Harnicarova, M. Using Virtual Reality as Support to the Learning Process of Forensic Scenarios. IEEE Access 2022, 10, 83297–83310. [Google Scholar] [CrossRef]
  19. Ewais, A.; Maree, M.; De Troyer, O.; Kharraz, B. Audio and Video Adaptation inside 3D Virtual Learning Environments. In Proceedings of the 8th International Conference on eLearning, Belgrade, Serbia, 28–29 September 2017; Belgrade Metropolitan University: Beograd, Serbia, 2017; pp. 77–81. [Google Scholar]
  20. Rapanta, C.; Botturi, L.; Goodyear, P.; Guàrdia, L.; Koole, M. Balancing Technology, Pedagogy and the New Normal: Post-Pandemic Challenges for Higher Education. Postdigital Sci. Educ. 2021, 3, 715–742. [Google Scholar] [CrossRef]
  21. Ewais, A.; Salah, Z.; Hamed, G. Need Analysis for Higher Educational Institutions for Using Virtual Reality-TESLA Project. Int. J. Emerg. Technol. Learn. (iJET) 2022, 17, 216–231. [Google Scholar] [CrossRef]
  22. Fragkaki, M.; Mystakidis, S.; Hatzilygeroudis, I.; Kovas, K.; Palkova, Z.; Salah, Z.; Hamed, G.; Khalilia, W.M.; Ewais, A. TPACK Instructional Design Model in Virtual Reality for Deeper Learning in Science and Higher Education: From “Apathy” to “Empathy”. In Proceedings of the 12th Annual International Conference on Education and New Learning Technologies (EDULEARN20), Online, 6–7 July 2020; pp. 3286–3292. [Google Scholar]
  23. Weidlich, J.; Kalz, M. How Well Does Teacher Education Prepare for Teaching with Technology? A TPACK-Based Investigation at a University of Education. Eur. J. Teach. Educ. 2023, 1–21. [Google Scholar] [CrossRef]
  24. Noguera, I.; Guerrero-Roldán, A.-E.; Masó, R. Collaborative Agile Learning in Online Environments: Strategies for Improving Team Regulation and Project Management. Comput. Educ. 2018, 116, 110–129. [Google Scholar] [CrossRef]
  25. Myers, J.L.; Well, A.D.; Lorch, R.F., Jr. Research Design and Statistical Analysis; Routledge: New York, NY, USA, 2013; ISBN 9781135811563. [Google Scholar]
  26. Thompson, B. Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications; American Psychological Association: Washington, DC, USA, 2004; ISBN 1-59147-093-5. [Google Scholar]
  27. Castelhano, M.; Almeida, D.; Morgado, L.; Pedrosa, D. Instructional Design Model for Virtual Reality: Testing and Participant Experience Evaluation. In Proceedings of the Design, Learning, and Innovation, 8th EAI International Conference, DLI 2023, Aalborg, Denmark, 6–7 November 2023; Brooks, E., Kalsgaard Møller, A., Edstrand, E., Eds.; Springer: Cham, Switzerland, 2024; pp. 62–75. [Google Scholar]
  28. Mystakidis, S.; Lympouridis, V. Immersive Learning Design in the Metaverse: A Theoretical Literature Review Synthesis. In Application of the Metaverse in Education; Liu, D., Huang, R., Hosny Saleh Metwally, A., Tlili, A., Fan Lin, E., Eds.; Springer: Cham, Switzerland, 2024; pp. 55–71. [Google Scholar]
  29. Tavakol, M.; Dennick, R. Making Sense of Cronbach’s Alpha. Int. J. Med. Educ. 2011, 2, 53–55. [Google Scholar] [CrossRef]
  30. Price, P.C.; Jhangiani, R.; Chiang, I.-C.A.; Leighton, D.C.; Cuttler, C. Conducting Your Analyses. In Research Methods in Psychology; Price, P.C., Jhangiani, R., Chiang, I.-C.A., Leighton, D.C., Cuttler, C., Eds.; American Psychological Association: Washington, DC, USA, 2012; pp. 289–301. [Google Scholar]
  31. Chiang, C.L. Statistical Methods of Analysis; World Scientific: Singapore, 2003; ISBN 9812383107. [Google Scholar]
  32. Tokbaeva, D.; Achtenhagen, L. Career Resilience of Female Professionals in the Male-dominated IT Industry in Sweden: Toward a Process Perspective. Gend. Work. Organ. 2023, 30, 223–262. [Google Scholar] [CrossRef]
  33. Delamarre, A.; Lisetti, C.; Buche, C. A Cross-Platform Classroom Training Simulator: Interaction Design and Evaluation. In Proceedings of the 2020 International Conference on Cyberworlds (CW), Caen, France, 29 September–1 October 2020; IEEE: New York, NY, USA, 2020; pp. 86–93. [Google Scholar]
  34. Joshi, A.; Mousas, C.; Harrell, D.F.; Kao, D. Exploring the Influence of Demographic Factors on Progression and Playtime in Educational Games. In Proceedings of the 17th International Conference on the Foundations of Digital Games, Athens, Greece, 5–8 September 2022; ACM: New York, NY, USA, 2022; pp. 1–15. [Google Scholar]
  35. Gherheș, V.; Stoian, C.E.; Fărcașiu, M.A.; Stanici, M. E-Learning vs. Face-To-Face Learning: Analyzing Students’ Preferences and Behaviors. Sustainability 2021, 13, 4381. [Google Scholar] [CrossRef]
  36. Atsikpasi, P.; Fokides, E. A Scoping Review of the Educational Uses of 6DoF HMDs. Virtual Real. 2022, 26, 205–222. [Google Scholar] [CrossRef]
  37. Stevens, G.J.; Bienz, T.; Wali, N.; Condie, J.; Schismenos, S. Online University Education Is the New Normal: But Is Face-to-Face Better? Interact. Technol. Smart Educ. 2021, 18, 278–297. [Google Scholar] [CrossRef]
  38. Cromley, J.G.; Chen, R.; Lawrence, L. Meta-Analysis of STEM Learning Using Virtual Reality: Benefits Across the Board. J. Sci. Educ. Technol. 2023, 32, 355–364. [Google Scholar] [CrossRef]
  39. Lin, H.; Hwang, G.; Chou, K.; Tsai, C. Fostering Complex Professional Skills with Interactive Simulation Technology: A Virtual Reality-based Flipped Learning Approach. Br. J. Educ. Technol. 2023, 54, 622–641. [Google Scholar] [CrossRef]
  40. Gim, G.; Bae, H.K.; Kang, S.A. The Effect of Self-Determination and Quality of VR-Based Education in the Metaverse on Learner Satisfaction. In Proceedings of the 1st ACIS International Symposium on Emotional Artificial Intelligence and Metaverse, EAIM 2022, Danang, Vietnam, 4–6 August 2022; Volume 1067, pp. 41–54. [Google Scholar]
  41. Makransky, G.; Borre-Gude, S.; Mayer, R.E. Motivational and Cognitive Benefits of Training in Immersive Virtual Reality Based on Multiple Assessments. J. Comput. Assist. Learn. 2019, 35, 691–707. [Google Scholar] [CrossRef]
  42. Røe, Y.; Wojniusz, S.; Bjerke, A.H. The Digital Transformation of Higher Education Teaching: Four Pedagogical Prescriptions to Move Active Learning Pedagogy Forward. Front. Educ. 2022, 6, 784701. [Google Scholar] [CrossRef]
  43. Araiza-Alba, P.; Keane, T.; Chen, W.S.; Kaufman, J. Immersive Virtual Reality as a Tool to Learn Problem-Solving Skills. Comput. Educ. 2021, 164, 104121. [Google Scholar] [CrossRef]
  44. Feng, Q.; Luo, H.; Li, Z.; Liang, J.; Li, G.; Yi, Y. Creating an Immersive Virtual Reality Game Space for Multiuser, Synchronous Co-Located Collaboration: Design Considerations and Influencing Factors. Appl. Sci. 2024, 14, 2167. [Google Scholar] [CrossRef]
  45. Han, E.; Bailenson, J.N. Social Interaction in VR. In Oxford Research Encyclopedia of Communication; Oxford University Press: Oxford, UK, 2024. [Google Scholar]
  46. Tyrväinen, H.; Uotinen, S.; Valkonen, L. Instructor Presence in a Virtual Classroom. Open Educ. Stud. 2021, 3, 132–146. [Google Scholar] [CrossRef]
  47. Dede, C.; Grotzer, T.A.; Kamarainen, A.; Metcalf, S. EcoXPT: Designing for Deeper Learning through Experimentation in an Immersive Virtual Ecosystem. J. Educ. Technol. Soc. 2017, 20, 166–178. [Google Scholar]
  48. Petersen, G.; Mottelson, A.; Makransky, G. Pedagogical Agents in Educational VR: An in the Wild Study. In Proceedings of the Conference on Human Factors in Computing Systems (CHI ’21), Yokohama, Japan, 8–13 May 2021. [Google Scholar]
Figure 1. Crime scene area in the virtual immersive environment.
Figure 1. Crime scene area in the virtual immersive environment.
Applsci 14 07513 g001
Figure 2. Virtual molecular biology lab in the VR environment.
Figure 2. Virtual molecular biology lab in the VR environment.
Applsci 14 07513 g002
Figure 3. Evaluation sequence and procedure.
Figure 3. Evaluation sequence and procedure.
Applsci 14 07513 g003
Figure 4. VR module evaluation process at AAUP during a face-to-face session.
Figure 4. VR module evaluation process at AAUP during a face-to-face session.
Applsci 14 07513 g004
Table 1. Exploratory factor analysis.
Table 1. Exploratory factor analysis.
ItemFactor 1 *Factor 2
Q1. How would you rate the content of the scenario in terms of relevance and accuracy?−0.64−0.07
Q2. How would you rate the visual quality of the 3D objects in the scenario?−0.55−0.33
Q3. How would you rate the smoothness and realism of the animations in the scenario?−0.47−0.43
Q4. How would you rate the overall quality of the learning materials in the scenario?−0.59−0.16
Q5. How would you rate the clarity and readability of the texts in the scenario?−0.33−0.6
Q6. To what extent did your activities in the 3D virtual environment help you understand the presented topics?−0.670.29
Q7. Do you feel that this tool positively impacted your learning by helping you develop new transversal skills such as collaboration and problem-solving?−0.58−0.04
Q8. What is your overall impression of learning in a 3D virtual environment?−0.74−0.01
Q9. How would you rate your overall immersive learning experience in the virtual environment?−0.590.43
Q10. To what extent do you believe teacher’s presence is necessary when undertaking learning activities in a virtual environment?−0.23−0.11
Q11. Would you consider using a similar educational 3D Virtual Environment for future training?−0.530.33
Q12. How likely are you to recommend this learning approach to other students?−0.570.1
* Note: Loadings above 0.4 are considered significant.
Table 2. Confirmatory factor analysis.
Table 2. Confirmatory factor analysis.
ItemFactor 1 *Factor 2
Q1. How would you rate the content of the scenario in terms of relevance and accuracy?0.85-
Q2. How would you rate the visual quality of the 3D objects in the scenario?0.78-
Q3. How would you rate the smoothness and realism of the animations in the scenario?0.75-
Q4. How would you rate the overall quality of the learning materials in the scenario?0.8-
Q5. How would you rate the clarity and readability of the texts in the scenario?0.68-
Q6. To what extent did your activities in the 3D virtual environment help you understand the presented topics?0.85-
Q7. Do you feel that this tool positively impact-ed your learning by helping you develop new transversal skills such as collaboration and problem-solving?0.8-
Q8. What is your overall impression of learning in a 3D virtual environment?0.9-
Q9. How would you rate your overall immersive learning experience in the virtual environment?0.82-
Q10. To what extent do you believe teacher’s presence is necessary when undertaking learning activities in a virtual environment?-0.72
Q11. Would you consider using a similar educational 3D Virtual Environment for future training?-0.8
Q12. How likely are you to recommend this learning approach to other students?-0.85
* Note: Loadings above 0.4 are considered significant.
Table 3. Descriptive statistics for participant demographics and prior experience.
Table 3. Descriptive statistics for participant demographics and prior experience.
Group/CategoryFace-to-FaceOnline
nPercentnPercent
Gender
Males1460.871669.57
Females939.13730.43
Age group
18–20 years old834.781252.17
21–23 years old1252.17834.78
24 years old and above313.04313.04
Experience with computer-based games
No experience14.3500
Beginner28.700
Intermediate939.13313.04
Advanced834.781252.17
Expert313.04834.78
Experience with Virtual Reality
No experience28.700
Beginner521.741252.17
Intermediate1043.48417.39
Advanced521.74626.09
Expert14.3514.35
Table 4. Descriptive statistics for participant demographics and prior experience.
Table 4. Descriptive statistics for participant demographics and prior experience.
Group/CategoryFace-to-FaceOnline
MMedStd DevMinMaxMMedStd DevMinMax
Age group20.96211.97182420.65202.211824
Experience with computer-based games3.4330.99154.2240.6735
Experience with virtual 3D virtual environments2.9131152.8320.9825
Perceived Quality of the Virtual Environment3.353.450.85252.9530.8214
Adoption Perception2.52.670.67132.4330.6613
Table 5. Mean ratings for VR experience and adoption perception by instructional modality.
Table 5. Mean ratings for VR experience and adoption perception by instructional modality.
Face-to-FaceOnline
1.1 How would you rate of the content of the scenario?2.953.65
1.2 How would you rate the quality of the 3D objects?3.173.43
1.3 How would you rate the quality of the animations?3.213.21
1.4 How would you rate the quality of the learning material (in the scenario) in general?3.303.6
1.5 How would you rate the quality of the texts (in the scenario)?3.393.52
1.6 Did your activities in the virtual world help you comprehend the presented topics?2.733.39
1.7 Do you feel that this tool positively impacted your learning by helping you develop new transversal skills such as collaboration and problem-solving?2.392.56
1.8 What is your overall impression of having a class in TESLA virtual world?2.823.69
1.9 How interesting did you find your time in the virtual world?2.953.13
2.1 Is there a need of a real teacher to be present in the classroom when learning in the virtual world?2.432.47
2.2 Would you use a similar educational Virtual World in the future?2.342.43
2.3 Would you recommend this Virtual World to other students?2.522.6
Table 6. Analysis of background characteristics by instructional format.
Table 6. Analysis of background characteristics by instructional format.
Variableχ2 (Statistic)DFp
Gender0.09610.75
Age Group4.53320.6
Computer Game Experience9.07340.05
3D Virtual Environment Experience7.54540.11
Table 7. Comparison of perceived quality and learning effectiveness.
Table 7. Comparison of perceived quality and learning effectiveness.
VariableUZp
Q1. Content Relevance158.5−2.480.01 *
Q2. Visual Quality211.5−1.260.2
Q3. Animation Quality262−0.050.96
Q4. Material Quality198−1.640.1
Q5. Text Quality234.5−0.740.46
Q6. Topic Comprehension189.5−1.690.09
Q7. Transversal Skill Development225−0.980.32
Q8. Overall Impression165−2.330.02*
Q9. Interest Level243.5−0.50.62
Q10. Teacher Necessity244−0.50.61
Q11. Future Use252.5−0.280.77
Q12. Recommendation236.5−0.710.47
* p < 0.05.
Table 8. Associations between participant characteristics and perceptions toward the learning experience.
Table 8. Associations between participant characteristics and perceptions toward the learning experience.
AgeExp. GamesExp. 3D Env.Content Rel.Visual Qual.Anim. Real.Learn. Mat. Qual.Text Clar.Comp.Skill Dev.Imp.ExperienceTeacher Pres.Future UseRecommend
Age1
Experience with Games−0.211
Experience with 3D Environments−0.180.16
Content Realism0.020.53 **−0.111
Visual Quality−0.080.31 *0.070.31 *1
Animation Realism−0.050.12−0.070.36 *0.30 *1
Learning Material Quality0.060.260.220.33 *0.47 **0.39 **1
Text Clarity00.15−0.20.33 *0.33 *0.44 **0.261
Comprehension−0.130.33 *−0.090.46 **0.30 *0.210.30 *0.131
Transversal Skill Dev.0.130.25−0.150.32 *0.270.37 *0.20.230.41 **1
Impression0.050.30 *−0.170.56 **0.53 **0.31 *0.44 **0.20.45 **0.49 **1
Immersive Learning Experience−0.040.27−0.130.50 **0.180.060.29 *−0.030.56 **0.220.51 **1
Teacher Pres.0.31 *0−0.050.170.38 **−0.020.39 **0.160.070.270.280.111
Future Use0.210.19−0.040.30 *0.180.140.27−0.030.44 **0.33 *0.36 *0.41 **0.30 *1
Recommend−0.050.22−0.090.170.270.170.42 **0.170.47 **0.45 **0.39 **0.260.150.43 **1
* p < 0.05, ** p < 0.01.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ewais, A.; Mystakidis, S.; Khalilia, W.; Diab, S.; Christopoulos, A.; Khasib, S.; Yahya, B.; Hatzilygeroudis, I. Virtual Reality Immersive Simulations for a Forensic Molecular Biology Course—A Quantitative Comparative Study. Appl. Sci. 2024, 14, 7513. https://doi.org/10.3390/app14177513

AMA Style

Ewais A, Mystakidis S, Khalilia W, Diab S, Christopoulos A, Khasib S, Yahya B, Hatzilygeroudis I. Virtual Reality Immersive Simulations for a Forensic Molecular Biology Course—A Quantitative Comparative Study. Applied Sciences. 2024; 14(17):7513. https://doi.org/10.3390/app14177513

Chicago/Turabian Style

Ewais, Ahmed, Stylianos Mystakidis, Walid Khalilia, Shadi Diab, Athanasios Christopoulos, Said Khasib, Baha Yahya, and Ioannis Hatzilygeroudis. 2024. "Virtual Reality Immersive Simulations for a Forensic Molecular Biology Course—A Quantitative Comparative Study" Applied Sciences 14, no. 17: 7513. https://doi.org/10.3390/app14177513

APA Style

Ewais, A., Mystakidis, S., Khalilia, W., Diab, S., Christopoulos, A., Khasib, S., Yahya, B., & Hatzilygeroudis, I. (2024). Virtual Reality Immersive Simulations for a Forensic Molecular Biology Course—A Quantitative Comparative Study. Applied Sciences, 14(17), 7513. https://doi.org/10.3390/app14177513

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop