Next Article in Journal
Infodemic and Fake News Turning Shift for Media: Distrust among University Students
Next Article in Special Issue
Educational Breakout Based on Star Wars for Learning the History of Spanish Sign Language
Previous Article in Journal
Study on Reradiation Interference Characteristics of Steel Towers in Transmission Lines
Previous Article in Special Issue
Educational Digital Escape Rooms Footprint on Students’ Feelings: A Case Study within Aerospace Engineering
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Digital Educational Escape Room Analysis Using Learning Styles

by
Oriol Borrás-Gené
1,*,
Raquel Montes Díez
1 and
Almudena Macías-Guillén
2
1
Computer and Statistics Department, Rey Juan Carlos University, Campus of Móstoles Calle Tulipán s/n, 28933 Madrid, Spain
2
Business Economics Department, Rey Juan Carlos University, Campus of Vicalvaro, Paseo de los Artilleros s/n, 28032 Madrid, Spain
*
Author to whom correspondence should be addressed.
Information 2022, 13(11), 522; https://doi.org/10.3390/info13110522
Submission received: 15 September 2022 / Revised: 22 October 2022 / Accepted: 1 November 2022 / Published: 2 November 2022
(This article belongs to the Special Issue Artificial Intelligence and Games Science in Education)

Abstract

:
Teachers often need to adapt their teaching methodologies in order to overcome possible limitations and ensure that education does not lose quality in the face of different scenarios that may arise in the educational environment, which are not always the most desirable. Techniques such as the Educational Escape Room (ERE) in higher education, are taking a great increase due to its popularity among young people as a leisure activity. This study shows an educational research based on the application of a Digital Educational Escape Room (DEER) to respond to the limitations of hybrid teaching with students divided between the classroom and their homes. Through the analysis of a control group, with a traditional lecture class, and an experimental group with the use of a pretest and a posttest, with the addition of studying the different learning styles of the students in each group, interesting results and conclusions have been obtained that offer a replicability of this technique for other fields and educational modalities.

1. Introduction

The health emergency derived from COVID-19 [1] has led universities and teachers to explore new ways to adapt to the measures imposed by different governments. Safe teaching models have been chosen from the health point of view, but not always the most appropriate from the educational point of view. The Rey Juan Carlos University has implemented a hybrid teaching model which implies that the lecturer needs to be aware of both online students and face-to-face students at the same time [2].
In order to overcome the barrier imposed by distance or hybrid education and maintain the highest quality of teaching, teachers have opted for the use of different methodologies, ensuring that students understand, retain, transform, and apply the educational content received [3].
On the other hand, knowing the different learning styles is one of the fundamental pillars of “learning to learn” and is one of the ways that the student will have to potentially expand their ways of learning [4]. Each student learns in a different way, and knowing their learning preferences will help us achieve better results [5]
The objective of this research is to analyze a game-based learning experience using the Escape Room technique to work on students’ autonomous learning and explore students’ learning styles.
For the subject “Introduction to Business”, adapted to a hybrid model with two groups of students, one in the classroom and the other remotely from home, a Digital Educational Escape Room (DEER) was designed to try to break down the limits caused by this educational model forced by the health situation. Based on the division of groups proposed by the university, the students who attended in person were established as the control group, and those who attended remotely were established as the experimental group. The DEER was used in the experimental group to work on a new concept of the subject individually and autonomously for each student, while the control group followed a traditional method such as the master class.
This experience is based on the following research hypotheses:
Hypothesis 1.
Students attending in person exhibit better academic results than students attending remotely.
Hypothesis 2.
Attending in person or remotely differently affects students with different learning style preferences.
Section 2 reviews the scientific literature on Educational Escape Rooms, a hybrid teaching concept carried out for health reasons related to COVID-19. as Additionally, it reviews the learning styles proposed by Felder and Silverman, in order to obtain a brief understanding of its state of the art application. In Section 3, we describe the teaching experience in detail, from the design to the application of the DEER. The results are then presented in Section 4 through statistical analysis of the data obtained, considering other current work. Finally, in Section 5, the discussion and conclusions of the research are presented.

2. Literature Review

2.1. Learning Styles

Not all students perceive and process information in the same way, hence the importance of making a diagnosis regarding the preferred learning style of university students in a particular subject. The didactic intervention supported by the optimization of learning profiles and the use of visual environments have a positive impact on the integral formation of the individual [6].
The concept of learning style emerged with Gibson [5], who proposed that everyone has a different way or preference when learning, and when the information is presented according to their preferences, the result is better. Alonso et al., in 1997 [7] concluded that when students were taught with their predominant learning styles, they learned better.
It is generally accepted that combining an individual’s learning style with the appropriate form of an educational intervention significantly impacts student performance and their achievement of learning outcomes [8].
There are several studies in the literature that determine the different learning styles associated with different e-learning problems [9]. There is no consensus on the best method to determine the different learning styles, and some controversy exists in this regard, resulting in several tests to determine the different learning profiles. Ocepek et al. [10] in their study use four different learning style models to obtain four complementary views of students’ learning preferences and characteristics. Othman and Amiruddin [11] discuss the different styles and recommend the VARK learning style for their research. However, Jarvis [12] states in their research that Felder and Soloman’s style is the best instrument for determining learning styles, as it is the one that handles the greatest number of dimensions, which provides the maximum information for the teacher and the student about the way in which the student learns. The most current model is found in the studies of Richard M. Felder and Linda K. Silverman [13].
In 1987, Richard M. Felder and Linda K. Silverman formulated their model of learning styles, which was composed of five dimensions, and published in 1988 [13]. The original model was modified by Felder to have four dimensions: (1) Active/Reflective, according to the learner’s preference for processing information; (2) Sensing/Intuitive, according to the type of information perceived by the learner; (3) Visual/Verbal, according to the preferred sensory channel for perceiving information; (4) Sequential/Global, based on the way of processing learning. Later, the questionnaire of the model was programmed and validated by Richard M. Felder and Barbara A. Soloman [14]. The questionnaire is based on 44 questions with answers A and B as shown in Table A1 (Appendix A).

2.2. Hybrid Teaching

As a consequence of COVID-19 and the need to reduce the number of students in the classroom, the hybrid teaching model was introduced. This model is characterized by the fact that half of the students attend class in person as usual and the other half stream the class online [2,15]. This model is similar to “blended learning”, which has been applied for more than a decade in the classroom. “Blended-learning” is a format where part of the subject is taught in a traditional way and the remainder is carried out online through virtual classrooms, where the resources of the subject are found, exams are taken or activities are submitted [16,17]. This differs from the traditional scheduled lecture-exam modality used in most courses during the pandemic. This mixed modality (face-to-face/online) has been considered differently by several authors in recent years [18], in which students attended class in the classroom to have discussion sessions guided by the teacher, based on the content of the online course.

2.3. Escape Room in Higher Education

In recent years, a part of the research in teaching innovation has focused on the use of Escape Room (ER) games in educational settings due to the extensive opportunities this offers to support a learning process [19]. Although the first generation of ER focused on complicated logic puzzles [20], ERs have evolved into fully immersive environments, involving high-quality accessories and effects [21]. ERs represent a novel technique in teaching practice that can enhance conventional simulation approaches and provide a means for less traditional learning activities. They can also act as a low-cost, high-impact resource for a variety of learners when conducted effectively. Although they can be difficult to administer in practice, they have the potential to generate great benefits when used correctly [22]. Guckian et al. [23] highlight that this topic has been analyzed in literature to a considerable extent.
Educational Escape Rooms (EER) are immersive, engaging, dynamic, and activity-oriented online learning experiences that are developed due to their cost-effectiveness, accessibility, and practicality [24]. They possess numerous benefits; among others, they achieve engagement with a learning environment. Furthermore, interaction through collaboration helps learners develop social skills.
In their literature review, Veldkamp et al. [25] report that 51% of the EERs were conducted with the use of ICTs. According to this study, Digital Educational Escape Rooms (DEER) achieve different uses and objectives depending on the area of knowledge in which they are used, with medical disciplines and Science, Technology, Engineering and Mathematics (STEM) disciplines being the pioneers in this regard. Thus, in relation to the subject, Guckian, et al. [23] report in their study that the active acquisition of knowledge and a deeper understanding of new concepts were related to medicine, programming, biology, electronics, astronomy, mathematics, and engineering.
There are few publications referring to this type of teaching resource in the field of social sciences. Calle-Carracedo, et al. [26] analyze the use of a mixed methodological approach, combining EER with the use of ICTs. The participants’ conceptions, evaluations, and perspectives on their experience, implementation, and educational potential lead them to a very positive evaluation in aspects related to the setting, design, tests, time, etc., as well as the motivational potential to generate learning. In the field of business economics, Authors [27] analyze motivation and emotion through the Educational Escape Hall, combining the physical and digital Educational Escape Room.
Regarding business training, no literature on DEER has been found.

3. Materials and Methods

This section will present the design of a research based on the use of Digital Educational Escape Room (DEER) within the university context. The implementation was performed in the subject “Introduction to Business” of the first course in the Marketing Degree at the Rey Juan Carlos University during the 2020-21 academic year with a total of 56 students, with a hybrid rotating model imposed by the pandemic.

3.1. Research Design

The faculty team designed and implemented an experience with the aim of obtaining similar learning results in the two existing scenarios, with a remote turn and a face-to-face turn in the classroom. For this purpose, the Escape Room technique was chosen, in which the team already had experience [27], although in this case, it was applied as a strategy to review content already studied.
The Escape Room designed for this experience was completely digital and online, and was used for remote students to learn new content on the subject. The lesson was based on the market-to-book ratio (what it is, how useful it is, how it is calculated in different circumstances, and how to interpret its value). This lesson was designed to be worked on in a single class session.
The organization of the turns was imposed by the university and was randomized. The control group was formed by students in the classroom, applying a traditional face-to-face class to explain the lesson, contents were transmitted through a presentation and without any additional artifice. The experimental group was formed by the students online for which the DEER was applied.
In order to better understand the students’ characteristics, on the first day of class, they filled out an anonymous online questionnaire on learning styles based on the Felder and Silverman model [13]. To analyze the experience, a pretest and posttest were designed as an element to measure the learning and knowledge acquisition of both groups [28,29,30].
The same test was presented to both groups at the beginning of the session and at the end of the session to identify what new knowledge they had acquired with respect to the knowledge they already had. All the tests were configured so that no feedback would appear at the end of the students’ attempts, thus avoiding the transmission of information between them during the experience.
The test included eight randomly displayed questions with four possible answers (only one correct answer) and with the incorrect answers subtracting 25% of the total test grade. The questions were organized into three categories according to their difficulty:
  • “Basic competencies” (questions 1 and 2). They could be answered without knowing the content of the lesson and just by applying common sense. They are used to check whether students were answering randomly or taking the test seriously.
  • “Specific competencies” (questions 3, 4, and 5). They were related to the minimum competencies that the students were required to achieve in the subject for that lesson;
  • “Advanced competencies” (questions 6, 7, and 8). They involved a greater cognitive process and a deeper assimilation of the content of the lesson.
The total experience lasted one hour and thirty minutes, dedicating one hour to work on the content (traditional face-to-face class or educational escape room, depending on the group of students). Then, the pretest and posttest took another 15 min each. The diagram in Figure 1 summarizes the proposed research design.
The following subsection will develop the design of the DEER applied to the experimental group.

3.2. Digital Educational Escape Room

For the experimental group, a Digital Educational Escape Room (DEER) was designed with a 100% digital environment, and a clear effort for the acquisition of learning in an autonomous way by the student, without any physical elements
Figure 2 shows the design of the DEER and the different technologies used. One of the objectives of this design was to make the process as simple as possible for the students, so that they would not lose time in understanding its operation and would focus on the subject knowledge to be acquired, concentrating the whole activity in the same digital space. The university’s Learning Management System (LMS), based on Moodle, was used, and the rest of the web resources that formed part of the DEER were embedded through HTML code.
The Moodle resource “Lesson” was used to create the main DEER site and include all the necessary resources within it. The objective of the experience was that the students discover by themselves the contents to be transmitted, through the DEER activities (theoretical materials and puzzles).
First, a narrative was defined to place the student at the center of the action, involving him/her in the activity and following the different learning objectives of the session. Coinciding with those in the control group, a script was developed containing the contents and a series of activities were designed to help understand them. In the story, the objective of the student, who had become an intern at a company, consisted of solving a series of tasks entrusted by his boss to escape from the office and return home.
The digital contents were associated with the subject matter of the theoretical session and in the form of various activities. They were generated using different technologies and were embedded in the lesson within Moodle:
  • Using the interactive platform Genially, two activities were created based on conversational games with various options that the student should choose correctly to be guided to the end of each activity and so to achieve each learning objective (Figure 3). Within these games was the theoretical content.
  • Using the YouTube streaming platform, videos were created with information of interest for the students: a video of the escape room presentation and instructions and another video embedded in one of the Genially activities (Figure 3 right). Both videos were dramatized with actors.
  • Other technologies, such as QR codes, digital puzzles, simulated websites, and digital locks, were also used.
  • Inside the Moodle lesson, numerical questions were created with a single correct value that students had to answer correctly to advance.
  • To implement both tests, the “Exam” tool of the University’s Moodle platform was used.
Finally, the MS Teams channel of the course was used for communication with the student during the DEER (Figure 2) in case of possible technical problems. A teacher, external to the course, was connected during the entire session for incident resolution.

3.3. Learning Styles

In order to assess learning styles to each student, we employed Felder and Soloman questionnaire [14], a methodology that is currently used in other research [31,32]. The questionnaire consists of 44 questions with dichotomous answers (“a” or “b”), and considers four scales, one for each dimension of the Felder-Silverman model [13]: (1) Active-Reflective (how information is processed); (2) Sensing-Intuitive (type of information best perceived); (3) Visual-Verbal (how sensory information is perceived); and (4) Sequential-Global (progress towards comprehension of information). Each scale consists of 11 randomly distributed questions. The score for each one of them is obtained by counting the number of responses “a” and the number of responses “b”, then subtracting the smaller number from the larger one, and the predominant letter is added to the resulting number. The answers with letter “a” correspond to the first pole of each of the four scales, while the answers with letter “b” correspond to the second extreme. A score of 1 to 3 indicates a balance between the two dimensions of the scale and therefore, the student can learn with teaching methods that favor both basic dimensions. A score of 5 to 7 indicates a moderate preference for one dimension of the scale, suggesting that a student learns more easily with teaching methods that favor that dimension. A score of 9 to 11 indicates a strong preference for one dimension of the scale and, according to Felder and Soloman [14], such a student will find it more difficult to learn under teaching methods that do not support that dimension. Thus, after applying this method, students are classified in a 1–5 scale for each one of the four mentioned dimensions. For instance, for the Active-Reflective dimension, scale may take values:
  • Strong preference for active learning
  • Moderate preference for active learning
  • Balance between active and reflective
  • Moderate preference for reflective learning
  • Strong preference for reflective learning and in a similarly for other three dimensions

4. Statistical Analysis

In this section we present the statistical analysis developed using the statistical software R. We define the learning results, our variable of interest, as the difference between the numerical results obtained in the posttest and the pretest. Our data contains 55 observations, corresponding to the students that complete the learning styles questionnaire and the pretest and posttest successfully, for which we observed (Table 1, Table 2, Table 3, Table 4 and Table 5).

4.1. Control/Experimental Groups Effect

Following Section 1, we are interested in testing the hypothesis:
Hypothesis 1.
Students attending in person exhibit better academic results than students attending remotely.
According to the standard theory of hypothesis testing, we enunciate our test using a null and an alternative hypothesis, where the null hypothesis is the claim that there is no effect on the population, and the alternative hypothesis (Ha) describes our research question, therefore it claims that there is an effect. Therefore, we enunciate the null and alternative hypotheses as:
  • H1: On average, the learning results are the same for students attending in person and students attending remotely.
The null hypothesis states that the Control Group (students attending in person) and the Experimental Group (students attending remotely) are identical populations regarding the learning results acquired during the academic term. The Welch Two Sample t-test evaluate the difference of learning results by Grupo (mean in Control group = 4.22, mean in Experimental group = 3.94), suggesting that the effect is positive, statistically not significant, and very small (difference = 0.27, 95% CI [−0.72, 1.26], t(49.91) = 0.55, p = 0.582). As the p-value turns out to be 0.582, and is less than the 0.05 significance level, we reject the null hypothesis. Therefore at 0.05 significance level, we cannot conclude that there are significant differences between Control Group and the Experimental Group.
It would be of interest to consider not just the group in which the students have developed their learning during the term, but also the learning style that students prefer. In other words, we are interested in evaluating our second hypothesis.
Hypothesis 2.
Attending in person or remotely has different effects on students with different learning style preferences.
Therefore, we are interested in employing the information provided by the survivor presented in Section 2.1. Hence, we consider four other factor variables regarding the learning styles, namely: Active/Reflexive, Sensing/Intuitive, Visual/Verbal, and Sequential/Global.
Note that here, we are not just interested in analyzing the impact that each of these factors may have had on the development of learning, but we are especially interested in the interaction that these factors may have with the type of teaching, that is, whether preferring a particular type of learning affects the fact that belonging to the Experimental or Control group has affected the learning results.
In the following subsections, we present descriptive statistics and perform two-way analysis of variance for each one of the categorical variables describing the learning preferences of students.

4.2. Active/Reflexive Factor

In this section we consider the factor describing whether the students prefer a more active of more reflexive type of learning. Students have been classified in 5 levels from 1 to 5 (1 indicating more active and 5 more reflexive preference) using their responses to the Felder and Soloman questionnaire [14]. Note that our students belong to only three of the five levels, namely 3 (n = 38, 69.09%), 4 (n = 16, 29.09%) and 5 (n = 1, 1.82%).

4.2.1. Descriptive Statistics for Control/Experimental Group and Active/Reflexive

Table 6 and Figure 4 show descriptive statistics for learning results for the different levels (3 and 4) of the Active/Reflexive factor and the Control and Experimental groups.
Note that both graphical and numerical summaries of learning results do not show big difference for students at level 3 or 4 of Active/Reflexive factor. Nowadays, in the following section, we test whether these differences are or not statistically significant. also It is also notable that level 5 is not considered here. Since there is only one student at that level, this does not allow us to test the differences with the other two levels.

4.2.2. Two-Way Analysis of Variance for Control/Experimental Group and Active/Reflexive

The two-way analysis of variance (two-way ANOVA) is a statistical procedure to examine the influence of two different categorical independent variables on one continuous dependent variable. The two-way ANOVA can evaluate not only the main effect of each independent variable but also the potential interaction between them. Here, we can test whether the different levels of the Active/Reflexive Factor and the Control/Experimental group are related to the variable of interest, in this case, the result of learning. By making the correct hypothesis, we can test two main effects and one interaction effect. Here we state the corresponding null hypothesis:
  • H2.1: On average, the learning results are the same for different Active/Reflexive levels.
  • H2.2: On average, the learning results are the same for Control/Experimental Groups.
  • H2.3: On average, the learning results for Control/Experimental groups does not depend on the different Active/Reflexive levels (this is there is not interaction effect between them).
The ANOVA suggests that:
  • The main effect of Control/Experimental Groups is statistically not significant and is very small (F(1, 50) = 0.30, p = 0.588).
  • The main effect of Active/Reflexive is statistically not significant and is small (F(2, 50) = 0.26, p = 0.773).
  • The interaction between Control/Experimental Groups and Active/Reflexive is statistically not significant and is small (F(1, 50) = 2.59, p =0.114).

4.3. Sensing/Intuitive and Visual/Verbal Factors

Next, we replicate the statistical procedure described in Section 4.1 for the Active/Reflexive factor for the rest of the qualitative variables describing learning style preferences of students. In particular, for Sensorial/Intuitive and Visual/Verbal factors, results are similar to those obtained in the previous section for the Active/Reflexive factor, concluding therefore that there are not significant differences between the learning results of students with different style learning preferences, and that these preferences have no interaction with the Control or Experimental group they experimented.

4.4. Sequential/Global Factor

In this section, we analyze whether the different levels of the Sequential/Global Factor and the Learning environment group are related to the variable of interest, the result of learning. By making the correct hypothesis, we can test two main effects and one interaction effect.

4.4.1. Descriptive Statistics for Control/Experimental Group and Sequential/Global

Table 7 and Figure 5 show descriptive statistics of the variable of interest (learning results) corresponding to the Sequential/Global factor and the Control and Experimental groups.
Note that here, Table 2 and Figure 4 show how learning results seem to be higher in the experimental group than in the control group for students with a level 4 (means 2.29 and 3.75 for Control and Experimental respectively) but lower for students with a level 3 (means 4.83 and 3.89 for Control and Experimental respectively) in the Sequential/Global variable. In order to test whether these differences are significant, we need to employ the ANOVA test as in the previous sections.

4.4.2. Two-Way Analysis of Variance for Control/Experimental Group and Sequential/Global

Once more, we test the following hypothesis:
  • H2.1: On average, the learning results are the same for different Sequential/Global levels.
  • H2.2: On average, the learning results are the same for Control/Experimental Groups.
  • H2.3: On average, the learning results for Control/Experimental groups do not depend on the different Sequential/Global levels (meaning there is not interaction effect between them).
Proceeding as in the previous sections, the ANOVA suggests that:
  • The main effect of Control/Experimental Groups is statistically not significant and very small (F(1,50) = 0.36, p = 0.553).
  • The main effect of Sequential/Global Factor is statistically significant and large (F(2,50) = 4.37, p = 0.018).
  • The interaction between Control/Experimental Groups and Sequential/Global is statistically significant and medium (F(1,50) = 5.22, p =0.027).
Note that a significant interaction between the factors in this analysis show that a preference for a Sequential/Global learning style affects the impact that belonging to the Control/Experimental group may affect the students performing on the subject.
Although these results should be taken with caution given the size of the sample, they undoubtedly leave an open door to consider the type of learning that students prefer when expecting learning based on a virtual escape room.

5. Discussion

Previous literature explores and reviews the existing relationship between learning styles and game-based learning experiences [33,34]. According to Khenissi et al. [35], the use of computer games for learning also has the potential to negatively affect the learning experience if the characteristics of individual learners are not considered. The research presented in this paper aims to test whether students who learn completely new concepts through the DEER technique, autonomously online, learn less than if they had received the explanations of their teacher, in the traditional face-to-face classroom. Furthermore, we are interested in testing whether that possible effect may also be related with the learning style preference of the students.
Jarvis’ research [12] validates the Felder and Soloman style, concluding that it is the best instrument for determining learning styles, as it is the one that handles the greatest number of dimensions, which provide the maximum information to the teacher and the student about the way in which the student learns. For this reason, in our teaching research we have used the most current model, as described in the studies of Richard M. Felder and Linda K. Silverman [13].
Hwang et al. [36], in their study of developing a personalized educational computer game based on students’ learning styles, concluded that game-based learning through ICT resources can be significantly promoted if learning styles are considered. Moreover, from the point of view of learning outcomes, the methodology used enabled individual students in the experimental group to learn in a way that matched their styles of information perception and processing, so that their learning achievements were significantly better than students in the control group.
The new requirements due to the COVID-19 health crisis have meant that the entire educational community has had to make an effort to adapt to the circumstances existing at that time. This has required new hybrid formats to comply with the standards imposed by the health authorities and the teaching staff has been under the pressure to find solutions that respond to this challenge. With the aim of overcoming the limitations of having half of the students at home following the class from a screen, we designed a DEER that has led them to learn a new concept: the market-to-book ratio. In addition, considering the different learning styles proposed by Felder and Silverman [13], we have been able to analyze the degree of learning according to these styles.
Previous studies, which conducted DEER showed a significant relationship between improved motivational outcomes, positive behaviors, which significantly influenced students’ engagement [37,38,39,40].
In this area, a recent study analyzed the scientific research on Educational Escape Room and concluded that adopting this type of technique can generate learning benefits for students. However, regarding research on the use of DEERs, being a novel topic, they concluded that there is “fertile ground for future research” and “since no scientific evidence was found on DEER learning outcomes in educational settings, it is crucial to analyze the effects of escape rooms in digital educational environments and harmonize them with learning objectives” [22]. In 2017 Eukel et al. [41] conducted a cross-sectional pre- and post-test investigation to assess performance in a sample of 74 players. These obtained an 81% average score in a posttest, which was considerably higher than the 56% obtained in the mean test. It is noteworthy that between the two, seven days elapsed between the pre-test and the DEER. This was the determining factor for designing the DEER presented in this work and thus observing whether this technique could be used to learn completely new knowledge immediately, with no time between pretest and posttest.
In social sciences, Manzano-León et al. [42] conducted an experience using DEER resources during the COVID-19 confinement. In their research, they conclude that online escape rooms can be motivating active learning strategies for students and propose as future lines of research to study their impact on students’ academic performance. Additionally, in this field, Calle-Carracedo et al. [26] examine a blended escape room methodological approach, combining traditional EER and DEER, with master’s degree students in teacher education, and analyze the participants’ conceptions, assessments, and perspectives on their experience of implementation and on the educational potential of blended ER.
In line with this research prior to ours, there is a growing interest in the literature in DEER as a didactic resource for increasing motivation and learning, which analyses the results of educational research related to this type of didactic experience, both at the level of motivation, which is so necessary today, and at the level of learning, in order to measure to what extent this technique can be a useful tool associated with learning styles.

6. Conclusions

One of the objectives of this research was to test whether students who learn completely new concepts through the DEER technique, remotely, even if it is synchronously, learn less than if they had received explanations from their teacher in the traditional face-to-face classroom setting (H1). We have observed that there are no significant differences in the learning results in the two groups analyzed, which allow us to affirm that, as long as an adequate design is elaborated and guided by an expert, the use of the DEER technique has not been an obstacle for learning new contents. These results justify the effectiveness of DEER as a teaching resource, and allow extrapolation to different remote teaching scenarios, such as e-learning. Additionally, this may prove to be an opportunity to create DEER materials adapted for use when digitization becomes necessary.
Moreover, by testing our second hypothesis (H2), we were interested in considering different learning styles, in order to test whether these could have and interaction with the teaching methodology applied. In other words, we are interested in testing whether conclusions to the to the first hypothesis may change when considering students with different learning style preferences. Regarding the first three learning styles analyzed, no significant differences between the experimental group (DEER) and the control group (traditional face-to-face classroom) have been observed. However, significant differences have been identified for the Sequential/Global style, between the two groups. Although the sample size used for this project is not very large and we must be cautious with this result, this leads us to the conclusion that there is a field of research in this direction. We believe that an analysis with a larger sample, based on the results obtained, could lead to very interesting consequences in the field of game-based learning under the DEER technique, or other fully online teaching techniques, considering information regarding students learning styles. Knowing in detail which learning styles are more suitable could help to set up groups of students with a higher learning efficiency and to design sessions adapted to them.
Future work includes studies with a larger sample of students repeating the experience to adapt the DEER to the different learning styles, as well as the use of other methodologies, such as expository class, debate, exposition of results, conceptual maps, etc. The objective is to achieve an adapted teaching that considers the heterogeneity of the students and to favor the plurality of learning styles in the achievement of key competences of each subject.

Author Contributions

Conceptualization, A.M.-G. and O.B.-G.; methodology, O.B.-G.; validation, R.M.D., O.B.-G. and A.M.-G.; formal analysis, R.M.D.; investigation, O.B.-G. and A.M.-G.; resources, A.M.-G.; data curation, R.M.D.; writing—original draft preparation, A.M.-G., O.B.-G. and R.M.D.; writing—review and editing, A.M.-G., O.B.-G. and R.M.D.; supervision, A.M.-G. and O.B.-G.; funding acquisition, O.B.-G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Madrid Regional Government, through the project e-Madrid-CM, under Grant P2018/TCS-4307, and in part by the Structural Funds (FSE and FEDER).

Data Availability Statement

All datasets are available and can be requested from the author.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Felder & Soloman [14] Questionnaire programmed from Felder & Siverman’s Learning Styles Model [13].
Table A1. Felder & Soloman [14] Questionnaire programmed from Felder & Siverman’s Learning Styles Model [13].
1. I understand something better after I
a. try it out.
b. think it through.
23. When I get directions to a new place, I prefer
a. a map.
b. written instructions.
2. I would rather be considered
a. realistic.
b. innovative.
24. I learn
a. at a fairly regular pace. If I study hard, I’ll “get it”.
b. in fits and starts. I’ll be totally confused and then suddenly it all “clicks”.
3. When I think about what I did yesterday, I am most likely to geta.
a picture.
b. words.
25. I would rather first
a. try things out.
b. think about how I’m going to do it
4. I tend to
a. understand details of a subject but may be fuzzy about its overall structure.
b. understand the overall structure but may be fuzzy about the details.
26. When I am reading for enjoyment, I like writers to
a. clearly say what they mean.
b. say things in creative, interesting ways.
5. When I am learning something new, it helps me to
a. talk about it.
b. think about it.
27. When I see a diagram or sketch in class, I am most likely to remember
a. the picture.
b. what the instructor said about it
6. If I were a teacher, I would rather teach a course
a. that deals with facts and real life situations.
b. that deals with ideas and theorie
28. When considering a body of information, I am more likely to
a. focus on details and miss the big picture.
b. try to understand the big picture before getting into the details.
7. I prefer to get new information in
a. pictures, diagrams, graphs, or maps.
b. written directions of verbal information.
29. I more easily remember
a. something I have done.
b. something I have thought a lot about.
8. Once I understand
a. all the parts, I understand the whole thing.
b. the whole thing, I see how the parts fit.
30. When I have to perform a task, I prefer to
a. master one way of doing it.
b. come up with new ways of doing it.
9. In a study group working on difficult material, I am more likely to
a. Jump in and contribute ideas.
b. The whole thing, I see how the parts fit.
31. When someone is showing me data, I prefer
a. charts or graphs.
b. text summarizing the results
10. I find it easier
a. to learn facts.
b. to learn concepts.
32. When writing a paper, I am more likely to
a. work on (think about or write) the beginning of the paper and progress forward.
b. work on (think about or write) different parts of the paper and then order them.
11. In a book with lots of pictures and charts, I am likely to
a. look over the pictures and charts carefully.
b. focus on the written text.
33. When I have to work on a group project, I first want to
a. have “group brainstorming” where everyone contributes ideas.
b. brainstorm individually and then come together as a group to compare ideas
12. When I solve math problems
a. I usually work my way to the solutions one step at a time.
b. I often just see the solutions but then have to struggle to figure out the steps to getto them.
34. I consider it high praise to call someone
a. Sensible
.b. imaginative.
13. In classes I have taken
a. I have usually gotten to know many of the students.
b. I have rarely gotten to know many of the students.
35. When I meet people at a party, I am more likely to remember
a. what they looked like.
b. what they said about themselves.
14. In reading nonfiction, I prefer
a. something that teaches me new facts or tells me how to do something.
b. something that gives me new ideas to think about.
36. When I am learning a new subject, I prefer to
a. stay focused on that subject, learning as much about it as I can.
b. try to make connections between that subject and related subjects.
15. I like teachers
a. who put a lot of diagrams on the board.
b. who spend a lot of time explaining.
37. I am more likely to be considered
a. outgoing.
b. reserved.
16. When I’m analyzing a story or a novel
a. I think of the incidents and try to put them together to figure out the themes.
b. I know just what the themes are when I finish reading and then I have to go backand find the incidents that demonstrate them.
38. I prefer courses that emphasize
a. concrete material (facts, data).
b. abstract material (concepts, theories).
17. When I start a homework problem, I am more likely to
a. start working on the solution immediately.
b. try to fully understand the problem first
39. For entertainment, I would rather
a. watch television.
b. read a book.
18. I prefer the idea of
a. certainty.
b. theory.
40. Some teachers start their lectures with an outline of what they will cover. Such outlines are
a. somewhat helpful to me.
b. very helpful to me.
19. I remember best
a. what I see.
b. what I hear.
41. The idea of doing homework in groups, with one grade for the entire group
a. appeals to me.
b. does not appeal to me.
20. It is more important to me that an instructor
a. lay out the material in clear sequential steps.
b. give me an overall picture and relate the material to other subjects.
42. When I am doing long calculations,
a. I tend to repeat all my steps and check my work carefully.
b. I find checking my work tiresome and have to force myself to do it.
21. I prefer to study in
a. study group
b. alone.
43. I tend to picture places I have been
a. easily and fairly accurately.
b. with difficulty and without much detail.
22. I am more likely to be considered
a. careful about the details of my work.
b. creative about how to do my work.
44. When solving problems in a group, I would be more likely to
a. think of the steps in the solution process.
b. think of possible consequences or application of the solution in a wide range of areas.

References

  1. Del Estado, J. Real Decreto-ley 21/2020, de 9 de junio, de medidas urgentes de prevención, contención y coordinación para hacer frente a la crisis sanitaria ocasionada por el COVID-19. BOE 2020, 163, 38723–38752. [Google Scholar]
  2. García-Peñalvo, F.J.; Corell, A. La COVID-19: ¿Enzima de la transformación digital de la docencia o reflejo de una crisis metodológica y competencial en la educación superior? Campus Virtuales 2020, 9, 83–98. [Google Scholar]
  3. Martín-Cuadrado, A.M.; Lavandera-Ponce, S.; Mora-Jaureguialde, B.; Sánchez-Romero, C.; Pérez-Sánchez, L. Working methodology with public universities in Peru during the pandemic—Continuity of virtual/online teaching and learning. Educ. Sci. 2021, 11, 351. [Google Scholar] [CrossRef]
  4. Tocci, A.M. Caracterización de perfiles de estilos de aprendizaje en alumnos de Ingeniería según el modelo de Felder y Silverman. Rev. Estilos Aprendiz. 2015, 8, 101–118. [Google Scholar] [CrossRef]
  5. Gibson, E.J. Principles of Perceptual Learning and Development; Appleton-Century-Crofts: Norwalk, CT, USA, 1969. [Google Scholar]
  6. Carracedo, M.D.C.R.; Carro, E.V. Fortalecer estilos de aprendizaje para aprender a aprender. Rev. Estilos Aprendiz. 2013, 6, 19–37. [Google Scholar] [CrossRef]
  7. Alonso, C.M.; Gallego, D.J.; Honey, P. Los Estilos de Aprendizaje: Procedimientos de Diagnóstico y Mejora; Mensajero: Bilbao, España, 1997. [Google Scholar]
  8. Gurpinar, E.; Alimoglu, M.K.; Mamakli, S.; Aktekin, M. Can learning style predict student satisfaction with different instruction methods and academic achievement in medical education? Adv. Physiol. Educ. 2010, 34, 192–196. [Google Scholar] [CrossRef]
  9. Khamparia, A.; Pandey, B. Association of learning styles with different e-learning problems: A systematic review and classification. Educ. Inf. Technol. 2020, 25, 1303–1331. [Google Scholar] [CrossRef]
  10. Ocepek, U.; Bosnić, Z.; Šerbec, I.N.; Rugelj, J. Exploring the relationship between learning style models and preferred multimedia types. Comput. Educ. 2013, 69, 343–355. [Google Scholar] [CrossRef]
  11. Othman, N.; Amiruddin, M.H. Different perspectives of learning styles from VARK model. Procedia-Soc. Behav. Sci. 2010, 7, 652–660. [Google Scholar] [CrossRef]
  12. Jarvis, M. The Psychology of Effective Learning and Teaching; Nelson Thornes: Cheltenham, UK, 2005. [Google Scholar]
  13. Felder, R.M.; Silverman, L.K. Learning and teaching styles in engineering education. Eng. Educ. 1988, 78, 674–681. [Google Scholar]
  14. Felder, F.M.; Soloman, B.A. Index of Learning Styles. North Carolina State University. 1999. Available online: www.ncsu.edu/effective_teaching/ILSdir/ILS-a.htm (accessed on 1 September 2022).
  15. García-Peñalvo, F.J. Reference model for virtual education at face-to-face universities. Campus Virtuales 2020, 9, 41–56. [Google Scholar]
  16. Longoria, J.F. La Educación en Línea. México. Colección Material Didáctico; Universidad Autónoma del Carmen: Campeche, México, 2005; pp. 11–12. [Google Scholar]
  17. Rao, V. Blended Learning: A New Hybrid Teaching Methodology. J. Res. Sch. Prof. Engl. Lang. Teach. 2019, 3, 1–6. [Google Scholar]
  18. Wang, L.; Huang, Y.; Omar, M. Analysis of Blended Learning Model Application Using Text Mining Method. Int. J. Emerg. Technol. Learn. 2021, 16, 172–187. Available online: https://www.learntechlib.org/p/218650/ (accessed on 1 September 2022). [CrossRef]
  19. Grande-de-Prado, M.; García-Martín, S.; Baelo, R.; Abella-García, V. Edu-Escape Rooms. Encyclopedia 2021, 1, 12–19. [Google Scholar] [CrossRef]
  20. Nicholson, S. Peeking behind the Locked Door: A Survey of Escape Room Facilities. 2015. Available online: https://scottnicholson.com/pubs/erfacwhite.pdf (accessed on 28 July 2022).
  21. Clarke, S.; Peel, D.J.; Arnab, S.; Morini, L.; Keegan, H.; Wood, O. EscapED: A framework for creating educational escape rooms and Interactive Games For Higher/Further Education. Int. J. Serious Games 2017, 4, 73–86. [Google Scholar] [CrossRef]
  22. Makri, A.; Vlachopoulos, D.; Martina, R.A. Digital Escape Rooms as Innovative Pedagogical Tools in Education: A Systematic Literature Review. Sustainability 2019, 13, 4587. [Google Scholar] [CrossRef]
  23. Guckian, J.; Eveson, L.; May, H. The great escape? The rise of the escape room in medical education. Future Healthc. J. 2020, 7, 112. [Google Scholar] [CrossRef]
  24. Ang, J.W.J.; Ng, Y.N.A.; Liew, R.S. Physical and digital educational escape room for teaching chemical bonding. J. Chem. Educ. 2020, 97, 2849–2856. [Google Scholar] [CrossRef]
  25. Veldkamp, A.; Van de Grint, L.; Knippels, M.C.P.; Van Joolingen, W.R. Escape education: A systematic review on escape rooms in education. Educ. Res. Rev. 2020, 31, 100364. [Google Scholar] [CrossRef]
  26. Calle-Carracedo, M.; López-Torres, E.; Miguel-Revilla, D.; Carril-Merino, M.T. Escape rooms en la formación inicial del profesorado de Ciencias Sociales: Valoración y potencial educativo. Educ. XX1 2022, 25, 129–150. [Google Scholar] [CrossRef]
  27. Macías-Guillén, A.; Díez, R.M.; Serrano-Luján, L.; Borrás-Gené, O. Educational Hall Escape: Increasing Motivation and Raising Emotions in Higher Education Students. Educ. Sci. 2021, 11, 527. [Google Scholar] [CrossRef]
  28. Allen, M. The SAGE Encyclopedia of Communication Research Methods; SAGE Publications: New York City, NY, USA, 2017. [Google Scholar] [CrossRef]
  29. Dimitrov, D.M.; Rumrill, P.D., Jr. Pretest-posttest designs and measurement of change. Work 2003, 20, 159–165. [Google Scholar] [PubMed]
  30. Moore, L.; Campbell, N. Effectiveness of an escape room for undergraduate interprofessional learning: A mixed methods single group pre-post evaluation. BMC Med. Educ. 2021, 21, 220. [Google Scholar] [CrossRef]
  31. Brito-Orta, M.; Espinoza-Tanguma, R. Evaluation of the Reliability of Felder and Soloman’s Learning Styles Questionnaire in Medical Students. Investig. En Educ. Méd. 2015, 4, 28–35. Available online: http://www.riem.facmed.unam.mx/index.php/riem/article/view/318 (accessed on 16 August 2022).
  32. Marcos Salas, B.; Alarcón Martínez, V.; Serrano Amarilla, N.; Cuetos Revuelta, M.J.; Manzanal Martínez, A.I. Application of learning styles according to Felder and Silverman’s model for the development of key competencies in teaching practice. Tend. Pedagóg. 2020, 37, 104–120. [Google Scholar] [CrossRef]
  33. Buckley, P.; Doyle, E. Individualising gamification: An investigation of the impact of learning styles and personality traits on the efficacy of gamification using a prediction market. Comput. Educ. 2017, 106, 43–55. [Google Scholar] [CrossRef]
  34. Becker, K. Games and Learning Styles. Presented at the IASTED International Conference on Education and Technology, Calgary, Alberta, Canada. 2005. Available online: http://mruir.mtroyal.ca/xmlui/handle/1880/46706 (accessed on 1 August 2022).
  35. Khenissi, M.A.; Essalmi, F.; Jemni, M.; Graf, S.; Chen, N.S. Relationship between learning styles and genres of games. Comput. Educ. 2016, 101, 1–14. [Google Scholar] [CrossRef]
  36. Hwang, G.J.; Sung, H.Y.; Hung, C.M.; Huang, I.; Tsai, C.C. Development of a personalized educational computer game based on students’ learning styles. Educ. Technol. Res. Dev. 2012, 60, 623–638. [Google Scholar] [CrossRef]
  37. Bassford, M.L.; Crisp, A.; O’Sullivan, A.; Bacon, J.; Fowler, M. CrashEd–A live immersive, learning experience embedding STEM subjects in a realistic, interactive crime scene. Res. Learn. Technol. 2016, 24, 30089. [Google Scholar] [CrossRef] [Green Version]
  38. López-Pernas, S.; Gordillo, A.; Barra, E.; Quemada, J. Examining the use of an educational escape room for teaching programming in a higher education setting. IEEE Access 2019, 7, 31723–31737. [Google Scholar] [CrossRef]
  39. Mystakidis, S.; Cachafeiro, E.; Hatzilygeroudis, I. Enter the serious E-scape room: A cost-effective serious game model for deep and meaningful E-learning. In Proceedings of the 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA), Patras, Greece, 15–17 July 2019; pp. 1–6. [Google Scholar] [CrossRef]
  40. Neumann, K.L.; Alvarado-Albertorio, F.; Ramírez-Salgado, A. Online approaches for implementing a digital escape room with preservice teachers. J. Technol. Teach. Educ. 2020, 28, 415–424. Available online: https://www.learntechlib.org/primary/p/216209/ (accessed on 10 August 2022).
  41. Eukel, H.N.; Frenzel, J.E.; Cernusca, D. Educational gaming for pharmacy students–design and evaluation of a diabetes-themed escape room. Am. J. Pharm. Educ. 2017, 81, 6265. [Google Scholar] [CrossRef] [PubMed]
  42. Manzano-León, A.; Aguilar-Parra, J.M.; Rodríguez-Ferrer, J.M.; Trigueros, R.; Collado-Soler, R.; Méndez-Aguado, C.; García-Hernández, M.J.; Molina-Alonso, L. Online Escape Room during COVID-19: A Qualitative Study of Social Education Degree Students’ Experiences. Educ. Sci. 2021, 11, 426. [Google Scholar] [CrossRef]
Figure 1. Research design. Source: Own elaboration.
Figure 1. Research design. Source: Own elaboration.
Information 13 00522 g001
Figure 2. Digital Educational Escape Room (DEER). Source: Own elaboration.
Figure 2. Digital Educational Escape Room (DEER). Source: Own elaboration.
Information 13 00522 g002
Figure 3. Examples of content with Genially. Source: Own elaboration.
Figure 3. Examples of content with Genially. Source: Own elaboration.
Information 13 00522 g003
Figure 4. Boxplots relating Learning Results for the Control/Experimental and Active/Reflexive groups of students.
Figure 4. Boxplots relating Learning Results for the Control/Experimental and Active/Reflexive groups of students.
Information 13 00522 g004
Figure 5. Boxplots relating Learning Results for the Control/Experimental and Sequential/Global groups of students.
Figure 5. Boxplots relating Learning Results for the Control/Experimental and Sequential/Global groups of students.
Information 13 00522 g005
Table 1. Numerical summaries of learning results: sample size (n), mean (m) and standard deviation (sd) for Control and Experimental groups.
Table 1. Numerical summaries of learning results: sample size (n), mean (m) and standard deviation (sd) for Control and Experimental groups.
Numerical
Summary
Groupnmsd
Control294.222.14
Experimental263.941.48
Table 2. Numerical summaries for the Active/Reflexive factor and the Control and Experimental groups.
Table 2. Numerical summaries for the Active/Reflexive factor and the Control and Experimental groups.
Active/Reflexive
Group345
Control2180
Experimental1781
Table 3. Numerical summaries for the Sensing/Intuitive factor and the Control and Experimental groups.
Table 3. Numerical summaries for the Sensing/Intuitive factor and the Control and Experimental groups.
Sensing/Intuitive
Group2345
Control11864
Experimental015101
Table 4. Numerical summaries for the Visual/Verbal factor and the Control and Experimental groups.
Table 4. Numerical summaries for the Visual/Verbal factor and the Control and Experimental groups.
Visual/Verbal
Group2345
Control101531
Experimental81501
Table 5. Numerical summaries for the Sequential/Global:factor and the Control and Experimental groups.
Table 5. Numerical summaries for the Sequential/Global:factor and the Control and Experimental groups.
Sequential/Global:
Group345
Control2270
Experimental1871
Table 6. Numerical summaries for learning results: sample size (n), mean, standard deviation (sd), minimum (min), 1st quantile (Q1), median, 3rd quantile (Q3), and maximum (max) for the different levels (3 and 4) of the Active/Reflexive factor and the Control and Experimental groups.
Table 6. Numerical summaries for learning results: sample size (n), mean, standard deviation (sd), minimum (min), 1st quantile (Q1), median, 3rd quantile (Q3), and maximum (max) for the different levels (3 and 4) of the Active/Reflexive factor and the Control and Experimental groups.
GroupActive/ReflexivenMeansdMinQ1MedianQ3Max
Control3214.342.190.002.503.756.258.75
Experimental3173.531.540.002.503.754.756.25
Control483.882.12-0.253.443.755.316.25
Experimental484.841.043.753.755.005.316.25
Table 7. Numerical summaries for learning results: sample size (n), mean, standard deviation (sd), minimum (min), 1st quantile (Q1), median, 3rd quantile (Q3) and maximum (max) for the different levels (3 and 4) of the Sequential/Global factor and the Control and Experimental groups.
Table 7. Numerical summaries for learning results: sample size (n), mean, standard deviation (sd), minimum (min), 1st quantile (Q1), median, 3rd quantile (Q3) and maximum (max) for the different levels (3 and 4) of the Sequential/Global factor and the Control and Experimental groups.
GroupSequential/
Global
nMeansdMinQ1MedianQ3Max
Control3224.831.861.253.755.006.258.75
Experimental3183.891.590.003.753.755.006.25
Control472.291.88-0.251.252.503.125.00
Experimental473.751.022.503.123.754.385.00
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Borrás-Gené, O.; Díez, R.M.; Macías-Guillén, A. Digital Educational Escape Room Analysis Using Learning Styles. Information 2022, 13, 522. https://doi.org/10.3390/info13110522

AMA Style

Borrás-Gené O, Díez RM, Macías-Guillén A. Digital Educational Escape Room Analysis Using Learning Styles. Information. 2022; 13(11):522. https://doi.org/10.3390/info13110522

Chicago/Turabian Style

Borrás-Gené, Oriol, Raquel Montes Díez, and Almudena Macías-Guillén. 2022. "Digital Educational Escape Room Analysis Using Learning Styles" Information 13, no. 11: 522. https://doi.org/10.3390/info13110522

APA Style

Borrás-Gené, O., Díez, R. M., & Macías-Guillén, A. (2022). Digital Educational Escape Room Analysis Using Learning Styles. Information, 13(11), 522. https://doi.org/10.3390/info13110522

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop