Next Article in Journal
Improvement of Baro Sensors Matrix for Altitude Estimation
Next Article in Special Issue
Watcher: Cloud-Based Coding Activity Tracker for Fair Evaluation of Programming Assignments
Previous Article in Journal
On Weather Data-Based Prediction of Gamma Exposure Rates Using Gradient Boosting Learning for Environmental Radiation Monitoring
Previous Article in Special Issue
A Model to Develop Chatbots for Assisting the Teaching and Learning Process
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights

Department of Informatics and Computer Engineering, University of West Attica, 12243 Athens, Greece
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(18), 7059; https://doi.org/10.3390/s22187059
Submission received: 23 August 2022 / Revised: 5 September 2022 / Accepted: 16 September 2022 / Published: 18 September 2022
(This article belongs to the Special Issue Smart Educational Systems: Hardware and Software Aspects)

Abstract

:
Adaptive systems and Augmented Reality are among the most promising technologies in teaching and learning processes, as they can be an effective tool for training engineering students’ spatial skills. Prior work has investigated the integration of AR technology in engineering education, and more specifically, in spatial ability training. However, the modeling of user knowledge in order to personalize the training has been neither sufficiently explored nor exploited in this task. There is a lot of space for research in this area. In this work, we introduce a novel personalization of the learning path within an AR spatial ability training application. The aim of the research is the integration of Augmented Reality, specifically in engineering evaluation and fuzzy logic technology. During one academic semester, three engineering undergraduate courses related to the domain of spatial skills were supported by a developed adaptive training system named PARSAT. Using the technology of fuzzy weights in a rule-based decision-making module and the learning theory of the Structure of the Observed Learning Outcomes for the design of the learning material, PARSAT offers adaptive learning activities for the students’ cognitive skills. Students’ data were gathered at the end of the academic semester, and a thorough analysis was delivered. The findings demonstrated that the proposed training method outperformed the traditional method that lacked adaptability, in terms of domain expertise and learning theories, considerably enhancing student learning outcomes.

1. Introduction

Extended Reality (XR) is an all-encompassing term that combines the experiences of augmented reality (AR), virtual reality (VR), and mixed reality (MR), meaning all the technologically enhanced realities fall under the umbrella term of XR. AR uses the existing real-world environment and puts virtual information on top of it to enhance the experience. On the contrary, VR immerses users into an entirely different environment, typically a virtual one created and rendered by computers. Finally, MR is a user environment in which physical reality and digital content are combined in a way that enables interaction with and among real-world and virtual objects.
AR technology superimposes a computer-generated 3D image on a user’s view of the real world [1]. AR is an enhanced version of the real physical world that is achieved through the use of digital stimuli, such as visual and/or sound elements, and delivered via technology. AR applications are user-friendly, providing a straightforward and pleasant method of human–computer interaction. AR has been integrated in many fields, gaining much potential in educational settings, and more specifically, in engineering training [2].
The improvement of students’ visualization skills is crucial in engineering education for the growth of their design abilities [3]. Numerous studies have examined the benefits of AR technology for enhancing students’ engineering drawing efficiency, as well as for improving their spatial skills, which are crucial for their studies and future careers [4,5,6,7]. Although the integration of AR in spatial ability training has been explored by many researchers, there is no research specifically designed as a personalized AR spatial ability training system that considers the student profile [8].
Personalized training offers great pedagogical affordances, as it provides an enhanced learning experience, improves student engagement, and promotes knowledge acquisition [9]. The adaptive systems integrate built-in components in order to offer knowledge domain adaptivity and deliver different learning activities, tailored to the student’s profile. The learning material’s pedagogical potential increases with how adaptable it is to the cognitive needs and capabilities of the students. For instance, in the case of a student who studies a specific domain concept, having a high knowledge level, and has been given many learning activities that are not appropriate for that level, then the learning process may not go as expected and the student would feel frustrated [10].
During the last years there has been a trend in combining mobile technologies with AR to achieve the implementation of AR applications that benefit from the portability features and immediate access to information that are achieved with mobile devices [11]. However, the combination of AR and its application in educational settings remains an open area research. There are not specific guidelines for the description of educational content based on AR techniques or methodologies for the design and creation of highly interactive material so that it can provide personalized learning in any place and at any time. The integration of such applications in an adaptive and accessible learning process would allow students to present highly interactive content, personalized to their characteristics and needs, and as such, can interpret the contents and relate them to the real world.
The main contributions of the paper can be identified as follows:
  • The use of fuzzy logic in an AR system in engineering education.
  • The use of the Structure of the Observed Learning Outcomes (SOLO) for the instructional design of learning content.
  • The delivery of the learning activities taught to students in an AR system.
The novelty of our research is the integration of adaptive techniques and learning theory to provide students with personalized learning activities within the framework of spatial ability training through AR. Fuzzy weights are specifically used in a rule-based decision-making engine to provide engineering students with adaptive learning activities, in terms of their knowledge level. The research question that the manuscript seeks to answer is how effective fuzzy weights can model the learner’s knowledge level in an AR training system.
Our paper is structured as follows. In Section 2, the literature review is investigated. Section 3 presents the system’s instructional design. Section 4 describes the matching between the learning activities and the normalized fuzzy weights. Section 5 presents the system’s evaluation, and finally, Section 6 concludes the work and continues with the limitations and future work.

2. Literature Review

The literature review reveals numerous studies focusing on the integration of AR technology in fields such as education [12,13,14], tourism [15,16,17], industry [18,19], marketing [20,21,22], and medical [23,24].
Many studies have explored the positive effects of AR technology in education, as compared to the traditional methods of teaching and learning. Previous authors [13] tested a firefighting training system using AR, which was more cost-effective and safer, compared to large-scale real-life training. Simulating firefighting scenarios helped the trainees evaluate their knowledge and deal with risky circumstances.
Another study [16] presented a mobile AR travel guide, supporting personalized recommendations. The authors explored the relationship between system properties, user emotions, and adoption behavior. More specifically, the developed AR application built a user profile, based on users’ preferences, and according to the updated profile, users are offered extra media features.
AR is considered one of the most disruptive technologies in the field of marketing [21]. Consumers derive tangible benefits from AR technology and expect it as part of their purchasing process. AR has been incorporated into store catalog applications, which allow consumers to visualize what different products would look like in different environments. With AR technology, marketers are able to carry out successful digital campaigns. AR aids marketing as it can let the customers try before they buy, augment touring and assistance, and finally, augment branding materials.
In [23], the authors explored the potential of VR, AR, and MR in both dental education and clinical dentistry. AR and VR technology can be beneficial not only for dental students, but also for patients, as AR and VR can reduce dental anxiety and treat dental phobias. Furthermore, a systematic review [24] investigated the usability of AR in the area of health sciences on the aspect of the psychopedagogy of students in higher education. The usage of AR improved many aspects of the learning process, including motivation, satisfaction, and autonomous learning [25,26].
Based on the analysis of the relevant literature, there are different aspects regarding the adaptation technique, which are mainly based on (a) the student’s specific learning style [27,28], (b) the student’s thinking preference [29,30,31], (c) information processing capability of the student [32], (d) student motivation [33,34], (e) the learning path [35,36,37], and (f) the learning material [38,39]. However, their adaptation focuses primarily on the manner in which the domain knowledge is presented, rather than the quantity and type of learning activities that are offered to the students. These studies suggest that students’ knowledge levels are the most important determinant. The field of adaptive domain knowledge models is poorly explored, and research has not yet focused on maintaining learner engagement [40,41].
In view of the above, it is concluded that previous research has not focused on the adaptivity of domain knowledge in terms of the scope and nature of the learning activities taught to students. Furthermore, past studies related to domain knowledge adaptivity have not utilized fuzzy weights in decision making to achieve adaptivity and did not incorporate learning theories to maintain pedagogical affordability. There is scope for intelligent tutoring techniques in engineering education.
The rest of this work initially describes the instructional design, which is a novelty in AR spatial ability training systems. Then, we analyze the fuzzy weights membership functions of the current knowledge level, and how the output determines how many learning activities will be delivered to the learner, transforming the system into an adaptive one. This structure makes it easier for the reader to navigate the paper and understand the material presented.

3. Instructional Design

The domain knowledge included learning activities where students manipulate (move, rotate, zoom) augmented 3D objects to better understand the object geometry, and finally, design the technical drawing of their orthographic views. The domain knowledge consists of fifteen chapters related to the technical drawing course, providing an introduction to advanced sections on complexity.
A guiding framework suitable for the development of educational products, namely the Structure of the Observed Learning Outcomes (SOLO) model [42,43], was used for the instructional design of the learning activities [44,45].
The SOLO taxonomy describes the levels of students’ understanding in ascending order of complexity. In particular, the model consists of five levels of understanding, namely pre-structural (L1), unistructural (L2), multi-structural (L3), relational (L4), and extended abstract (L5). This model can be used to deliver the most appropriate learning activity to students with the intention of improving their learning outcomes [46]. Therefore, our Personalized Augmented Reality Spatial Ability Training application (PARSAT) uses the SOLO model to offer each student the learning activities that suit them best. Table 1 illustrates the learning goals and the corresponding activities per SOLO level.

4. Adaptation of the Learning Activities

4.1. Fuzzy Weights

The users of PARSAT are learners with a variety of background knowledge in the domain of technical drawing, and therefore, they have different learning requirements. In order to provide each learner with the most accurate learning path and material, an AR system was developed (namely PARSAT), which determines their knowledge level and their learning needs. This is accomplished through the student model, which, nowadays, is present in the majority of most adaptive educational software [49].
The student model’s function is to represent the students’ current level of knowledge, and it is crucial for the system to provide the appropriate personalization for students’ learning needs [50]. There are other methods that can be used to construct the student model, including neural networks and fuzzy logic networks [51]. The fuzzy weightings that define students’ present level of knowledge, are the foundation of the PARSAT student model. Each student’s degree of knowledge is explicitly described by the quintet Novice (N), Advanced Beginner (AB), Competent (C), Proficient (P), and Expert (E). The five parties involved reflect on how well each of the subsequent five fuzzy sets represents the learner’s current level of understanding [52]:
  • Novice (N): The student has minimal or textbook knowledge of the educational material, without connecting it to the practice. He/she needs close supervision or guidance and has little or no idea of how to deal with complexity.
  • Advanced Beginner (AB): The student has basic knowledge of key aspects of the educational material, while straightforward tasks are likely to be performed to an acceptable standard. He/she is able to achieve some steps using his/her own judgment but needs supervision for the overall task.
  • Competent (C): The student has good working and background knowledge of the educational material, and results can be achieved for open tasks, though may lack refinement. He/she is able to achieve most tasks using own judgment and copes with complex situations through deliberate analysis and planning.
  • Proficient (P): The student has depth of understanding of the educational material, while results are achieved for open tasks. He/she deals with complex situations holistically and has become confident in decision-making.
  • Expert (E): The student has authoritative knowledge of the educational material and deep tacit understanding across areas of the domain, while excellence is achieved with relative ease. He/she is able to move between intuitive and analytical approaches with ease.
Utilizing the following membership functions, the quintet that describes the student’s present degree of expertise is calculated. The boundary values for each of the aforementioned fuzzy weights, which range from 0 to 1, are expressed using a trapezoidal function (Figure 1).
The degree of membership scales from 0 to 1 before flattening out and dropping to 0 at the end. The flattened portion of the trapezoidal function clearly demonstrates that the student’s score (x) belongs in the designated group. The fuzzy weights membership functions are shown in Figure 2.
The student’s level of knowledge is determined by five fuzzy sets (N, AB, C, P, and E), varying from 0 to 1. According to the membership functions presented in Figure 2, a student’s score of 41 equals μN(x) = 0, μAB(x) = 0.90, μC(x) = 0.10, μP(x) = 0, and μE(x) = 0, meaning that the quintet (0, 0.90, 0.10, 0, 0) indicates a student is 90% advanced beginner and 10% competent. In case the student’s score is 48, the resulting values are μN(x) = 0, μAB(x) = 0.20, μC(x) = 0.80, μP(x) = 0, and μE(x) = 0, representing a student who is 20% advanced beginner and 80% competent. The last example of a student’s score of 98 results in μN(x) = 0, μAB(x) = 0, μC(x) = 0, μP(x) = 0, and μE(x) = 1, therefore the quintet (0, 0, 0, 0, 1) indicates a 100% expert student. In any case, the equation μN(x) + μAB(x) + μC(x) + μP(x) + μE(x) = 1 stands.
Eight professors from the Department of Informatics and Computer Engineering utilized the fuzzy weights and the related thresholds at the membership functions. The faculty members were asked to define, in more detail, the technical drawing knowledge levels that students gain during the course throughout the course of an entire semester. All the faculty members have more than 15 years of experience instructing technical drawing in academic contexts, and they can attest to the accuracy of the depiction of students’ knowledge levels.

4.2. Decision Making

In this section, the analysis of the rules in combination with the fuzzy weights to adapt the teaching strategy to the students’ knowledge level is presented [28,29,30]. The number of learning activities of each chapter that the student has to learn each time, is dynamically defined according to the current level of knowledge.
The rules design plays an important role for determining the number and the difficulty of the learning activities delivered to the students. The rules have been defined by the aforementioned eight faculty members, who matched each learning activity with the corresponding SOLO level. The set of rules in total is presented in Table 2.
According to these rules, a proficient student who scored 82 per cent is classified as the fourth fuzzy set, as the values of μN(82), μAB(82), μC(82), μP(82), and μE(82) are 0, 0, 0, 0.8, and 0.2, respectively. The delivered learning activities will be:
  • No learning activity of SOLO-L1.
  • No learning activity of SOLO-L2.
  • No learning activity of SOLO-L3.
  • Three learning activities of SOLO-L4.
  • Two learning activities of SOLO-L5.

5. Evaluation Results and Discussion

5.1. Research Population

The current study was evaluated over three courses of an entire academic semester, while students were taking the (a) Computer-Aided-Design, (b) Technical Drawing, and (c) 3D Monument Modelling courses, at an undergraduate curriculum of a public university, located in the nation’s capital. The sample consisted of 148 s, third, and fourth-year undergraduate students, and three educators. All measurements of gender and age were obtained from a randomly chosen sample and had no impact on the outcomes of our study. Table 3 presents the analysis of demographics.
The instructors evenly divided the population into two groups of 74 students. The experimental group (group A) was instructed to run the PARSAT independently, while utilizing the system’s adaptability. For instance, the modeling of students’ knowledge levels enabled them to watch video tutorials of various lengths and rotate 3D objects of various complexity to see and comprehend their structures, and generally engage in various learning activities adjusted to their unique profiles.
The control group (group B) used the same instructional material and exercises, without any customization based on the students’ individual profiles. The students were given instructions on how to carry out the learning activities, which included the same content and approach of the learning activity presented in group A.
However, the visualization and explanation techniques were different for both groups. The experimental group with AR application could use PARSAT and actually see the system in action on their smartphones and/or tablets and leverage the proposed framework to derive pedagogically meaningful semantics, while group B did not use PARSAT. The educators were involved in the educational procedure in both groups.

5.2. Analysis of the Students’ Feedback

At the end of the semester, after the successful completion of all three courses, the two groups were delivered a questionnaire and were asked to respond to the following questions, using a 10-point Likert scale ranging from “Not at all” (0) to “Very much” (10):
  • How much did the activities match your level of knowledge? (Q1).
  • Was the quantity of the activities used efficient? (Q2).
  • Did the activities’ level of complexity enhance your learning? (Q3).
A t-test was used to further assess the statistical significance of our findings and respond to the research questions. The statistical importance of the questions 1, 2, and 3 is presented in Table 4, Table 5 and Table 6.
First, we have two conditions, an experimental condition in which students receive the AR-assisted approach and a control condition in which they do not. We compared performance in the two conditions in order to define whether the difference between the two conditions was clear enough or not. In these circumstances, the t-test was used to decide whether the difference between the two conditions was real or whether it was due merely to chance fluctuations. For the t-test, we were interested in the p-value, and we used the t-value as an intermediate step to calculate the p-value. We state the two conditions, namely null and alternative:
  • Condition 0 (null hypothesis): μ1 = μ2 (group A and group B means are equal).
  • Condition 1: μ1 ≠ μ2 (group A and group means are not equal).
The 74 participants who used PARSAT (M = 8.2, SD = 1.1) compared to the 74 participants in the control group (M = 6.6, SD = 0.4) demonstrated significantly better peak flow scores in the first question, t(239) = 16.9, p < 0.05, as the significance level of the alpha value is a = 0.05 (Table 4).
The 74 participants of the experimental group (M = 8.9, SD = 0.8) compared to the participants of group B (M = 6.5, SD = 0.4) also demonstrated significantly better peak flow scores in the second question, t(270) = 26.8, p < 0.05 (Table 5).
Finally, the participants of group A (M = 9.0, SD = 1.0) compared to the participants of group B (M = 6.4, SD = 0.6) showed much higher peak flow scores in the third question, t(277) = 25.3, p < 0.05 (Table 6).
This means we have sufficient evidence to say that the means of the two groups are, for all three questions, significantly different, so we reject the null hypothesis.
It is deduced from the analysis of the t-test findings (Table 4, Table 5 and Table 6) that the means of the two groups differ statistically significantly regarding the aforementioned questions. More specifically, the provided system outperforms its traditional equivalent in all three terms of the volume of the activities, the complexity of the activities, and the reliability of the activities depending on students’ knowledge levels. These outcomes were anticipated, given that PARSAT uses intelligent techniques to tailor the learning activities to the needs of the students. As a result, a learning environment focused on the needs of the students is provided, and knowledge acquisition and learning outcomes are further enhanced.

5.3. Evaluation of the Learning Outcome

In order to compare the learning outcome between the two groups and assess the improvement in their knowledge, we used the pre-test–post-test non-equivalent groups design [53]. In particular, the same pre-test was delivered to each student of group A and group B to evaluate their prior domain knowledge. Both groups of students took the same post-test at the end of the semester, and a paired t-test was used to compare the differences and examine whether the students of the experimental group improve more than the students in the control group. Table 7 presents the results of the t-test evaluation.
The analysis of the results of group A (presented in Table 8) from the pre-test (M = 4.9, SD = 0.9) and post-test (M = 6.0, SD = 0.9) indicate that the use of the proposed personalized AR application resulted in an improvement in students’ spatial skills, t(147) = −13.8, p < 0.05. Furthermore, the Pearson correlation value of r = 0.828 suggests a very strong positive correlation between the pre-test and the post-test scores [54].
The analysis of the results of group B (presented in Table 9) from the pre-test (M = 5.0, SD = 0.8) and post-test (M = 5.5, SD = 0.8) indicate that the traditional educational method also resulted in an improvement in students’ spatial skills, t(147) = −6.9, p < 0.05. The correlation between the scores of group B is 0.892, suggesting another very strong correlation.
However, the control group achieved an improvement to a lesser extent than in the experimental group, demonstrating the benefits that our proposed approach brought to students’ learning.
From the analysis of the literature review, it is shown that the current AR applications in engineering education focused only on hardware, not emphasizing intelligent techniques. This study shows a new path toward adaptivity through fuzzification. Furthermore, we create a roadmap to deliver learning activities to students appropriate for their knowledge level.

6. Conclusions and Future Work

6.1. Conclusions

Our research paper presents a novel instructional strategy by providing students with adaptive learning activities according to the learning theory of the Structure of the Observed Learning Outcomes model. This is achieved by using fuzzy weight-based decision making that defines the students’ knowledge level based on their scores in technical drawing’s domain concepts. As a result, students receive different learning activities based on their level of knowledge.
Regarding the evaluation results, they show high levels of student satisfaction and improvement in their learning outcomes. Specifically, the pre-test and post-test evaluation showed a significant improvement in student outcomes, confirming the pedagogical affordability of the proposed learning method. Lastly, the comparison of the proposed system with the traditional method showed that it outperforms the second one in terms of enhancing the effectiveness of adopted adaptivity and using rule-based training, as well as confirming the efficacy of the teaching method employed in learning activities.
The goal of the current study is to provide students with relevant learning activities while primarily determining their adaptability based on their knowledge level. The introduction of additional fuzzy weights indicating other students’ characteristics, such as categories of mistakes, etc., for increasing the system adaption with the intention to further improve the learning results is a future inquiry resulting from this work.

6.2. Theoretical Contributions

This study contributes by exploring fuzzy logic as a tool for assessing students’ knowledge level through AR technology. In our proposed model, we incorporated five fuzzy sets representing the students’ current level of understanding, providing a meaningful addition to the standard training method of engineering students’ spatial skills.
In doing so, it expands previous studies that have not researched this field in the past. Additionally, our approach tested the students’ group performance and showed that our model is indeed an upgrade in engineering training, helping them to interact better.

6.3. Implications in Educational Practice

The results of our study showed that using a mobile AR application personalized to the learner’s knowledge level increased the learning motivation of the students. It is essential for engineers of any field to update their knowledge and train their spatial skills to stay competitive in their field.
The personalized AR spatial ability training application makes this process more interesting and exciting, and as such, the educational practice becomes more effective. Students are more motivated and more engaged in their training, regardless of their starting level of achievement.

6.4. Limitations

The research population involved undergraduate university engineering students. We did not extend the study to non-engineering students and/or learners of a higher age or postgraduate level.

6.5. Future Work

The potential for MR, VR, and AR to transform how we interact with the digital environment is high. AR applications seem to be heading toward more practical uses, especially in terms of education. We tested a mobile AR application to train engineering students’ spatial skills. However, in the future, we could explore the impact of VR in delivering spatial skills training. Additionally, a future research field could be the use of MR platforms for practicing the ability to manipulate and interact with an object and improving visualizations skills.

Author Contributions

Conceptualization, C.P., C.T. and A.K.; methodology, C.P., C.T. and A.K.; validation, C.P., C.T. and A.K.; formal analysis, C.P., C.T. and A.K.; investigation, C.P., C.T. and A.K.; resources, C.P., C.T. and A.K.; data curation, C.P., C.T. and A.K.; writing—original draft preparation, C.P., C.T. and A.K.; writing—review and editing, C.P., C.T. and A.K.; visualization, C.P., C.T. and A.K.; supervision, C.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval is not required, because this study involved the analysis of dataset obtained from past research based on voluntary participation, where the data were properly anonymized. The research presents no risk of harm to subjects.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study at the time of original data collection.

Data Availability Statement

Data are available on request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Azuma, R.; Baillot, Y.; Behringer, R.; Feiner, S.; Julier, S.; MacIntyre, B. Recent Advances in Augmented Reality. IEEE Comput. Graph. Appl. 2001, 21, 34–47. [Google Scholar] [CrossRef]
  2. Takrouri, K.; Causton, E.; Simpson, B. AR Technologies in Engineering Education: Applications, Potential, and Limitations. Digital 2022, 2, 171–190. [Google Scholar] [CrossRef]
  3. Ali, D.F.; Omar, M.; Ibrahim, N.H.; Surif, J.; Ali, M.; Ismail, S. Overcoming the Problems Faced by Student’s in Learning Engineering Drawing with the Implementation of Augmented Reality Learning Environment. Man India 2017, 97, 147–159. [Google Scholar]
  4. Sorby, S. Developing 3D Spatial Skills for Engineering Students. Australas. J. Eng. Educ. 2007, 13, 1–11. [Google Scholar] [CrossRef]
  5. Arslan, A.R.; Dazkir, S. Technical Drafting and Mental Visualization in Interior Architecture Education. Int. J. Scholarsh. Teach. Learn. 2017, 11, n2. [Google Scholar] [CrossRef]
  6. Šafhalter, A.; Glodež, S.; Šorgo, A.; Ploj Virtič, M. Development of Spatial Thinking Abilities in Engineering 3D Modeling Course Aimed at Lower Secondary Students. Int. J. Technol. Des. Educ. 2022, 32, 167–184. [Google Scholar] [CrossRef]
  7. Gerson, H.B.P.; Sorby, S.A.; Wysocki, A.; Baartmans, B.J. The Development and Assessment of Multimedia Software for Improving 3-D Spatial Visualization Skills. Comput. Appl. Eng. Educ. 2001, 9, 105–113. [Google Scholar] [CrossRef]
  8. Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Exploration of Augmented Reality in Spatial Abilities Training: A Systematic Literature Review for the Last Decade. Inform. Educ. 2021, 20, 107–130. [Google Scholar] [CrossRef]
  9. Soofi, A.; Uddin, M. A Systematic Review of Domains, Techniques, Delivery Modes and Validation Methods for Intelligent Tutoring Systems. Int. J. Adv. Comput. Sci. Appl. 2019, 10. [Google Scholar] [CrossRef]
  10. Holmes, M.; Latham, A.; Crockett, K.A.; O’Shea, J.D. Near Real-Time Comprehension Classification with Artificial Neural Networks: Decoding e-Learner Non-Verbal Behavior. IEEE Trans. Learn. Technol. 2018, 11, 5–12. [Google Scholar] [CrossRef]
  11. Papagiannakis, G.; Singh, G.; Thalmann, N. A Survey of Mobile and Wireless Technologies for Augmented Reality Systems (Preprint). Comput. Animat. Virtual Worlds 2008, 19, 3–22. [Google Scholar] [CrossRef] [Green Version]
  12. Yu, J.; Denham, A.R.; Searight, E. A Systematic Review of Augmented Reality Game-Based Learning in STEM Education. Educ. Technol. Res. Dev. 2022, 70, 1169–1194. [Google Scholar] [CrossRef]
  13. Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Measuring User Experience, Usability and Interactivity of a Personalized Mobile Augmented Reality Training System. Sensors 2021, 21, 3888. [Google Scholar] [CrossRef] [PubMed]
  14. Khan, N.; Muhammad, K.; Hussain, T.; Nasir, M.; Munsif, M.; Imran, A.S.; Sajjad, M. An Adaptive Game-Based Learning Strategy for Children Road Safety Education and Practice in Virtual Space. Sensors 2021, 21, 3661. [Google Scholar] [CrossRef] [PubMed]
  15. Han, D.-I.; tom Dieck, M.C.; Jung, T. User Experience Model for Augmented Reality Applications in Urban Heritage Tourism. J. Herit. Tour. 2018, 13, 46–61. [Google Scholar] [CrossRef]
  16. Kourouthanassis, P.; Boletsis, C.; Bardaki, C.; Chasanidou, D. Tourists Responses to Mobile Augmented Reality Travel Guides: The Role of Emotions on Adoption Behavior. Pervasive Mob. Comput. 2015, 18, 71–87. [Google Scholar] [CrossRef]
  17. Kim, H.; Matuszka, T.; Kim, J.-I.; Kim, J.; Woo, W. Ontology-Based Mobile Augmented Reality in Cultural Heritage Sites: Information Modeling and User Study. Multimed. Tools Appl. 2017, 76, 26001–26029. [Google Scholar] [CrossRef]
  18. Alam, S.S.; Susmit, S.; Lin, C.-Y.; Masukujjaman, M.; Ho, Y.-H. Factors Affecting Augmented Reality Adoption in the Retail Industry. J. Open Innov. Technol. Mark. Complex. 2021, 7, 142. [Google Scholar] [CrossRef]
  19. de Pace, F.; Manuri, F.; Sanna, A. Augmented Reality in Industry 4.0. Am. J. Comput. Sci. Inf. Technol. 2018, 6, 17. [Google Scholar] [CrossRef]
  20. Obara, K. Augmented Reality and Marketing. Available online: https://www.researchgate.net/publication/349883390_VIRTUAL_AND_AUGMENTED_REALITY_IN_MARKETING/references (accessed on 1 September 2022).
  21. Bekus, T. The Application of Augmented Reality in Marketing. Zesz. Nauk. Wyższej Szkoły Humanit. Zarządzanie 2018, 19, 279–296. [Google Scholar] [CrossRef]
  22. Mitrovic, K.; Novakovic, N.; Spajić, J.; Cosic, I. Augmented Reality in Marketing—State of Art. In Proceedings of the 32nd International DAAAM Symposium 2021, Vienna, Austria, 28–29 October 2021; pp. 566–575, ISBN 9783902734334. [Google Scholar]
  23. Monterubbianesi, R.; Tosco, V.; Vitiello, F.; Orilisi, G.; Fraccastoro, F.; Putignano, A.; Orsini, G. Augmented, Virtual and Mixed Reality in Dentistry: A Narrative Review on the Existing Platforms and Future Challenges. Appl. Sci. 2022, 12, 877. [Google Scholar] [CrossRef]
  24. Rodríguez-Abad, C.; Fernández-de-la-Iglesia, J.-C.; Martínez-Santos, A.-E.; Rodríguez-González, R. A Systematic Review of Augmented Reality in Health Sciences: A Guide to Decision-Making in Higher Education. Int. J. Environ. Res. Public Health 2021, 18, 4262. [Google Scholar] [CrossRef] [PubMed]
  25. Buchner, J.; Buntins, K.; Kerres, M. The Impact of Augmented Reality on Cognitive Load and Performance: A Systematic Review. J. Comput. Assist. Learn. 2022, 38, 285–303. [Google Scholar] [CrossRef]
  26. Makransky, G.; Petersen, G.B. The Cognitive Affective Model of Immersive Learning (CAMIL): A Theoretical Research-Based Model of Learning in Immersive Virtual Reality. Educ. Psychol. Rev. 2021, 33, 937–958. [Google Scholar] [CrossRef]
  27. Christalin, B.; Ezra, K.; Jeba Thangaiah, R. An Evolutionary Approach for Personalization of Content Delivery in E-Learning Systems Based on Learner Behavior Forcing Compatibility of Learning Materials. Telemat. Inform. 2017, 35, 520–533. [Google Scholar] [CrossRef]
  28. Elghouch, N.; Kouissi, M.; el Mokhtar, E.-N. Multi-Agent System of an Adaptive Learning Hypermedia Based on Incremental Hybrid Case-Based Reasoning. In SCA’19: Proceedings of the 4th International Conference on Smart City Application, Casablanca, Morocco, 2–4 October 2019; Association for Computing Machinery: New York, NY, USA, 2020; pp. 143–156. ISBN 978-3-030-37628-4. [Google Scholar]
  29. Chiu, T.K.F.; Mok, I. Learner Expertise and Mathematics Different Order Thinking Skills in Multimedia Learning. Comput. Educ. 2017, 107, 147–164. [Google Scholar] [CrossRef]
  30. Khamparia, A.; Pandey, B. SVM and PCA Based Learning Feature Classification Approaches for E-Learning System. Int. J. Web-Based Learn. Teach. Technol. 2018, 13, 32–45. [Google Scholar] [CrossRef]
  31. Kostolányová, K. Adaptation of Personalized Education in E-Learning Environment; Springer: Cham, Switzerland, 2017; Volume 10108, ISBN 978-3-319-52835-9. [Google Scholar]
  32. Scheiter, K.; Schubert, C.; Schüler, A.; Schmidt, H.; Zimmermann, G.; Wassermann, B.; Krebs, M.-C.; Eder, T. Adaptive Multimedia: Using Gaze-Contingent Instructional Guidance to Provide Personalized Processing Support. Comput. Educ. 2019, 139, 31–47. [Google Scholar] [CrossRef]
  33. Bauer, M.; Bräuer, C.; Schuldt née Krebs, J.; Kroemker, H. Adaptive E-Learning for Supporting Motivation in the Context of Engineering Science. In Advances in Human Factors in Training, Education, and Learning Sciences; Springer: Cham, Switzerland, 2019; pp. 409–422. ISBN 978-3-319-93881-3. [Google Scholar]
  34. Cornelisz, I.; van Klaveren, C. Student Engagement with Computerized Practising: Ability, Task Value, and Difficulty Perceptions. J. Comput. Assist. Learn. 2018, 34, 828–842. [Google Scholar] [CrossRef]
  35. Vanitha, V.; Krishnan, P. A Modified Ant Colony Algorithm for Personalized Learning Path Construction. J. Intell. Fuzzy Syst. 2019, 37, 1–16. [Google Scholar] [CrossRef]
  36. Nabizadeh, A.H.; Gonçalves, D.; Gama, S.; Jorge, J.; Rafsanjani, H. Adaptive Learning Path Recommender Approach Using Auxiliary Learning Objects. Comput. Educ. 2019, 147, 103777. [Google Scholar] [CrossRef]
  37. Saito, T.; Watanobe, Y. Learning Path Recommendation System for Programming Education Based on Neural Networks. Int. J. Distance Educ. Technol. 2020, 18, 36–64. [Google Scholar] [CrossRef]
  38. El Said, G.R. Context-Aware Adaptive m-Learning: Implicit Indicators of Learning Performance, Perceived Usefulness, and Willingness to Use. ASEE Comput. Educ. 2019, 10, 1–14. [Google Scholar]
  39. Shawky, D.; Badawi, A. Towards a Personalized Learning Experience Using Reinforcement Learning. In Studies in Computational Intelligence; Springer: Cham, Switzerland, 2019; pp. 169–187. ISBN 978-3-030-02356-0. [Google Scholar]
  40. Farmer, E.; Catalano, A.; Halpern, A. Exploring Student Preference between Textbook Chapters and Adaptive Learning Lessons in an Introductory Environmental Geology Course. TechTrends 2019, 64, 150–157. [Google Scholar] [CrossRef]
  41. Troussas, C.; Krouska, A.; Sgouropoulou, C. A Novel Teaching Strategy through Adaptive Learning Activities for Computer Programming. IEEE Trans. Educ. 2020, 64, 103–109. [Google Scholar] [CrossRef]
  42. Bromley, M. The SOLO Taxonomy. SecEd 2015, 2015, 8–9. [Google Scholar] [CrossRef]
  43. Seel, N.M. (Ed.) Solo Taxonomy. In Encyclopedia of the Sciences of Learning; Springer US: Boston, MA, USA, 2012; p. 3150. ISBN 978-1-4419-1428-6. [Google Scholar]
  44. Vrettaros, J.; Vouros, G.; Drigas, A. An Intelligent System for Solo Taxonomy; Springer: Cham, Switzerland, 2006; Volume 228, ISBN 978-0-387-44639-4. [Google Scholar]
  45. Lucander, H.; Bondemark, L.; Brown, G.; Knutsson, K. The Structure of Observed Learning Outcome (SOLO) Taxonomy: A Model to Promote Dental Students’ Learning. Eur. J. Dent. Educ. 2010, 14, 145–150. [Google Scholar] [CrossRef]
  46. El Mouhayar, R. Levels of Generalization and the SOLO Taxonomy. In Proceedings of the 42nd Conference of the International Group for the Psychology of Mathematics Education, Umeå, Sweden, 3–7 July 2018; p. 43, ISBN 978-91-7601-902-3. [Google Scholar]
  47. Biggs, J. Teaching for Quality Learning at University. Society for Research into Higher Education; The Higher Education Academy. (2008). Groupwork, Retrieved August; Open University Press: Maidenhead, UK, 2003; Volume 6, p. 2008. [Google Scholar]
  48. Biggs, J.; Tang, C. Teaching for Quality Learning at University; UK Higher Education OUP Humanities & Social Sciences Higher Education OUP; McGraw-Hill Education: New York, NY, USA, 2011; ISBN 9780335242764. [Google Scholar]
  49. Medina-Medina, N.; García-Cabrera, L. A Taxonomy for User Models in Adaptive Systems: Special Considerations for Learning Environments. Knowl. Eng. Rev. 2016, 31, 124–141. [Google Scholar] [CrossRef]
  50. Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. On the Development of a Personalized Augmented Reality Spatial Ability Training Mobile Application. In Novelties in Intelligent Digital Systems; IOS Press: Amsterdam, The Netherlands, 2021; pp. 75–83. [Google Scholar]
  51. Mousavinasab, E.; Zarifsanaiey, N.; Niakan, R.; Kalhori, S.; Rakhshan, M.; Keikha, L.; Ghazi Saeedi, M. Intelligent Tutoring Systems: A Systematic Review of Characteristics, Applications, and Evaluation Methods. Interact. Learn. Environ. 2021, 29, 142–163. [Google Scholar] [CrossRef]
  52. Zadeh, L. Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer Hubert L. Dreyfus and Stuart E. Dreyfus. Published by: New York, The Free Press, 1986. Future Gener. Comput. Syst. FGCS 1987, 3, 149–151. [Google Scholar] [CrossRef]
  53. Oakes, J.M.; Feldman, H.A. Statistical Power for Nonequivalent Pretest-Posttest Designs: The Impact of Change-Score versus ANCOVA Models. Eval. Rev. 2001, 25, 3–28. [Google Scholar] [CrossRef] [PubMed]
  54. Evans, R.H. An Analysis of Criterion Variable Reliability in Conjoint Analysis. Percept. Mot. Ski. 1996, 82, 988–990. [Google Scholar] [CrossRef]
Figure 1. Linguistic scales and fuzzy weights numbers of current knowledge level.
Figure 1. Linguistic scales and fuzzy weights numbers of current knowledge level.
Sensors 22 07059 g001
Figure 2. Fuzzy weights membership functions of current knowledge level.
Figure 2. Fuzzy weights membership functions of current knowledge level.
Sensors 22 07059 g002
Table 1. Learning goals and activities per SOLO level [47,48].
Table 1. Learning goals and activities per SOLO level [47,48].
SOLO LevelLearning GoalLearning ActivitiesDescription of the Activities
Pre-structural (L1)Students get information on the subject
  • Define concepts
  • List items
  • Match information
  • Name facts
Introduction to Technical Drawing: A history and current importance of drawing are presented.
Students are asked to illustrate the significance of drawing by presenting applications and reports of both good and negative uses of the skill
Unistructural (L2)Students define, recognize, name, sketch, reproduce, recite, follow simple instructions, calculate, reproduce, arrange, find
5.
Identify content to be memorized, show examples
6.
Provide disciplinary context
7.
Mnemonics in groups
8.
Repetition of procedures
9.
Games
10.
Repetitive testing and matching
11.
Peer testing (one student asks, one answers)
Setting up a model space in CAD software by defining limits, grid,
snap, layers, and object snap.
Video tutorials on standard viwes, views alignment, completion of activity sheet, and setting up the model space.
Border creation with a completed title block to be used for all future drawings, and drawing templates with all the settings necessary saved within it
Multi-structural (L3)Students describe, list, classify, structure, enumerate, conduct, complete, illustrate, solve
12.
Glossaries of key terms with definitions, classifications, examples to build disciplinary vocabulary
13.
Simple laboratory exercises
14.
Define terms, compare to glossary
15.
Games modelled on Trivial Pursuit, Family Feud
Orthographic drawing creation.
Lines, layers.
Isometric object drawing.
Video tutorials on linetype, lineweight and isometric drawing creation of objects in
the activity.
Relational (L4)Students relate, analyze, compare, integrate, plan, construct, implement, summarize
16.
Case studies, simulations, and complex lab exercises
17.
Concept maps
18.
Research projects and experiential learning cycles
19.
Application of theoretical models
20.
Reflective journals
21.
Student seminars and debates
22.
Syndicate groups (each group is part of whole)
23.
Problem-Based Learning and Inquiry Learning
Scaling the border and title block to fit the orthographic drawing.
Dimensioning an orthographic drawing,
Video tutorials on basic dimesioning rules and parts of dimensions
Filling in a title block, including Name, Date, Title, Drawing No., and the correct scale.
Snapping and Text commands.
Extended abstract (L5)Students generalize, hypothesize, theorize, predict, judge, evaluate, assess, predict, reason, criticize
24.
Self-directed projects involving research, design, application, argumentation, evaluation
25.
Case studies involving extensive analysis, debate, reflection, argumentation, evaluation, forecasting
26.
Development of a theory or model
27.
Experiential learning cycles
28.
Problem Based Learning and Inquiry learning
Printing the drawing on 8.5” × 11” paper (letter size) in
landscape orientation.
Video tutorial on cutting plane, half and full sections.
Printer/plotter settings.
Export/plot an object that has been drawn in CAD so it can be exported or printed to a variety of other applications.
CAD software to create objects that are more precise and sometimes easier to draw in CAD than in other software.
Table 2. Decision rules for adaptive instruction.
Table 2. Decision rules for adaptive instruction.
Fuzzy WeightsL1L2L3L4L5Sum of Las
μN = 17500012
μN < 16500011
μAB = 14420010
μAB < 1 & μC < 1333009
μC = 1113218
μC < 1 & μP < 1012317
μP = 1001416
μP < 1 & μΕ < 1000325
μΕ = 1000134
Table 3. Demographics.
Table 3. Demographics.
MeasureItemFrequencyPercentage (%)
Sample size 148100.0
GenderMale10168.2
Female4731.8
Age (over 18)18–195738.5
20–214228.4
22–233624.3
Over 23138.8
Level of prior knowledgeNone12987.2
Technical background1912.8
Computer skillsKnowledge of computers at a high level
MotivationAll students wanted to achieve a high grade at the attended course
Table 4. t-test results of Q1.
Table 4. t-test results of Q1.
Group AGroup B
Mean8.2366.581
Variance1.0530.368
Observations7474
Hypothesized Mean Difference0
df239
t Stat16.900
P (T ≤ t) one-tail<0.001
t Critical one-tail1.651
P (T ≤ t) two-tail<0.001
t Critical two-tail1.970
Table 5. t-test results of Q2.
Table 5. t-test results of Q2.
Group AGroup B
Mean8.8996.500
Variance0.7720.415
Observations7474
Hypothesized Mean Difference0
df270
t Stat26.785
P (T ≤ t) one-tail<0.001
t Critical one-tail1.651
P (T ≤ t) two-tail<0.001
t Critical two-tail1.969
Table 6. t-test results of Q3.
Table 6. t-test results of Q3.
Group AGroup B
Mean9.0476.378
Variance1.0250.618
Observations7474
Hypothesized Mean Difference0
df277
t Stat25.333
P (T ≤ t) one-tail<0.001
t Critical one-tail1.650
P (T ≤ t) two-tail<0.001
t Critical two-tail1.969
Table 7. t-test results of pre-test and post-test.
Table 7. t-test results of pre-test and post-test.
Group AGroup B
Pre-test Mean4.9735.014
Post-test Mean6.0275.493
Difference1.0540.480
Standard Deviation0.9320.837
Pearson Correlation0.8280.892
t Stat−13.765−6.974
p-value<0.001<0.001
Table 8. t-test: Paired two samples for means of group A.
Table 8. t-test: Paired two samples for means of group A.
Pre-testPost-test
Mean4.9736.027
Variance2.0542.748
Observations7474
Pearson Correlation0.828
Hypothesized Mean Difference0
df147
t Stat−13.765
P (T ≤ t) one-tail<0.001
t Critical one-tail1.655
P (T ≤ t) two-tail<0.001
t Critical two-tail1.976
Table 9. t-test: Paired two samples for means of group B.
Table 9. t-test: Paired two samples for means of group B.
Pre-testPost-test
Mean5.0145.493
Variance2.0683.272
Observations7474
Pearson Correlation0.892
Hypothesized Mean Difference0
df147
t Stat−6.974
P (T < = t) one-tail<0.001
t Critical one-tail1.655
P (T < = t) two-tail<0.001
t Critical two-tail1.976
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights. Sensors 2022, 22, 7059. https://doi.org/10.3390/s22187059

AMA Style

Papakostas C, Troussas C, Krouska A, Sgouropoulou C. Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights. Sensors. 2022; 22(18):7059. https://doi.org/10.3390/s22187059

Chicago/Turabian Style

Papakostas, Christos, Christos Troussas, Akrivi Krouska, and Cleo Sgouropoulou. 2022. "Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights" Sensors 22, no. 18: 7059. https://doi.org/10.3390/s22187059

APA Style

Papakostas, C., Troussas, C., Krouska, A., & Sgouropoulou, C. (2022). Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights. Sensors, 22(18), 7059. https://doi.org/10.3390/s22187059

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop