Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights
Abstract
:1. Introduction
- The use of fuzzy logic in an AR system in engineering education.
- The use of the Structure of the Observed Learning Outcomes (SOLO) for the instructional design of learning content.
- The delivery of the learning activities taught to students in an AR system.
2. Literature Review
3. Instructional Design
4. Adaptation of the Learning Activities
4.1. Fuzzy Weights
- Novice (N): The student has minimal or textbook knowledge of the educational material, without connecting it to the practice. He/she needs close supervision or guidance and has little or no idea of how to deal with complexity.
- Advanced Beginner (AB): The student has basic knowledge of key aspects of the educational material, while straightforward tasks are likely to be performed to an acceptable standard. He/she is able to achieve some steps using his/her own judgment but needs supervision for the overall task.
- Competent (C): The student has good working and background knowledge of the educational material, and results can be achieved for open tasks, though may lack refinement. He/she is able to achieve most tasks using own judgment and copes with complex situations through deliberate analysis and planning.
- Proficient (P): The student has depth of understanding of the educational material, while results are achieved for open tasks. He/she deals with complex situations holistically and has become confident in decision-making.
- Expert (E): The student has authoritative knowledge of the educational material and deep tacit understanding across areas of the domain, while excellence is achieved with relative ease. He/she is able to move between intuitive and analytical approaches with ease.
4.2. Decision Making
- No learning activity of SOLO-L1.
- No learning activity of SOLO-L2.
- No learning activity of SOLO-L3.
- Three learning activities of SOLO-L4.
- Two learning activities of SOLO-L5.
5. Evaluation Results and Discussion
5.1. Research Population
5.2. Analysis of the Students’ Feedback
- How much did the activities match your level of knowledge? (Q1).
- Was the quantity of the activities used efficient? (Q2).
- Did the activities’ level of complexity enhance your learning? (Q3).
- Condition 0 (null hypothesis): μ1 = μ2 (group A and group B means are equal).
- Condition 1: μ1 ≠ μ2 (group A and group means are not equal).
5.3. Evaluation of the Learning Outcome
6. Conclusions and Future Work
6.1. Conclusions
6.2. Theoretical Contributions
6.3. Implications in Educational Practice
6.4. Limitations
6.5. Future Work
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Azuma, R.; Baillot, Y.; Behringer, R.; Feiner, S.; Julier, S.; MacIntyre, B. Recent Advances in Augmented Reality. IEEE Comput. Graph. Appl. 2001, 21, 34–47. [Google Scholar] [CrossRef]
- Takrouri, K.; Causton, E.; Simpson, B. AR Technologies in Engineering Education: Applications, Potential, and Limitations. Digital 2022, 2, 171–190. [Google Scholar] [CrossRef]
- Ali, D.F.; Omar, M.; Ibrahim, N.H.; Surif, J.; Ali, M.; Ismail, S. Overcoming the Problems Faced by Student’s in Learning Engineering Drawing with the Implementation of Augmented Reality Learning Environment. Man India 2017, 97, 147–159. [Google Scholar]
- Sorby, S. Developing 3D Spatial Skills for Engineering Students. Australas. J. Eng. Educ. 2007, 13, 1–11. [Google Scholar] [CrossRef]
- Arslan, A.R.; Dazkir, S. Technical Drafting and Mental Visualization in Interior Architecture Education. Int. J. Scholarsh. Teach. Learn. 2017, 11, n2. [Google Scholar] [CrossRef]
- Šafhalter, A.; Glodež, S.; Šorgo, A.; Ploj Virtič, M. Development of Spatial Thinking Abilities in Engineering 3D Modeling Course Aimed at Lower Secondary Students. Int. J. Technol. Des. Educ. 2022, 32, 167–184. [Google Scholar] [CrossRef]
- Gerson, H.B.P.; Sorby, S.A.; Wysocki, A.; Baartmans, B.J. The Development and Assessment of Multimedia Software for Improving 3-D Spatial Visualization Skills. Comput. Appl. Eng. Educ. 2001, 9, 105–113. [Google Scholar] [CrossRef]
- Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Exploration of Augmented Reality in Spatial Abilities Training: A Systematic Literature Review for the Last Decade. Inform. Educ. 2021, 20, 107–130. [Google Scholar] [CrossRef]
- Soofi, A.; Uddin, M. A Systematic Review of Domains, Techniques, Delivery Modes and Validation Methods for Intelligent Tutoring Systems. Int. J. Adv. Comput. Sci. Appl. 2019, 10. [Google Scholar] [CrossRef]
- Holmes, M.; Latham, A.; Crockett, K.A.; O’Shea, J.D. Near Real-Time Comprehension Classification with Artificial Neural Networks: Decoding e-Learner Non-Verbal Behavior. IEEE Trans. Learn. Technol. 2018, 11, 5–12. [Google Scholar] [CrossRef]
- Papagiannakis, G.; Singh, G.; Thalmann, N. A Survey of Mobile and Wireless Technologies for Augmented Reality Systems (Preprint). Comput. Animat. Virtual Worlds 2008, 19, 3–22. [Google Scholar] [CrossRef] [Green Version]
- Yu, J.; Denham, A.R.; Searight, E. A Systematic Review of Augmented Reality Game-Based Learning in STEM Education. Educ. Technol. Res. Dev. 2022, 70, 1169–1194. [Google Scholar] [CrossRef]
- Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Measuring User Experience, Usability and Interactivity of a Personalized Mobile Augmented Reality Training System. Sensors 2021, 21, 3888. [Google Scholar] [CrossRef] [PubMed]
- Khan, N.; Muhammad, K.; Hussain, T.; Nasir, M.; Munsif, M.; Imran, A.S.; Sajjad, M. An Adaptive Game-Based Learning Strategy for Children Road Safety Education and Practice in Virtual Space. Sensors 2021, 21, 3661. [Google Scholar] [CrossRef] [PubMed]
- Han, D.-I.; tom Dieck, M.C.; Jung, T. User Experience Model for Augmented Reality Applications in Urban Heritage Tourism. J. Herit. Tour. 2018, 13, 46–61. [Google Scholar] [CrossRef]
- Kourouthanassis, P.; Boletsis, C.; Bardaki, C.; Chasanidou, D. Tourists Responses to Mobile Augmented Reality Travel Guides: The Role of Emotions on Adoption Behavior. Pervasive Mob. Comput. 2015, 18, 71–87. [Google Scholar] [CrossRef]
- Kim, H.; Matuszka, T.; Kim, J.-I.; Kim, J.; Woo, W. Ontology-Based Mobile Augmented Reality in Cultural Heritage Sites: Information Modeling and User Study. Multimed. Tools Appl. 2017, 76, 26001–26029. [Google Scholar] [CrossRef]
- Alam, S.S.; Susmit, S.; Lin, C.-Y.; Masukujjaman, M.; Ho, Y.-H. Factors Affecting Augmented Reality Adoption in the Retail Industry. J. Open Innov. Technol. Mark. Complex. 2021, 7, 142. [Google Scholar] [CrossRef]
- de Pace, F.; Manuri, F.; Sanna, A. Augmented Reality in Industry 4.0. Am. J. Comput. Sci. Inf. Technol. 2018, 6, 17. [Google Scholar] [CrossRef]
- Obara, K. Augmented Reality and Marketing. Available online: https://www.researchgate.net/publication/349883390_VIRTUAL_AND_AUGMENTED_REALITY_IN_MARKETING/references (accessed on 1 September 2022).
- Bekus, T. The Application of Augmented Reality in Marketing. Zesz. Nauk. Wyższej Szkoły Humanit. Zarządzanie 2018, 19, 279–296. [Google Scholar] [CrossRef]
- Mitrovic, K.; Novakovic, N.; Spajić, J.; Cosic, I. Augmented Reality in Marketing—State of Art. In Proceedings of the 32nd International DAAAM Symposium 2021, Vienna, Austria, 28–29 October 2021; pp. 566–575, ISBN 9783902734334. [Google Scholar]
- Monterubbianesi, R.; Tosco, V.; Vitiello, F.; Orilisi, G.; Fraccastoro, F.; Putignano, A.; Orsini, G. Augmented, Virtual and Mixed Reality in Dentistry: A Narrative Review on the Existing Platforms and Future Challenges. Appl. Sci. 2022, 12, 877. [Google Scholar] [CrossRef]
- Rodríguez-Abad, C.; Fernández-de-la-Iglesia, J.-C.; Martínez-Santos, A.-E.; Rodríguez-González, R. A Systematic Review of Augmented Reality in Health Sciences: A Guide to Decision-Making in Higher Education. Int. J. Environ. Res. Public Health 2021, 18, 4262. [Google Scholar] [CrossRef] [PubMed]
- Buchner, J.; Buntins, K.; Kerres, M. The Impact of Augmented Reality on Cognitive Load and Performance: A Systematic Review. J. Comput. Assist. Learn. 2022, 38, 285–303. [Google Scholar] [CrossRef]
- Makransky, G.; Petersen, G.B. The Cognitive Affective Model of Immersive Learning (CAMIL): A Theoretical Research-Based Model of Learning in Immersive Virtual Reality. Educ. Psychol. Rev. 2021, 33, 937–958. [Google Scholar] [CrossRef]
- Christalin, B.; Ezra, K.; Jeba Thangaiah, R. An Evolutionary Approach for Personalization of Content Delivery in E-Learning Systems Based on Learner Behavior Forcing Compatibility of Learning Materials. Telemat. Inform. 2017, 35, 520–533. [Google Scholar] [CrossRef]
- Elghouch, N.; Kouissi, M.; el Mokhtar, E.-N. Multi-Agent System of an Adaptive Learning Hypermedia Based on Incremental Hybrid Case-Based Reasoning. In SCA’19: Proceedings of the 4th International Conference on Smart City Application, Casablanca, Morocco, 2–4 October 2019; Association for Computing Machinery: New York, NY, USA, 2020; pp. 143–156. ISBN 978-3-030-37628-4. [Google Scholar]
- Chiu, T.K.F.; Mok, I. Learner Expertise and Mathematics Different Order Thinking Skills in Multimedia Learning. Comput. Educ. 2017, 107, 147–164. [Google Scholar] [CrossRef]
- Khamparia, A.; Pandey, B. SVM and PCA Based Learning Feature Classification Approaches for E-Learning System. Int. J. Web-Based Learn. Teach. Technol. 2018, 13, 32–45. [Google Scholar] [CrossRef]
- Kostolányová, K. Adaptation of Personalized Education in E-Learning Environment; Springer: Cham, Switzerland, 2017; Volume 10108, ISBN 978-3-319-52835-9. [Google Scholar]
- Scheiter, K.; Schubert, C.; Schüler, A.; Schmidt, H.; Zimmermann, G.; Wassermann, B.; Krebs, M.-C.; Eder, T. Adaptive Multimedia: Using Gaze-Contingent Instructional Guidance to Provide Personalized Processing Support. Comput. Educ. 2019, 139, 31–47. [Google Scholar] [CrossRef]
- Bauer, M.; Bräuer, C.; Schuldt née Krebs, J.; Kroemker, H. Adaptive E-Learning for Supporting Motivation in the Context of Engineering Science. In Advances in Human Factors in Training, Education, and Learning Sciences; Springer: Cham, Switzerland, 2019; pp. 409–422. ISBN 978-3-319-93881-3. [Google Scholar]
- Cornelisz, I.; van Klaveren, C. Student Engagement with Computerized Practising: Ability, Task Value, and Difficulty Perceptions. J. Comput. Assist. Learn. 2018, 34, 828–842. [Google Scholar] [CrossRef]
- Vanitha, V.; Krishnan, P. A Modified Ant Colony Algorithm for Personalized Learning Path Construction. J. Intell. Fuzzy Syst. 2019, 37, 1–16. [Google Scholar] [CrossRef]
- Nabizadeh, A.H.; Gonçalves, D.; Gama, S.; Jorge, J.; Rafsanjani, H. Adaptive Learning Path Recommender Approach Using Auxiliary Learning Objects. Comput. Educ. 2019, 147, 103777. [Google Scholar] [CrossRef]
- Saito, T.; Watanobe, Y. Learning Path Recommendation System for Programming Education Based on Neural Networks. Int. J. Distance Educ. Technol. 2020, 18, 36–64. [Google Scholar] [CrossRef]
- El Said, G.R. Context-Aware Adaptive m-Learning: Implicit Indicators of Learning Performance, Perceived Usefulness, and Willingness to Use. ASEE Comput. Educ. 2019, 10, 1–14. [Google Scholar]
- Shawky, D.; Badawi, A. Towards a Personalized Learning Experience Using Reinforcement Learning. In Studies in Computational Intelligence; Springer: Cham, Switzerland, 2019; pp. 169–187. ISBN 978-3-030-02356-0. [Google Scholar]
- Farmer, E.; Catalano, A.; Halpern, A. Exploring Student Preference between Textbook Chapters and Adaptive Learning Lessons in an Introductory Environmental Geology Course. TechTrends 2019, 64, 150–157. [Google Scholar] [CrossRef]
- Troussas, C.; Krouska, A.; Sgouropoulou, C. A Novel Teaching Strategy through Adaptive Learning Activities for Computer Programming. IEEE Trans. Educ. 2020, 64, 103–109. [Google Scholar] [CrossRef]
- Bromley, M. The SOLO Taxonomy. SecEd 2015, 2015, 8–9. [Google Scholar] [CrossRef]
- Seel, N.M. (Ed.) Solo Taxonomy. In Encyclopedia of the Sciences of Learning; Springer US: Boston, MA, USA, 2012; p. 3150. ISBN 978-1-4419-1428-6. [Google Scholar]
- Vrettaros, J.; Vouros, G.; Drigas, A. An Intelligent System for Solo Taxonomy; Springer: Cham, Switzerland, 2006; Volume 228, ISBN 978-0-387-44639-4. [Google Scholar]
- Lucander, H.; Bondemark, L.; Brown, G.; Knutsson, K. The Structure of Observed Learning Outcome (SOLO) Taxonomy: A Model to Promote Dental Students’ Learning. Eur. J. Dent. Educ. 2010, 14, 145–150. [Google Scholar] [CrossRef]
- El Mouhayar, R. Levels of Generalization and the SOLO Taxonomy. In Proceedings of the 42nd Conference of the International Group for the Psychology of Mathematics Education, Umeå, Sweden, 3–7 July 2018; p. 43, ISBN 978-91-7601-902-3. [Google Scholar]
- Biggs, J. Teaching for Quality Learning at University. Society for Research into Higher Education; The Higher Education Academy. (2008). Groupwork, Retrieved August; Open University Press: Maidenhead, UK, 2003; Volume 6, p. 2008. [Google Scholar]
- Biggs, J.; Tang, C. Teaching for Quality Learning at University; UK Higher Education OUP Humanities & Social Sciences Higher Education OUP; McGraw-Hill Education: New York, NY, USA, 2011; ISBN 9780335242764. [Google Scholar]
- Medina-Medina, N.; García-Cabrera, L. A Taxonomy for User Models in Adaptive Systems: Special Considerations for Learning Environments. Knowl. Eng. Rev. 2016, 31, 124–141. [Google Scholar] [CrossRef]
- Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. On the Development of a Personalized Augmented Reality Spatial Ability Training Mobile Application. In Novelties in Intelligent Digital Systems; IOS Press: Amsterdam, The Netherlands, 2021; pp. 75–83. [Google Scholar]
- Mousavinasab, E.; Zarifsanaiey, N.; Niakan, R.; Kalhori, S.; Rakhshan, M.; Keikha, L.; Ghazi Saeedi, M. Intelligent Tutoring Systems: A Systematic Review of Characteristics, Applications, and Evaluation Methods. Interact. Learn. Environ. 2021, 29, 142–163. [Google Scholar] [CrossRef]
- Zadeh, L. Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer Hubert L. Dreyfus and Stuart E. Dreyfus. Published by: New York, The Free Press, 1986. Future Gener. Comput. Syst. FGCS 1987, 3, 149–151. [Google Scholar] [CrossRef]
- Oakes, J.M.; Feldman, H.A. Statistical Power for Nonequivalent Pretest-Posttest Designs: The Impact of Change-Score versus ANCOVA Models. Eval. Rev. 2001, 25, 3–28. [Google Scholar] [CrossRef] [PubMed]
- Evans, R.H. An Analysis of Criterion Variable Reliability in Conjoint Analysis. Percept. Mot. Ski. 1996, 82, 988–990. [Google Scholar] [CrossRef]
SOLO Level | Learning Goal | Learning Activities | Description of the Activities |
---|---|---|---|
Pre-structural (L1) | Students get information on the subject |
| Introduction to Technical Drawing: A history and current importance of drawing are presented. Students are asked to illustrate the significance of drawing by presenting applications and reports of both good and negative uses of the skill |
Unistructural (L2) | Students define, recognize, name, sketch, reproduce, recite, follow simple instructions, calculate, reproduce, arrange, find |
| Setting up a model space in CAD software by defining limits, grid, snap, layers, and object snap. Video tutorials on standard viwes, views alignment, completion of activity sheet, and setting up the model space. Border creation with a completed title block to be used for all future drawings, and drawing templates with all the settings necessary saved within it |
Multi-structural (L3) | Students describe, list, classify, structure, enumerate, conduct, complete, illustrate, solve |
| Orthographic drawing creation. Lines, layers. Isometric object drawing. Video tutorials on linetype, lineweight and isometric drawing creation of objects in the activity. |
Relational (L4) | Students relate, analyze, compare, integrate, plan, construct, implement, summarize |
| Scaling the border and title block to fit the orthographic drawing. Dimensioning an orthographic drawing, Video tutorials on basic dimesioning rules and parts of dimensions Filling in a title block, including Name, Date, Title, Drawing No., and the correct scale. Snapping and Text commands. |
Extended abstract (L5) | Students generalize, hypothesize, theorize, predict, judge, evaluate, assess, predict, reason, criticize |
| Printing the drawing on 8.5” × 11” paper (letter size) in landscape orientation. Video tutorial on cutting plane, half and full sections. Printer/plotter settings. Export/plot an object that has been drawn in CAD so it can be exported or printed to a variety of other applications. CAD software to create objects that are more precise and sometimes easier to draw in CAD than in other software. |
Fuzzy Weights | L1 | L2 | L3 | L4 | L5 | Sum of Las |
---|---|---|---|---|---|---|
μN = 1 | 7 | 5 | 0 | 0 | 0 | 12 |
μN < 1 | 6 | 5 | 0 | 0 | 0 | 11 |
μAB = 1 | 4 | 4 | 2 | 0 | 0 | 10 |
μAB < 1 & μC < 1 | 3 | 3 | 3 | 0 | 0 | 9 |
μC = 1 | 1 | 1 | 3 | 2 | 1 | 8 |
μC < 1 & μP < 1 | 0 | 1 | 2 | 3 | 1 | 7 |
μP = 1 | 0 | 0 | 1 | 4 | 1 | 6 |
μP < 1 & μΕ < 1 | 0 | 0 | 0 | 3 | 2 | 5 |
μΕ = 1 | 0 | 0 | 0 | 1 | 3 | 4 |
Measure | Item | Frequency | Percentage (%) |
---|---|---|---|
Sample size | 148 | 100.0 | |
Gender | Male | 101 | 68.2 |
Female | 47 | 31.8 | |
Age (over 18) | 18–19 | 57 | 38.5 |
20–21 | 42 | 28.4 | |
22–23 | 36 | 24.3 | |
Over 23 | 13 | 8.8 | |
Level of prior knowledge | None | 129 | 87.2 |
Technical background | 19 | 12.8 | |
Computer skills | Knowledge of computers at a high level | ||
Motivation | All students wanted to achieve a high grade at the attended course |
Group A | Group B | |
---|---|---|
Mean | 8.236 | 6.581 |
Variance | 1.053 | 0.368 |
Observations | 74 | 74 |
Hypothesized Mean Difference | 0 | |
df | 239 | |
t Stat | 16.900 | |
P (T ≤ t) one-tail | <0.001 | |
t Critical one-tail | 1.651 | |
P (T ≤ t) two-tail | <0.001 | |
t Critical two-tail | 1.970 |
Group A | Group B | |
---|---|---|
Mean | 8.899 | 6.500 |
Variance | 0.772 | 0.415 |
Observations | 74 | 74 |
Hypothesized Mean Difference | 0 | |
df | 270 | |
t Stat | 26.785 | |
P (T ≤ t) one-tail | <0.001 | |
t Critical one-tail | 1.651 | |
P (T ≤ t) two-tail | <0.001 | |
t Critical two-tail | 1.969 |
Group A | Group B | |
---|---|---|
Mean | 9.047 | 6.378 |
Variance | 1.025 | 0.618 |
Observations | 74 | 74 |
Hypothesized Mean Difference | 0 | |
df | 277 | |
t Stat | 25.333 | |
P (T ≤ t) one-tail | <0.001 | |
t Critical one-tail | 1.650 | |
P (T ≤ t) two-tail | <0.001 | |
t Critical two-tail | 1.969 |
Group A | Group B | |
---|---|---|
Pre-test Mean | 4.973 | 5.014 |
Post-test Mean | 6.027 | 5.493 |
Difference | 1.054 | 0.480 |
Standard Deviation | 0.932 | 0.837 |
Pearson Correlation | 0.828 | 0.892 |
t Stat | −13.765 | −6.974 |
p-value | <0.001 | <0.001 |
Pre-test | Post-test | |
---|---|---|
Mean | 4.973 | 6.027 |
Variance | 2.054 | 2.748 |
Observations | 74 | 74 |
Pearson Correlation | 0.828 | |
Hypothesized Mean Difference | 0 | |
df | 147 | |
t Stat | −13.765 | |
P (T ≤ t) one-tail | <0.001 | |
t Critical one-tail | 1.655 | |
P (T ≤ t) two-tail | <0.001 | |
t Critical two-tail | 1.976 |
Pre-test | Post-test | |
---|---|---|
Mean | 5.014 | 5.493 |
Variance | 2.068 | 3.272 |
Observations | 74 | 74 |
Pearson Correlation | 0.892 | |
Hypothesized Mean Difference | 0 | |
df | 147 | |
t Stat | −6.974 | |
P (T < = t) one-tail | <0.001 | |
t Critical one-tail | 1.655 | |
P (T < = t) two-tail | <0.001 | |
t Critical two-tail | 1.976 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Papakostas, C.; Troussas, C.; Krouska, A.; Sgouropoulou, C. Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights. Sensors 2022, 22, 7059. https://doi.org/10.3390/s22187059
Papakostas C, Troussas C, Krouska A, Sgouropoulou C. Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights. Sensors. 2022; 22(18):7059. https://doi.org/10.3390/s22187059
Chicago/Turabian StylePapakostas, Christos, Christos Troussas, Akrivi Krouska, and Cleo Sgouropoulou. 2022. "Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights" Sensors 22, no. 18: 7059. https://doi.org/10.3390/s22187059
APA StylePapakostas, C., Troussas, C., Krouska, A., & Sgouropoulou, C. (2022). Personalization of the Learning Path within an Augmented Reality Spatial Ability Training Application Based on Fuzzy Weights. Sensors, 22(18), 7059. https://doi.org/10.3390/s22187059