Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System
Abstract
:1. Introduction
- Does the CPRLS improve students’ learning achievement in robotics compared to traditional teaching methods?
- Does the CPRLS enhance students’ motivation to learn robotics more than traditional teaching methods?
- Does the CPRLS incur less cognitive load in learning robotics compared to traditional teaching methods?
- What is the students’ level of satisfaction after using the CPRLS for learning robotics?
2. Literature Review
2.1. Robots and STEM Education
2.2. Digital Twins and AI Robots
- Perception: The ability to gather data from the environment through sensors such as cameras, microphones, and other devices.
- Reasoning and Decision-Making: The process of interpreting data, making inferences, and deciding on actions based on algorithms and models.
- Learning: The capability to improve performance over time through various forms of learning, such as supervised, unsupervised, and reinforcement learning.
2.3. Virtual Reality
3. Materials and Methods
3.1. Forward Kinematics
3.2. Inverse Kinematics
3.3. Path Planning
3.4. Digital Twin
4. Teaching Experiment
- Achievement test
- Learning motivation questionnaire
- Cognitive load questionnaire
- Technology acceptance questionnaire
- The integrated robot learning system
- VR headset
- SPSS software
5. Experimental Results
5.1. Learning Effectiveness
5.2. Learning Motivation
5.3. Cognitive Load
5.4. System Satisfaction Analysis
6. Discussion
7. Conclusions and Future Works
- Learning geometric shapes and spatial concepts
- Learning vector operation and rotation in 3D space
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
- ( ) Which of the following statements about industrial six-joint manipulators is correct?
- 2.
- ( ) How is an industrial six-joint manipulator usually designed to control each joint?
- 3.
- ( ) Which of the following statements about industrial six-joint manipulators is correct?
- 4.
- ( ) Which of the following statements about forward and inverse kinematics is correct?
- 5.
- ( ) Which of the following statements about forward and inverse kinematics is correct?
- 6.
- ( ) Which point can the end-effector move to from (−6, 8, 6) by adjusting only the first joint?
- 7.
- ( ) Which point can the end-effector move to from (9, 12, 6) by adjusting only the first joint?
- 8.
- ( ) If the end-effector moves from (17, 0, 9) to (9, 0, 17) and you only want to adjust the first joint,
- 9.
- ( ) If the end-effector moves from (17, 0, 9) to (0, 17, 9) and you only want to adjust the first joint,
- 10.
- ( ) Which set of joint parameters (J1, J2, J3, J4, J5, J6) can make the end-effector perpendicular to the platform?
- 11.
- ( ) If the joint parameters (0, 0, 45, 0, J5, −45) are to make the end-effector perpendicular to the platform, then what is the value J5?
- 12.
- ( ) If the joint parameters (0, 90, 0, 0, −90, J6) are to make the end-effector perpendicular to the platform, then what is the value of J6?
References
- ISO. Manipulating Industrial Robots. ISO Standard 8373. 2023. Available online: https://www.iso.org/standard/75539.html (accessed on 12 December 2023).
- Robots. What Is a Robot? Top Roboticists Explain Their Definition of a Robot. 2023. Available online: https://robots.ieee.org/learn/what-is-a-robot (accessed on 12 December 2023).
- Honda. ASIMO by Honda: The World’s Most Advanced Humanoid Robot. 2023. Available online: https://global.honda/en/robotics (accessed on 10 June 2023).
- Rorel, B. A Ping-Pong-Playing Terminator. 2010. Available online: https://www.popsci.com/technology/article/2010-02/ping-pong-playing-terminator (accessed on 9 September 2023).
- Gurgul, M. Industrial Robots and Cobots: Everything You Need to Know about Your Future Co-Worker; INKPAD: Carmel, IN, USA, 2018; ISBN 978-83-952513-0-6. [Google Scholar]
- Ghosh, A.; Fischer, P. Controlled propulsion of artificial magnetic nanostructured propellers. Nano Lett. 2009, 9, 2243–2245. [Google Scholar] [CrossRef]
- Geeks for Geeks. Top 10 Applications of Robotics in 2020. Available online: https://www.geeksforgeeks.org/top-10-applications-of-robotics-in-2020 (accessed on 12 December 2023).
- Lindner, P. Better, virtually: The past, present, and future of virtual reality cognitive behavior therapy. Int. J. Cogn. Ther. 2021, 14, 23–46. [Google Scholar] [CrossRef]
- Sweller, J. Element interactivity and intrinsic, extraneous, and germane cognitive load. Educ. Psychol. Rev. 2010, 22, 123–138. [Google Scholar] [CrossRef]
- Artino, A.R., Jr. Cognitive load theory and the role of learner experience: An abbreviated review for educational practitioners. AACE J. 2008, 16, 425–439. [Google Scholar]
- Corke, P. Robotics, Vision & Control: Fundamental Algorithms in MATLAB; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar] [CrossRef]
- Tao, J.; Qin, C.; Xiao, D.; Shi, H.; Ling, X.; Li, B.; Liu, C. Timely chatter identification for robotic drilling using a local maximum synchro-squeezing-based method. J. Intell. Manuf. 2020, 31, 1243–1255. [Google Scholar] [CrossRef]
- Tiryaki, A.; Adigüzel, S. The effect of STEM-based robotic applications on the creativity and attitude of students. J. Sci. Learn. 2021, 4, 288–297. [Google Scholar] [CrossRef]
- Apriyani, R.; Ramalis, T.R.; Suwarma, I.R. Analyzing students’ problem-solving abilities of direct current electricity in STEM-based learning. J. Sci. Learn. 2019, 2, 85–91. [Google Scholar] [CrossRef]
- Anikarnisia, N.M.; Wilujeng, I. Need assessment of STEM education based on local wisdom in junior high school. J. Phys. Conf. Ser. 2020, 1440, 012001. [Google Scholar] [CrossRef]
- Henning, K.; Wolfgang, W.; Johannes, H. Recommendations for Implementing the Strategic Initiative INDUSTRIE 4.0; Federal Ministry of Education and Research: Frankfurt, Germany, 2013.
- Aheleroff, S.; Xu, X.; Zhong, R.Y.; Lu, Y. Digital twin as a service (DTaaS) in Industry 4.0: An architecture reference model. Adv. Eng. Inform. 2021, 47, 101225. [Google Scholar] [CrossRef]
- Bao, J.; Guo, D.; Li, J.; Zhang, J. The modelling and operations for the digital twin in the context of manufacturing. Enterp. Inf. Syst. 2019, 13, 534–556. [Google Scholar] [CrossRef]
- He, B.; Bai, K.J. Digital twin-based sustainable intelligent manufacturing: A review. Adv. Manuf. 2021, 9, 1–21. [Google Scholar] [CrossRef]
- Kowalski, C.; Brinkmann, A.; Böhlen, C.F.; Hinrichs, P.; Hein, A. A rule-based robotic assistance system providing physical relief for nurses during repositioning tasks at the care bed. Int. J. Intell. Robot. Appl. 2022, 7, 1–12. [Google Scholar] [CrossRef]
- Russell, S.; Norvig, P. Artificial Intelligence—A Modern Approach, 4th ed.; Pearson: London, UK, 2016; Available online: http://aima.cs.berkeley.edu (accessed on 22 August 2022).
- Cox, A.M. Exploring the impact of Artificial Intelligence and robots on higher education through literature-based design fictions. Int. J. Educ. Technol. High. Educ. 2021, 18, 3. [Google Scholar] [CrossRef]
- Dede, C. Immersive interfaces for engagement and learning. Science 2009, 323, 66–69. [Google Scholar] [CrossRef]
- Luo, H.; Li, G.; Feng, Q.; Yang, Y.; Zuo, M. Virtual reality in K-12 and higher education: A systematic review of the literature from 2000 to 2019. J. Comput. Assist. Learn. 2021, 37, 887–901. [Google Scholar] [CrossRef]
- Dalgarno, B.; Hedberg, J. 3D learning environments in tertiary education. In Meeting at the Crossroads; University of Melbourne for Computers in Learning in Tertiary Education: Melbourne, Australia, 2001; pp. 33–36. [Google Scholar]
- Burdea, G.; Coiffet, P. Virtual Reality Technology; Wiley IEEE-Press: London, UK, 2003. [Google Scholar]
- Sherman, W.R.; Craig, A.B. Understanding Virtual Reality; Morgan Kaufmann Publishers: New York, NY, USA, 2003. [Google Scholar]
- Tarng, W.; Pan, I.C.; Ou, K.L. Effectiveness of virtual reality on attention training for elementary school students. Systems 2022, 10, 104. [Google Scholar] [CrossRef]
- Dunleavy, M.; Dede, C.; Mitchell, R. Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 2016, 18, 7–22. [Google Scholar] [CrossRef]
- Lee, H.P. An example of the interaction between virtual and physical experiments in dynamics. Int. J. Mech. Eng. Educ. 2004, 32, 93–99. [Google Scholar] [CrossRef]
- Chen, C.H.; Yang, J.C.; Shen, S.; Jeng, M.C. A desktop virtual reality earth motion system in astronomy education. Educ. Technol. Soc. 2007, 10, 289–304. [Google Scholar]
- Lee, E.A.L.; Wong, K.W.; Fung, C.C. How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach. Comput. Educ. 2010, 55, 1424–1442. [Google Scholar]
- Togias, T.; Gkournelos, C.; Angelakis, P.; Michalos, G.; Makris, S. Virtual reality environment for industrial robot control and path design. Procedia CIRP 2021, 100, 133–138. [Google Scholar] [CrossRef]
- Verner, I.; Cuperman, D.; Perez-Villalobos, H.; Polishuk, A.; Gamer, S. Augmented and virtual reality experiences for learning robotics and training integrative thinking skills. Robotics 2022, 11, 90. [Google Scholar] [CrossRef]
- Adami, P.; Rodrigues, P.; Woods, P.; Becerik-Gerber, B.; Soibelman, L.; Copur-Gencturk, Y.; Lucas, G. Impact of VR-Based Training on Human-Robot Interaction for Remote Operating Construction Robots. J. Comput. Civ. Eng. 2022, 36, 1943–5487. [Google Scholar] [CrossRef]
- Malik, A.; Masood, T.; Bilberg, A. Virtual reality in manufacturing: Immersive and collaborative artificial-reality in design of human-robot workspace. Int. J. Comput. Integr. Manuf. 2020, 33, 22–37. [Google Scholar] [CrossRef]
- Heradio, R.; de la Torre, L.; Galan, D.; Cabrerizo, F.J.; Herrera-Viedma, E.; Dormido, S. A Systematic Review of Virtual and Remote Laboratories for Robotics Education. Int. J. Interact. Multimed. Artif. Intell. 2016, 4, 9–24. [Google Scholar]
- Tzafestas, S.G.; Alifragis, M. Remote and Virtual Labs in Engineering Education: A Comparison Study. Int. J. Eng. Educ. 2015, 31, 414–422. [Google Scholar]
- Alimisis, D. Educational Robotics and Virtual Labs in Higher Education. Int. J. Adv. Robot. Syst. 2018, 15, 1–10. [Google Scholar]
- Bencomo, S.D.; Dormido, R.; Farias, G.; Vargas, H. Design and Implementation of Virtual Labs for Robotics Education. IEEE Trans. Educ. 2014, 57, 76–82. [Google Scholar] [CrossRef]
- Gomes, L.; Bogosyan, S. Remote Laboratories in Engineering Education: The Simulation vs. Remote Experimentation Debate. IEEE Trans. Ind. Electron. 2009, 56, 4744–4756. [Google Scholar] [CrossRef]
- Sacks, R.; Girolami, M.; Brilakis, I. Building Information Modelling, Artificial Intelligence and Construction Tech. Dev. Built Environ. 2020, 4, 100011. [Google Scholar] [CrossRef]
- Mourtzis, D.; Vlachou, E.; Dimitrakopoulos, G.; Zogopoulos, V. Cyber-Physical Systems and Education 4.0—The Teaching Factory 4.0 Concept. Procedia Manuf. 2018, 23, 129–134. [Google Scholar] [CrossRef]
- Tao, F.; Zhang, H.; Liu, A.; Nee, A. Digital Twin in Industry: State-of-the-Art. IEEE Trans. Ind. Inform. 2019, 15, 2405–2415. [Google Scholar] [CrossRef]
- Jones, D.; Snider, C.; Nassehi, A.; Yon, J.; Hicks, B. Characterising the Digital Twin: A Systematic Literature Review. CIRP J. Manuf. Sci. Technol. 2020, 29, 36–52. [Google Scholar] [CrossRef]
- Bruynseels, K.; Santoni de Sio, F.; van den Hoven, J. Digital Twins in Health Care: Ethical Implications of an Emerging Engineering Paradigm. Front. Genet. 2018, 9, 31. [Google Scholar] [CrossRef] [PubMed]
- Uhlemann, T.H.-J.; Schock, C.; Lehmann, C.; Freiberger, S.; Steinhilper, R. The Digital Twin: Demonstrating the Potential of Real Time Data Acquisition in Production Systems. Procedia Manuf. 2017, 9, 113–120. [Google Scholar] [CrossRef]
- Kucuk, S.; Bingul, Z. Robot Kinematics: Forward and Inverse Kinematics. In Industrial Robotics: Theory, Modelling, Control; Cubero, S., Ed.; Intech Open: Berlin, Germany, 2006. [Google Scholar]
- Siciliano, B.; Sciavicco, L.; Villani, L.; Oriolo, G. Robotics: Modelling, Planning and Control; Springer: Berlin/Heidelberg, Germany, 2009; ISBN 978-1846286414. [Google Scholar]
- Wang, L.C.; Chen, M.P. The effects of game strategy and preference-matching on flow experience and programming performance in game-based learning. Innov. Educ. Teach. Int. 2010, 47, 39–52. [Google Scholar] [CrossRef]
- Hwang, G.J.; Yang, L.H.; Wang, S.Y. A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Comput. Educ. 2013, 69, 121–130. [Google Scholar] [CrossRef]
- Briz, L.; García-Peñalvo, F. An empirical assessment of a technology acceptance model for apps in medical education. J. Med. Syst. 2015, 39, 176. [Google Scholar] [CrossRef]
Research Question | Research Tool | Statistical Method |
---|---|---|
| Achievement test | Paired sample t-test and one-way ANCOVA |
| Learning motivation questionnaire | Independent samples t-test |
| Cognitive load questionnaire | Independent samples t-test |
| Satisfaction questionnaire | Descriptive statistics |
Group | Pre-Test Mean | Pre-Test S.D. | Post-Test Mean | Post-Test S.D. |
---|---|---|---|---|
Experimental Group | 3.60 | 1.70 | 8.71 | 2.97 |
Control Group | 2.93 | 1.40 | 3.75 | 1.78 |
Source | Mean | S.D. | t | Significance |
---|---|---|---|---|
Experimental Group | −5.114 | 3.367 | 8.895 | <0.001 *** |
Control Group | −0.825 | 1.893 | 2.756 | 0.009 ** |
Source | Type III Sum of Squares | Freedom | F | Significance | |
---|---|---|---|---|---|
Pre-test | 7.501 | 1 | 1.301 | 0.258 | 0.018 |
Group | 414.382 | 1 | 71.868 | <0.001 *** | 0.500 |
Deviation | 415.141 | 71 | |||
Sum | 3643.000 | 75 |
Group | N | Mean | S.D. | df | t | p |
---|---|---|---|---|---|---|
Experimental Group | 35 | 3.994 | 0.735 | 73 | 3.621 | <0.001 *** |
Control Group | 40 | 3.290 | 0.923 |
Evaluation Items | Experimental Group | Control Group | p | ||
---|---|---|---|---|---|
Mean | S.D. | Mean | S.D. | ||
| 4.09 | 0.82 | 3.48 | 0.86 | 0.004 ** |
| 4.03 | 0.82 | 3.42 | 0.95 | 0.006 ** |
| 3.97 | 0.79 | 3.10 | 0.88 | 0.000 *** |
| 3.97 | 0.82 | 3.25 | 0.90 | 0.001 ** |
| 3.91 | 0.89 | 3.20 | 0.84 | 0.001 ** |
Group | N | Mean | S.D. | df | t | p |
---|---|---|---|---|---|---|
Experimental Group | 35 | 2.149 | 0.676 | 73 | −5.094 | <0.001 *** |
Control Group | 40 | 2.970 | 0.714 |
Evaluation Items | Experimental Group | Control Group | p | ||
---|---|---|---|---|---|
Mean | S.D. | Mean | S.D. | ||
| 2.03 | 0.79 | 3.20 | 0.96 | 0.000 *** |
| 2.11 | 0.96 | 3.80 | 0.84 | 0.000 *** |
| 2.20 | 0.83 | 2.45 | 0.80 | 0.108 |
| 2.26 | 0.70 | 2.70 | 0.89 | 0.014 * |
| 2.14 | 0.73 | 2.70 | 0.92 | 0.004 ** |
Technology Acceptance Model | Mean | S.D. | |
---|---|---|---|
Perceived Usefulness (Mean = 4.29) |
| 4.34 | 0.59 |
| 4.31 | 0.58 | |
| 4.29 | 0.67 | |
| 4.34 | 0.68 | |
| 4.17 | 0.71 | |
Perceived Ease of Use (Mean = 4.05) |
| 4.11 | 0.68 |
| 4.17 | 0.71 | |
| 4.03 | 0.95 | |
| 4.09 | 0.89 | |
| 3.86 | 0.98 | |
Behavioral Intention (Mean = 4.10) |
| 4.17 | 0.79 |
| 4.11 | 0.80 | |
| 4.03 | 0.79 | |
Overall technology acceptance | 4.16 | 0.54 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tarng, W.; Wu, Y.-J.; Ye, L.-Y.; Tang, C.-W.; Lu, Y.-C.; Wang, T.-L.; Li, C.-L. Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System. Electronics 2024, 13, 2848. https://doi.org/10.3390/electronics13142848
Tarng W, Wu Y-J, Ye L-Y, Tang C-W, Lu Y-C, Wang T-L, Li C-L. Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System. Electronics. 2024; 13(14):2848. https://doi.org/10.3390/electronics13142848
Chicago/Turabian StyleTarng, Wernhuar, Yu-Jung Wu, Li-Yuan Ye, Chun-Wei Tang, Yun-Chen Lu, Tzu-Ling Wang, and Chien-Lung Li. 2024. "Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System" Electronics 13, no. 14: 2848. https://doi.org/10.3390/electronics13142848
APA StyleTarng, W., Wu, Y. -J., Ye, L. -Y., Tang, C. -W., Lu, Y. -C., Wang, T. -L., & Li, C. -L. (2024). Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System. Electronics, 13(14), 2848. https://doi.org/10.3390/electronics13142848