Factors Affecting Students’ Acceptance of Mobile Learning Application in Higher Education during COVID-19 Using ANN-SEM Modelling Technique
Abstract
:1. Introduction
- (1)
- What factors influence students’ use of mobile learning platform in Jordan?
- (2)
- What factors hinder the use of mobile learning platforms in Jordan?
- (3)
- What are the students’ perceptions of mobile learning platforms as a higher distance-learning platform available in Jordan?
Significance of the Study
2. Literature Review
2.1. Value of M-Learning Systems in Higher Education during COVID-19
2.2. The Use of Mobile Learning Platform and Technology Acceptance Models
3. Development of the Proposed Theoretical Model
3.1. Constructs of the TAM Model
3.2. External Factors
4. Research Methodology
4.1. Data Collection
4.2. Research Participants
4.3. Research Measurements
4.4. Artificial Neural Network Modelling (ANN)
5. Data Analysis and Results
5.1. Reliability and Validity Analysis
5.2. Structural Equation Modelling Analysis
5.3. Artificial Neural Network Validation Analysis
5.4. Sensitivity Analysis
6. Discussion
6.1. Significance of the Research
6.2. Implications and Limitations of the Study
7. Conclusions and Future Work
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Almaiah, M.A.; Al-Khasawneh, A.; Althunibat, A.; Almomani, O. Exploring the Main Determinants of Mobile Learning Application Usage During Covid-19 Pandemic in Jordanian Universities. Emerg. Technol. Dur. Era COVID-19 Pandemic 2021, 348, 275. [Google Scholar]
- Almaiah, M.A. Acceptance and usage of a mobile information system services in University of Jordan. Educ. Inf. Technol. 2018, 23, 1873–1895. [Google Scholar] [CrossRef]
- Jacques, S.; Ouahabi, A.; Lequeu, T. Synchronous E-learning in Higher Education during the COVID-19 Pandemic. In Proceedings of the 2021 IEEE Global Engineering Education Conference (EDUCON), Vienna, Austria, 21 April 2021; pp. 1102–1109. [Google Scholar]
- Almaiah, M.A.; Man, M. Empirical investigation to explore factors that achieve high quality of mobile learning system based on students’ perspectives. Engineering science and technology. Int. J. 2016, 19, 1314–1320. [Google Scholar]
- Jacques, S.; Ouahabi, A. Distance Learning in Higher Education in France during the COVID-19 Pandemic Chapter 4. In Nina Tomaževič, Dejan Ravšelj and Aleksander Aristovnik. Higher Education Policies for Developing Digital Skills to Respond to the Covid-19 Crisis: European and Global Perspectives. Available online: https://hal.univ-reunion.fr/INSA-CVL/hal-03214612v1 (accessed on 9 December 2021).
- Cicha, K.; Rizun, M.; Rutecka, P.; Strzelecki, A. COVID-19 and higher education: First-year students’ expectations toward distance learning. Sustainability 2021, 13, 1889. [Google Scholar] [CrossRef]
- Almaiah, M.A.; Alamri, M.M.; Al-Rahmi, W. Applying the UTAUT model to explain the students’ acceptance of mobile learning system in higher education. IEEE Access 2019, 7, 174673–174686. [Google Scholar] [CrossRef]
- Almaiah, M.A.; Al Mulhem, A. Analysis of the essential factors affecting of intention to use of mobile learning applications: A comparison between universities adopters and non-adopters. Educ. Inf. Technol. 2019, 24, 1433–1468. [Google Scholar] [CrossRef]
- Torres Martín, C.; Acal, C.; El Honrani, M.; Mingorance Estrada, Á.C. Impact on the virtual learning environment due to COVID-19. Sustainability 2021, 13, 582. [Google Scholar] [CrossRef]
- Almaiah, M.A.; Alyoussef, I.Y. Analysis of the effect of course design, course content support, course assessment and instructor characteristics on the actual use of E-learning system. IEEE Access 2019, 7, 171907–171922. [Google Scholar] [CrossRef]
- Alamri, M.M.; Almaiah, M.A.; Al-Rahmi, W.M. The role of compatibility and task-technology fit (TTF): On social networking applications (SNAs) usage as sustainability in higher education. IEEE Access 2020, 8, 161668–1616681. [Google Scholar] [CrossRef]
- Almaiah, M.A.; Al-Khasawneh, A. Investigating the main determinants of mobile cloud computing adoption in university campus. Educ. Inf. Technol. 2020, 25, 3087–3107. [Google Scholar] [CrossRef]
- Shawai, Y.G.; Almaiah, M.A. Malay language mobile learning system (MLMLS) using NFC technology. Int. J. Educ. Manag. Eng. 2018, 2, 1–7. [Google Scholar] [CrossRef]
- Al Amri, M.M.; Almaiah, M.A. The Use of Mobile Gamification Technology for Sustainability Learning in Saudi Higher Education. Int. J. 2020, 9, 8236–8244. [Google Scholar]
- Almaiah, M.A.; Alamri, M.M.; Al-Rahmi, W.M. Analysis the effect of different factors on the development of Mobile learning applications at different stages of usage. IEEE Access 2019, 8, 16139–16154. [Google Scholar] [CrossRef]
- Almaiah, M.A.; Almulhem, A. A conceptual framework for determining the success factors of e-learning system implementation using Delphi technique. J. Theor. Appl. Inf. Technol. 2018, 96, 5962–5976. [Google Scholar]
- Almaiah, M.A.; Nasereddin, Y. Factors influencing the adoption of e-government services among Jordanian citizens. Electronic Government. Int. J. 2020, 16, 236–259. [Google Scholar]
- Alghazi, S.S.; Kamsin, A.; Almaiah, M.A.; Wong, S.Y.; Shuib, L. For Sustainable Application of Mobile Learning: An Extended UTAUT Model to Examine the Effect of Technical Factors on the Usage of Mobile Devices as a Learning Tool. Sustainability 2021, 13, 1856. [Google Scholar] [CrossRef]
- Almaiah, M.; Al-Khasawneh, A.; Althunibat, A.; Khawatreh, S. Mobile government adoption model based on combining GAM and UTAUT to explain factors according to adoption of mobile government services. Int. Assoc. Online Eng. 2020, 14, 199–225. [Google Scholar] [CrossRef] [Green Version]
- Almaiah, M.A.; Al-Zahrani, A.; Almomani, O.; Alhwaitat, A.K. Classification of cyber security threats on mobile devices and applications. In Artificial Intelligence and Blockchain for Future Cybersecurity Applications; Springer: Cham, Germany, 2021; pp. 107–123. [Google Scholar]
- Althunibat, A.; Binsawad, M.; Almaiah, M.A.; Almomani, O.; Alsaaidah, A.; Al-Rahmi, W.; Seliaman, M.E. Sustainable Applications of Smart-Government Services: A Model to Understand Smart-Government Adoption. Sustainability 2021, 13, 3028. [Google Scholar] [CrossRef]
- Bubukayr, M.A.; Almaiah, M.A. Cybersecurity concerns in smart-phones and applications: A survey. In Proceedings of the 2021 International Conference on Information Technology (ICIT), Amman, Jordan, 14–15 July 2021; pp. 725–731. [Google Scholar]
- Alksasbeh, M.; Abuhelaleh, M.; Almaiah, M. Towards a model of quality features for mobile social networks apps in learning environments: An extended information system success model. Int. Assoc. Online Eng. 2019, 5, 75–93. [Google Scholar] [CrossRef] [Green Version]
- Almaiah, M.A.; Al-Khasawneh, A.; Althunibat, A. Exploring the critical challenges and factors influencing the E-learning system usage during COVID-19 pandemic. Educ. Inf. Technol. 2020, 25, 5261–5280. [Google Scholar] [CrossRef]
- Al-Fraihat, D.; Joy, M.; Sinclair, J. Evaluating E-learning systems success: An empirical study. Comput. Hum. Behav. 2020, 102, 67–86. [Google Scholar] [CrossRef]
- Al-Emran, M.; Mezhuyev, V.; Kamaludin, A. Technology Acceptance Model in M-learning context: A systematic review. Comput. Educ. 2018, 125, 389–412. [Google Scholar] [CrossRef]
- Almaiah, M.A.; Jalil, M.A.; Man, M. Extending the TAM to examine the effects of quality features on mobile learning acceptance. J. Comput. Educ. 2016, 3, 453–485. [Google Scholar] [CrossRef]
- Salloum, S.A.; Alhamad, A.Q.; Al-Emran, M.; Monem, A.A.; Shaalan, K. Exploring students’ acceptance of e-learning through the development of a comprehensive technology acceptance model. IEEE Access 2019, 7, 128445–128462. [Google Scholar] [CrossRef]
- Mulhem, A.A.; Almaiah, M.A. A Conceptual Model to Investigate the Role of Mobile Game Applications in Education during the COVID-19 Pandemic. Electronics 2021, 10, 2106. [Google Scholar] [CrossRef]
- Al Amri, M.; Almaiah, M.A. Sustainability Model for Predicting Smart Education Technology Adoption Based on Student Perspectives. Int. J. Adv. Soft Comput. Its Appl. 2021, 13, 60–77. [Google Scholar]
- Almaiah, M.A.; Almomani, O.; Al-Khasawneh, A.; Althunibat, A. Predicting the Acceptance of Mobile Learning Applications during COVID-19 Using Machine Learning Prediction Algorithms. Emerg. Technol. Dur. Era COVID-19 Pandemic 2021, 348, 319. [Google Scholar]
- Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef] [Green Version]
- Almaiah, M.A.; Alismaiel, O.A. Examination of factors influencing the use of mobile learning system: An empirical study. Educ. Inf. Technol. 2019, 24, 885–909. [Google Scholar] [CrossRef]
- Al Mulhem, A. Exploring the Key Factors in the Use of an E-Learning System Among Students at King Faisal University, Saudi Arabia. Int. Assoc. Online Eng. 2020, 14, 19–37. [Google Scholar] [CrossRef] [Green Version]
- Alamri, M.M.; Almaiah, M.A.; Al-Rahmi, W.M. Social media applications affecting Students’ academic performance: A model developed for sustainability in higher education. Sustainability 2020, 12, 6471. [Google Scholar] [CrossRef]
- Aldossry, B. Evaluating the madrasati platform for the virtual classroom in Saudi arabian education during the time of Covid-19 Pandemic. Eur. J. Open Educ. E-Learn. Stud. 2021, 6. [Google Scholar] [CrossRef]
- Madrasati. Ministry of Education, Kingdom of Saudi Arabia. 2021. Available online: https://backtoschool.sa/ (accessed on 19 June 2021).
- Khalife, W. The effectiveness of using active learning based on distance learning on improving academic achievement and developing the trend towards distance learning for the learning technologies course for mathematics education students. Sci. J. Phys. Educ. Sports Sci. 2019, 87, 321–334. [Google Scholar]
- Khanfar, A.R. Distance-learning entrepreneurship education in the time of corona virus—COVID-19 challenges & solution. J. Entrep. Educ. 2020, 23, 1–17. [Google Scholar]
- MOE. Ministry of Education, Kingdom of Saudi Arabia. 2020. Available online: https://www.moe.gov.sa/ar/mediacenter/MOEnews/Pages/MR2-2020-453.aspx (accessed on 21 June 2021).
- Almaiah, M.A.; Jalil, M.A.; Man, M. Preliminary study for exploring the major problems and activities of mobile learning system: A case study of Jordan. J. Theor. Appl. Inf. Technol. 2016, 93, 580–594. [Google Scholar]
- Almaiah, M.A.; Alamri, M.M. Proposing a new technical quality requirements for mobile learning applications. J. Theor. Appl. Inf. Technol. 2018, 96, 6955–6968. [Google Scholar]
- Almaiah, M.A. Thematic analysis for classifying the main challenges and factors influencing the successful implementation of e-learning system using Nvivo. Int. J. Adv. Trends Comput. Sci. Eng. 2020, 9, 142–152. [Google Scholar] [CrossRef]
- Almaiah, M.A. Masita@ Masila Abdul Jalil Investigating Students’ Perceptions on Mobile Learning Services. Int. J. Interact. Mob. Technol. 2014, 8, 31–36. [Google Scholar] [CrossRef] [Green Version]
- Kemp, A.; Palmer, E.; Strelan, P. A taxonomy of factors affecting attitudes towards educational technologies for use with technology acceptance models. Br. J. Educ. Technol. 2019, 50, 2394–2413. [Google Scholar] [CrossRef]
- Venkatesh, V.; Thong, J.Y.; Xu, X. Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Q. 2012, 157–178. [Google Scholar] [CrossRef] [Green Version]
- Ahmad, N.; Feroz, I.; Anjum, A. Usability Analysis of Educational Information Systems from Student’s Perspective. In Proceedings of the 2020 International Conference on Big Data in Management, Manchester, UK, 15 May 2020; pp. 130–135. [Google Scholar]
- Alqahtani, A.Y.; Rajkhan, A.A. E-learning critical success factors during the covid-19 pandemic: A comprehensive analysis of e-learning managerial perspectives. Educ. Sci. 2020, 10, 216. [Google Scholar] [CrossRef]
- Sargent, K.; Hyland, P.; Sawang, S. Factors influencing the adoption of information technology in a construction business. Australas. J. Constr. Econ. Build. 2012, 12, 72–86. [Google Scholar] [CrossRef] [Green Version]
- Ergüzen, A.; Erdal, E.; Ünver, M.; Özcan, A. Improving Technological Infrastructure of Distance Education through Trustworthy Platform-Independent Virtual Software Application Pools. Appl. Sci. 2021, 11, 1214. [Google Scholar] [CrossRef]
- Al-Shihi, H.; Sharma, S.K.; Sarrab, M. Neural network approach to predict mobile learning acceptance. Educ. Inf. Technol. 2018, 23, 1805–1824. [Google Scholar] [CrossRef]
- Alshurideh, M.; Al Kurdi, B.; Salloum, S.A.; Arpaci, I.; Al-Emran, M. Predicting the actual use of m-learning systems: A comparative approach using PLS-SEM and machine learning algorithms. Interact. Learn. Environ. 2020, 1–5. [Google Scholar] [CrossRef]
- Chong, A.Y. A two-staged SEM-neural network approach for understanding and predicting the determinants of m-commerce adoption. Expert Syst. Appl. 2013, 40, 1240–1247. [Google Scholar] [CrossRef]
- Iacobucci, D. Everything you always wanted to know about SEM (structural equations modeling) but were afraid to ask. J. Consum. Psychol. 2009, 19, 673–680. [Google Scholar] [CrossRef]
- Hew, T.S.; Leong, L.Y.; Ooi, K.B.; Chong, A.Y. Predicting drivers of mobile entertainment adoption: A two-stage SEM-artificial-neural-network analysis. J. Comput. Inf. Syst. 2016, 56, 352–370. [Google Scholar] [CrossRef]
- Asadi, S.; Abdullah, R.; Safaei, M.; Nazir, S. An integrated SEM-Neural Network approach for predicting determinants of adoption of wearable healthcare devices. Mob. Inf. Syst. 2019, 2019. [Google Scholar] [CrossRef]
- Sharma, S.K. Integrating cognitive antecedents into TAM to explain mobile banking behavioral intention: A SEM-neural network modeling. Inf. Syst. Front. 2019, 21, 815–827. [Google Scholar] [CrossRef]
- Chiang, W.Y.; Zhang, D.; Zhou, L. Predicting and explaining patronage behavior toward web and traditional stores using neural networks: A comparative analysis with logistic regression. Decis. Support Syst. 2006, 41, 514–531. [Google Scholar] [CrossRef]
- Joseph, H.; Rolph, F.; Anderson, E.; Babin, B.J.; Black, W.C. Multivariate Data Analysis: A Global Perspective; Pearson: London, UK, 2010; Volume 7. [Google Scholar]
- Chan, F.T.; Chong, A.Y. A SEM–neural network approach for understanding determinants of interorganizational system standard adoption and performances. Decis. Support Syst. 2012, 54, 621–630. [Google Scholar] [CrossRef]
- Leong, L.Y.; Hew, T.S.; Tan, G.W.; Ooi, K.B. Predicting the determinants of the NFC-enabled mobile credit card acceptance: A neural networks approach. Expert Syst. Appl. 2013, 40, 5604–5620. [Google Scholar] [CrossRef]
- Zabukovšek, S.S.; Kalinic, Z.; Bobek, S.; Tominc, P. SEM–ANN based research of factors’ impact on extended use of ERP systems. Cent. Eur. J. Oper. Res. 2019, 27, 703–735. [Google Scholar] [CrossRef]
- Graham, C.R.; Woodfield, W.; Harrison, J.B. A framework for institutional adoption and implementation of blended learning in higher education. Internet High. Educ. 2013, 18, 4–14. [Google Scholar] [CrossRef]
- Alkarney, W.; Albraithen, M. Are critical success factors always valid for any case? A contextual perspective. IEEE Access 2018, 6, 63496–63512. [Google Scholar] [CrossRef]
- Althunibat, A.; Almaiah, M.A.; Altarawneh, F. Examining the Factors Influencing the Mobile Learning Applications Usage in Higher Education during the COVID-19 Pandemic. Electronics 2021, 10, 2676. [Google Scholar] [CrossRef]
Constructs | Cronbach’s Alpha | Average Variance Extracted (AVE > 0.5) |
---|---|---|
PEU | 0.901 | 0.752 |
PU | 0.773 | 0.779 |
BI | 0.887 | 0.829 |
AU | 0.865 | 0.801 |
CQ | 0.912 | 0.750 |
SYQ | 0.897 | 0.882 |
SEQ | 0.832 | 0.912 |
HLM | 0.792 | 0.937 |
TF | 0.873 | 0.918 |
PEU | PU | BI | AU | CQ | SYQ | SEQ | HLM | TF | |
---|---|---|---|---|---|---|---|---|---|
PEU | 0.936 | ||||||||
PU | 0.797 | 0.958 | |||||||
BI | 0.630 | 0.758 | 0.964 | ||||||
AU | 0.646 | 0.684 | 0.545 | 0.978 | |||||
CQ | 0.759 | 0.769 | 0.563 | 0.689 | 0.963 | ||||
SYQ | 0.769 | 0.792 | 0.643 | 0.707 | 0.790 | 0.943 | |||
SEQ | 0.530 | 0.623 | 0.506 | 0.643 | 0.527 | 0.614 | 0.988 | ||
HLM | 0.738 | 0.657 | 0.514 | 0.584 | 0.621 | 0.717 | 0.525 | 0.960 | |
TF | 0.645 | 0.688 | 0.527 | 0.665 | 0.607 | 0.639 | 0.736 | 0.575 | 0.968 |
Hypotheses | Path | β | SE | t-Value | Results | ||
---|---|---|---|---|---|---|---|
H1 | PEU | → | PU | 0.346 ** | 0.043 | 4.717 | Supported |
H2 | PEU | → | BI | 0.374 ** | 0.039 | 4.133 | Supported |
H3 | PU | → | BI | 0.387 ** | 0.063 | 1.324 | Supported |
H4 | BI | → | AU | 0.392 ** | 0.057 | 3.468 | Supported |
H5 | CQ | → | PU | 0.327 ** | 0.072 | 3.014 | Supported |
H6 | SYQ | → | PEU | 0.330 ** | 0.066 | 5.065 | Supported |
H7 | SEQ | → | PU | 0.307 ** | 0.064 | 2.994 | Supported |
H8 | HML | → | SYQ | 0.298 ** | 0.066 | 5.837 | Supported |
H9 | HML | → | SEQ | 0.281 ** | 0.060 | 9.015 | Supported |
H10 | TF | → | AU | 0.389 ** | 0.071 | 4.023 | Supported |
Input: CQ, SYQ, SEQ, HLM, TF, PEU, PU and BI Output: AU | ||||
---|---|---|---|---|
Neural Network | Training Dataset (80% of Data Sample 3000, N = 2400) | Testing Dataset (20% of Data Sample 3000, N = 600) | ||
SSE | RMSE | SSE | RMSE | |
ANN1 | 0.131 | 0.323 | 0.118 | 0.918 |
ANN2 | 0.127 | 0.318 | 0.129 | 0.960 |
ANN3 | 0.131 | 0.323 | 0.166 | 0.910 |
ANN4 | 0.128 | 0.319 | 0.107 | 0.874 |
ANN5 | 0.124 | 0.314 | 0.110 | 0.886 |
ANN6 | 0.112 | 0.299 | 0.118 | 0.918 |
ANN7 | 0.112 | 0.299 | 0.115 | 0.906 |
ANN8 | 0.112 | 0.299 | 0.119 | 0.922 |
ANN9 | 0.112 | 0.299 | 0.107 | 0.874 |
ANN10 | 0.112 | 0.299 | 0.118 | 0.918 |
Mean | 0.309 | Mean | 0.905 |
Independent Variables | Importance | Normalized Importance |
---|---|---|
PEU | 0.297 | 85.7 |
PU | 0.231 | 66.2 |
BI | 0.209 | 58.6 |
CQ | 0.355 | 100.0 |
SYQ | 0.247 | 71.3 |
SEQ | 0.217 | 61.1 |
HLM | 0.129 | 36.4 |
TF | 0.157 | 44.2 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Almaiah, M.A.; Al-lozi, E.M.; Al-Khasawneh, A.; Shishakly, R.; Nachouki, M. Factors Affecting Students’ Acceptance of Mobile Learning Application in Higher Education during COVID-19 Using ANN-SEM Modelling Technique. Electronics 2021, 10, 3121. https://doi.org/10.3390/electronics10243121
Almaiah MA, Al-lozi EM, Al-Khasawneh A, Shishakly R, Nachouki M. Factors Affecting Students’ Acceptance of Mobile Learning Application in Higher Education during COVID-19 Using ANN-SEM Modelling Technique. Electronics. 2021; 10(24):3121. https://doi.org/10.3390/electronics10243121
Chicago/Turabian StyleAlmaiah, Mohammed Amin, Enas Musa Al-lozi, Ahmad Al-Khasawneh, Rima Shishakly, and Mirna Nachouki. 2021. "Factors Affecting Students’ Acceptance of Mobile Learning Application in Higher Education during COVID-19 Using ANN-SEM Modelling Technique" Electronics 10, no. 24: 3121. https://doi.org/10.3390/electronics10243121
APA StyleAlmaiah, M. A., Al-lozi, E. M., Al-Khasawneh, A., Shishakly, R., & Nachouki, M. (2021). Factors Affecting Students’ Acceptance of Mobile Learning Application in Higher Education during COVID-19 Using ANN-SEM Modelling Technique. Electronics, 10(24), 3121. https://doi.org/10.3390/electronics10243121