A Framework for Mobile-Assisted Formative Assessment to Promote Students’ Self-Determination
Abstract
:1. Introduction
1.1. Background
1.2. Self-Determination Theory of Motivation
1.3. The Proposed Framework
1.3.1. Layer 1: Self-Determination Theory
1.3.2. Layer 2: Pedagogies
1.3.3. Layer 3: Mobile Technologies
2. Materials and Methods
2.1. Participants
2.2. Instruments
2.3. Procedures
3. Results
4. Discussions
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Black, P.; Harrison, C.; Lee, C.; Marshall, B.; Wiliam, D. Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan 2004, 86, 9–21. [Google Scholar] [CrossRef]
- Willis, J. Affiliation, autonomy and Assessment for Learning. Assess. Educ. Princ. Policy Pract. 2011, 18, 399–415. [Google Scholar] [CrossRef] [Green Version]
- Chang, C.; Chang, C.-K.; Shih, J.-L. Motivational strategies in a mobile inquiry-based language learning setting. System 2016, 59, 100–115. [Google Scholar] [CrossRef]
- Hwang, G.-J.; Wu, P.-H. Applications, impacts and trends of mobile technology-enhanced learning: A review of 2008–2012 publications in selected SSCI journals. Int. J. Mob. Learn. Organ. 2014, 8, 83–95. [Google Scholar] [CrossRef]
- Nikou, S.A.; Economides, A.A. Mobile-Based micro-Learning and Assessment: Impact on learning performance and motivation of high school students. J. Comput. Assist. Learn. 2018, 34, 269–278. [Google Scholar] [CrossRef]
- Nikou, S.A.; Economides, A.A. An outdoor Mobile-Based Assessment activity: Measuring Students’ Motivation and Acceptance. Int. J. Interact. Mob. Technol. 2016, 10, 11–17. [Google Scholar] [CrossRef] [Green Version]
- West, M.; Vosloo, S.E. UNESCO Policy Guidelines for Mobile Learning 2013; UNESCO: Paris, France, 2013. [Google Scholar]
- Huang, Y.-M.; Chiu, P.-S.; Liu, T.-C.; Chen, T.S. The design and implementation of a meaningful learning-based evaluation method for ubiquitous learning. Comput. Educ. 2011, 57, 2291–2302. [Google Scholar] [CrossRef]
- Hwang, G.J.; Chang, H.-F. A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students. Comput. Educ. 2011, 56, 1023–1031. [Google Scholar] [CrossRef]
- Kearney, C. Efforts to increase students’ interest in pursuing mathematics, science and technology studies and careers. In National Measures Taken by 30 Countries; European Schoolnet: Brussels, Belgium, 2016. [Google Scholar]
- Khoo, B.K.S. Mobile applications in higher education: Implications for teaching and learning. Int. J. Inf. Commun. Technol. Educ. 2019, 15, 95–108. [Google Scholar] [CrossRef]
- Chang, C.-Y.; Lai, C.-L.; Hwang, G.-J. Trends and research issues of mobile learning studies in nursing education: A review of academic publications from 1971 to 2016. Comput. Educ. 2018, 116, 28–48. [Google Scholar] [CrossRef]
- Lia, K.; Keller, J.M. Use of the ARCS model in education: A literature review. Comput. Educ. 2018, 122, 54–62. [Google Scholar] [CrossRef]
- Deci, E.L.; Ryan, R.M. Handbook of Self-Determination Research; University of Rochester Press: Rochester, NY, USA, 2002. [Google Scholar]
- Hartnett, M.K. Influences that undermine learners’ perceptions of autonomy competence and relatedness in an online context. Australas. J. Educ. Technol. 2015, 31, 86–99. [Google Scholar] [CrossRef] [Green Version]
- Spector, J.M.; Ifenthaler, D.; Samspon, D.; Yang, L.; Mukama, E.; Warusavitarana, A.; Lokuge, D.K.; Eichhorn, K.; Fluck, A.; Huang, R.; et al. Technology Enhanced Formative Assessment for 21st Century Learning. Educ. Technol. Soc. 2016, 19, 58–71. [Google Scholar]
- Hsu, Y.-C.; Ching, Y.-H. A review of models and frameworks for designing mobile learning experiences and environments. Can. J. Learn. Technol. 2015, 41, 1–21. [Google Scholar] [CrossRef] [Green Version]
- Zurita, G.; Nussbaum, M. A conceptual framework based on activity theory for mobile CSCL. Br. J. Educ. Technol. 2007, 38, 211–235. [Google Scholar] [CrossRef]
- Park, Y.A. Pedagogical framework for mobile learning: Categorizing educational applications of mobile technologies into four types. Int. Rev. Res. Open Distance Learn. 2011, 12, 78–102. [Google Scholar] [CrossRef] [Green Version]
- Parsazadeh, N.; Rosmah, A.; Rezaeia, M. A framework for cooperative and interactive mobile learning to improve online information evaluation skills. Comput. Educ. 2018, 120, 75–89. [Google Scholar] [CrossRef]
- Sha, L.; Looi, C.-K.; Chen, W.; Zhang, B.H. Understanding mobile learning from the perspective of self-regulated learning. J. Comput. Assist. Learn. 2012, 28, 366–378. [Google Scholar] [CrossRef]
- Hwang, G.-J.; Yang, T.-C.; Tsai, C.-C.; Yang, S.J.H. A context-aware ubiquitous learning environment for conducting complex science experiments. Comput. Educ. 2009, 53, 402–413. [Google Scholar] [CrossRef]
- Harchay, A.; Cheniti-Belcadhi, L.; Braham, R. A context-aware approach for personalized mobile self-assessment. J. Univers. Comput. Sci. 2015, 21, 1061–1085. [Google Scholar]
- Yin, C.; Song, Y.; Tabata, Y.; Ogata, H.; Hwang, G.-J. Developing and implementing a framework of participatory simulation for mobile learning using scaffolding. Educ. Technol. Soc. 2013, 16, 137–150. [Google Scholar]
- Hartnett, M. The importance of motivation in online learning. In Motivation in Online Education; Hartnett, M., Ed.; Springer: Singapore, 2016; pp. 5–32. [Google Scholar]
- Deci, E.L.; Ryan, R.M. Intrinsic Motivation and Self-Determination in Human Behavior; Plenum: New York, NY, USA, 1985. [Google Scholar]
- Niemiec, C.P.; Ryan, R.M. Autonomy, competence, and relatedness in the classroom: Applying self-determination theory to educational practice. Theory Res. Educ. 2009, 7, 133–144. [Google Scholar] [CrossRef]
- Simons, J.J.P. Psychological frameworks for persuasive information and communication technologies. IEEE Pervasive Comput. 2016, 16, 536–1268. [Google Scholar] [CrossRef]
- Reeve, J.; Ryan, R.M.; Deci, E.L.; Jang, H. Understanding and promoting autonomous self-regulation: A self-determination theory perspective. In Motivation and Self-Regulated Learning: Theory, Research, and Applications; Schunk, D.H., Zimmerman, B.J., Eds.; Lawrence Erlbaum: New York, NY, USA, 2008; pp. 223–244. [Google Scholar]
- Chen, K.C.; Jang, S.J. Motivation in online learning: Testing a model of self-determination theory. Comput. Hum. Behav. 2010, 26, 741–752. [Google Scholar] [CrossRef]
- Roca, J.C.; Gagné, M. Understanding e-learning continuance intention in the workplace: A self-determination theory perspective. Comput. Hum. Behav. 2008, 24, 1585–1604. [Google Scholar] [CrossRef]
- Sorebo, O.; Halvari, H.; Gulli, V.F.; Kristiansen, R. The role of self-determination theory in explaining teachers’ motivation to continue to use e-learning technology. Comput. Educ. 2009, 53, 1177–1187. [Google Scholar] [CrossRef]
- Nikou, S.A.; Economides, A.A. Mobile-Based Assessment: Integrating acceptance and motivational factors into a combined model of Self-Determination Theory and Technology Acceptance. Comput. Hum. Behav. 2017, 68, 83–95. [Google Scholar] [CrossRef]
- Hartnett, M.; St. George, A.; Dron, J. Examining motivation in online distance learning environments: Complex, multifaceted and situation-dependent. Int. Rev. Res. Open Distance Learn. 2011, 12, 20–38. [Google Scholar] [CrossRef] [Green Version]
- Ryan, R.M.; Deci, E.L. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemp. Educ. Psychol. 2000, 25, 54–67. [Google Scholar] [CrossRef] [PubMed]
- Reeve, J.; Halusic, M. How K-12 teachers can put self-determination theory principles into practice. Theory Res. Educ. 2009, 7, 145–154. [Google Scholar] [CrossRef]
- Wang, J.C.K.; Ng, B.L.L.; Liu, W.C.; Ryan, R.M. Can being autonomy-supportive in teaching improve students’ self-regulation and performance? In Building Autonomous Learners. Perspectives from Research and Practice Using Self-Determination Theory; Springer: Berlin, Germany, 2015; pp. 227–243. [Google Scholar]
- Csikszentmihalyi, M. Flow: The Psychology of Optimal Experience; Harper & Row: Manhattan, NY, USA, 1990. [Google Scholar]
- Burgers, C.; Eden, A.; van Engelenburg, M.D.; Buningh, S. How feedback boosts motivation and play in a brain-training game. Comput. Hum. Behav. 2015, 48, 94–103. [Google Scholar] [CrossRef] [Green Version]
- Bruck, P.A.; Motiwalla, L.; Foerster, F. Mobile learning with micro-content: A framework and evaluation. In Proceedings of the BLED 2012, Bled, Slovenia, 17–20 June 2012; Available online: http://aisel.aisnet.org/bled2012/2 (accessed on 30 April 2021).
- Adams Becker, S.; Freeman, A.; Giesinger Hall, C.; Cummins, M.; Yuhnke, B. NMC/CoSN Horizon Report: 2016 K-12 Edition; The New Media Consortium: Austin, TX, USA, 2016. [Google Scholar]
- Cochrane, T.; Antonczak, L. Designing Creative Learning Environments. Interact. Des. Archit. 2015, 24, 125–144. [Google Scholar]
- FitzGerald, E. Creating user-generated content for location-based learning: An authoring framework. J. Comput. Assist. Learn. 2012, 28, 195–207. [Google Scholar] [CrossRef]
- Burchell, H.; Woolhouse, M. Learner autonomy in competence-based post-compulsory teacher education. Br. J. Serv. Educ. 1995, 21, 137–148. [Google Scholar] [CrossRef]
- Lucke, U.; Rensing, C. A survey on pervasive education. Pervasive Mob. Comput. 2014, 14, 3–16. [Google Scholar] [CrossRef]
- Wong, L.H.; Looi, C.K. What seams do we remove in mobile-assisted seamless learning? A critical review of the literature. Comput. Educ. 2011, 57, 2364–2381. [Google Scholar] [CrossRef] [Green Version]
- Bruer, J.T. Schools for Thought: A Science of Learning in the Classroom; MIT Press: Cambridge, MA, USA, 1993. [Google Scholar]
- Zimmerman, B.J.; Schunk, D.H. Reflections on theories of self-regulated learning and academic achievement. In Self-Regulated Learning and Academic Achievement: Theoretical Perspectives; Zimmerman, B.J., Schunk, D.H., Eds.; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, USA, 2001; pp. 289–307. [Google Scholar]
- Song, Y.; Wong, L.-H.; Looi, C.-K. Fostering personalized learning in science inquiry supported by mobile technologies. Educ. Technol. Res. Dev. 2012, 60, 679–701. [Google Scholar] [CrossRef]
- Bertucci, A.; Conte, S.; Johnson, D.W.; Johnson, R.T. The impact of size of cooperative group on achievement, social support, and self-esteem. J. Gen. Psychol. 2010, 137, 256–272. [Google Scholar] [CrossRef]
- Fu, Q.-K.; Hwang, G.-J. Trends in mobile technology-supported collaborative learning: A systematic review of journal publications from 2007 to 2016. Comput. Educ. 2018, 119, 129–143. [Google Scholar] [CrossRef]
- Johnson, L.; Becker, S.A.; Cummins, M.; Estrada, V.; Freeman, A.; Hall, C. NMC Horizon Report: 2016 Higher Education Edition; The New Media Consortium: Austin, TX, USA, 2016. [Google Scholar]
- Farell, D.; Moffat, D. Applying the self-determination theory of motivation in game-based learning. In Proceedings of the European Conference on Games Based Learning, Berlin, Germany, 9–10 October 2014; Volume 1, pp. 118–127. [Google Scholar]
- Economides, A.A. Adaptive context-aware pervasive and ubiquitous learning. Int. J. Technol. Enhanc. Learn. 2009, 1, 169–192. [Google Scholar] [CrossRef]
- Milrad, M.; Wong, L.-H.; Sharples, M.; Hwang, G.-J.; Looi, C.-K.; Ogata, H. Seamless Learning: An international perspective on next generation technology enhanced learning. In Handbook of Mobile Learning; Berge, Z.L., Muilenburg, L.Y., Eds.; Routledge: New York, NY, USA, 2013; pp. 95–108. [Google Scholar]
- Graf, S.; Liu, T.-C. Analysis of learners’ navigational behaviour and their learning styles in an online course. J. Comput. Assist. Learn. 2010, 26, 116–131. [Google Scholar] [CrossRef]
- Jeno, L.M.; Grytnes, L.-A.; Vandvik, V. The effect of a mobile-application tool on biology students’ motivation and achievement in species identification: A Self-Determination Theory perspective. Comput. Educ. 2017, 107, 1–12. [Google Scholar] [CrossRef]
- Cordova, D.I.; Lepper, M.R. Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. J. Educ. Psychol. 1996, 88, 715–730. [Google Scholar] [CrossRef]
- Pachler, N.; Bachmair, B.; Cook, J. Mobile Learning: Structures, Agency, Practices; Springer: New York, NY, USA, 2009. [Google Scholar]
- Moridis, C.N.; Economides, A.A. Affective learning: Empathetic agents with emotional facial and tone of voice expressions. IEEE Trans. Affect. Comput. 2012, 3, 260–272. [Google Scholar] [CrossRef]
- Butz, N.T.; Stupnisky, R.H. Improving student relatedness through an online discussion intervention: The application of self-determination theory in synchronous hybrid programs. Comput. Educ. 2017, 114, 117–138. [Google Scholar] [CrossRef]
- LeNoue, M.; Hall, T.; Eighmy, M.A. Adult education and the social media revolution. Adult Learn. 2011, 22, 4–12. [Google Scholar] [CrossRef] [Green Version]
- Hew, T.-S.; Kadir, S.L.S.A. Applying Channel Expansion and Self-Determination Theory in predicting use behaviour of cloud-based VLE. Behav. Inf. Technol. 2017, 36, 875–896. [Google Scholar] [CrossRef]
- Hsu, Y.-S.; Lin, Y.-H.; Yang, B. Impact of augmented reality lessons on students’ STEM interest. Res. Pract. Technol. Enhanc. Learn. 2017, 12, 2. [Google Scholar] [CrossRef] [Green Version]
- McAuley, E.; Duncan, T.; Tammen, V.V. Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: A confirmatory factor analysis. Res. Q. Exerc. Sport 1989, 60, 48–58. [Google Scholar] [CrossRef]
- Baard, P.P.; Deci, E.L.; Ryan, R.M. Intrinsic need satisfaction: A motivational basis of performance and well-being in two work settings. J. Appl. Soc. Psychol. 2004, 34, 2045–2068. [Google Scholar] [CrossRef]
- Volet, S.; Kimmel, K. Editorial introduction: Motivation and learning in multiple contexts. Eur. J. Psychol. Educ. 2012, 27, 155–160. [Google Scholar] [CrossRef]
- Cohen, J. Statistical Power Analysis for the Behavioral Sciences; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 1988. [Google Scholar]
- Shute, V.J.; Rahimi, S. Review of computer-based assessment for learning in elementary and secondary education. J. Comput. Assist. Learn. 2017, 33, 1–19. [Google Scholar] [CrossRef]
- Nikou, S.A.; Economides, A.A. Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018. Comput. Educ. 2018, 125, 101–119. [Google Scholar] [CrossRef]
- Sung, Y.-T.; Chang, K.-E.; Liu, T.-C. The effects of integrating mobile devices with teaching and learning on students’ learning performance: A meta-analysis and research synthesis. Comput. Educ. 2016, 94, 252–275. [Google Scholar] [CrossRef] [Green Version]
- Crompton, H.; Burke, D.; Gregory, K.H.; Gräbe, C. The use of mobile learning in science: A systematic review. J. Sci. Educ. Technol. 2016, 25, 149–160. [Google Scholar] [CrossRef]
- Lim, C.P.; Chai, C.S. An activity-theoretical approach to research of ICT integration in Singapore schools: Orienting activities and learner autonomy. Comput. Educ. 2004, 43, 215–236. [Google Scholar] [CrossRef]
- Chen, F.C.; Wang, T.C. Social conversation and effective discussion in online group learning. Educ. Technol. Res. Dev. 2009, 57, 587–612. [Google Scholar] [CrossRef]
- Cochrane, T.D. Critical success factors for transforming pedagogy with mobile Web 2.0. Br. J. Educ. Technol. 2014, 45, 65–82. [Google Scholar] [CrossRef]
- Pintrich, P.R.; De Groot, E. Motivational and self-regulated learning components of classroom academic. Perform. J. Educ. Psychol. 1990, 82, 33–40. [Google Scholar] [CrossRef]
- Kearney, M.; Schuck, S.; Burden, K.; Aubusson, P. Viewing mobile learning from a pedagogical perspective. Res. Learn. Technol. 2012, 20, 14406. [Google Scholar] [CrossRef]
- Troussas, C.; Krouska, A.; Sgouropoulou, C. Collaboration and fuzzy-modeled personalization for mobile game-based learning in higher education. Comput. Educ. 2020, 144, 103698. [Google Scholar] [CrossRef]
Learning and Assessment Activities | Control Group | Experimental Group | |
---|---|---|---|
Self-assessment | |||
AfL1 | Electrical circuits | Paper worksheets with face-to-face tutor feedback | Mobile-based guided activities using QR-codes with mobile-based feedback |
AfL2 | Biodiversity Assessment of student portfolios | ||
AfL1 | Assembly of electrical circuits | Paper sketches | Mobile device camera |
AfL2 | Leaf morphologies and taxonomy of plants | ||
Assessment of collaborative learning | |||
AfL1 | Electrical measurements | Collaborative answers on paper worksheets | Collaborative answers on cloud-based shared documents |
AfL2 | Plant taxonomies Peer Assessment | ||
AfL1 | Electrical circuits artifacts | Face-to-face discussions and peer feedback on paper worksheets | Face-to-face discussions and on-line peer feedback using class social media |
AfL2 | Plant taxonomy artifacts and biodiversity |
Variable | Group | N | Mean | SD | Adjusted Mean | Std. Error | F Value |
---|---|---|---|---|---|---|---|
Autonomy | Control | 25 | 4.23 | 0.89 | 4.21 | 0.17 | 12.43 *** |
Experimental | 26 | 5.04 | 0.91 | 5.05 | 0.16 | ||
Competence | Control | 25 | 4.58 | 0.96 | 4.59 | 0.09 | 10.18 ** |
Experimental | 26 | 4.99 | 1.05 | 4.99 | 0.08 | ||
Relatedness | Control | 25 | 3.22 | 0.83 | 3.29 | 0.06 | 14.03 *** |
Experimental | 26 | 3.69 | 1.17 | 3.63 | 0.06 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Nikou, S.A.; Economides, A.A. A Framework for Mobile-Assisted Formative Assessment to Promote Students’ Self-Determination. Future Internet 2021, 13, 116. https://doi.org/10.3390/fi13050116
Nikou SA, Economides AA. A Framework for Mobile-Assisted Formative Assessment to Promote Students’ Self-Determination. Future Internet. 2021; 13(5):116. https://doi.org/10.3390/fi13050116
Chicago/Turabian StyleNikou, Stavros A., and Anastasios A. Economides. 2021. "A Framework for Mobile-Assisted Formative Assessment to Promote Students’ Self-Determination" Future Internet 13, no. 5: 116. https://doi.org/10.3390/fi13050116
APA StyleNikou, S. A., & Economides, A. A. (2021). A Framework for Mobile-Assisted Formative Assessment to Promote Students’ Self-Determination. Future Internet, 13(5), 116. https://doi.org/10.3390/fi13050116