Bayesian Hierarchical Modelling of Student Academic Performance: The Impact of Mathematics Competency, Institutional Context, and Temporal Variability
Abstract
:1. Introduction
1.1. Theoretical Framework
1.2. Reviewed Studies
1.3. Research Questions
- To what extent do high school mathematics marks influence the academic performance of undergraduate STEM students at a South African university?
- How does gender impact student academic success in STEM programmes?
- How does age impact student academic success in STEM programmes?
- What is the role of socio-economic status, represented by school quintiles, in shaping the academic outcomes of STEM students?
- How do admission scores affect students’ average marks and overall academic performance?
- What impacts do progression rates have on students’ average marks and overall academic performance?
- What variability exists across different academic programmes and years in relation to student success, and how do these group-level factors influence academic outcomes?
1.4. Hypotheses
- H1: High school mathematics marks have a significant positive effect on the academic performance of undergraduate STEM students.
- H2: There is no significant difference in academic performance between male and female students enrolled in STEM programmes.
- H3: Age has no significant effect on the academic performance of undergraduate STEM students.
- H4: Socio-economic status, as represented by school quintiles, significantly influences the academic outcomes of STEM students.
- H5: Admission Point (AP) scores do not significantly predict student academic performance in STEM programmes.
- H6: Progression rates significantly positively impact the academic performance of students in STEM programmes.
- H7: Variability in academic performance is significantly influenced by the academic programme and the year of study.
2. Materials and Methods
2.1. Research Design
Hierarchical Bayesian Analysis
- ○
- represents an observation at the individual level within group ;
- ○
- is the group-specific mean;
- ○
- is the overall mean across groups;
- ○
- to represent group-level and individual-level variances, respectively.
2.2. Sample and Sampling Procedure
2.3. Data Collection
2.4. Measures
2.5. Statistical Analysis
3. Results
3.1. Descriptive Statistics
3.2. Bayesian Hierarchical Modelling Empirical Study
- ○
- indexes individual students;
- ○
- indexes academic programmes;
- ○
- indexes academic years;
- ○
- is the overall intercept;
- ○
- to are the fixed effect coefficients;
- ○
- represents the random intercept for academic programme ;
- ○
- represents the random intercept for academic year ;
- ○
- is the residual error term.
- ○
- AP: admission point score;
- ○
- Gr12FM: Grade 12 final mathematics mark (NSC);
- ○
- CredPlan: total credit plan;
- ○
- Age: age of student;
- ○
- AvgMark: average university mark;
- ○
- Credits: credits passed;
- ○
- Progress: progression rate.
3.3. Testing Existence of Multicollinearity
- ○
- b_school_quintile3: Students from schools in the third socio-economic quintile;
- ○
- b_school_quintile2: Students from schools in the second socio-economic quintile;
- ○
- b_school_quintile4: Students from schools in the fourth socio-economic quintile;
- ○
- b_grt12_fmath_nsc_marks: Grade 12 final mathematics marks (NSC);
- ○
- b_progression_rate: Progression rate, calculated as the ratio of credits passed to total credits required;
- ○
- b_age: Age of the student;
- ○
- b_ap_score: Admission Point Score (AP Score), reflecting the student’s overall high school academic performance;
- ○
- b_genderMALE: Gender, specifically male students in the sample;
- ○
- b_Intercept: Intercept term in the statistical model, representing the baseline level of the outcome variable when all predictors are set to zero.
3.4. Motivation for the Choices of Priors
- is the regression coefficient for the jth predictor;
- is the intercept of the regression model;
- : is the standard deviation of the kth random effect (e.g., for academic programs or years);
- is the normal (Gaussian) distribution with the mean, , and variance, ;
- is the Cauchy distribution with the location parameter, , and scale parameter, .
3.5. Summary of Findings
4. Discussion
5. Conclusions
5.1. Limitation
5.2. Educational Implications and Recommendations
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Anderton, R., Hine, G., & Joyce, C. (2017). Secondary school mathematics and science matters: Predicting academic success for secondary students transitioning into university allied health and science courses. International Journal of Innovation in Science and Mathematics Education, 25(1), 34–47. Available online: https://openjournals.library.sydney.edu.au/CAL/article/view/11317 (accessed on 15 September 2024).
- Autor, D., Figlio, D., Karbownik, K., Roth, J., & Wasserman, M. (2019). Family disadvantage and the gender gap in behavioral and educational outcomes. American Economic Journal: Applied Economics, 11(3), 338–381. [Google Scholar] [CrossRef]
- Becker, G. S. (1964). Human capital: A theoretical and empirical analysis, with special reference to education. University of Chicago Press. [Google Scholar]
- Britten, G., Mohajerani, Y., Primeau, F., Aydın, M., Garcia, C., Wang, W., Pasquier, B., Cael, B. B., & Primeau, F. W. (2021). Evaluating the benefits of Bayesian hierarchical methods for analyzing heterogeneous environmental datasets: A case study of marine organic carbon fluxes. Frontiers in Environmental Science, 9, 491636. [Google Scholar] [CrossRef]
- Brunner, M., Keller, U., Wenger, M., Fischbach, A., & Lüdtke, O. (2018). Between-school variation in students’ achievement, motivation, affect, and learning strategies: Results from 81 countries for planning group-randomized trials in education. Journal of Research on Educational Effectiveness, 11(3), 452–478. [Google Scholar] [CrossRef]
- Burns, S. M. (2011). Predicting academic progression for student registered nurse anesthetists. AANA Journal, 79(3), 203–210. [Google Scholar]
- Casanova, J. R., Castro-López, A., Bernardo, A. B., & Almeida, L. S. (2023). The dropout of first-year STEM students: Is it worth looking beyond academic achievement? Sustainability, 15(2), 1253. [Google Scholar] [CrossRef]
- Cáceres-Delpiano, J., & Giolito, E. P. (2019). The impact of age of entry on academic progression. In A. Tavidze (Ed.), Progress in economic research (Vol. 39, pp. 249–267). Springer International Publishing. [Google Scholar] [CrossRef]
- Charlesworth, T. E. S., & Banaji, M. R. (2019). Gender in science, technology, engineering, and mathematics: Issues, causes, solutions. Journal of Neuroscience, 39(37), 7228–7243. [Google Scholar] [CrossRef] [PubMed]
- Çelikkol, Ö. (2023). Impacts of the school starting age on academic achievement. Shanlax International Journal of Education, 11(S1), 208–215. [Google Scholar] [CrossRef]
- Dabaliz, A. A., Hamadeh, G. N., Farhat, F., El Zein, H., Kabbara, S., & Malaeb, D. (2017). Predictive validity of pre-admission assessments on medical student performance. International Journal of Medical Education, 8, 408–412. [Google Scholar] [CrossRef] [PubMed]
- Edwards, D., Friedman, T., & Pearce, J. (2013). Same admissions tools, different outcomes: A critical perspective on predictive validity in three undergraduate medical schools. BMC Medical Education, 13, 173. [Google Scholar] [CrossRef]
- Egara, F. O., & Mosimege, M. D. (2023). Gender difference in secondary school students’ retention in algebra: A computer simulation approach. EURASIA Journal of Mathematics, Science and Technology Education, 19(7), 1–9. [Google Scholar] [CrossRef] [PubMed]
- Egara, F. O., & Mosimege, M. D. (2024). Effect of blended learning approach on secondary school learners’ mathematics achievement and retention. Education and Information Technologies, 29, 19863–19888. [Google Scholar] [CrossRef]
- Gelman, A., Carlin, J., Stern, H., & Rubin, D. (2003). Bayesian data analysis (2nd ed.). Chapman & Hall/CRC. [Google Scholar] [CrossRef]
- Goings, R. B., & Boyd, B. (2024). The influence of the Sherman STEM Teacher Scholars Program on persistence in science, technology, engineering, and mathematics: A mixed-methods study. Education Sciences, 14(10), 1076. [Google Scholar] [CrossRef]
- Harding, M. M. (2012). Efficacy of progression testing in predicting nursing student academic success. Journal of Nursing Education and Practice, 2(2), 137–140. [Google Scholar] [CrossRef]
- Hsieh, T. L., & Yu, P. (2023). Exploring achievement motivation, student engagement, and learning outcomes for STEM college students in Taiwan through the lenses of gender differences and multiple pathways. Research in Science & Technological Education, 41(3), 1072–1087. [Google Scholar] [CrossRef]
- Huang, M. (2024). Predictive performance of Bayesian stacking in multilevel education data. Journal of Educational and Behavioral Statistics, 1–25. [Google Scholar] [CrossRef]
- Islam, M. M., & Al-Ghassani, A. (2015). Predicting college math success: Do high school performance and gender matter? Evidence from Sultan Qaboos University in Oman. International Journal of Higher Education, 4(2), 67–80. [Google Scholar] [CrossRef]
- Kazu, İ. Y., & Kurtoğlu Yalçın, C. (2021). The effect of STEM education on academic performance: A meta-analysis study. Turkish Online Journal of Educational Technology, 20(4), 101–115. Available online: https://files.eric.ed.gov/fulltext/EJ1313488.pdf (accessed on 17 September 2024).
- Lee, K. S., Rix, B., & Spivey, M. Z. (2021). Predictions of success in organic chemistry based on a mathematics skills test and academic achievement. Chemistry Education Research and Practice, 24(1), 176–191. [Google Scholar] [CrossRef]
- Liu, J., Peng, P., & Luo, L. (2020). The relation between family socioeconomic status and academic achievement in China: A meta-analysis. Educational Psychology Review, 32, 49–76. [Google Scholar] [CrossRef]
- Lubishtani, F. Q., & Avdylaj, B. T. (2023). The importance of high school on university students’ success in the subject of mathematics. Frontiers in Education, 8, 933465. [Google Scholar] [CrossRef]
- Molontay, R., & Nagy, M. (2023). How to improve the predictive validity of a composite admission score? A case study from Hungary. Assessment & Evaluation in Higher Education, 48(4), 419–437. [Google Scholar] [CrossRef]
- Mosia, M., & Egara, F. O. (2024a). Predictors of student success in mathematics: Hierarchical bayesian approach. International Journal of Applied Engineering & Technology, 6(2), 59–72. Available online: https://romanpub.com/resources/Vol%206%20%2C%20No%202%20-%207.pdf (accessed on 5 October 2024).
- Mosia, M., & Egara, F. O. (2024b). Sustaining retentive memory of mathematics concepts in adolescents utilising game-based learning: A case of repeated measures. International Journal of Learning, Teaching and Educational Research, 23(7), 413–434. [Google Scholar] [CrossRef]
- Mosia, M., Egara, F. O., Nannim, F., & Basitere, M. (2025). Bayesian Growth Curve Modelling of Student Academic Trajectories: The Impact of Individual-Level Characteristics and Implications for Education Policy. Applied Sciences, 15(1426), 1426. [Google Scholar] [CrossRef]
- Munir, J., Faiza, M., Jamal, B., Daud, S., & Iqbal, K. (2023). The impact of socio-economic status on academic achievement. Journal of Social Science Review, 3(2), 695–705. [Google Scholar] [CrossRef]
- Nagy, M., & Molontay, R. (2021). Comprehensive analysis of the predictive validity of the university entrance score in Hungary. Assessment & Evaluation in Higher Education, 46(8), 1235–1253. [Google Scholar] [CrossRef]
- Nam, K. (2014). Until when does the effect of age on academic achievement persist? Evidence from Korean data. Economics of Education Review, 40, 106–122. [Google Scholar] [CrossRef]
- Nitzan-Tamar, O., & Kohen, Z. (2022). Secondary school mathematics and entrance into the STEM professions: A longitudinal study. International Journal of STEM Education, 9, 63. [Google Scholar] [CrossRef]
- Ogbonnaya, U., & Awuah, F. K. (2019). Quintile ranking of schools in South Africa and learners’ achievement in probability. Statistics Education Research Journal, 18(1), 106–119. [Google Scholar] [CrossRef]
- Okeke, A. M., Egara, F. O., & Mosia, M. (2025). The Van Hiele model’s effects on student attitudes and achievement in geometry content ofsenior secondary mathematics. International Journal of Pedagogy and Curriculum, 32(1), 81–105. [Google Scholar] [CrossRef]
- Pennington, C. R., Kaye, L. K., Qureshi, A. W., & Heim, D. (2021). Do gender differences in academic attainment correspond with scholastic attitudes? An exploratory study in a UK secondary school. Journal of Applied Social Psychology, 51(1), 3–17. [Google Scholar] [CrossRef]
- Rickels, H. A. (2017). Predicting college readiness in STEM: A longitudinal study of Iowa students [Doctoral dissertation, University of Iowa]. [Google Scholar] [CrossRef]
- Sánchez, T., Gilar-Corbi, R., Castejón, J. L., Vidal, J., & León, J. (2020). Students’ evaluation of teaching and their academic achievement in a higher education institution of Ecuador. Frontiers in Psychology, 11, 233. [Google Scholar] [CrossRef]
- Schreiber, B., & Yu, D. (2016). Exploring student engagement practices at a South African university: Student engagement as a reliable predictor of academic performance. South African Journal of Higher Education, 30(5), 157–175. [Google Scholar] [CrossRef]
- Simelane, B., & Engelbrecht, J. (2023). Measuring the mathematical maturity of students in an academic development programme. International Journal of Research in Undergraduate Mathematics Education, 10, 577–606. [Google Scholar] [CrossRef]
- Singh, P., & Choudhary, G. (2015). Impact of socio-economic status on academic achievement of school students: An investigation. International Journal of Applied Research, 1(4), 266–272. [Google Scholar]
- Spaull, N. (2013). Poverty and privilege: Primary school inequality in South Africa. International Journal of Educational Development, 33(5), 436–447. [Google Scholar] [CrossRef]
- Tandrayen-Ragoobur, V., & Gokulsing, D. (2021). Gender gap in STEM education and career choices: What matters? Journal of Applied Research in Higher Education, 13(3), 704–720. [Google Scholar] [CrossRef]
- Van Der Berg, S., & Hofmeyr, H. (2018). Education in South Africa. World Bank. [Google Scholar]
- Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press. [Google Scholar]
- Wigfield, A., & Eccles, J. S. (2000). Expectancy-value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81. [Google Scholar] [CrossRef]
- Xu, W., & Ouyang, F. (2022). The application of AI technologies in STEM education: A systematic review from 2011 to 2021. International Journal of STEM Education, 9(1), 59. [Google Scholar] [CrossRef]
- Yu, J., & McLellan, R. (2019). Beyond academic achievement goals: The importance of social achievement goals in explaining gender differences in self-handicapping. Learning and Individual Differences, 69, 33–44. [Google Scholar] [CrossRef]
- Zhang, S., Chu, H., Bickel, W., Le, C., Smith, T., Thomas, J., Donny, E. C., Hatsukami, D. K., & Luo, X. (2022). A Bayesian hierarchical model for individual participant data meta-analysis of demand curves. Statistics in Medicine, 41(12), 2276–2290. [Google Scholar] [CrossRef] [PubMed]
Predictor | Estimate | Est. Error | Rhat | ||
---|---|---|---|---|---|
Mathematics Marks | 2.13 | 0.35 | 1.45 | 2.82 | 1.00 |
Gender (Male) | −0.84 | 0.57 | −1.94 | 0.27 | 1.00 |
AP Score | 0.11 | 0.32 | −0.52 | 0.74 | 1.00 |
Age | −0.19 | 0.32 | −0.82 | 0.44 | 1.00 |
Progression Rate | 7.66 | 0.32 | 7.02 | 8.30 | 1.00 |
Grouping Factor | Estimate | Est. Error | Rhat | ||
---|---|---|---|---|---|
Plan Code | 4.26 | 1.06 | 2.58 | 6.76 | 1.00 |
School Quintile | 50.11 | 30.96 | 2.39 | 114.84 | 1.00 |
Year | 13.76 | 24.91 | 1.11 | 84.13 | 1.00 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mosia, M.; Egara, F.O.; Nannim, F.A.; Basitere, M. Bayesian Hierarchical Modelling of Student Academic Performance: The Impact of Mathematics Competency, Institutional Context, and Temporal Variability. Educ. Sci. 2025, 15, 177. https://doi.org/10.3390/educsci15020177
Mosia M, Egara FO, Nannim FA, Basitere M. Bayesian Hierarchical Modelling of Student Academic Performance: The Impact of Mathematics Competency, Institutional Context, and Temporal Variability. Education Sciences. 2025; 15(2):177. https://doi.org/10.3390/educsci15020177
Chicago/Turabian StyleMosia, Moeketsi, Felix O. Egara, Fadip A. Nannim, and Moses Basitere. 2025. "Bayesian Hierarchical Modelling of Student Academic Performance: The Impact of Mathematics Competency, Institutional Context, and Temporal Variability" Education Sciences 15, no. 2: 177. https://doi.org/10.3390/educsci15020177
APA StyleMosia, M., Egara, F. O., Nannim, F. A., & Basitere, M. (2025). Bayesian Hierarchical Modelling of Student Academic Performance: The Impact of Mathematics Competency, Institutional Context, and Temporal Variability. Education Sciences, 15(2), 177. https://doi.org/10.3390/educsci15020177