Education in Programming and Mathematical Learning: Functionality of a Programming Language in Educational Processes

Abstract

(1) Background: It is becoming more common to incorporate education in programming into educational environments. (2) Methods: In order to show the benefits of including teaching programming, we present an investigation carried out with a group of Spanish schoolchildren in the fifth year of primary education (ages 10–11). We demonstrate an integrated experience in the ordinary curriculum connecting technology to mathematics education. We created a work project for students to use Scratch and to assess its benefits, created two groups of students, an experimental and a control group, with a sample of 3795 individuals. They were administered the online version of the Battery of Mathematical Competence Evaluation (BECOMA On) at two timepoints, the pretest (the beginning of the project) and the post-test (the final stage). (3) Results: The results showed statistically significant differences between groups and timepoints, with the experimental group scoring higher, demonstrating the effectiveness of the education in programming program for mathematics. (4) Conclusions: Education systems face a challenge in the sphere of the consolidation of technologies in education with the consequent need to change didactic designs to enhance quality, equitable, sustainable education processes.

1. Introduction

Information and Communication Technologies (ICT) offer an enormous breadth of important new pedagogical tools. These tools turn out to be remarkably appealing to students, increasing their motivation in the learning process [1]. In this study, out of the wide range of technological resources applicable to schools, we focus on teaching programming. The essential core of computer education is the incorporation of programming into school contexts, rather than ICT, which is more focused on useful skills for the knowledge society. Various reports influence this conceptual differentiation [2,3]. Computer Science Education (CSE) is a research field with decades of research about teaching programming [4,5].

The inclusion of education in programming in the classroom is a reality in educational processes today [6,7]. Traditionally, the integration of Information and Communication Technologies has been focused on activities in support of learning curriculum subjects throughout the different educational levels, but education in programming requires going further. It involves the inclusion of programming under essential principles such as problem-solving and creativity [8].

Current and future schoolchildren should be considered technology consumers and creators. Furthermore, in terms of lifelong learning, the European Commission considers education in programming as a fundamental skill to be integrated into schools throughout the 21st century [9], considering its instrumental and transversal nature in the acquisition of other skills [10,11]. Teacher training, together with the early integration of learning these skills, is especially important in achieving this [12,13,14,15,16,17]. There are multiple occurrences of integration of programming into schools [10,18,19,20,21,22,23], including the work of mathematical content through programming [24,25,26,27,28,29].

One of the foundations of this integration of education in programming in schools may be the development of the Sustainable Development Goals (SDGs); the search for practical and innovative solutions to certain situations and problems could justify such a relationship. The SDGs are part of a 15-year action plan adopted by all United Nations member states in 2015 as part of the 2030 Agenda for Sustainable Development, which seeks to increase prosperity, promote peace, and eradicate global poverty before 2030. Through 17 SDG and 169 targets, it is an attempt to make human rights a reality for all [30]. The research presented below is particularly related to three goals: Goal 4—Quality Education, Goal 5—Gender Equality, and Goal 12—Sustainable Consumption and Production.

The first of those goals, Quality Education, seeks the achievement of inclusive, equitable, and quality education that promotes learning opportunities throughout life for all. Its targets include the development of the necessary skills (technical and professional competencies) in the population to access the labor market and stimulate entrepreneurship. To achieve this goal, the use of technology in educational processes is a key issue in all stages of the educational system [31,32]. There is a need to adjust educational practices to the innovations and transformations that have resulted from the integration of emerging technologies in schools. This generates progress and change and makes it essential to be able to adapt the teaching and learning processes. Innovation generates quality in education, and technology is an ideal instrument for establishing a connection between them.

The second SDG, Gender Equality, is a fundamental right to put an end to any type of discrimination between men and women. One of the targets proposed for this goal is to ensure the effective participation of women in all contexts, facilitating their leadership, decision-making, and empowerment at all levels. Despite this, there are still some problems regarding full parity [33,34,35]; a clear example being the existing inequality in scientific disciplines between men and women in different domains, as indicated by various studies [36,37,38,39,40], including mathematics [41,42,43,44,45,46].

Finally, the third goal, Sustainable Consumption and Production, highlights the need to increase the efficiency of resources and promote healthier and more responsible lifestyles. Among the targets for this goal, one thing that stands out is the importance of supporting countries in strengthening their scientific and technological capacities, in order to promote more sustainable consumption and production habits. It is necessary to combat the idea that technological consumption only causes harm to the environment [47,48]. As an example, in this study, we applied an assessment instrument electronically to a large sample of students instead of using a pencil and paper format, with consequent energy savings in courier transportation and paper consumption.

Therefore, this study establishes a connection between the three aforementioned SDGs. The application of this educational experience is aimed at providing students with strategies to solve problems and communicate ideas through the computer and the work of a programming language applied to mathematics, under the title of the project “Learn mathematics (and other things) with the new Scratch 3”. The main contribution of this article is to offer a contribution to mathematics learning, in this case, through education in programming. The study objective was to compare the results in an online version of the Battery of Mathematical Competence Evaluation (BECOMA On) between two groups of students, a control and an experimental group, at two different timepoints, pretest and post-test. Between the two timepoints, the students carried out a project with the Scratch 3 programming language; this made it possible to measure the impact of that project. In short, the study aimed to assess students’ mathematics progress via education in programming. In addition, this method of evaluation via ICT allowed a thorough evaluation of a school population, giving information about their competence and potential in mathematics.

2. Materials and Methods

2.1. Participants

This study was part of an initiative from the Spanish Ministry of Education and Vocational Training carried out during the 2018/19 academic year with students in the fifth grade of primary education (10–11 years old) through the National Institute of Educational Technologies and Faculty Training (INTEF), in collaboration with the Spanish autonomous regions and municipalities. The sample comprised 147 Spanish schools, which were selected by each autonomous region and municipality based mainly on the availability of sufficient ICT resources to carry out the study. The sample was balanced between state-funded, privately-funded, and independent (concertado) schools from both urban and rural environments.

The sample was divided into two groups of non-equivalent schoolchildren without random assignment, the experimental group (142 schools) and the control group (5 schools). The experimental group did programming activities with Scratch 3, the control group continued with their usual teaching and learning processes without working on any mathematical programming activities. Both groups participated in a pretest and post-test measurement in order to estimate the impact of the intervention with Scratch. The distribution of the participating sample is shown in

Table 1. Participating sample for the research groups.

Group	Pretest	Post-Test
Experimental (EG)	3629	2159
Control (CG)	166	97
Total	3795	2256

Source: Authors’ own work (2020).

.

As Table 1 shows, the final valid sample that participated in all the phases of the study was large: 2178 schoolchildren from 16 autonomous regions and 2 Spanish municipalities. Nevertheless, there was a loss of subjects throughout the phases mainly due to the fact that some schools had to drop out of the study due to problems with the provision of necessary computer equipment for the planned programming activities.

2.2. Variables and Instruments

The Scratch Maths program [24,25] is a project from University College London created in 2015. It is designed to support mathematical learning through curricular materials adapted to programming for students between 9 and 11 years old, with two essential aspects [13]: the algorithm and the concept of a 360° rotation. This graphical programming environment allows students to create stories, games, and interactive animations by editing scenes and objects, and subsequently to share what they create with other users.

In this experiment, we used the new version, Scratch 3, and its content was adapted to the Spanish perspective and the legislated primary education curriculum, laid out in Royal Decree 126/2014, of February 28, 2014, on the enactment of the basic curriculum for primary education. An example of its practical application can be found in The School of Computational Thinking and Its Impact on Learning: School Year 2018–2019 [49]. Students were given an introduction to the application and taught the main options in the software environment up to the creation of scenarios and objects to produce animations. The students in both the experimental and the control groups received the same hours of mathematics class according to the established curriculum, mainly content from the geometry block. However, in that class time, the experimental group also learned programming with Scratch. None of the participating students had worked with Scratch before.

In addition, to measure mathematical competence at both study timepoints, we used an online version of the Battery of Mathematical Competence Evaluation (BECOMA On). We created an ICT method for evaluating this by adapting the battery to a Google Docs questionnaire, which allowed a thorough evaluation to be carried out on a school population in order to determine their competence and potential for mathematics. This instrument has 30 items with a score of 0, 1, or 2 points, with the total score ranging from 0 to 60 points. The items are divided into content blocks: Arithmetic (14 items), Geometry (5 items), Magnitudes and Proportionality (6 items), and Statistics and Probability (5 items). In terms of statistical validity [45], the test shows a reliability index of 0.83, and validity indices between 0.78 and 0.86 (criterion and construct).

2.3. Process

Before the study proper, the fifth grade primary teachers were given a tutored online training course of about 30 h on Scratch 3, between December 2018 and February 2019. This course addressed computer programming in the teaching and learning processes for the area of mathematics, from conceptualization to implementation and integration. This was to ensure that students would be taught programming as well as mathematical concepts. In addition, the teachers were introduced to the BECOMA On in a training seminar, and they learned about its structure and conceptualization, as well as instructions and recommendations for its application. Those educators that passed this training activity went on to perform the implementation phase in the classroom with the students in the experimental group for 40 h over three months, from March to May 2019. The work with Scratch was divided into three modules: Mosaic Patterns, the Geometry of the Beetle, and Interacting Objects. Each module included practice activities for students to learn how to handle the program, together with the key vocabulary worked on. All of this learning content was given exclusively in schools. The control group was taught via the regular teaching–learning process without using any alternative educational tools for mathematics education, such as Geogebra. Education in programming was only given to the experimental group. Students in both the experimental and control groups took the initial pretest in February 2019, before the Scratch experiment, and the post-test in June 2019 [49].

3. Results

The reliability at both study timepoints was high, with a Cronbach Alpha of 0.81 at the pretest and 0.84 at the post-test. The descriptive statistics for the two timepoints are shown in

Table 2. Descriptive statistics at the pretest and post-test.

	Min	Max	M	SD	Asymmetry	Kurtosis
Pretest	3	59	36.08	9.27	−0.03	−0.30
Post-test	11	60	38.79	9.59	−0.09	−0.54

Source: Authors’ own work (2020).

.

The scores increased between the two study timepoints, the mean at the pretest being 36.08 (SD = 9.27) and at post-test, 38.79 (SD = 9.59). We conducted an analysis of covariance (ANCOVA) in order to examine the impact of the mathematics programming project and determine any statistically significant differences at the post-test between the experimental group and the control group. We found statistically significant differences, with an F value = 17.76 and a significance p < 0.001. The effect size of the intervention project for both groups and both study timepoints was 0.45, reflecting a medium or moderate effect [50]. This showed that the intervention project had a significant impact on the mathematical competence of the students in the experimental group, in contrast to the children in the control group.

In order to look more deeply into those differences, to examine which items had the greater impact on the differences in the results between the study timepoints, we performed t-tests for a comparison of means for each timepoint, assessing the items that make up the BECOMA On and the total score. The results at the pretest are shown in

Table 3. t test for independent samples in pretest.

Items	EG		CG		t	df	p	d
	M	SD	M	SD
IT 1	1.35	0.84	1.33	0.84	−0.33	3793	0.738	0.02
IT 2	0.91	0.78	0.98	0.80	1.06	3793	0.288	0.09
IT 3	1.13	0.85	1.20	0.87	0.98	3793	0.327	0.08
IT 4	1.49	0.75	1.48	0.74	−0.14	3793	0.885	0.01
IT 5	1.54	0.71	1.52	0.74	−0.33	3793	0.741	0.03
IT 6	1.46	0.68	1.52	0.66	1.00	3793	0.315	0.09
IT 7	1.57	0.68	1.75	0.52	3.37	3793	0.001 **	0.27
IT 8	1.33	0.79	1.51	0.74	2.84	3793	0.005 **	0.23
IT 9	1.12	0.83	1.30	0.79	2.78	3793	0.005 **	0.22
IT 10	0.92	0.80	1.05	0.80	2.10	3793	0.036 *	0.16
IT 11	0.73	0.84	1.00	0.90	4.04	3793	0.000 ***	0.32
IT 12	1.43	0.87	1.48	0.83	0.79	3793	0.430	0.06
IT 13	1.61	0.72	1.63	0.72	0.33	3793	0.740	0.03
IT 14	1.63	0.65	1.55	0.71	−1.59	3793	0.113	0.12
IT 15	1.03	0.77	0.95	0.76	−1.40	3793	0.160	0.10
IT 16	0.81	0.77	0.80	0.73	−0.32	3793	0.748	0.01
IT 17	0.80	0.76	0.75	0.76	−0.85	3793	0.397	0.07
IT 18	1.07	0.75	1.00	0.73	−1.10	3793	0.271	0.09
IT 19	1.05	0.74	1.07	0.76	0.43	3793	0.664	0.03
IT 20	1.13	0.89	1.20	0.89	1.05	3793	0.295	0.08
IT 21	0.81	0.89	1.00	0.91	2.62	3793	0.009 **	0.21
IT 22	1.48	0.84	1.43	0.87	−0.81	3793	0.418	0.06
IT 23	1.16	0.89	1.14	0.89	−0.26	3793	0.793	0.02
IT 24	1.04	0.86	0.92	0.83	−1.86	3793	0.063	0.14
IT 25	1.28	0.80	1.13	0.87	−2.39	3793	0.017 *	0.19
IT 26	0.97	0.75	1.01	0.75	0.54	3793	0.589	0.05
IT 27	1.13	0.96	0.95	0.95	−2.39	3793	0.017 *	0.19
IT 28	0.56	0.65	0.51	0.61	−0.97	3793	0.332	0.08
IT 29	0.98	0.75	1.01	0.73	0.42	3793	0.674	0.04
IT 30	1.27	0.81	1.23	0.83	−0.50	3793	0.616	0.05
Total	34.80	9.69	35.38	90.74	0.75	3793	0.454	0.06

* Significant at 5% (p < 0.05). ** Significant at 1% (p < 0.01). *** Significant at 0.01% (p < 0.001). Source: Authors’ own work (2020).

.

Table 3 shows that there were significant differences between the two groups in various items at the pretest. The experimental group scored higher in Items 25 (p < 0.05) and 27 (p < 0.05), the control group scored higher in in items 7 (p < 0.01), 8 (p < 0.01), 9 (p < 0.05), 10 (p < 0.01), 11 (p < 0.001), and 21 (p < 0.01). In all these items with statistically significant differences, the effect size indices ranged between 0.16 and 0.32.

The post-test results are shown in

Table 4. t test for independent samples in post-test.

Items	EG		CG		t	df	p	d
	M	SD	M	SD
IT 1	1.46	0.81	1.43	0.73	−0.37	2254	0.710	0.04
IT 2	1.02	0.79	1.10	0.78	0.96	2254	0.339	0.10
IT 3	1.24	0.85	1.12	0.87	−1.29	2254	0.198	0.14
IT 4	1.59	0.68	1.53	0.69	−0.88	2254	0.376	0.09
IT 5	1.66	0.62	1.70	0.60	0.60	2254	0.547	0.06
IT 6	1.49	0.66	1.60	0.59	1.64	2254	0.101	0.17
IT 7	1.62	0.63	1.75	0.52	1.96	2254	0.051	0.21
IT 8	1.42	0.75	1.67	0.64	3.17	2254	0.002 **	0.34
IT 9	1.31	0.78	1.39	0.76	0.97	2254	0.332	0.10
IT 10	1.17	0.76	1.22	0.78	0.60	2254	0.549	0.07
IT 11	0.97	0.86	1.03	0.86	0.71	2254	0.480	0.07
IT 12	1.66	0.72	1.71	0.68	0.67	2254	0.504	0.07
IT 13	1.77	0.57	1.76	0.61	−0.14	2254	0.889	0.02
IT 14	1.71	0.57	1.51	0.72	−3.39	2254	0.001 **	0.35
IT 15	1.12	0.77	1.14	0.79	0.29	2254	0.770	0.03
IT 16	0.98	0.80	0.87	0.80	−1.36	2254	0.173	0.14
IT 17	0.94	0.77	0.88	0.78	−0.75	2254	0.451	0.08
IT 18	1.23	0.74	1.11	0.78	−1.44	2254	0.149	0.16
IT 19	1.21	0.72	1.09	0.76	−1.58	2254	0.114	0.17
IT 20	1.23	0.87	1.05	0.88	−1.96	2254	0.051	0.21
IT 21	0.98	0.91	0.77	0.81	−2.18	2254	0.029 *	0.23
IT 22	1.58	0.78	1.44	0.85	−1.68	2254	0.093	0.18
IT 23	1.22	0.87	1.13	0.91	−0.95	2254	0.334	0.10
IT 24	1.10	0.86	1.03	0.85	−0.75	2254	0.455	0.08
IT 25	1.36	0.80	1.14	0.83	−2.59	2254	0.010 *	0.27
IT 26	1.04	0.75	0.99	0.76	−0.63	2254	0.526	0.07
IT 27	1.18	0.95	0.91	0.94	−2.74	2254	0.006 **	0.28
IT 28	0.70	0.69	0.60	0.67	−1.48	2254	0.139	0.15
IT 29	1.22	0.75	0.89	0.75	−4.25	2254	0.000 ***	0.44
IT 30	1.48	0.74	1.26	0.77	−2.83	2254	0.005 **	0.30
Total	38.65	9.66	36.84	9.53	−1.81	2254	0.070	0.19

* Significant at 5% (p < 0.05). ** Significant at 1% (p < 0.01). *** Significant at 0.01% (p < 0.001). Source: Authors’ own work (2020).

.

In the post-test, we found the opposite pattern to the pretest, with the experimental group scoring higher with statistically significant differences in more items; in this case, Items 14 (p < 0.01), 21 (p < 0.05), 27 (p < 0.01), 29 (p < 0.001), and 30 (p < 0.01). For the control group, the statistically significant difference continued in Item 8 (p < 0.01). In terms of the total score in the instrument, the experimental group had a higher mean score (38.65; SD = 9.66), than the control group (36.84; SD = 9.53), although the difference was not statistically significant (p = 0.070). The effect size at the post-test of the items with statistically significant differences ranged between 0.23 and 0.44, significantly higher than the values at the pretest, demonstrating the effectiveness of the education in programming program with the students in the experimental group.

Table 5. Difference of means between groups for the two study timepoints.

Items	EG			CG
	Post-Test	Pretest	Dif.	Post-Test	Pretest	Dif.
IT 1	1.46	1.35	0.11	1.43	1.33	0.10
IT 2	1.02	0.91	0.11	1.10	0.98	0.12
IT 3	1.24	1.13	0.11	1.12	1.20	−0.08
IT 4	1.59	1.49	0.10	1.53	1.48	0.05
IT 5	1.66	1.54	0.12	1.70	1.52	0.18
IT 6	1.49	1.46	0.03	1.60	1.52	0.08
IT 7	1.62	1.57	0.05	1.75	1.75	0.00
IT 8	1.42	1.33	0.09	1.67	1.51	0.16
IT 9	1.31	1.12	0.19	1.39	1.30	0.09
IT 10	1.17	0.92	0.25	1.22	1.05	0.17
IT 11	0.97	0.73	0.24	1.03	1.00	0.03
IT 12	1.66	1.43	0.23	1.71	1.48	0.23
IT 13	1.77	1.61	0.16	1.76	1.63	0.13
IT 14	1.71	1.63	0.08	1.51	1.55	−0.04
IT 15	1.12	1.03	0.09	1.14	0.95	0.19
IT 16	0.98	0.81	0.17	0.87	0.80	0.07
IT 17	0.94	0.80	0.14	0.88	0.75	0.13
IT 18	1.23	1.07	0.16	1.11	1.00	0.11
IT 19	1.21	1.05	0.16	1.09	1.07	0.02
IT 20	1.23	1.13	0.10	1.05	1.20	−0.15
IT 21	0.98	0.81	0.17	0.77	1.00	−0.23
IT 22	1.58	1.48	0.10	1.44	1.43	0.01
IT 23	1.22	1.16	0.06	1.13	1.14	−0.01
IT 24	1.10	1.04	0.06	1.03	0.92	0.11
IT 25	1.36	1.28	0.08	1.14	1.13	0.01
IT 26	1.04	0.97	0.07	0.99	1.01	−0.02
IT 27	1.18	1.13	0.05	0.91	0.95	−0.04
IT 28	0.70	0.56	0.14	0.60	0.51	0.09
IT 29	1.22	0.98	0.24	0.89	1.01	−0.12
IT 30	1.48	1.27	0.21	1.26	1.23	0.03
Total	38.65	34.80	3.85	36.84	35.38	1.46

Source: Authors’ own work (2020).

shows the difference in the mean scores between the two groups for the two study timepoints.

The differences between the group means at the two study timepoints were greater for the experimental group than for the control group, the total difference between the pretest and post-test for the experimental group was 3.85, and for the control group, 1.46. It is striking that there were no negative scores in the experimental group; in other words, there was no lower score in any of the instrument items at the post-test compared to the pretest, something that did occur in the control group in 8 out of the 30 items in the instrument. The items that stood out as having the greatest differences between the pre- and post-test in the experimental group were Items 10 (difference of 0.25), 11 (difference of 0.24), 12 (difference of 0.23), 29 (difference of 0.24), and 30 (difference of 0.21). In the control group, the items with the greatest differences were Items 12 (difference of 0.23) and 15 (difference of 0.19), in terms of positive differences, and 20 (difference of −0.15) and 21 (difference of −0.23), in terms of negative differences.

The differences we found in effect sizes between the two groups at the two study timepoints are shown in

Table 6. Difference in effect size between groups for the two study timepoints.

Items	EG	CG	Dif.
IT 1	0.13	0.12	0.01
IT 2	0.14	0.15	−0.01
IT 3	0.13	0.09	0.04
IT 4	0.14	0.07	0.07
IT 5	0.18	0.26	−0.08
IT 6	0.04	0.13	−0.09
IT 7	0.08	0.00	0.08
IT 8	0.12	0.23	−0.11
IT 9	0.23	0.12	0.11
IT 10	0.32	0.21	0.11
IT 11	0.28	0.03	0.25
IT 12	0.28	0.30	−0.02
IT 13	0.24	0.19	0.05
IT 14	0.13	0.06	0.07
IT 15	0.12	0.25	−0.13
IT 16	0.22	0.09	0.13
IT 17	0.18	0.17	0.01
IT 18	0.21	0.15	0.06
IT 19	0.22	0.03	0.19
IT 20	0.11	0.17	−0.06
IT 21	0.19	0.26	−0.07
IT 22	0.12	0.01	0.11
IT 23	0.07	0.01	0.06
IT 24	0.07	0.13	−0.06
IT 25	0.10	0.01	0.09
IT 26	0.09	0.03	0.06
IT 27	0.05	0.04	0.01
IT 28	0.21	0.14	0.07
IT 29	0.32	0.16	0.16
IT 30	0.27	0.04	0.23
Total	0.40	0.15	0.25

Source: Authors’ own work (2020).

.

The total effect size of the study was higher in the experimental group (0.40) compared to the control group (0.15), with the difference between the effect size of the two groups being 0.25. The largest effect sizes for the differences between the pre- and post-test in the experimental group were in Items 10 (0.32), 11 (0.28), 12 (0.28), 29 (0.32), and 30 (0.27). In the control group, the largest effect sizes were in items 5 (0.26), 12 (0.30), 15 (0.25), and 21 (0.26). The items with the greatest differences in effect sizes between the two groups were Items 11 (0.25), 19 (0.19), and 30 (0.23), with the experimental group having higher values. It is worth mentioning that in 21 of the 30 items, the higher values for effect size were in the experimental group.

In summary, on comparing the means and effect sizes for the two timepoints, we found that Items 11, 19, and 30 demonstrated the largest differences between the experimental and control groups after the project (Items 11 and 19 were about arithmetic content, Item 30 was about geometry). The items are shown in Figure 1.

It is also worth noting Items 10, 11, 12, 29, and 30, (two about arithmetic content, and three about geometry), as they were the items with the largest differences between the pre- and post-test in the experimental group. The items are shown in Figure 2, with the exception of 11 and 30 (which appear in Figure 1):

Finally, in accordance with the SDGs, in this case, Goal 5—Gender Equality, the results based on the sex of the participants at each timepoint are shown in

Table 7. Study sample by sex.

Sex	EG		CG
	Pretest	Post-Test	Pretest	Post-Test
Boys	1920	1112	82	42
Girls	1709	1047	84	55
Total	3629	2159	166	97

Source: Authors’ own work (2020).

and

Table 8. Results by sex at each timepoint.

Sex	EG				CG
	Pretest		Post-Test		Pretest		Post-Test
	M	SD	M	SD	M	SD	M	SD
Boys	35.11	10.05	39.24	10.19	36.73	10.67	38.17	11.13
Girls	34.46	9.26	38.04	9.04	34.06	8.60	35.82	8.06
Total	34.80	9.69	38.65	9.66	35.38	9.74	36.84	9.53

Source: Authors’ own work (2020).

.

Both boys and girls in the experimental group had higher scores. The difference in mean scores between the pre- and post-test was 4.13 for the boys and 3.58 for the girls. In the control group, the difference in mean scores between the pre-and post-test was 1.44 for the boys and 1.76 for the girls. Thus, following the program (the experimental group), both boys and girls had higher scores, something that we did not see to the same extent in the control group.

4. Discussion

Globalization is producing rapid and frequent exchanges of ideas and innovation, which changes how people assimilate society’s cultural patterns. The roadmap set out by the Sustainable Development Goals is an ideal framework for maintaining global balance at the social and environmental level, and therefore, also at the educational level. In schools, students have to learn knowledge that is continually changing; learning evolves gradually, with the need to integrate more collaborative and participatory methodologies that demand greater commitment and involvement in tasks from students [51]. We find ourselves within a networked society that has brought about changes in the social and relational structures of the population. Coming generations will be digital natives, and artificial intelligence—machine learning—will be increasingly incorporated into the teaching and learning process. Technology offers a wide variety of opportunities for more visual and intuitive learning [52]. Teaching design should include learning how to use these resources and methodologies, which includes education in programming being incorporated into all areas of learning in an interdisciplinary manner [53,54].

This study aimed to assess whether there is empirical evidence justifying the integration of education in programming into schools. To do this, we implemented a project in mathematics using Scratch and assessed its effects via a pre- and post-test with an experimental group and a control group, using a test battery to assess mathematical competence. Education in programming needs to be integrated into schools [55,56], and the schools’ current situations need to be assessed to facilitate their decisions about whether to include it [57,58]. It is essential to generalize research in order to assess whether it works and what its effects are; there are examples pursuing this goal [59,60], a goal that is shared by our study.

Our results show that the fifth grade primary education students who participated in the project and who worked on mathematical competence through computer programming activities developed their mathematics skills more than the students who were taught mathematics via other activities and the usual resources for this area. These differences were more apparent in specific items than in the global differences between the two groups at the pretest (p = 0.454) and at the post-test (p = 0.070). Mean scores increased between the pretest and the post-test, with a p < 0.001 and an effect size of 0.45. The difference between the pretest and the post-test was larger in the experimental group (3.85) than in the control group (1.46), as was the effect size (0.40 for the experimental group, 0.15 for the control group). The items that exhibited differences between the two groups, with the experimental group scoring higher, were in arithmetic and geometry content. In terms of sex, boys and girls in the experimental group had better results than the control group at the post-test compared with the pretest.

The inclusion of new didactic methodologies in the teaching/learning process promotes educational innovation and encourages students to take on active roles. This represents a greater cognitive load for the students but, in the case of the present study, their interest and motivation towards learning in the area of mathematics was not affected. This was analyzed by asking the students at both stages of the study to rate (on a scale from 0 to 10) their interest in and motivation towards mathematics. The results showed little difference between the study timepoints: in the pretest, we found a mean value of 7.71 (SD = 2.37) for the experimental group and 7.90 (SD = 2.63) for the control group. At the post-test, the results were 7.75 (SD = 2.37) for the experimental group and 7.97 (SD = 2.20) for the control group. The reliability of the results between timepoints was high, with values above 0.80. Therefore, the learning of mathematics and technology appear closely related, something that other studies have noted and analyzed [61,62].

One limitation of this study that is worth highlighting is the small size of the control group, something to be considered in subsequent studies. Replicating this study with a similar size experimental group while expanding the control group is the main line for the development of future research. We will attempt to maintain the homogeneity of the characteristics and circumstances of this current study as much as possible. There is also the possibility of establishing relationships between the results according to variables such as gender or academic performance in mathematics.

Ultimately, education systems will not be able to remain outside of the technology revolution in educational practices [63]. This will need initial and continuous training for teachers [64], with a goal to transmit to students, as facilitators and mediators, the importance of technology in applying, analyzing, evaluating, and creating knowledge [65]. Putting the concepts of lifelong learning and continual learning into practice becomes important, knowledge becomes obsolete, and technology helps us move forward.