Next Article in Journal
Receding-Horizon Prediction of Vehicle Velocity Profile Using Deterministic and Stochastic Deep Neural Network Models
Next Article in Special Issue
Two Years of Hybrid Education in Romania: A Comparative Overview of the Students’ Expectations for the Online Educational Platforms
Previous Article in Journal
Appropriate Strategies for the Use of Fairtrade Certification to Improve the Organizational Climate in a Fairtrade Banana-Producing Company
Previous Article in Special Issue
An Interpretable Framework for an Efficient Analysis of Students’ Academic Performance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Investigating the Association between Algorithmic Thinking and Performance in Environmental Study

by
Kalliopi Kanaki
1,*,
Michail Kalogiannakis
1,*,
Emmanouil Poulakis
2 and
Panagiotis Politis
2
1
Pedagogical Department of Preschool Education, Rethymnon Campus, University of Crete, 741-00 Rethymnon, Greece
2
Department of Primary Education, University of Thessaly, 382-21 Volos, Greece
*
Authors to whom correspondence should be addressed.
Sustainability 2022, 14(17), 10672; https://doi.org/10.3390/su141710672
Submission received: 7 July 2022 / Revised: 7 August 2022 / Accepted: 24 August 2022 / Published: 26 August 2022

Abstract

:
Presently, computational thinking (CT) is considered necessary for adapting to the future. Concurrently, the COVID-19 pandemic has accentuated the demand for strengthening Environmental Education as a means to improve sustainability and stimulate environmental protection and public health. Having in mind that CT does not concern only technocrats but also applies in solving everyday problems, we introduce the novel idea of the synergistic learning of CT and Environmental Study. Thus, our research aim is to explore the correlation between algorithmic thinking (AT), as a fundamental CT competency, and educational achievements in the Environmental Study course during the early primary school years. Towards this end, we implemented a quantitative research study, employing an innovative assessment framework we propose. The adoption of cluster sampling eventuated in a sample of 435 students. The exploitation of ordinal logistic regression analysis and machine learning method validated the correlation of the two fields and pointed out that AT levels constitute a predictive factor for performance in the Environmental Study course and vice versa. These results support the novel idea of concurrently cultivating environmental consciousness and CT and build a robust base for future studies that will focus on providing an ecological reflection on CT activities.

1. Introduction

Nowadays, the increasing attention to incorporating CT in education has provoked the concomitant emergence of need and interest in exploring its cultivation and assessment [1,2]. At the same time, while humankind is rocked with unrepresented magnitude by a pandemic originated from the mismanagement of natural habitats and wildlife, the importance of environmental awareness and sustainability is more relevant than ever [3]. Advocating for the multi-faceted nature of CT, which is not only to create future scientists or engineers, but also to enhance many cognitive and intellectual skills, facilitating people to solve everyday problems [4], we introduce the innovative idea of the synergistic learning of CT and Environmental Study.
In a classification scheme of science fields and subfields, Environmental Science and Technology is under the branch of Agriculture and Environment [5]. Furthermore, although Environmental Science does not belong to the group of the so-called core sciences (e.g., mathematics and physics), Next Generation Science Standards (NGSS) [6] set out several environmental issues, such as the role of water in Earth’s surface processes, human impacts on earth systems and global climate change, as disciplinary core ideas of science. NGSS also include the influence of engineering, technology and science on society and the natural world in the list of the proposed crosscutting concepts. Consequently, NGSS accept that Environmental Science is under the broad umbrella of STEM (Science, Technology, Engineering, and Mathematics).
Until now, several educational approaches have been proposed regarding the synergistic learning of CT and other STEM fields, such as physics [7], chemistry [8], and mathematics [9]. Nevertheless, as far as we know, no study has been conducted yet examining the potential educational synergy between CT and Environmental Study. Motivated by this research opportunity and in light of the imperative need of: (a) creating environmental literal citizens well-trained to establish environmental and resource sustainability [10] and (b) cultivating CT as necessary equipment in the contemporary digital era, we focus on investigating the relationship between CT and performance in the Environmental Study course. This article provides evidence of a relevant research study we conducted, focusing on assessing AT as a fundamental CT competency.
Indeed, although pertinent studies expound on different skills as fundamental CT elements [1], there is a convergence of opinions that AT is one of its fundamental components [11,12]. Exercising AT turns out to be one of the major CT competencies, facilitating our understanding of existing problems and empowering us to provide solutions in order to deal with them [13], while it creates a fertile ground for sensitizing the ethical concerns that algorithms introduce [14].
This article discusses part of a wider research study we carried out exploiting a novel assessment framework, with the objective of investigating age [15], gender [16], and learning achievements in the Environmental Study course as predictive factors of core CT competencies, namely AT and abstraction [17]. The proposed assessment framework, which is of a constructivist, multidisciplinary and game-based structure, was applied to 435 primary first and second graders. We directed our attention to the early ages, following the recent international trend of developing CT as soon as possible in compulsory education [18,19]. The primary motivation of cultivating CT even from kindergarten derives from the demand to equip future generations to respond to real-life challenges [19]. Having in mind that learning CT can be approached through digital game mediums [20] such as jigsaw puzzles [21] and being aware that game-design requires CT [2], we constructed the research study discussed in this article around the assumption that solving jigsaw puzzles could estimate students’ CT skills, such as AT.
The discussed research study was implemented in the framework of quantitative methodology, aiming to answer the research question: “Is there an association between AT skills and educational achievements in the Environmental Study course during the early years of primary school?” Thus, we set the hypothesis that: “There is no association between AT skills and educational achievements in the Environmental Study course during the early years of primary school.” In order to test the hypothesis set, we performed chi-square statistic, calculated p-value, determined odds ratio, conducted ordinal logistic regression analysis and employed the machine learning method. The research results confirmed the association between AT skills and educational achievements in the Environmental Study course, supporting the innovative idea of cultivating environmental consciousness together with CT, and laying the foundations of future studies regarding the provision of ecological reflection on CT activities.

2. Theoretical Framework

Aiming to establish the conceptual framework of our research approach, we are going to shortly discuss its fundamental axes i.e., early childhood education, CT, AT, Environmental Study and game-based learning.

2.1. Early Childhood Education

Early childhood education concerns young children from birth through age eight [22], and it is of great importance as it boosts a variety of early-life competencies and later-life attainments. During the sensitive early years, children rapidly mature linguistically, cognitively, socially and emotionally, in a way that will determine their future functioning in many fields [23,24]. Children who benefit from high-quality early learning, from kindergarten to the first primary school grades, develop considerably more appropriate behavior, socially interact significantly better and show much more emotional maturity than peers that do not participate in early learning settings [23].
Research has revealed that children‘s development of socio-emotional skills during the early years of education is crucial for long-term school and life achievements [25]. Furthermore, competencies cultivated in early childhood education, such as language, literacy and math cognitive skills, as well as self-regulation, motivation, engagement and persistence in learning, are precursors of children’s future academic performance [26].

2.2. Computational Thinking

Contemporary educational and social demands lead to cultivating CT even within the context of early learning settings [15,16,17]. Indeed, in the modern digital era, CT is seen as a set of competencies that are essential for the productive citizenry [27], as it is estimated that by the end of the century it will have evolved into a fundamental set of skills, such as reading, writing and arithmetic [28]. It is inextricably linked to Computer Science, and, in addition, its development is related to the study of a wide range of STEAM (Science, Technology, Engineering, Arts and Mathematics) fields [29]. The range of its effects covers every kind of thinking. For example, it has a long tradition of influencing the law [30] and especially the prospect of providing a set of logical rules that can automate the legal decision process [31].
The growing interest in integrating CT into the learning process has led researchers, educators, and education policymakers to engage conscientiously in the cultivation and evaluation of students’ CT skills. Thus, a great deal of research has been conducted regarding: (a) the development of curricula that include CT [32,33], (b) the implementation of instructional tools aiming at enhancing CT [34,35], (c) the design and implementation of educational environments that promote CT [36] and (d) the development of tools for assessing basic CT skills [37,38].
As far as the evaluation of CT is concerned, recent studies show that the relevant subject remains open, as a research challenge [1,39]. This is an extremely urgent issue that needs to be tackled, because without valid and reliable assessment tools, it is very difficult for CT to be successfully integrated into the educational system, running a serious risk of disappearing as a structure, although it deserves very serious consideration [40].

2.3. Algorithmic Thinking

One of the core components of CT is AT, which pertains to the ability to develop skills or rules that can formulate solutions to problems by indicating the exact steps needed [41]. Although these solutions can take various forms, such as flowcharts and pseudocode, the most common is that of converting an algorithm into a computer program [42].
AT is closely related to fundamental skills, such as abstraction, logic, structured thinking, problem-solving skills, creativity [43], ability to locate the structural elements of a problem, top-down design, iteration, identifying optimal solutions, data organization, generalization and configuration ability [44]. Based on the above, it is anticipated that, in many cases, students consider learning algorithms a laborious and unattractive process. Its complexity makes AT a skill that is difficult to cultivate and imposes the need to build effective teaching approaches to enhance it [43].
Especially at the beginning of cultivating AT, the simplest possible methods should be sought, aiming at achieving a natural learning process. More specifically, when it comes to beginners, there is a need for: (a) tasks related to the daily life of the trainees, (b) dealing with problems that do not necessitate antecedent programming knowledge, (c) using language that will provide the ability to represent algorithms in a natural way, (d) systems that will allow the learner to experiment with algorithms, offer instant learning experiences, be flexible to run numerous algorithms and provide feedback [43].
It is worth mentioning that AT does not have exclusive tendency towards technological solutionism, treating major social and environmental problems in a simplistic way of proposing new technological solutions without exploring environmental consequences [45]. On the contrary, it is strongly related to environmental issues, supporting environmental awareness and sustainability [46,47].

2.4. Environmental Study

Systematic engagement with the sciences inspires children to observe, pose questions, form hypotheses, design and perform experiments, make measurements, process and explain data, and substantiate theories and models [48]. The science activities introduced in preschool and elementary school classes have the privilege of fitting effortlessly into the natural way children process their experiences. Furthermore, they support their innate curiosity about the way the world around them functions. Typical examples of such activities are: mixing basic colors [49], creating shadows [50,51], observing the movement of a worm [52], recording the seasonal changes of a tree, observing water—how it flows and how its path could be controlled [53].
In this way, the foundations are laid for a deeper understanding of concepts related to Environmental Sciences, while giving impetus to the growth of critical thinking and the development of problem-solving skills through trial and error [53]. Let us consider a group of young children who are planting a community or school garden. Through this activity, they begin to grasp fundamental scientific concepts and learn about the natural world around them—how much water each plant needs, what the roots are for, how the growth of a plant depends on the seasons of the year, and so on.
In the context of environmental education, students acquire knowledge about the environment and environmental problems, become aware of them and develop their problem-solving skills [54]. They learn about the geographical characteristics of their region and become acquainted with natural phenomena and disasters they may face. Thus, future citizens are formed, who have demythologized the fear of natural phenomena, such as earthquakes and tsunamis, and are prepared to confront them calmly and effectively, both in a collective and a personal way [55].
The orientation of education towards environmental awareness and sustainability is of particular importance, aiming at the cultivation of individual and collective consciousness to address contemporary environmental and health challenges [3]. Coherently organized contact with environmental education can bring about a general change in the attitude of modern people, preventing them from distinguishing themselves from nature. Furthermore, studying sustainability science provides students with a unique lens through which they can engage present events and envision a sustainable future that may arise from current and prospective hardships [56]. For example, students who study sustainability science are equipped with a remarkable set of tools to analyze the crisis that entailed from the COVID-19 global pandemic and conceptualize a more sustainable future [56].

2.5. Game-Based Learning

A way to foster Environmental Study is by employing game-based learning activities. Play instinctively constitutes a part of people’s lives [57] and stimulates feelings of pleasure and excitement, regardless of age [58]. However, the value of games is not limited to their entertaining character. Mammals—including humans—are biologically prepared to use play as a learning tool [59]. The dynamics of utilizing games to achieve learning goals had already been recognized in ancient Greece. According to Plato, toys should be faced as a means of guiding preferences and predisposing children to the role they will play as adults. For example, if a child is to become a farmer or a builder, they should play with toys related to agricultural activities or house-building, respectively, and their teacher should provide them with tools modeled accordingly [60].
Within the context of game-based educational environments, students’ learning motivation is improved, their exploratory mood is developed, their interest in learning is strengthened and their active participation in the educational process is encouraged [61]. Game-based learning approaches offer interactive learning experiences that are more engaging than traditional techniques and add to the acquisition and retention of knowledge [61,62]. Moreover, they guide even preschoolers in learning computational logic [63] and have a positive effect on students’ problem-posing and problem-solving abilities [62]. In addition, the atmosphere in the classroom becomes conducive to learning and enhances students’ interest in computer programming and STEM activities [59].

Jigsaw Puzzles

For hundreds of years, people have been pleasantly entertained by assembling an image from its pieces [64,65]. However, solving puzzles related to assembling an image is not limited to its fun aspect, but also touches on issues related to everyday life [65,66]. In addition, it finds application in various scientific domains and professional fields, such as biology, archeology, image processing [67,68] and voice communication security [69].
Several research efforts focus on studying jigsaw puzzles and exploring their algorithmic solutions [64,67]. Actually, this study is a demanding mathematical and engineering problem, which has aroused the interest of mathematicians, engineers, and computer scientists [65]. The fact that scientists and researchers are looking for algorithms to solve puzzles creates the basis for claiming that solving puzzles requires AT. Therefore, an individual’s ability to solve puzzles could constitute the touchstone for assessing their AT skills.

3. Materials and Methods

In this study, the control variables under investigation are first and second graders’ AT skills and performance in the Environmental Study course. Both these variables are categorical. The assessment of AT skills is implemented through solving jigsaw puzzles of graded difficulty, while the assessment of performance in the Environmental Study course is accomplished employing a pertinent worksheet. For analyzing the data gathered, we exploited RStudio, an integrated development environment (IDE) for the programming language R, which is suitable for statistical computing and graphics [70,71]. In the following sections, we thoroughly discuss issues regarding the materials and methods employed.

3.1. Research Context and Sample

The research took place under the umbrella of a robust ethical framework, with the permission of the Greek Ministry of Education, in the school year 2018–2019 on the island of Crete and, more specifically, in Heraklion city, which is the fourth largest city in Greece. The first and the third author committed to conducting the relevant interventions. Aiming at the transparency of what was happening in the classroom during the research process, the teacher of each class was present, but not actively involved.
In order to draw conclusions for the wider population of first and second-graders of Heraklion city, we adopted the cluster sampling method [72] and estimated the sample size by employing the Cochran formula [73]. Thus, we ended up with a sample of 435 primary school students in first and second grade. The sample was both gender-balanced (48.28% girls and 51.72% boys i.e., 210 girls and 225 boys) and grade-balanced (50.11% first-graders and 49.89% second-graders i.e., 218 first-graders and 217 second-graders).

3.2. Instruments Used and Data Analysis

The pillar of our research is the digital platform PhysGramming (an acronym derived from Physical Science Programming) [74], which we designed and implemented from scratch to serve the needs of our work, aligning with good methods that enhance the usability of young children’s applications [75].
PhysGramming is developmentally appropriate for kindergarteners and first and second-graders, and provides them with the opportunity to construct and play with their own digital games. For constructing the games, young students must first define the attributes of the entities they are dealing with (either orally or in writing), using command lines, the syntax of which deploys a novel text-based and visual programming schema we introduce (Figure 1). While assigning the values of the attributes, students experience their first contact with basic object-oriented programming concepts, even though there is no explicit reference to them.
Users of PhysGramming can create puzzles, among other games, by employing pictures they have painted or shot themselves, or just retrieved from the ones embedded in PhysGramming. Since students select the pictures of the entities they study and assign their names, PhysGramming automatically creates puzzles of graduated difficulty (Figure 2).

3.2.1. Assessing Algorithmic Thinking

In order to assess AT competencies, we focus on the most difficult puzzle (based on the number of its pieces) each student manages to solve, exploiting the information provided by the log files of PhysGramming. The scale we propose has four levels: Basic (four-piece puzzle), Medium (six-piece puzzle), Satisfactory (nine-piece puzzle) and Excellent (twelve-piece puzzle), adopting the viewpoint of relevant research studies that also propose four levels for evaluating CT skills [76].
PhysGramming is programmed so that the lower right cell of each puzzle is initially empty. The student can move the pieces adjacent to the empty cell, in horizontal, vertical, or diagonal direction. Thus, in four-piece puzzles, all the pieces can be moved, making the solving process quite easy. However, in all other cases, the pieces that are not adjacent to an empty cell cannot change position, until an adjoining cell becomes empty. Actually, the more pieces the puzzle contains, the more the pieces cannot change position until a neighboring cell becomes empty, raising the difficulty level of the puzzle reconstruction and requiring higher levels of AT.
Taking into account relevant research studies that propose solving jigsaw puzzles in early childhood education [77] and the special characteristics of our research, we decided to stick to four types of puzzles with graded levels of difficulty and twelve to be the maximum number of puzzle pieces. Two factors contributed to forming this decision. Firstly, unlike the puzzles of PhysGramming, the typical jigsaw puzzles comprise of interlocking pieces that can only connect to the appropriate adjacent piece, facilitating the solving effort. Secondly, PhysGramming was shortly presented the same day the assessment tool was applied in the classroom, and, thus, students lacked familiarity with its functionality, which they had to explore while being assessed.

3.2.2. Assessing Content Understanding

The unit of the Environmental Study course, in the framework of which we chose to conduct our research, was the eating habits of animals. We selected the particular thematic unit based on children’s special relationship with animals, which explains why animals hold children’s attention even when tempting toys are available [78]. As a means of assessing students’ content understanding, we created a worksheet in which students were asked to record the eating habits of 10 animals (Figure 3).
The choice of the topic was indicative. We could choose any other topic, such as, for example, the body covering of animals, the type of a plant depending on whether it sheds its leaves or keeps them all year round, the materials’ shape, etc. In case of choosing another topic, the content of the worksheet should be formatted appropriately, in order to examine the relevant content. Nevertheless, regardless of its subject, the selected topic must have been taught before assessing the comprehension of its content.
When applying the proposed assessment tool, special care must be taken to avoid cheating. Aiming to eliminate the effect of factors such as cheating and giving random answers that would damage the accuracy of our research results, we created a second worksheet identical to the abovementioned one. Nevertheless, the students were not asked to fill it in since the teacher had filled it in before handing it out to the students. This time, students were asked to identify the wrong answers that the teacher deliberately gave.
The evaluation of the content understanding is based on studying the union of the sets of wrong answers in both worksheets. The proposed grading scale is based on the relevant and most recent Ministerial Decision [79] and is constituted of four levels: Excellent (Zero or one mistake), Very Good (Two or three mistakes), Good (Four or five mistakes), Almost Good (More than five mistakes).

3.2.3. Validation

The results of our research would be of no value if the assessment tool we propose had not been tested for the validity and reliability of the results it provides. Thus, both validity and reliability were thoroughly examined, based on methods proposed in the international literature [72]. Since the subject of this article does not include the abovementioned issue, we indicatively report that Pearson’s r (Pearson correlation coefficient)—which is commonly used to quantify the strength of the relationship between test/retest scores [80]—was measured to be 0.81. This result demonstrates very good test/retest reliability. In other words, it indicates very good stability of measurements acquired from a sample at different times [80,81].

4. Results

We are going to test the hypothesis set, i.e., the lack of association between AT skills and the content understanding of the Environmental Study course, at a 5% level of significance, and, thus, with the alpha level of 0.05.
Based on the contingency tables of observed (Table 1) and expected frequencies, chi-square is calculated to be 36.434, degrees of freedom are 9 (df = 9) and the p-value is 3.32 × 10−5. Since p < 0.05, we reject the hypothesis set and accept its alternative. Thus, we accept that there is association between AT and content understanding.
Next, we examine the association of each one of the AT levels with each one of the content understanding levels and we calculate the odds ratio (Table 2). Results indicate that students that have been placed in one of the two higher levels of AT are more likely to be placed in one of the two higher levels of content understanding as well. On the contrary, students that have been grouped into one of the lower levels of AT are more likely to be grouped into one of the lower levels of content understanding.
Next, we apply the ordinal logistic regression method [82] in order to investigate if AT levels constitute a predictive factor for the content understanding of the Environmental Study course and vice versa. Our first step is to explore the odds for students with excellent content understanding to have excellent AT versus basic, medium or satisfactory AT. Using R’s polr function, we obtain the regression output coefficient table that includes the values of coefficient, standard errors, and t-value. In addition, we calculate the p-values (Table 3). The first line of Table 3 presents the values of coefficient, standard errors, t-value and p-value. The three lines that follow present the estimates of the three intercepts, which show where the latent variable is cut to make the four groups we observe in our data. Table 3 indicates that for students that have excellently understood the content of the Environmental Study course, the log odds of having basic AT (versus all the other levels of AT) is 0.02 points lower than students who have not excellently understood the content.
We also calculate odds ratio, confidence intervals and predicted probabilities. Indicatively, the results reveal that the predicted probability for a student with excellent content understanding to have excellent AT is 1.01 times greater than not.
Finally, we apply the machine learning method, seeking to predict the possibility of new data being classified into the AT levels, with dependence on the content understanding. In order to construct the prediction equations, we employed 80% of the research data, while the remaining 20% was exploited for testing [83].
In Chart 1, the independent variable is the content understanding of the Environmental Study course and the dependent variable is AT (probabilities). We see that the higher the level of the content understanding, the higher the probability of being placed at the higher levels of AT (satisfactory and excellent). On the contrary, the probability of being placed at the lower levels of AT (basic and medium) decreases as the level of the content understanding increases.
Analogous results are obtained if we apply the ordinal logistic regression model considering that the content understanding of the Environmental Study course (probabilities) is the dependent variable and AT is the independent variable. The relevant diagram (Chart 2) indicates that the higher the AT level, the higher the probability of students to be classified at the higher levels of content understanding. In a like manner, the lower the AT levels, the higher the probability of students to be classified at the lower levels of content understanding.

5. Discussion

If CT is to become viable in the educational systems around the globe, its assessment will need to play a prominent role. This assumption is echoed in the academic discourse on CT, in which the crucial role of CT assessment is emphasized and the construction of developmentally appropriate assessment tools figures prominently [15,16,17,38,39]. At the same time, the demand for establishing a truly ethical and honest relationship between people and the planet that we inhabit so carelessly, and the need to guarantee a sustainable future for posterity, demands nothing less than introducing Environmental Science even from kindergarten [84,85]. Reflecting on a multidisciplinary collaboration, we support the synergistic cultivation of CT competencies and environmental awareness from the first grades of compulsory education. Towards this aim, we propose a relevant assessment framework, which we have employed in order to investigate the association between fundamental CT skills and several factors, such as age, gender and performance in the Environmental Study course [15,16,17].
The results of the research study discussed in this article confirm the association between AT skills of first and second-graders with the content understanding of the Environmental Study course. The odds ratio calculation for each one of the AT levels in relation to each one of the content understanding levels brings out the way they are correlated to each other. For example, the presence of excellent AT raises the odds of the presence of excellent content understanding by 2.372. On the contrary, the presence of excellent content understanding reduces the odds of the presence of medium AT (odds ratio = 0.782) and even more the presence of basic AT (0.264).
Applying ordinal logistic regression analysis, we come to the same, but more detailed, information regarding the association we investigate. For example, the predicted probability for a student with excellent content understanding to have excellent AT is 1.01 times greater than not. This probability is considerably high if we take into account that excellent AT level is checked against all the remaining AT levels.

5.1. Perspectives

Our research efforts aimed at the first two grades of primary school, where the foundations are built for the subsequent academic trajectory of the children, while at the same time attitudes are formed towards the learning process [16,17]. We went ahead to the assessment research area, as it is not only useful for teachers who want to monitor their students’ progress, but also helps to promote learning and maintain cognitive achievement. Furthermore, without valid and reliable assessment tools, introducing CT in compulsory education could not be successful.
Going beyond the cultivation and the assessment of individual disciplines in the first school years, we investigated the synergy of CT and Environmental Study. The originality of our work relies on the fact that there is no recorded study to test the correlation between the CT skills of first-graders with the content understanding of the Environmental Study course. Furthermore, most of the relevant surveys target older children [86,87], leaving the part of preschool and early school education under-explored.
In attempting an overall evaluation of our research approach, in terms of the impact it had on the members of the educational community who participated in the research, we would say that both students and their teachers easily accepted the proposed assessment tool. Especially the piece that had to do with solving puzzles immediately became beloved by the students. The animated fireworks that appear on the screen after solving each puzzle, accompanied with a rewarding sound, turned out to be very joyful for the users. In fact, in all the classrooms in which the assessment tool was applied, a festive atmosphere emerged. Every time a student managed to solve a difficult puzzle of nine or twelve pieces, they shouted out to the first author: “Mrs., fireworks”. Thus, a creative competition developed between the students, who tried their best. The first author, aiming at strengthening the positivity of the echo of the students’ experience, strengthened the creative atmosphere, rewarding the students verbally and motivating them to continue the good work. The nice atmosphere developed in the classrooms eliminated the reservations of some teachers, who initially objected to the implementation of our research interventions because they were concerned about the completion of the material.

5.2. Limitations and Future Research Directions

A limitation of the work concerns the research population, which consisted of students only from the city of Heraklion. For this very reason, we plan to expand our research to a nationwide level. Another limitation of our work is conducting the research study amid one thematic unit of the Environmental Study course, i.e., animals’ nutritional habits. In fact, to be more precise, the assessment tool was also applied amid studying which animals sleep in the winter season, employing a small sample of 75 students. This small-scale research study confirmed the results presented in this article. Nevertheless, our future research direction is to confirm our results by applying the assessment tool in several thematic units of the Environmental Study course, conducting a large-scale research study.
Moreover, a limitation of our study is the lack of examining potential underlying factors that might have an effect on the correlation between AT and performance in the Environmental Study course. For example, a recent meta-analysis that examined 34 studies in a wide range of ages—from first-graders to fourth-year students—confirmed the association between CT and academic achievement and revealed that their positive link is moderated by culture, grade level, achievement indicators, and gender [88]. Thus, our future research orientation includes the implementation of an experimental design with the objective of investigating such factors.
Finally, we intend to examine children’s growing AT abilities by adopting a quasi-experimental design and exploiting PhysGramming’s new edition, which is not limited to supporting CT assessment but also adds to the efforts of CT development in the early ages.

6. Conclusions

This study provides evidence of a multidisciplinary assessment approach of constructivist and game-based nature, designed in the interest of examining the correlation between educational achievements in the Environmental Study course and AT skills of first and second-graders.
The rationality of our research is threefold. Firstly, it relates to the impact that technology will have on the future of the next generation, arousing the interest in introducing CT as soon as possible in compulsory education in order to equip this future generation with 21st-century skills and prepare it for a new reality regarding the job market [19]. Secondly, it pertains to the fact that environmental education is experiencing dynamic growth in research and practice due to enduring environmental challenges [10]. Finally, yet importantly, a significant factor that triggered the implementation of our study was the detection of a research gap regarding the correlation between CT competencies and performance in the Environmental Study course. In order to establish the synergy of the two disciplines, we started with their joint evaluation. Thus, we propose an assessment tool that reflects on multidisciplinary collaboration, taking advantage of incorporating a diversity of scientific perspectives and considering several instructional approaches [89].
Summarizing the contribution of our work to the scientific community, we should refer to fostering CT in early primary school years, assessing AT skills of young students while solving digital puzzles, examining the correlation between AT and Environmental Study, highlighting the option of synergistically cultivating CT and environmental consciousness, and injecting object-oriented programming concepts in early childhood education. Hence, the subject of this study is of interest to educators and researchers who approve the cultivation of CT from the very first grades of elementary school, applaud the orientation of education towards environmental awareness and sustainability, and advocate the synergistic learning of CT and STEM fields. It also concerns those who support game-based learning, and adopt educational practices that face students as active creators rather than passive consumers of digital technology.

Author Contributions

Conceptualization, K.K. and M.K.; Data curation, K.K.; Formal analysis, K.K.; Investigation, K.K. and E.P.; Methodology, K.K. and M.K.; Project administration, M.K.; Resources, K.K. and M.K.; Software, K.K.; Validation, K.K., M.K., E.P. and P.P.; Visualization, K.K.; Writing—original draft, K.K.; Writing—review & editing, K.K., M.K., E.P. and P.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the University of Crete (555/17.10.2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found at http://physgramming.edc.uoc.gr/main.html.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Tang, X.; Yin, Y.; Lin, Q.; Hadad, R.; Zhai, X. Assessing computational thinking: A systematic review of empirical studies. Comput. Educ. 2020, 148, 103798. [Google Scholar] [CrossRef]
  2. Zhang, L.; Nouri, J. A systematic review of learning computational thinking through Scratch in K-9. Comput. Educ. 2019, 141, 103607. [Google Scholar] [CrossRef]
  3. Cruz, T.L.; Pinto, P.I.M.; Ferreira, A.H.J. Environmental Education as a Tool to Improve Sustainability and Promote Global Health: Lessons from the COVID-19 to Avoid Other Pandemics. In COVID-19: Paving the Way for a More Sustainable World, 1st ed.; Filho, W.L., Ed.; Springer: Cham, Switzerland, 2021; pp. 331–347. [Google Scholar] [CrossRef]
  4. Wei, X.; Lin, L.; Meng, N.; Tan, W.; Kong, S.C. The effectiveness of partial pair programming on elementary school students’ computational thinking skills and self-efficacy. Comput. Educ. 2021, 160, 104023. [Google Scholar] [CrossRef]
  5. Glänzel, W.; Schubert, A. A new classification scheme of science fields and subfields designed for scientometric evaluation purposes. Scientometrics 2003, 56, 357–367. [Google Scholar] [CrossRef]
  6. Next Generation Science Standards. Available online: https://www.nextgenscience.org/ (accessed on 12 June 2022).
  7. Hutchins, N.M.; Biswas, G.; Maróti, M.; Lédeczi, Á.; Grover, S.; Wolf, R.; Blair, K.P.; Chin, D.; Conlin, L.; Basu, S.; et al. C2STEM: A system for synergistic learning of physics and computational thinking. J. Sci. Educ. Technol. 2020, 29, 83–100. [Google Scholar] [CrossRef]
  8. Aslan, U.; LaGrassa, N.; Horn, M.; Wilensky, U. Putting the Taxonomy into Practice: Investigating Students’ Learning of Chemistry with Integrated Computational Thinking Activities. In Proceedings of the American Education Research Association (AERA) 2020 Annual Meeting, San Francisco, CA, USA, 17–21 April 2020. [Google Scholar]
  9. Sung, W.; Ahn, J.; Black, J.B. Introducing computational thinking to young learners: Practicing computational perspectives through embodiment in mathematics education. Technol. Knowl. Learn. 2017, 22, 443–463. [Google Scholar] [CrossRef]
  10. Ardoin, N.M.; Bowers, A.W. Early childhood environmental education: A systematic review of the research literature. Educ. Res. Rev. 2020, 31, 100353. [Google Scholar] [CrossRef]
  11. Angeli, C.; Giannakos, M. Computational thinking education: Issues and challenges. Comp. Hum. Behav. 2020, 105, 106185. [Google Scholar] [CrossRef]
  12. Fagerlund, J.; Häkkinen, P.; Vesisenaho, M.; Viiri, J. Computational thinking in programming with scratch in primary schools: A systematic review. Comput. Appl. Eng. Educ. 2021, 29, 12–28. [Google Scholar] [CrossRef]
  13. Turchi, T.; Fogli, D.; Malizia, A. Fostering computational thinking through collaborative game-based learning. Multim. Tools Appl. 2019, 78, 13649–13673. [Google Scholar] [CrossRef]
  14. Tsamados, A.; Aggarwal, N.; Cowls, J.; Morley, J.; Roberts, H.; Taddeo, M.; Floridi, L. The ethics of algorithms: Key problems and solutions. AI Soc. 2021, 37, 215–230. [Google Scholar] [CrossRef]
  15. Kanaki, K.; Kalogiannakis, M. Assessing Algorithmic Thinking Skills in Relation to Age in Early Childhood STEM Education. Educ. Sci. 2022, 12, 380. [Google Scholar] [CrossRef]
  16. Kanaki, K.; Kalogiannakis, M. Assessing algorithmic thinking skills in relation to gender in early childhood. Educ. Process Int. J. 2022, 11, 44–59. [Google Scholar] [CrossRef]
  17. Kanaki, K.; Kalogiannakis, M.; Poulakis, E.; Politis, P. Employing Mobile Technologies to Investigate the Association Between Abstraction Skills and Performance in Environmental Studies in Early Primary School. Int. J. Interact. Mob. Technol. 2022, 16, 241–249. [Google Scholar] [CrossRef]
  18. Bers, M.U. Coding as a Playground: Programming and Computational Thinking in the Early Childhood Classroom, 2nd ed.; Routledge Publishers: Oxford, UK, 2022. [Google Scholar]
  19. Silva, E.F.; Dembogurski, B.J.; Semaan, G.S. A Systematic Review of Computational Thinking in Early Ages 2021. arXiv 2021, arXiv:2106.10275. [Google Scholar]
  20. Rowe, E.; Almeda, M.V.; Asbell-Clarke, J.; Scruggs, R.; Baker, R.; Bardar, E.; Gasca, S. Assessing implicit computational thinking in Zoombinis puzzle gameplay. Comput. Hum. Behav. 2021, 120, 106707. [Google Scholar] [CrossRef]
  21. Rompapas, D.; Steven, Y.; Chan, J. A Hybrid Approach to Teaching Computational Thinking at a K-1 and K-2 Level. In Proceedings of the CTE-STEM 2021: 5th APSCE International Conference on Computational Thinking and STEM Education 2021, Virtual Conference, Singapore, 2–4 June 2021. [Google Scholar]
  22. National Association for the Education of Young Children (NAEYC). Available online: https://www.naeyc.org/ (accessed on 22 June 2022).
  23. Bakken, L.; Brown, N.; Downing, B. Early childhood education: The long-term benefits. J. Res. Child. Educ. 2017, 31, 255–269. [Google Scholar] [CrossRef]
  24. McCoy, D.C.; Yoshikawa, H.; Ziol-Guest, K.M.; Duncan, G.J.; Schindler, H.S.; Magnuson, K.; Yang, R.; Koepp, A.; Shonkoff, J.P. Impacts of early childhood education on medium-and long-term educational outcomes. Educ. Res. 2017, 46, 474–487. [Google Scholar] [CrossRef]
  25. Ferreira, M.; Reis-Jorge, J.; Batalha, S. Social and Emotional Learning in Preschool Education-A Qualitative Study with Preschool Teachers. Int. J. Emot. Educ. 2021, 13, 51–66. [Google Scholar]
  26. Heckman, J.; Pinto, R.; Savelyev, P. Understanding the mechanisms through which an influential early childhood program boosted adult outcomes. Am. Econ. Rev. 2013, 103, 2052–2086. [Google Scholar] [CrossRef]
  27. Hsu, T.C.; Chang, S.C.; Hung, Y.T. How to learn and how to teach computational thinking: Suggestions based on a review of the literature. Comput. Educ. 2018, 126, 296–310. [Google Scholar] [CrossRef]
  28. Wing, J.M. Computational thinking. Commun. ACM 2006, 49, 33–35. [Google Scholar] [CrossRef]
  29. Dolgopolovas, V.; Dagienė, V. Computational thinking: Enhancing STEAM and engineering education, from theory to practice. Comput. Appl. Eng. Educ. 2021, 29, 5–11. [Google Scholar] [CrossRef]
  30. Wing, J.M. Computational Thinking. In Proceedings of the Presentation Slides from Trippel Helix Conference on Computational Thinking and Digital Competencies in Primary and Secondary Education Stockholm, Stockholm, Sweden, 8 September 2017; Available online: https://pdfs.semanticscholar.org/presentation/d20a/a49744877f2bb98d6ad303742be7bd025fcd.pdf (accessed on 6 July 2022).
  31. Metsker, O.; Trofimov, E.; Kopanitsa, G. Application of machine learning metrics for dynamic E-justice processes. In Proceedings of the IEEE FRUCT 2021: 28th Conference of Open Innovations Association, Moscow, Russia, 27–29 January 2021; pp. 293–300. [Google Scholar] [CrossRef]
  32. Rich, K.M.; Spaepen, E.; Strickland, C.; Moran, C. Synergies and differences in mathematical and computational thinking: Implications for integrated instruction. Interact. Learn. Environ. 2019, 28, 1–12. [Google Scholar] [CrossRef]
  33. Sung, E. Fostering computational thinking in technology and engineering education: An unplugged hands-on engineering design approach. Technol. Eng. Teach. 2019, 78, 8–13. [Google Scholar]
  34. Grover, S. Assessing algorithmic and computational thinking in K-12: Lessons from a middle school classroom. In Emerging Research, Practice, and Policy on Computational Thinking, 1st ed.; Rich, P.J., Hodges, C.B., Eds.; Springer: Cham, Switzerland, 2017; pp. 269–288. [Google Scholar] [CrossRef]
  35. Del Olmo-Muñoz, J.; Cózar-Gutiérrez, R.; González-Calero, J.A. Computational thinking through unplugged activities in early years of Primary Education. Comput. Educ. 2020, 150, 103832. [Google Scholar] [CrossRef]
  36. García-Valcárcel-Muñoz-Repiso, A.; Caballero-González, Y.A. Robotics to develop computational thinking in early Childhood Education. Comunicar. Media Educ. Res. J. 2019, 27, 63–72. [Google Scholar] [CrossRef]
  37. Chen, G.; Shen, J.; Barth-Cohen, L.; Jiang, S.; Huang, X.; Eltoukhy, M. Assessing elementary students’ computational thinking in everyday reasoning and robotics programming. Comput. Educ. 2017, 109, 162–175. [Google Scholar] [CrossRef]
  38. Korkmaz, Ö.; Cakir, R.; Özden, M.Y. A validity and reliability study of the computational thinking scales (CTS). Comput. Hum. Behav. 2017, 72, 558–569. [Google Scholar] [CrossRef]
  39. Poulakis, E.; Politis, P. Computational Thinking Assessment: Literature Review. In Research on E-Learning and ICT in Education, 1st ed.; Tsiatsos, T., Demetriadis, S., Mikropoulos, A., Dagdilelis, V., Eds.; Springer: Cham, Switzerland, 2021; pp. 111–128. [Google Scholar] [CrossRef]
  40. Román-González, M.; Moreno-León, J.; Robles, G. Combining assessment tools for a comprehensive evaluation of computational thinking interventions. In Computational Thinking Education, 1st ed.; Cong, S.C., Abelson, H., Eds.; Springer: Cham, Switzerland, 2007; pp. 79–98. [Google Scholar] [CrossRef]
  41. Zhao, L.; Liu, X.; Wang, C.; Su, Y.S. Effect of different mind mapping approaches on primary school students’ computational thinking skills during visual programming learning. Comput. Educ. 2022, 181, 104445. [Google Scholar] [CrossRef]
  42. Wong, G.K.; Jiang, S. Computational thinking education for children: AT and debugging. In Proceedings of the 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), Wollongong, NSW, Australia, 4–7 December 2018; pp. 328–334. [Google Scholar] [CrossRef]
  43. Futschek, G.; Moschitz, J. Developing algorithmic thinking by inventing and playing algorithms. In Proceedings of the 2010 Constructionist Approaches to Creative Learning, Thinking and Education: Lessons for the 21st Century (Constructionism 2010), Paris, France, 16–20 August 2010; pp. 1–10. [Google Scholar]
  44. Cooper, S.; Dann, W.; Pausch, R. Developing AT with Alice. In Proceedings of the 36th Information Systems Education Conference, Plano, TX, USA, 26–28 March 2020; Volume 17, pp. 506–539. [Google Scholar]
  45. Easterbrook, S. From computational thinking to systems thinking. In Proceedings of the 2nd International Conference ICT for Sustainability (ICT4S), Stockholm, Sweden, 24–27 August 2014; pp. 235–244. [Google Scholar] [CrossRef]
  46. Gosal, A.S.; McMahon, J.A.; Bowgen, K.M.; Hoppe, C.H.; Ziv, G. Identifying and Mapping Groups of Protected Area Visitors by Environmental Awareness. Land 2021, 10, 560. [Google Scholar] [CrossRef]
  47. Rezapouraghdam, H.; Akhshik, A.; Ramkissoon, H. Application of machine learning to predict visitors’ green behavior in marine protected areas: Evidence from Cyprus. J. Sustain. Tour. 2021, 1–25. [Google Scholar] [CrossRef]
  48. Schleicher, A.; Zimmer, K.; Evans, J.; Clements, N. PISA 2009 Assessment Framework: Key Competencies in Reading, Mathematics and Science, 1st ed.; OECD Publishing: Paris, France, 2009. [Google Scholar]
  49. Sari, N.P.; Setiawan, M.A.; Makaria, E.C. Can Science Develop Creativity in Early Children? In 2nd Progress in Social Science, Humanities and Education Research Symposium (PSSHERS 2020), West Sumatera, Indonesia, 30–31 October 2020; Advances in Social Science, Education and Humanities Research Series; Atlantis Press: Amsterdam, The Netherlands, 2021; pp. 202–205. [Google Scholar] [CrossRef]
  50. Lindstrand, A.E.; Hansson, L.; Olsson, R.; Ljung-Djärf, A. Playful learning about light and shadow: A learning study project in early childhood education. Creat. Educ. 2016, 7, 333–348. [Google Scholar] [CrossRef]
  51. Ravanis, K. The Physical Sciences in Early Childhood Education: Theoretical frameworks, strategies and activities. J. Phys. Conf. Ser. 2021, 1796, 012092. [Google Scholar] [CrossRef]
  52. Lange, A.; Lodien, L.; Lowe, A. The Worms Are Dancing! Sci. Child. 2019, 56, 40–45. [Google Scholar] [CrossRef]
  53. McClure, E.R.; Guernsey, L.; Clements, D.H.; Bales, S.N.; Nichols, J.; Kendall-Taylor, N.; Levine, H.L. STEM Starts Early: Grounding Science, Technology, Engineering, and Math Education in Early Childhood; The Joan Ganz Cooney Center at Sesame Workshop: New York, NY, USA, 2017; Available online: https://joanganzcooneycenter.org/wp-content/uploads/2017/01/jgcc_stemstartsearly_final.pdf (accessed on 28 July 2022).
  54. Nyika, J.M.; Mwema, F.M. Environmental Education and Its Effects on Environmental Sustainability. In Handbook of Research on Environmental Education Strategies for Addressing Climate Change and Sustainability, 1st ed.; Karmaoui, A., Salem, A.B., Anees, M.T., Eds.; IGI Global: Hershey, PA, USA, 2021; pp. 182–199. [Google Scholar] [CrossRef]
  55. Bulut, A. Raising Awareness of Disaster and Giving Disaster Education to Children in Preschool Education Period. Acta Educ. Gen. 2020, 10, 162–179. [Google Scholar] [CrossRef]
  56. Quinn, C.E.; Cohen, M. Using COVID-19 to Teach Sustainability Futures Thinking. In COVID-19: Paving the Way for a More Sustainable World, 1st ed.; Filho, W.L., Ed.; Springer: Cham, Switzerland, 2021; pp. 411–426. [Google Scholar] [CrossRef]
  57. Rosyati, T.; Purwanto, M.R.; Gumelar, G.; Yulianti, R.T.; Mukharrom, T. Effects of Games and How Parents Overcome Addiction to Children. J. Crit. Rev. 2020, 7, 65–67. [Google Scholar]
  58. Karakoç, B.; Eryılmaz, K.; Özpolat, E.T.; Yıldırım, İ. The effect of game-based learning on student achievement: A meta-analysis study. Technol. Knowl. Learn. 2020, 27, 207–222. [Google Scholar] [CrossRef]
  59. Santos, P.A. The Past, Present and Future of Serious Games and Gamification in STEM Learning. In Research on Outdoor STEM Education in the digiTal Age (ROSETA) Digital Conference, 16–19 June 2020; WTM: Münster, Germany; pp. 147–154. [CrossRef]
  60. D’Angour, A. Plato and play: Taking education seriously in ancient Greece. Am. J. Play 2013, 5, 293–307. [Google Scholar]
  61. Lamrani, R.; Abdelwahed, E.H. Game-based learning and gamification to improve skills in early years education. Comput. Sci. Inf. Syst. 2020, 17, 339–356. [Google Scholar] [CrossRef]
  62. Chang, K.E.; Wu, L.J.; Weng, S.E.; Sung, Y.T. Embedding game-based problem-solving phase into problem-posing system for mathematics learning. Comp. Educ. 2012, 58, 775–786. [Google Scholar] [CrossRef]
  63. Lin, S.Y.; Chien, S.Y.; Hsiao, C.L.; Hsia, C.H.; Chao, K.M. Enhancing Computational Thinking Capability of Preschool Children by Game-based Smart Toys. Electron. Commer. Res. Appl. 2020, 44, 101011. [Google Scholar] [CrossRef]
  64. Gallagher, A.C. Jigsaw puzzles with pieces of unknown orientation. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012; pp. 382–389. [Google Scholar]
  65. Huroyan, V.; Lerman, G.; Wu, H.T. Solving jigsaw puzzles by the graph connection Laplacian. SIAM J. Imaging Sci. 2020, 13, 1717–1753. [Google Scholar] [CrossRef]
  66. Doherty, M.J.; Wimmer, M.C.; Gollek, C.; Stone, C.; Robinson, E.J. Piecing together the puzzle of pictorial representation: How jigsaw puzzles index metacognitive development. Child. Dev. 2021, 92, 205–221. [Google Scholar] [CrossRef]
  67. Paikin, G.; Tal, A. Solving multiple square jigsaw puzzles with missing pieces. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 7–12 June 2015; pp. 4832–4839. [Google Scholar] [CrossRef]
  68. Pomeranz, D.; Shemesh, M.; Ben-Shahar, O. A fully automated greedy square jigsaw puzzle solver. In Proceedings of the 24th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011; pp. 9–16. [Google Scholar]
  69. Zhao, Y.X.; Su, M.C.; Chou, Z.L.; Lee, J. A puzzle solver and its application in speech descrambling. In Proceedings of the 2007 WSEAS International Conference on Computer Engineering and Applications, Gold Coast, Australia, 17–19 January 2007; pp. 171–176. [Google Scholar]
  70. Krotov, V.A. Quick Introduction to R and RStudio. Technical Report; Murray State University: Murray, KY, USA, 2017; pp. 1–15. [Google Scholar] [CrossRef]
  71. Hair, J.F.; Hult, G.T.M.; Ringle, C.M.; Sarstedt, M.; Danks, N.P.; Ray, S. Overview of R and RStudio. In Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R, 1st ed.; Springer: Cham, Switzerland, 2021; pp. 31–47. [Google Scholar]
  72. Cohen, L.; Manion, L.; Morrison, K. Research Methods in Education, 7th ed.; Routledge Publishers: Oxford, UK, 2013. [Google Scholar]
  73. Cochran, W.G. Sampling Techniques, 3rd ed.; John Wiley & Sons: New York, NY, USA, 2007. [Google Scholar]
  74. Kanaki, K.; Kalogiannakis, M. Introducing fundamental object-oriented programming concepts in preschool education within the context of physical science courses. Educ. Inf. Technol. 2018, 23, 2673–2698. [Google Scholar] [CrossRef]
  75. Darejeh, A.; Singh, D. A review on user interface design principles to increase software usability for users with less computer literacy. J. Comput. Sci. 2013, 9, 1443–1450. [Google Scholar] [CrossRef]
  76. Chongo, S.; Kamisah Osman, K.; Nayan, N.A. Level of Computational Thinking Skills among Secondary Science Student: Variation across Gender and Mathematics Achievement. Sci. Educ. Int. 2020, 31, 159–163. [Google Scholar] [CrossRef]
  77. Nieto-Márquez, L.N.; Baldominos, A.; Pérez-Nieto, M.Á. Digital Teaching Materials and Their Relationship with the Metacognitive Skills of Students in Primary Education. Educ. Sci. 2020, 10, 113. [Google Scholar] [CrossRef]
  78. LoBue, V.; Bloom Pickard, M.; Sherman, K.; Axford, C.; DeLoache, J.S. Young children’s interest in live animals. Br. J. Dev. Psychol. 2013, 31, 57–69. [Google Scholar] [CrossRef]
  79. Greek Ministry of Education. Document of Checking Progress of Primary School Students; Government Gazette 4358/issue B/13-12-2017; Government Printing Department: Athens, Greece, 2017. [Google Scholar]
  80. Vaz, S.; Falkmer, T.; Passmore, A.E.; Parsons, R.; Andreou, P. The case for using the repeatability coefficient when calculating test–retest reliability. PLoS ONE 2013, 8, e73990. [Google Scholar] [CrossRef]
  81. Sullivan, G.M. A primer on the validity of assessment instruments. J. Grad Med. Educ. 2011, 3, 119–120. [Google Scholar] [CrossRef]
  82. Liang, J.; Bi, G.; Zhan, C. Multinomial and ordinal Logistic regression analyses with multi-categorical variables using R. Ann. Transl. Med. 2020, 8, 982. [Google Scholar] [CrossRef]
  83. Janiesch, C.; Zschech, P.; Heinrich, K. Machine learning and deep learning. Electron. Mark. 2021, 31, 685–695. [Google Scholar] [CrossRef]
  84. Melis, C.; Wold, P.A.; Bjørgen, K.; Moe, B. Norwegian kindergarten children’s knowledge about the environmental component of sustainable development. Sustainability 2020, 12, 8037. [Google Scholar] [CrossRef]
  85. Wang, G.; Zhou, X.; Cui, H. Exploring education for sustainable development in a Chinese kindergarten: An action research. ECNU Rev. Educ. 2019, 2, 497–514. [Google Scholar] [CrossRef]
  86. Alsancak, D. Investigating computational thinking skills based on different variables and determining the predictive variables. Particip. Educ. Res. 2020, 7, 102–114. [Google Scholar] [CrossRef]
  87. Alyahya, D.M.; Alotaibi, A.M. Computational thinking skills and its impact on TIMSS achievement: An Instructional Design Approach. Issues Trends Learn. Technol. 2019, 7, 3–19. [Google Scholar] [CrossRef]
  88. Lei, H.; Chiu, M.M.; Li, F.; Wang, X.; Geng, Y.J. Computational thinking and academic achievement: A meta-analysis among students. Child. Youth Serv. Rev. 2020, 118, 105439. [Google Scholar] [CrossRef]
  89. Stubbs, E.A.; Zimmerman, A.R.; Warner, L.A.; Myers, B.E. Reflecting on a multidisciplinary collaboration to design a general education climate change course. J. Environ. Stud. Sci. 2018, 8, 32–38. [Google Scholar] [CrossRef]
Figure 1. Assigning values to the attribute “name”.
Figure 1. Assigning values to the attribute “name”.
Sustainability 14 10672 g001
Figure 2. (a) Four-piece puzzle; (b) Six-piece puzzle; (c) Nine-piece puzzle; (d) Twelve-piece puzzle.
Figure 2. (a) Four-piece puzzle; (b) Six-piece puzzle; (c) Nine-piece puzzle; (d) Twelve-piece puzzle.
Sustainability 14 10672 g002
Figure 3. Assessment worksheet about animals’ eating habits.
Figure 3. Assessment worksheet about animals’ eating habits.
Sustainability 14 10672 g003
Chart 1. AT levels in relation to content understanding.
Chart 1. AT levels in relation to content understanding.
Sustainability 14 10672 ch001
Chart 2. Content understanding levels in relation to AT.
Chart 2. Content understanding levels in relation to AT.
Sustainability 14 10672 ch002
Table 1. Contingency table of observed frequencies.
Table 1. Contingency table of observed frequencies.
CU 1ExcellentVery GoodGoodAlmost GoodSum
AT
Excellent322615982
Satisfactory35522827142
Medium36454044165
Basic47161946
Sum1071309999435
1 CU stands for content understanding.
Table 2. The ratio of the odds of CU levels in the presence of AT levels.
Table 2. The ratio of the odds of CU levels in the presence of AT levels.
CUExcellentVery GoodGoodAlmost Good
AT
Excellent2.371.110.720.36
Satisfactory1.011.590.770.72
Medium0.780.821.151.42
Basic0.260.391.972.71
Table 3. Ordinal logistic regression model for excellent content understanding.
Table 3. Ordinal logistic regression model for excellent content understanding.
ValueStd Errort-Valuep-Value
excellentContUnder3226159
basic|excellent35522827
excellent|medium36454044
medium|satisfactory471619
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kanaki, K.; Kalogiannakis, M.; Poulakis, E.; Politis, P. Investigating the Association between Algorithmic Thinking and Performance in Environmental Study. Sustainability 2022, 14, 10672. https://doi.org/10.3390/su141710672

AMA Style

Kanaki K, Kalogiannakis M, Poulakis E, Politis P. Investigating the Association between Algorithmic Thinking and Performance in Environmental Study. Sustainability. 2022; 14(17):10672. https://doi.org/10.3390/su141710672

Chicago/Turabian Style

Kanaki, Kalliopi, Michail Kalogiannakis, Emmanouil Poulakis, and Panagiotis Politis. 2022. "Investigating the Association between Algorithmic Thinking and Performance in Environmental Study" Sustainability 14, no. 17: 10672. https://doi.org/10.3390/su141710672

APA Style

Kanaki, K., Kalogiannakis, M., Poulakis, E., & Politis, P. (2022). Investigating the Association between Algorithmic Thinking and Performance in Environmental Study. Sustainability, 14(17), 10672. https://doi.org/10.3390/su141710672

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop