Next Article in Journal
Efficient Reuse of Railway Track Waste Materials
Next Article in Special Issue
Corporate Sustainability and Market Response According to the Name Change Strategy: Focusing on Korean IT Industry Firms
Previous Article in Journal
Analysis of the Cognitive Load of Employees Working from Home and the Construction of the Telecommuting Experience Balance Model
Previous Article in Special Issue
Deterioration Models for Bridge Pavement Materials for a Life Cycle Cost Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improving Computational Thinking and Teamwork by Applying Balanced Scorecard for Sustainable Development

1
Department of Information Management, National Taipei University of Business, Taipei City 100, Taiwan
2
Department of Business Administration, National Taipei University of Business, Taipei City 100, Taiwan
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(18), 11723; https://doi.org/10.3390/su141811723
Submission received: 1 August 2022 / Revised: 10 September 2022 / Accepted: 15 September 2022 / Published: 19 September 2022
(This article belongs to the Special Issue Sustainability Management Strategies and Practices)

Abstract

:
This work aimed to analyze the concept of a balance scorecard (BSC) tool integrated with computational thinking (CT) in university education. An experiential approach to learning about the CT through the study of a BSC performance evaluation tool has been reported. The BSC project offers students hands-on experience with the team-based, cross-functional, and strategic aspects of conceptual thinking. This study integrates the four aspects of the BSC into CT to evaluate students through four perspectives. The experiential approach requires each student to compose a team, find information about their motivation, and develop BSC concepts that apply learning performance in a computational thinking course. The conclusion suggests that the BSC project had a positive impact on the students who participated, indicating their overall knowledge and understanding of functional areas and relationships within the teamwork cooperation were enhanced. Our paper reports an experiential method of learning CT by studying BSC performance evaluation tools. The application example can enhance students’ logical thinking, what is indispensable and essential in maintaining competitiveness.

1. Introduction

Computational thinking (CT) is a term used since the 1950s to describe the fundamental concepts and problem-solving skills derived from computer science. Papert in 1980 [1] predicted that computational thinking could change the way children think across domains. In fact, his prediction has indeed been realized, and many researchers today agree that CT is a general ability [2,3] and can be applied to a wide range of fields, including social studies, humanities, and arts [4,5]. Wing [6] first proposed the term CT and mentioned that computational thinking is a problem-solving method. In 2008, it was again stated that operational thinking affects everyone’s performance and effort in every field [7]. Computational thinking is an analytical manner of thinking. It is consistent with mathematical thinking for the way that people solve problems. It has something in common with engineering ideas, that is, we can design and evaluate a complex system operating under the constraints of the real world. Although it is generally accepted in the literature that CT involves many skills, such as problem decomposition (decomposing complex problems into simpler problems), pattern recognition (observing trends and regularities in data), abstraction (identifying the general principles), and algorithm design (a step-by-step approach to problem solving), around some problems and challenges, people need to learn how to design an appropriate learning experience for CT capabilities with limited evidence. As for the research and implementation in the classroom, the teaching methods, content, and learning strategies of CT should be adjusted according to the age of students, because the cognitive ability of students changes with age [8]. Related to this, Brackmann et al. [9] pointed out that CT is now used and studied in schools through two main methods: computer programming exercises (plugin activities) and unplugged activities. The main difference between these two types of activities is the latter’s method of exposing students to CT without using a computer [10,11,12,13].
However, there are few studies on the training of computational thinking ability in the course at present [10,11,12]. The research of this computational thinking often lacks a logical process to introduce it into the university curriculum. The balance scorecard (BSC) is a concept developed by Kaplan and Norton [14,15]. The concept has been successfully applied in the service industry, government units, non-profit companies, and other industries [16,17,18]. The current work integrates a computational thinking process into a course using a BSC. It is meaningful to use a BSC as an educational tool, because it can evaluate financial and non-financial indicators and enables students to establish quantitative and non-quantitative measurement benchmarks among different functional management areas. Students’ academic performance is like financial indicators in management, while the learning process is like non-financial indicators. The learning process includes team cooperation and interaction. It can represent the process of operational thinking, teach students how to think and interact, and then promote students’ performance. Therefore, a BSC assists operational thinking to construct a logical process.
Computational thinking course design aims to promote teamwork and help students to provide opportunities to cooperate with students from various backgrounds. However, in the past, there was a lack of an effective management tool to achieve such goals. With the invention and development of information technology, the environment that teachers are facing today is quite different from that in the past. These environments include students from diverse backgrounds and students’ degrees are often different. Teachers undoubtedly face more challenges in the teaching process. University teachers must make full use of management tools to create teaching synergy. This paper fills the gap of computational thinking through a BSC, with indicator measurements, and we found essential ways in which logical thinking has been greatly integrated into training courses for students’ computational thinking and working style.
This paper is organized as follows. Section 2 introduces computational thinking. The questionnaire technique used to attain computational thinking criteria and factors is presented in Section 3. In Section 4, we infer the development procedure of the BSC project with the empirical results of computational thinking through the BSC framework and illustrate a simple example to conduct the computational thinking. Section 5 presents our conclusions and suggestions.

2. Literature Review

2.1. Computational Thinking

Computational thinking (CT) is a common skill in our lives or work; it is no longer stereotypically only required by computer engineers. Wing [1] first proposed CT in 2006. He mentioned that computational thinking is one way to solve problems. Furthermore, it was stated again in 2008 that computational thinking can affect everyone’s performance and efforts in each field [2], and that is why we should carefully review our education and teaching methods to meet new educational challenges. When the National Research Council of the United States held a conference to discuss computational thinking in 2010, it listed the relevant skills that computational thinking may include: problem abstraction, problem decomposition, reasoning, and computer science concepts [19]. Brennan and Resnick [20] described the key dimensions of the CT framework: computational concepts, computational practices, and computational perspectives, and after evaluating how these dimensions are developed, proposed a set of learning recommendations for evaluating young people studying programming. When students learn programming, they also need to use computational-thinking-related methods to solve problems through the process of abstraction, disassembly, design, and evaluation [21].
In recent years, computational thinking has gradually been recognized as an important skill for students in learning computer science and other subjects. Although this field has always attracted much attention, it is rarely taught as a formal course. There is no standard to evaluate what computational thinking is and how to teach it. However, the operation of CT can be divided into two categories: The first category is the definition of programming and computing concepts explicitly related to the learning and practice of CT through programming [22,23,24]. The second category is the position of CT as a capability and a problem-solving process, characterized by finding effective solutions through logical organization, analysis of data, use of models or simulations, etc. [25,26]. Therefore, no matter which category, the problems encountered in various fields can be solved through the framework of CT.
Lee et al. [27] proposed the computational thinking framework of “use, modify, and create” to represent the three stages of students’ cognitive and practical activities and develop a learning environment more suitable for computational thinking, hoping to help more students. del Olmo-Muñoz, Cózar-Gutiérrez, and González-Calero [28] assessed whether unplugged activities are beneficial to the early primary education of CT. To this end, a quasi-experimental study was carried out to explore the ultimate benefits of a hybrid approach combining unplugged and plug-in activities. In this event, three questions are analyzed and raised by three different terms: before teaching, during teaching, and after teaching. It was concluded that, considering CT, motivation, and gender, it seems beneficial to include unplugged activities in teaching. The study proposed by Wei, Lin, Meng, Tan, and Knog [29] examined partial pair programming pupils, CT skills, and self-efficacy (SE). The effectiveness of the research results showed that in 12-year basic education, programming teachers can use partial pair programming to improve students’ CT skills and programming SE.
Zhang et al. [30] proposed a flow chart progressive thinking training method to cultivate students’ computational thinking ability. The experimental results showed that the academic performance of the experimental group was significantly higher than that of the control group. At the same time, the programming self-efficacy of the experimental group was significantly improved. In addition, participants in the experimental group demonstrated higher levels of computational thinking skills, including cooperative learning, critical thinking, and problem-solving skills. The study [31] developed a scale to determine the programming-oriented computational thinking skills of university students. The scale consists of 33 items under conceptual knowledge, algorithmic thinking, and evaluation subscales. Experimental results show that programming experience has a significant impact on conceptual knowledge, algorithmic thinking, and evaluation. There are significant differences in algorithmic thinking abilities among students with low-, middle-, and high-level programming experience.

2.2. Balanced Scorecard (BSC)

The balanced scorecard (BSC) was first proposed by Kaplan and Norton [14]. This model can measure the functions of an organization from financial and non-financial perspectives. The BSC is a strategic planning and management system, which is widely used in government, industry, business, and non-profit organizations around the world to align business activities with the organization’s vision and strategy, improve internal and external communication, and monitor the organization’s performance in accordance with strategic goals [15].
Kaplan and Norton [14] suggested that managers can consider their strategic measures as a set of causal relationships among aspects of the BSC, rather than as performance factors on independent dimensions. They proposed a strategy map to enable managers to understand how the performance in each dimension follows a hierarchical structure. Improvement in learning and growth leads to better internal processes, enhanced value proposition to customers, and ultimately financial performance. Figure 1 shows these relationships between BSC dimensions. Kaplan and Norton believe that the strategic relationship among the dimensions can enable managers to examine strategy. For example, investment in sales (learning and growth) via the Internet can complete sales faster and more accurately (in terms of internal processes). It can increase market share (on the customer side) and thus bring in more profits (on the financial side). This study emphasizes how to introduce computational thinking into the BSC framework. The initial aspect of the BSC is learning and growth. The learning process includes team cooperation and interaction. It can represent the process of operational thinking, teach students how to think and interact, and then promote students’ performance. Therefore, the BSC assists operational thinking to construct a logical process.
Mio [32] used the balanced scorecard for sustainability (SBSC) as a performance measurement and management control tool that plays an important role in driving companies to achieve sustainable development goals. Specifically, it addresses the determinants of SBSC use, the approach companies take in SBSC application, and the results it produces in terms of its impact on sustainability control and management. The authors [33] aimed to assess the current state of research using the SBSC as they relate to outcomes related to environmental performance. It also attempts to propose a conceptual framework that presents the relationship between SBSC and environmental performance. The paper also highlighted that SBSC knowledge plays a mediating role in the above relationship. Furthermore, based on expert competence theory, the presence of experts may moderate the relationship between SBSC architecture and environmental performance outcomes.
Kaplan and Norton [14,15] introduced the BSC and its four perspectives to attain enterprise performance. It is a management framework that integrates strategic performance and can help organizations articulate, communicate, and translate strategy into action. The current study adopted the BSC framework in our computational thinking courses to emphasize the key role played by computational thinking in influencing and assessing learning performance from the four perspectives outlined by the BSC, as shown Table 1.
Balaji et al. [34] showed that supply chain management plays an important role in improving organizational efficiency and effectiveness. Designing a supply chain may not be enough to improve an organization’s overall performance, which can only be improved through evaluation. In addition to the supply chain operations reference model (SCOR), analytic hierarchy process (AHP), data envelope analysis (DEA), and heuristic-based models [16,17], the balanced scorecard (BSC) is a suitable tool. Addressing this ambiguity and improving supply chain performance using the balanced scorecard model is the focus of the current research effort by providing a way to examine value creation from four perspectives: financial, customer, internal business process, and learning and growth. Camilleri [35] presents a critical review of the relevant literature on managerialism in higher education. The interpretative study relied on the BSC approach as it appraised the participants’ opinions and perceptions. The findings revealed the strengths and weaknesses of using the BSC’s financial and non-financial measures to assess the institutional performance and productivity of individual employees. Based on this connection, we aimed for this paper to link the application of BSC in higher education to the CT course.
Therefore, referring to the computational practice in the key dimensions of the CT framework proposed by Brennan and Resnick [20], we aimed to lead students to construct a problem-solving process and, through cooperation among group members, constantly think, realize, test, rethink, re-realize, and test again. By repeating this process over and over, the team can gradually refine its solution to the problem. Finally, through the integration of the BSC performance evaluation tools, the overall knowledge and understanding of students’ team learning can be enhanced. We designed and implemented a computational thinking project into BSC and posed simple questions about a triangular figure to practice the computational thinking procedure.

3. Methodology

3.1. Research Hypothesis

The importance of designing interest-oriented computational thinking courses is proposed by Kong, Chiu, and Lai [36]. This type of course aims to improve students’ creative self-efficacy and provides opportunities for cooperation. Teachers need to adopt strategies to increase their interest in programming. Future research can evaluate whether courses incorporating collaboration opportunities can enhance students’ interest and ability in programming. Schröder-Hinrichs [37] designed a positive spirit of teamwork and provided students with opportunities to cooperate with students from different backgrounds. He found that students who were more active in cooperative attitudes had a greater sense of creative self-efficacy. Otheitis and Kunc [38] presented a method to help businesses develop their relationship models and understand them, and they proposed systematic thinking as a way to achieve these goals. A BSC helps enterprises outline the methods to achieve their goals. Relatively, a BSC can also be used in computational thinking courses to construct a set of methods to achieve their learning process. The research framework is shown for Figure 2.
These characteristics are classified in training and are satisfactory so as to benefit each other and improve the overall performance of the organization. The expected results can be presented in the form of two hypotheses:
Hypothesis 1 (H1):
The BSC significantly improves students’ perception and understanding of computational thinking processes.
Hypothesis 2 H2:
The BSC significantly improves students’ perception of how computational thinking promotes each other and teamwork.

3.2. Project Development Discussion

After graduating from junior high school, students in Taiwan’s education system can enter ordinary senior high schools or junior colleges. Junior colleges refer to five-year junior high schools, which enroll junior high school graduates. Through junior high school education examination, each department of junior college takes entrance without examination as the main recruitment channel. This study involves a computational thinking course for the first year of the five-year junior college. The goal of the course is to make students get used to finding solutions in a systematic way. At the beginning, it will take a lot of time for students to get used to; however, as long as they are gradually familiar with the whole process, this course is sure to be able to teach and develop a set of solutions for their own problems. The course content includes exercises of various types of questions, Sudoku games, and program logic analysis.
First of all, we first designed a theme of computational thinking for this project. The theme content includes exercises, such as various types of questions, Sudoku games, and program logic analysis. College students were invited to participate in an experimental study. This project used a balanced scorecard as a system of functional areas that work together to enhance the learning effectiveness of computational thinking. There are two classes with 58 students each. One class of 58 students (50%) completed the BSC project and agreed to further participate in the pilot study. All participating students have completed the BSC project, which is part of their grading course requirements. In the BSC project, students answered questionnaires and passed qualitative reasoning questions. The development of the BSC project considered computational thinking learning results, which ensures the BSC project is successful. In addition, some factors to consider include student expertise, course structure, teamwork, and teacher network. Adjusting the advantages and disadvantages of the BSC project strategically helps to enable students’ positive experience and computational thinking abilities.
At the beginning of the course, participants completed an online questionnaire so we could understand their views on the BSC project as well as to help them to understand the overall concept of computational thinking and the functional areas. The questionnaire scale consists of 10 questions. The 5-point Likert scale ranges from 1 (strongly disagree) to 5 (strongly agree). In addition, the questionnaire obtained demographic information, such as profession and gender, which is very important.
As shown in Table 2, we found that 58 students answered less than three of the ten questions before conducting computational thinking. It shows that students lacked the willingness and ability of thinking and teamwork. When measuring the research dimension, the reliability test method of the Cronbach alpha was used to measure whether the attributes are consistent and reliable. A summary measure of the correlation that exists between items is provided by the coefficient α. Table 2 shows the reliability test results of respondents’ views on the 10 items of the Likert type scale. The reliability values of all inspection items are far higher than 0.7, which is considered to be sufficient in basic research to achieve a satisfactory level of reliability [39]. We believe that participation in the BSC project can increase students’ understanding of how computational thinking promotes themselves, other students, team cooperation.

4. Empirical Results

For the reliability and validity analysis, the reliability of this paper applies Cronbach’s α to measure the consistency of each variable. If the value of Cronbach’s α falls between 0.7 and 0.98, the variable has a high level of reliability; if the value falls lower than 0.35, the variable must be deleted. After conducting reliability analysis, the average value for each variable reaches over 0.8, and they therefore have a high reliability value. Table 2 shows the reliability analysis results for each variable and factor. The questionnaire of this work has a theoretical foundation or practical verifications that were developed by foreign scholars conducting studies. Hence, the current study contains reasonable content validity.

4.1. Integrated BSC into Computational Thinking

This work applies the four perspectives of the BSC to computational thinking teamwork. Computational thinking courses should also start from the perspective of BSC learning and growth. The reconstruction of computational thinking can enhance students’ learning level and performance, and can evaluate students’ performance foundation through autonomous learning. Similar to the BSC, as employees learn and grow well, organizations can improve internal processes, such as teaching computational thinking in college courses. Students can play a role in autonomous learning if there is an ability to read, and a lot of information can be immediately found. Similar to the perspective of the BSC framework, internal processes can improve customer satisfaction. Students can solve difficult problems by decomposing several steps through computational thinking. Finally, the goal of the BSC is the financial performance of the enterprise, and the learning achievement of the CT course is just like the financial dimension of the BSC. The course learning achievement records the problem-solving process through computational thinking.
From the perspective of the BSC, we can connect the cause and effect of non-financial indicators and financial indicators. The design of a relative CT course can also be divided into final learning achievements (financial indicators) and learning processes (non-financial indicators). CT could determine the process of students solving problems and obtaining test scores. The concept of the BSC can promote the process of students’ understanding of CT. It can give students a better understanding of how to solve problems in facing difficult situations; see Figure 3.
In order to fill the gap between theory and practice, Figure 3 shows a causal analysis of the reconstruction of computational thinking. Initially, in students’ spare time, they surf the Internet or read books related to thinking (employee learning and growth). When students face the problem, they think about the possible solutions and write them down (internal processes). In the process of discussion, students always patiently explain the things they want to express to people (customer). This computational thinking course teaches students to come up with more possible solutions (financial). The above process represents the point of view of the BSC so that all students are aware of the causal relationship between the BSC and the computational thinking framework.
After designing a computational thinking framework from a BSC perspective, we integrated the BSC and CT frameworks into the process of teamwork analysis. Improving student problem solving through teamwork cooperation is indispensable and essential in a computational thinking course to promote logical thinking, avoiding repeat errors, and enhance computational ability. This computational thinking learning process mainly aims for educators to reconstruct the process of curriculum development, curriculum optimization, and teamwork through a BSC causal relationship, as shown in Figure 4.

4.2. Designing Computational Thinking Course through BSC Perspective

In order to allocate resources related to the BSC project, the management of the course is used to publish a large number of resources, such as:
(a)
Examples of a balanced scorecard;
(b)
Scorecards of different industries for comparison;
(c)
Project description;
(d)
Project team business contact information;
(e)
Project calendar.
Through the BSC project, we developed CT teaching materials. Through the design of the BSC, we taught students the procedures of team cooperation, as shown in Table 3.
As can be seen in Table 3, the BSC project needs time to introduce the BSC concept and team introduction. The BSC framework should be introduced in class before student groups begin to study their balanced scorecard projects. The BSC can be introduced at any time during the course. The teacher restructured the computational thinking curriculum for freshmen around the four aspects of BSC, and introduced the framework and four aspects of BSC in the first class. With the understanding of the structure of the whole course, even traditional programming topics, such as programming languages, can be discussed within the framework of BSC’s four perspectives. The 14-week sample syllabus uses the BSC as the learning evaluation, as shown in Table 3. The total classroom time for a balanced scorecard project obviously depends on teamwork and presentation duration.

4.3. Teaching Instruments and Course Plan (Formal Courses)

Table 4 shows the teaching materials and content used in CT courses. The most commonly used is the programming design course, which takes 18 weeks and earns students two credits per semester. The course is arranged to help students complete CT activities through experiments and playing online games. At the same time, robots, game competitions, videos, or other materials are also involved to train students’ CT ability. Table 3 can demonstrate how the BSC assists the CT course arrangement for 18 weeks through four steps: autonomous learning, computational thinking ability, group cooperation, and learning achievement.
As seen in Table 3, regarding the questionnaire item for designing a computational thinking course through the BSC perspective, 58 students (50%) completed the BSC project and answered the questions in Table 2. The results in Table 5 show that the integration of the four CT perspectives of the BSC explains the significant differences in CT objects, and H1 is supported: the BSC significantly improves students’ perception and understanding of the computational thinking process. Students can obtain self-practice and thinking to solve any complicated problems through the learning and internal processes of BSC perspectives. In Figure 3, the computational thinking process is formed from with the BSC and it reconstructs the process of curriculum development. H2 is supported: the BSC significantly improves students’ understanding of how computational thinking promotes themselves, other students, and teamwork. Students can learn and imitate to observe the teamwork cooperation through sharing and discussion about logical thinking problems. Therefore, we suggest that, in the information management course, we should also cultivate students’ logical thinking ability, help them understand the causal relationship, and provide the basis for the future conceptual thinking course arrangement, in addition to training information professionals.

5. Conclusions and Suggestions

5.1. Conclusions

Several past studies have found that managers lack a basic understanding of the BSC method [40,41,42,43,44]. Our paper reports an experience method of learning CT by studying BSC performance evaluation tools. The BSC project provides students with practical experience in cross-functional, team-based, and conceptual thinking. The project aims to address several educational objectives, including improving student problem-solving through teamwork cooperation, promoting logical thinking, avoiding repeat errors, enhancing computational abilities, and developing oral presentation and teamwork skills.
Our results correspond to Hunt, Taylor, Winter, Mackie, and Fisher [45]. In order to confirm students’ understanding of the business function domain, Hunt et al. [45] assigned BSC projects to students in basic courses and completed a survey to determine whether BSC enhanced their knowledge and understanding of business disciplines within the organization. Therefore, because the balanced scorecard can improve the learning effect, we conducted a study to help improve students’ cognition and understanding of the importance of computational thinking. We hypothesized that BSC would significantly increase students’ awareness of mutual benefit and teamwork in computational thinking and functional areas. The survey results show that the BSC project has a positive impact on the participating students, indicating that their overall knowledge and understanding of the functional areas and relationships in teamwork have been enhanced.

5.2. Contributions and Future Directions

This paper has several advantages over the existing BSC case studies in the literature because it encourages students to think first before proceeding with subsequent process. The experiential approach requires each student to compose a team, find information about their motivation, and develop BSC concepts that apply learning performance in a computational thinking course. To achieve this, we recommend that lesson plans should include functional areas and a manner for how each functional area affects the tasks of teaching arrangements. All four assessments of a BSC project—financial, customer, internal processes, and learning and growth —should be taught. This study can integrate the four aspects of BSC and CT to evaluate students through four perspectives: autonomous learning, computational thinking ability, group cooperation, and curriculum learning achievement. Enhancing students’ logical thinking is essential for maintaining competitiveness. This BSC framework mainly requires educators to redo curriculum development, the development of colleges and universities, and the technical specifications of the convention. The theoretical implication is that BSC can not only be used as a performance management tool, but can also be used to further achieve students’ learning results in CT courses.
The research limitation in this study is the measurement of the computational thinking course, which is mainly based on the number of small classes. If we can expand to a larger number of samples and fill in the quantitative questionnaire, we can understand the causal relationship between variables. As long as it is carefully designed, implemented, and evaluated, the BSC project has great potential. Therefore, it is possible to provide a summative assessment in the first year of the school’s preliminary courses, and to promote students’ knowledge and understanding of computational thinking innovation. This paper can help related university educators establish computational thinking courses to enhance student competitiveness and construct problem solving approaches for professional abilities to be applied throughout the BSC. BSC is a comprehensive tool that allows teachers and students to perform in the teaching scene and can have a significant impact on their university education and learning, which can affect their future careers.

Author Contributions

Conceptualization, L.-C.C. and W.-C.L.; methodology, L.-C.C. and W.-C.L.; software, L.-C.C. and W.-C.L.; validation, L.-C.C. and W.-C.L.; formal analysis, L.-C.C. and W.-C.L.; investigation, L.-C.C.; data curation, L.-C.C.; writing—original draft preparation, W.-C.L.; writing—review and editing, W.-C.L.; project administration, L.-C.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Papert, S. Mindstorms: Children, Computers, and Powerful Ideas; Basic Books, Inc.: New York, NY, USA, 1980. [Google Scholar]
  2. Barr, V.; Stephenson, C. Bringing computational thinking to K-12: What is involved and what is the role of the computer science education community? ACM Inroads 2011, 2, 48–54. [Google Scholar] [CrossRef]
  3. Voogt, J.; Fisser, P.; Good, J.; Mishra, P.; Yadav, A. Computational thinking in compulsory education: Towards an agenda for research and practice. Educ. Inf. Technol. 2015, 20, 715–728. [Google Scholar] [CrossRef]
  4. Kalelioglu, F.; Gülbahar, Y.; Kukul, V. A framework for computational thinking based on a systematic research review. Balt. J. Mod. Comput. 2016, 4, 583–596. [Google Scholar]
  5. Tang, X.; Yin, Y.; Lin, Q.; Hadad, R.; Zhai, X. Assessing computational thinking: A systematic review of empirical studies. Comput. Educ. 2020, 148, 103798. [Google Scholar] [CrossRef]
  6. Wing, J.M. Computational thinking. Commun. ACM 2006, 49, 33–35. [Google Scholar] [CrossRef]
  7. Wing, J.M. Computational thinking and thinking about computing. Philos. Trans. R. Soc. 2008, 366, 3717–3725. [Google Scholar] [CrossRef]
  8. Hsu, T.C.; Chang, S.C.; Hung, Y.T. How to learn and how to teach computational thinking: Suggestions based on a review of the literature. Comput. Educ. 2018, 126, 296–310. [Google Scholar] [CrossRef]
  9. Brackmann, C.P.; Roman-Gonzalez, M.; Robles, G.; Moreno-Leon, J.; Casali, A.; Barone, D. Development of computational thinking skills through unplugged activities in primary school. In Proceedings of the 12th Workshop on Primary and Secondary Computing Education—WiPSCE ’17, Nijmegen, The Netherlands, 8–10 November 2017; pp. 65–72. [Google Scholar]
  10. Huang, W.; Looi, C.K. A critical review of literature on “unplugged” pedagogies in K-12 computer science and computational thinking education. Comput. Sci. Educ. 2021, 31, 83–111. [Google Scholar] [CrossRef]
  11. Relkin, E.; de Ruiter, L.E.; Bers, M.U. Learning to code and the acquisition of computational thinking by young children. Comput. Educ. 2021, 169, 104222. [Google Scholar] [CrossRef]
  12. Saxena, A.; Lo, C.K.; Hew, K.F.; Wong, G.K.W. Designing unplugged and plugged activities to cultivate computational thinking: An exploratory study in early childhood education. Asia-Pac. Educ. Res. 2020, 29, 55–66. [Google Scholar] [CrossRef]
  13. Tikva, C.; Tambouris, E. Mapping computational thinking through programming in K-12 education: A conceptual model based on a systematic literature Review. Comput. Educ. 2021, 162, 104083. [Google Scholar] [CrossRef]
  14. Kaplan, R.S.; Norton, D.P. The Balanced scorecard: Measures that drive performance. Harv. Bus. Rev. 1992, 70, 71–79. [Google Scholar]
  15. Kaplan, R.S.; Norton, D.P. Using the balance scorecard as a strategic management system. Harv. Bus. Rev. 1996, 74, 75–85. [Google Scholar]
  16. El Dardery, O.I.; Gomaa, I.; Rayan, A.R.; El Khayat, G.; Sabry, S.H. Sustainable Balanced Scorecard for Kaizen Evaluation: Comparative Study between Egypt and Japan. Int. J. Econ. Manag. Eng. 2021, 15, 917–926. [Google Scholar]
  17. Gazi, F.; Atan, T.; Kılıç, M. The Assessment of Internal Indicators on The Balanced Scorecard Measures of Sustainability. Sustainability 2022, 14, 8595. [Google Scholar] [CrossRef]
  18. Sucozhañay, G.; Cabrera, F.; Sucozhañay, D.; Guaman, R.; Siguenza-Guzman, L.; Vanegas, P. Toward a sustainability balanced scorecard for managing corporate social responsibility: A conceptual model. In Advances and Applications in Computer Science, Electronics and Industrial Engineering; Springer: Singapore, 2021; pp. 279–298. [Google Scholar]
  19. National Research Council. Report of a Workshop on the Scope and Nature of Computational Thinking; National Academies Press: Washington, DC, USA, 2010. [Google Scholar]
  20. Brennan, K.; Resnick, M. New frameworks for studying and assessing the development of computational thinking. In Proceedings of the 2012 Annual Meeting of the American Educational Research Association 2012, Vancouver, BC, Canada, 13–17 April 2012; Volume 1, p. 25. [Google Scholar]
  21. Selby, C.; Woollard, J. Computational Thinking: The Developing Definition; Project Report; University of Southampton: Southampton, UK, 2013. [Google Scholar]
  22. Lye, S.Y.; Koh, J.H.L. Review on teaching and learning of computational thinking through programming: What is next for K-12? Comput. Hum. Behav. 2014, 41, 51–61. [Google Scholar] [CrossRef]
  23. Román-González, M.; Pérez-González, J.C.; Jiménez-Fernández, C. Which cognitive abilities underlie computational thinking? Criterion validity of the computational chinking test. Comput. Hum. Behav. 2017, 72, 678–691. [Google Scholar] [CrossRef]
  24. Buitrago Fl´orez, F.; Casallas, R.; Hern´andez, M.; Reyes, A.; Restrepo, S.; Danies, G. Changing a generation’s way of thinking: Teaching computational thinking through programming. Rev. Educ. Res. 2017, 87, 834–860. [Google Scholar] [CrossRef]
  25. Tedre, M.; Denning, P.J. The long quest for computational thinking. In Proceedings of the Koli Calling Conference on Computing Education Research, Koli, Finland, 24–27 November 2016; pp. 120–129. [Google Scholar]
  26. Weintrop, D.; Beheshti, E.; Horn, M.; Orton, K.; Jona, K.; Trouille, L.; Wilensky, U. Defining computational thinking for mathematics and science classrooms. J. Sci. Educ. Technol. 2016, 25, 127–147. [Google Scholar] [CrossRef]
  27. Lee, I.; Martin, F.; Denner, J.; Coulter, B.; Allan, W.; Erickson, J.; Malyn-Smith, J.; Werner, L. Computational thinking for youth in practice. ACM Inroads 2011, 2, 32–37. [Google Scholar] [CrossRef]
  28. del Olmo-Muñoz, J.; Cózar-Gutiérrez, R.; González-Calero, J.A. Computational thinking through unplugged activities in early years of Primary Education. Comput. Educ. 2020, 150, 103832. [Google Scholar] [CrossRef]
  29. Wei, X.; Lin, L.; Meng, N.; Tan, W.; Kong, S.C. The effectiveness of partial pair programming on elementary school students’ computational thinking skills and self-efficacy. Comput. Educ. 2021, 160, 104023. [Google Scholar] [CrossRef]
  30. Zhang, J.H.; Meng, B.; Zou, L.C.; Zhu, Y.; Hwang, G.J. Progressive flowchart development scaffolding to improve university students’ computational thinking and programming self-efficacy. Interact. Learn. Environ. 2021, 1–18. [Google Scholar] [CrossRef]
  31. Kılıç, S.; Gökoğlu, S.; Öztürk, M. A valid and reliable scale for developing programming-oriented computational thinking. J. Educ. Comput. Res. 2021, 59, 257–286. [Google Scholar] [CrossRef]
  32. Mio, C.; Costantini, A.; Panfilo, S. Performance measurement tools for sustainable business: A systematic literature review on the sustainability balanced scorecard use. Corp. Soc. Responsib. Environ. Manag. 2022, 29, 367–384. [Google Scholar] [CrossRef]
  33. Jassem, S.; Zakaria, Z.; Azmi, A.C. Sustainability balanced scorecard architecture and environmental performance outcomes: A systematic review. Int. J. Product. Perform. Manag. 2021; ahead-of-print. [Google Scholar]
  34. Balaji, M.; Dinesh, S.N.; Kumar, P.M.; Ram, K.H. Balanced Scorecard approach in deducing supply chain performance. Mater. Today Proc. 2021, 47, 5217–5222. [Google Scholar] [CrossRef]
  35. Camilleri, M.A. Using the balanced scorecard as a performance management tool in higher education. Manag. Educ. 2021, 35, 10–21. [Google Scholar] [CrossRef]
  36. Kong, S.C.; Chiu, M.M.; Lai, M. A study of primary school students’ interest, collaboration attitude, and programming empowerment in computational thinking education. Comput. Educ. 2018, 127, 178–189. [Google Scholar] [CrossRef]
  37. Schröder-Hinrichs, J.U. Human and organizational factors in the maritime world—Are we keeping up to speed? WMU J. Marit. Aff. 2010, 9, 1–3. [Google Scholar] [CrossRef]
  38. Otheitis, N.; Kunc, M. Performance measurement adoption and business performance. Manag. Decis. 2015, 53, 139–159. [Google Scholar] [CrossRef]
  39. Churchill, G.A. Marketing Research: Methodological Foundations, 5th ed.; The Dryden Press: New York, NY, USA, 1991. [Google Scholar]
  40. Capelo, C.; Lopes, A.I.; Mata, A. Teaching the balanced scorecard through simulation. In Proceedings of the IADIS International Conference on Cognition and Exploratory Learning in Digital Age, Madrid, Spain, 19–21 October 2012. [Google Scholar]
  41. Ladewski, B.J.; Al-Bayati, A.J. Quality and safety management practices: The theory of quality management approach. J. Saf. Res. 2019, 69, 193–200. [Google Scholar] [CrossRef]
  42. Lingle, J.; Schiemann, W. From balanced scorecard to strategic gauges: Is measurement worth it? Manag. Rev. 1996, 85, 56–61. [Google Scholar]
  43. Malmi, T. Balanced scorecards in finish companies. Manag. Account. Res. 2001, 12, 207–220. [Google Scholar] [CrossRef]
  44. Stivers, B.; Colvin, T.; Hall, G.; Smalt, S. How nonfinancial performance measures are used. Manag. Account. 1998, 44, 46–49. [Google Scholar]
  45. Hunt, I.; Taylor, R.K.; Winter, A.; Mackie, J.J.; Fisher, D. Using the balanced scorecard to enhance undergraduate education in a first year business course: A pilot study. J. Educ. Bus. 2016, 91, 132–137. [Google Scholar] [CrossRef]
Figure 1. The causal relationships among BSC’s perspectives.
Figure 1. The causal relationships among BSC’s perspectives.
Sustainability 14 11723 g001
Figure 2. Research framework.
Figure 2. Research framework.
Sustainability 14 11723 g002
Figure 3. BSC integrated into computational thinking.
Figure 3. BSC integrated into computational thinking.
Sustainability 14 11723 g003
Figure 4. Simple computational thinking theme integrated into BSC procedure.
Figure 4. Simple computational thinking theme integrated into BSC procedure.
Sustainability 14 11723 g004aSustainability 14 11723 g004b
Table 1. The four perspectives of the BSC framework.
Table 1. The four perspectives of the BSC framework.
PerspectivesObjectiveMeasure
FinancialHow do we look to shareholders?The financial view covers the income in terms of sales growth, profitability, and cash flow.
CustomerHow do customers see us?Customer views reflect measures to provide customers with differentiated value.
Internal businessWhat must we excel at?The internal business view focuses on key business processes in order to satisfy customers and shareholders.
Innovation and learningCan we continue to improve and create value?The point of view of innovation and learning is to address the need for an organizational climate that promotes knowledge and innovation by strengthening human resources and information technology.
Table 2. Frequency, means, standard deviations and reliability of students observed.
Table 2. Frequency, means, standard deviations and reliability of students observed.
ItemQuestionFMSD α
1When discussing problems with people, I always know clearly what they want to express.343.480.720.86
2I am a person who enjoys sharing ideas with others.333.600.970.74
3When I have a problem, I can always come up with a solution.233.270.700.90
4I’ve always been able to work out a set of simple and easy to understand methods for dealing with complex problems.193.130.810.91
5I’m good at writing. I can easily write an article.42.200.910.89
6I always listen patiently to what others want to say and express.443.870.720.81
7I always have patience to explain and explain what I want to express.293.420.950.86
8When I encounter something I don’t understand, I will be brave to ask questions and seek solutions.173.050.830.86
9Usually, I always record what I see, think of and hear.112.671.070.75
10Usually, I like to observe surrounding affairs and try to think about solutions to problems.323.530.900.81
Note: F = Frequency of more than 3; total of 58 students to answer questions; α = reliability.
Table 3. Design of computational thinking course through BSC perspective.
Table 3. Design of computational thinking course through BSC perspective.
PerspectiveCourse ArrangementConcrete Practice
Autonomous learningSelf-practice and thinkingIn my spare time, I will try to think about various problems.
In my spare time, I will download app related to Computational Thinking to train myself.
In my spare time, I will spend more time thinking about problems.
In my spare time, I will surf the Internet or read books related to thinking.
Computational thinking abilityDecomposition processWhen the problem is more complex, I will try to break the problem into several small problems for easy solution.
When I see the problem, I think about the possible solutions and write them down.
If I encounter any problem, I will try every means.
Group cooperationLearning and imitationI’m going to observe the way the team members express themselves.
I will go to learn the problem-solving or explanation methods of more powerful team members.
I always listen patiently to what others want to say and express.
Share and expressI always have patience to explain and explain what I want to express.
During the discussion, I am a person who is willing to share my ideas.
Curriculum learning achievementCertificate examinationThis course has taught me the skill of problem thinking.
This course makes me no longer afraid to deal with problems.
This course has taught me to come up with more possible solutions.
Semester resultsThis course gives me a better understanding of how to carry out problems in other courses
In the future, I will consider taking professional technical courses related to computational thinking.
Table 4. Teaching materials and content in CT course.
Table 4. Teaching materials and content in CT course.
WeekTopicLevel of DetailComplementing Item
1Introduction Test 1 Initial questionnaire
2Step 1: Understanding problemsLead students to understand the logical relationship between the description of the problem and how to find the key points in the problem.BSC integrated into computational thinking: autonomous learning
3Step 2: Find a wayTry to find out possible solutions according to what you have learned. You don’t care about the processing efficiency of the method, but only care whether the problem can be solved.BSC integrated into computational thinking: computational thinking ability
4Step 3: Confirm the resultsAccording to the proposed solution, the problem is solved in practice and the result is confirmed to be correct.BSC integrated into computational thinking: group cooperation
5Step 4: Share the results
(1)
The results are the same, but the methods of solving problems are different.
(2)
Students can share on stage to make themselves more clearly confirm whether they really understand and can clearly describe to others.
BSC integrated into computational thinking: learning achievement (Students share individual problem-solving methods and learn more about the way to solve problems).
6Question exercisesAll kinds of exercises are standard answers as long as they can be solved.Collaboration discussion, Brainstorming
7
8
9Mid-term examOral or pen and paper test
10Question exercisesAll kinds of exercises are standard answers as long as they can be solved.Collaboration discussion, Brainstorming
11
12
13Video appreciation,
robots, games competition
How the protagonist can deal with problems in the competition of video or games so that students can learn various possible methods in a relaxed atmosphere.Four steps of BSC to help students solve problems
14
15Question exercisesAll kinds of exercises are standard answers as long as they can be solved.Collaboration discussion, Brainstorming
16
17
18Final examOral or pen and paper testTest 2 Final questionnaire
Table 5. Regression analysis of conceptual thinking and learning outcomes.
Table 5. Regression analysis of conceptual thinking and learning outcomes.
VariablesBtSignificanceHypothesis
Constant0.3720.423--
Autonomous learning0.1252.125***H1
Computational thinking ability0.2762.573***H1
Group cooperation0.3283.281***H2
Course learning achievement0.4514.387***H2
Note: *** shows p < 0.005.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chang, L.-C.; Lin, W.-C. Improving Computational Thinking and Teamwork by Applying Balanced Scorecard for Sustainable Development. Sustainability 2022, 14, 11723. https://doi.org/10.3390/su141811723

AMA Style

Chang L-C, Lin W-C. Improving Computational Thinking and Teamwork by Applying Balanced Scorecard for Sustainable Development. Sustainability. 2022; 14(18):11723. https://doi.org/10.3390/su141811723

Chicago/Turabian Style

Chang, Lung-Chun, and Wen-Cheng Lin. 2022. "Improving Computational Thinking and Teamwork by Applying Balanced Scorecard for Sustainable Development" Sustainability 14, no. 18: 11723. https://doi.org/10.3390/su141811723

APA Style

Chang, L. -C., & Lin, W. -C. (2022). Improving Computational Thinking and Teamwork by Applying Balanced Scorecard for Sustainable Development. Sustainability, 14(18), 11723. https://doi.org/10.3390/su141811723

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop