Next Article in Journal
The Influence of Consumption Context on Indulgent Versus Healthy Yoghurts: Exploring the Relationship between the Associated Emotions and the Actual Choices
Next Article in Special Issue
Can Holistic Education Solve the World’s Problems: A Systematic Literature Review
Previous Article in Journal
Comparative Efficiency and Sensitivity Analysis of AC and DC Power Distribution Paradigms for Residential Localities
Previous Article in Special Issue
Self-Efficacy Beliefs of Teaching ESD: A Theory-Driven Instrument and the Effectiveness of ESD in German Teacher Education
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sustainability
Volume 14
Issue 13
10.3390/su14138221
sustainability-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effectiveness of Social Participation Courses Applied in the Disaster Prevention for Taiwanese K-12 Education

by
Wen-Jye Shyr
1,*,
Wei-Sho Ho
1,
Jie-Ru Chen
2,*,
Li-Ya Chang
3 and
I-Min Chen
1
1
Department of Industrial Education and Technology, National Changhua University of Education, No. 1, Jin-De Rd., Changhua 500, Taiwan
2
Department of Civil Engineering, National Chi Nan University, No. 1, University Rd., Puli, Nantou 54561, Taiwan
3
Center for General Education, National Chi Nan University, No. 1, University Rd., Puli, Nantou 54561, Taiwan
*
Authors to whom correspondence should be addressed.
Sustainability 2022, 14(13), 8221; https://doi.org/10.3390/su14138221
Submission received: 21 May 2022 / Revised: 24 June 2022 / Accepted: 29 June 2022 / Published: 5 July 2022
(This article belongs to the Special Issue Effectiveness of Education for Sustainable Development (ESD) in Kindergarten, School and University: Empirical Educational Research Perspectives)
Browse Figures
Versions Notes

Abstract

:
The development of disaster prevention literacy is not listed as a compulsory course in the K-12 education system in Taiwan, and there are very few academic departments that focus mainly on disaster prevention education in the domestic higher education system. For Taiwan, where disasters are relatively frequent, it is indispensable for every citizen to have the proper disaster prevention knowledge and response skills. In recent years, education courses related to disaster prevention have been gradually set up in general education courses in universities and colleges in response to the trend. This study took students of the elective courses on disaster prevention education in the general education courses of universities as the experimental subjects. Supplemented by the social participation course operation model, the cooperation of team members during the course can bring students a different experiential value to further achieve the teaching goal of improving learning achievement and feedback. It was found from the research results that: (1) the appropriate disaster prevention course arrangement can bring positive and significant effects on the dimensions of perceived experience and team interaction; (2) the learning mode of the university disaster prevention education course, combined with the social participation course operation model, was helpful to the improvement of experiential value and learning achievement; (3) the mediation regression analysis showed the cooperation mode of group team members’ interaction did have a partial mediation effect in terms of experiential value, as well as learning achievement and feedback compared with the traditional pure classroom teaching model. The research results indicated that the teaching effectiveness of the disaster prevention education course for college students with the social participation course operation model was good.

1. Introduction

The occurrence of natural disasters around the world continues, and according to the statistic over the past twenty years from “Our World in Data” of the University of Oxford, around 1,230,000 people died from large-scale natural disasters equals to annually around 60,000 in average, which takes 0.1 percentage of the total number of death over the world. A total of 720,221 people (63%) died from earthquakes, 36,368 people (24%) died from extreme climate, 104,707 people (11%) died from flood, and 17,947 people (2%) died from landslide [1]. The book ‘How to Avoid a Climate Disaster: the Solutions we Have and the Breakthroughs we Need’ mentioned that 1–3% GDP expenditure will be used in disaster prevention [2]. According to the report of United Nations and OCED [3,4], 90% of earthquake deaths occurs in developing countries due to the underperformance in engineering design, construction practices, corruption of the building department, and the lack of knowledge and preparedness [5]. Natural disasters not only cause great destruction to human lives, and especially in developing countries, but causes significant economic losses in developed countries [6]. Other than strengthening the documentation of the causes of events and improving disaster analysis capabilities, counting and reviewing from a historical perspective, learning about disasters, improving disaster risk awareness, and reducing disaster losses have become the key tasks of the government in every country. Since the 921 Earthquake in Taiwan in 1999, the relevant government departments have not only set 21 September as the National Disaster Prevention Day every year but also actively introduced disaster prevention education courses to all stages of the education system. Baytiyeh and Öcal [7] showed that incorporating earthquake risk education into school curricula is necessary to reduce the impact of future earthquake hazards and make vulnerable communities less vulnerable to future crises. However, in Taiwan’s higher education system, few general education centers offer disaster prevention education courses.
In view of the fact that the government of Nigeria in West Africa has implemented a social participatory operation model to lead farmers to fight against climate change, the strategy has achieved great success [8]. In addition, there is no relevant literature in Taiwan that integrates the social participation operation model and disaster prevention education curriculum design into the teaching. Only recently the Taichung City Government’s promotion of social participatory budget review has received enthusiastic responses from the general public [9]. This study was designed and implemented to fill the gaps in the literature. The purpose of this research is to use the disaster prevention education courses offered by the university general education center combined with the social participatory operation model to bring the courses to the service field for implementation. Students can make use of the disaster prevention knowledge or the skills learned to design a set of course learning models suitable for the service targets (e.g., the elderly in the community or the elementary school students) through the discussions and ideas of the team members and further to teach and interact with the service targets to deepen the students’ self-disaster-prevention literacy in the process, to understand the students’ overall learning achievement and feedback, and verify whether the perceived usefulness, team interaction, experiential value, and other factors have a mediation effect and also to explore the feasibility and related factors affecting learning achievement.
This study explored whether personal perceived usefulness is a subjective evaluation that can be controlled by improving experiential value or achievement and feedback in disaster prevention education courses. Therefore, we added team interaction, experiential value, and other influencing factors apart from the above-mentioned theories and research. Further, we proposed a comprehensive model combining the design of disaster prevention courses in the disaster prevention education of the university general education course with the social participation operation model. Moreover, we used perceived usefulness as a mediation variable to explore the model’s impact on the experiential value and learning achievement and feedback.

2. Literature Review

2.1. Social Participation Courses

In the competitive environment of diversified learning and cross-field training, “service learning” and “social participation” will inevitably become key capabilities in the future lifelong learning process. The relationship between the two is also two sides of the same thing. Liu and Tsai [10] found that after the service learning, university students’ communication ability, empathy, teamwork skills, social care and civic literacy will increase significantly. Therefore, if related learning and experience are provided to students in the general education course of universities, it will help university students become social persons, indirectly improving their adaptability to enter the workplace after graduation.
“Service learning” means that learners combine theories, learning goals, and self-reflection from the service activities in the social participation course field and apply the learned theories and course content to solve problems related to the served object or field. They can even learn how to integrate themselves as a member of the field and become problem solvers through services and understand the true meaning of service. The experience of service learning is very meaningful to university students [11], especially their participation in the learning process [12]. Service learning is vital for higher education [13]. Zlotkowski [14] indicated that service learning is beneficial for university students to develop their problem-solving ability and build interpersonal relationships, something which also helps them quickly face the challenges of new environment and new education model. Service learning also helps students learn from experiences and at the same time increase their critical thinking ability to questions [15]. Students, schools, community agencies, teachers, and those who are served all benefit from service learning, which created a multi-win situation in education [16]. The two core elements of service learning are reflection and feedback. Service learning is a course-based, credit-bearing educational experience model that allows learners to achieve the goal of meeting the needs of the served through the arrangement and reflection process of the package course, promote the learning and development of the server, and nurture the correct sense of personal value and civic responsibility [17]. Eyler [18] pointed out that the reflection process of service learning should focus on whether problem-solving strategies, personal creativity growth, life-long learning skills, and analysis or insights on the causes of complex issues can be obtained via discussion. In addition, the reflection process should also focus on whether it can help individuals adjust to pressure and enhance group cohesion, where trust is also the focus of thinking [19]. According to the reports, students with service-learning experiences and active social interaction gain higher satisfaction in workplace [20,21,22]. Service learning not only improves interpersonal relationships but also significantly increases activities of daily living, learning motivation and job performance [23,24].
Instead of classroom teaching and learning, the main purpose of social participation courses [25] was planned by using the existed social issues and real field to help learners from different fields with their self-transformation through their feeling, experiences, hands-on and minds-on learning [26] in order to allow students to experience “service done”, “learning acquired”, and thinking about the learning concepts of how to “reflect the spirit of service”, “go out of the traditional classroom”, and “give back to the society” from the designed courses, then to achieve social participation. Social participation could be in ways of cultures, economy or other kinds of public lives, which improve participants’ public responsibility and service consciousness and as a consequence creates the value of mutual cooperation [27]. Through the operation of the disaster prevention courses via the social participation interface, students can identify with the service object or the field during the learning process, which inspires them in both microeconomics and macroeconomics to initiate re-learning to gain problem-solving abilities and recognize social responsibility [28,29,30]. The participating students can deeply feel the needs of the people being served and discover their potential value. This is the important purpose of offering courses in the field of disaster prevention in the general education of universities.

2.2. Disaster Prevention Literacy and Disaster Prevention Course Design

The so-called disaster prevention literacy can usually be divided into three aspects [31]: disaster prevention knowledge, disaster prevention attitude, and disaster prevention skills. The three are closely related, of which the course design for disaster prevention education is also constructed based on the abovementioned three aspects.
The subject content of disaster prevention courses roughly includes three categories: natural disasters, man-made disasters, and compound disasters. The quality of the course design and the final learning achievement and feedback must be related to a certain degree. The development of disaster prevention literacy has become an indispensable link among the education system of all countries in the world. Taiwan, which suffers from frequent natural disasters, is no exception. In recent years, the design of disaster prevention courses is no longer limited to the traditional one-way teaching method in the classroom [32,33]. Instead, various diversification models, interaction, and practical experience are continuously introduced to deepen learning achievement, cultivate disaster prevention literacy, and teach students the correct concept of facing disasters and the attitude toward disaster prevention and mitigation. Consequently, they can use the disaster prevention literacy accumulated in peacetime, react quickly, and show enough resilience when disasters come.
Zhang et al. [34] had indicated that disaster prevention literacy of college students belongs to lower level. From the result of the survey participants, 79.43% of students show that their families are not prepared for the disasters. A total of 88.64% of them gain the disaster prevention knowledge from TV or the Internet while only 12.89% of them gain from school courses. Up to 77.8% of people indicate that they used to experience disaster education and 85.5% of people hope to attend systematic disaster prevention courses in which the rescue skills courses is much needed [35].
A large-scale investigation has been conducted by Dong et al. [36] concerning university students’ disaster cognition and emergency response ability in Mainland China, Macao, Hong Kong, and Taiwan and the result showed university students’ lack of unexpected disasters cognition, lack of emergency response ability and their deficiency of disaster related consciousness. Baytiyeh and Naja [37] showed that students form different subjects in Lebanese University shows that they have lower level of earthquake preparedness and higher-level academic institutions do not make a significant contribution to earthquake preparedness. A survey in way of questionnaire by Su et al. [38] about university students’ focus on natural disasters, disaster prevention consciousness, knowledge of disaster theory, emergency response, and their thinking about education for disaster reduction showed that university students were at a low level in disaster cognition and there was a high bias between the disaster reduction education nowadays and students’ expectation. It’s suggested that disaster prevention related elective subjects be set up and combine with gym class and military training class to cultivate students’ first aid, escape and survival skills, and related keynote lectures and drills are also necessary for students to enhance their evacuation, rescue and risk avoidance ability.
Academic institutions are regarded by students as the learning environment for their knowledge development, interpersonal relationship ability, and the foundation of safety culture in communities [39]. Consequently, there is an urgent need to set up disaster prevention courses in college and related research suggests that courses about the fundamental concept of risks and disasters are priority [40]. Otherwise, to improve college disaster prevention education system, the disaster prevention exercise should be conducted once a semester among all college departments as groundwork for reviews and disaster preparedness. As for the setting up of disaster prevention, Çalışkan and Üner [41] built the conceptual model base on mitigation, preparedness, response, and recovery dimensions and at the same time offered a basis for the development of the disaster literacy measuring tool and in the long run to make contribution to the evidence-based research.
In addition to the introduction to the field of action, environmental inspections, grouping of members, and interactive communication, the disaster prevention courses in this study also included climate change and various types of disasters in Taiwan, introduction to disaster prevention and rescue process and plans in Taiwan, the aging society and life disasters, community disaster prevention and community construction, teaching materials design for disaster prevention education promotion, introduction to life safety and disaster prevention, emergency medicine, discussion of common campus accident cases, design and implementation of disaster prevention teaching aids, action plan simulation and implementation, practical teaching in the field of service, and others. The on-site operation in the neighboring primary and secondary schools or communities was integrated into the process with the concept of learning from doing and doing while learning so that students in the course can become seed disaster-prevention teachers. It not only improves their own disaster prevention awareness but also enables them to assist service targets or the people around them in implementing disaster prevention and safety awareness. In this way, the students in the course can develop the correct values and sense of responsibility for disaster prevention education and get a deeper disaster prevention experience and literacy cultivation to apply “disaster prevention as an attitude of life” in everyday life rather than merely taking it as a slogan.

2.3. Perceived Usefulness

Among the relevant theories on the acceptance of the use of information technology, the “technology acceptance model (TAM)” proposed by Davis et al. [42] and Davis [43] is the most extensively used, which can be applied to different research contexts, regardless of people, systems, and field and time backgrounds. It has become a research model that spans time, domains, and research subjects. This model introduces two personal beliefs of “perceived usefulness” and “perceived ease of use”, which are considered to directly affect the attitude toward use. Meanwhile, other influencing factors all have an indirect effect on the attitude through these two beliefs.
The theory of planned behavior (TPB) proposed by Ajzen [44] believes that people’s behaviors are not completely controlled by personal will but are also affected by perceived behavioral control. The so-called perceived behavioral control is the degree to which an individual feel that they can control or master a specific behavior. “Perceived usefulness” has direct influence on the acceptability of virtual learning environment, VLE; “perceived ease of use” and “Subjective Norm, SN” have indirect effect only on “perceived usefulness” while personal creativity and computer anxiety have direct effect on “perceived ease of use” [45]. Chai et al. [46] founded that “perceived usefulness” has positive correlation with attitude toward using. Lee et al. [47] indicated that “perceived usefulness” plays the mediator role between external variable and attitude toward using.
This study explored whether personal perceived usefulness is a subjective evaluation that can be controlled by improving experiential value or achievement and feedback in disaster prevention education courses. Wang [48] indicated that perceived practicality has positive correlation with experiential value. Therefore, we added team interaction, experiential value, and other influencing factors apart from the above-mentioned theories and research. Further, we proposed a comprehensive model combining the design of disaster prevention courses in the disaster prevention education of the university general education course with the social participation operation model. Moreover, we used perceived usefulness as a mediation variable to explore the model’s impact on the experiential value and learning achievement and feedback.

2.4. Team Interaction

While learning the courses, students can improve their learning process and improve academic achievement if they ask questions and participate in various class discussions [49]. Class participation is divided into three aspects, namely cognitive participation, emotional participation, and behavioral participation [50]. Cognitive participation [51] refers to the cognitive efforts for psychological contribution, learning, understanding, and acquiring knowledge. Emotional participation [52] includes emotional reactions, such as interest, boredom, self-confidence, and fear in the classroom, as well as attitudes towards schools, teachers, and learning. Behavior participation [53] refers to students’ general behavior (i.e., compliance with school rules and regulations) and all forms of behaviors that are more directly related to learning, including group questioning, filling in worksheets, and other forms of active learning activities. Talat and Riaz [54] analyzed how teams work from the view of information processing and found that information situation, communication information and task interdependence play important roles in teamwork [55]. Therefore, this study aims to enhance members’ communication, coordination and cooperation among each other through teamwork and team sharing [56]. Chang et al. [57] indicated that teamwork that applied in university students’ service experimental and learning camp abilities in the front, middle and back process helps accomplish the goal of the service experimental and learning camp through members’ interaction, candid communication and mutual trust and cooperation. The social participation operation model of this study was also based on the framework of team interaction, as well as small group division of labor and cooperation.

2.5. Experiential Value

Zeithaml [58] pointed out that the result and evaluation of the overall feeling of consumers’ comparing the cost of the process and the feedback they receive after the experience is called value. The so-called experience is the practical wisdom accumulated by the interaction between the organism and the environment, which can be used to guide current life affairs [59]. Sheth et al. [60] showed that consumer decision process, consumers made decision according to product function, mass society connection, feelings, emotion situation, curiosity and the desire to knowledge, which is called “experiential value”. In addition, experience is also known as people’s evaluation of whether a certain thing is worth investing in or is similar to the original self-cognition through the degree of self-experience. Nowadays, there are multiple divisions of labor in society, and the meaning of “experience” is interpreted in each field from different professional perspectives. The theory of experiential marketing put forward has attracted the most attention. Schmitt [61] proposed the related elements of experiential marketing, including sense, feel, think, act, and relate. These five forms consist of the strategic experiential modules (SEMs), among which the concepts sense, feel and think are personal experiences, while act and relate are shared experiences. As a consequence, experiential value is a kind of mental spiritual satisfaction which forms deep memory or create good one [62]. Chen et al. [63] proposed that experiential value is visitor’s’ overall feeling created from local team interaction when traveling.
Throsby [64] explored the components of experiential value at the cultural level and divided it into six aspects: aesthetic value, spiritual value, social value, historical value, symbolic value, and authenticity value. In the field of marketing, Mathwick et al. [65] divided the experiential value into four types based on the classification of consumer value: customer, return on investment, aesthetics, playfulness, and service excellence.

2.6. Achievement and Feedback

An effective feedback strategy for course teaching is an indispensable and important factor in achieving teaching goals. Related studies have shown that feedback is the information that learners receive through certain channels in learners’ performance after learning [66], which is further divided into knowledge of performance (KP) and knowledge of results (KR). The former refers to the information on tricks, skills, or techniques about performance that learners receive from themselves, teachers, or coaches. On the other hand, the latter means that after learners complete the action response, teachers or coaches provide the relevant response results and skill performance characteristics and return the results to the learners [67].
The mutual feedback of peer learning is the most powerful information resource and the most effective feedback since, in the process of learning, the cultivation of interpersonal communication and social skills can be strengthened through mutual encouragement, mutual explanation, teaching, demonstration among the members of the same group, and cooperative learning environment. Feedback can stimulate the individual’s internal learning motivation, making it easier to improve learning achievements and goals [68,69].

3. Methodology

3.1. Research Structure

This study took the subject courses related to disaster prevention education in the university general education program as the main research object to discuss the impact of disaster prevention course design, perceived usefulness, team interaction, the experiential value on achievement and feedback; and verify whether there is a mediation effect. The research structure model is shown in Figure 1.
Figure 1 found that the predictive variable (X) simultaneously affected the parallel mediation variables (perceived usefulness, M1; team interaction, M2). In turn, it affected the serial mediation variable (experiential value, M3), finally affecting the outcome variable (achievement and feedback, Y).

3.2. Research Hypotheses

In this study, relevant theories and research were summarized, and the path analysis concept of the multiple regression model was adopted to propose the following research hypotheses according to the research structure, as shown in Figure 1.
Hypothesis 0 (H0).
“Disaster prevention course design” has a positive and significant overall effect on the “achievement and feedback” of general courses on disaster prevention education.
Hypothesis 1 (H1).
“Disaster prevention course design” has a positive and significant direct effect on the “achievement and feedback” of general education courses on disaster prevention education.
Hypothesis 2 (H2).
“Disaster prevention course design” has a positive and significant impact on the “perceived usefulness” of general courses on disaster prevention education.
Hypothesis 3 (H3).
“Perceived usefulness” has a positive and significant impact on the “experiential value” of general courses on disaster prevention education.
Hypothesis 4 (H4).
“Perceived usefulness” has a positive and significant impact on the “achievement and feedback” of general courses on disaster prevention education.
Hypothesis 5 (H5).
“Disaster prevention course design” has a positive and significant impact on the “experiential value” of general courses on disaster prevention education.
Hypothesis 6 (H6).
“Experiential value” has a positive and significant impact on the “achievement and feedback” of general courses on disaster prevention education.
Hypothesis 7 (H7).
“Disaster prevention course design” has a positive and significant impact on the “team interaction” of general courses on disaster prevention education.
Hypothesis 8 (H8).
“Team interaction” has a positive and significant impact on the “experiential value” of general courses of disaster prevention education.
Hypothesis 9 (H9).
“Team interaction” has a positive and significant impact on the “achievement and feedback” of general courses on disaster prevention education.

3.3. Participates

By way of purposive sampling, this study was conducted for freshman to senior students who took elective courses in a one-semester in 2021 fall related to disaster prevention education in the general education program of a comprehensive university in central Taiwan (the geographic area where most people died from natural disasters in the recent 60 years according to the statistic [70]. A total of 132 people participated in the study by filling out the response scale questionnaire and there was a total of 124 valid samples (45 males and 79 females) after excluding the incomplete and invalid samples which meets the requirement of the existing literature [71]. There are two universities in this geographic area and the sampling distribution corresponded to the population which is considered to be representativeness of sample [72,73,74].

3.4. Research Tools and Measurement of Variables

The learning response scale and the questionnaire were adopted as the research tools. Five-factor dimensions (potential variables), namely (1) “disaster prevention course design”, (2) “perceived usefulness”, (3) “team interaction”, (4) “experiential value”, and (5) “achievement and feedback”, were planned in combination with disaster prevention education courses and the social participation operation model to complete the research items (observation variables). Each item in the scale was answered with a Likert five-point scoring method [75], with 5 point, 4 point, 3 point, 2 point, and 1 point, respectively, assigned for the five options, namely “Strongly agree”, “Agree”, “Somewhat agree”, “Disagree”, and “Strongly disagree”. According to the factor analysis extraction results, 4 to 6 items were retained as the measurement items for the five-factor dimensions, leaving a total of 23 items. There are five items for (1) “disaster prevention course design”: basic understanding, concept strengthening, thinking guidance, disaster prevention experience, and awareness enhancement; four items for (2) “perceived usefulness”: perceived diversity, perceived practicality, perceived help, and perceived benefit; five items for (3) “team interaction”: teamwork, team concept, team communication, team achievement, and team experience; six items for (4) “experiential value”: functional experiential value, interactive experiential value, inductive experiential value, knowledge experiential value, and feedback experiential value; three items for (5) “achievement and feedback”: effective feedback, experiential feedback, and application feedback.

3.5. Data Processing

In this study, after the students completed the questionnaire, the valid questionnaires (N = 124) were coded and logged, and the data were imported into the SPSS statistical analysis software to analyze the questionnaire data. This research operation follows the suggestion from Babbie et al. [76]. In addition to the basic descriptive statistics, multiple regression analysis methods in combination with the plug-in software PROCESS 3.5 Mode 80 and other statistical methods were also used [77]. Furthermore, the test significance level was set as α = 0.05.

3.6. Statistical Methods

3.6.1. Exploratory Factor Analysis

This study aimed to understand the number and correlations of potential variables extracted from the observation variables originally measured (25 items) after exploratory factor analysis. Each student must go through a semester-long course work before qualified for taking the questionnaire survey. According to related literature of the factor analysis [78], when there are over 100 valid questionnaires and the number of the valid ones are five times than the question items, the statistical data has reference value [79,80,81]. There was a total of 25 items in the original observation variables of this study. After performing 3 rounds of factor analysis, items 16 and 22 were deleted in the 2nd and 3rd rounds, respectively, and a total of 5 dimensions (potential variables) were extracted from the remaining 23 items, which are “disaster prevention course design”, “perceived usefulness”, “team interaction”, “experiential value”, and “achievement and feedback”.

3.6.2. Validity Analysis

For validity analysis, this study used the principal component analysis method of factor analysis for factor extraction, performed a principal component analysis on the original 25 items with the normalized Kaiser maximum variation method (Varimax) for the orthogonal rotation axis, and extracted the common factors through the component matrix after the rotation axis. For factors with a factor loading greater than 0.50 and the eigenvalues greater than 1.0, the communality between the items and component validity was further verified. The results [82,83] showed that the research factor explained less than 50% of the variation for all variables, indicating that the common method variation did not affect the results of this study.

3.6.3. Reliability Analysis

Generally, after the validity is confirmed by factor analysis, the reliability and validity of the questionnaire items will be further investigated. Thus, the reliability test must be carried out. The reliability test method commonly used in the Likert scale is the “Cronbach’s α” coefficient or the “split-half reliability” [84]. Therefore, this study used the Cronbach’s α values (alpha reliability) of the overall scale and the scale of the five-factor dimensions to verify the internal consistency of the scales. Hair et al. [85] suggested that Cronbach’s α value should be greater than 0.7 to be viewed as credible; the questionnaire could be revised or the questions could be added or deleted if the α value is below 0.7.

3.6.4. Statistical Analysis Methods of Mediation Mechanism

In order to explore the mediation mechanisms of the disaster prevention course experience and achievement in the field of disaster prevention education and estimate the degree and importance of direct and indirect effects, this study used the Mode 80 in the PROCESS macro (version 3.5) [86]. This research follows Abu-Bader and Jones point of view that considers the significance of computation coefficient models [87], and also refers to Baron and Kenny’s point of view to verify the mediating effect [88].
All indirect effects were tested by bootstrapping analysis, using 5000 bootstrap samples to generate bias-corrected bootstrap confidence intervals. That is, the original data is replaced and repeatedly sampled thousands of times to estimate the pattern of each sub-sample, calculate its own indirect effects, and test the end value of the confidence interval of each sub-sample.
Figure 2 shows the use of Mode 80 in testing the hybrid serial-parallel mediation path method assumed in this study to estimate the parameters. The indirect effect was estimated by the percentile bootstrapping method using 5000 bootstrap samples. Considering the problem between the statistical power and Type I error in various inferential statistical methods, Hayes and Scharkow [89] believe that using the percentile bootstrapping method to test indirect effects is appropriate.

4. Results

4.1. Research Hypothesis Empirical Results

The research hypotheses formulated in this study based on the research structure are as follows. After the statistical analysis, 8 original hypotheses have positive and significant effects (H0, H1, H2, H5, H6, H7, H8, and H9), ** p < 0.01. Only two hypotheses did not have significant positive effects (H3, H4). The complete research hypotheses and verification results are shown in Table 1.

4.2. Correlation and Descriptive Statistical Analysis

To ensure the correlation between the various variables of the mediation mechanism of the constructed disaster prevention course experience and effectiveness, this study conducted a Pearson correlation analysis shown in Table 2 indicated a significant correlation among all variables, including predictive variable, parallel and serial mediation variables, and the outcome variable (p < 0.01), where X had a positive correlation with M1, M2, and M3.

4.3. Reliability and Validity Test

The varimax orthogonal axis was used to extract factors with factor loading greater than 0.5. In testing the scale’s construction validity, the results showed that the KMO value of the scale of this study was 0.917, which is judged as a good value, after 3 rounds of factor analysis and the deletion of two items [90]. The χ2 value of Bartlett’s spherical test was 3342.663, p < 0.001, and reached a significant level [91], demonstrating that there were common factors among the items in the learning response scale. In addition, the average communality of the items was also 0.7 or more [92]. This finding means that the variance of each item can be explained by common factors to a good degree and is suitable for factor analysis. The result of the factor analysis showed that the cumulative total explained variance of the 5 common factors after the rotation axis was 82.998%, significantly more than 50%, indicating that the validity has reached a certain level. The scale used in this study has good factor validity. In addition, validation of validity was based on the method suggested by Anderson and Gerbing [93].
As mentioned above, Cronbach’s α value was adopted as the reliability coefficient of the study to test the internal consistency of the scale. The Cronbach’s α values of the five common factor scales extracted were between 0.897–0.953, and the Cronbach’s α value of the overall scale was 0.973, implying good internal consistency of the scale. With regards to the reliability test, the study takes the standard suggested by Nunnally to set the Cronbach’s α value of each variable to at least 0.7 [94]. The results are summarized in Table 3.

5. Discussion

This study explored that the teaching effectiveness of the disaster prevention education course for college students with the social participation course operation model. The control value theory of achievement emotions refers to learning achievement-related emotions for examining the affective factors [95,96,97].

5.1. Parameter Estimation of Mediation Effect Model

This study used disaster prevention course design (X) as the independent variable, achievement and feedback (Y) as the outcome variable; and perceived usefulness (M1), team interaction (M2) and experiential value (M3) as mediation variables, as shown in Table 4. First, the disaster prevention course design (X) had a significant positive predictive effect on perceived usefulness (M1), and its prediction explained the variance of 69.7%. The prevention disaster course design (X) had a significant positive predictive effect on team interaction (M2), and its prediction explained the variance of 30.4%. Second, both disaster prevention course design (X) and team interaction (M2) had a significant positive predictive effect on the experiential value (M3), and its prediction explained the variance of 68.4%. Finally, disaster prevention course design (X), team interaction (M2), and experiential value (M3) also had a significant positive predictive effect on achievement and feedback (Y), and the prediction explained 74.1% of the variance.

5.2. Test of Effects of Mediation Mechanism

This study tests the overall, direct, and indirect effects, as shown in Table 5. First, the disaster prevention course design (X) had a significant positive overall effect on the achievement and feedback (Y) (c2 = 0.796, t = 14.031). This is followed by disaster prevention course design (X), which also had a significant direct effect on achievement and feedback (Y) (c2′ = 0.276, t = 2.801) after adding the mediation variables, such as perceived usefulness (M1), team interaction (M2), experiential value (M3), etc. Disaster prevention course design (X) still had a significant positive impact on achievement and feedback (Y), showing that this mode was partial mediation, where the strength of mediation was as high as 65.3%.
Finally, the disaster prevention course design (X) through perceived usefulness (M1), team interaction (M2), experiential value (M3), and other mediation variables had a significant positive-sum indirect effect on achievement and feedback (Y) (total indirect effects). The tests of each path’s specific indirect effects respectively showed that (1) disaster prevention course design (X) failed to have significant indirect effect on achievement and feedback (Y) through the mediation of perceived usefulness (M1); (2) disaster prevention course design (X) had a significant indirect effect on achievement and feedback(Y) through the mediation of team interaction (M2) and the strength of the mediation effect reached 13.0%; (3) disaster prevention course design (X) did not have a significant indirect effect on achievement and feedback (Y) through the mediation of perceive usefulness (M1) and experiential value (M3); (4) disaster prevention course design (X) had a significant indirect effect on achievement and feedback (Y) through the mediation of team interaction (M2) and experiential value (M3), but the strength of the mediation effect was only 6.6%.
The standardized regression coefficients of each path in Figure 3 showed that the mediation mechanism of the disaster prevention course experience and effectiveness constructed by this study had three significant indirect effects. The mediation mechanism involved two strong paths, namely disaster prevention course design (X)→experiential value (M3)→achievement and feedback (Y), and disaster prevention course design (X)→team interaction (M2)→achievement and feedback (Y). The weaker path was disaster prevention course design (X)→team interaction (M2)→experiential value (M3)→achievement and feedback (Y).
The above-mentioned statistical results indicate that “team interaction” and “experiential value” are key factors to “achievement and feedback”. The “team interaction” dimension is planned and designed according to the concept of cognitive participation, emotional participation and behavioral participation while in this study is divided into five questionnaires including team cooperation, team concept, team communication, and team achievement to match the study’s situation of disaster prevention for college students. Both results show that “team interaction” used in disaster prevention courses enhance college students’ learning effectiveness. The “experiential value” is planned according to the theoretical framework of experiential marketing and is conducted into the following six questionnaires of experiential value of functionality, experiential value of interactivity, experiential value of inducement, experiential value of emotionality, experiential value of knowledge, and experiential value of feedback in which the significant indirect effects are shown.
The statistical data analysis of this study is as follows. (1) Most of the original research hypotheses established are in conformity with other researchers [98,99,100,101,102,103]. Only two hypotheses were not established: (H3) “perceived usefulness has a positive and significant impact on the experiential value of general courses of disaster prevention education” and (H4) “perceived usefulness has a positive and significant impact on the achievement and feedback of general courses of disaster prevention education”. (2) The learning response scale has reached a certain level. (3) In terms of verifying the mediation effect, team interaction and experiential value did have a partial mediation effect on the impact of disaster prevention course design on learning achievement and feedback in conformity with other researchers [100,101].
The summary of this study is as follows. (1) General education courses related to disaster prevention, when offered in universities, will not be able to improve experiential value, bring positive effects on the learning achievement and feedback of the disaster prevention education courses, or achieve learning goals if the students taking the courses stop at the cognitive level of “perceived usefulness”. For example, students would (a) only understand that disaster prevention education courses are rich and diversified in content; (b) only understand that the knowledge on disaster prevention and mitigation as well as disaster relief is useful in life; (c) only know that having good disaster prevention skills is helpful for their own safety; and (d) only agree that the overall benefit of learning disaster prevention courses is high, or the motivation for some students to take such courses is only to meet the requirements of the school’s general education credits. (2) If a good disaster prevention education course can be designed to provide students with complete learning, experience, and practice, the results would show that students’ response is good for the achievement and feedback in having basic knowledge of disaster prevention and disaster relief or other content. (3) Introducing the social participation course operation model into the university disaster prevention education courses through group team interaction with actual field service learning can not only improve students’ learning achievement, make them think about how to meet the needs of service receivers, and stimulate their own potential, but it can also strengthen their ability to respond to various types of disasters in the future, further affecting their family or friends. (4) Students who have taken the courses are also willing to conduct further study or research on knowledge related to disaster prevention education if relevant opportunities are available in the future to achieve a positive cycle in promoting disaster prevention education. (5) The launch of disaster prevention education is indeed an urgent need for college students. The disaster prevention education courses in this study aims to let students understand about different types of natural disasters and risks in Taiwan, and to think and experience the disasters in their daily lives in order to carry out the further teaching goals of learning from doing and doing while learning, and at the same time to enhance students’ disaster prevention literacy, which is same as what scholars suggested in reference [14] to design the courses based on risks and disasters as priority.

6. Limitations and Future Recommendations

This study strives for preciseness but still has the following limitations which can be offered as suggestion for further related researches in the future. First, as far as the research participants are concerned, this study only chose university students as samples. Therefore it is suggested that further studies consider students in different study periods (senior high school, junior high school, elementary school and kindergarten) in order to understand the differences. Secondly, in response to the COVID-19 pandemic and to follow government’s epidemic prevention regulations, this study was not able to have any further counseling interviews with university students. We suggest future researchers toward related topic to consider qualitative research [104,105,106], narrative research [107,108], grounded theory [109,110], case study [111], and quantitative research [112] to increase research’s reliability and validity. In terms of statistical analysis, since the validation only is limited to university students in this research, we suggest collecting observations from different participants toward the same condition in the future, and at the same time make use of the multilevel model [113] or hierarchical linear model, HLM [114] for analysis in order to delineate the interaction effect of cross-level analysis and to complete the research results.

7. Conclusions

This study took elective disaster prevention education courses in the general education program of universities. The content mainly focused on the social participation course operation model and the discussion of related courses on disaster prevention education. To design the operating modes for the courses for audiences of different ages and on different topics, such as students of other academic systems or social people, we should consider the essential differences. That is, when thinking about the scenario and planning for other similar research topics, we still need to focus on the “perceived usefulness”, “team interaction”, “experiential value”, and other dimensions or items for further exploration or introduce different learning modes to verify learning achievement and overall feedback further. Further research direction will be: (1) to choose different kinds of audience as research object or use related disaster prevention courses as situation study direction; and (2) to increase the participant quantity of attending the disaster prevention related courses.
Government in countries around the world should be prepared for the natural disasters that will happen at any time, and therefore the strengthening in disaster prevention and reduction become the common issue that the government and public should face together in which the education is the primary part that should be started first. It is expected that the similar operation model which combines disaster prevention education and social participation implemented in this study will be widely accepted and applied.

Author Contributions

All authors contributed meaningfully to this study. W.-J.S. and I.-M.C.—research topic; W.-S.H., I.-M.C., J.-R.C. and L.-Y.C.—data acquisition and analysis; W.-J.S., W.-S.H. and J.-R.C.—methodology support; W.-J.S., W.-S.H. and L.-Y.C.—original draft preparation; W.-J.S., J.-R.C. and I.-M.C.—writing review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This study was based on work supported by the Ministry of Science and Technology of Taiwan, Republic of China, under contract MOST 110-2124-M-260-001.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Global Change Data Lab. Global Natural Disaster Death Rates, All natural Disasters, 1900 to 2019. Available online: https://ourworldindata.org/grapher/natural-disaster-death-rates (accessed on 10 March 2022).
  2. Gates, B. How to Avoid a Climate Disaster: The Solutions We Have and the Breakthroughs We Need; Random House Large Print: New York, NY, USA, 2021. [Google Scholar]
  3. UN. The Sustainable Development Goals Report 2019; UN: New York, NY, USA, 2019. [Google Scholar]
  4. OECD. Costs of Inaction of Environmental Policy Challenges; Report ENV/EPOC(2007)17/REV2; OECD: Washington DC, USA, 2008. [Google Scholar]
  5. Escaleras, M.; Anbarci, N. Register Public sector corruption and major earthquakes: A potentially deadly interaction. Public Choice 2007, 132, 209–230. [Google Scholar] [CrossRef]
  6. Daniell, J.; Vervaeck, A. Damaging Earthquake Database 2011—The Year in Review, CATDAT-Integrated Historical Global Catastrophe Database. 2011. Available online: https://www.cedim.kit.edu/download/CATDATDamagingEarthquakesDatabase2011AnnualReview.pdf (accessed on 20 May 2022).
  7. Baytiyeh, H.; Öcal, A. High school students’ perceptions of earthquake disaster: A comparative study of Lebanon and Turkey. Int. J. Disaster Risk Reduct. 2016, 18, 56–63. [Google Scholar] [CrossRef]
  8. Ogunleye, A.; Kehinde, A.; Mishra, A.; Ogundeji, A. Impacts of Farmers’ Participation in Social Capital Networks on Climate Change Adaptation Strategies Adoption in Nigeria. Heliyon 2021, 7, e08624. [Google Scholar] [CrossRef] [PubMed]
  9. Shih, S.W. Leaving no trace on the water? Reflections on the practice of participatory budgeting in Taichung city. J. New Prax. 2022, 2, 129–175. [Google Scholar]
  10. Liu, R.L.; Tsai, H.C. Action research to enrich learning from conflict to collaboration: Bridging the first-year students and the NGOs agencies in service learning program. Syst. Pract. Action Res. 2020, 33, 295–309. [Google Scholar] [CrossRef]
  11. Gardner, J.N. What, so what, now what: Reflections, findings, conclusions, and recommendations on service-learning and the first-year experience. In Service-Learning and the First Year Experience: Preparing Students for Personal Success and Civic Responsibility (Monograph No. 34); Zlotkowski, E., Ed.; University of South Carolina, National Resource Center for the First-Year Experience and Students in Transition: Columbia, SC, USA, 2002; pp. 141–150. [Google Scholar]
  12. Astin, A.W.; Sax, L.J. How undergraduates are affected by service participation. J. Coll. Stud. Dev. 1998, 39, 251–263. [Google Scholar]
  13. Bringle, R.G.; Hatcher, J.A.; Muthiah, R.N. The role of service-learning on the retention of first-year students to second year. Mich. J. Commun. Serv. Learn. 2010, 16, 38–49. [Google Scholar]
  14. Zlotkowski, E. Service-learning and the first-year student. In Challenging and Supporting the First-Year Student: A Handbook for Improving the First Year of College; Upcraft, M.L., Gardner, J.N., Barefoot, B.O., Eds.; Jossey-Bass: San Francisco, CA, USA, 2005; pp. 356–370. [Google Scholar]
  15. Cress, C.M.; Collier, P.J.; Reitenauer, V.L. Learning through Serving: A Student Guidebook for Service-Learning across the Disciplines; Stylus Publishing, LLC.: Sterling, VA, USA, 2005. [Google Scholar]
  16. Geroge-Paschal, L.; Hawkins, A.; Graybeal, L. Investigating the overlapping experience and impacts of service-learning: Juxtaposing perspectives of students, faculty, and community partners. Mich. J. Community Serv. Learn. 2019, 25, 43–61. [Google Scholar]
  17. Bringle, R.G.; Hatcher, J.A. A service-learning curriculum for faculty. Mich. J. Community Serv. Learn. 1995, 2, 112–122. [Google Scholar]
  18. Eyler, J. Creating your reflection map. In Developing and Implementing Service-Learning Programs; Canada, M., Speck, B.W., Eds.; Jossey-Bass: San Francisco, CA, USA, 2001; pp. 35–44. [Google Scholar]
  19. Wade, R.C. (Ed.) Community Service Learning: A Guide to Including Service in the Public School Curriculum; State University of New York Press: Albany, NY, USA, 1997; pp. 94–112. [Google Scholar]
  20. Cho, H.; Wong, Z.E.; Chiu, W. The effect of volunteer management on intention to continue volunteering: A mediating role of job satisfaction of volunteers. Sage Open 2020, 10, 2158244020920588. [Google Scholar] [CrossRef]
  21. Ocal, A.; Altınok, A. Developing social sensitivity with service-learning. Soc. Indic. Res. 2016, 129, 61–75. [Google Scholar] [CrossRef]
  22. Wozencroft, A.J.; Hardin, R. Students’ job satisfaction in a therapeutic recreation service learning project. J. Hosp. Leis. Sport Tour. Educ. 2014, 15, 103–115. [Google Scholar] [CrossRef]
  23. Cheng, T.M.; Hou, H.Y.; Agrawal, D.C.; Chi, C.J. A hierarchical linear model of alumni survey on individual competency, institutional service, and job satisfaction in a case university in taiwan. J. Inst. Res. South East Asia 2021, 19, 81–100. [Google Scholar]
  24. Huang, Y. Learning from Service-Cross-Domain Service Learning Theory and Practice; Hong Ye: Taipei, China, 2007. [Google Scholar]
  25. Jacoby, B. Building Partnership for Service-Learning; Jossey-Bass: San Francisco, CA, USA, 2009. [Google Scholar]
  26. Su, Y.R.; Chen, Y.F.; Lin, M.Z. A retrospective preliminary study on the operation and action reflection of university social practice courses. New Pract. Local Soc. 2019, 159–191. Available online: https://www.hisp.ntu.edu.tw/report_news?id=61 (accessed on 20 May 2022).
  27. Hsu, M.L.; Juang, W.J. Study of Campus Journalist’s Utilization of Citizen Media and Civic Participation Practice: With PeoPo Citizen Journalism Platform as Example. J. Democr. Gov. 2019, 6, 1–31. [Google Scholar]
  28. Aldrich, D.P. Fixing Recovery: Social Capital in Post-Crisis Resilience. J. Homel. Secur. Forthcom. 2010. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1599632 (accessed on 20 April 2022).
  29. Prasad, S.; Su, H.C.; Altay, N.; Tata, J. Building disaster-resilient micro enterprises in the developing world. Disasters 2015, 39, 447–466. [Google Scholar] [CrossRef] [Green Version]
  30. Kehinde, A.D.; Adeyemo, R.; Ogundeji, A.A. Does social capital improve farm productivity and food security? Evidence from cocoa-based farming households in Southwestern Nigeria. Heliyon 2021, 7, e06592. [Google Scholar] [CrossRef]
  31. Chung, S.C.; Yen, C.J. Disaster prevention literacy among school administrators and teachers: A study on the plan for disaster prevention and campus network deployment and experiment in Taiwan. J. Life Sci. 2016, 10, 203–214. [Google Scholar]
  32. Felder, R.M.; Silverman, L.K. Learning and teaching styles in engineering education. J. Eng. Educ. 1988, 78, 674–681. [Google Scholar]
  33. Wang, J.J. Study on the context of school-based disaster management. Int. J. Disaster Risk Reduct. 2016, 19, 224–234. [Google Scholar] [CrossRef]
  34. Zhang, D.; Zhu, X.; Zhou, Z.; Xu, X.; Ji, X.; Gong, A. Research on disaster literacy and affecting factors of college students in central China. Disaster Med. Public Health Prep. 2021, 15, 216–222. [Google Scholar] [CrossRef] [PubMed]
  35. Tan, Y.; Liao, X.; Su, H.; Li, C.; Xiang, J.; Dong, Z. Disaster preparedness among university students in Guangzhou, China: Assessment of status and demand for disaster education. Disaster Med. Public Health Prep. 2017, 11, 310–317. [Google Scholar] [CrossRef] [PubMed]
  36. Dong, X.M.; Chen, X.F.; Wang, S.Y.; Li, F.; Tu, Z.F.; Li, H.; Lin, J.M.; Lin, M.Y.; Yang, H.; Bi, Y. A survey of college students’ cognition and adaptability to sudden disasters. Chin. J. Public Health 2006, 22, 660–661. [Google Scholar]
  37. Baytiyeh, H.; Naja, M.K. Are colleges in Lebanon preparing students for future earthquake disasters? Int. J. Disaster Risk Reduct. 2015, 14, 519–526. [Google Scholar] [CrossRef]
  38. Su, Y.; Wu, G.F.; Zhu, L.; Chen, Q. Survey on Hazard Cognition of University Students in Beijing and Suggestion on Disaster Risk Reduction Education. Disaster Sci. 2007, 22, 100–104. [Google Scholar]
  39. Baytiyeh, H. Developing effective earthquake risk reduction strategies: The potential role of academic institutions in Lebanon Prospect. Q. Rev. Comp. Educ. 2015, 45, 245–258. [Google Scholar] [CrossRef]
  40. Rezaee, R.; Peyravi, M.; Marzaleh, M.A.; Khorram-Manesh, A. Needs assessment for standardized educational program for Iranian Medical Students in crisis and disaster management. J. Adv. Med. Educ. Prof. 2019, 7, 95. [Google Scholar]
  41. Çalışkan, C.; Üner, S. Disaster literacy and public health: A systematic review and integration of definitions and models. Disaster Med. Public Health Prep. 2021, 15, 518–527. [Google Scholar] [CrossRef]
  42. Davis, F.D.; Bagozzi, R.P.; Warshaw, P.R. User acceptance of computer technology: A comparison of two theoretical models. Manag. Sci. 1989, 35, 982–1003. [Google Scholar] [CrossRef] [Green Version]
  43. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989, 13, 319–339. [Google Scholar] [CrossRef] [Green Version]
  44. Ajzen, I. The theory of planned behavior. Organ. Behav. Hum. Decis. Processes 1991, 50, 179–211. [Google Scholar] [CrossRef]
  45. Raaij, E.M.V.; Schepers, J.J.L. The acceptance and use of a virtual learning environment in China. Comput. Educ. 2008, 50, 838–852. [Google Scholar] [CrossRef]
  46. Chai, K.W.; Ou, W.M.; Huang, P.C.; Lin, M.H.; Chen, T.H.; Huang, T.S.; Teng, F.C. The influence of Shopee application users’ perceived usefulness on use attitude: The moderating effects of mobile shopping system quality. Manag. Inf. Comput. 2021, 10, 1–10. [Google Scholar]
  47. Lee, H.N.; Cheng, Y.F.; Chang, C.H.S.; Wu, J.G. Study on Attitude toward Mobile Devices in Students with Visual Impairments: Perceived Usefulness and Perceived Ease of Use as Mediating Variables. Bull. Educ. Psychol. 2018, 50, 107–129. [Google Scholar]
  48. Wang, S.C. The Research on the Customer’s Perceptual Value, Experience Value, Perceived Ease of Use, and Perceived Usefulness on the Satisfaction of Tourist Factory: The Use of Interactive Media as a Moderator. Master’s Thesis, Fu Jen Catholic University, New Taipei City, Taiwan, 2021. Available online: https://hdl.handle.net/11296/xhu5yd (accessed on 20 May 2022).
  49. Rocca, K.A. Student participation in the college classroom: An extended multidisciplinary literature review. Commun. Educ. 2010, 59, 185–213. [Google Scholar] [CrossRef]
  50. Fredricks, J.A.; Blumenfeld, P.C.; Paris, A.H. School engagement: Potential of the concept, state of the evidence. Rev. Educ. Res. 2004, 74, 59–109. [Google Scholar] [CrossRef] [Green Version]
  51. Madison, W. Student Engagement and Achievement in American Secondary Schools; Newmann, F.M., Ed.; National Center on Effective Secondary Schools, Teachers College Press: New York, NY, USA, 1992. [Google Scholar]
  52. Skinner, E.A.; Belmont, M.J. Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. J. Educ. Psychol. 1993, 85, 571. [Google Scholar] [CrossRef]
  53. Fritschner, L.M. Inside the undergraduate college classroom: Faculty and students differ on the meaning of student participation. J. High. Educ. 2000, 71, 342–362. [Google Scholar] [CrossRef]
  54. Talat, A.; Riaz, Z. An integrated model of team resilience: Exploring the roles of team sensemaking, team bricolage and task interdependence. Pers. Rev. 2020, 49, 2007–2033. [Google Scholar] [CrossRef]
  55. Chen, H.F.; Liang, H.W. Team Interaction, Resource Boundary, and Bricolage Behavior: Team Creativity in Escape Room Game. J. Hum. Resour. Manag. 2021, 21, 83–113. [Google Scholar]
  56. Jones, G.; George, J. The experience and evolution of trust: Implications for cooperation and teamwork. Acad. Manag. Rev. 1998, 23, 531–546. [Google Scholar] [CrossRef] [Green Version]
  57. Chang, T.M.; Lin, M.J.; Su, S.P. Exploring the Relationship among Team Interaction, Team Commitment and Team Performance—Based on Participating Clubs’ Service-Learning in Summer Camps for University Students. J. Recreat. Sport Health Promot. 2019, 16, 1–22. [Google Scholar]
  58. Zeithaml, V.A. Consumer perceptions of price, quality, and value: A means-end model and synthesis of evidence. J. Mark. 1988, 52, 2–22. [Google Scholar] [CrossRef]
  59. Dewey, J. Experience and Mature; Dover publications: New York, NY, USA, 1958. [Google Scholar]
  60. Sheth, J.N.; Newman, B.I.; Gross, B.L. Why we buy what we buy: A theory of consumption values. J. Bus. Res. 1991, 22, 159–170. [Google Scholar] [CrossRef]
  61. Schmitt, B.H. Experiential Marketing: How to Get Customers to Sense, Feel, Think, Act and Relate to Your Company and Brand; The Free Press: New York, NY, USA, 1999. [Google Scholar]
  62. Chen, N.C.; Ma, C.P.; Wu, T.Y. The Experience Value, Satisfaction, and Happiness of Tourists. Sport Recreat. Rev. 2022, 10, 79–91. [Google Scholar]
  63. Chen, C.A.; Yang, P.H.; Chiang, Y.J. A Study of the Relationship between the Visitors’ Experience Value and Satisfaction—A Case of Ban Tou Community in Chiayi County. Sustain. Community-Based Tour. Stud. 2021, 5, 1–10. [Google Scholar]
  64. Throsby, C.D. Economics and Culture; Cambridge University Press: New York, NY, USA, 2001. [Google Scholar]
  65. Mathwick, C.; Malhotra, N.; Rigdon, E. Experiential value: Conceptualization, measurement and application in the catalog and internet shopping environment. J. Retail. 2001, 77, 39–56. [Google Scholar] [CrossRef]
  66. Rink, J.E. Teaching Physical Education for Learning, 3rd ed.; McGraw-Hill: Boston, MA, USA, 1989. [Google Scholar]
  67. Magill, R.A. Motor Learning: Concepts and Applications, 4th ed.; Brown & Benchmark: Dubuque, IA, USA, 1989. [Google Scholar]
  68. Johnson, D.W.; Johnson, R.T. Cooperative learning and feedback in technology-based instruction. In Interactive Instruction and Feedback; Dempsey, J., Sales, G.C., Eds.; Educational Technology Publications: Englewood Cliffs, NJ, USA, 1993. [Google Scholar]
  69. Slavin, R.E.; Madden, N.A. Summary of research on success for all and roots and wings. In Success for All: Research and Reform in Elementary Education; Slavin, R.E., Madden, N.A., Eds.; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2001; pp. 12–48. [Google Scholar]
  70. National Fire Agency. Statistical Table of Natural Disaster Losses in Taiwan. 2021. Available online: https://www.nfa.gov.tw/cht/index.php?code=list&flag=detail&ids=233&article_id=9639 (accessed on 10 March 2022).
  71. Comrey, A.L. Factor analytic methods of scale development in personality and clinical psychology. J. Consult. Clin. Psychol. 1988, 56, 754–761. [Google Scholar] [CrossRef]
  72. Ministry of Education. Statistics of Colleges and Universities. 2022. Available online: https://depart.moe.edu.tw/ED4500/cp.aspx?n=1AC243AF6EF5E5DD&s=EDC4A4E717ED32CF (accessed on 10 March 2022).
  73. Chang, S.S. Research Methods: Social Science and Biomedical Methodology; Wn-Nan Culture Enterprise: Taipei, Taiwan, 2020. [Google Scholar]
  74. Babbie, E.R. The Practice of Social Research, 15th ed.; Cengage: Boston, MA, USA, 2021. [Google Scholar]
  75. Likert, R.A. A technique for the measurement of attitudes. Arch. Psychol. 1932, 140, 55. [Google Scholar]
  76. Babbie, E.; Wagner, W.E.; Zaino, J. Adventures in Social Research: Data Analysis using IBM SPSS Statistics; Sage Publications: New York, NY, USA, 2022. [Google Scholar]
  77. Hayes, A.F. The PROCESS Macro for SPSS, SAS, and R (Version 3.5). 2022. Available online: http://www.processmacro.org/download.html (accessed on 31 January 2022).
  78. Gorsuch, R.L. Factor Analysis; Lawrence Erlbaum: Hillsdale, NJ, USA, 1983. [Google Scholar]
  79. Schreiber, J.B. Issues and recommendations for exploratory factor analysis and principal component analysis. Res. Soc. Adm. Pharm. 2021, 17, 1004–1011. [Google Scholar] [CrossRef] [PubMed]
  80. Watkins, M.W. A Step-by-Step Guide to Exploratory Factor Analysis with SPSS; Routledge: Oxfordshire, UK, 2021. [Google Scholar]
  81. Goretzko, D.; Pham, T.T.H.; Bühner, M. Exploratory factor analysis: Current use, methodological developments and recommendations for good practice. Curr. Psychol. 2021, 40, 3510–3521. [Google Scholar] [CrossRef]
  82. Podsakoff, P.M.; Organ, D.W. Self-reports in organizational research: Problems and prospects. J. Manag. 1986, 12, 531–544. [Google Scholar] [CrossRef]
  83. Podsakoff, P.M.; MacKenzie, S.B.; Lee, J.Y.; Podsakoff, N.P. Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies. J. Appl. Psychol. 2003, 88, 879–903. [Google Scholar] [CrossRef]
  84. Cronbach, L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef] [Green Version]
  85. Hair, J.F.; William, C.B.; Barry, J.B.; Rolph, E.A. Multivariate Data Analysis, 8th ed.; Prentice Hall: Englewood Cliffs, NJ, USA, 2022. [Google Scholar]
  86. Hayes, A.F. Introduction to Mediation, Moderation, and Conditional Process Analysis, 2nd ed.; The Guilford Press: New York, NY, USA, 2018. [Google Scholar]
  87. Soleman, A.B.; Jones, T.V. Statistical mediation analysis using the sobel test and hayes spss process macro. Int. J. Quant. Qual. Res. Methods 2021, 9, 42–61. Available online: https://ssrn.com/abstract=3799204 (accessed on 6 March 2021).
  88. Baron, R.M.; Kenny, D.A. The moderatormediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J. Personal. Soc. Psychol. 1986, 51, 1173–1182. [Google Scholar] [CrossRef]
  89. Hayes, A.F.; Scharkow, M. The Relative Trustworthiness of Inferential Tests of the Indirect Effect in Statistical Mediation Analysis. Psychol. Sci. 2013, 24, 1918–1927. [Google Scholar] [CrossRef]
  90. Kaiser, H.F. An index of factorial simplicity. Psychometrika 1974, 39, 31–36. [Google Scholar] [CrossRef]
  91. Bartlett, M.S. The effect of standardization on a Chi-square approximation in factor analysis. Biometrika 1951, 38, 337–344. [Google Scholar]
  92. Stevens, J. Applied Multivariate Statistics for the Social Sciences, 2nd ed.; Lawrence Erlbaum: Hillsdale, NJ, USA, 1992. [Google Scholar]
  93. Anderson, J.; Gerbing, D. Structural equation modeling in practice: A review and recommended two-step approach. Psychol. Bull. 1988, 103, 411–423. [Google Scholar] [CrossRef]
  94. Nunnally, J.C.; Bernstein, I.H.; Berge, J.M.T. Psychometric Theory; McGraw-Hill: New York, NY, USA, 1967; Volume 226. [Google Scholar]
  95. Pekrun, R. The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educ. Psychol. Rev. 2006, 18, 315–341. [Google Scholar] [CrossRef]
  96. Sommer, M.; Ritzhaupt, A. Impact of the flipped classroom on learner achievement and satisfaction in an undergraduate technology literacy course. J. Inf. Technol. Educ. Res. 2018, 17, 159–182. [Google Scholar] [CrossRef] [Green Version]
  97. Alamri, M.M. Students’ learning achievement performance and satisfaction in a flipped classroom in Saudi Arabia. Int. J. Technol. Enhanc. Learn. 2019, 11, 103–119. [Google Scholar] [CrossRef]
  98. Horton, E.R.; Belliveau, P. Pediatric pharmacotherapy in the PharmD curriculum: Course design and student self-assessment of learning outcomes achievement. Curr. Pharm. Teach. Learn. 2014, 6, 277–283. [Google Scholar] [CrossRef]
  99. Chuang, N.C. Service-Learning: Course Design and Student Learning Outcome in Oral Training Courses of Shilin High School of Commerce. Second. Educ. 2015, 66, 135–155. [Google Scholar]
  100. Huang, C.H.; Lu, P.C. The Relationships among the Recreation Attraction and Experiential Satisfaction of Leisure Fishpond: Taking Experiential Value as A Intervening Variables. NTU J. Phys. Educ. 2015, 28, 47–57. [Google Scholar]
  101. Chang, T.M. Exploring the Relationship among Team Leadership Styles, Team Interaction and Team Service Performance for Service-Learning Activity Camps of Student Clubs in Southern University. Kaohsiung Norm. Univ. J. 2020, 49, 31–58. [Google Scholar]
  102. Lin, L.Y.; Yang, C.Y. The Influence of Curriculum Design on Learning Effectiveness in the Master’s In-Service Program-Using Interactive Behavior and Social Support as Moderators. Tzu-Chi Univ. J. Educ. Res. 2021, 17, 167–205. [Google Scholar]
  103. Grønlien, H.K.; Christoffersen, T.E.; Ringstad, Ø.; Andreassen, M.; Lugo, R.G. A blended learning teaching strategy strengthens the nursing students’ performance and self-reported learning outcome achievement in an anatomy, physiology and biochemistry course–A quasi-experimental study. Nurse Educ. Pract. 2021, 52, 103046. [Google Scholar] [CrossRef]
  104. Silverman, D. Qualitative Research, 5th ed.; Sage: Los Angeles, CA, USA, 2020; Available online: https://reurl.cc/j1jQV2 (accessed on 31 May 2022).
  105. Hennink, M.; Hutter, I.; Bailey, A. Qualitative Research Methods, 2nd ed.; Sage: London, UK, 2020; Available online: https://reurl.cc/p1j9ba (accessed on 31 May 2022).
  106. Denzin, N.K.; Lincoln, Y.S. The Landscape of Qualitative Research, 2nd ed.; Sage: London, UK, 2012; Available online: https://reurl.cc/e34GNQ (accessed on 31 May 2022).
  107. Lieblich, A.; Tuval-Mashiach, R.; Zilber, T. Narrative Research: Reading, Analysis, and Interpretation; Sage: London, UK, 1998; Volume 47, Available online: https://reurl.cc/vdjplo (accessed on 31 May 2022).
  108. Riessman, C.K. Narrative Methods for the Human Sciences; Sage: Los Angeles, CA, USA, 2008; Available online: https://reurl.cc/GxR5zD (accessed on 31 May 2022).
  109. Charmaz, K. Constructing Grounded Theory, 2nd ed.; Sage: London, UK, 2014; Available online: https://reurl.cc/3olKDV (accessed on 31 May 2022).
  110. Strauss, A.; Corbin, J.M. Grounded Theory in Practice; Sage: London, UK, 1997; Available online: https://reurl.cc/DyQqvN (accessed on 31 May 2022).
  111. Thomas, G. How to Do Your Case Study; Sage: London, UK, 2021; Available online: https://reurl.cc/VD (accessed on 31 May 2022).
  112. Muijs, D. Doing Quantitative Research in Education: With SPSS; Sage: London, UK, 2004; Available online: https://methods.sagepub.com/book/doing-quantitative-research-in-education-with-spss-2e (accessed on 31 May 2022).
  113. Koskinen, J.; Snijders, T.A. Multilevel Longitudinal Analysis of Social Networks. 2022. Available online: https://arxiv.org/abs/2201.12713 (accessed on 31 May 2022).
  114. Khine, M.S. Hierarchical linear modeling and multilevel modeling in educational research. In Methodology for Multilevel Modeling in Educational Research; Springer: Singapore, 2022; pp. 3–8. [Google Scholar]
Sustainability 14 08221 g001 550
Figure 1. Research structure.
Figure 1. Research structure.
Sustainability 14 08221 g001
Sustainability 14 08221 g002 550
Figure 2. Estimation of path parameters of mediation effect model.
Figure 2. Estimation of path parameters of mediation effect model.
Sustainability 14 08221 g002
Sustainability 14 08221 g003 550
Figure 3. Mediation effect model analysis results (** p < 0.01, *** p < 0.001).
Figure 3. Mediation effect model analysis results (** p < 0.01, *** p < 0.001).
Sustainability 14 08221 g003
Table
Table 1. Research hypothesis empirical results.
Table 1. Research hypothesis empirical results.
Research HypothesispEmpirical Results
H0: “Disaster prevention course design” has a positive and significant overall effect on the “achievement and feedback” of general courses on disaster prevention education.0.000Established
H1: “Disaster prevention course design” has a positive and significant direct effect on the “achievement and feedback” of general education courses on disaster prevention education.0.006Established
H2: “Disaster prevention course design” has a positive and significant impact on the “perceived usefulness” of general courses on disaster prevention education.0.000Established
H3: “Perceived usefulness” has a positive and significant impact on the “experiential value” of general courses on disaster prevention education.0.080Falsified
H4: “Perceived usefulness” has a positive and significant impact on the “achievement and feedback” of general courses on disaster prevention education. 0.274Falsified
H5: “Disaster prevention course design” has a positive and significant impact on the “experiential value” of general courses on disaster prevention education.0.000Established
H6: “Experiential value” has a positive and significant impact on the “achievement and feedback” of general courses on disaster prevention education.0.000Established
H7: “Disaster prevention course design” has a positive and significant impact on the “team interaction” of general courses on disaster prevention education.0.000Established
H8: “Team interaction” has a positive and significant impact on the “experiential value” of general courses on disaster prevention education.0.001Established
H9: “Team interaction” has a positive and significant impact on the “achievement and feedback” of general courses on disaster prevention education.0.002Established
Table
Table 2. Correlation and descriptive statistics of variables.
Table 2. Correlation and descriptive statistics of variables.
Research VariableMSDXM1M2M3Y
X- Disaster prevention course design4.6940.4461
M1- Perceived usefulness4.6590.4480.835 **1
M2- Team interaction4.5240.6450.551 **0.566 **1
M3- Experiential value4.6240.4910.799 **0.740 **0.602 **1
Y- Achievement and feedback4.6560.4520.786 **0.735 **0.639 **0.814 **1
N = 124; ** p < 0.01.
Table
Table 3. Summary of item, validity, and reliability analysis.
Table 3. Summary of item, validity, and reliability analysis.
Dimension
Item		Observation VariableItem AnalysisValidity AnalysisReliability Analysis
CITCα Value after Deletion of This ItemEIGENVALUECumulative Variance Explained %Factor LoadingsCronbach’s α
Disaster prevention course design
(A)		A1Basic understanding0.8780.9324.90721.3350.6410.948
A2Concept enhancement0.8410.9390.685
A3Thought guidance0.8780.9320.623
A4Disaster prevention experience0.8480.9380.824
A5Awareness raising0.8430.9380.724
Perceived usefulness
(B)		B1Perceived diversity0.7070.8454.16939.4590.5890.872
B2Perceived practicality0.6950.8480.686
B3Perceived subservience0.7550.8250.561
B4Perceived effectiveness0.7570.8260.754
Team interaction
(C)		C1Team cooperation0.8890.9614.13057.4170.8850.966
C2Team concept0.9000.9590.833
C3Team communication0.9440.9520.894
C4Team achievement0.9000.9590.896
C5Team feels0.8880.9610.833
Experiential value
(D)		D1Experiential value of functionality0.8300.9213.19271.2960.6110.935
D2Experiential value of interactivity0.7520.9290.628
D3Experiential value of inducement0.8660.9150.796
D4Experiential value of emotionality0.8630.9150.763
D5Experiential value of knowledge0.7180.9330.579
D6Experiential value of feedback0.8260.9200.678
Achievement and feedback
(E)		E1Effective feedback0.7790.8102.69282.9980.6080.876
E2Experiential feedback0.7600.8280.693
E3Application feedback0.7480.8390.566
Total scale 0.966
Table
Table 4. Regression coefficient and model summary for mediated regression analysis of curriculum learning effectiveness.
Table 4. Regression coefficient and model summary for mediated regression analysis of curriculum learning effectiveness.
Result VariableM1M2M3Y
Predictive Variable Coefficienttp Coefficienttp Coefficienttp Coefficienttp
Constant termiM10.4851.6590.099iM20.7462.5650.011iM30.2811.0460.297iY0.0750.3540.724
Xa10.84812.3000.000a20.81811.9150.000a30.2702.7130.008c2′0.2953.6560.000
M3 b30.1852.7230.007
M1 b10.2743.4030.001d10.2413.6300.000
M2 b20.3794.6900.000d20.2643.8350.000
Model summary R2 = 0.523 R2 = 0.507 R2 = 0.621 R2 = 0.745
F(1,138) = 151.296p < 0.001 F(1,138) = 141.969p < 0.001 F(1,138) = 74.247p < 0.001 F(4,135) = 98.484p < 0.001
Note: Course content arrangement (X), Interactive teaching experience (M1), Technology action puzzle (M2, Learning effectiveness (M3), Achievement and feedback (Y).
Table
Table 5. The overall, direct, and indirect effects of mediated regression analysis on the learning effectiveness of courses.
Table 5. The overall, direct, and indirect effects of mediated regression analysis on the learning effectiveness of courses.
Bootstrapping 95% Trust Interval
Category (Coefficient)Effect PathEffect SizetpLower Limit (LLCI)Upper Limit (ULCI)
Overall effect (c2)X→Y0.796 14.031 0.000 0.6840.909
Direct effect(c2′)X→Y0.276 2.801 0.006 0.0810.471
Aggregate indirect effectX→Y0.520 0.2420.782
Indirect Effect(a1 × d1)X→M1→Y0.822 −0.0730.276
Indirect Effect(a2 × d2)X→M2→Y0.103 0.0010.223
Indirect Effect(a3 × b3)X→M3→Y0.228 0.0820.393
Indirect Effect(a1 × b1 × b3)X→M1→M3→Y0.059 −0.0200.186
Indirect Effect(a2 × b2 × b3)X→M2→M3→Y0.048 0.0040.114
Note: Disaster prevention course design (X), perceived usefulness (M1), team interaction (M2), experiential value (M3), achievement and feedback(Y).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Shyr, W.-J.; Ho, W.-S.; Chen, J.-R.; Chang, L.-Y.; Chen, I.-M. Effectiveness of Social Participation Courses Applied in the Disaster Prevention for Taiwanese K-12 Education. Sustainability 2022, 14, 8221. https://doi.org/10.3390/su14138221

AMA Style

Shyr W-J, Ho W-S, Chen J-R, Chang L-Y, Chen I-M. Effectiveness of Social Participation Courses Applied in the Disaster Prevention for Taiwanese K-12 Education. Sustainability. 2022; 14(13):8221. https://doi.org/10.3390/su14138221

Chicago/Turabian Style

Shyr, Wen-Jye, Wei-Sho Ho, Jie-Ru Chen, Li-Ya Chang, and I-Min Chen. 2022. "Effectiveness of Social Participation Courses Applied in the Disaster Prevention for Taiwanese K-12 Education" Sustainability 14, no. 13: 8221. https://doi.org/10.3390/su14138221

APA Style

Shyr, W. -J., Ho, W. -S., Chen, J. -R., Chang, L. -Y., & Chen, I. -M. (2022). Effectiveness of Social Participation Courses Applied in the Disaster Prevention for Taiwanese K-12 Education. Sustainability, 14(13), 8221. https://doi.org/10.3390/su14138221

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop