Next Article in Journal
Robust Blocking of Human Faces with Personal Information Using Artificial Deep Neural Computing
Previous Article in Journal
The Attractiveness of Adaptive Heritage Reuse: A Theoretical Framework
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability

by
María del Carmen Olmos-Gómez
1,*,
Mónica Luque Suárez
2,*,
Concetta Ferrara
1,3 and
Eva María Olmedo-Moreno
4
1
Department of Research Methods and Diagnosis in Education, Faculty of Education and Sport Science, University of Granada, 52005 Melilla, Spain
2
Department of Sociology, Faculty of Education and Sport Science, University of Granada, 52005 Melilla, Spain
3
Associazione Culturale Italiana Per La Formazione, A.C.I.F. University of Naples, Via Salvatore Gambardella, 19, 80145 Napoli NA, Italy
4
Department of Research Methods and Diagnosis in Education, Faculty of Education Science, University of Granada, 18071 Granada, Spain
*
Authors to whom correspondence should be addressed.
Sustainability 2020, 12(6), 2366; https://doi.org/10.3390/su12062366
Submission received: 10 February 2020 / Revised: 12 March 2020 / Accepted: 17 March 2020 / Published: 18 March 2020
(This article belongs to the Section Sustainable Education and Approaches)

Abstract

:
The objective of this study is to analyse individual differences in quality of higher education through the pursuit of satisfaction with a focus on sustainability, whilst considering variables pertaining to groups (family, teachers and pupils) and satisfaction in a sample of 1091 Italians: 510 pupils (45.8%), 121 teachers (11.1%) and 469 relatives (42.9%). Once the quality parameters of the instrument (quality of higher education through the pursuit of satisfaction with a focus on the sustainability (QHES) questionnaire) were determined, reliability was confirmed through confirmatory factor analysis using structural equation modelling methodology, and data collection was initiated. Results from the multi-level study (ANOVA) showed significant differences between groups. From this, it can be concluded from the study that the role performed by a quality education oriented towards sustainability equally includes teachers, students and relatives. This role focuses on the battle to incorporate effective participatory methods into the teaching process, motivating members of the educational community and social future in the search for knowledge, skills, attitudes and necessary values. This will forge a sustainable future given that it does not only depend on the characteristics and experiences of individuals but also their training, both within the centre and their families. This factor is of vital importance, as demonstrated and concluded in the present study.

1. Introduction

Quality is a vitally important concept in current society [1,2], given that we are capable of achieving an optimal use of resources through the creation of quality evaluation. Education forms an essential part of society and obtaining a quality education is the pillar from which sustainable development is based [3]. This is evident, given that the future of society’s citizens will play out in accordance with the educational development they undergo. For this reason, the optimisation, improvement and development of mechanisms which guarantee educational quality and, especially, the quality of higher education, will assist future citizens who find themselves in a transitional period with regards to training for the world of work. This is also crucial for social development. Quality is supported through mechanisms which enable regulation of effectiveness, efficiency, functionality and reliability of the evaluated process. This, by definition, forms the basis from which the quality of any type of activity can be preserved and improved [4]. In the present day, quality control systems are normally applied in all areas relevant to society: Governmental programs, business activities, urban development, transport and food, and so on [5]. In recent years, not a single area of social action has remained untouched by quality control systems and, of course, the field of education is no exception [6,7,8].
The concept of quality in higher education can have multiple focuses or meanings, with this being reflected in the literature. Amongst the most common focuses, three are highlighted: Those that centre on the idea of service, those that explore quality from the student’s perspective, and those that approach this concept from the teacher’s perspective.
The first focus refers to service quality. This concept has received a great deal of attention from a research perspective in the educational sector and at an international level [9,10,11,12,13]. The concept has also been employed to improve service from an objective and subjective point of view, with the outcome being improved client interaction with the service being provided. Preliminary studies from the educational sector suggest that the concept of quality in higher education in the present day has become blurred [14], with different meanings being attributed [15].
In the same sense, Lago, López, Municio, Ospina and Vergara [16] state that quality is the outcome of comparing expectations of a service with the perception of the actual service received. This means that the measurement of quality lies in the satisfaction of individuals and in the value that they believe they receive. Authors such as Carvalho and de Oliveira [17,18,19] explain that educational model dynamics place the student as the recipient of education and, as a result, converts them into the client receiving the service, with the second and third focuses (student and teacher) being encompassed by the first (service).
The apparently identical concepts of sustainability and sustainable development are topics that currently dominate the continuing global social development of discourse. This is due to the lack of broadly accepted definitions and a variety of viewpoints regarding their real connotations [20,21]. As indicated by Boström [22], the present study is based on the description of sustainability as a state of utopia, whilst sustainable development consists of the necessary steps to reach this state. Thus, within the limits of higher education institutions, it refers to the desire to achieve a sustainable university status in relation to sustainability (utopic state). This occurs through their internal processes, with the product of said processes and commitment to society giving shape to sustainable development, which advances towards the implementation of sustainability [23,24]
According to the declarations of [25], a sustainable higher education institute is one that values the quality of teaching, implements practices destined to improve the quality of academic life and is concerned with managing its use of natural resources. With regards to the scientific literature identified on the topic, studies have been directed towards the examination of student satisfaction and the quality of the service offered [26], and comes from around the world [27,28,29]. Research studies have also focused on the value of the educational service offered to the student [13,17,18,30], whilst others understand satisfaction as an emotional response that comes from cognitive judgements [31].
Nevertheless, there are very few research studies that enable us to see the moderating effect of the quality of higher education on satisfaction. Given this, the present research is based on measuring student satisfaction with their educational centre, and the opinions of teachers and family members [32].
According to Mateo [1], this growing interest in quality control within the educational field is determined by the development of a new management paradigm. This paradigm is based on educational actions that pursue the achievement of previously defined objectives. It also involves internal audits to evaluate the extent of the achievement reached, with regards to objectives established at the start and the possibility of elevating decision making to a higher level where strategic sustainability skills are involved.
At the root of that previously discussed, when discussing the quality indicators that determine student satisfaction, authors such as Resino, Chamizo, Cano and Gutiérrez [33] highlight three focuses: resources and facilities, academic aspects and social aspects. Thus, in the present work, we will analyse student perceptions about the quality of services received from their educational institution and examine the quality dimension through the use of physical infrastructure and resources. This is done in order to support educational quality in a sustainable way, ensuring that future generations will also reap the benefits. It seeks to guarantee the sustainability of better quality [34] knowledge transmission processes carried out by teachers and integral development promoted in students, academic programs [35], and families.
As we can observe, the quality of teaching has become an important strategic issue in higher education [36,37]. We find ourselves embroiled in initiatives that have been developed to analyse and satisfy the needs of interested parties in general; in other words, families, institutions, teaching staff and students [38]. DiDomenico and Bonnici [39] argue that higher education institutions must analyse the quality of service offered in order to be able to function effectively and efficiently within a competitive environment, whilst also making efforts to define a strategy focused on the need satisfaction of clients [40,41]. The Bolonia process has made this a reality by accelerating the introduction and elaboration of quality assurance, taking both an institutionalized approach and making use of quality management mechanisms [42].
The present research study is developed in Italy and, just like in other countries, it is carried out through student evaluations, with these students being considered as “consumers”. Globalised competition has emphasised the strategic importance of satisfaction and quality in the battle for winning over the preferences of consumers and maintaining sustainability but with competitive advantages. This is important given that universities are moving towards a focus that is more directed towards market values [43,44,45].
The challenge for institutions is to understand and channel their resources in order to achieve client satisfaction [46]. This very satisfaction provides a quality barometer for educational services [47]. Thus, to investigate educational quality is to invest in the future, given that, with this, we can optimise resources and realise sustainable development for future generations.
Based on the previous analysis, the objectives and the novelty of the present study are as follows:
(1)
To design and validate an instrument to analyse the impact of higher education quality through the pursuit of satisfaction with a focus on sustainability, according to the groups (family, pupils and teachers) of participants involved in higher education. This is relevant because no instruments currently exist which examine quality whilst taking a sustainability focus.
(2)
To determine the possible associations between quality through the pursuit of satisfaction with a focus on sustainability and the variables of groups and satisfaction.

2. Materials and Methods

2.1. Method

In the present research, a quantitative-descriptive study was conducted based on the social analytical–empirical research method [48].

2.2. Participants

We analysed the associations between general satisfaction, groups (families, students and teachers) and educational quality in higher education as it related to students, families and teachers selected through random sampling. Sixteen groups were selected (from a total of 21) from higher education student groups from the south of Italy (Naples, Italy). Participants came from the University of Naples and were selected through random sampling. Sampling followed a random selection of one class from each year undertaking courses at the selected institution. Naples is the most highly populated city located in the southern region of Italy. It is known as the capital of the Campania region and the metropolitan city of Naples. Just under one million inhabitants live within the area delimited within the municipality of Naples. It is located between Mount Vesuvius and the Phlegraean Fields. It has enormous historical, artistic, cultural and gastronomic wealth, which led UNESCO to declare its historical centre as a world heritage site. It was briefly under Austrian rule in the early decades of the 18th century. Following this, it was converted into the political centre of the independent kingdom of Naples and, later, part of the Two Sicilies governed by the Bourbons (Spanish). For this reason, it has strong Spanish resemblances.
In total, N = 1091 students, fathers and teachers participated in the present study. The entire sample was selected using non-probabilistic sampling (convenience), with the questionnaire being administered to those who indicated a desire to participate. Sample distribution consisted of 510 students (45.8%), 121 teachers (11.1%) and 469 relatives (42.9%). The age of participants ranged between 17 and 25 years old (mean = 19.84 years). The age of participating teachers ranged between 35 and 45 years old (mean = 38.5 years). The age of participants who were relatives of students ranged between 50 and 65 years old (mean = 55.9 years). The participating sample constituted 86% of the overall sample of individuals undertaking higher education in the region of southern Italy.

2.3. Instrument

Each participant received the questionnaire developed for the present study, which was based on previously developed questionnaires [33,36,37]. The tool design was aligned with the main theoretical guidelines for building tests (the American Association of Educational research, the American Association of Psychology and the National Council for Educational Evaluation 2014) Responses should be rated on a continuum of 1 to 5 from “I don´t agree” to “I always agree”. To test the understanding and clarity of the items included, the first version of the questionnaire was administered in a centre of higher education. After the pilot run, modifications were made to the initial design, eliminating those items that had been detected as difficult to understand, which were three of the 49 original items in the questionnaire. The tool worked on basic principles taken from other international models of quality evaluation and satisfaction, such as those of Sweden or Italy, based on educational philosophy and curriculum design with a marked focus on the value of work and the sense of all teaching efforts, which was shortened and adapted to the context of Southern Italy and further modified to incorporate the variable describing satisfaction. As an initial focus in selecting the items to be included in the questionnaire, a group of students (n = 501), with similar characteristics to the sample used in the present study, were asked to indicate all the items with which they most identified. After collecting this information and following the process of content validity, the questionnaire was analyzed using an expert panel process. Subsequently, 20 experts assessed the instrument using Delphi´s method [49]. They signaled any item that they deemed to be poorly written, in addition to indicating its congruence, adequacy and belonging. All the members of the expert panel were PhD holders and were experts in the field of investigation related to the present research. All members of the expert panel held positions in the university context and were experts in the field of investigation at the heart of the present research. Specifically, there were twenty judges who evaluated the instrument. They signalled any item that they deemed to be unclear or badly written, in addition to suggesting recommendations regarding its relevance, congruence and adequacy. Here we will present the professional profile of all of the judges who participated in the process: 7 Doctors (PhD) belonging to the Department of Research Methods and Diagnostics in Education at the University of Granada; 4 Doctors (PhD) belonging to the Department of Research Methods and Diagnostics in Education at the University of Granada (Campus of Melilla); 3 Doctors (PhD) belonging to the Department of Evolutionary Psychology and of Education at the University of Granada; 2 Doctors (PhD) belonging to the Department of Didactics of the Social Sciences at the University of Granada and four Doctors (PhD) belonging to the Department of Didactics and School Organization at the University of Granada [49] The final version of the adapted instrument was developed in the exploratory phase. To this end, three rounds of analyses were conducted amongst the experts. The percentage of agreement within the first round of discussions was in 79%, 82% in the second round, and 90% in the third round.
Those items whose agreement percentage amongst the expert panel from was ≥80% were modified, eliminated, or regrouped. Following the application of this method, most elements were not significantly modified, although four were completely eliminated. This means that the final questionnaire included 46 questions divided between five dimensions (factors). The survey instrument was divided into two parts. In the first part, participants were requested to provide their personal information, including pertinence and reference groups, sex, age, and religion. The second part included questions about the frequency with which participants’ opinions manifested with respect to the items expressed. A 5-point scale was used that ranged from 1 = I don´t agree, to 5 = I always agree. An exploratory factorial analysis (EFA) was applied to examine the instruments’ construct validity. To guarantee the validity and reliability of the instrument, a factorial analysis of the variables was then completed. The objective of this exploratory study was to estimate the validity of the questionnaire. To validate the instrument, the Kaiser–Meyer–Olkin (KMO) index was calculated. A KMO value above 0.5 is considered to be acceptable. The KMO index here was 0.979. Hence, the coefficient was close to achieving singularity and was sufficient to proceed to the next step in analyzing the validity and reliability of the test. Using the test of sphericity, we ensured that the level of significance was adequate. The value obtained was 0.000, which enabled us to proceed with the factorial analysis. Finally, from the table of variance for the rotated component matrix, we were able to obtain the variance outcomes for all the analyzed variables. The outcomes from the previously described analysis identified the existence of five factors that, when combined, explained 70.757% of the variance.
We estimated the reliability of scores provided on the scale using tests for ordinal data [50], producing a Cronbach alpha of 0.979.
Next, with the intention of verifying the internal consistency of the preliminary exploratory factor analysis, a confirmatory factor analysis was performed. Each agglomerated component was obtained as a latent variable and the various elements associated with each factor as observable variables.
Subsequently, confirmatory factor analysis (CFA) using the structural equation modeling (SEM) methodology, through which we examined the multivariate regression coefficients based on structural equations [51], which examined the multivariate regression coefficient produced from structural equations. Evaluation of the fit of the data to the model was conducted according to multiple criteria: χ2/df, comparative fit index (CFI) and root mean square error approximation (RMSEA). The literature suggests that fit can be considered to be adequate when χ2/df < 5, CFI > 0.90 and RMSEA < 0.08 [52]. The data were analysed through statistical software packages SPSS 20 (International Business Machines Corporation (IBM), Chicago, IL, USA, 2011), LISREL v9.1 (Scientific Software International, Princeton, NJ, USA, 2010), and PANTH GRAHF (Scientific Software International, Princeton, New Jersey, 2010) [53].
The results of the CFA confirm the adequate fit of the data to the model (Figure 1). This model originates from both exploratory factors and a theoretical model. The parsimonious fit was χ2/df = 4170.47/989 p < 0.001, A model was formed with 90 degrees of freedom (df) with a maximum likelihood. The p-value was less than 0.05; CFI (comparative adjustment goodness index) = 0.87; RMSEA (root mean square error of approximation) [54] = 0.074 (90% CI = 0.053–0.080). Although the scores produced were adequate when one factor was eliminated, it is necessary to examine a number of other indices. The most interesting of these is the root mean square error approximation (RMSEA), which was slightly below the critical limit: 0.080. For this reason, the focus is shifted to the adjusted model. The examination of the CFA was conducted using SEM methodology via path analysis. Likewise, the mean square approximation root error (RMSEA) reflects a value of 0.74 being the correct interpretation. Just as can be observed in Figure 1, all of the regression weights were higher than 0.05, whilst covariance between factors ranged between 0.12 and 1.00. The evaluation conducted according to the SEM methodology verifies that the derived coefficients show positive agreement with the theory employed to configure the measurement model, with the exception of one weakly linked value [55]. Analysis of the multivariate regression coefficients was conducted through the examination of the covariance matrix of the observed variables. The program Lisrel 9.1 was used to carry this out. The observed and latent variables are formed as follows (Figure 2), in the optionality of confirmatory factorial analysis, in order to analyze the covariance matrix of observable variables. The regression coefficients between the observed and latent variables were represented as follows: Factor 1—management of higher education and teaching resources; Factor 2—coordination of educational activities in higher education; Factor 3—management of teaching in higher education through knowledge of the topics included in the study program, and delivery of a planned timetable in order to meet program objectives and the evaluation system; Factor 4—teacher planning and teaching staff in higher education.
The majority of existing questionnaires that have been developed to diagnose the quality of higher education ignore sustainability variables, highly implicated groups and satisfaction levels, and, instead, focus solely on quality [36,37].
Analysis of educational quality is an inescapable requirement of education. This fact becomes even more relevant in contexts such as higher education, where there is growing demand, student diversity, incomplete information and scarcity of resources [56]. For this reason, the instrument we used established four dimensions (factors) in order to analyse the quality of sustainability variables, implicated groups and satisfaction levels of the setting in which they co-exist. The first dimension is called the management of higher education and teaching resources. It is related to the variety and adequacy of methodology, alongside the formative development of the teachings used in study programs. It is linked with the factor presented by Salas [57] and Yáñez and Soria [58], in that it deals with the achievement of a certain level of quality, in order to meet some of the standards required in teaching and institutional management. The second dimension relates to the coordination of educational activities in higher education. It refers to general satisfaction with staff, facilities and settings, with these being seen as respectful of cooperation and collaboration amongst students. This favours the orientation and management of learning activities, interpersonal relationships, and the channelling of information [59,60]. The third dimension describes the management of teaching in higher education through knowledge of the topics included in the study program and the delivery of a planned timetable in order to meet program objectives and the evaluation system used for this. [61,62,63] argue in support of this dimension, identifying its contribution to the improvement of teaching processes and welcome programs for new students. Finally, the fourth dimension refers to teacher planning and teaching staff in higher education, with this determining the organisation of spaces and timings [61]. Basante, Coronel and Vinueza [64] discuss policies pertaining to the distribution of the load imposed by the academic timetable. This is another way in which resources can be optimised in a sustainable way.

2.4. Procedure

2.4.1. Comprehension Validity of the Instrument

We conducted a pilot study to check validity. In this study, the instrument was distributed to a sample of 1091 participants (duration of 30 to 60 min) to establish the level of comprehension from a qualitative perspective while noting doubts and suggestions.

2.4.2. Data Collection Procedure

Questionnaires were administered in a paper format during student and teacher free time in order to avoid interfering with the class timetable of the sample. The questionnaire was administered during March and April 2019. It was approved by the directors of the higher education centres prior to obtaining permission from the Italian Educational Authorities of Naples. Educators collaborated with the research by assisting with participant recruitment. As a consequence, questionnaires were handed out to students, teachers and parents. They were distributed and read together within groups of no more than 30 participants. This enabled us to be able to respond to any question related to understanding and completion of the questionnaire. Participants were not informed about the purpose of the study in order to avoid insincere responses and social desirability. Twelve postgraduate students were present in order to facilitate question understanding and provide any help required. We guaranteed that all gathered information would be used purely for scientific research purposes and that anonymity would be preserved throughout.

2.5. Data Analysis

Content analysis of qualitative questions was used for data analysis, with corresponding validation from an expert panel. Quantitative data were analysed in accordance with descriptive statistics and internal consistency estimations. As previously mentioned, this was conducted using SPSS 24.0. Semi-confirmatory factor analysis was conducted using FACTOR Analysis 9.3.1 (IBM SPSS Statistics 24.0 Chicago, EEUU, 2016) [65]. Confirmatory analysis was carried out using LISREL v9.1 (Scientific Software International, Princeton, New Jersey, 2010) [66].
Data were analysed in order to determine the most appropriate type of statistical procedure to be applied. The Levene test statistic was calculated via a t-test for independent samples. This test is appropriate when data indicate homogeneity of variance for both the grouping variables and the variable describing satisfaction. As the sample was sufficiently large in addition to the homogeneity of variance outcome, it was decided that parametric tests were appropriate [67].
A multi-level design for multiple comparisons was followed. Analysis of covariance (ANCOVA) with various factor levels was used to evaluate the difference between participating groups and satisfaction.

3. Results

Table 1 and Figure 2 (Appendix A) demonstrate that in the study context, students’ families and teachers were identified to be more satisfied with the management of higher education and teaching resources. In addition, families, teachers and students, but particularly teachers who coordinated educational activities in higher education, were found to be highly satisfied with teaching management in higher education. Further, teachers were found to have the greatest level of satisfaction with teacher planning and the planning of teaching staff in higher education.
Table 1 shows the results of the ANOVA conducted on the variables of groups and satisfaction, and the interaction between them. Initially, the multivariate test indicated significant differences and large effect sizes for quality to satisfaction (F = 4.891, p < 0.001 and η2 = 0.995), significant differences regarding groups (F = 2.044, p < 0.001, η2 = 0.452), and significant outcomes for the interaction between satisfaction and groups (F = 12.704, p < 0.001, η2 = 0.339).
The multivariate test is a response to the need to simultaneously analyse the relationship between different levels of the same variable with other variables with several levels [68], which allowed us to statistically model the influence of independent groups variables (with three levels) and satisfaction (with five levels) on the coding measured at the individual level. This allowed us to identify the covariance effect of these variables. The results indicate significant differences and large effect sizes with respect to satisfaction, which indicates that in relation to the significance. The sample size or proportion of the variance explained (ANOVA) [69] indicated, with respect to the satisfaction variable, that more than 99.5% (η2 = 0.995) of the differences found can be attributed to the effect of quality. Similarly, the results obtained show significant differences with respect to groups as a function of quality, and the sample size (ANOVA) [69] indicated, with respect to the groups variable, that only 45.2% (η2 = 0.452) of the differences found can be attributed to the effect of quality, which, although the value is small, is still one-quarter of the population surveyed, which, in social terms and based on the study, is a value to consider. In relation to the square sample size in the interaction between groups of family, teachers and students with respect to satisfaction, almost 33% (η2 = 0.339) of the differences found were attributed to the effect of quality.
The fit of the ANOVA outcomes to the data reveals significant associations between the quality of higher education through the pursuit of satisfaction with a focus on sustainability and examines groups and satisfaction. Outcomes related to the existence of specific areas for the protection of sustainability material and resources (p = 0.000), classrooms and equipment meeting sustainability protocols (p = 0.000), extra-curricular activities targeting sustainability as a complement to the overall formative development of the student (p = 0.000), and subjects reorienting education to address sustainability and including it on the syllabus (p = 0.000). The quality of higher education through the pursuit of satisfaction, with a focus on sustainability, produced moderate effect sizes in relation to satisfaction. The remaining effects were all small in size.

4. Discussion

The present work analysed existing links between general satisfaction and education quality according to various groups (family, students and teachers). It further investigated the relevant role of the sustainability factor in higher education in a community of students undertaking higher education in the south of Italy (Naples). These data corroborate work conducted by [70]. This concluded that collaboration with families is one of the most influential components of satisfaction amongst teachers, with this being one of the aspects of teaching work with which teachers are found to be least satisfied.
Outcomes can also be considered by adopting the focus of the student perspective. González López [71] discuss factors that determine quality in higher education through elements such as skill development for accessing the job market, the working of governing bodies and representatives, student satisfaction with their personal performance, and availability and access to academic information [72,73]. The present research has also uncovered other elements such as facilities (classrooms, catering service, laboratories, library). Facilities enable expectations to be fulfilled in line with those programmed by course prospects. This brings with it strong feelings of personal satisfaction in general and helps achieve a sustainable environment.
In order to carry out the present research, the psychometric evaluation of the questionnaire was performed using the Delphi method. Here, the content validity of the scale was analysed. The panel of 20 experts used existing literature [49] to establish the denomination of variables. It is worth mentioning that the reference studies focus on analysing educational quality in higher education; however, there are some studies which urge caution around the concept of quality in higher education [14]. For this reason, educational institutions are destined to increase and incentivise organisational quality, which brings with it the offer of more satisfactory service to students. Thus, it is of great importance to be able to offer a reliable and empirically tested instrument in order to continue advancing sustainable educational quality and, in this way, optimise resources.
Further analysis conducted on the questionnaire included exploratory factor analysis (EFA), with this providing another indicator of scale reliability. With regards to EFA outcomes, following extraction of common elements, it was found that all elements could be reliably maintained. Thus, the 46 elements established by the expert panel via the Delphi method were retained by the scale. Subsequently, confirmatory factor analysis (CFA) was performed with this confirming reliability of the model by obtaining acceptable indices (CFI and TLI) [51,52]. In addition, construct validity analysis demonstrated consistency with the scale used in the majority of proportions produced for the adapted version. A novel characteristic of the elaboration and validation of this instrument is the inclusion of items specific to sustainability, with these being included in the consideration of management quality as a necessary tool for the examination and improvement of higher education.
A total of 75.70% of participants reported always agreeing that subjects should be reoriented within education to address sustainability and to ensure it is included in the syllabus. Sustainability is understood as transversal material within the curriculum of higher education teaching, but its inclusion as an integral part of the study plan improves teaching quality. In total, 75.3% consider that sustainability activities can complement the overall formative development of the student and, thus, must not only be included in the inclusion curricular from a theoretical standpoint. It should also be practiced through activities within both the centre and the community in which it is developed. All of this improves quality. Further, 73% consider collaboration to be relevant between higher education and other sustainability civil society organizations. This agrees with the idea that the institution is an active social agent whose objective is the overall improvement of teaching. Additionally, 71.5% consider that, in relation to the promotion of quality education with a focus on sustainability, classrooms and equipment must meet sustainability protocols, which must form part of the higher education institution. Furthermore, 62.50% reported being in complete agreement with the existence of specific areas for the protection of sustainability-related materials and resources. Indeed, responsible consumption may depend on the characteristics and experiences of individuals, where both the type of training received during schooling and in other settings (such as the family setting), and their uncertainties [74] will come into play. Finally, 82.90% highlighted the importance of internet connections in higher education. This is clear, given we operate in an increasingly globalized world in which the international sphere is becoming more and more relevant. In recent years in Western society, there have been significant changes, seeing the widespread use of information and communication technology and its increase amongst adolescents [66]. This makes internet connections an essential element for the promotion of both quality and development sustainability in higher education.
ANOVA testing demonstrated significant differences and varied effect sizes in the frequency of participants’ responses with regards to the quality of higher education, through the pursuit of satisfaction with a focus on sustainability as a function of the grouping variable and satisfaction. Hence, we found differences in the teaching staff group for questionnaire items 2, 3, 4, 7, 15, 16, 19, 20, 29, 30 and 43, with items 16 and 20 describing variables that consider sustainability. Within the group of students, the relevant items were 1, 22, 24, 25, 33, 34, 35, 36 and 42, with the sustainability variable being found in item 34. Finally, the third group which pertains to family, included items 5, 8, 9, 10, 11, 12, 13, 14, 17, 18, 21, 27, 28, 31, 32, 37, 39, 40 and 41, with this final item collecting information relevant to sustainability.
It is necessary to highlight some limitations of the present study. Firstly, the sample should be extended to include all higher education centres in the south of Italy. This will broaden knowledge about the quality of higher education as it relates to satisfaction. The focus on sustainability should be retained, with the aim of obtaining further significant results from data collected through the questionnaire developed in the present study. Secondly, we underline the need to conduct further studies that are capable of providing evidence about the effect of satisfaction and relevant societal groups in relation to other experimental variables, which could include, for example, public or private teaching, amongst others. This will be useful in identifying the individuals and social principles required to bring this concept to life. Another of the limitations experienced by the present study was the difficulty in accessing the sample in other southern parts of Italy, although it should be noted that the time needed for data collection was reliable.

5. Conclusions

In this sense, far from the results providing only empirical evidence of the advantages of the tools referred to, they also provide an instrument that favours educational quality in a sustainable way [36,37]. This can be appreciated in the three groups that were analysed (family, teachers and students) as significant differences were reflected between the various items which relate to sustainable development in higher education. The importance of developing policy statements has been previously demonstrated in a number of studies [75], with the aim of increasing the number and quality of evaluations of educational quality through the lens of sustainability [76] in higher education.
Nevertheless, the role played by a quality education that is geared towards pro-sustainability can no longer be ignored. This includes its economic, social, environmental and organisational dimensions, as these can mark differences in the inter-related circles of learning and performance throughout life [41]. The challenge posed by this to teachers, students and family members alike centres on the struggle to incorporate effective participatory methods within the teaching process. These methods must motivate all players to acquire the knowledge, skills, attitudes and values required to forge a sustainable future [77].
In agreement with that proposed by [78], it is necessary for all those who practice teaching to be critical of their own practice. Self-evaluations of this practice will enable teachers to achieve continuous improvement in their profession [58].
As was previously discussed in the introduction, higher education institutions are associated with advances in knowledge development, which determine the expectations held by society regarding sustainable development. Four factors were obtained in the present study: Management of higher education and teaching resources; coordination of educational activities in higher education; management of teaching in higher education through knowledge of the topics included in the study program; delivery of a planned timetable in order to meet program objectives, the evaluation system, and teacher planning and teaching staff in higher education. It is expected that these will help future generations of professionals, students and families to have the required skills to supervise the implementation of this sustainable development.
According to Stephens and Hernández [40], it is expected that higher education institutions lead by example, serving as sustainable practice models for society to emulate. Incorporation of a spirit of sustainability shows how these institutions are transforming their study plans in various disciplines in order to strengthen this sustainable development. This can occur by evaluating the existing curriculum and making subsequent modifications [79,80].
We conclude that the results of the present study will enable further multi-dimensional analysis to be carried out in the future.

Author Contributions

M.d.C.O.-G., M.L.S. and E.M.O.-M., conceptualization. M.d.C.O.-G., methodology and validation, and E.M.O.-M. analysed the data. M.d.C.O.-G. and M.L.S., writing—review and editing. M.d.C.O.-G., supervision. All authors contributed to data interpretation of the analysis. M.d.C.O.-G., M.L.S. and C.F. wrote the paper with significant input from E.M.O.-M. All authors read and approved the final manuscript.

Funding

This research received external funding by Project HUM-983 (ITACA): “Research through transforming learning and contexts.”. Principal Researcher: Eva María Olmedo-Moreno.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Means and standard deviations for QHES by satisfaction and groups.
Table A1. Means and standard deviations for QHES by satisfaction and groups.
ItemsSatisfactionFamilyPupilsTeachers
MeanSDMeanSDMeanSD
1. Management and teaching resources in higher education22.900.3053.220.4234.001.563
33.960.8524.110.8004.301.341
45.541.0884.801.3704.251.238
56.850.3765.001.0693.331.497
Total4.111.1634.191.0004.171.376
2. Coordination of educational activities in higher education23.100.4802.900.3794.401.647
33.560.8973.750.7154.061.141
45.251.2944.321.0714.251.438
56.310.9475.911.4774.171.642
Total3.791.1773.870.9804.121.269
3. Management of teaching content and staff in higher education23.490.5042.900.4414.401.955
33.940.7913.940.7784.481.572
44.730.9624.471.0424.381.708
55.151.5196.001.3804.081.676
Total4.020.8914.041.0084.421.616
4. Adequate timetables and shifts23.510.5042.780.4234.501.650
33.850.4663.850.6714.361.478
45.170.9314.211.3464.061.436
56.620.5064.140.3514.001.706
Total4.050.8423.840.8724.301.498
5. Rules in higher education22.900.4803.280.6404.000.667
34.190.6383.990.5763.651.029
45.690.7934.021.2343.750.856
56.770.4394.360.9023.580.900
Total4.291.0373.950.7763.690.966
6. Application of sanctions in higher education23.080.2813.120.5163.501.080
34.140.8184.070.8063.581.180
44.930.8484.531.0533.630.806
55.000.4084.730.8833.330.985
Total4.130.9094.100.9083.551.103
7. Communication between staff and parents23.250.4392.850.4834.100.738
33.790.5783.940.6104.020.715
44.880.8324.531.2014.000.516
55.620.8704.230.5283.750.754
Total3.910.7973.960.8324.000.695
8. Adequate timeline for achieving syllabus objectives (total duration)22.750.4392.650.5803.300.823
33.980.6583.770.8053.310.795
45.220.7444.221.1693.620.619
55.310.7515.551.2623.580.793
Total4.010.9233.831.0253.380.777
9. Existing procedures for filing complaints and / or offering suggestions with respect to teaching23.080.2812.570.5013.400.699
33.590.8193.550.8643.460.770
44.610.5583.581.4423.441.153
55.081.0384.730.9853.420.669
Total3.690.8793.531.0363.450.806
10. Overall satisfaction with higher education oversight23.690.4643.450.5043.800.422
34.150.5354.170.6573.800.406
45.120.6184.280.8543.870.342
55.460.6604.680.6463.670.492
Total4.250.6884.160.7213.790.407
11. Availability of syllabus information (web page or other sources)23.310.4642.730.5063.700.675
33.990.6144.101.0723.700.599
45.801.0794.591.0723.690.602
56.770.4396.000.6903.750.452
Total4.211.0414.161.1803.700.587
12. Accessibility of syllabus information (web page or other sources)23.070.2542.800.5643.300.675
33.940.5383.950.7223.600.492
45.581.1334.731.1593.560.512
56.620.7685.860.5603.580.515
Total4.110.9974.070.9933.570.514
13. Usefulness of existing syllabus information (web page or other sources) 23.680.4713.600.4963.800.422
34.130.5324.120.5424.160.890
45.971.1744.690.8593.940.574
56.460.8775.730.6314.170.835
Total4.370.9844.250.7374.100.821
14. Orientation systems and welcome programmes for new students.23.000.0002.850.3623.100.994
33.760.7923.770.8123.550.685
45.921.0054.611.0813.500.730
56.620.7685.360.4923.000.853
Total4.011.1883.910.9813.450.753
15. Objectives (skills) pursued by the syllabus23.710.4573.600.4964.800.919
34.090.3244.190.6094.420.767
45.341.0775.16.8714.630.885
56.920.2775.680.6464.250.622
Total4.280.8064.380.8244.460.786
16. Subjects reorient education to address sustainability - included on the syllabus23.810.3933.180.3854.800.632
34.220.5584.190.7524.520.687
45.360.8465.010.9574.560.727
56.461.1275.180.5014.330.492
Total4.380.8144.300.8974.530.672
17. Variety and adequacy of teaching methodology included in the syllabus23.360.4832.950.5974.600.966
34.090.6083.960.6034.160.969
45.490.9544.600.6404.381.025
56.920.2775.360.4923.831.030
Total4.250.9614.050.7714.190.986
18. Planned timeline to achieve syllabus objectives (duration of studies)23.680.4713.400.4964.900.568
34.500.8234.230.8404.580.767
46.410.8535.250.7854.750.775
56.310.9475.590.7344.250.452
Total4.691.1084.400.9634.600.737
19. Quantity of practical application included in the syllabus23.250.4393.150.7004.500.707
34.000.5204.070.7284.540.611
45.170.9314.880.9564.560.629
56.540.7765.090.2944.330.778
Total4.120.8654.180.8854.520.634
20. Sustainability activities as a complement to the overall formative development of the student23.660.4772.850.5804.700.823
34.080.5343.940.6534.430.799
45.310.7494.330.6794.500.966
55.540.8775.910.6843.830.718
Total4.220.7574.000.8444.400.832
21. Tutorials as a support system for better learning23.080.6512.870.4043.401.075
33.920.5563.780.7073.690.854
45.150.8474.260.7103.500.894
56.620.5064.320.6463.500.674
Total4.050.9143.810.7643.620.859
22. Support tutorials for students33.070.2543.000.5553.500.527
43.830.6423.930.8403.580.665
54.850.5824.671.1383.560.629
66.310.9475.180.5883.580.669
Total3.930.8564.040.9873.570.643
23. Collaboration between higher education and other sustainability civil society organizations23.420.4983.350.5803.600.516
34.210.7324.110.8563.670.471
45.800.9965.181.3203.750.447
56.310.4805.360.4923.670.492
Total4.371.0184.291.0603.680.469
24. Evaluation system used23.710.4573.180.6363.900.316
34.210.7984.341.1004.101.031
45.631.0495.261.2924.811.559
57.000.0005.000.4363.831.115
Total4.411.0414.431.1994.151.108
25. Expectations met by the syllabus23.810.3933.280.4524.200.789
34.060.6694.260.9524.120.572
45.080.8365.140.7744.190.544
55.380.7685.640.6584.000.603
Total4.190.7844.391.0254.120.586
26. Overall satisfaction with the syllabus23.170.3783.630.4904.100.316
34.040.4864.190.7074.250.437
45.020.9005.090.6294.250.447
55.310.6305.640.7904.080.515
Total4.090.7464.360.8314.220.438
27. Knowledge of subject matter of staff participating on syllabus courses23.850.3633.450.5043.100.994
34.500.8624.400.9863.430.784
46.320.8605.190.8663.560.727
56.920.2775.500.8023.750.452
Total4.721.1114.511.0383.450.775
28. Teaching skills and methodology of staff participating on syllabus courses23.030.1833.080.4744.500.527
34.670.9964.501.1324.460.501
46.460.9345.280.9214.440.512
56.311.1825.000.4364.670.492
Total4.741.2944.541.1614.480.502
29. Overall environment of cooperation and collaboration amongst students23.340.4772.950.5525.100.568
33.920.4524.050.6545.100.597
45.340.7345.060.4725.000.632
55.771.0136.000.0005.500.522
Total4.080.7974.220.8785.120.600
30. Public relations: degree of availability of staff to students22.830.6733.270.5544.200.632
33.880.4624.030.6224.420.885
45.080.5964.850.7944.130.885
56.620.7685.450.6714.170.835
Total3.970.8894.170.8074.340.862
31. Overall human environment: degree of availability of staff to parents22.660.4773.130.5164.300.483
34.120.5413.970.7544.100.335
45.760.9354.740.9664.130.342
56.920.2775.000.4364.330.492
Total4.221.0804.080.8834.140.372
32. Professional capacity of administrative staff23.780.4183.850.4833.800.422
33.910.8344.060.5294.110.494
46.001.1304.950.7384.130.500
56.920.2775.050.2134.250.452
Total4.241.1744.240.6794.100.490
33. Overall satisfaction with staff and respectful student environment within higher education 23.070.2543.320.4743.700.483
33.790.4954.070.4623.660.524
45.460.7505.050.4603.690.479
56.850.3765.590.6663.750.452
Total3.990.9454.240.7083.680.504
34. Classrooms and equipment meet sustainability protocols23.200.4062.970.2763.800.789
33.770.5384.010.5973.820.647
45.190.6564.810.7153.880.619
56.150.3765.550.6713.750.622
Total3.940.8404.130.8053.820.645
35. Labs and workshops and their equipment meet sustainability protocols22.440.6232.600.6323.400.699
33.520.6503.730.7363.420.798
44.920.7724.450.6273.380.719
56.690.6305.360.4923.580.669
Total3.651.0453.840.8863.430.762
36. The library and its equipment22.830.3782.570.5013.400.699
33.310.6023.560.7083.420.798
44.370.7404.150.4763.380.719
55.310.7515.140.3513.580.669
Total3.440.7923.650.8093.430.762
37. Accessibility of the library23.470.5043.200.4054.100.568
33.740.6783.660.6754.290.863
44.881.1154.320.8344.380.957
55.311.1824.360.6584.000.603
Total3.890.8783.770.7554.260.832
38. Use of IT as a teaching resource23.170.3783.050.5974.000.816
33.870.6233.790.6523.750.809
44.800.9434.320.7274.000.632
55.151.5194.770.9223.671.231
Total3.930.8243.870.7623.790.836
39. IT lab use23.320.4712.650.4833.400.699
33.840.7973.450.6553.270.646
44.930.8484.150.9193.380.619
57.000.0004.410.6663.250.866
Total4.001.0053.550.8053.290.664
40. Sports facilities and equipment22.880.6182.750.4393.600.699
33.820.8253.620.7963.420.701
45.170.7914.220.9803.690.602
56.310.4804.770.7523.580.669
Total3.941.0583.700.9063.490.685
41. Existence of specific areas for protection of sustainability material and resources22.460.5023.080.4743.800.422
33.570.6743.540.7563.670.627
44.970.9283.551.0293.750.447
56.690.7513.820.7953.580.669
Total3.691.0673.520.8043.690.592
42. Catering services at the higher education institution 22.190.3932.750.4392.900.738
33.280.7633.340.8272.760.597
44.440.6233.681.1042.940.574
55.230.5994.270.8832.750.622
Total3.340.9583.390.9052.790.604
43. Application of higher education sanctions22.340.4772.900.6723.500.527
33.210.4083.440.7923.630.534
43.970.7873.600.9903.560.512
54.380.6503.950.4863.580.515
Total3.230.6643.450.8323.600.524
44. Internet connection at the higher education institution23.950.2224.180.5494.900.876
34.010.1724.250.6065.170.695
44.880.6465.220.6245.120.885
56.001.0006.000.0005.080.515
Total4.170.5344.480.7685.130.718
45. Safety and hygiene when teaching23.810.3933.800.4054.400.699
34.010.2314.150.5223.960.756
44.730.520 4.820.4133.810.655
55.850.6895.590.5034.170.718
Total4.130.05034.300.6344.000.742
Note: QHES according to satisfaction and groups.

References

  1. Mateo, J. La evaluación del profesorado y la gestión de la calidad de la educación. Hacia un modelo comprensivo de evaluación sistemática de la docencia. Rev. Investig. Educ. 2000, 18, 7–34. [Google Scholar]
  2. Sierra, J. Factors influencing a student’s decision to pursue a communications degree in Spain. Intang. Cap. 2012, 8, 43–60. [Google Scholar] [CrossRef] [Green Version]
  3. United Nations (UN). Post-2015Development Agenda; United Nations: New York, NY, USA, 2015. [Google Scholar]
  4. De La Orden, A. Evaluación del rendimiento educativo y la calidad de la enseñanza. En Instituto de Pedagogía “San José de Calasanz”. En La Calidad de la Educación; Consejo Superior de Investigaciones Científicas (CSIC): Madrid, Spain, 1981; pp. 111–131. [Google Scholar]
  5. De La Orden, A. Evaluación y calidad: Análisis de un modelo. Est. Educ. 2009, 16, 17–36. [Google Scholar]
  6. Caballero, J. Satisfacción e Insatisfacción de los Directores Escolares; Grupo Editorial Universitario: Granada, Spain, 2001. [Google Scholar]
  7. Mogensen, F.; Mayer, M.; Breiting, S.; Varga, A. Educación para el desarrollo sostenible. Tendencias; GRAÓ: Barcelona, Spain, 2009. [Google Scholar]
  8. López, M.; Pantoja, A. Escala para valorar la percepción y grado de satisfacción del profesorado de educación primaria de la comunidad autónoma de Andalucía respecto a los procesos tutoriales. Rev. Complut. Educ. 2018, 29, 287–306. [Google Scholar] [CrossRef] [Green Version]
  9. Ham, C.L. Service Quality, Customer Satisfaction, and Customer Behavioral Intentions in Higher Education; D.C.A.: Ann Arbor, MI, USA, 2003. [Google Scholar]
  10. Martínez, M.; García, B.; Quintanal, J. El perfil del profesor universitario de calidad desde la perspectiva del alumnado. Educ. XXI 2009, 9, 183–198. [Google Scholar] [CrossRef] [Green Version]
  11. Pérez, R. Calidad de la educación, calidad en la educación. Hacia su necesaria integración. Educ. XXI 2005, 8, 11–33. [Google Scholar]
  12. Vergara, J.C.; Quesada, V.M. Análisis de la calidad en el servicio y satisfacción de los estudiantes de Ciencias Económicas de la Universidad de Cartagena mediante un modelo de ecuaciones estructurales. Rev. Electron. Investig. Educ. 2011, 13, 108–122. [Google Scholar]
  13. Zineldin, M.; Akdag, H.C.; Vasicheva, V. Assessing quality in higher education: new criterio for evaluating student´s satisfaction. Qual. High. Educ. 2011, 17, 231–243. [Google Scholar] [CrossRef]
  14. Larrauri, J.O.; Espinosa, E.M.; Robles, M.I.P. La diversidad semántica y el carácter político de las nociones de calidad en la Educación Superior de México. Rev. Educ. Super. 2015, 44, 85–102. [Google Scholar] [CrossRef] [Green Version]
  15. Barrenetxea, A.M. Modelos de Calidad y Evaluación de la Educación Superior en la Unión Europea. Bilbao. Doctoral Thesis, Universidad del País Vasco, País, Vasco, Spain, 2005. [Google Scholar]
  16. Lago, D.; López, E.; Municio, P.; Ospina, R.; Vergara, G. La Calidad de la Educación Superior.¿Un reto o una utopía? Ed. Ecoe: Bogotá, Colombia, 2013. [Google Scholar]
  17. Carvalho, S.W.; De Oliveira, M. The role of trust in creating value and student loyalty in relational exchanges between higher education institutions and their students. J. Mark. High. Educ. 2010, 20, 145–165. [Google Scholar] [CrossRef]
  18. Ledden, L.; Kalafatis, S.P.; Mathioudakis, A. The idiosyncratic behaviour of service quality, value, satisfaction, and intention to recommend in higher education: An empirical examination. J. Mark. Manag. 2011, 27, 1232–1260. [Google Scholar] [CrossRef]
  19. Simpson, J.M. Student Perceptions of Quality and Satisfaction in Online Education; The University of Alabama: Tuscaloosa, AL, USA, 2012. [Google Scholar]
  20. Waas, T.; Hugé, J.; Verbruggen, A.; Wright, T. Sustainable Development: A Bird’s Eye View. Sustainability 2011, 3, 1637–1661. [Google Scholar] [CrossRef] [Green Version]
  21. Awuzie, B.O.; Abuzeinab, A. Modelling Organisational Factors Influencing Sustainable Development Implementation Performance in Higher Education Institutions: An Interpretative Structural Modelling (ISM) Approach. Sustainability 2019, 11, 4312. [Google Scholar] [CrossRef] [Green Version]
  22. Boström, M. A missing pillar? Challenges in theorizing and practicing social sustainability: Introduction to the special issue. Sustain. Sci. Pract. Policy. 2012, 8, 3–14. [Google Scholar] [CrossRef] [Green Version]
  23. Friman, M.; Schreiber, D.; Syrjänen, R.; Kokkonen, E.; Mutanen, A.; Salminen, J. Steering sustainable development in higher education—Outcomes from Brazil and Finland. J. Clean. Prod. 2018, 186, 364–372. [Google Scholar] [CrossRef]
  24. Godemann, J.; Bebbington, J.; Herzig, C.; Moon, J. Higher education and sustainable development: Exploring possibilities for organisational change. Account. Audit. Account. J. 2014, 27, 218–233. [Google Scholar] [CrossRef]
  25. Madeira, A.C.F.D. Indicadores de Sustentabilidade Para Instituiç õ es de Ensino Superior; Universidad de Oporto: Oporto, Portugal, 2008. [Google Scholar]
  26. Gruber, T.; Fuss, S.; Vossy, R.; Glaser-Zikuda, M. Examining student satisfaction with higher education services. Intern. J. Public Sect. Manag. 2010, 23, 105–123. [Google Scholar] [CrossRef] [Green Version]
  27. Al-Rahimy, S.A.S. Students satisfaction with service quality in Jordanian Universities. Interdiscip. J. Contemp. Res. Bus. 2013, 4, 638–644. [Google Scholar]
  28. Hassan, M.M. Academic satisfaction and approaches to learning among United Arab Emirates University students. Soc. Behav. Pers. 2002, 30, 443–451. [Google Scholar] [CrossRef]
  29. Petruzzellis, L.; d’Uggento, A.M.; Romanazzi, S. Student satisfaction and quality of service in Italian universities. Manag. Serv. Qual. 2006, 16, 349–364. [Google Scholar] [CrossRef] [Green Version]
  30. Chung, E.; McLarney, C. The classroom as a service encounter: Suggestions for value creation. J. Mark. Res. 2000, 19, 491–504. [Google Scholar] [CrossRef]
  31. Yu, Y.-T.; Dean, A. The contribution of emotional satisfaction to consumer loyalty. Int. J. Serv. Ind. Manag. 2001, 12, 234–250. [Google Scholar] [CrossRef]
  32. Alonso-Dos Santos, M. Calidad y satisfacción: El caso de la universidad de Jaén. Rev. Educ. Super. 2016, 45, 79–95. [Google Scholar] [CrossRef] [Green Version]
  33. Resino, J.J.; Chamizo, J.; Cano, E.I.; Gutiérrez, S. Calidad de vida universitaria: Identificación de los principales indicadores de satisfacción estudiantil. Rev. Educ. 2013, 362, 458–484. [Google Scholar] [CrossRef]
  34. Rodríguez, A.; Mármol, M. Liderazgo formativo y desarrollo sostenible de la calidad de la educación. Investig. Desarro. 2009, 17, 192–207. [Google Scholar]
  35. Alvarado, E. Percepción de la calidad educativa: caso aplicado a estudiantes de la Universidad Autónoma de Nuevo León y del Instituto Tecnológico de Estudios Superiores de Monterrey. Rev. Educ. Super. 2016, 45, 55–74. [Google Scholar] [CrossRef] [Green Version]
  36. Harvey, L.; James, W. Fifteen Years of Quality in Higher Education (Part two). Qual. High. Educ. 2010, 16, 81–113. [Google Scholar] [CrossRef]
  37. Enders, J.; Westerheijden, D.F. Quality Assurance in the European Policy Arena. Policy Soc. 2014, 33, 167–176. [Google Scholar] [CrossRef] [Green Version]
  38. Petruzzellis, L.; Romanazzi, S. Educational value: How students choose university: Evidence from an Italian university. Int. J. Educ. Manag. 2010, 24, 139–158. [Google Scholar] [CrossRef]
  39. Didomenico, E.; Bonnici, J. Assessing service quality within the educational environment. Education 1996, 116, 353–360. [Google Scholar]
  40. Stephens, J.C.; Hernandez, M.E.; Román, M.; Graham, A.C.; Scholz, R.W. Higher Education as a Change Agent for Sustainability in Different Cultures and Contexts. Int. J. Sustain. High. Educ. 2008, 9, 317–338. [Google Scholar] [CrossRef] [Green Version]
  41. De Matos, E.; Leitão, J.; Alves, H. Bridging Intellectual Capital, Sustainable Development and Quality of Life in Higher Education Institutions. Sustainability 2020, 12, 479. [Google Scholar] [CrossRef] [Green Version]
  42. DGES, M. Processo de Bolonha. Available online: https://www.dges.gov.pt/en/node/733 (accessed on 21 December 2019).
  43. Pariseau, S.; McDaniel, J.R. Evaluación de la calidad del servicio en las escuelas de negocios. Rev. Intern. Gest. Calid. Fiabil. 1997, 14, 204–218. [Google Scholar]
  44. Chua, C. Percepción de la calidad en la educación superior, Calidad de las universidades australianas. In Proceedings of the 2004 Forum (AUQF), Adelaide, Australia, 7–9 July 2004. [Google Scholar]
  45. Sherry, C.; Bhat, R.; Beaver, B.; Ling, A. Students as customers: The expectations and perceptions of local and international students. HERDSA Conf. 2004. [Google Scholar] [CrossRef]
  46. Correia, S.M.; Miranda, F.J. DUAQUAL: Calidad percibida por docentes y alumnos en la gestión universitaria. Cuad. Gest. 2012, 12, 107–122. [Google Scholar] [CrossRef]
  47. Arambewela, R.; Hall, J. A comparative analysis of international education satisfaction using SERVQUAL. J. Serv. Res. 2006, 6, 141–163. [Google Scholar]
  48. Howell, D.; William, O.; Turner, S. The analysis of missing data. In Handbook Social Science Methodology; Sage: London, UK, 2008; pp. 208–224. [Google Scholar]
  49. Escobar, J.; Cuervo, A. Validez de contenido y juicio de expertos: Una aproximación a su utilización. Avances en Medición. 2008, 6, 27–36. [Google Scholar]
  50. Elosua, P.; Zumbo, B. Reliability coefficients for ordinal response scales. Psicothema 2008, 20, 896–901. [Google Scholar]
  51. González, M.J.; Backhoff, E. Validación de un cuestionario de contexto para evaluar sistemas educativos con Modelos de Ecuaciones Estructurales. RELIEVE. Rev. Electron. Investig. Eval. Educ. 2010, 16, 1–17. [Google Scholar]
  52. Kline, R.B. Convergence of Structural Equation Modeling and Multilevel Modeling; Sage: Thousand Oaks, CA, USA, 2011. [Google Scholar]
  53. Olmedo, E.M.; Berrocal, E.; Olmos, M.C.; Expósito, J. Structural Equations Model (SEM) of a questionnaire on the evaluation of intercultural secondary education classrooms. Suma Psicol. 2014, 21, 107–115. [Google Scholar] [CrossRef] [Green Version]
  54. Bentler, P.; Bonett, D. Significance tests and goodness of fit in the analysis of covariance structures. Psychol. Bull. 1980, 88, 588. [Google Scholar] [CrossRef]
  55. Batista-Foguet, J.M.; Coenders, G.; Alonso, J. Análisis factorial confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Med. Clin. 2004, 122, 21–27. [Google Scholar] [CrossRef]
  56. Pedraza, L.; Rodríguez, E. El aseguramiento de la calidad: Un imperativo estratégico en la educación universitaria. Ingeniare. Ingeniare. Rev. Chil. Ing. Edit. 2015, 23, 4–5. [Google Scholar] [CrossRef] [Green Version]
  57. Salas, I.; Ordóñez, F. La acreditación desde la perspectiva de sus actores: El caso del Centro Universitario de Ciencias Exactas e Ingenierías de la Universidad de Guadalajara. In En la acreditación de la educación superior en Iberoamérica. La gestión de la calidad de los programas educativos. Tensiones, desencuentros, conflictos y resultados; Rosario, V., Didriksson, A., Marúm, E., Dias, J., Fernández, N., López, F., Villanueva, E., Ríos, J., Eds.; Palibrio: Bloomington, IN, USA, 2013; pp. 237–248. [Google Scholar]
  58. Yáñez, L.M.; Soria, K. Reflexión de Buenas Prácticas Docentes como eje de Calidad en la Educación Universitaria: Caso Escuela de Ciencias Empresariales de la Universidad Católica del Norte. Form. Univ. 2017, 10, 59–69. [Google Scholar] [CrossRef] [Green Version]
  59. Zabalza, M.A.; Zabalza-Beraza, M.A. Competencias Docentes del Profesorado Universitario; Narcea Ediciones: Madrid, Spain, 2003. [Google Scholar]
  60. Vásquez, J.A. Nuevos Escenarios y Tendencias Universitarias. Rev. Investig. Educ. 2015, 33, 13–26. [Google Scholar]
  61. Zabalza, M.A. Metodología Docente. Revi. Docencia Univ. 2011, 9, 75–98. [Google Scholar] [CrossRef] [Green Version]
  62. Casanova, M.A. El diseño curricular como factor de calidad educativa. Rev. Iberoam. Calid. Efic. Cambio Educ. 2012, 10, 7–20. [Google Scholar]
  63. Mas, O.; Olmos, P. El profesor universitario en el espacio europeo de educación superior. la autopercepción de sus competencias docentes actuales y orientaciones para su formación pedagógica. Rev. Mex. Investig. Educ. 2016, 21, 437–470. [Google Scholar]
  64. Basantes, R.; Coronel, J.; Vinueza, A. Impacto de la evaluación y acreditación de las carreras profesionales ofertadas por la Universidad Nacional de Chimborazo desde la percepción de los estudiantes. Rev. Cienc. Unemi. 2016, 9, 36–47. [Google Scholar] [CrossRef] [Green Version]
  65. Martínez, A.; Olmos, M.C.; Tomé, M.; Olmedo, E.M. Analysis of Psychometric Properties and Validation of the Personal Learning Environments Questionnaire (PLE) and Social Integration of Unaccompanied Foreign Minors (MENA). Sustainability 2019, 11, 2903. [Google Scholar] [CrossRef] [Green Version]
  66. Olmos, M.C.; López, R.; Mohamed, L. Religion and Sex as Factors of Individual Differences of Reification in an Intercultural-Community-Based Society. Religions 2019, 10, 621. [Google Scholar] [CrossRef] [Green Version]
  67. Warner, N.; Letsky, M.; Cowen, M. Cognitive model of team collaboration: Macro-cognitive focus. In Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomic Society, Orlando, FL, USA, 26–30 September 2005; Sage CA: Los Angeles, CA, USA; pp. 269–273. [Google Scholar]
  68. Andréu, J. El análisis multinivel: Una revisión actualizada en el ámbito sociológico. Metodol. Encuestas 2011, 13, 161–176. [Google Scholar]
  69. Badenes, L.; Frías, D.; Bonilla, A. Un estudio exploratorio sobre el nivel de conocimiento sobre el tamaño del efecto y meta-análisis en psicólogos profesionales españoles. Eur. J. Investig. Health Psychol. Educ. 2018, 7, 111–122. [Google Scholar] [CrossRef]
  70. Larrosa, F.; García-Fernández, J.M. Percepciones de familias y profesorado de Educación Primaria y Secundaria sobre los deberes y derechos docentes y posibilidades de colaboración. Revi. Electron. Investig. Docencia (REID). 2014, 11, 7–28. [Google Scholar]
  71. González, I. Determinación de los elementos que condicionan la calidad de la universidad: Aplicación práctica de un análisis factorial. RELIEVE Rev. Electron. Investig. Eval. Educ. 2003, 9, 83–96. [Google Scholar] [CrossRef]
  72. Nygaard, C.; Belluigi, D.Z. A proposed methodology for contextualised evaluation in higher education. Assess. Eval. High. Educ. 2011, 36, 657–671. [Google Scholar] [CrossRef]
  73. Sproule, R. Student Evaluation of Teaching: A Methodological Critique. Educ. Policy Anal. Archiv. 2000, 50, 1–23. [Google Scholar] [CrossRef] [Green Version]
  74. Olmos, M.C.; Estrada, L.I.; Ruiz, F.; López, R.; Mohamed, L. Making future teachers more aware of issues related to sustainability: An Assessment of best practices. Sustainability 2019, 11, 7222. [Google Scholar] [CrossRef] [Green Version]
  75. Larrán, J.M.; Madueño, J.H.; Calzado, Y.; Andrades, J.A. Proposal for Measuring Sustainability in Universities: A Case Study of Spain. Int. J. Sustain. High. Educ. 2016, 17, 671–697. [Google Scholar] [CrossRef]
  76. Aleixo, A.M.; Azeiteiro, U.; Leal, S. The Implementation of Sustainability Practices in Portuguese Higher Education Institutions. Int. J. Sustain. High. Educ. 2018, 19, 146–178. [Google Scholar] [CrossRef]
  77. Litzner, L.I.; Werner, R. La educación para el desarrollo sostenible en la universidad boliviana. Percepciones del profesorado. Teor. Educ. Rev. interuniv. 2019, 31, 149–173. [Google Scholar] [CrossRef]
  78. Rubio, M.J.; Ruiz, A.; Martínez, F. Percepción del alumnado sobre la utilidad de las actividades de aprendizaje para desarrollar competencias. Revi. Investig. Educ. 2016, 34, 221–240. [Google Scholar] [CrossRef] [Green Version]
  79. Mulder, K.F.; Segalas, J.; Ferrer-Balas, D. How to educate engineers for/in sustainable development: Ten years of discussion, remaining challenges. Int. J. Sustain. High. Educ. 2012, 13, 211–218. [Google Scholar] [CrossRef]
  80. Thomas, I. Challenges for implementation of education for sustainable development in higher education institutions. In Routledge Handbook of Higher Education for Sustainable Development; Barth, M., Michelsen, G., Thomas, I., Rieckmann, M., Eds.; Routledge: London, UK, 2016; pp. 40–55. [Google Scholar]
Figure 1. Schematic (path graph) of the quality of higher education through the pursuit of satisfaction with a focus on sustainability (QHES) questionnaire.
Figure 1. Schematic (path graph) of the quality of higher education through the pursuit of satisfaction with a focus on sustainability (QHES) questionnaire.
Sustainability 12 02366 g001
Figure 2. Histogram of the means and standard deviations for QHES by satisfaction and groups.
Figure 2. Histogram of the means and standard deviations for QHES by satisfaction and groups.
Sustainability 12 02366 g002
Table 1. ANOVA and effect size (η2) for QHES by satisfaction and groups.
Table 1. ANOVA and effect size (η2) for QHES by satisfaction and groups.
ItemsSatisfactionGroups Satisfaction × Groups
Fpη2Fpη2Fpη2
1—Management and teaching resources in higher education19.6880.0000.0520.1880.6650.00019.6880.0000.052
2—Coordination of educational activities in higher education14.6560.0000.0390.1470.7020.00014.6560.0000.039
3—Management of higher education teaching content and staff5.6440.0010.0151.2550.2630.0015.6440.0010.015
4—Adequate timetables and shifts35.7890.0000.09030.6800.0000.02835.7890.0000.090
5—Higher education rules57.7260.0000.13870.7830.0000.06157.7260.0000.138
6—Application of sanctions in higher education1.1280.3370.0032.7840.0960.0031.1280.3370.003
7—Communication between staff and parents17.8060.0000.0470.2440.6220.00017.8060.0000.047
8—Adequate timeline for achieving syllabus objectives (total duration)8.0000.0000.02226.4330.0000.0248.0000.0000.022
9—Existing procedures for filing complaints and / or offering suggestions with respect to teaching12.7970.0000.03416.2120.0000.01512.7970.0000.034
10—Overall satisfaction with higher education oversight18.6600.0000.04912.1600.0010.01118.6600.0000.049
11—Availability of syllabus information (web page or other sources)22.2500.0000.0587.9360.0050.00722.2500.0000.058
12—Accessibility of syllabus information (web page or other sources)11.1800.0000.0308.7660.0030.00811.1800.0000.030
13—Usefulness of existing syllabus information (web page or other sources)30.1370.0000.07721.1500.0000.01930.1370.0000.077
14—Orientation systems and welcome programmes for new students.22.5700.0000.05914.8470.0000.01422.5700.0000.059
15—Objectives (skills) pursued by the syllabus12.8340.0000.0340.0340.8540.00012.8340.0000.034
16—Subjects reorient education to address sustainability - included on the syllabus13.2950.0000.03613.7140.0000.01313.2950.0000.036
17—Variety and adequacy of teaching methodology included in the syllabus19.6880.0000.05245.4700.0000.04019.6880.0000.052
18—Planned timeline to achieve syllabus objectives (duration of studies)9.9060.0000.02757.4800.0000.0509.9060.0000.027
19—Quantity of practical application included in the syllabus13.6540.0000.0360.8630.3530.00113.6540.0000.036
20—Sustainability activities as a complement to the overall formative development of the student22.4250.0000.05851.3520.0000.04522.4250.0000.058
21—Tutorials as a support system for better learning32.2030.0000.08248.9840.0000.04332.2030.0000.082
22—Support tutorials for students6.7350.0000.0180.0900.7640.0006.7350.0000.018
23—Collaboration between higher education and other sustainability civil society organizations4.3140.0050.01210.1330.0010.0094.3140.0050.012
24—Evaluation system used14.7700.0000.0391.2270.2680.00114.7700.0000.039
25—Expectations met by syllabus6.3970.0000.0175.5660.0180.0056.3970.0000.017
26—Overall satisfaction with the syllabus1.7670.1520.00522.5310.0000.0201.7670.1520.005
27—Knowledge of subject matter of staff participating on syllabus courses17.3980.0000.04632.4760.0000.02917.3980.0000.046
28—Teaching skills and methodology of staff participating on syllabus courses 10.9630.0000.02922.9350.0000.02110.9630.0000.029
29—Overall environment of cooperation and collaboration amongst students12.3280.0000.0567.2930.0000.03610.6540.0000.022
30—Public relations: degree of availability of staff to students16.3650.0000.06121.2010.0000.05411.2910.0000.032
31—Overall human environment: degree of availability of staff to parents21.2020.0000.0238.5040.0000.0616.9720.0000.054
32—Professional capacity of administrative staff40.7530.0000.1013.4540.0630.00340.7530.0000.101
33—Overall satisfaction with staff and respectful student environment at the higher education institution32.2180.0000.08217.5440.0000.01632.2180.0000.082
34—Classrooms and equipment meet sustainability protocols13.4380.0000.0365.1850.0230.00513.4380.0000.036
35—Labs and workshops and their equipment18.7240.0000.0492.3020.1300.00218.7240.0000.049
36—The library and its equipment7.7340.0000.02110.0930.0020.0097.7340.0000.021
37—Accessibility of the library 6.1030.0000.01713.7290.0000.0136.1030.0000.017
38—IT use as a teaching resource3.3360.0190.00910.0280.0020.0093.3360.0190.009
39—IT lab use23.9960.0000.062123.2340.0000.10223.9960.0000.062
40—Sports facilities and equipment 12.4510.0000.03338.8460.0000.03512.4510.0000.033
41—Existence of specific areas for protection of sustainability materials and resources74.9940.0000.17226.4020.0000.02474.9940.0000.172
42—Catering services at the higher education institution14.6260.0000.0390.2640.6080.00014.6260.0000.039
43—Application of sanctions in higher education12.1630.0000.03312.2710.0000.01112.1630.0000.033
44—Internet connection at the higher education institution0.8150.4850.00240.2150.0000.0360.8150.4850.002
45—Safety and hygiene of teaching facilities1.4850.2170.0045.6250.0180.0051.4850.2170.004
Note: The multilevel linear adjustment was used to reduce the type I error (α). Thus, the α-value was divided by the number of pair comparisons for each ANOVA.

Share and Cite

MDPI and ACS Style

Olmos-Gómez, M.d.C.; Luque Suárez, M.; Ferrara, C.; Olmedo-Moreno, E.M. Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability. Sustainability 2020, 12, 2366. https://doi.org/10.3390/su12062366

AMA Style

Olmos-Gómez MdC, Luque Suárez M, Ferrara C, Olmedo-Moreno EM. Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability. Sustainability. 2020; 12(6):2366. https://doi.org/10.3390/su12062366

Chicago/Turabian Style

Olmos-Gómez, María del Carmen, Mónica Luque Suárez, Concetta Ferrara, and Eva María Olmedo-Moreno. 2020. "Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability" Sustainability 12, no. 6: 2366. https://doi.org/10.3390/su12062366

APA Style

Olmos-Gómez, M. d. C., Luque Suárez, M., Ferrara, C., & Olmedo-Moreno, E. M. (2020). Quality of Higher Education through the Pursuit of Satisfaction with a Focus on Sustainability. Sustainability, 12(6), 2366. https://doi.org/10.3390/su12062366

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop