Next Article in Journal
Burnout in Nursing Managers: A Systematic Review and Meta-Analysis of Related Factors, Levels and Prevalence
Next Article in Special Issue
Validation of the Achievement Emotions Questionnaire for Physical Education (AEQ-PE)
Previous Article in Journal
Multiple Sclerosis: Impact on Oral Hygiene, Dysphagia, and Quality of Life
Previous Article in Special Issue
Teaching-Learning Processes: Application of Educational Psychodrama in the University Setting
 
 
ijerph-logo
Article Menu
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing the Relationship between Autonomy Support and Student Group Cohesion across Ibero-American Countries

by
Juan Antonio Moreno-Murcia
1,*,
Elisa Huéscar Hernández
1,
Luís Cid
2,3,
Diogo Monteiro
2,3,
Filipe Rodrigues
2,3,4,
Diogo Teixeira
5,
Jeanette M. López-Walle
6,
Argenis Vergara-Torres
6,
José Tristan
6,
Gabriel Gastélum-Cuadras
7,
Julio Cesar Guedea Delgado
7,
Juan Luis Soto Peña
8,
Iván Rentería
9,
Rodrigo Vargas Vitoria
10,
Aquiles Alejandro Almonacid Fierro
10,
Alfonso Valero-Valenzuela
11,
Jorge Flandez
12,
Rudy José Nodari Júnior
13,
Gracielle Fin
13,
Mauricio Rocha Calomeni
14,
Divaldo Martins de Souza
15 and
César Augusto de Souza Santos
15
add Show full author list remove Hide full author list
1
Miguel Hernández University of Elche, Avda. Universidad, s/n, Elche, 30202 Alicante, Spain
2
Sport Sciences School of Rio Maior (ESDRM—IPSantarém), Av. Dr. Mário Soares n-110, 2040-413 Rio Maior, Portugal
3
Research Center in Sports Sciences, Health Sciences and Human Development (Portugal), Quinta de Prados, Edifício Ciências de Desporto, 5001-801 Vila Real, Portugal
4
Life Quality Research Center (CIEQV), Av Dr. Mário Soares n-110, Rio Maior, 2040-413 Santarém, Portugal
5
Research Center in Sport, Health and Human Development, Lusófona University, Lisbon (Portugal), Campo Grande, 376, 1749-024 Lisboa, Portugal
6
Sport Organization School, Universidad Autónoma de Nuevo León (México), Cd. Universitaria, s/n, C.P. 66455 San Nicolás de los Garza, Mexico
7
Facultad de Ciencias de la Cultura Física, Universidad Autónoma de Chihuahua (México), C. Escorza, 900, Col. Centro 31000 Chihuahua, Mexico
8
Facultad de Educación Física y Deporte, Universidad Autónoma de Sinaloa (México), Av. de las Américas y Prol, Josefa Ortíz de Domínguez s/n, Circuito interior sur-oriente, Ciudad Universitaria, C.P. 80040 Culiacán Rosales, Mexico
9
Facultad de Deportes, Campus Ensenada, Universidad Autónoma de Baja California (México), Boulevard Zertuche y Boulevard Los Lagos Sin Número, Fraccionamiento Valle Dorado, C.P. 22890 Ensenada, Mexico
10
Departmento de Ciencias de la Actividad Física, Universidad Católica del Maule (Chile), Avda. San Miguel, Talca, 3605 Maule, Chile
11
Departmento Actividad Física y Deporte, Universidad de Murcia (España), C/ Argentina, 19, 30720 San Javier, Spain
12
Instituto Ciencias de la Educación, Escuela Pedagogía en Educación Física, Facultad Filosofía y Humanidades, Universidad Austral de Chile (Chile), Independencia, 631 Valdivia, 5090000 Los Ríos, Chile
13
Department of Physical Education, Universidade do Oeste de Santa Catarina (Brasil), R. Getúlio Vargas, 2125, Flor da Serra, Joaçaba 89600-000, Brazil
14
Departamento de Educação Física, Laboratório de Biociências da Motricidade Humana do ISECENSA, (Brasil), R. Benta Pereira- Centro, Campos dos Goytacazes 28030-260, Brazil
15
Departamento de Ciências do Movimento Humano, Universidade do Estado do Pará (Brasil), Travessa Angustura, 2219, Pedreira, Belém 66087-310, Brazil
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(11), 3981; https://doi.org/10.3390/ijerph17113981
Submission received: 14 May 2020 / Revised: 27 May 2020 / Accepted: 27 May 2020 / Published: 4 June 2020

Abstract

:
Teacher-endorsed supporting behaviors present themselves as key influencers of student adaptive academic and social functions. The objective of this paper was twofold. First, this study sought to test a model in which student-perceived autonomy support was associated with group cohesion, considering the mediating role of basic psychological needs satisfaction and intrinsic motivation. Second, the current study examined the dimensionality of the model across five Western countries, namely Spain, Portugal, Brazil, Chile, and Mexico. A convenience sample of 3033 college students (Mage = 21.51 ± SD = 3.71) were recruited for the analysis. The results revealed that perceived autonomy support was positively associated with needs satisfaction, being consequently associated with intrinsic motivation and, ultimately, with group cohesion. Additionally, a multigroup analysis revealed that the model was invariant across college students from the different countries. The current results are discussed around the promotion of teacher uses of autonomy-supportive behaviors fostering adaptive outcomes in students regarding positive social relations and that the cultures of Ibero-American countries are equivalent in this process.

1. Introduction

In the last decade, based on Theory of Self-Determination (SDT) [1] research, teachers have been considered as key figures in adaptive results—among others, the positive socialization of students—through their motivational styles [2]. Thus, two types of motivational teaching practices have been determined in the past, namely, the autonomy-supportive style and the controlling style [2]. Motivational teaching style is the tone of interpersonal behaviors that teachers use during interactions with their students. While controlling behaviors involves putting pressure on the student to think, feel, and act in a concrete way [3], autonomy support practices are related to self-determined behaviors and positive outcomes across students [4].
The adoption of a motivational style of autonomy support by the teaching figure has been shown to increase the need for autonomy (i.e., student’s sense of having the ability to decide about their own actions), competence (i.e., student’s sense of being able to achieve their proposed goals), and relatedness (i.e., student’s sense of being connected to others), as stated in previous literature [5]. Contrarily, controlling practices have been associated with an increased frustration of basic psychological needs, leading to maladaptive outcomes for students [6]. Through the satisfaction or frustration of basic psychological needs, it is possible to observe a more and a less self-determined motivation across students, respectively, generating positive results in the first case and maladaptive results in the second one [7,8].
Both of these theoretical constructs have given rise to two different motivational patterns known as the bright side of motivation (positive motivational process) and the dark side of motivation (motivational process that would lead to maladaptive outcomes). Although there is consensus in previous works on the functioning of this motivational process to generate differentiated results, the literature is scare on several social aspects across students. In fact, literature has pointed out the role of social triggers in the satisfaction of basic psychological needs to promote a quality (intrinsic) motivation that would eventually be related to different student outcomes (cognitive, emotional, and behavioral) [9,10,11]; however, many of the consequences of both pathways remain unexplored.
In recent years, the phenomena that have to do with harmonious group relations—that is, the positive development within social relations—are getting special attention among scholars and teachers. Specifically, the “team” factor, although mainly studied in the sport context [12], seems to optimize personal efforts in other contexts, such as education [13], and to be able to generate benefits not only at the personal level but, also, at the group level. In this sense, perceived group cohesion is defined as the individual sense of belonging to a group along with the moral feelings associated with the other group members [14]. In this regard, the concept of belonging and the values of morality would be fundamental for adaptive outcomes among students. Additionally, the feeling of belonging is of a cognitive nature, and it has been associated with the promotion of positive relationships among peers [1]. In the case of the feeling of morality, it is of an affective nature and would have its value in promoting the mobilization of the person in achieving the common goals of the organization or group in which the persons belongs. In this sense, although work in this line is still very scarce, a recent study [15] with a sample of college students has pointed out the importance of positive teaching strategies in student self-regulation strategies as a way of student-perceiving group cohesion generating positive academic results. Thus, the value of this dynamic process that guarantees the permanence of the group together in order to achieve the proposed objectives or to satisfy the affective needs of its members [16] should be valued by teachers in order to optimize positive results in students.
From the results of previous research based on the SDT framework [1], there is support that social factors are very important in generating quality motivation (e.g., intrinsic motivation) to the extent in which needs are satisfied. Some works have shown how autonomy-supportive behaviors increase needs satisfaction by catalyzing positive social functioning, such as commitment or prosocial behaviors [17,18]. With respect to group cohesion, although studies are very limited and virtually inexistent, positive results have been found with self-determined motivation [19]. However, to the best of our knowledge, there is virtually no study to date that has examined and explored the influence of student perception of teacher-endorsed autonomy-supportive behaviors on student group cohesion. Therefore, the aim of this study was to analyze the sequence of support for the perceived autonomy support of the teacher, satisfaction of basic psychological needs, intrinsic motivation, and group cohesion in college students. The hypothesis is based on previous research indicating that support for autonomy will fulfill basic psychological needs by relating positively to intrinsic motivation, ultimately catalyzing a greater perception of group cohesion.

Cross-Cultural Generalizabiliy and Equivalence

Considering the assumptions of the SDT framework, there are different ways in which behavioral practices can be internalized attending to a culture [1,20,21], suggesting that the need to carry out multinational studies to avoid potential limitations in the development of theories is recently proliferating [22]. Specifically, and based on the recommendations of the STD, the objective of these cross-cultural investigations is to avoid possible biases due to inappropriate cultural generalizations. Thus, for example, while some works have verified the nonvariability of the theoretical constructs of SDT between countries [23], other cross-cultural works have found differences across cultures in non-Western cultures, including differences in countries of Western cultures [24]. In one particular study [25] considering 815 teachers from eight different nations, a mediation analysis showed that teachers in collectivistic nations self-described themselves to be more prone to controlling styles due to their perceptions as being a culturally normative classroom practice.
Therefore, considering the recommendation on the need to incorporate intercultural analyses to check the variability of culture on certain motivational constructs, mainly in SDT research [26], this research set has a second objective. As a secondary aim, this study analyzed the invariance of the proposed model across five Western countries, namely Spain, Portugal, Chile, Mexico, and Brazil. Although some of these countries are in Latin America (Brazil, Chile, and Mexico), these countries share the same linguistic background as Spain and Portugal. The concept of the Ibero-American Community of Nations (CIN) or Western Spanish and Portuguese-speaking nationalities, used in scientific and academic research [23] would identify possible variability or equivalence among the same cultures from the different countries. Given the political efforts that have been adopted in order to identify a common cultural heritage, pointing out the cultural affinities that unite the countries of the CIN [27], as well as previous research regarding the universal assumption of psychological needs in each human being [28,29], it is hypothesized that the proposed model would display equivalence across countries, in which there would be no difference between the countries of Spain, Portugal, Chile, Mexico, and Brazil in the relationship to student perception of autonomy support endorsed by teachers, the satisfaction of basic psychological needs, intrinsic motivation, and group cohesion.

2. Materials and Methods

2.1. Participants

A convenience sample of 3033 students (2051 female; 982 male) aged between 17 and 63 years (M = 21.51 ± SD = 3.71) was recruited for the present study. Participants were college students from five different countries, namely Spain, Portugal, Mexico, Chile, and Brazil. Sample statistics of each group are displayed in Table 1.

2.2. Measures

The Autonomy Support Scales for Spanish-speaking students [30] and for Portuguese-speaking students [31] were used to measure student perception of autonomy support. Participants were questioned to express their perception of autonomy supportive behaviors endorsed by teachers (6 items: e.g., “My teacher gives me meaningful proposals and positive feedback”) using a 7-point scale ranging from 1 (not agree at all) to 7 (totally agree).
The Basic Psychological Need in Exercise Scales Spanish version [32] and Portuguese version [33] with item adaptation to the classroom settings were used to measure the experiences of autonomy, competence, and relatedness satisfaction. This scale comprises fifteen items assessing autonomy (5 items: e.g., “I feel that I can complete task in the way that I prefer.”), competence (5 items; e.g., “I believe that I can complete personal challenges.”), and relatedness (5 items; e.g., “I feel connected with the people when I engage in the activities.”) satisfaction where responses were given using a 7-point scale anchored from 1 (totally disagree) to 7 (totally agree). Internal consistency for autonomy, competence, and relatedness satisfaction was 0.76, 0.82 and 0.90, respectively. All needs were regressed into a composite factor using similar procedures reported in previous literature [34].
Intrinsic motivation was measured using four items of the Behavioral Regulation in Sport Questionnaire, with proper adaptation to the physical education context in Spanish-speaking students [32] and in Portuguese-speaking students [35]. Students responded to each item based on how they perceive their intrinsic motivation in school-context activities (e.g., “For the pleasure I feel in expanding my knowledge about topics that interest me.”) using a 7-point scale anchored from 1 (totally disagree) to 7 (totally agree).
Spanish and Portuguese native students responded to the Perceived Cohesion Scale [36] to measure how students perceive their bounding with the social environment, specifically group cohesion. It is composed of 6 items (e.g., “I feel that I belong to this group.”). Agreement with each statement was rated on a 7-point scale anchored from 1 (totally disagree) to 7 (totally agree).

2.3. Procedures

The study protocol was approved by the Ethical Committee (registration number: 191007203011) and conducted in accordance with the 1964 Helsinki declaration and its later amendments. Schools were identified by the researchers with links in the universities, and school principals and councils were contacted by phone and/or e-mail informing the purpose of the study and signed approval upon agreement prior to data collection. Afterwards, students were contacted based on the e-mail database provided by the school councils. Students were contacted to participate voluntarily, and informed consent was obtained from each participant individually prior to data collection. Responses given by the students were received during the entire school year of each country during the years of 2018 and 2019. Students completed an anonymous online multisection survey, which took approximately 15 min to complete.

2.4. Statistical Analysis

Mean, standard deviation, skewness, kurtosis, and bivariate correlations were calculated for each construct under analysis. Cutoffs for normality were considered based on guidelines [37]; we accepted scores within −2/+2 and −7/+7 for skewness and kurtosis, respectively. In addition, composite reliability was assessed suggesting scores above 0.70 as acceptable [38].
A structural equation modeling procedure to test the hypothesized model was conducted using the Weighted Least Square Mean and Variance adjusted (WLSMV) estimator. The model adequacy was assessed according to the following goodness-of-fit indexes: Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), and the Root Mean Square Error of Approximation (RMSEA) with its respective confidence interval (CI 90%). The weighted root mean residual (WRMR) was not considered, since it is not a well-studied fit statistic and has not behaved as well as expected, since this index could provide misleading results under extremely large sample sizes [39].
For cutoffs, CFI and TLI ≥ 0.90 and RMSEA ≤ 0.08 were considered as acceptable [38,40,41]. The confidence interval at 95% (CI 95%) was considered to measure direct and indirect effects among constructs, accepting significance if the CI did not encompass zero [42].
To test the multigroup analysis, the structural SEM model was initially assessed in each group separately. Afterwards, all groups were imputed at the same time in the model to conduct the invariance analysis. Several levels of invariance assumptions were measured according to Morin, Arens, and Marsh [43], namely configural invariance (i.e., factor structure is the same between groups, and items are associated with the same factors); weak factorial invariance (i.e., factor structure and factor loadings are equal between groups); strong invariance (i.e., item factor structure, factor loadings, and item thresholds are equal between groups); and strict factorial invariance (i.e., item factor structure, factor loadings, item thresholds, and item residuals are equal between groups).
Current research adopted differences in CFI (∆CFI), TLI (∆TLI), and RMSEA (∆RMSEA) to evaluate the structural invariance [44]. Structural invariance was considered to be acceptable when differences were ≤ 0.010 [44]. Analyses were conducted in Mplus 7 [45].

3. Results

3.1. Preliminary Analysis

Descriptive statistics show that participants rated above-average on all constructs under analysis. Univariate skewness and kurtosis were contained within cutoffs, as seen in Table 2. Composite reliability coefficients were above acceptable, and all bivariate correlations were significant, as theoretically expected: (i) autonomy support was positively and significantly correlated with needs satisfaction, intrinsic motivation, and group cohesion; (ii) needs satisfaction was positively and significantly correlated with intrinsic motivation and group cohesion; and (iii) intrinsic motivation displayed a significant association with group cohesion.

3.2. Structural Model, Direct and Indirect Effects

The model in each sample provided acceptable fit to the data (see Table 3). All direct effects were significant, as hypothetically proposed in all samples, namely (i) perceived autonomy support displayed a positive and significant association with needs satisfaction, (ii) needs satisfaction was a positive and significant predictor on intrinsic motivation, and (iii) intrinsic motivation was positively and significantly associated with group cohesion.
Looking at the indirect effects, positive and significant were found in all country samples: (i) perceived autonomy support displayed a significant indirect effect on intrinsic motivation and group cohesion, and (ii) needs satisfaction showed a positive and significant indirect effect on group cohesion. Beta coefficients of direct and indirect effects and their respective CI 95% across samples are shown in Table 4.

3.3. Multigroup Analysis

The structural model was invariant between groups, since invariance criteria were respected: namely, configural, weak, strong, and strict factorial. Looking specifically to the differences in CFI, TLI, and RMSEA, they were all below the cutoffs. For detailed information, see Table 5.

4. Discussion

The current study aimed to examine the relationships between how college students perceive teacher-endorsed autonomy-supportive behaviors, the satisfaction of basic psychological needs, intrinsic motivation, and group cohesion. The proposed model advances previous research applying the SDT framework by analyzing its effectiveness in accounting for adaptive outcomes such as group cohesion. The present study is expected to provide further robust evidence to inform the development of protocols aimed at promoting crucial academic outcomes delivered in the classroom setting. The results supported the hypothesis and found that perceived autonomy support was positively related to group cohesion, in which needs satisfaction and intrinsic motivation displayed mediating roles. Although the scientific literature has so far supported this theoretical sequence among SDT constructs [46], confirming that it catalyzes positive consequences in the student related to positive social relations such as prosocial behavior [18], to the best of our knowledge, the relationships between perceived behaviors from others and prosocial behaviors among students is still under-researched.
The present study supports several of the key premises of the SDT framework when considering the relationship between motivational constructs and adaptive outcomes. Specifically, perceived autonomy support predicted needs satisfaction in the classroom setting directly. Results provide further evidence that a student’s experience of needs fulfillment is related to their behavior regulation towards a more self-determined (i.e., intrinsic motivation) behavior. Current findings support the central premises of the SDT framework: the positive impact of perceived autonomy-supportive behaviors on needs satisfaction and, consequently, the critical aspect of needs fulfillment as an indicator of internalized behavior and optimal functioning. This finding has crucial important implications for interventions to promote greater levels of autonomous motivation, in which the student considers classroom activities as important, resulting in greater academic success [47]. Previous studies suggest that college teachers can foster intrinsic motivation in the classroom setting by displaying key autonomy-supportive behaviors such as providing evaluative feedback, choice, and clear rationale and that such interpersonal behaviors lead to increased perceptions of autonomy support in college students [4,30,31]. If such interpersonal behaviors are effective in changing the perceptions of autonomy support among students, they could lead to adaptive outcomes related to other social interactions. While the effects of such protocols should be empirically tested, present findings may signpost a key strategy that may have utility in promoting positive changes in needs satisfaction, intrinsic motivation, and, consequently, group cohesion.
Current findings found indirect effects of perceived autonomy-supportive behaviors endorsed by teachers in group cohesion. Indeed, the teacher who adopts a motivational style that supports the autonomy of the student, favoring effort and cooperation towards learning, is also functioning as a social reference model for the student that can contribute to being able to more easily adopt positive social patterns [48]. In SDT research, Balaguer et al. [12] pointed out that, when the figure of authority favors a positive atmosphere, it facilitates the desire between group members within the group to remain cohesive and to maintain close ties. Forthcoming studies should explore more adaptive outcomes using this empirical sequence, which confirms the benefits of autonomy-supportive teaching [17], in order to verify the relationship of cohesion and student academic success, as it has been pointed out in previous literature [49].
Given the exponentially growing interest in motivational models as its implication in adaptive outcomes, it is important to rely on reliable and solid models that provide a robust picture on how teachers can endorse in need-supportive behaviors. The use of autonomy-supportive behaviors seems of the utmost importance, as the understanding of the college student internal frame of reference, in which students perceive a sense of volitional choice, should be provided. In this sense, teachers are encouraged to provide rationale for a requested task, encourage students’ initiation towards a given activity, and express student ownership when they have self-initiation. The results of this study could help to illuminate the directional orientations between interpersonal behaviors and prosocial interactions. All in all, when college students experience need-supportive behaviors from teachers, their needs are satisfied, and they experience a form of motivation that is more autonomous, consequently leading to positive outcomes, as demonstrated in the current study.

4.1. Cross-Cultural Analysis

The second aim of the present study was to explore the invariance of the model in samples of college students from different Western countries who shared similar languages (i.e., Spanish and Portuguese). Specifically, this study intended to examine if the proposed model would maintain equivalence across Spain, Portugal, Brazil, Chile, and Mexico. Measurement experts [50] have maintained that multigroup analysis is at the heart of the process of generalization. Overall, evidence has emerged for the invariance of the proposed model across the diverse countries that have been examined. Present results showed that the model had the same theoretical structure for each study group, similar to the existing literature [40].
Current results show that college students speaking different languages did not differ in the level of motivational constructs and group cohesion. This makes sense given the assumptions proposed by Ryan and Deci [1]. Specifically, these results are aligned with the SDT framework in the sense that the theory argues the universal meaning of the three psychological needs regarding their robust effects on the adaptive development and positive functioning of people regardless of the cultural context [1,5]. In this regard, this study considering samples from Spanish and Portuguese-speaking countries indicates that culture may not be more important than the motivational constructs underlying the motivational framework of SDT. Previous research has corroborated with this argument in countries such as the United States, Australia, and Belgium to Mexico, Peru, Malaysia, China, and the Philippines [51,52], agreeing in the case of Mexico with the data of the present study. Regarding the rest of the countries considered in this study, there are no previous works in this line. The fact that the model displayed equivalence across cultures provides strong support of the generalizability of the motivational constructs that are related to previous SDT research.
It is worth mentioning that, regarding the motivational orientations among students, findings of previous research carried out with Western countries [22,52] do not seem to be conclusive, findings only in some cases invariant among samples [23,53]. Therefore, this work could be considered a preliminary study in the analysis of intercultural differences in the motivational processes of Latin American and Iberian students. More work is needed in this sense in order to increase the knowledge on the possible differences in the understanding of the measurement variables used, as well as other variables that may explain the current findings. The main finding of this work was to provide support for an empirical model based on SDT in which the motivational style of autonomy support perceived by college students catalyzes the perceived group cohesion through the satisfaction of basic psychological needs and intrinsic motivations, being equivalent among five countries native to Spanish and Portuguese-speaking cultures.

4.2. Strengths, Limitations, and Avenues for Future Research

Strengths of the current study are the adoption of the SDT framework, an appropriate model that provides a clear set of associations on the motivational determinants across five countries, the use of robust, previously validated measures for Spanish and Portuguese native speakers, and the adoption of robust statistical analyses to account for possible variability across countries. Although the current study investigated students with diverse cultural backgrounds, there are some limitations that should be acknowledged. First, the sample consisted of college students. It would be especially interesting to investigate less-educated (e.g., high school and middle school students) students on how they perceive autonomy-supportive environments and how they are related to group cohesion and compare the results with the current findings. Second, the samples were from Spanish and Portuguese native-speaking countries, preventing the generalization of other cultures. Given the interindividual variability in cultural backgrounds [54], future research should explore and analyze the current model in different cultures and populations (e.g., Western and Eastern nationalities). Third, the methodological limitation was that all reported measures were cross-sectional in nature, preventing us from drawing any causal conclusions. Thus, future studies could implement an experimental design involving observational measures where teachers could also express their perceptions of their behaviors. Again, longitudinal manipulations are paramount for measuring inferences. Last, since no hypotheses were proposed considering sociodemographic (e.g., gender and age) and academic course (i.e., type of specialization) variables, more studies are paramount for examining the possible variabilities across moderators.

5. Conclusions

The current study contributed to the cross-cultural understanding of a teaching motivational style, finding that autonomy-supportive behaviors contribute to needs satisfaction, intrinsic motivation, and group cohesion in college students from five countries, supporting the previous literature [23,55,56]. Specifically, these results support the strength of the SDT assumptions regarding their intercultural relevance in Spanish and Portuguese native-speaking countries, which encourages further knowledge in subsequent works regarding intercultural variability. The SDT was applied to outline how student perceptions of need-supportive behaviors endorsed by teachers are associated with needs fulfillment, intrinsic motivation, and, ultimately, group cohesion. Furthermore, these relations were equal by cultural differences, displaying how strongly students from different cultural backgrounds value autonomy-supportive behaviors endorsed by teachers. The present findings suggest that the motivational style students perceive from teachers is essential for optimal functioning and adaptive outcomes across college students from all cultural backgrounds.
The present results confirm the overall positive associations between SDT motivational constructs and group cohesion that have been demonstrated in the previous literature. Consequently, manipulating group processes by teacher-induced team-building activities could be a promising avenue for the promotion of continuous group cohesion among college students. The acknowledgement of group dynamics by teachers seems to be a paramount prerequisite when implementing school-based activities in college students. These assumptions seem to fit in Spanish and Portuguese native-speaking students, since the proposed model was equivalent among the countries. Thus, by analyzing group processes that have been developed by students over a period of time, one could propose adaptive outcomes such as greater academic grades [47] and more engagement in leisure-time physical activities [57]. More research is warranted to examine this hypothesis and relate it to the general classroom setting.

Author Contributions

Conceptualization, J.A.M.-M. and E.H.H.; methodology, L.C., D.M., and F.R.; formal analysis, J.A.M.-M., E.H.H., and D.T.; investigation, J.A.M.-M., J.M.L.-W., A.V.-T., J.T., G.G.-C., and J.C.G.D.; data curation, J.L.S.P., I.R., R.V.V., A.A.A.F., A.V.-V., J.F., R.J.N.J., M.R.C., D.M.d.S., and C.A.d.S.S.; writing—original draft preparation, E.H.H. and F.R.; writing—review and editing, A.V.-V., D.T., R.J.N.J., D.M.d.S., C.A.d.S.S., and G.F.; supervision, J.A.M.-M.; and project administration, J.A.M.-M. All authors have read and agreed to the published version of the manuscript.

Funding

L.C. and D.M. were supported by national funds through the Portuguese Foundation for Science and Technology, I.P., under the project UID04045/2020. F.R. was supported by the national funds through the Portuguese Foundation for Science and Technology, I.P., under the project UID/04748/2020.

Acknowledgments

The authors wish to express their gratitude to the universities who granted approval for the data collection.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Ryan, R.M.; Deci, E.L. Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness; Guilford Press: New York, NY, USA, 2017. [Google Scholar]
  2. Reeve, J. Autonomy-Supportive Teaching: What it is, How to do it. In Motivation in Educational Research: Translating Theory into Classroom Practice; Wang, J.C.K., Liu, W.C., Ryan, R.M., Eds.; Springer: New York, NY, USA, 2016; pp. 77–89. [Google Scholar]
  3. Bartholomew, K.J.; Ntoumanis, N.; Mouratidis, A.; Katartzi, E.; Thøgersen-Ntoumani, C.; Vlachopoulos, S. Beware of your teaching style: A school-year long investigation of controlling teaching and student motivational experiences. Learn. Instr. 2018, 53, 50–63. [Google Scholar] [CrossRef] [Green Version]
  4. Jang, H.; Kim, E.J.; Reeve, J. Why students become more engaged or more disengaged during the semester: A self-determination theory dual-process model. Learn. Instr. 2016, 43, 27–38. [Google Scholar] [CrossRef]
  5. Deci, E.L.; Ryan, R.M. The «what» and «why» of goal pursuits: Human needs and the self-determination of behaviour. Psychol. Inq. 2000, 11, 227–268. [Google Scholar] [CrossRef]
  6. Amoura, C.; Berjot, S.; Gillet, N.; Caruana, S.; Cohen, J.; Finez, L. Autonomy-supportive and controlling styles of teaching. Swiss J. Psychol. 2015, 74, 141–158. [Google Scholar] [CrossRef]
  7. Aelterman, N.; Vansteenkiste, M.; Haerens, L. Correlates of students’ internalization and defiance of classroom rules: A self-determination theory perspective. Br. J. Educ. Psychol. 2019, 89, 22–40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Behzadnia, B.; Adachi, P.J.C.; Deci, E.L.; Mohammadzadeh, H. Associations between students’ perceptions of physical education teachers’ interpersonal styles and students’ wellness, knowledge, performance, and intentions to persist at physical activity: A self-determination theory approach. Psychol. Sport Exerc. 2018, 39, 10–19. [Google Scholar] [CrossRef]
  9. Haerens, L.; Aelterman, N.; Vansteenkiste, M.; Soenens, B.; Van Petegem, S. Do perceived autonomy-supportive and controlling teaching relate to physical education students’ motivational experiences through unique pathways? Distinguishing between the bright and dark side of motivation. Psychol. Sport Exerc. 2015, 16, 26–36. [Google Scholar] [CrossRef]
  10. Haerens, L.; Vansteenkiste, M.; De Meester, A.; Delrue, J.; Tallir, I.; Vande Broek, G.; Aelterman, N. Different combinations of perceived autonomy support and control: Identifying the most optimal motivating style. Phys. Educ. Sport Pedagog. 2017, 23, 1–21. [Google Scholar] [CrossRef]
  11. Tilga, H.; Hein, V.; Koka, A.; Hamilton, K.; Hagger, M.S. The role of teachers’ controlling behaviour in physical education on adolescents’ health- related quality of life: Test of a conditional process model. Educ. Psychol. 2019, 39, 1–19. [Google Scholar] [CrossRef]
  12. Balaguer, I.; Castillo, I.; Ródenas, L.; Fabra, P.; Duda, J.L. Los entrenadores como promotores de la cohesión del equipo. Cuad. De Psicol. Del Deporte 2015, 15, 233–242. [Google Scholar] [CrossRef] [Green Version]
  13. Thornton, C.; Miller, P.; Perry, K. The impact of group cohesion on key success measures in higher education. J. Further Higher Educ. 2020, 44, 542–553. [Google Scholar] [CrossRef]
  14. Bollen, K.A.; Hoyle, R.H. Perceived cohesion: A conceptual and empirical examination. Soc. Forces 1990, 69, 479–504. [Google Scholar] [CrossRef]
  15. Xie, K.; Hensley, L.C.; Law, V.; Sun, Z. Self-regulation as a function of perceived leadership and cohesion in small group online collaborative learning. Br. J. Educ. Technol. 2019, 50, 456–468. [Google Scholar] [CrossRef] [Green Version]
  16. Carron, A.V.; Brawley, L.R.; Widmeyer, W.N. The Measurement of Cohesiveness in Sport Groups. In Advances in Sport and Exercise Psychology Measurement; Duda, J.L., Ed.; Fitness Information Technology: Morgantown, WV, USA, 1998; pp. 213–226. [Google Scholar]
  17. Cheon, S.H.; Reeve, J.; Lee, Y.; Lee, J. Why autonomy-supportive interventions work: Explaining the professional development of teachers’ motivating style. Teach. Teach. Educ. 2018, 69, 43–51. [Google Scholar] [CrossRef]
  18. Cheon, S.H.; Reeve, J.; Ntoumanis, N. A needs-supportive intervention to help PE teachers enhance students’ prosocial behavior and diminish antisocial behavior. Psychol. Sport Exerc. 2018, 35, 74–88. [Google Scholar] [CrossRef] [Green Version]
  19. Blanchard, C.M.; Amiot, C.E.; Perreault, S.; Vallerand, R.J.; Provencher, P. Cohesiveness, coach’s interpersonal style and psychological needs: Their effects on self-determination and athletes’ subjective well-being. Psychol. Sport Exerc. 2009, 10, 545–551. [Google Scholar] [CrossRef]
  20. Chirkov, V.I.; Ryan, R.M.; Kim, Y.; Kaplan, U. Differentiating autonomy from individualism and independence: A self-determination theory perspective on internalization of cultural orientations and well-being. J. Personal. Soc. Psychol. 2003, 84, 97–109. [Google Scholar] [CrossRef]
  21. Chirkov, V.I.; Ryan, R.M.; Willness, C. Cultural context and psychological needs in Canada and Brazil: Testing a self-determination approach to the internalization of cultural practices, identity, and well-being. J. Cross-Cult. Psychol. 2005, 36, 423–443. [Google Scholar] [CrossRef]
  22. King, R.B.; McInerney, D.M.; Pitliya, R.J. Envisioning a culturally imaginative educational psychology. Educ. Psychol. Rev. 2018, 30, 1031–1065. [Google Scholar] [CrossRef]
  23. Nalipay, M.J.; King, N.; Cai, Y. Autonomy is equally important across East and West: Testing the cross-cultural universality of self-determination Theory. J. Adolesc. 2020, 68, 67–72. [Google Scholar] [CrossRef]
  24. Zusho, A.; Clayton, K. Culturalizing achievement goal theory and research. Educ. Psychol. 2011, 46, 239–260. [Google Scholar] [CrossRef]
  25. Reeve, J.; Vansteenkiste, M.; Assor, A.; Ahmad, I.; Cheon, S.H.; Jang, H.; Kaplan, H.; Moss, J.D.; Olaussen, B.S.; Wang, C.K.J. The beliefs that underlie autonomy-supportive and controlling teaching: A multinational investigation. Motiv. Emot. 2014, 38, 93–110. [Google Scholar] [CrossRef]
  26. Ryan, R. Psychological Needs and the Facilitation of Integrative Processes. J. Personal. 1995, 63, 397–427. [Google Scholar] [CrossRef] [PubMed]
  27. Comunidad Iberoamericana de Naciones (CIN). 2006. Available online: https://www.oei.es/historico/xvicumbr (accessed on 13 May 2020).
  28. Aknin, L.B.; Barrington-Leigh, C.P.; Dunn, E.W.; Helliwell, J.F.; Burns, J.; Biswas-Diener, R.; Kemza, I.; Nyende, P.; Ashton-James, C.E. Prosocial spending and well-being: Cross-cultural evidence for a psychological universal. J. Pers. Soc. Psychol 2013, 104, 635–652. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Aknin, L.B.; Broesch, T.; Hamlin, J.K.; Van de Vondervoort, J.W. Prosocial behavior leads to happiness in a small-scale rural society. J. Exp. Psychol. 2015, 144, 788–795. [Google Scholar] [CrossRef] [PubMed]
  30. Moreno-Murcia, J.A.; Huescar, E.; Fabra, J.A.A.; Sánchez-Latorre, F. Adaptation and validation of autonomy support and controller style’s scales in physical education: Relationship with feedback. Revista Ciencias de la Actividad Física, UCM. (in press).
  31. Moutao, J.; Cid, L.; Leitao, J.C.; Alves, J. Tradução e validação do Perceived Autonomy Support: Exercise Climate Questionnaire numa amostra de praticantes de exercício portugueses. Psicol. Reflex. E Crítica 2012, 25, 701–708. [Google Scholar] [CrossRef] [Green Version]
  32. Moreno-Murcia, J.A.; Marzo, J.C.; Martínez, C.; Conte, L. Validación de la Escala de “Satisfacción de las Necesidades Psicológicas Básicas” y del Cuestionario de la “Regulación Conductual en el Deporte” al contexto español. Rev. Int. De Cienc. Del Deporte 2011, 26, 355–369. [Google Scholar] [CrossRef]
  33. Moutão, J.M.R.P.; Serra, L.F.C.; Alves, J.A.M.; Leitão, J.C.; Vlachopoulos, S.P. Validation of the basic psychological needs in exercise scale in a Portuguese sample. Span. J. Psychol. 2012, 15, 399–409. [Google Scholar]
  34. Cid, L.; Rodrigues, F.; Teixeira, D.S.; Alves, J.; Machado, S.; Murillo-Rodriguez, E.; Monteiro, D. Exploração de um modelo de segunda ordem da Versão Portuguesa da Basic Psychological Needs in Exercise Scale (BPNESp): Validade do constructo e invariância. Cuad. De Psicol. Del Deporte 2020, 20, 95–111. [Google Scholar] [CrossRef]
  35. Monteiro, D.; Moutão, J.M.; Cid, L. Validation of the Behavioral Regulation Sport Questionnaire in Portuguese athletes. Rev. De Psicol. Del Deporte 2018, 27, 145–150. [Google Scholar]
  36. Chin, W.W.; Salisbury, W.D.; Pearson, A.W.; Stollak, M.J. Perceived Cohesion in Small Groups: Adapting and Testing the Perceived Cohesion Scale in a Small Group Setting. Small Group Res. 1999, 30, 751–766. [Google Scholar] [CrossRef]
  37. Gravetter, F.; Wallnau, L. Essentials of Statistics for the Behavioral Sciences, 8th ed; Cengage Learning Wadsworth: Belmont, CA, USA, 2014. [Google Scholar]
  38. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis, 8th ed.; Cengage: Boston, MA, USA, 2019. [Google Scholar]
  39. DiStefano, C.; Liu, J.; Jang, N.; Shi, D. Examination of the weighted root mean square residual: Evidence for trusworthiness? Struct. Equ. Model. A Multidiscip. J. 2018, 25, 453–466. [Google Scholar] [CrossRef]
  40. Byrne, B.M. Structural Equation Modeling with AMOS: Basic Concepts, Applications and Programming, 3rd ed.; Routledge: Abingdon, UK, 2016. [Google Scholar]
  41. Marsh, H.; Hau, K.; Wen, Z. In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Struct. Equ. Model. 2004, 11, 320–341. [Google Scholar] [CrossRef]
  42. Williams, J.; MacKinnon, D.P. Resampling and distribution of the product methods for testing indirect effects in complex models. Struct. Equ. Model. 2008, 15, 23–51. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Morin, A.; Arens, A.; Marsh, H.A. Bifactor Exploratory Structural Equation Modeling Framework for the Identification of Distinct Sources of Construct-Relevant Psychometric Multidimensionality. Struct. Equ. Model. A Multidiscip. J. 2015, 23, 116–139. [Google Scholar] [CrossRef]
  44. Cheung, G.W.; Rensvold, R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 2002, 9, 233–255. [Google Scholar] [CrossRef]
  45. Muthén, L.K.; Muthén, B.O. Mplus User’s Guide, 6th ed.; Muthén & Muthén: Los Ángeles, CA, USA, 2010. [Google Scholar]
  46. Cheon, S.H.; Reeve, J.; Song, Y.-G. A teacher-focused intervention to decrease PE students’ amotivation by increasing need satisfaction and decreasing need frustration. J. Sport Exerc. Psychol. 2016, 38, 217–235. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Huéscar, E.; Moreno-Murcia, J.A.; Cid, L.; Monteiro, D.; Rodrigues, F. Passion or perseverance? The effect of perceived autonomy support and grit on academic performance in college students. Int. J. Environ. Res. Public Health 2020, 17, 2143. [Google Scholar] [CrossRef] [Green Version]
  48. Hendrickx, M.M.H.G.; Mainhard, T.; Oudman, S.; Boor-Klip, H.J.; Brekelmans, M. Teacher behavior and peer liking and disliking: The teacher as a social referent for peer status. J. Educ. Psychol. 2017, 109, 546–558. [Google Scholar] [CrossRef]
  49. Caprara, G.; Barbaranelli, C.; Pastorelli, C.; Bandura, A.; Zimbardo, P. Prosocial foundations of children’s academic achievement. Psychol. Sci. 2000, 11, 302–306. [Google Scholar] [CrossRef] [PubMed]
  50. Hair, J.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis 574, 8th ed.; Pearson Education: London, UK, 2019. [Google Scholar]
  51. Church, A.T.; Katigbak, M.S.; Locke, K.D.; Zhang, H.; Shen, J.; de Jesús Vargas-Flores, J.; Ibáñez-Reyes, J.; Tanaka-Matsumi, J.; Curtis, G.J.; Cabrera, H.F.; et al. Need satisfaction and well-being: Testing self-determination theory in eight cultures. J. Cross Cult. Psychol. 2013, 44, 507–534. [Google Scholar] [CrossRef]
  52. Chen, B.; Vansteenkiste, M.; Beyers, W.; Boone, L.; Deci, E.L.; Deeder, J.; Duriez, B.; Lens, W.; Matos, L.; Mouratidis, A.; et al. Basic psychological need satisfaction, need frustration, and need strength across four cultures. Motiv. Emot. 2015, 39, 216–236. [Google Scholar] [CrossRef]
  53. Viladrich, C.; Appleton, P.R.; Quested, E.; Duda, J.L.; Alcaraz, S.; Heuzé, J.-P.; Fabra, P.; Samdal, O.; Ommundsen, Y.; Hill, A.P.; et al. Measurement invariance of the Behavioural Regulation in Sport Questionnaire when completed by young athletes across five European countries. Int. J. Sport Exerc. Psychol. 2013, 11, 384–394. [Google Scholar] [CrossRef]
  54. Franco, A.E.; Coterón, L.J.; Martínez, A. Invarianza cultural del Cuestionario de la Orientación a la Tarea y al Ego (TEOSQ) y diferencias en las orientaciones motivacionales entre adolescentes de España, Argentina, Colombia y Ecuador. Divers. Perspect. En Psicol. 2019, 15, 49–58. [Google Scholar] [CrossRef]
  55. Hofstede, G. The cultural relativity of organizational practices and theories. J. Int. Bus. Stud. 1983, 14, 75–89. [Google Scholar] [CrossRef] [Green Version]
  56. Cheon, S.H.; Reeve, J.; Ntoumanis, N. An intervention to help teachers establish a prosocial peer climate in physical education. Learn. Instr. 2019, 64, 101223. [Google Scholar] [CrossRef]
  57. Cid, L.; Pires, A.; Chicau, C.; Mendes, P.; Teixeira, D.; Moutão, J.M.; Monteiro, D. Motivational determinants of physical education grades and the intention to practice sport in the future. PLoS ONE 2019, 14. [Google Scholar] [CrossRef]
Table 1. Sample characteristics.
Table 1. Sample characteristics.
CountriesNFMIN–MAXM ± SD
Spanish60245618–4822.39 ± 1.24
Portuguese46933518–6321.82 ± 3.90
Mexican117778418–5820.81 ± 3.17
Chileans37226018–3421.33 ± 2.24
Brazilian41321618–5422.03 ± 3.97
Note: N = sample size, F = female, MIN–MAX = age range, and M ± SD = age mean and standard deviation.
Table 2. Descriptive statistics, composite reliability, and correlations.
Table 2. Descriptive statistics, composite reliability, and correlations.
FactorsMSDSKCR1234
1. PAS3.940.81−1.352.090.911
2. BPNS4.070.68−1.162.730.700.50 **1
3. IM5.741.12−1.001.020.830.18 **0.27 **1
4. GC5.491.40−1.080.890.950.27 **0.47 **0.34 **1
Note: PAS = perceived autonomy support, BPNS = basic psychological need satisfaction, IM = intrinsic motivation, GC = group cohesion, M = mean, SD = standard deviation, S = skewness; K = kurtosis, and CR = composite reliability; ** p ≤ 0.01.
Table 3. Model fit indexes.
Table 3. Model fit indexes.
ModelWLSMVχ2dfCFITLIRMSEA (90% CI)
Total5183.550 *2960.9680.9650.074 [0.072, 0.076]
Spanish1093.928 *2960.9760.9740.067 [0.063, 0.071]
Portuguese1167.984 *2960.9550.9510.079 [0.075, 0.084]
Mexican2494.885 *2960.9690.9660.079 [0.077, 0.082]
Chileans831.890 *2960.9790.9770.070 [0.064, 0.075]
Brazilian1305.062 *2960.9700.9670.091 [0.086, 0.096]
Note: WLSMVχ2 = Weighted Least Square Mean and Variance Adjusted Chi-Square Test, df = degrees of freedom, CFI = Comparative Fit Index, TLI = Tucker-Lewis Index, RMSEA = Root Mean Squared Error of Approximation, and 90% CI = 90% confidence interval of RSMEA; * p < 0.001.
Table 4. Direct and indirect effects in all samples.
Table 4. Direct and indirect effects in all samples.
PathTotalSpanishPortugueseMexicanChileansBrazilian
βCI 95%βCI 95%βCI 95%βCI 95%βCI 95%βCI 95%
LowUp LowUp LowUp LowUp LowUp LowUp
Direct Effects
PAS → BPNS0.570.530.610.540.440.630.650.560.660.610.560.670.670.570.770.560.470.68
BPNS → IM0.670.630.720.750.660.840.890.800.970.640.560.710.530.400.650.770.670.87
IM → GC0.640.610.680.610.540.690.560.460.740.710.660.760.700.610.780.550.450.65
Indirect Effects
PAS → GC0.250.220.280.250.180.320.320.240.410.280.220.330.250.160.330.240.170.32
PAS → IM0.390.340.430.400.310.500.570.480.670.390.330.450.350.240.460.440.340.55
BPNS → GC0.430.390.470.460.380.520.500.400.590.450.390.510.370.260.480.430.340.51
Note: Low = lower, Up = upper, PAS = perceived autonomy support; BPNS = Basic Psychological Needs Satisfaction; IM = Intrinsic Motivation; GC = Group Cohesion; β = standardized coefficient; CI 95% = Confidence Interval at 95%.
Table 5. Multigroup analysis of the structural model across all countries.
Table 5. Multigroup analysis of the structural model across all countries.
ModelWLSMVχ2∆χ2df∆dfCFI∆CFITLI∆TLIRMSEA∆RMSEA
Configural Invariance9355.805 *-2021-0.961-0.969-0.077-
Weak Factorial Invariance9947.596 *591.7912047260.9580.0030.9670.0020.0800.003
Strong Invariance10,008.286 *652.4812068470.9580.0030.9670.0020.0800.003
Strict Factorial Invariance9526.751 *170.9462064430.9600.0010.9690.0000.0770.000
Note: WLSMVχ2 = Weighted Least Square Mean and Variance Adjusted Chi-Square, ∆χ2 = difference in χ2, df = degrees of freedom, ∆df = differences in df, CFI = comparative fit index, ∆CFI = differences in CFI, RMSEA = Root Mean Squared Error of Approximation, and ∆RMSEA = differences in RMSEA; * p < 0.001.

Share and Cite

MDPI and ACS Style

Moreno-Murcia, J.A.; Huéscar Hernández, E.; Cid, L.; Monteiro, D.; Rodrigues, F.; Teixeira, D.; M. López-Walle, J.; Vergara-Torres, A.; Tristan, J.; Gastélum-Cuadras, G.; et al. Assessing the Relationship between Autonomy Support and Student Group Cohesion across Ibero-American Countries. Int. J. Environ. Res. Public Health 2020, 17, 3981. https://doi.org/10.3390/ijerph17113981

AMA Style

Moreno-Murcia JA, Huéscar Hernández E, Cid L, Monteiro D, Rodrigues F, Teixeira D, M. López-Walle J, Vergara-Torres A, Tristan J, Gastélum-Cuadras G, et al. Assessing the Relationship between Autonomy Support and Student Group Cohesion across Ibero-American Countries. International Journal of Environmental Research and Public Health. 2020; 17(11):3981. https://doi.org/10.3390/ijerph17113981

Chicago/Turabian Style

Moreno-Murcia, Juan Antonio, Elisa Huéscar Hernández, Luís Cid, Diogo Monteiro, Filipe Rodrigues, Diogo Teixeira, Jeanette M. López-Walle, Argenis Vergara-Torres, José Tristan, Gabriel Gastélum-Cuadras, and et al. 2020. "Assessing the Relationship between Autonomy Support and Student Group Cohesion across Ibero-American Countries" International Journal of Environmental Research and Public Health 17, no. 11: 3981. https://doi.org/10.3390/ijerph17113981

APA Style

Moreno-Murcia, J. A., Huéscar Hernández, E., Cid, L., Monteiro, D., Rodrigues, F., Teixeira, D., M. López-Walle, J., Vergara-Torres, A., Tristan, J., Gastélum-Cuadras, G., Guedea Delgado, J. C., Soto Peña, J. L., Rentería, I., Vargas Vitoria, R., Almonacid Fierro, A. A., Valero-Valenzuela, A., Flandez, J., Nodari Júnior, R. J., Fin, G., ... de Souza Santos, C. A. (2020). Assessing the Relationship between Autonomy Support and Student Group Cohesion across Ibero-American Countries. International Journal of Environmental Research and Public Health, 17(11), 3981. https://doi.org/10.3390/ijerph17113981

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop