Next Article in Journal
Associations between Physical Activity and Comorbidities in People with COPD Residing in Spain: A Cross-Sectional Analysis
Next Article in Special Issue
Maturity Related Differences in Body Composition Assessed by Classic and Specific Bioimpedance Vector Analysis among Male Elite Youth Soccer Players
Previous Article in Journal
Asbestos-Related Lung Cancer: A Hospital-Based Case-Control Study in Indonesia
Previous Article in Special Issue
The Effect of Respiratory Muscle Training on the Pulmonary Function, Lung Ventilation, and Endurance Performance of Young Soccer Players
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effects of Motivational Climate on Fear of Failure and Anxiety in Teen Handball Players

by
Manuel Gómez-López
1,2,
Carla Chicau Borrego
3,
Carlos Marques da Silva
3,
Antonio Granero-Gallegos
4,5,* and
Juan González-Hernández
6
1
Department of Physical Activity and Sport, Faculty of Sport Sciences, University of Murcia, Santiago de la Ribera, 30720 Murcia, Spain
2
Campus of International Excellence “Mare Nostrum”, University of Murcia, 30720 Murcia, Spain
3
Sport Sciences School of Rio Maior, Polytechnic Institute of Santarém, Research Center in Life Quality (CIEQV), 2040-413 Rio Maior, Portugal
4
Department of Education, Faculty of Education Sciences, University of Almeria, 04120 Almeria, Spain
5
Health Research Center, University of Almeria, 04120 Almeria, Spain
6
Department of Personality, Evaluation and Psychological Treatment, University of Granada, 18071 Granada, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(2), 592; https://doi.org/10.3390/ijerph17020592
Submission received: 26 December 2019 / Revised: 11 January 2020 / Accepted: 11 January 2020 / Published: 16 January 2020

Abstract

:
The aim of this study was to examine the effects of the motivational climate created by the coach and perceived by a group of young, high-performance handball players on their fear of failure and precompetitive anxiety. The study participants were 479 young handball players. The age range was 16–17 years old. Players were administered a battery composed of a Perceived Motivational Climate in Sport Questionnaire, a Performance Failure Appraisal Inventory, and Competitive State Anxiety Inventory-2R, to measure the aforementioned theoretical constructs. Using structural equation modelling (SEM), the results showed that the handball players experienced high levels task-involving climate and moderate values of self-confidence. In contrast, players experienced lower levels of ego-involving climate, fear of failure, and cognitive and somatic anxiety. The obtained model shows that fear of failure positively mediates the association between an ego-involving climate with both cognitive and somatic anxiety, and negatively in terms of self-confidence. In contrast, fear of failure does not mediate the associations between a task-involving climate and both somatic and cognitive anxiety and self-confidence.

1. Introduction

In sport, physical and psychological factors that affect the athlete’s performance. While motivational factors play an important protector role in the long-term effects of regular sport practice on the psychosocial development of the athlete, the emotional responses provoked by anxiety can affect athletic performance [1], and a state of permanent anxiety can even become a determining factor in the relative or total abandonment of sports practice [2]. Anxiety is a psychological response produced as a consequence of differences between the self-assessment of a person’s ability to respond to a specific situation (e.g., challenge, action) and that person’s actual ability to respond [3]. Understood as a neurotic personality feature [4], anxiety is associated with the tendency to show poor emotional adjustment in the form of high levels of reactivity and emotional sensitivity (e.g., fear, worry or anger) [5]. Despite this, anxiety also exerts a self-regulatory influence against low levels of coping or motivation [6], which can set up adaptive effects which are suitable for short-term performance improvements [7].
In a context of skill and achievement, in which athletes try to reach a goal and in which proving competence and ability is important [8], Roberts and Treasure [9] claim that physical and psychological well-being depends on the contexts where sports practice is carried out. More specifically, in the case of a team sport, such as handball, and at the height of adolescence, peers and coaches are the main social agents in a team [10,11] in terms of the motivational climate perceived during training [12,13,14,15,16]. As result of that self-evaluation cognitive process, and mediated for other psychological skills (e.g., perceived control or coping resources), it is not the perceived situations that directly cause the anxiety response, but certain situations of pressure or potential conflict that become stressful when they are assessed as threatening [17].
According to achievement goal theory [18,19], this motivational climate refers to the set of signals generated by family, friends or colleagues, a coach, etc., which are perceived by athletes in their environment, and through which the key factors for success and failure are identified. That is, it depends on how the context is subjectively interpreted in terms of the present criteria of success or failure. Thus, according to achievement goal theory [19], either an ego-involving or a task-involving motivational climate will be created according to how the athletes perceive the context [20,21]. In this regard, if victory and showing good skills and performance are the most important aspects for the people in the players’ environment, they will create an ego-involving climate, while if they see effort, personal improvement and skills development as central aspects, they will create a task-involving climate. One of the triggers of avoidance behaviors and fear of failure is the motivational climate created during adolescents’ socialization processes. An athlete’s ability to manage and control this situation depends on many factors, and poor management of it can lead to errors or mistakes [22].
Even when sports are one of the most suitable contexts for achievement, as athletes are motivated to succeed showing their competence and skills [19,23], different authors claim that it is also a medium that can reflect athletes’ incompetence in front of their peers [24]. This is related to the fact that many athletes experience fear of failure in highly competitive environments (e.g. national or regional tournaments), when their performance is judged by others (e.g., referees, coaches, parents, peers, or spectators) on the basis of success criteria [25]. This motivational climate of ego involvement emphasizes public recognition based on social comparison through success, and considers error as something to be avoided [3]. Thus, the practice of sports can generate a sensation of fear of failure and feelings of shame, which, in turn, create insecurity, anxiety, and stress in athletes, as well as avoidance behaviors in relation to what people may say or think about them, especially during the course of a game, which results in impaired performance [26].
Fear of failure is conceptualized as the motive to avoid failure in evaluative achievement situations, associated with anticipatory shame [27]. Conroy, Poczwardowski, and Henschen [28], and Conroy, Willow and Mezler [29] define fear of failure as a stable tendency to anticipate shame and humiliation after failure. In the context of sport, Conroy [30] and Conroy et al. [29] developed a multidimensional, hierarchical model of fear of failure based upon the cognitive-motivational-relational theory of emotion [31].
Different studies have shown that there is a positive relationship between the perception of a coach-initiated ego involvement motivational climate and the fear of failure [15,16,22,32,33]. Fear of failure triggers an assessment of the negative consequences (e.g., ridicule, shame, or stage fright) on the player’s well-being of those potential emotions that players may feel after not performing a task correctly in front of their peers, coaches, or teachers [25,29,30]. Gustafsson, Sagar, and Stenling [34] recently showed that the fear of feeling shame is associated with high levels of psychological stress, which would have an impact on fear of failure. Youngsters with a high level of competitive anxiety worry more than their peers who have low levels of anxiety about making mistakes, not playing well, or losing. Within the context of sport, athletes with higher anxiety are also more concerned about the evaluation of their coaches, peers, and parents, and have strong expectations that failure will lead to criticism from them [35,36,37,38]. Some elite athletes may be reluctant to reveal their fear of failure as they associate that fear with weakness of character and lack of success and confidence [25]. Fear of failure, therefore, affects the well-being, interpersonal behavior and sporting performance of athletes [39].
Because the coach is the highest authority on the team, his/her decisions and an agonizing (or highly competitive) motivational climate are more likely to induce anxiety in young participants, probably experienced when the focus (personal or situational) is on the player’s skill level and public recognition of his/her achievements [3,19], and his/her emotional and cognitive self-assessments are focused on the potential punishment for making mistakes [40]. The literature has shown that athletes’ perceptions of an ego-centered climate are positively correlated with competitive anxiety [41,42]. According to West, Rhoden, et al. [43], neuroticism has a strong positive relationship with amotivation, and it also deepens in the influence of the extroversion factor in athletes’ motivational processes. Athletes who perceive a high level ego-centered motivational climate had the highest levels of cognitive anxiety, especially in the form of worry [44,45,46]. While somatic anxiety can affect the motor component of sports behavior, cognitive anxiety can have a greater impact on athletes’ attention spans, concentration, and decision making abilities [47]. This cognitive component has two levels: the first refers to concerns about the potentially negative consequences associated with performance; and the second, deconcentration, describes difficulties in focusing on the key aspects of the competitive task [48]. Finally, in order to stand out, these sportsmen tend to be more prone to responding to errors and unsatisfactory performance with punitive responses [49].
Another important aspect is that players who perceive a coach task-involving climate in their training see defeat as a learning factor, and believe that success is achieved with effort, as opposed to those who were subject to an ego climate, for whom ability and tricks are the main tools by which to succeed in sports [1,21]. Furthermore, coaches who promote a task-involving climate see mistakes as part of players’ learning processes, a stance that is transmitted to their players, who thus feel lower levels of fear of failure, as recently shown by Gómez-López, Ruiz-Sánchez, and Granero-Gallegos [15] in a study with handball players. On the other hand, the literature has shown that athletes’ perceptions of a master’s climate are associated with low levels of anxiety [41,46,50,51].
In the present study, the motivational climate generated by the coach was selected, as he/she represents the hierarchical figure of reference in the sporting context [52]. In addition, as the leader of the sports group, the coach plays a prominent role in the process of sport socialization due to his/her ability to judge and provide rewards or punishment to athletes [53]. This is very evident in athletes aged 16 to 17 years, who see the coach as a model that helps them to develop their autonomy, competence, commitment, and relationship through their behavior and instructions. [2,54]. The selection of the sample age study was motivated by the crucial role played by the coach at this stage of development.
The aim of this study is to analyze how a motivational climate generated by the coach affects the fear of failure and the precompetitive anxiety perceived by handball players in regional teams. Specifically, we hypothesize that players’ perceptions of mastery-involving climate will be positively related to self-confidence, while perceptions of an ego-involving climate will be positively related to fear of failure and precompetitive anxiety.
Therefore, the present study, by examining the relationship between perceived motivational climate, fear of failure, and anxiety in sport, will broaden the knowledge base on motivational climate and fear of failure as a background to anxiety in competitive situations, and will empirically recognize the coach-initiated motivational climate and fear of failure as a predictor of anxiety in sport.

2. Materials and Methods

2.1. Participants

Four hundred and seventy-nine youth handball players (250 boys and 229 girls), who were selected to compete in the Spanish Regional Championships, participated in the study. Since they are the best players of their regions, they belong to the regional handball team, and most of them have participated in more than two Spanish handball championships. These players were rated as “high-performance players” by the Spanish Sports Council according to Royal Decree 971/2007 (July 13, 2007). The age range was 16 (40.1%) and 17 (59.9%) years old (M = 16.60; SD = 0.50.) With regard to the years of experience, 85.4% had more than five years of experience as federated handball players.

2.2. Measurement instruments

Perceived Motivational Climate in Sport Questionnaire (PMCSQ-2) [20,51]. The Spanish version of PMCSQ-2 was used [10,11]. The inventory includes 29 items grouped into two dimensions measuring the ego-involving (competitive) climate (14 items, e.g. “On this team, the coach gives most of his or her attention to the stars.”), and the task-involving (mastery) climate (15 items, e.g. “On this team, the coach emphasizes always trying to do your best”). Each item was headed with the phrase “In my training group or team…”. Answers were collected on a Likert-type scale ranging from “strongly disagree” (1) to “strongly agree” (5). Cronbach´s alpha (α) for the instruments range from α = 0.82 in mastery or task-involving climate, to α = 0.85 in competitive or ego- involving climate.
Performance Failure Appraisal Inventory (PFAI) [29]. The Spanish long version of the PFAI [22] includes 25 items grouped into five dimensions: Fear of Experiencing Shame and Embarrassment (e.g. “When I am failing, it is embarrassing if others are there to see it.”), Fear of Devaluing One’s Self-estimate” (e.g. “When I am failing, it is often because I am not smart enough to perform successfully”), Fear of Having an Uncertain Future (e.g. “When I am failing, I believe that my plans for the future will change”), Fear of Important Others Losing Interest (e.g., “When I am not succeeding, some people are not interested in me anymore.”), and Fear of Upsetting Important Others (e.g. “When I am failing, important others are disappointed.”). All items were headed by the phrase “In my sports practice…”. The answers were collected on a Likert-type scale ranging from “do not believe at all” (1) to “believe 100% of the time” (5). Here, the internal consistency analysis was satisfactory for the different subscales; Fear of Experiencing Shame and Embarrassment, α = 0.85; Fear of Devaluing One’s Self-Esteem α = 0.70; Fear of Having an Uncertain Future, α = 0.83; Fear of Important Others Losing Interest, α = 0.84; Fear of Upsetting Important Others, α = 0.81. Fear of failure, α = 0.74.
Competitive State Anxiety Inventory-2R (CSAI-2R) [55]. This inventory comes from the original CSAI-2 composed of 27 items [56]. This study used the Spanish version of the revised edition which was validated on Spanish athletes [57]. The CSAI-2R is a specific inventory for the sports context, but with a one-dimensional conception of the state of anxiety. The scale is composed of 16 items grouped into three dimensions that measure somatic state anxiety (6 items; e.g., "My heart is racing"), self-confidence (5 items; e.g., "I’m sure of myself"), and cognitive state anxiety (5 items; e.g., "I’m worried that others will be disappointed with my performance"). Each item on the scale had to be suitable to the measure of the player’s feelings just before the competition. The answers were collected on a Likert scale of 4 points ranging from “not at all” (1) to “very much so” (4). The internal consistency analysis was satisfactory for the different subscales; somatic state anxiety, α = 0.78; self-confidence, α = 0.82; cognitive state anxiety, α = 0.75.

2.3. Procedure

The study was carried out during the Championship of Autonomic Selections. The national federation, the regional federations, and the coaches of the different regional teams all granted permission prior to our data collecting after reading a letter explaining the objectives of the study and the way it would be carried out. Prior to the administration of the questionnaires to the participants, and in accordance with the ethical guidelines of the American Psychological Association (APA), they were presented with an informed consent form [15] for ethical compliance and data protection, ensuring the rigor of the investigation and the privacy of the information obtained. The consent obtained from the players and their parents or tutors was both written and informed. A sample of the questionnaire was provided to each participant. Data collection was carried out during the national Championship, at the hotels where the teams were staying during time off, in agreement with the coaches and in the presence of one of the researchers. Each participant had 20–30 minutes to complete the questionnaire, and they were all briefed on the objectives of the study, their rights as participants, the voluntary nature of their participation, and the confidentiality of answers and data management. They were also informed that there were no correct or incorrect answers, and were asked to give true and honest replies. Following data verification, the following variables were recorded: gender, year of birth, years of experience as a handball player, playing position, and the numbers of hours per week dedicated to training, as well as the times it was carried out. The protocol was approved by the Ethics Committee of the Universidad de Murcia (ID: 1494/2017). All subjects gave written informed consent in accordance with the Declaration of Helsinki [58].

2.4. Statistical Analysis

All variables were analyzed for means, standard deviation, and bivariate correlations, and, as suggested by Kline [59], a two-step maximum likelihood (ML) approach was performed in AMOS 23.0 (SPSS Inc., Chicago, IL, USA) In order to analyse the psychometric properties of the purposed model, a confirmatory factor analysis (CFA) was performed. Internal consistency was accessed using Raykov [60] composite reliability with a cut-off value of 0.70 [61,62]. Convergent validity was estimated considering average variance extracted (AVE) higher than 0.5 [61]. Discriminant validity was established when the correlation coefficients were lower than the AVE for each construct exceeding the squared correlations between that construct and any other [63]. A structural equation modelling (SEM) was also performed in order to test the relations between different constructs. The following indices were specifically used for the CFA and SEM analyses: Comparative Fit Index (CFI), Tucker Lewis Index (TLI), Standard Root Mean Residual (SRMR), and Root Mean Square Error of Approximation (RMSEA) with a Confidence Interval (CI: 90%). For these indices, scores of CFI and TLI ≥0.90, SRMR and RMSEA ≤0.8 were considered as acceptable, following several recommendations [61,64,65].

2.5. Mediation analysis

For mediation analysis, the direct and indirect effects among constructs on outcome variables were analyzed as suggested by Hair et al. [61] and Hayes [66]. Bootstrap resampling was performed (1000 samples) via AMOS 23.0 A 95% confidence intervals (CI) was used to analyse the significance of direct and indirect effects. The indirect effect was considered significant if the CI did not include/cross zero, [66,67,68]. The effect sizes were evaluated as trivial (0–0.19), small (0.20–0.49), medium (0.50–0.79), and large (0.80 and greater), as suggested by Cohen [69].

3. Results

3.1. Preliminary analyses

A preliminary analysis presented no missing values or outliers (univariate or multivariate). The data also revealed no univariate distributions violations. However, Mardia´s coefficient form multivariate kurtosis exceeded the recommended value (>0.5). Thus, Bootstrap Bollen-Stine [70] was performed [71]. Additionally, the variance inflation factor (VIF) was calculated to check the collinearity diagnosis. Results indicated that all VIF values were less than 10, i.e., a recommended value suggested by Hair et al. [62]. Finally, a G*Power 3.1 [72], was used to determine the required sample size, considering the following parameters: effect size f2 = 0.1; a = 0.05; statistical power = 0.95 and four predictors, given that the minimum required size would be 176 subjects, which was respected in the present study.

3.2. Measurement model

Table 1 shown the means, standard deviations, and bivariate correlations among all of the studied variables. The players demonstrated high levels of task-involving climate (M = 3.17; SD = 0.56), and moderate values of self-confidence (M = 2.77; SD = 0.63). In contrast, players showed lower levels of ego-involving climate (M = 1.63; SD = 0.76), fear of failure (M = 1.94; SD = 0.73), cognitive (M = 2.02; SD = 0.49), and somatic anxiety (M = 1.58; SD = 0.41). The correlation patterns evidence that a task-involving climate is negatively and significantly associated with an ego-involving climate and fear of failure, while an ego-involving climate is positively and significantly associated with all variables under analysis. In turn, fear of failure was positively and significantly associated both cognitive and somatic anxiety and negatively associated with self-confidence. Regarding anxiety constructs, the results showed that somatic and cognitive anxiety were associated positively and significantly, while self-confidence was negatively and significantly associated with both somatic and cognitive anxiety. Finally, it was possible to observe that all constructs present an adjusted value of composite reliability, with all of them being greater than or equal to 0.70 [61]. The test of the measurement model included the task and ego-involving climate, fear of failure, cognitive, somatic, and self-confidence. The results showed that the initial model did not fit the data (χ2 = 1105.05 (545); SRMR = 0.059; B-Sp ≤0.001; RMSEA = 0.046 (90%CI = 0.043, 0.050); TLI = 0.881; CFI = 0.891). Furthermore, modification indexes from AMOS 23.0 were analyzed, revealingthat errors from items 11 and 15 (ego-involving climate) and items 6 and 12 (somatic anxiety) should be correlated. Theoretically, these relationships make sense due to the multidimensional association of these indicators with the latent variable, maintaining the parsimoniosity of the model. In these circumstances, an alternative model should be considered, provided that its theoretical integrity, parsimony, and adjustment to data is maintained [59]. After error correction, the respecified model fit the data (χ2 = 988.818 (543); SRMR = 0.057; B-Sp ≤ 0.001; RMSEA = 0.042 (90%CI = 0.037, 0.046); TLI = 0.905; CFI = 0.913). Additionally, the measurement model revealed that no problems occurred in terms of the convergent and discriminant validity, since the average extracted variance was greater than or equal to 0.50 [61,63], and the square correlations among all constructs were less than the AVE of each factor [63].

3.3. Structural model

The structural model showed a good fit with the data (χ2 = 1032.261 (295); SRMR = 0.064; B-Sp ≤0.001; RMSEA = 0.043 (90%CI = 0.039, 0.047); TLI = 0.900; CFI = 0.906). For the standardized direct effect (Figure 1), positive and significant effects were observed across ego-involving climate and fear of failure (β = 0.37 (0.226, 0.489)) and fear of failure, i.e., both somatic (β = 0.44 (0.306, 0.557)) and cognitive anxiety (β = 0.51 (0.375, 0.621)). In contrast, a negative but nonsignificant effect was observed between a task-involving climate and fear of failure (β = −0.09 (−0.231, 0.071)) and between fear of failure and self-confidence (β = −0.22 (−0.362, −0.088)).
Regarding mediation analysis between task and an ego-involving climate on cognitive, somatic, and self-confidence, the results showed a positive a significant indirect effect across ego-involving climates, i.e., in terms of both somatic (β = 0.16 (0.087, 0.273)) and cognitive anxiety (β = 0.19 (0.113, 0.237)), through fear of failure, and a negative and significant effect between ego-involving climate and self-confidence (β= −0.08 (−0.140, −0.035)), via fear of failure. In turn, the task-involving climate evidenced a negative but nonsignificant indirect effect with somatic (β = −0.04 (−0.103, 0.028)) and cognitive anxiety (β = −0.05 (−0.118, 0.031)) through fear of failure, and a positive but nonsignificant indirect correlation with self-confidence (β = 0.02 (−0.012, 0.064)), also via fear of failure.
In summary, the mediation analysis revealed that fear of failure positively influences the association between an ego-involving climate, i.e., both cognitive and somatic anxiety, and negatively influences self-confidence. In contrast, fear of failure does not influence the associations between a task-involving climate and both somatic and cognitive anxiety and self-confidence.

4. Discussion

In a highly competitive sports environment, such as teams selections, many players fear failure due to the evaluation they are regularly subjected to, according to the criteria of performance and success, both by their coaches, parents, teammates, and even by fans that attend the competitions [12,15,16,25]. Smith, Smoll, and Schutz [47] suggested that the most salient sources of situational stress in competitive sports environments are related to performance failure. Increasing pressure to achieve top performances will unequivocally create anxiety and fear of failure in young athletes [26].
The results recently provided by Gómez-López et al. [15] showed that except for fear of feeling shame, which was predicted by the peer ego-involving climate, all the aversive causes of fear of failure may be predicted by the coach climate. The immediate environment was proven to be determinant in avoidance behaviors and fear of failure. For that reason, the aim of this study was to analyze how the motivational climate generated by the coach affected the fear of failure and precompetitive anxiety perceived by the handball players of the region selection’s teams.
The descriptive results showed that most of the handball players analyzed perceived a high motivational climate of task involvement as well as a moderate level of self-confidence. Similarly, there were also players who perceived lower levels of motivational climate of ego involvement, fear of failure, and anxiety, i.e., both somatic and cognitive anxiety. These are positive results in view of the fact that so far, the literature has shown that coaches who create a task-involving climate promote effort, interest in learning, and personal progress through comparison to oneself to value competence level, skill development, and mutual cooperation in their team players [73]. Furthermore, different studies have shown that sports players subject to this type of motivational climate enjoy psychological well-being, increase their enjoyment of practicing their sport and of their team’s performance, and show lower levels of competitive anxiety, as opposed to players training in a competitive or ego-based climate, who experience high anxiety levels and derive less satisfaction in sports practice [74].
The results of the correlation analysis are consistent with the hypothesis made, given that the perceived motivational climate is strongly correlated with the fear of failure; this is strongly correlated with sports anxiety. The mediation analysis revealed that fear of failure positively influenced the association between an ego-involving climate, both in terms of cognitive and somatic anxiety, and negatively in terms of self-confidence. In contrast, fear of failure did not have an influence upon the associations between a task-involving climate and both somatic and cognitive anxiety and self-confidence. These results showed that the hypothesis formulated in the study were not completely fulfilled, since the fear of failure did not influence the association between the motivational climate of task involvement and self-confidence. The results found by Tsai and Chen [33], regarding the nonsignificant results found between the fear of failure and the climate of involvement in the task, were similar.
Even so, these results are congruent with previously-published data. The coaches who promote a task climate see mistakes as part of players’ learning processes, a stance that is transmitted to their players who thus feel lower levels of fear of failure, as recently shown by Tsai and Chen [33] with Taiwanese athletes, and by Ruiz-Sánchez et al. [16,32] with Spanish handball players. Likewise, Moreno-Murcia, Huéscar Hernández et al. [75] showed a significant and positive relationship between coaches’ controlling style and athletes’ fear of failure, whereas coach autonomy support was associated with a reduced fear of failure.
On the other hand, the literature has shown that the players who trained in a competitive climate (ego climate) had higher levels of anxiety [46,47], lower satisfaction levels with sports practice [2,54], and a reduced intention to continue doing sport [14]. Previously, Ntoumanis and Biddle [45] found no significant direct link between motivational climate and competitive anxiety, thus implying that motivational climates could have an indirect impact on affective responses through the different goal orientations.
Previous research has shown that fear of failure is related to high levels of fatigue, psychological stress, concern, and sports anxiety [29,34]. Even more, it was recently demonstrated that it is a strong predictor of the sport anxiety [26]. Hence, it has been confirmed that fear of failure affects well-being, interpersonal behavior, and the performance of the players [39].
Therefore, the present study demonstrates that the coach’s role as a socializing agent is important regarding avoidance behaviors, fear of failure, and the perceived anxiety for the players during sports practice. According to the results of the present study, coaches should provide their players with a motivational climate of task involvement which valorizes success and failure as a means of learning, and not merely as a sporting outcome. Also, during the competition, the coach should emphasize achievements related to skill, personal effort, and interest in the sports activity itself, and not only in the results. In this way, players will enjoy the practice of sport, will reduce their fear of failure, and will increase their level of commitment.
As a limitation of the study, it should be mentioned that although the results extend existing, published information, the specificity of the sample examined limits its generalization. These results require confirmation in future research with individual athletes where the interaction with the coach is different. In addition, other variables that influence the anxiety or fear process from personal perception (e.g. impulsivity or neuroticism) or from social perception (e.g. parental or peer influence) were not taken into account, which might explain why the reflected relationships, although interesting, are only partially explained. Perhaps the use of data from only one sport (handball) may suggest that they are taken into account in studies with team sports, and may be contrasted with other studies involving sports carried out by individuals.

5. Conclusions

It was shown that players’ immediate sports environment, created based on the coach’s motivational climate, is a critical factor in terms of fear of failure and the perception of anxiety in handball practice. The results obtained reinforce the importance of supportive behavior and promoting a coach task climate, both during training and in competition, as opposed to just results. Likewise, players should be involved in task-oriented criteria in order to analyze failures and successes, not only as a means to improve their results, but also to make them value errors as a means of learning, thus reducing their fear of failure and favoring satisfactory experiences and sports commitment. In conclusion, the present study is unique in determining the relationship between motivational climate, fear of failure, and sport anxiety in a sample of young male players from a team sport.
Finally, and based on all that has been pointed out so far and on the extensive review carried out, it is necessary to highlight the importance of this present study since, in the first place, there are, to date, no published studies on sports in Spain attempting to analyze the three variables studied here. Further to this, it constitutes a preliminary study with which to guide future research in which the main objective would be to carry out individualized psychological interventions on coaches to improve satisfaction levels among their players. Further topics that could be addressed in the future are the influence on players of parents and peers, and the difference between an athlete’s and coach’s own perception of the coach-created motivational climate.
Research on the influence of personality features (e.g., neuroticism) on the psychological skills (e.g., self-control, self-talk) is increasingly necessary. For this reason, the results offer important data for the sport sciences, but they should be reinforced by studies that deepen the mediation and moderation of personality traits (e.g., high-order traits) and their relationship with functional (e.g., motivation or self-efficacy) and dysfunctional (e.g., anxiety or concerns) psychological responses.
We hope that the current findings will increase the general understanding of the important role of the motivational climate that the coach favors over the fear of failure and anxiety in sports environments.

Author Contributions

Conceptualization, M.G.-L. and A.G.-G.; Data curation, M.G.-L.; Formal analysis, C.C.B. and C.M.d.S.; Investigation, M.G.-L. and A.G.-G.; Methodology, C.C.B. and C.M.d.S.; Project administration, M.G.-L. and J.G.-H.; Writing – original draft, C.C.B., J.G.-H. and M.G.-L.; Writing – review & editing, C.C.B., C.M.d.S. and A.G.-G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

We are grateful for the support received from the Royal Spanish Handball Federation (RFEBM), which allowed this study to be carried out.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Abraldes, J.A.; Granero-Gallegos, A.; Baena-Extremera, A.; Gómez-López, M.; Rodríguez-Suárez, N. Goal orientations, satisfaction, beliefs in sport success and motivational climate in swimmers. Rev. Int. Med. Cienc Act. 2016, 16, 583–599. [Google Scholar]
  2. Alesi, M.; Gómez-López, M.; Borrego, C.C.; Monteiro, D.; Granero-Gallegos, A. Effects of a motivational climate on psychological needs satisfaction, motivation and commitment in teen handball players. Int. J. Environ. Res. Public Health 2019, 16, 2702. [Google Scholar] [CrossRef] [Green Version]
  3. Ames, C. Classrooms: Goals, structures and student motivation. J. Educ. Psychol. 1992, 84, 261–271. [Google Scholar] [CrossRef]
  4. Poulos, A.M.; Mehta, N.; Lu, B.; Amir, D.; Livingston, B.; Santarelli, A.; Zhuravka, I.; Fanselow, M.S. Conditioning-and time-dependent increases in context fear and generalization. Learn. Mem. 2016, 23, 379–385. [Google Scholar] [CrossRef] [Green Version]
  5. Jonas, E.; McGregor, I.; Klackl, J.; Agroskin, D.; Fritsche, I.; Holbrook, C.; Nash, K.; Proulx, T.; Quirin, M. Threat and defense: From anxiety to approach. In Advances in Experimental Social Psychology; Olson, J.M., Zanna, M.P., Eds.; Elsevier Academic Press: San Diego, CA, USA, 2014; Volume 49, pp. 219–286. [Google Scholar] [CrossRef]
  6. Bonanno, G.A.; Burton, C.L. Regulatory flexibility: An individual differences perspective on coping and emotion regulation. Perspect. Psychol. Sci. 2013, 8, 591–612. [Google Scholar] [CrossRef] [PubMed]
  7. Tamir, M. Don’t worry, be happy? Neuroticism, trait-consistent affect regulation, and performance. J. Personal. Soc. Psychol. 2005, 89, 449–461. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. González-Hernández, J.; González-Reyes, A. Perfectionism and “adaptative alarm” to anxiety in sports figthing. Rev. Psicol. Deporte 2017, 26, 15–23. [Google Scholar]
  9. Roberts, G.C.; Treasure, D. Advances in Motivation in Sport and Exercise, 3rd ed.; Human Kinetics: Leeds, UK, 2012. [Google Scholar]
  10. Balaguer, I.; Guivernau, M.; Duda, J.L.; Crespo, M. Analysis of the validity of the construct and the predictive validity of the questionnaire of motivational climate perceived in sport (PMCSQ-2) with Spanish competition tennis players. Rev. Psicol. Deporte 1997, 6, 41–58. [Google Scholar]
  11. Balaguer, I.; Mayo, C.; Atienza, F.L.; Duda, J.L. Factorial validity of the Perceived Motivational climate in Sport Questionnaire-2 in the case of Spanish elite female handball teams. J. Sport Exerc. Psychol. 1997, 19, 27. [Google Scholar]
  12. Moreno, J.A.; Conte, L.; Martínez, C.; Alonso, N.; González-Cutre, D.; Cervelló, E. Psychometric properties of the Peer Motivational Climate in Youth Sport Questionnaire (PEERMCYSQ) with a sample of spanish athletes. Rev. Psicol. Deport. 2011, 20, 101–118. [Google Scholar]
  13. Ntoumanis, N.; Vazou, S.; Duda, J.L. Peer-created motivational climate. In Social Psychology in Sport; Jowette, S., Lavallee, D., Eds.; Human Kinetics: Champaign, IL, USA, 2007; pp. 145–156. [Google Scholar]
  14. Gómez-López, M.; Merino-Barrero, J.A.; Manzano-Sánchez, D.; Valero-Valenzuela, A. A cluster analysis of high-performance handball players’ perceived motivational climate: Implications on motivation, implicit beliefs of ability and intention to be physically active. Int. J. Sports Sci. Coach. 2019, 14, 541–551. [Google Scholar] [CrossRef]
  15. Gómez-López, M.; Ruiz-Sánchez, V.; Granero-Gallegos, A. Analysis of the prediction of motivational climate in handball players’ fear of failure. Int. J. Environ. Res. Public Health 2019, 16, 344. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Ruiz-Sánchez, V.; Gómez-López, M.; Granero-Gallegos, A.; González-Hernández, J. Relationship of motivational climate and fear of failure in high performance players in handball. Cuad. Psicol. Deporte 2017, 17, 55–64. [Google Scholar]
  17. Dias, C.S.; Cruz, J.F.A.; Fonseca, A.M. Anxiety, threat appraisal and coping in sports: Individual trait anxiety differences. Ansiedad Estrés 2011, 17, 1–13. [Google Scholar]
  18. Ames, C. Achievement goals, motivational climate, and motivational processes. In Motivation in Sport and Exercise; Roberts, G.C., Ed.; Human Kinetics: Champaign, IL, USA, 1992; pp. 161–176. [Google Scholar]
  19. Nicholls, J.G. The Competitive Ethos and Democratic Education; Harvard University Press: Cambridge, UK, 1989. [Google Scholar]
  20. Newton, M.; Duda, J.L.; Yin, Z. Examination of the psychometric properties of the Perceived Motivational Climate in Sport Questionnaire-2 in a simple of female athletes. J. Sports Sci. 2000, 18, 275–290. [Google Scholar] [CrossRef]
  21. Seifriz, J.J.; Duda, J.L.; Chi, L. The relationship of perceived motivational climate and intrinsic motivation and beliefs about success in basketball. J. Sport Exerc. Psychol. 1992, 14, 375–391. [Google Scholar] [CrossRef]
  22. Moreno-Murcia, J.A.; Conte, L. Prediction of fear to err in basketball players through the peer motivational climate and intrinsic motivation. Rev. Mex. Psicol. 2011, 28, 43–52. [Google Scholar]
  23. Nicholls, J.G. Conceptions of ability and achievement motivation. In Research on Motivation in Education: Student Motivation; Ames, R., Ames, C., Eds.; Academic Press: New York, NY, USA, 1984; Volume 1, pp. 39–73. [Google Scholar]
  24. Cecchini-Estrada, J.A.; González-González de Mesa, C.; Montero-Méndez, J. Participation in sport, goal orientation and moral functioning. Rev. Lat. Am. Psicol. 2008, 40, 497–509. [Google Scholar]
  25. Sagar, S.S.; Lavallee, D.; Spray, C.M. Why young elite athletes fear failure: Consequences of failure. J. Sport Sci. 2007, 25, 1171–1184. [Google Scholar] [CrossRef]
  26. Correia, M.E.; Rosado, A. Fear of failure and anxiety in sport. Anal. Psicol. 2018, 1, 75–86. [Google Scholar] [CrossRef] [Green Version]
  27. Atkinson, J.W. Motivational determinants of risk-taking behaviour. Psychol Rev. 1957, 64, 359–372. [Google Scholar] [CrossRef] [PubMed]
  28. Conroy, D.E.; Poczwardowski, A.; Henschen, K.P. Evaluative criteria and consequences associated with failure and success for elite athletes and performing artists. J. Appl. Sport Psychol. 2001, 13, 300–322. [Google Scholar] [CrossRef]
  29. Conroy, D.E.; Willow, J.P.; Metzler, J.N. Multidimensional fear of failure measurement: The Performance Failure Appraisal Inventory. J. Appl. Sport Psychol. 2002, 14, 76–90. [Google Scholar] [CrossRef]
  30. Conroy, D.E. Progress in the development of a multidimensional fear of failure measurement: The Performance Failure Appraisal Inventory (PFAI). Anxiety Stress Coping 2001, 14, 431–452. [Google Scholar] [CrossRef]
  31. Lazarus, R.S. Emotion and Adaptation; Oxford University Press: New York, NY, USA, 1991. [Google Scholar]
  32. Ruiz-Sánchez, V.; Gómez-López, M.; Granero-Gallegos, A. Motivational climate and fear of failure in the youthful teams of handball. Ebm: Recide 2017, 13, 199–206. [Google Scholar]
  33. Tsai, Y.M.; Chen, L.H. Relation of motivational climate and fear of Failure in taiwanese adolescent athletes. Psychol. Rep. 2009, 104, 627–632. [Google Scholar] [CrossRef]
  34. Gustafsson, H.; Sagar, S.S.; Stenling, A. Fear of failure, psychological stress, and burnout among adolescent athletes competing in high level sport. Scand. J. Med. Sci. Sports 2017, 27, 2091–2102. [Google Scholar] [CrossRef]
  35. Gould, D.; Horn, T.; Spreeman, J. Sources of stress in junior elite wrestlers. J. Sport Exerc. Psychol. 1983, 5, 159–171. [Google Scholar] [CrossRef]
  36. Passer, M.W. Fear of failure, fear of evaluation, perceived competence, and self-esteem in competitive-trait-anxious children. J. Sport Psychol. 1983, 5, 172–188. [Google Scholar] [CrossRef]
  37. Rainey, D.W.; Conklin, W.E.; Rainey, K.W. Competitive trait anxiety among male and female junior high school athletes. Int. J. Sport Psychol. 1987, 18, 171–180. [Google Scholar]
  38. O’Rourke, D.J.; Smith, R.E.; Smoll, F.L.; Cumming, S.P. Trait anxiety in young athletes as a function of parental pressure and motivational climate: Is parental pressure always harmful? J. Appl. Sport Psychol. 2011, 23, 398–412. [Google Scholar] [CrossRef]
  39. Sagar, S.S.; Lavallee, D.; Spray, C.M. Coping with the effects of fear of failure: A preliminary investigation of young elite athletes. J. Clin. Sport Psychol. 2009, 3, 73–98. [Google Scholar] [CrossRef]
  40. Ruiz, M.C.; Haapanen, S.; Tolvanen, A.; Robazza, C.; Duda, J.L. Predicting athletes’ functional and dysfunctional emotions: The role of the motivational climate and motivation regulations. J. Sports Sci. 2017, 35, 1598–1606. [Google Scholar] [CrossRef] [PubMed]
  41. García-Mas, A.; Palou, P.; Smith, R.E.; Ponseti, X.; Almeida, P.; Lameiras, J.; Jiménez, R.; Leiva, A. Performance anxiety and motivational climate in young competitive soccer players in relation to performance and skills perceived by their coaches. Rev. Psicol. Deporte 2011, 20, 197–207. [Google Scholar]
  42. Vazou, S.; Ntoumanis, N.; Duda, J.L. Predicting young athletes’ motivational indices as a function of their perceptions of the coach- and peer-created climate. Psychol. Sport Exerc. 2006, 7, 215–233. [Google Scholar] [CrossRef] [Green Version]
  43. West, J.; Rhoden, C.; Robinson, P.D.; Castle, P.; St Clair Gibson, A. How motivated are you? Exploring the differences between motivational profiles and personality traits. Sport Exerc. Psychol. Rev. 2016, 12, 28–42. [Google Scholar]
  44. Duda, J.L. Achievement goal research in sport: Pushing the boundaries and clarifying some misunderstandings. In Advances in Motivation in Sport and Exercise; Roberts, G.C., Ed.; Human Kinetics: Champaign, IL, USA, 2001; pp. 129–182. [Google Scholar]
  45. Ntoumanis, N.; Biddle, S. The relationship between competitive anxiety, achievement goals, and motivational climates. Res. Q. Exerc. Sport 1998, 69, 176–187. [Google Scholar] [CrossRef]
  46. Yoo, J. Motivational climate and perceived competence in anxiety and tennis performance. Percept. Motor Skills 2003, 96, 403–413. [Google Scholar] [CrossRef]
  47. Smith, R.E.; Smoll, F.L.; Schutz, R. Measurement and correlates of sport-specific cognitive and somatic anxiety: The Sport Anxiety Scale. Anxiety Res. 1990, 2, 263–280. [Google Scholar] [CrossRef]
  48. Grossbard, J.R.; Smith, R.E.; Smoll, F.L.; Cummings, S.P. Competitive anxiety in young athletes: Differentiating somatic anxiety, worry, and concentration disruption. Anxiety Stress Coping 2009, 22, 153–166. [Google Scholar] [CrossRef]
  49. McArdle, S.; Duda, J.K. Implications of the motivational climate in youth sports. In Children and Youth in Sport: A Biopsychosocial Perspective; Smoll, F.L., Smith, R.E., Eds.; Kendall/Hunt: Dubuque, IA, USA, 2002; pp. 409–434. [Google Scholar]
  50. Papaioannou, A.; Kouli, O. The effect of task structure, perceived motivational climate and goal orientations on students’ task involvement and anxiety. J. Appl. Sport Psychol. 1999, 11, 51–71. [Google Scholar] [CrossRef]
  51. Walling, M.D.; Duda, J.L.; Chi, L. The perceived motivational climate in sport questionnaire: Construct and predictive validity. J. Sport Exerc. Psychol. 1993, 15, 172–183. [Google Scholar] [CrossRef]
  52. Wylleman, P.; Lavallee, D. A developmental perspective on transitions faced by athletes. In Developmental Sport and Exercise Psychology: A Lifespan Perspective; Weiss, M.R., Ed.; Fitness Information Technology: Morgantown, WV, USA, 2004; pp. 507–527. [Google Scholar]
  53. Giwin, K.B. Goal orientations of adolescents, coaches, and parents: Is there a convergence of beliefs? J. Early Adolesc. 2001, 21, 227–247. [Google Scholar] [CrossRef]
  54. Granero-Gallegos, A.; Gómez-López, M.; Rodríguez-Suárez, N.; Abraldes, J.A.; Alesi, M.; Bianco, A. Importance of the motivational climate in goal, enjoyment, and the causes of success in handball players. Front. Psychol. 2017, 8, 2081. [Google Scholar] [CrossRef] [Green Version]
  55. Cox, R.H.; Martens, M.P.; Russell, W.D. Measuring anxiety in athletics: The revised Competitive State Anxiety Inventory-2. J. Sport Exerc. Psychol. 2003, 25, 519–533. [Google Scholar] [CrossRef]
  56. Martens, R.; Burton, D.; Vealey, R.S.; Bump, L.A.; Smith, D.E. Development and validation of the Competitive State Anxiety Inventory-2. In Competitive Anxiety in Sport; Martens, R., Vealey, R.S., Burton, D., Eds.; Human Kinetics: Champaign, IL, USA, 1990; pp. 117–190. [Google Scholar]
  57. Andrade, E.M.; Lois, G.; Arce, C. Psychometric properties of the Spanish version of the Revised Competitive State Anxiety Inventory-2 with athletes. Psicothema 2007, 19, 150–155. [Google Scholar]
  58. World Medical Association. World Medical Association Declaration of Helsinki: Ethical Principles for Medical Research Involving Human Subjects. JAMA 2013, 310, 2191–2194. [Google Scholar] [CrossRef] [Green Version]
  59. Kline, R. Principles and Practice of Structural Equation Modelling; The Guilford Press: New York, NY, USA, 2016. [Google Scholar]
  60. Raykov, T. Estimation of composite reliability for congeneric measures. Appl. Psychol. Meas. 1997, 21, 173–184. [Google Scholar] [CrossRef]
  61. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E. Multivariate Data Analysis, 7th ed.; Pearson: New York, NY, USA, 2009. [Google Scholar]
  62. Hair, J.F. Multivariate Data Analysis: An Overview. In International Encyclopedia of Statistical Science; Lovric, M., Ed.; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar] [CrossRef] [Green Version]
  63. Fornell, C.; Larcker, D.F. Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 1981, 18, 39–50. [Google Scholar] [CrossRef]
  64. Byrne, B. Structural Equation Modeling with AMOS Basic Concepts, Applications, and Programming; Taylor & Francis Group, LLC.: New York, NY, USA, 2010. [Google Scholar]
  65. Marsh, H.; Hau, K.; Wen, Z. In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Struct. Equ. Model. 2004, 11, 320–341. [Google Scholar] [CrossRef]
  66. Hayes, A.F. Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach; The Guilford press: London, UK, 2018. [Google Scholar]
  67. Mackinnon, D.P.; Lockwood, C.M.; Williams, J. Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivar. Behav. Res. 2004, 39, 99–123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Williams, J.; MacKinnon, D.P. Resampling and distribution of product methods for testing indirect effects in complex models. Struct. Equ. Model. 2008, 15, 23–51. [Google Scholar] [CrossRef] [Green Version]
  69. Cohen, J. A power primer. Psychol. Bull. 1992, 112, 155–159. [Google Scholar] [CrossRef] [PubMed]
  70. Enders, C.K. Applying the Bollen-Stine Bootstrap for Goodness-of-Fit measures to structural equation models with missing data. Multivar. Behav. Res. 2002, 37, 359–377. [Google Scholar] [CrossRef] [PubMed]
  71. Nevitt, J.; Hancock, G.R. Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Struct. Equ. Model. 2001, 8, 353–377. [Google Scholar] [CrossRef]
  72. Faul, F.; Erdfelder, E.; Buchner, A.; Lang, A.G. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 2009, 41, 1149–1160. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  73. Barkoukis, V.; Koidou, E.; Tsorbatzoudis, H. Effects of a motivational climate intervention on state anxiety, self-efficacy, and skill development in physical education. Eur. J. Sport Sci. 2010, 10, 167–177. [Google Scholar] [CrossRef]
  74. Smith, R.E.; Smoll, F.L.; Cumming, S.F. Effects of a motivational climate intervention for coaches on young athletes’ sport performance anxiety. J. Sport Exerc. Psychol. 2007, 29, 39–59. [Google Scholar] [CrossRef]
  75. Moreno-Murcia, J.A.; Huéscar Hernández, E.; Conte Marín, L.; Nuñez, J.L. Coaches’ motivational style and athletes’ fear of failure. Int. J. Environ. Res. Public Health 2019, 16, 1563. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Standardized individual parameters – Hypothesized model. Note. (*) significant paths.
Figure 1. Standardized individual parameters – Hypothesized model. Note. (*) significant paths.
Ijerph 17 00592 g001
Table 1. Descriptive and correlation analysis for all constructs and composite reliability.
Table 1. Descriptive and correlation analysis for all constructs and composite reliability.
ConstructsTIEIFFSomaticSelf-ConfidenceCognitive
Task-involving1-----
Ego-involving −0.53 **1----
FF −0.31 ** 0.43 **1---
Somatic −0.07 0.14 **0.44 **1--
Self-Confidence 0.01 0.16 **0.50 **−0.20 **1-
Cognitive −0.01−0.19 ** −0.19 ** 0.61 **−0.38 **1
Mean 3.17 1.631.941.582.772.02
SD 0.56 0.560.730.410.630.49
CR 0.82 JEL M ISLIS0.860.750.760.820.75
Note: TI = task-involving climate; EI = ego-involving climate; FF = fear of failure; CR = Composite reliability; SD = standard deviation; ** p ≤ 0.01.

Share and Cite

MDPI and ACS Style

Gómez-López, M.; Chicau Borrego, C.; Marques da Silva, C.; Granero-Gallegos, A.; González-Hernández, J. Effects of Motivational Climate on Fear of Failure and Anxiety in Teen Handball Players. Int. J. Environ. Res. Public Health 2020, 17, 592. https://doi.org/10.3390/ijerph17020592

AMA Style

Gómez-López M, Chicau Borrego C, Marques da Silva C, Granero-Gallegos A, González-Hernández J. Effects of Motivational Climate on Fear of Failure and Anxiety in Teen Handball Players. International Journal of Environmental Research and Public Health. 2020; 17(2):592. https://doi.org/10.3390/ijerph17020592

Chicago/Turabian Style

Gómez-López, Manuel, Carla Chicau Borrego, Carlos Marques da Silva, Antonio Granero-Gallegos, and Juan González-Hernández. 2020. "Effects of Motivational Climate on Fear of Failure and Anxiety in Teen Handball Players" International Journal of Environmental Research and Public Health 17, no. 2: 592. https://doi.org/10.3390/ijerph17020592

APA Style

Gómez-López, M., Chicau Borrego, C., Marques da Silva, C., Granero-Gallegos, A., & González-Hernández, J. (2020). Effects of Motivational Climate on Fear of Failure and Anxiety in Teen Handball Players. International Journal of Environmental Research and Public Health, 17(2), 592. https://doi.org/10.3390/ijerph17020592

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop