Next Article in Journal
“Better If They Laugh with Me than at Me”: The Role of Humor in Coping with Obesity-Related Stigma in Women
Next Article in Special Issue
Standing Long Jump Performance in Youth with Visual Impairments: A Multidimensional Examination
Previous Article in Journal
Longitudinal Associations between the Neighborhood Built Environment and Cognition in US Older Adults: The Multi-Ethnic Study of Atherosclerosis
Previous Article in Special Issue
Analysis and Validation of Cross-Modal Generative Adversarial Network for Sensory Substitution
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Brief Form of the Test of Gross Motor Development-3 for Individuals with Visual Impairments

1
Department of Physical Education, University of South Carolina, Columbia, SC 29208, USA
2
Child Development Research Center, University of South Carolina, Columbia, SC 29208, USA
3
Natural Science Division, Pepperdine University, Malibu, CA 90263, USA
4
SUNY-Brockport, Kinesiology, Sport Studies, and Physical Education, Brockport, NY 14420, USA
5
SUNY-Cortland, Physical Education Department, Cortland, NY 13045, USA
6
Department of Movement Arts, Health Promotion, and Leisure Studies, Bridgewater State University, Bridgewater, MA 02324, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(15), 7962; https://doi.org/10.3390/ijerph18157962
Submission received: 27 June 2021 / Revised: 22 July 2021 / Accepted: 23 July 2021 / Published: 28 July 2021
(This article belongs to the Special Issue Movement Studies for Individuals with Visual Impairments)

Abstract

:
Children with visual impairments (VI) tend to struggle with their fundamental motor skills (FMS), and these difficulties often persist across the lifespan, requiring frequent assessment. The Test of Gross Motor Development (TGMD) shows robust psychometric properties for children with VI. The TGMD, which includes 13 skills, is time-consuming to administer and score, warranting the need to explore brief versions. Therefore, the purpose of this study was to explore the psychometric properties of three, six-skill versions of the TGMD-3 with children with VI. Children (n = 302; Boys = 58%, Girls = 42%; Mage = 13.00, SD = 2.50 years) with VI (B1 = 27%, B2 = 20%, B3 = 38%, B4 = 15%) participated in this study. We examined three different models using confirmatory factor analyses on the relationships between the motor skills and latent traits across the models. Scores from all three brief versions had acceptable global fit. Although further research should be conducted, practitioners can adopt a brief version of the TGMD to assess children with VI.

1. The Brief Form of the Test of Gross Motor Development-3 for Individuals with Visual Impairments

Fundamental motor skills are a subset of gross motor skills (body movement patterns which are goal-directed) that includes manipulating objects (e.g., ball, object control, or manipulative skills—throw, catch, strike), keeping the body “stabilized” (e.g., twisting, bending, curling), or moving the body from one point in space to another (e.g., locomotor skills—run, jump, hop) [1]. Fundamental motor skills are the “building blocks” to more complex movements necessary to play sports, games, or participate in physical activity behaviors [1]. Thus, it is no surprise that fundamental motor skill in childhood/adolescence can predict physical activity behaviors throughout the lifespan [2].
Unfortunately, children, adolescents, and youth (herein referred to as children) with visual impairments (VI), including blindness, tend to struggle with their fundamental motor skills, and these difficulties often persist to the extent of arrested/delayed development across the lifespan [3,4]. However, if children with VI receive intervention, their fundamental motor skill difficulties can resolve quickly [3] and to the level needed to support health-enhancing levels of fitness [5]. Thus, it is critical that children with VI have their fundamental motor skills assessed as early and as frequently as possible.
The Test of Gross Motor Development (2nd edition [6] or 3rd edition [7]) is one of the most widely adopted assessments of fundamental motor skill in the United States and across the world [8,9] and its psychometric properties were specifically vetted for children with VI [10]. The TGMD is not only a common choice of practitioners for assessing children with VI in rehabilitation [11], but also for researchers exploring descriptive, cross-sectional, and/or longitudinal inquiries [3,4,5].
Despite its popularity among practitioners and researchers, there are some challenges to both administering and scoring the TGMD (2nd or 3rd editions) with large samples and in school-based settings due to the time needed to administer and score [8,9,12]. Administration of the TGMD-3 requires 20–30 min per child. Scoring the TGMD-3 may require an additional 40–60 min per child [6,7]. Thus, it is not surprising that time tends to be the more frequently reported barrier for assessing gross motor skills among teachers [12].
For practitioners, time with their students (if teachers) or patients (if employed in rehabilitative settings) is quite limited. Often, teachers and physical therapists see their students/patients 30 min a week for physical education or for therapy sessions. Faster assessments in terms of administration and scoring may increase likelihood of assessment amongst practitioners. More frequent assessment often leads to improved downstream effects for children with VI (e.g., lessons rooted in present level of performance, knowledge of program effectiveness, etc. [11,13]).
For researchers, time can also be of the essence when assessing children with VI as access to the population tends to occur via schools or short-run events (e.g., camps). Visual impairment is considered low incidence among children as there are approximately 547,000 children with VI (including those with vision difficulty despite the use of corrective lens) in the United States [14] of which approximately 68,000 are considered legally blind [15]. As a result, research teams need to travel to many schools or sites to accumulate a large enough sample sufficiently powered for analyses. Furthermore, schools and short-run events tend to provide very limited time for research. Thus, it is very difficult and expensive to capture robust, powered data sets given the time constraints inherent within standardized motor assessments with good psychometric properties. Furthermore, fewer skills should be faster to both administer and score (e.g., half as many items should cut time in half, addressing the time constraints above), warranting the need to explore the extent to which a brief version of the TGMD-3 can retain the stout psychometric properties of the full battery for use with children with VI.
Along with time constraints, the use of the TGMD-3 for children with VI might oblige criticism regarding its ecological and external validity. Ecological and external validity are somewhat conflated terms but are not synonyms. Ecological validity refers to the extent to which research occurs in a setting that best mimics the real world [16]. Similarly, external validity refers to the extent to which findings from a study can then generalize from that specific sample to a larger population. Thus, studies with good external validity may not be ecologically valid and vice versa; however, assessing outcomes in a manner that best mimics “real world” settings can certainly improve external validity [16].
For children with VI, many previous studies suffer from issues with external validity as samples are often limited in size and occur in somewhat contrived settings (e.g., laboratories; [17]). Issues with ecological validity also emerge as many skills within test batteries may not be familiar [18], may not be developmentally appropriate (e.g., should an 18-year-old gallop), or may not translate to the sports and games specifically designed for children/adults with VI (e.g., there is no throwing in Beep Baseball). Completing the entire test battery (e.g., 13 skills on the TGMD-3) may result in issues surrounding ecological validity. For example, certain items within the battery may be more appropriate than others depending on the age, location, and culture of the sample. In addition, older samples of children (e.g., 11 years+) with VI may participate in the United States Association for Blind Athletes (USABA) track and field competition. Thus, hopping and running are appropriate, familiar, and relevant. Furthermore, Beep Baseball is one of the most popular sports in the United States for children and adults with VI, supporting the need to assess strike, catch, and run. In other countries, other Paralympic sports are more the norm. For example, children with VI in Brazil may be more likely to participate in 5-a-side soccer (a new/growing sport in the United States) or goalball (Paralympic sport) warranting the assessment of kick and roll (or underarm throw). Thus, brief versions of the TGMD-3 for children with VI that include different skills warrant exploration.

2. Potential/Proposed Brief TGMD-3 Batteries for Children with VI

The TGMD-3 is a two-factor model (locomotor and ball skill subscales) with psychometric properties that are typically stout [7]. While developed for children without disabilities, Brian and others [10] showed that the two-factor structure holds for children with VI. According to Kline [19], any factor within a model should have at least three items. Therefore, target/exemplar models had to have at least three skills per factor, and we followed that suggestion in the following ways.

2.1. Brazilian TGMD-2 Short Form (TGMD-2-SF; V-6)

There is precedent for adopting a brief version of the TGMD-2 [14,20]. Although originating from the TGMD-2 (and not the current TGMD-3), Valentini and colleagues [21] introduced a short form for the TGMD-2 using Brazilian youth aged three to ten years of age. Using exploratory and confirmatory factor analyses, the two-factor TGMD-2-SF included the run, gallop, and hop (i.e., locomotor factor) and the two-handed strike, kick, and throw (i.e., object control/ball skill factor) skills. Due to the previously established precedence of this short form (albeit in Brazilian youth without VI using a previous version of the TGMD), the skills within the TGMD-2-SF were investigated as a potential two-factor solution within the current sample (referred to as V-6).

2.2. A Novel, Paralympic, and VI Sport-Specific Inspired Short Form (SPT-6)

Based on sports that are common in the VI community (e.g., goalball, beep baseball, blind 5-a-side soccer) and the foundational requirements needed for skilled movement/mobility (e.g., strength, power, rhythm, coordination) the run, hop, and skip (locomotor factor) as well as the two-hand strike, kick, and underhand throw (ball skill factor) were hypothesized skills for the proposed VI sport-specific battery. For example, the two-hand strike is a significant component of beep baseball (i.e., batting) while the underhand throw (also described as the toss) is biomechanically similar to rolling as rolling is a major component of goalball. Unfortunately, although present in the TGMD-2, the roll was removed from the TGMD-3 [6,7]. The kick was included as it is a necessary skill in 5-a-side soccer and, importantly, the kick represents lower-body ball skill motor competence. Concerning locomotor skills, running is a ubiquitous transportation skill. The hop requires a significant amount of power production and dynamic postural control while both the hop and the skip require substantial inter-limb coordination and rhythmicity. While rationales were provided for the inclusion of each skill, youth with VI may not regularly participate in and/or have consistent access to the acknowledged VI-specific sports. Thus, while the selection of said VI-specific skills was advisable, the premise that such skills may be developed, experienced, or were motorically representative of American youth with VI was based on ecological assumptions/hypotheses.

2.3. Previous Results of Psychometrics of TGMD-3 for Children with VI (STAT-6)

In order to determine a statistically based brief form, we selected six skills based upon the factor loadings from the original psychometric evaluation of the TGMD-3 for children with VI [10]. Using factor loadings, the top three ball skills (i.e., overarm throw, dribble, and one-hand strike) and two of the top three locomotor skills (i.e., run and hop) were included. We chose to not include skip as it was already the third locomotor skill in the SPT-6 model. As such, we strategically opted for slide instead of jump since the slide shows discrimination into the frontal plane and out of the sagittal plane. Most children with VI are taught to move within the sagittal plane from orientation and mobility specialists by using their canes [22]. However, the ability to locomote within the frontal plane may better predict the ability to avoid obstacles and shed light into co-morbidities associated with VI that result from cortical or cerebral etiologies [23]. Thus, we wanted to assess movements into the frontal plane in concert with skills that assess movements within the sagittal plane (e.g., running).
Although there are previous inquiries to support the statistical and theoretical basis of this study, it is important to explore the psychometric properties of brief versions of the TGMD-3 specifically for children with VI. Thus, the purpose of the current study was to examine the psychometric properties of the three brief versions of the TGMD-3 for adequately measuring locomotor and ball skills in children with VI. We hypothesize that the STAT-6 and SPT-6 models, developed for US children with VI statistically and contextually, respectively, will measure locomotor and ball skills as well as the full TGMD-3 battery. We were unsure how the V-6 model would perform compared to the full battery, as this brief version was previously vetted on Brazilian children without VI.

3. Methods and Materials

3.1. Design, Participants, and Setting

This study featured a descriptive-analytic design with convenience sampling. Children (n = 302; Boys = 58%, Girls = 42%; Mage = 13.00, SD = 2.50 years) with VI (B1 = 27%, B2 = 20%, B3 = 38%, B4 = 15%; see below for definitions) participated in this study. This study occurred at several seven-day sports camps specifically designed for children with VI across New York, Florida, and Texas. All children with VI who attended these camps were invited to participate.

3.2. Instrumentation

3.2.1. United States Association of Blind Athletes (USABA) Classification System

Participants were stratified across degree of vision based upon the United States Association for Blind Athletes (USABA) classification scale. The USABA scale includes four levels: B1 includes no light perception in either eye up to light perception, as well as an inability to recognize the shape of a hand at any distance or in any direction and is considered the lowest level of visual acuity. Children who are B2 can recognize the shape of a hand with a visual acuity up to 20/600; B3 includes 20/600–20/200. Both B2 and B3 may or may not include a visual field of less than 5° in the best eye including eye correction. In contrast, children who are B4 possess visual acuity above 20/200 and up to 20/70, as well as a visual field larger than 20° in the best eye with the best practical eye correction.

3.2.2. TGMD-3

The TGMD-3 [24,25] includes 13 items within two subscales: locomotor and ball skills. The locomotor subscale contains six items (run, jump, hop, skip, gallop, and slide) and the ball skills subscale includes seven object control skills (catch, kick, strike with a bat, strike with a racquet, underarm throw, overhand throw, and dribble) that are each scored on several performance criteria, resulting in a raw score ranging between 0–100 (locomotor = 46, ball skills = 54) points. Standardized procedures include: (1) a verbal and visual demonstration for each skill one at a time; (2) one practice trial for each skill (again, one skill at a time); (3) if necessary, the repetition of an additional verbal and visual demonstration after the practice trial; and (4) two trials (by the participants) without cueing or assistance from the administrator. All trials should be digitally video recorded for scoring purposes [7]. The TGMD-3 holds good psychometric properties for youth without VI ages 3 to 10 years, 11 months [7].
In 2018, Brian and colleagues [10] established the psychometric properties of the TGMD-3 for children/adolescents (ages 8–19 years) with VI. The psychometric properties were quite stout, revealing high internal consistency (ω = 0.89–0.95), strong interrater reliability (ICC = 0.91–0.92), convergence with the TGMD-2 (r = 0.96), and good model fit, χ2(63) = 80.10, p = 0.072, χ2/df ratio = 1.27, RMSEA = 0.06, CFI = 0.97. Not only were the psychometrics acceptable, but Brian and colleagues also established recommendations to modify the TGMD-3 for individuals with VI as needed [10]. Modifications included: (1) using least-to-most prompting for the demonstration (no modifications, demonstration from different angles, tactile modeling, the use of verbal cues only if necessary); (2) placing audio devices, such as a buzzer, or a human guide as a clapper at both the start/stop points for each locomotor skill item (only if needed); (3) using bright-colored/reflective tape around the boundaries; and (4) allowing the participant to walk the test area, if necessary, to assure their safety for comfort [10]. Historically, there have been no significant differences when those without VI performed the TGMD with and without the same affordances/modifications for those with VI [24]. Furthermore, it is acceptable to administer the TGMD-3, using raw scores for analyses, when participants fail to reach a maximum score, if they are beyond the age of 11 years [25].

3.3. Procedures

The Institutional Review Board of the University of South Carolina (CR00026556) approved all procedures. Parents of participants provided written informed consent and completed a demographic survey for their children while all child participants provided verbal assent. All participants completed the entire TGMD-3 battery with members of the research staff following the procedures outlined within the TGMD-3 manual [7] and featuring vetted modifications, if necessary [10]. All TGMD-3 trials occurred within a seven-day period in the summer at various sport camp locations in New York, Florida, and Texas. Research staff digitally recorded each trial and then coded from the digital recordings. All raters passed inter-rater reliability requirements of greater than 80% with the lead researcher.

3.4. Analytic Methods

Confirmatory factor analysis (CFA) was an appropriate statistical analysis for our study for several reasons. Gross motor skill is represented as two latent traits: locomotor skills and object control skills [10], and CFA can handle the measurement errors [20]. CFA allowed us to examine the relationships between the observed skills and the two latent traits across the different versions of the TGMD proposed. Lastly, given the a priori decision of a two-factor model, the CFA framework provided more information than exploratory factor analysis. As such, CFA was deemed the most methodologically sound approach for addressing the research questions.
All analyses were completed using Mplus version 8.4 statistical software. The maximum likelihood estimation method was used to estimate parameters. In accordance with current methodological research, global model fit was examined using a variety of fit indices [19]. We considered the p-value of the model χ 2 statistic, where a nonsignificant value indicated good fit between the hypothesized model and the observed variables. Furthermore, the ratio of χ 2 / df should be a relatively small number with most recommending less than three [19]. We also examined the root mean square error of approximation (RMSEA), the standardized root mean square residual (SRMR), and the comparative fit index (CFI). RMSEA values less than 0.08, SRMR values less than 0.05, and CFI values greater than 0.90 are recommended for relatively good evidence of model-to-data fit [26]. We also considered psychometric properties of the manifest indicator variables, including reliability estimates and convergent validity [27,28]. In Mplus, the parameter estimate (loading) divided by the standard error is treated as a z-score, where significant values for all indicators of the factor indicate convergent validity [29]. Lastly, we examined psychometric properties of the latent factors by calculating composite reliability and the variance extracted estimate. Composite reliability reflects the internal consistency of the individual skills that are hypothesized to measure the latent trait (e.g., locomotor skills). The variance extracted estimate for the latent trait indicates the amount of variance that is captured by that factor in relation to the amount of variance that is due to measurement error. Composite reliability should exceed 0.70 [30], and the variance extracted estimate should exceed 0.50 [31]. Finally, we used global fit indices and the psychometric properties of the observed variables and latent factor to compare our proposed versions of the TGMD-3.

4. Results

4.1. Model Fit

Descriptive statistics for observed skills are shown in Table 1, and correlations among skills are presented in Table 2. Item difficulty represents the proportion of children with VI who got the maximum score for a skill. Difficulty values for each item should range between 0.20 and 0.80 [32]. Item discrimination is a point-biserial correlation and refers to the ability of a skill to differentiate among children with VI based on how well they perform on locomotor and object control skills. The accepted practice is to omit or revise items with indexes below 0.35 [33]. According to Table 3, nearly all models had acceptable global fit. For the model χ 2 statistic, the full TGMD-3 ( χ 2 (64) = 79.39, p = 0.093), STAT-6 ( χ 2 (8) = 10.45, p = 0.24), and V-6 ( χ 2 (8) = 7.44, p = 0.49) had nonsignificant values indicating good fit. Conversely, SPT-6 ( χ 2 (8) = 18.07, p = 0.02) had a significant value suggesting possible poorer fit. All models had a ratio of χ 2 / df below the suggested cutoff of 3. All models had CFI values above 0.90, and, similarly, they all had SRMR values below 0.05. With RMSEA, the results were mixed with three of the four models showing acceptable fit, meaning an estimate below 0.08 and preferably a 90% confidence interval reflecting as much. The full TGMD-3 (estimate = 0.028, 90% CI [0.00, 0.05]), STAT-6 (estimate = 0.032, 90% CI [0.00, 0.08]), and V-6 (estimate = 0.00, 90% CI [0.00, 0.06]) had good fit based on both the estimate and the confidence interval. SPT-6 (estimate = 0.065, 90% CI [0.02, 0.10]) had RMSEA estimates below 0.08 but probabilities being in range below 90%.

4.2. Psychometric Properties of Individual Skills

Table 4 reports information related to the psychometric properties of the measurement models investigated in the current study. For each skill within each model, standardized loadings are presented, along with z-scores for the loadings and item reliabilities. For each model, the group of skills displayed convergent validity since the factor loading statistic for each skill was significant (p < 0.001). Regarding reliability at the skill level, skill reliabilities across the models ranged from 0.19 to 0.58 (Mdn = 0.50). Only gallop (Mdn = 0.19) and slide (Mdn = 0.295) had reliabilities below 0.30.

4.3. Psychometric Properties of the Latent Trait

Across all models, composite reliabilities exceeded 0.70 for the latent trait of object control skills. For locomotor skills, most models had composite reliabilities that exceeded 0.70, excluding V-6 (0.63). For the variance extracted estimate for object control skills, STAT-6 (0.55) and V-6 (0.53) had variance extracted estimates above the full TGMD-3 (0.50). SPT-6 (0.46) had a variance extracted estimate below the full TGMD-3. For the latent trait of locomotor skills, STAT-6 (0.42) and SPT-6 (0.47) had variance extracted estimates above the full TGMD-3 (0.39). However, V-6 (0.37) had a variance extracted estimate below the full TGMD-3. Lastly, the correlation between locomotor and object control skills was similar across all four models (TGMD-3: 0.945, STAT-6: 0.923, V-6: 0.989, SPT-6: 0.990).

5. Discussion

The purpose of this study was to assess the psychometric properties of brief, six-skill versions of the TGMD-3 for children with VI. Within this study, we examined three different models using CFA to examine the relationships between the motor skills and latent traits across the models. Originally, the psychometrics for the TGMD-3 were acceptable with modified equipment for children with VI [10]. The results of this current study are also very promising, like previous findings on a brief version of the TGMD-2 for Brazilian youth [21].
All models had acceptable global fit, indicating much potential and flexibility in developing a brief version of the TGMD. All models also had good SRMR and CFI values; however, the SPT-6 model showed potential issues with the global model fit based upon the 90% confidence interval for RMSEA. With regard to reliability, all three brief versions were above the cutoff of 0.70 for ball skills, and the STAT-6 and SPT-6 models were above the cutoff for locomotor skills. Regarding variance extracted estimates, the STAT-6 and V-6 models do better than the full TGMD-3 model for ball skills. Similarly, the STAT-6 and SPT-6 models do better than the full battery for locomotor skills. In combination, these results demonstrate how locomotor and ball skills need to be strategically selected for the brief versions for children with VI. Contextually, gallop should be used with caution to measure locomotor skills in children with VI. From our results, we glean that gallop is an extremely difficult skill that has lower discrimination for children in the sample, regardless of degree of VI. Gallop is a continuous skill that relies upon rhythmical control and multi-limb coordination. It is very difficult to provide a tactile model that replicates the gallop. Unsurprisingly, gallop had a low factor loading on both the full TGMD-3 and the V-6 models, resulting in lower reliability and variance extracted for the locomotor latent trait for the V-6 model. These data are similar to those from Brian et al. (2018) when they vetted the full TGMD-3 in children with VI. Could the low discrimination of the gallop be due to the need for a visual representation to mimic the demonstration? Interestingly, these low discriminations did not emerge for the skip (another continuous skill which relies upon rhythm). Plausibly, the contralateral nature of the skip along with its even rhythm pattern lends itself better to featuring physical prompting than gallop (ipsilateral pattern with uneven rhythms). The uneven rhythm of the gallop might require visual information whereas the vertical movements in the skip can be felt via haptics alone, rendering it less reliant upon visual information than the gallop. However, future research efforts should explore different ways though which to demonstrate skills that may be more reliant upon vision (e.g., gallop) than closed ball skills (e.g., two-hand strike).
Concurrently, we see that the underhand throw has a lower factor loading than the other ball skills, resulting in a lower variance extracted estimate for the SPT-6 model compared to the full TGMD-3. Item analysis showed that underhand throw is a somewhat difficult skill with the lowest discrimination among the ball skills. In the a priori model development, underhand toss was strategically selected as the closest TGMD-3 skill to rolling a ball (necessary as the roll (from the TGMD-2) was removed from the TGMD-3). The roll (now underarm throw) is an important skill for goalball and other Paralympic sports. Unfortunately, based upon our results, the underhand throw may be more difficult than rolling a ball in the VI context. The underhand throw requires a judgement of distance (e.g., hit a wall 15 feet away). Judging distance requires figure ground and visual motor integration. Although sound sources can assist judgement, clearly more support is needed. However, future research is needed to discern whether additional supports with the underhand toss might improve its discriminant function and whether rolling a ball (instead of toss) might contribute similarly to the latent trait of ball skills in the VI context.
Overall, the authors recommend using the locomotor skills for the STAT-6 (run, hop, slide) and SPT-6 (run, hop, skip) models and the ball skills for the STAT-6 (one-hand strike, dribble, overhand throw) and V-6 (two-handed strike, kick, overhand throw) models. These shorter, latent traits are reliable and show more convergent validity that the full TGMD-3.

5.1. Implications for Practitioners

The findings of this study provide some important implications for practitioners. Most importantly, a brief version of the TGMD could be adopted by practitioners for evaluation or investigation based upon the reliability/validity results of the present study. Brief versions of the TGMD are highly desirable due to the lengthy administrative and scoring time required for each assessment (going from 13 to 6 skills should cut time in half). Often administrative time is even lengthier in children with VI due to reduced experience in many motor skills and adapted teaching strategies when necessary [24]. Although saving administrative time is important, it is critical that any version of the TGMD that is adopted should be vetted regarding its psychometric properties. Notably, practitioners should not use a brief version of the TGMD as a normative reference for placement. Rather, the brief versions should be used for program evaluation purposes or to provide additional assessments with the full battery.

5.2. Strength, Limitations, and Future Research

To our knowledge, the is the first investigation of brief version of the TGMD-3 for individuals with VI. Along with the innovation behind this inquiry, there are other strengths. Specifically, our analyses incorporated both item difficulty and discrimination. We also considered composite reliability and convergent validity for the latent traits of locomotor and object control skills across multiple models. Although there is always an inherent risk when running multiple models on a single sample, these robust analyses (namely composite reliability and variance extracted) take that risk into account, thus mitigating some of the potential for risk.
In addition to the rigor with our analyses, we specifically focused on practical translations of these findings. Specifically, we suggest that practitioners may now have an efficient way to evaluate formative and summative gains with their students, patients, and stakeholders in a manner that converges with the full battery. Practitioners could use the abbreviated batteries as formative, summative, and criterion references to better evaluate their programs and the extent to which their clients (students, children, patients, etc.) are making gains towards goals. By knowing programmatic effectiveness early and often, assessment data can then better support learning in the long run. Thus, providing ecologically valid brief versions of the TGMD-3 can only support maximation of learning and meeting programmatic goals.
Although this study includes many strengths, it is certainly not without limitations. These limitations should be addressed within future research in the following ways. Further research should be conducted on brief versions of the TGMD for children with VI. Although we conducted several evaluations of various models, we are not suggesting that researchers choose skills at random yet. These data allude to a trend that skill choice may be a possibility; however, further testing and replication are needed with different samples. We suggest that when researchers conduct future inquiry, they select half locomotor and half ball skills in order to maintain the general trait of motor. In addition, researchers using the brief versions of the TGMD should investigate different populations, specifically children with VI outside of camps, both from integrated schools and schools for the blind.

6. Conclusions

Scores from all three brief versions of the TGMD tested had acceptable global fit, indicating much potential of the use of a shorter version of the TGMD, saving not only considerable administrative and assessment time, but also potentially providing flexibility to tailor the instrument to be most ecologically valid. Although further research should be conducted, practitioners can adopt a brief version of the TGMD to assess children with VI.

Author Contributions

Conceptualization, A.S.B.; methodology, A.S.B., A.S. (Angela Starrett), and A.P.; formal analysis, A.S. (Angela Starrett); data curation, A.S.B., A.P., S.T.M., A.S. (Alexandra Stribing), E.G., M.P., and P.H.B.; writing—original draft preparation, A.S.B., A.S. (Angela Starrett), P.H.B., and A.P.; writing—review and editing, A.S.B., A.S. (Angela Starrett), A.P., P.H.B., and L.J.L.; project administration, A.S.B., A.P., S.T.M., A.S. (Alexandra Stribing), E.G., M.P., P.H.B., and L.J.L. All authors have read and agreed to the published version of the manuscript.

Funding

The research received no funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of University of South Carolina (CR00026556—17 October 2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Brian, A.; Getchell, N.; True, L.; De Meester, A.; Stodden, D.F. Reconceptualizing and Operationalizing Seefeldt’s Proficiency Barrier: Applications and Future Directions. Sports Med. 2020, 50, 1889–1900. [Google Scholar] [CrossRef]
  2. Barnett, L.; Webster, E.; Hulteen, R.; De Meester, A.; Lenoir, M.; Pesce, C.; Valentini, N.; Getchell, N.; Lopes, V.; Robinson, L.; et al. Through the looking glass: A systematic review of longitudinal evidence providing new insight for motor competence and health. Sports Med. 2021, in press. [Google Scholar]
  3. Brian, A.; Bostick, L.; Starrett, A.; Klavina, A.; Miedema, S.T.; Pennell, A.; Stribing, A.; Gilbert, E.; Lieberman, L.J. The Effects of Ecologically Valid Intervention Strategies on the Locomotor Skills of Children With Visual Impairments. Adapt. Phys. Act. Q. 2020, 37, 177–192. [Google Scholar] [CrossRef]
  4. Brian, A.; Starrett, A.; Pennell, A.; Haibach-Beach, P.; Gilbert, E.; Stribing, A.; Miedema, S.T.; Lieberman, L. Longitudinal Locomotor Competence and BMI Across Self-Reported Gender and Vision Level for Youth With Visual Impairments: A three-Year Investigation. Adapt. Phys. Act. Q. 2021, 38, 268–285. [Google Scholar] [CrossRef]
  5. Brian, A.; Pennell, A.; Haibach-Beach, P.; Foley, J.; Taunton, S.; Lieberman, L.J. Correlates of physical activity among children with visual impairments. Disabil. Health J. 2019, 12, 328–333. [Google Scholar] [CrossRef]
  6. Ulrich, D.A. Test of Gross Motor Development: Examiner’s Manual, 2nd ed.; Pro-Ed: Austin, TX, USA, 2000. [Google Scholar]
  7. Ulrich, D.A. Test of Gross Motor Development: Examiner’s Manual, 3rd ed.; Pro-Ed: Austin, TX, USA, 2019. [Google Scholar]
  8. Cools, W.; De Martelaer, K.; Samaey, C.; Andries, C. Movement Skill Assessment of Typically Developing Preschool Children: A Review of Seven Movement Skill Assessment Tools. J. Sports Sci. Med. 2009, 8, 154–168. [Google Scholar]
  9. Eddy, L.H.; Bingham, D.D.; Crossley, K.L.; Shahid, N.F.; Ellingham-Khan, M.; Otteslev, A.; Figueredo, N.S.; Mon-Williams, M.; Hill, L.J.B. The validity and reliability of observational assessment tools available to measure fundamental movement skills in school-age children: A systematic review. PLoS ONE 2020, 15, e0237919. [Google Scholar] [CrossRef] [PubMed]
  10. Brian, A.; Taunton, S.; Lieberman, L.J.; Haibach-Beach, P.; Foley, J.; Santarossa, S. Psychometric Properties of the Test of Gross Motor Development-3 for Children With Visual Impairments. Adapt. Phys. Act. Q. 2018, 35, 145–158. [Google Scholar] [CrossRef]
  11. Bakke, H.A.; Cavalcante, W.A.; De Oliveira, I.S.; Sarinho, S.W.; Cattuzzo, M.T. Assessment of Motor Skills in Children With Visual Impairment: A Systematic and Integrative Review. Clin. Med. Insights Pediatr. 2019, 13. [Google Scholar] [CrossRef]
  12. Gallo, A.M.; Patton, K.; Sheehy, D.; Griffin, L. Assessment benefits and barriers: What are you committed to? J. Phys. Educ. Recreation Dance 2006, 77, 46–50. [Google Scholar] [CrossRef]
  13. Lund, J.L.; Veal, M.L. Assessment-Driven Instruction in Physical Education: A Standards-Based Approach to Promoting and Documenting Learning; Human Kinetics: Champaign, IL, USA, 2013. [Google Scholar]
  14. American Foundation for the Blind. Statistics about Children and Youth with Vision Loss. 2020. Available online: https://www.afb.org/research-and-initiatives/statistics/statistics-blind-children#gender19 (accessed on 15 January 2021).
  15. American Printing House for the Blind. School Experience for Children and Youth with Vision Loss. 2019. Available online: https://www.afb.org/research-and-initiatives/statistics/statistics-blind-children/school-experience (accessed on 15 January 2021).
  16. Diehl, M.; Wahl, H.-W.; Freund, A. Ecological Validity as a Key Feature of External Validity in Research on Human Development. Res. Hum. Dev. 2017, 14, 177–181. [Google Scholar] [CrossRef]
  17. Rooks-Ellis, D.L. Inquiry-Based Education for Students with Visual Impairment. ISRN Educ. 2014, 2014, 361685. [Google Scholar] [CrossRef] [Green Version]
  18. Haegele, J.; Zhu, X.; Holland, K. Fitness testing experiences in integrated physical education as reflected by adults with visual impairments. Eur. Phys. Educ. Rev. 2019, 26, 747–763. [Google Scholar] [CrossRef]
  19. Kline, R.B. Principles and Practice of Structural Equation Modeling. Can. Stud. Popul. 2018, 45, 188–195. [Google Scholar] [CrossRef]
  20. Duncan, M.J.; Roscoe, C.M.; Noon, M.; Clark, C.C.; O’Brien, W.; Eyre, E.L. Run, jump, throw and catch: How proficient are children attending English schools at the fundamental motor skills identified as key within the school curriculum? Eur. Phys. Educ. Rev. 2020, 26, 814–826. [Google Scholar] [CrossRef]
  21. Valentini, N.C. Validity and Reliability of the TGMD-2 for Brazilian Children. J. Mot. Behav. 2012, 44, 275–280. [Google Scholar] [CrossRef]
  22. Zijlstra, G.R.; Ballemans, J.; Kempen, G.I. Orientation and mobility training for adults with low vision: A new standardized approach. Clin. Rehabil. 2012, 27, 3–18. [Google Scholar] [CrossRef] [Green Version]
  23. Chokron, S.; Dutton, G.N. Impact of Cerebral Visual Impairments on Motor Skills: Implications for Developmental Coordination Disorders. Front. Psychol. 2016, 7, 1471. [Google Scholar] [CrossRef] [Green Version]
  24. Lieberman, L.J.; Haibach, P.; Wagner, M.O. Let’s play together: Sports equipment for children with and without visual impairments. Palaestra 2014, 28, 13–15. [Google Scholar]
  25. Ulrich, D.A. Introduction to the Special Section: Evaluation of the Psychometric Properties of the TGMD-3. J. Mot. Learn. Dev. 2017, 5, 1–4. [Google Scholar] [CrossRef]
  26. Hooper, D.; Coughlan, J.; Mullen, M. Evaluating model fit: A synthesis of the structural equation modelling literature. In Proceedings of the 7th European Conference on Research Methodology for Business and Management Studies, Regent’s College, London, UK, 19–20 June 2008; pp. 195–200. [Google Scholar]
  27. Anderson, J.C.; Gerbing, D.W. Structural equation modeling in practice: A review and recommended two-step approach. Psychol. Bull. 1988, 103, 411–423. [Google Scholar] [CrossRef]
  28. Long, J.S. Confirmatory Factor Analysis: A Preface to LISREL; Sage Publications: New York, NY, USA, 1983; Volume 33. [Google Scholar]
  29. Muthén, L.K.; Muthén, B.O. Mplus User’s Guide; Angeles, L., Ed.; Muthén & Muthén: Los Angeles, CA, USA, 2017. [Google Scholar]
  30. Mueller, R.O.; Hancock, G.R. Best Practices in Structural Equation Modeling. In Best Practices in Quantitative Methods; Osborne, J., Ed.; Sage Publications: New York, NY, USA, 2011; pp. 488–508. [Google Scholar] [CrossRef] [Green Version]
  31. Fornell, C.; Larcker, D.F. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J. Mark. Res. 1981, 18, 39. [Google Scholar] [CrossRef]
  32. McIntire, S.; Miller, L. Foundations of Psychological Testing: A Practical Approach, 2nd ed.; Sage Publications: New York, NY, USA, 2007. [Google Scholar]
  33. McCowan, R.J.; McCowan, S.C. Item Analysis for Criterion-Referenced Tests, Online Submission. 1999. Available online: https://eric.ed.gov/?id=ED501716 (accessed on 15 January 2021).
Table 1. Descriptive statistics for individual skills.
Table 1. Descriptive statistics for individual skills.
Gross Motor SkillMeanSDSkewnessKurtosisItem DifficultyItem Discrimination
Locomotor Skills
Run5.392.53−0.71−0.620.310.60
Gallop4.062.37−0.47−0.890.050.47
Hop4.162.41−0.07−0.880.130.61
Skip2.972.23−0.22−1.330.170.73
Jump5.062.41−0.43−0.870.230.74
Slide6.512.22−1.722.150.530.51
Object Control Skills
Two-handed Strike6.702.44−0.49−0.420.150.64
One-handed Strike3.802.60−0.15−1.170.080.37
Dribble3.992.22−0.70−1.000.420.59
Catch3.331.690.17−0.900.160.67
Kick4.132.34−0.03−0.950.110.50
Overhand Throw3.193.060.35−1.440.150.68
Underhand Throw5.212.10−0.920.530.150.42
Table 2. Correlations among motor skills.
Table 2. Correlations among motor skills.
Locomotor SkillsObject Control Skills
RunGallopHopSkipJumpSlideTwo-Handed StrikeOne-Handed StrikeDribbleCatchKickOverhand ThrowUnderhand Throw
Run1
Gallop0.351
Hop0.450.241
Skip0.510.280.451
Jump0.480.270.450.461
Slide0.450.290.360.280.401
Two-handed Strike0.490.360.480.550.440.341
One-handed Strike0.500.300.480.420.420.320.551
Dribble0.530.270.490.400.450.340.480.531
Catch0.530.270.410.460.430.310.560.490.501
Kick0.570.260.420.390.480.390.540.490.550.471
Overhand Throw0.500.280.430.470.500.250.500.540.560.570.501
Underhand Throw0.520.360.300.380.360.460.420.500.410.420.380.441
Note. All correlations are significant at p < 0.001.
Table 3. Fit indices for the measurement model of various versions of the TGMD-3.
Table 3. Fit indices for the measurement model of various versions of the TGMD-3.
Model chi-Square
Modelchi-Squaredfpchi/dfCFISRMRRMSEARMSEA 90% CI
TGMD-379.39640.0931.240.9860.0390.0280.000, 0.047
STAT-610.4580.2351.310.9940.0320.0320.000, 0.079
V-67.4480.4900.931.0000.0210.0000.000, 0.064
SPT-618.0780.0212.260.9750.0330.0650.024, 0.105
Table 4. Psychometric properties of the latent traits and motor skills that constitute each model.
Table 4. Psychometric properties of the latent traits and motor skills that constitute each model.
Latent TraitIndicatorsResults for Indicators (Skills)Results for Composites
Standardized LoadingEstimate/s.e.Item ReliabilityComposite ReliabilityVariance Extracted
TGMD-3
LocomotorRun0.75923.73 **0.5760.790.39
Gallop0.4348.32 **0.188
Hop0.63615.65 **0.405
Skip0.66016.85 **0.436
Jump0.66617.08 **0.443
Slide0.54011.41 **0.292
Object ControlTwo-handed Strike0.74119.44 **0.5490.870.50
One-handed Strike0.72117.90 **0.520
Dribble0.71417.47 **0.510
Catch0.70817.01 **0.501
Kick0.70116.63 **0.492
Overhand Throw0.73018.52 **0.533
Underhand Throw0.61512.20 **0.379
STAT-6
LocomotorRun0.75117.10 **0.5630.700.42
Hop0.63412.93 **0.401
Slide0.54610.49 **0.298
Object ControlOne-handed Strike0.73316.10 **0.5370.790.55
Dribble0.76217.72 **0.580
Overhand Throw0.73015.91 **0.534
V-6
LocomotorRun0.72715.93 **0.5290.630.37
Gallop0.4387.78 **0.192
Hop0.61812.84 **0.381
Object ControlTwo-handed Strike0.74617.00 **0.5560.770.53
Kick0.73316.24 **0.537
Overhand Throw0.69714.51 **0.485
SPT-6
LocomotorRun0.73618.34 **0.5420.720.47
Hop0.62813.72 **0.394
Skip0.68015.74 **0.463
Object ControlTwo-handed Strike0.75516.62 **0.5700.720.46
Kick0.68613.81 **0.471
Underhand Throw0.58210.15 **0.339
Note. ** denotes p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Brian, A.S.; Starrett, A.; Pennell, A.; Beach, P.H.; Miedema, S.T.; Stribing, A.; Gilbert, E.; Patey, M.; Lieberman, L.J. The Brief Form of the Test of Gross Motor Development-3 for Individuals with Visual Impairments. Int. J. Environ. Res. Public Health 2021, 18, 7962. https://doi.org/10.3390/ijerph18157962

AMA Style

Brian AS, Starrett A, Pennell A, Beach PH, Miedema ST, Stribing A, Gilbert E, Patey M, Lieberman LJ. The Brief Form of the Test of Gross Motor Development-3 for Individuals with Visual Impairments. International Journal of Environmental Research and Public Health. 2021; 18(15):7962. https://doi.org/10.3390/ijerph18157962

Chicago/Turabian Style

Brian, Ali S., Angela Starrett, Adam Pennell, Pamela Haibach Beach, Sally Taunton Miedema, Alexandra Stribing, Emily Gilbert, Matthew Patey, and Lauren J. Lieberman. 2021. "The Brief Form of the Test of Gross Motor Development-3 for Individuals with Visual Impairments" International Journal of Environmental Research and Public Health 18, no. 15: 7962. https://doi.org/10.3390/ijerph18157962

APA Style

Brian, A. S., Starrett, A., Pennell, A., Beach, P. H., Miedema, S. T., Stribing, A., Gilbert, E., Patey, M., & Lieberman, L. J. (2021). The Brief Form of the Test of Gross Motor Development-3 for Individuals with Visual Impairments. International Journal of Environmental Research and Public Health, 18(15), 7962. https://doi.org/10.3390/ijerph18157962

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop