Next Article in Journal
Children’s Self-Perceived and Actual Motor Competence in Relation to Their Peers
Next Article in Special Issue
Review of Short-Form Questions for the Evaluation of a Diet, Physical Activity, and Sedentary Behaviour Intervention in a Community Program Targeting Vulnerable Australian Children
Previous Article in Journal
Food Allergy Perceptions and Health-Related Quality of Life in a Racially Diverse Sample
Previous Article in Special Issue
The Feasibility of a Novel School Peer-Led Mentoring Model to Improve the Physical Activity Levels and Sedentary Time of Adolescent Girls: The Girls Peer Activity (G-PACT) Project
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Children
Volume 5
Issue 6
10.3390/children5060071
children-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Self-Reported Physical Activity is Not a Valid Method for Measuring Physical Activity in 15-Year-Old South African Boys and Girls

by
Makama Andries Monyeki
1,*,
Sarah J. Moss
1,
Han C.G. Kemper
2 and
Jos W.R. Twisk
2,3
1
Physical Activity, Sport and Recreation Focus Area; Faculty of Health Sciences, North-West University, Potchefstroom 2520, South Africa
2
Amsterdam Public Health Research Institute, VU University Medical Centre, De Boelelaan 1085, 1081 HV Amsterdam, The Netherlands
3
Department of Clinical Epidemiology and Biostatistics and EMGO-institute, Vrije Universiteit Medical Centre (VUmc), Vd Boechorststraat 7, 1081 BT Amsterdam, The Netherlands
*
Author to whom correspondence should be addressed.
Children 2018, 5(6), 71; https://doi.org/10.3390/children5060071
Submission received: 27 February 2018 / Revised: 30 May 2018 / Accepted: 1 June 2018 / Published: 6 June 2018
(This article belongs to the Special Issue Physical Activity and Sedentary Behaviour in Children and Adolescents)
Browse Figure
Versions Notes

Abstract

:
Physical activity plays an important role in the prevention of chronic lifestyle-related diseases. The development of valid instruments for the assessment of physical activity remains a challenge in field studies. The purpose of the present study was therefore to determine the level of agreement between physical activity objectively measured by the ActiHeart® (Cambridge Neurotechnology Ltd, Cambridge, UK) device and subjectively reported physical activity by means of the International Physical Activity Questionnaire Short Form (IPAQ-SF) among adolescents attending schools in the Tlokwe Local Municipality, South Africa. A cross-sectional study design was used with a total of 63 boys and 45 girls aged 15 years who took part in the Physical Activity and Health Longitudinal Study (PHALS). Stature and weight were measured according to standard International Society for the Advancement of Kinanthropometry (ISAK) protocols. Objective physical activity (PA) was measured by a combined heart rate and accelerometer device (ActiHeart®) for seven consecutive days. Time spent in moderate-to-vigorous intensity physical activity (MVPA) was assessed. Subjective physical activity was assessed with the self-reported IPAQ-SF. Objective PA indicated that 93% of the participants were inactive and only 6% were highly active. The IPAQ-SF showed that 24% were inactive, with 57% active. A non-significant correlation (r = 0.11; p = 0.29) between the ActiHeart® measure of activity energy expenditure (AEE) and total physical activity (IPAQ-SF) was observed. The Bland–Altman plot showed no agreement between the two measurement instruments and also a variation in the level of equivalence. When Cohen’s kappa (κ) was run to determine the agreement between the two measurement instruments for estimated physical activity, a poor agreement (κ = 0.011, p < 0.005) between the two was found. The poor level of agreement between the objective measure of physical activity (ActiHeart®) and the IPAQ-SF questionnaire should be interpreted cautiously. Future physical activity research using a combination of subjective and objective assessment methods in a large-scale cohort in adolescents is recommended.

1. Introduction

Studies indicate the important role of regular physical activity in the prevention of chronic diseases related to lifestyle [1,2]. Increased physical activity participation is highly recommended in order to decrease morbidity and mortality [3,4]. Since engagement in physical activity during childhood is found to track into adulthood [5] it is imperative to encourage children to sustain physically active lifestyles. To promote appropriate levels of physical activity in children, it is imperative to have precise measurement methods of physical activity in epidemiological studies [6].
Numerous methods in assessing physical activity are well documented [7,8,9,10]. It is ideal for physical activity instruments to capture all domains of physical activity, such as activity levels (i.e., low, moderate, and high intensities) during and after school, on week and weekend days, and during commuting, as well as sport and leisure activity and sedentary time [5,11,12,13,14]. Accurate assessments of physical activity are important for the advancement of research [15], especially in children [16]. Moreover, the selection of a method to determine physical activity must be based on careful consideration of the advantages and disadvantages of the instrument, as well as indications for application and evidence to support that the instrument is reliable and valid [6,17]. An objective measure of physical activity is ideal [18], but impossible to perform in large populations, and therefore alternative simple assessment methods of habitual physical activity are necessary [19]. Assessing physical activity is fraught with difficulties as it is multidimensional, and no single method can capture all subcomponents and domains in the activity of interest. Crude measures of physical activity may have led to inconsistent and false-negative results for the association between physical activity (or inactivity) and disease risk in epidemiological studies [20]. It has been alluded that the International Physical Activity Questionnaire (IPAQ), a physical activity questionnaire designed by a multinational working group as a common instrument for epidemiological studies, is suitable to use in adolescents from different settings [21,22]. Furthermore, IPAQ is the most commonly used subjective tool for evaluating physical activity because of its cost effectiveness and relative ease of use in large samples [23].
The differences between physical activity measure instruments (objective and subjective), result in the inability to compare physical activity levels between studies. Cross-validation between measurement instruments allows researchers to compare physical activity data across different methodologies, should the unit of measure be similar. Truthfully, validity should be reported as the degree of agreement between methods [24] because correlation coefficients in accordance with Schmidt and Steindorf’s [25] opinion may be misleading. A reliable questionnaire that overestimates physical activity to a large extent may correlate highly with an objective physical activity instrument [26,27]; these two measurements correlate but disagree. Such a questionnaire is considered valid to rank individuals (validity at the population level) but is not valid to measure physical activity with an absolute score (lack of validity at the individual level). Usually, self-reported instruments such as questionnaires show moderate to good reliability, but poor to moderate criterion validity (i.e., correlation coefficients of about r = 0.30 to 0.40), and absolute validity is often poor [14,22]. There seem to be sparse studies in South Africa which investigate the level of agreement between subjective and objective measures of physical activity. In addition, the current study may respond to a vital call made in the body of literature regarding the validation of physical activity questionnaires against criterion measures in studies on children [28,29,30,31]. The purpose of this study was therefore to determine the level of agreement between objectively measured physical activity by means of combined heart rate and accelerometry, ActiHeart® (Cambridge Neurotechnology Ltd, Cambridge, UK) and the International Physical Activity Questionnaire Short Form (IPAQ-SF) among adolescents attending high schools in the Tlokwe Local Municipality of South Africa.

2. Methods

2.1. Participants

A cross-sectional study design was performed with a total of 63 boys and 45 girls aged 15 years who took part in the Physical Activity and Health Longitudinal Study (PHALS) [32]. Demographic information on age, gender, race, and socio-economic background (township or town) were assessed from the participants’ information. In addition, participants were asked to indicate their sport participation with the question: ‘Do you participate in sport?’. The question was answered by indicating “Yes” or “No”. Stature (cm) and weight (kg) were measured according to standard International Society for the Advancement of Kinanthropometry (ISAK) protocol [33].
Prior to the study, permission to conduct the measurements was granted by the District Manager of the Department of Education in Potchefstroom, South Africa. The protocol was approved by the Ethics Committee of the North-West University (Ethics number: NWU-0058-01-A1) of the Potchefstroom campus. Parents or guardians gave permission for their children to participate in the study, and participants provided informed assent for participation in the study. More details about the study are described elsewhere [32].

2.2. Objectively Measured Physical Activity

Physical activity was objectively measured using a combined heart rate and accelerometer device. The Actiheart® instrument is a chest-mounted, light weight (10 g) instrument that uses synchronized heart rate (HR) and piezoelectric accelerometery data. This signal is converted to beats per minute (BPM) and written to the memory at the end of each epoch. The measurable range of HR in the manufacturer specification is 31–350 beat per minute, after which it was clipped onto two electrocardiography (ECG) electrodes on the left side of the chest according to the manufacturer’s instructions and recommendations detailed elsewhere [34]. Participants were told to wear the Actiheart® device for 24 h for seven consecutive days. Activity data were recorded in 60-s epochs. The participants were instructed to carry on with their habitual lifestyle, keep the monitor on at all times (when awake and asleep), and only remove it when bathing, swimming, or partaking in high-impact sports (like rugby). Objective and subjective data were collected from August to October of 2011 during regular school term and weekend days. Data from the ActiHeart® device were downloaded with commercial software (Version 2. 132, Cambridge Neurotechnology Ltd. Cambridge, UK). The software also recovered missing data by interpolating missing and noisy heart rates. The data were also trimmed to remove data of wear periods longer than seven days. The software helped in determining wear time and no-wear time as per the following categories: Actiheart® software ‘OK’, ‘revered’, ‘interpolated’, ‘lost’, or ‘not worn’. Only accelerometer counts recorded under the classification ‘OK’, ‘recovered’ or ‘interpolated’ were used for calculating time spent in physical activity; this showed that Actiheart® was detecting a signal, suggesting wear time. Recordings classified as ‘lost’ and ‘not worn’ were excluded from the analyses. Data from adolescents who wore the device for a minimum of four days (one of which was a weekend day) and for at least ten hours per day were included in the analysis.
Physical activity level (PAL) was calculated by dividing total energy expenditure (TEE) by estimated resting metabolic rate (RMR). The PAL cut-off points as described by the United Nations Food and Agriculture Organization (2001) are as follows: Sedentary (<1.40); light (1.40–1.60); moderate (1.61–1.99); heavy (2.00–2.40) and extremely heavy (>2.40). Heavy and extremely heavy physical activity scores were considered as ‘high’ [17]. The MET cut-off points which describe the intensity level of the physical activity were: Sedentary (<1.5 METs); light (1.5–3 METs); and moderate-to-vigorous (>3.0 METs) [34]. The CPM activity cut-offs for children aged 6–17 years were: sedentary (0–149 CPM); light (150–499 CPM); moderate (500–3999 CPM); vigorous (4000–7599 CPM) and very vigorous (>7600 CPM) [34]. Physical inactivity was described as performing insufficient amounts of physical activity, that is, not meeting specified physical activity guidelines [34]. The ActiHeart® has been validated against doubly labeled water (DLW) in adults (r = 0.53, r2 = 0.29, p < 0.05) and adolescents (r = 0.23, r2 = 0.05, p = 0.36) [34].

2.3. Measurement of Subjective Physical Activity

Subjective PA was assessed using the IPAQ-SF [35,36,37], which was reported to be a valid and reliable tool for assessing PA [37]. The IPAQ-SF is considered suitable for use by adolescents in different settings [38] and the short form consists of seven items which identify the frequency and time spent in walking and engaging in other moderate-to-vigorous intensity PA during the seven days prior to administering the questionnaire. Only physical activity sessions that lasted ten minutes or more were analyzed with the IPAQ-SF. The IPAQ-SF also elicits information about time spent sitting, which is used as an indicator of sedentary time/behavior. The IPAQ-SF questionnaire was assessed after the ActiHeart® was worn for seven consecutive days in order to be aligned with the objective physical activity recorded. To determine the intensity of the physical activity the METs were determined. Physical activity was classified into four categories in accordance with IPAQ Research Committee [37] classifications, namely: Low activity (METs < 3), moderate activity (METs 3–6), and vigorous activity (METs > 6). The debate and inconclusive agreement [38,39] on the use of the three or four METs in children may have affected the results of IPAQ-SF questionnaire. As such, we chose the use of METs in the current study based on the current physical activity (PA) guidelines for children and adolescents also using the METs to define moderate and vigorous activity [40]. Total physical activity (TPA) was calculated by adding all physical activity categories scores performed in seven days of the week.

2.4. Statistical Analyses

Statistical analyses were performed with the use of IBM SPSS (IBM Corp. Released 2017. IBM SPSS Statistics for Windows, Version 25.0. Armonk, NY: IBM Corp.) which is available from the North-West University network systems. Descriptive statistics (mean, min, maximum, standard deviation) and frequencies were determined. The Mann–Whitney U test was performed to determine the significant differences between males and females. The Bland–Altman method for continuous data and kappa (κ) for categorical data between ActiHeart® and IPAQ-SF were applied. Cohen’s κ was calculated to measure the magnitude of agreement between objective physical activity measures determined with the ActiHeart® and subjective physical activity with the IPAQ-SF. Spearman rank correlation coefficients (r) were calculated to determine the association between ActiHeart® and the IPAQ-SF. Dixon and Pechmann [41], as well as Welk [42] describe the equivalence test as a technique that is used to examine measurement agreement (in the case of the current study it would be ActiHeart® vs. IPAQ-SF). The approach implies that the null hypothesis states that the two methods are equal. Should the null hypothesis be accepted, the suggestion is that there is “no evidence of a difference”; however, Hauck and Anderson [43] argue that this “does not necessarily imply that there is evidence of equivalence”. As such, in equivalence tests, the null hypothesis is flipped to specify a difference between two means, thereby allowing a direct test of equivalence [44]. In our analysis, a 95% equivalence test (i.e., α = 5%) would help to conclude that ActiHeart® and IPAQ-SF are considered significantly equivalent to each other if a 90% of confidence interval (CI) for the mean of the ActiHeart® method falls into a proposed equivalence zone (i.e., ±10% of the mean) of the IPAQ-SF. Since the PA data of both subjective (IPAQ-SF) and objective (ActiHeart®) measurements were not normally distributed, the equivalence test was calculated by the use of a one-sample t-test and the non-parametric Wilcoxon signed-rank test to examine respectively the differences and the level of agreement between the differences between the two methods and the mean of the two methods. The differences between the averages of subjective (IPAQ-SF) (y-axis) and objective (ActiHeart®) methods were plotted against the average (x-axis) of the objective and subjective methods in the Blant–Altman graph (Figure 1). Significance was set at a level of p ≤ 0.05.

3. Results

The male participants were significantly taller and heavier (Table 1) as compared to their female counterparts. Data from ActiHeart® show a significant gender difference for activity energy expenditure (AEE) in favor of the girls. With regard to IPAQ-SF, though not significant, boys showed higher mean values as compared to girls with respect to total physical activity.
Out of 108 participants, 90 (83%) adolescents participated in school sport, with 18 (17%) not taking part in any school sports. Male participants 50 (78%) participated less in sport compared to their female counterparts (n = 40; 91%). A total of 174 adolescents were issued with an Actiheart®, of which 108 (62%) successfully adhered to wear time and 66 (38%) did not comply with wear time or presented with incomplete IPAQ-SF information. No bias was observed between participants with complete data sets and those with incomplete data sets.
Data on the intensity of the physical activity from the ActiHeart® classified 93% of the adolescents as low active, with only 1% moderately active and 6% vigorously active (Table 2).
The data from the IPAQ-SF, in contrast with the ActiHeart® data, classified physical activity participation as 24% low active, 19% moderately active, and 57% highly active, with a Cohen’s κ of 0.011. Based on the guidelines from Altman [45], and adapted from Landis and Koch [46], a κ of 0.011 represents a poor strength of agreement. Furthermore, since p = 0.068 (which actually means p < 0.0005), our κ coefficient is statistically on the borderline of being significantly different from zero. When the Pearson Chi-square test was used to determine the observed distribution, a value of 4.88 with a p-value of 0.30 was found.
Results from the Spearman correlation coefficients indicated a significant positive correlation (r = 0.11; p = 0.29) between the ActiHeart® measure of AEE and total physical activity (IPAQ-SF). However, the one t test of nonparametric technique revealed that the mean differences between the mean values of the two methods were statistically significant (t = −17.581, mean = −1415.8279; p = 0.001).
The measurement of agreement between the two physical activity measuring methods, assessed using a Bland–Altman plot, are shown in Figure 1. The Bland–Altman plots showed the differences between the two methods and the mean of the two methods to have poor limits of 95% confidence interval (CI) agreement (mean difference of −1415.8279; 95% CI −1575.5395 to −1256.1162; inter-method difference 1.96 SD of the differences). The mean differences between the two methods were scattered with no linearity along the liner line. The low percentage of vigorous PA as recorded with the Actiheart® may be the reason for a non-linear association with relatively high values determined by IPAQ-SF. The Wilcoxon tests for the two one-sided tests used to test equivalence between the differences of subjective and objective PA are presented in Table 3. The probability level for equivalence test is less than the designated value of α (p < 0.05) (Z = −8.63; p < 0.001); we can reject the null hypothesis and conclude that the medians are equivalent for an equivalence margin of 1. Thus, the test required no assumption that the differences are normal. The results, therefore, show considerable variations in the individual differences between IPAQ-SF and Actiheart®, with yielded non-equivalent overestimation by IPAQ-SF self-reporting, as demonstrated by 57% of individuals being reported in the highly active category. Therefore, no agreement was found between the two measurement instruments.

4. Discussion

The purpose of the study was to determine the level of agreement between objectively measured physical activity (ActiHeart®) and the subjective measurement of physical activity with the IPAQ-SF among adolescents attending high schools in the Tlokwe Local Municipality of South Africa. The results show no significant level of agreement between ActiHeart® and the IPAQ-SF in the assessment of physical activity. Additionally, there is no significant level of equivalence between the two methods for assessing physical activity. The reason for the low level of agreement observed in the study may be explained in part by the greater level of variability that was apparent for self-reported measures compared to objective measures.
A low non-significant positive correlation (r = 0.11; p = 0.29) between AEE (ActiHeart®) and total IPAQ-SF was found. The observed findings were somewhat similar to a study on primary school girls in Cape Town done by Mciza et al. [5] with the use of physical activity questionnaire (PAQ) and ACTIVITYGRAM, whereby in their study a significant positive association (p = 0.19; p < 0.001 and p = 0.26; p < 0.001 respectively) between PAQ-SF and intensity activities by ACTIVITYGRAM was reported. Furthermore, the observed low correlation was congruent with the findings from a review study by Helmerhorst et al. [10]. A similar correlation coefficient between ActiHeart® and IPAQ-SF was reported in 24 boys and six girls aged between 16 and 20 in an Italian high school [47]. The lack of equivalence between the mean differences of ActiHeart and IPAQ-SF is somewhat incongruent with a study by Kim et al. [29] which compared the validity of Actigraph 2-regression models (2RM) and 1-regression models (1RM) for estimation of energy expenditure. It was revealed that none of the two 2RMs and four 1RMs were significantly equivalent to the indirect calorimetry method for both overall group comparisons and activity-specific comparison (with the exception of one activity with the Treuth 1 regression model (TH1RM)).
The lack of agreement between ActiHeart® and the IPAQ-SF in our current study may be attributed to the well-known over-reporting of physical activity, which is mostly characterized by the problem of systematically recalling the exact activities performed in the previous seven days [13]. Additionally, there were coding errors with misclassification of intensity, duration, and frequency of PA bouts [47]. Vadone et al. [47] alluded that even a small variation in the expression and interpretation of PA recommendations has an enormous impact on the interpretation of objectively-derived estimates of physical activity. Assah and colleagues [48] report that a high prevalence of labor-intensive work involving activities such as digging, lifting, and load-carrying in rural dwellers reduced the amount of inter-individual variance in physical activity energy expenditure (PAEE) captured by the ActiHeart® device, ultimately affecting the accuracy of the estimation for the more highly active subsample. Another reason for the observed of lack of agreement in the present study may be that participants reached a reporting threshold of a high level for physical activity scores (53%) with the IPAQ-SF as compared to ActiHeart (6%). While the types of activities performed by both township and urban adolescent learners would be significantly different compared with the types of sporting activities engaged in by the current sample, a high prevalence of different types of extracurricular sport and physical activity participation for many individuals in our sample (reported by IPAQ-SF) may also have reduced the degree of interindividual variability in PAEE. In establishing adolescent-specific PAEE prediction equations, particular attention should be afforded to accounting for the variation in activity levels and range of physical activities typical of the day-to-day behavioral patterns exhibited by this population. The equations used by the ActiHeart® to estimate energy expenditure (EE) in adolescents were derived using data from 39 children aged 12–13 years during a treadmill protocol [49]. Additionally, this may be another reason for the lack of agreement between the two instruments since activities used during laboratory differ from activities performed in free-living settings [50,51,52], especially in the South African context. There exists a need to develop adolescent-specific prediction equations and validation of ActiHeart® against a criterion reference standard with a population-specific cut-point [51] since inconsistency in the cut-points exists [8,44]. Hence, there is need for more comparative studies of the PA with the IPAQ-SF and ActiHeart® for school-going adolescents [51], as some authors question the ability of the ActiHeart® to accurately measure AEE in free-living adolescents [49,51]. Developmental differences between children, adolescents, and adults, in terms of metabolic costs and movement economy [53], impact the aerobic demand of activity for each age group. More specifically, biomechanical differences in walking and running between children, adolescents, and adults (e.g., faster stride rates, a higher body surface to body mass ratio, and greater muscle coactivation of the leg muscles), make children less economical compared with adolescents [54] and adolescents less economical in contrast to adults [55]. In spite of the advantages of objective measures like ActiHeart®, Barreira and colleagues [8] caution us about the inappropriate of this device for quantification of activities other than walking and running. For example, on studying the Actiheart monitor and other comparable measures, Actiheart® underestimated energy expenditure for only one workload (jogging at 9.6 km/h) [8]. In a 2014 review by Hills and co-workers, the use of combined methods for assessing physical activity is highly recommended [13], since the use of subjective measures of PA have the potential to provide rich descriptive data, while objective instruments provide true reflection of the activity.

Limitations

To our knowledge this is the first study to determine the level of agreement between the ActiHeart® device and the IPAQ-SF in 15-year-old South African boys and girls. A lack of age appropriate group-based prediction equations may have limited the validity of the ActiHeart® device for assessing school-going AEE in adolescents [10]. The absence of conducting the calibration step test during the set-up of the device might have influenced the results obtained and should in future be part of the standard protocol. The adolescents’ PA could have been influenced by the wearing of the ActiHeart® device in the sense that they could have been more conscious of their own physical activity levels [52].
The scales of the outcome scores between ActiHeart and the IPAQ-SF are not the same since physical activity with IPAQ-SF is based on activity recall that assesses the individual ability to keep track of time, while physical activity with ActiHeart is based on the real-time physical activity that is performed. These factors may have contributed to lack of agreement between the two instruments. The IPAQ-SF sought information on the frequency and time spent in walking and engaging in other forms of moderate-to-vigorous intensity PA as well as time spent sitting, which is used as an indicator of inactivity on the one hand. The absence of the regression models in the analyses of the study (as done by Kim et al. [29]) may limit result comparison, of which further studies should make use of all different models of analyses to determine the level of agreement between physical activity measuring instruments. The reliance of adolescents to tell us when they last performed physical activity may have led to measured resting values being higher than expected, and as such might have had potential to affect activity-related METs values since an elevated resting MET value would result in lower activity METs [38]. As such, reliance of adolescents to provide information about PA is a limitation of this study. Additionally, caution is needed in the interpretation of a subjective measure like IPAQ-SF, since it has been reported that the questionnaire lacks the precision needed to detect physical activity on a day-to-day basis [12,56], which may have contributed to the low level of agreement between the two measurement instruments.

5. Conclusions

Our results showed substantial differences in the prevalence estimates between subjective measured physical activity compared to objective criterion measures. ActiHeart® indicated that almost all the adolescents in the study were in the low physical activity category, while physical activities by questionnaire showed that 43% adolescents participated in low to moderate activity, with 57% participating in high-intensity physical activity. A poor level of agreement was found between the objective measure of physical activity by ActiHeart® and subjective IPAQ-SF methods. Thus, the use of a combination of subjective and objective physical activity assessment methods in large-scale adolescent cohorts is recommended for future physical activity research.

Author Contributions

M.A.M. is a primary investigator in the PAHLS, conceptualized and prepared the write-up of the manuscript, and analyzed the data. S.J.M., participated in the PAHL study and the write-up of the manuscript. J.W.R.T. played an important role in advice concerning the analysis and commented on the final version of the manuscript. H.C.G.K. contributed critical comments on the write-up and finalization of the manuscript. All authors read and approved the final manuscript.

Funding

This material is based upon work supported financially by the National Research Foundation (NRF) and the Medical Research Council of South Africa (MRC).

Acknowledgments

The cooperation of the District Office of the Department of Education, school authorities, teachers, parents, and children of the Tlokwe Municipality is greatly appreciated. We thank the fourth-year (2010–2014 honors group) students in the School of Biokinetics, Recreation and Sport Science, and Sandra Dube-Wushe for their assistance in the collection of the data. The vital guidance of Esté Vorster (NWU) in the inception of the PAHLS is greatly appreciated. In addition, the contribution of the PAHLS Research Team (Ankebè Kruger, Ben Coetzee, and Cindy Pienaar, Erna Bruwer, Mariette Swanepoel, Martinique Sparks, Dorita Du Toit) is highly appreciated.

Conflicts of Interest

All the authors declare that they have no competing interests.

Disclaimer

Any opinion, findings and conclusions or recommendations expressed in this material are those of the authors and therefore the NRF and MRC do not accept any liability in this regard.

References

  1. Montgomery, C.; Reilly, J.J.; Jackson, D.M.J.; Kelly, L.A.; Slater, C.; Paton, J.Y.; Grant, S. Relationship between physical activity and energy expenditure in a representative sample of young children. Am. J. Clin. Nutr. 2004, 80, 591–596. [Google Scholar] [CrossRef] [PubMed]
  2. World Health Organisation (WHO). Global Recommendations on Physical Activity for Health; WHO: Geneva, Switzerland, 2010. [Google Scholar]
  3. Haskell, W.L.; Lee, I.M.; Pate, R.R.; Powell, K.E.; Blair, S.N.; Franklin, B.A.; Macera, C.A.; Heath, G.W.; Thompson, P.D.; Bauman, A. Physical activity and public health: Updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med. Sci. Sports Exerc. 2007, 39, 1423–1434. [Google Scholar] [CrossRef] [PubMed]
  4. Bonomi, A.G.; Westerterp, K.R. Advances in physical activity monitoring and lifestyle intervention in obesity: A review. Int. J. Obes. 2012, 36, 167–177. [Google Scholar] [CrossRef] [PubMed]
  5. Mciza, Z.J.; Goedecke, J.H.; Lambert, E.V. Validity and reliability of a physical activity/inactivity questionnaire in South African primary schoolgirls. S. Afr. J. Sports Med. 2007, 19, 117–123. [Google Scholar] [CrossRef]
  6. Haskell, W.L.; Blair, S.N.; Hill, J.O. Physical activity: Health outcomes and importance for public health policy. Prev. Med. 2009, 48, 280–282. [Google Scholar] [CrossRef] [PubMed]
  7. Montoye, H.J.; Kemper, H.C.G.; Saris, W.H.M.; Washburn, R.A. Measuring Physical Activity and Energy Expenditure; Human Kinetics: Champaign, IL, USA, 1996. [Google Scholar]
  8. Barreira, T.V.; Kang, M.; Caputo, J.L.; Farley, R.S.; Renfrow, M.S. Validation of the Actiheart monitor for measurement of physical activity. Int. J. Exerc. Sci. 2009, 2, 60–71. [Google Scholar]
  9. Loney, T.; Standage, M.; Thompson, D.; Sebire, S.J.; Cumming, S. Self-reported vs. objectively assessed physical activity: Which is right for public health? J. Phys. Act. Health 2011, 8, 62–70. [Google Scholar] [CrossRef] [PubMed]
  10. Helmerhorst, H.J.F.; Brage, S.; Warren, J.; Besson, H.; Ekelund, U. A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int. J. Behav. Nutr. Phys. Act. 2012, 9, 103. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Ainsworth, B.E. How do I measure physical activity in my patients? Questionnaires and objective methods. Br. J. Sports Med. 2009, 43, 6–9. [Google Scholar] [CrossRef] [PubMed]
  12. Schneller, M.B.; Pedersen, M.T.; Gupta, N.; Aadehl, M.; Holtermann, A. Validation of five minimally obstructive methods to estimate physical activity energy expenditure in young adults in semi-standardized settings. Sensors 2015, 15, 6133–6151. [Google Scholar] [CrossRef] [PubMed]
  13. Hills, A.P.; Mokhtar, N.; Byrne, N.M. Assessment of physical activity and energy expenditure: An overview of objective measures. Nutrition 2014, 11, 1–16. [Google Scholar] [CrossRef] [PubMed]
  14. Sallis, J.F.; Saelens, B.E. Assessment of physical activity by self-report: Status, limitations, and future directions. Res. Q. Exerc. Sport 2000, 71, S1–S14. [Google Scholar] [CrossRef] [PubMed]
  15. Welk, G.J.; Wood, K. Physical activity assessments in physical education—A practical review of instruments and their use in the curriculum. J. Phys. Educ. Recreat. Dance 2000, 71, 30–40. [Google Scholar] [CrossRef]
  16. Koplan, J.P.; Liverman, C.T.; Kraak, V.I. Predicting childhood obesity: Health in the balance: Executive summary. J. Am. Diet. Assoc. 2005, 105, 131–138. [Google Scholar] [CrossRef] [PubMed]
  17. Treuth, M.S.; Hou, N.Q.; Young, D.R.; Maynard, L.M. Validity and reliability of the Fels Physical Activity Questionnaire for children. Med. Sci. Sports Exerc. 2005, 37, 488–495. [Google Scholar] [CrossRef] [PubMed]
  18. Brage, S.; Brage, N.; Franks, P.W.; Ekelund, U.; Wareham, N.J. Reliability and validity of the combined heart rate and movement sensor Actiheart. Eur. J. Clin. Nutr. 2005, 59, 561–570. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Rennie, K.L.; Waren, N.J. The validation of physical activity instruments for measuring energy expenditure: Problems and pitfalls. Public Health Nutr. 1998, 1, 265–271. [Google Scholar] [CrossRef] [PubMed]
  20. Rangul, V.; Holmen, T.L.; Kurtze, N.; Cuypers, K.; Midthjell, K. Reliability and validity of two frequently used self-administered physical activity questionnaires in adolescents. BMC Med. Res. Methodol. 2008, 8, 47. [Google Scholar] [CrossRef] [PubMed]
  21. Lagerros, Y.T.; Lagiou, P. Assessment of physical activity and energy expenditure in epidemiological research of chronic diseases. Eur. J. Epidemiol. 2007, 22, 353–362. [Google Scholar] [CrossRef] [PubMed]
  22. Craig, C.; Marshall, A.L.; Sjostrom, L.; Bauman, A.; Booth, M.; Ainsworth, B.; Pratt, M.U.; Yngve, A.; Sallis, J. International physical questionnaire: 12-country reliability and validity. Med. Sci. Sports Exerc. 2003, 35, 1381–1395. [Google Scholar] [CrossRef] [PubMed]
  23. Ainsworth, B.E.; Bassett, D.R., Jr.; Strath, S.J.; Swart, A.M.; O’Brien, W.L.; Thompson, R.W.; Jones, D.A.; Macera, C.A.; Kimsey, C.A. Comparison of three methods for measuring the time spent in physical activity. Med. Sci. Sports Exerc. 2000, 32, S457–S464. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. Stat. Methods Med. Res. 1999, 8, 135–160. [Google Scholar] [CrossRef] [PubMed]
  25. Schmidt, M.E.; Steindorf, K. Statistical methods for the validation of questionnaires–discrepancy between theory and practice. Methods Inf. Med. 2006, 45, 409–413. [Google Scholar] [CrossRef] [PubMed]
  26. Boon, R.M.; Hamlin, M.J.; Steel, G.D.; Ross, J.J. Validation of the New Zealand physical activity questionnaire (NZPAQ-LF) and the international physical activity questionnaire (IPAQ-LF) with accelerometry. Br. J. Sports Med. 2010, 44, 741–746. [Google Scholar] [CrossRef] [PubMed]
  27. Lee, P.H.; Macfarlan, D.J.; Lam, T.H.; Stewart, S.M. Validity of the international physical activity questionnaire short form (IPAQ-SF): A systematic review. Int. J. Behav. Nutr. Phys. Act. 2011, 8, 115. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Shephard, R.J. Limits to the measurement of habitual physical activity by questionnaires. Br. J. Sports Med. 2003, 37, 197–206. [Google Scholar] [CrossRef] [PubMed]
  29. Saint-Maurice, P.F.; Welk, G. Calibration of context-specific survey items to assess youth physical activity behaviour. J. Sports Sci. 2017, 35, 866–872. [Google Scholar] [CrossRef] [PubMed]
  30. Welk, G.J.; Bai, Y.; Saint-Maurice, P.F.; Allums-Featherston, K.; Candelaria, N. Design and evaluation of the NFL PLAY 60 FITNESSGRAM® Partnership Project. Res. Q. Exec. Sport 2016, 87, 1–13. [Google Scholar] [CrossRef] [PubMed]
  31. Celis-Morales, C.A.; Perez-Bravo, F.; Ibañez, L.; Salas, C.; Bailey, M.E.S.; Gill, J.M.R. Objective vs. Self-Reported Physical Activity and Sedentary Time: Effects of Measurement Method on Relationships with Risk Biomarkers. PLoS ONE 2012, 7, e36345. [Google Scholar] [CrossRef] [PubMed]
  32. Monyeki, M.A.; Neetens, R.; Moss, S.J.; Twisk, J. The relationship between body composition and physical fitness in 14 years old adolescents residing within the Tlokwe local municipality, South Africa: The PAHL study. BMC Public Health 2012, 12, 374. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Marfell-Jones, M.; Old, T.; Steward, A.; Carter, J.E.L. International Standards for Anthropometric Assessment; ISAK: Palmerston North, New Zealand, 2006. [Google Scholar]
  34. Campbell, N.; Prapavessis, H.; Gray, C. The Actiheart in Adolescents: A Doubly Labelled Water Validation. Pediatr. Exerc. Sci. 2012, 24, 589–602. [Google Scholar] [CrossRef] [PubMed]
  35. Department of Health and Human Services. Centers for Disease Control and Prevention (CDC): Promoting Better Health for Young People through Physical Activity and Sports; Department of Health and Human Services: Washington, DC, USA, 2009. [Google Scholar]
  36. World Health Organisation (WHO). Obesity and Physical Activity, Technical Report Series; World Health Organization: Geneva, Switzerland, 2009. [Google Scholar]
  37. Guidelines for the Data Processing and Analysis of the International Physical Activity Questionnaire 2005. Available online: http:// www.ipaq.ki.se (accessed on 15 November 2016).
  38. Crouter, S.E.; Horton, M.; Bassett, D.R., Jr. Validity of ActiGraph Child-Specific Equations during Various Physical Activities. Med. Sci. Sports Exerc. 2013, 45, 1403–1409. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Cain, K.L.; Sallis, J.F.; Conway, T.L.; Van Dyck, D.; Calhoon, L. Using Accelerometers in Youth Physical Activity Studies: A Review of Methods. J. Phys. Act. Health 2013, 10, 437–450. [Google Scholar] [CrossRef] [PubMed]
  40. U.S. Department of Health and Human Services [Internet]. Atlanta: 2008 Physical Activity Guidelines for Americans. Available online: http://www.health.gov/paguidelines (accessed on 20 February 2017).
  41. Dixon, P.M.; Pechmann, J.H.K. A statistical test to show negligible trend. Ecology 2005, 86, 1751–1756. [Google Scholar] [CrossRef]
  42. Welk, G.J. Principles of design and analyses for the calibration of accelerometry-based activity monitors. Med. Sci. Sports Exerc. 2005, 37, S501–S511. [Google Scholar] [CrossRef] [PubMed]
  43. Hauck, W.W.; Anderson, S. A new statistical procedure for testing equivalence in two-group comparative bioavailability trials. J. Pharmacokinet. Biopharm. 1984, 12, 83–91. [Google Scholar] [CrossRef] [PubMed]
  44. Kim, Y.K.; Crouter, S.E.C.; Lee, J.M.; Dixon, P.M.; Gaessere, G.A.; Welk, G.J. Comparison of prediction equations for estimating energy expenditure in youth. J. Sci. Med. Sport 2016, 19, 35–40. [Google Scholar] [CrossRef] [PubMed]
  45. Altman, D.G. Practical Statistics for Medical Research; Chapman & Hall/CRC Press: New York, NY, USA, 1999. [Google Scholar]
  46. Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [PubMed]
  47. Vandoni, M.; Buzzachera, C.; Ottobrini, S.; Coreale, L.; Borrelli, P.; Berzolari, F.G.; Codrons, E. Perceived and objective measured physical activity in high school students: Is there any link between aerobic fitness, psychological responses and acute exercise? Sport Sci. Health 2016. [Google Scholar] [CrossRef]
  48. Assah, K.K.; Ekelund, U.; Brage, S.; Wright, A.; Mbanya, J.C.; Wareham, N.J. Accuracy and validity of a combined heart rate and motion sensor for the measurement of free-living physical activity energy expenditure in adults in Cameroon. Int. J. Epidemiol. 2011, 40, 112–120. [Google Scholar] [CrossRef] [PubMed]
  49. Spierer, D.; Haggins, M.; Rundle, A.; Pappas, E. A comparison of energy expenditure estimates from the Actiheart and Actical physical activity monitors during low intensity activities, walking & jogging. Eur. J. Appl. Physiol. 2011, 111, 659–667. [Google Scholar] [PubMed]
  50. Trost, S.G.; Way, R.; Okely, A.D. Predictive validity of three Actigraph energy expenditure equations for children. Med. Sci. Sports Exerc. 2006, 38, 380–387. [Google Scholar] [CrossRef] [PubMed]
  51. Wilson, H.; Dickson, F.; Griffiths, P.; Bogin, B.; Varela-Silva, M. Logistics of using Actiheart physical activity monitor in urban Mexico among 7 to 9-year old children. Am. J. Hum. Biol. 2011, 23, 426–428. [Google Scholar] [CrossRef] [PubMed]
  52. Morgan, D.W. Economy of locomotion. In Paediatric Exercise Science and Medicine; Armstrong, N., van Mechelen, W., Eds.; Oxford University Press: New York, NY, USA, 2000; pp. 183–190. [Google Scholar]
  53. Harrell, J.S.; McMurray, R.G.; Baggett, C.D.; Pennell, M.L.; Pearce, P.F.; Bangdiwala, S.I. Energy costs of physical activities in children and adolescents. Med. Sci. Sports Exerc. 2005, 37, 329–336. [Google Scholar] [CrossRef] [PubMed]
  54. McCann, D.J.; Adams, W.C. The size-dependent oxygen cost of running. Med. Sci. Sports Exerc. 2003, 35, 1049–1056. [Google Scholar] [CrossRef] [PubMed]
  55. Bahler, C.; Bjarnason-Wehrens, B.; Schmid, J.P. SWISSPAQ: Validation of a new physical activity questionnaire in cardiac rehabilitation patients. Swiss Med. Wkly. 2013. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Remoortel, H.V.; Giavedoni, S.; Raste, Y.; Burtin, C.; Louvaris, Z.; Gimeno-Santos, E.; Daniel Langer, D.; Glendenning, A.; Hopkinson, N.S.; Vogiatzis, I.; et al. Validity of activity monitors in health and chronic disease: A systematic review. Int. J. Behav. Nutr. Phys. Act. 2012, 9, 84. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Children 05 00071 g001 550
Figure 1. A Bland–Altman plot of the differences between the average of the objective activity energy expenditure (AEE) and total physical activity (PA) using the International Physical Activity Questionnaire Short Form (IPAQ-SF). The solid line is the average of the mean difference and the dotted lines are the 95% limits of agreement (inter-method difference is 1.96 standard deviation (SD) of the differences; upper and lower limits) between the AEE and the IPAQ-SF.
Figure 1. A Bland–Altman plot of the differences between the average of the objective activity energy expenditure (AEE) and total physical activity (PA) using the International Physical Activity Questionnaire Short Form (IPAQ-SF). The solid line is the average of the mean difference and the dotted lines are the 95% limits of agreement (inter-method difference is 1.96 standard deviation (SD) of the differences; upper and lower limits) between the AEE and the IPAQ-SF.
Children 05 00071 g001
Table
Table 1. Descriptive information (min, max, mean, standard deviation (SD) and p-values) of the participants.
Table 1. Descriptive information (min, max, mean, standard deviation (SD) and p-values) of the participants.
MinMaxMeanSDp-Value of Gender
Stature (m)Female142.0186.0157.50.07<0.001
Male155.0191.0170.00.08
Body Mass (kg)Female33.893.055.2211.080.04
Male38.1105.060.4713.72
Body Mass Index (kg/m2)Female154022.204.580.05
Male14.934.020.563.63
AEE (kCal)Female2581533584.77215.37<0.003
Male181878462.15153.30
TPA (MET.min/week)Female16.01977.0704.95561.940.06
Male8.02488.5941.49639.45
AEE (kCal) = activity energy expenditure (derived from objective measure); TPA = total physical activity (subjectively measured physical activity derived from the four PA categories); MET = Metabolic Equivalent.
Table
Table 2. Percentages and Cohen’s kappa (κ) of physical activity intensity as assessed by ActiHeart® and IPAQ-SF for different MET levels.
Table 2. Percentages and Cohen’s kappa (κ) of physical activity intensity as assessed by ActiHeart® and IPAQ-SF for different MET levels.
PA LevelPAL Categories (ActiHeart®)IPAQ-SF
n%n%
Low PA100932624
Moderate PA112119
Vigorous PA766157
Total PA108100108100
Symmetric Measures
ValueAsymp. Std. Error aApprox T bApprox. Sig.
Measure of Agreementκ0.0110.0081.8280.068
Number of Valid Cases108
a Not assuming the null hypothesis. b Using the asymptotic standard error assuming the null hypothesis; MET = Metabolic Equivalent; n = number; % = percentage; PAL = physical activity level; PA = physical activity; IPAQ-SF = international physical activity questionnaire short form; Asymp. Std: Error = Asymptotic Standard Error; Approx T = Approximation Testing; Approx. Sig. = Approximation Significance.
Table
Table 3. Equivalency analysis examining whether estimates are equivalent at the group level.
Table 3. Equivalency analysis examining whether estimates are equivalent at the group level.
NMean RankSum of Ranks
Averages of two methods – Differences between two methodsNegative Ranks2 a56.00112.00
Positive Ranks105 b53.965666.00
Ties0 c
Total108
Averages of two methods – Differences between two methods (i)
Z−8.63 (ii)
Probability level0.001
a. Averages of two methods < Differences between two methods; b. Averages of two methods > Differences between two methods; c. Averages of two methods = Differences between two methods; i = Wilcoxon Signed Ranks Test; ii = Based on negative ranks.

Share and Cite

MDPI and ACS Style

Monyeki, M.A.; Moss, S.J.; Kemper, H.C.G.; Twisk, J.W.R. Self-Reported Physical Activity is Not a Valid Method for Measuring Physical Activity in 15-Year-Old South African Boys and Girls. Children 2018, 5, 71. https://doi.org/10.3390/children5060071

AMA Style

Monyeki MA, Moss SJ, Kemper HCG, Twisk JWR. Self-Reported Physical Activity is Not a Valid Method for Measuring Physical Activity in 15-Year-Old South African Boys and Girls. Children. 2018; 5(6):71. https://doi.org/10.3390/children5060071

Chicago/Turabian Style

Monyeki, Makama Andries, Sarah J. Moss, Han C.G. Kemper, and Jos W.R. Twisk. 2018. "Self-Reported Physical Activity is Not a Valid Method for Measuring Physical Activity in 15-Year-Old South African Boys and Girls" Children 5, no. 6: 71. https://doi.org/10.3390/children5060071

APA Style

Monyeki, M. A., Moss, S. J., Kemper, H. C. G., & Twisk, J. W. R. (2018). Self-Reported Physical Activity is Not a Valid Method for Measuring Physical Activity in 15-Year-Old South African Boys and Girls. Children, 5(6), 71. https://doi.org/10.3390/children5060071

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop