Next Article in Journal
Phytopharmacological Possibilities of Bird Cherry Prunus padus L. and Prunus serotina L. Species and Their Bioactive Phytochemicals
Next Article in Special Issue
Nutrition Knowledge and Perspectives of Physical Activity for Pre-Schoolers amongst Early Childhood Education and Care Teachers
Previous Article in Journal
Factors Affecting Vitamin C Status and Prevalence of Deficiency: A Global Health Perspective
Previous Article in Special Issue
The Effects on Immune Function and Digestive Health of Consuming the Skin and Flesh of Zespri® SunGold Kiwifruit (Actinidia Chinensis var. Chinensis ‘Zesy002’) in Healthy and IBS-Constipated Individuals
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Nutrients
Volume 12
Issue 7
10.3390/nu12071964
nutrients-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Development of a Psychometrically Valid and Reliable Questionnaire to Assess Nutrition Knowledge Related to Pre-Schoolers

by
Jeanette Rapson
,
Cathryn Conlon
,
Kathryn Beck
,
Pamela von Hurst
and
Ajmol Ali
*
School of Sport, Exercise and Nutrition, Massey University, Auckland 0632, New Zealand
*
Author to whom correspondence should be addressed.
Nutrients 2020, 12(7), 1964; https://doi.org/10.3390/nu12071964
Submission received: 3 June 2020 / Revised: 24 June 2020 / Accepted: 29 June 2020 / Published: 1 July 2020
(This article belongs to the Special Issue Selected Papers from 2019 Annual Scientific Meeting of the Nutrition Society of New Zealand: Beyond Nutrition—kei tua i te kaitōtika)
Browse Figure
Versions Notes

Abstract

:
With rising childcare enrollments, caregivers have a unique opportunity to promote children’s nutrition education and healthy eating. Accurately identifying nutrition knowledge gaps amongst caregivers is necessary for professional development planning. Our aim was to design an early childhood education and care (ECEC) teacher nutrition knowledge questionnaire that satisfies psychometric criteria of validity and reliability. Items were based on the New Zealand Ministry of Health dietary guidelines, literature and expert advice. University students in their final year of a Bachelor of Science (BSc) in Human Nutrition (n = 40), and students with no nutrition background (n = 51) completed the questionnaire to assess construct validity; 35 BSc nutrition students completed the questionnaire two weeks later to assess reliability. The Mann-Whitney-U test and a median-split table assessed construct validity; Pearson’s product-moment correlation assessed test-retest reliability. Nutrition students achieved higher total and subcategory scores (p < 0.01). All nutrition students scored above the median of the combined group; 82% of non-nutrition students scored below the median. In testing reliability, first and second administration median scores for total and subcategories were significantly correlated (r = 0.43–0.78; p < 0.01). The questionnaire achieved construct validity and test-retest reliability and measured ECEC teachers’ nutrition knowledge for preschoolers.

1. Introduction

Participation in early childhood education and care (ECEC) continues to rise across globally [1]. In New Zealand, the number of children attending education and care services increased to 135,237 in 2019 (up 0.4% from 2018), with an average attendance of 23.3 h per week [2]. Therefore, these environments are increasingly considered to impact a child’s dietary and physical activity patterns [3,4]. The childcare nutrition environment, however, is often suboptimal with evidence of low adherence to recommended nutrition-related behaviours and childcare menus not meeting nutrition guidelines for quantity, variety, and limiting ‘sometimes’ and ‘occasional’ foods [4,5,6,7]. Providing guidance to caregivers and ECEC teachers on appropriate nutrition and physical activity for preschoolers is recommended to ensure children establish good nutrition and physical activity behaviours that maximise child development and reduce the risk of developing obesity [8]. A first step for providing this support is to accurately identify knowledge deficits, in which using a valid and reliable ECEC teacher nutrition and physical activity knowledge questionnaire is useful. The current range of ECEC teacher nutrition and physical activity knowledge questionnaires that demonstrate at least construct and content validity are relatively out-of-date (ranging from 1972–2010) [9,10,11,12], mostly related to US teachers [9,10,11,12,13,14,15,16,17,18,19,20], and/or often include content that is not specific to pre-schoolers’ nutrition nor physical activity [11,17,18,21]. Other knowledge questionnaires focusing on the diet of young children have been used to assess parental knowledge, but these are limited in scope, lack validity, and feature items that are overly specialised, for example, asking parents to decide if the following statement is correct: “If one should pay attention to the weight of a pre-schooler, it is preferable to substitute potatoes by rice and pasta” [22,23]. Through a semi-structured literature review of caregivers’ nutrition knowledge, we identified only four [9,10,12,24] of 15 studies used nutrition/physical activity knowledge questionnaires that showed content and construct validity; four were partially validated (no construct validity) [16,19,20,25], and the remaining seven [13,14,15,17,18,21,26] either did not describe validation methods or did not appear to be validated. These characteristics may have limited the quality of evidence for ECEC teachers’ nutrition knowledge.
Psychometrics, the science of maximising quality assessment, provides criteria for validating a knowledge questionnaire [27]. Common forms of validity used for nutrition knowledge questionnaires include content and construct validity and test-retest reliability [9,10,11,16,28,29]. Content validity refers to how well the questionnaire content matches with the questionnaire purpose [27,30], and is usually assessed by using feedback from experts in the instrument’s relevant field. Construct validity refers to the extent that the measure’s variance relates with the variance of its underlying construct or idea of an attribute [30]. This means that a group of experts of the attribute in question (e.g., nutritionists) should score significantly higher than a group of non-experts (e.g., non-nutritionists) completing the same questionnaire [29]. Test-retest reliability ensures scores do not significantly change when completed by the same sample on two separate occasions [27], and is typically assessed by the Pearson’s product-moment correlation method [27,28,29].
In New Zealand, no studies prior to this investigation have objectively measured ECEC teachers’ nutrition knowledge for preschoolers, which may partly be due to a lack of suitable measuring tools. To help address this issue, the availability of a psychometrically valid and reliable questionnaire that can measure ECEC teachers’ nutrition knowledge would be useful. Therefore, the aim of this study is to design an ECEC teachers’ nutrition knowledge questionnaire that satisfies psychometric criteria of content and construct validity and reliability.

2. Materials and Methods

2.1. Study Design and Participants

The protocol for this validation study followed psychometric guidelines for constructing questionnaires [27,30] and methods of previous studies [28,29]. To assure content validity, the questionnaire was developed alongside an expert panel of three nutrition and exercise science experts and three key ECEC stakeholders (i.e., childcare managers/head teachers) in New Zealand. Following semi-structed interview questions and using a feedback form, items were discussed in terms of relevancy, difficultly, readability, accuracy, and scope; panel consensus confirmed the final questionnaire.
To measure construct validity, a class of nutrition university students and those identified through a screening questionnaire as non-nutrition university students were invited to participate in the study. Nutrition students who agreed, completed the questionnaire online in a controlled setting with the primary author present. In addition, at the end of the testing session, the nutrition students provided general verbal feedback on the questionnaire format and readability, which was recorded by the researcher for further content validity testing. Non-nutrition university students were invited through other faculties within the university (e.g., business school) and social media to complete the questionnaire once via e-mail; their responses were compared to the nutrition students’ first occasion responses.
To test reliability, the nutrition students completed the same questionnaire two weeks later. This time period is considered long enough to prevent participants remembering their previous responses, yet short enough to avoid real change in nutrition knowledge [28,29]. As test-retest reliability in its simplest form requires two data sets from different time points from the same group [27], only the nutrition students completed the second administration. Principles of Classical Test Theory were followed, including a basic assumption that the observed score of a person on a test is composed of a true score and an error, and so allows for reliability testing [31]. The Classical Test Theory model fits the questionnaire design, which adds together the scores of individual items to reach a total score [32]. As per previous validation studies [28,29], the sample sizes were reflective of typical classroom enrolments. Ethical approval was provided by the Massey University Human Ethics Committee: Northern (application No. 15/36).

2.2. Questionnaire Design

The questionnaire design was based on a literature search of existing ECEC nutrition knowledge questionnaires, nutrition guidelines for preschoolers [33,34], input from the ECEC stakeholders, and nutrition and exercise science experts. Following consultation with the expert panel, four nutrition knowledge domains for testing were identified, including: the recommended servings per food group; suitable food and beverage choices; appropriate portion versus serving size; and awareness of current child nutrition guidelines/resources. Experts agreed that all items should be specific to nutrition for preschoolers, rather than general nutrition knowledge for adults. Rust and Golombok’s [27] knowledge questionnaire guidelines were followed, for example, providing clear instructions as to how to choose a response (i.e., “please select one”). Nutrition-related perspective items (e.g., “meal times should be fun”) were included to improve questionnaire design and align with previous questionnaires [9,11,12,14,16,18,21,26]. These items were not assessed as they focused on perspectives rather than knowledge but were reviewed for content validity by the expert panel. Demographic items included gender, age, ethnicity, previous training in nutrition, highest qualification, and current course of study.
There were approximately 20 revisions of the questionnaire, with the first version featuring 56 items and the Healthy Food Guide’s serving chart [35], while the final version had eliminated 16 items and used the Ministry of Health’s serving examples [34] to better align with the Ministry of Health’s guideline documents. The final questionnaire was placed online using Qualtrics survey software. Skip-logic questions, by which a set of conditions triggered skipping ahead in the survey, were used to reduce respondent burden, thus improve response rates. For example, if a participant selected that they were not aware of the New Zealand nutrition guidelines for preschoolers, then the next question asking if they had used the guidelines was skipped. Previously, ECEC staff have indicated that a survey length of 20 min was a reason not to participate in the study [36]. Since it took the nutrition students approximately 25 min to complete the questionnaire, five nutrition knowledge items that appeared cumbersome (required reading a case study) were omitted to reduce completion time. The nutrition students’ feedback after completing the questionnaire resulted in no other changes. The final 40-item questionnaire took approximately 15 min to complete. Nineteen items objectively measured nutrition and were tested for validity; and were organised into subcategories: servings (6 questions; maximum score 6), food choices (7 questions; maximum score 25), portions (5 questions; maximum score 5), and resources (1 question; maximum score 1). Participants could score a maximum total of 37.
To ensure the questionnaire was at an appropriate level, testing concepts that seemed historically difficult to grasp were avoided, such as recommended daily intakes (RDI) [16,18,37]. Moreover, RDI may be phasing out from nutrition resources [34,38,39], so appeared less relevant. Examples of serving sizes were taken from nutrition guidelines [33,34] to standardise answers for the servings’ subcategory. Due to the increasing use of digital technologies in education [40], the questionnaire was in an online digital and visually appealing format that could be completed using a computer or smart mobile devices (e.g., tablets, smartphones) (Figure 1). Images were royalty-free or created by the primary author. Lunchbox food images were based on previous research [41]. To maximise data quality and increase response rates, the questionnaire favoured closed-questions (quantitative data); however, open-questions (qualitative) were included (e.g., “please specify”) to clarify answers [42]. However, for the knowledge items, qualitative data was only collected when asking if there were any other suitable drinks or snacks that are appropriate for preschoolers. Forced responses and request responses were used to minimise missing data; however, an option “choose not to answer” was provided. Items were coded numerically, with nutrition knowledge items being given a “+1” score for a correct answer and “0” for an incorrect, “choose not to answer” or “not sure” response. For the purpose of scoring, a qualitative response that was contradictory to nutrition guidelines was also scored as “0” for incorrect, while a response in alignment was scored “+1”. The sum of these answers provided total and subcategory knowledge scores. A copy of the questionnaire is available (see Supplementary File S1).

2.3. Statistical Analysis

Statistical analysis was conducted using IBM SPSS (version 24.0 IBM Corp., Armonk, NY, USA, 2016). Descriptive statistics summarised participant characteristics and nutrition knowledge scores. As histograms and Kolmogorov-Smirnov tests showed that data were not normally distributed and no improvements were seen with data transformation, the Mann-Whitney-U test was used to test construct validity and median (25th, 75th percentiles) scores were reported. Effect size was calculated using Rosenthal’s [43] formula and interpreted using Cohen’s [44] guidelines on effect size r (small: 0.1, medium: 0.3, large: 0.5). A median-split table was used as a second measure of construct validity. Pearson’s product-moment correlation coefficient assessed test-retest reliability (nutrition students’ data only) as this is a straight-forward method previously used [28,29] and recommended by Rust and Golombok [27]. Intraclass correlations were not conducted because when raters/assessors are adequately informed and trained to make appropriate assessments (as in this study), a Pearson’s product-moment correlation and intraclass correlation should produce similar results [45]. Correlations (r) were interpreted using Cohen’s [44] guidelines for interpreting r (small: 0.1, medium: 0.3, large: 0.5). The significance level was p < 0.05 for all tests.

3. Results

3.1. Participants

The total sample comprised 77 females and 13 males; 58% were 16–24 years and 67% were of New Zealand European ethnicity. The nutrition students (n = 40) included 35 females; 68% were 16–24 years and 63% were New Zealand European. The non-nutrition students (n = 51) included 42 females; 51% were 16–24 years and 71% were New Zealand European.

3.2. Content Validity

Content validity was considered satisfactory due to the organised design methods involving experts [29]. Written and verbal feedback collected from the panel of experts/stakeholders and the 40 nutrition students confirmed content validity.

3.3. Construct Validity

Nutrition students’ median scores for total and subcategory nutrition knowledge was higher than the non-nutrition students (p < 0.01; Table 1). The median-split table (Table 2) shows 100% of nutrition students scored better than the median of the combined group, while 72% of non-nutrition students scored below the median.

3.4. Test-Retest Reliability

First and second median scores for overall and subcategory scores (except the resource subcategory) were significantly correlated (p < 0.01); correlation coefficients ranged from r = 0.43–0.78. There was a small, but non-significant correlation (r = 0.12, p = 0.503) for the resources subcategory (Table 3).

4. Discussion

This study aimed to develop a psychometrically valid and reliable questionnaire to assess ECEC teacher nutrition knowledge. As the nutrition students scored significantly higher overall and for each subcategory, the questionnaire demonstrated satisfactory construct validity. Furthermore, 100% of nutrition students scored above the median of the combined group, while 72% of non-nutrition students scored below the median. The questionnaire also met satisfactory content validity; researchers may consider the organised methods used (including a literature review and expert advice) to indicate “undoubtedly high” [29] content validity; however, we remain conservative in view of no other benchmarks available. The test-retest reliability of this tool proved acceptable levels for reliability, with all correlations of medium to large strength, except for the ‘resources’ subcategory.
The construct validity reported here suggests that this tool adequately measures what it is supposed to measure, which is ECEC teacher’s nutrition knowledge for preschoolers. It is difficult to compare results to those of previous studies given the dearth of validated ECEC teacher nutrition knowledge questionnaires, heterogeneity between study designs, and limited detail provided in reporting. Nevertheless, these findings may be comparable to early questionnaires [9,10], for example, Gillis and Sabry [10] found 44 students who had completed at least one course in nutrition obtained a significantly higher (p < 0.005) total average knowledge score of 15.9 ± 2.7 on the study’s 20-item childcare teacher nutrition knowledge questionnaire, compared with 29 students who had not studied nutrition and scored 11.0 ± 2.9 [10]. In our study, it was unclear as to why nine non-nutrition students scored above the median as demographic data was similar between groups and all indicated that they had not attained any previous training in nutrition or physical activity for young children. Further investigation of non-nutrition students’ specific area of expertise may have provided more insight, but with the majority scoring below the median, results still indicated the expected knowledge difference between the two groups.
Our test-retest reliability results suggest that one could trust the tool to accurately measure nutrition knowledge when administered to caregivers in the future. These results may be comparable to those of Dias et al. [46], which seems to be the only other study to have reported on test-retest reliability of a questionnaire measuring caregivers’ nutrition knowledge for preschoolers. In their validation analysis, a paired t-test found that all knowledge scores were higher in the questionnaire’s retest administration, but differences were not significant for nursery staff (p = 0.05), and the intraclass correlation coefficient (ICC) was 0.76, which is just above the acceptable level of 0.7 [46]. As a sample size of fifty participants was needed for estimating an ICC of 0.8 with a 95% CI ± 0.1 for two repeated measures, their small sample of 21 nursery staff may have limited results. In our study, the small and non-significant correlation for the ‘resources’ subcategory suggested that these items were less reliable; however, they were retained in the interest of content validity, which is not an uncommon practice if overall reliability is unaffected [29]. Furthermore, scores for this section might be less indicative of ECEC teachers’ nutrition knowledge for preschoolers, as it only consisted of one item asking if New Zealand had specific nutrition and physical activity guidelines, rather than testing the content of these guidelines.
A strength of this study is that it is the first to develop a psychometrically valid nutrition knowledge questionnaire that can be used amongst New Zealand ECEC teachers. The methodology is detailed regarding questionnaire design, which should be useful to those wanting to use the questionnaire or create a similar tool. As university students tend to share similar characteristics (e.g., age, geographic location), yet differ in fields of expertise, they were an ideal population group to test validity. The nutrition students were in their third and final year of university study, therefore, could be considered experts compared to the group with no nutrition training (non-experts). In addition, as the benchmark qualification for New Zealand qualified ECEC teachers is at tertiary level [47], using tertiary education students in a university setting was considered comparable to the target population. Findings may be limited by the different testing conditions for each group (e.g., the nutrition students completed the questionnaires in a classroom scenario, whereas the non-nutrition students were participating remotely). However, with similar completion times and clear instructions to answer items without reference material, it is likely that differences in setting did not impact results.
The Classical Test Theory has traditionally been used to assess the validity of nutrition knowledge questionnaires. It is also based on the assumption that all items equally measure an individual’s nutrition knowledge and is unable to differentiate individuals with the same ‘total’ score. Such bias may have been addressed with Rasch analysis, which has recently been used to develop a brief nutrition knowledge questionnaire for athletes [48,49]. In situations where respondents receive the same ‘total’ score, Rasch analysis can take into account differences in knowledge levels according to which questions were correctly answered or question difficulty [48,49,50,51]. While including this analysis may have strengthened results and given more detailed diagnostics of how to improve the questionnaire, authors recommend it be carried out in a larger sample size (e.g., 240 participants) [49,50].
This questionnaire covers current New Zealand nutrition recommendations for preschoolers, thus represents a comprehensive and objective assessment of knowledge in this area. Previous ECEC nutrition knowledge questionnaires were relatively out-of-date, poorly validated, and/or non-specific for preschoolers’ nutrition, with none available for use in New Zealand. Given the validity and currency of this tool, it may be adapted for use in other countries, especially those with similar nutrition guidelines (e.g., UK, Australia). This questionnaire may serve as a template for researchers and authorities investigating parents’, caregivers, practitioners’, and/or teachers’ nutrition knowledge across other settings, including primary and secondary schools. For example, a preschool-based intervention in the Netherlands, which recognises the important role that ECEC teachers play in promoting children’s healthy eating and physical activity, is currently underway [52]. An assessment of improved teacher nutrition knowledge is one of the key indicators of the intervention’s success, and so the results of this study could be useful to inform their assessment methods. Meanwhile, if a similar intervention were to be conducted in New Zealand, the tool can now be used, and the comparability of studies may be possible. Given that ECEC teachers work in a busy environment and may have limited resources [4], we would recommend that ECEC teachers are given support to identify an appropriate time and place to complete this questionnaire. It is important to stress to teachers that the tool is designed to inform future training and professional development, rather than to degrade or embarrass them. As the questionnaire is written in English, additional support when interpreting the questions using a translator may be required where English is not a first language. Finally, the potential impact of this tool for the New Zealand and global ECEC sector may largely be for the development of teacher qualification programmes. When used to accurately identify knowledge gaps amongst ECEC teachers (both practicing or in training) this tool could: (1) help justify a greater amount of time allocated to teacher nutrition training; (2) develop specific learning objectives and content for teacher course curriculum, and: (3) be a valuable assessment tool for ECEC teacher competency testing.

5. Conclusions

This study is the first to develop a psychometrically valid and reliable ECEC teachers’ nutrition knowledge for preschoolers questionnaire for use in New Zealand. It is intended that this tool be used by researchers, practitioners or ECEC providers aiming to investigate ECEC teachers’ nutrition knowledge and related perspectives; as we have demonstrated elsewhere [53]. Identifying knowledge gaps is a first step for providing ECEC teachers with the relevant knowledge to support and implement children’s healthy eating practices whilst in childcare. This may be one of many important strategies for obesity prevention in early life.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6643/12/7/1964/s1, Supplementary S1: Questionnaire to assess knowledge related to pre-schoolers’ nutrition.

Author Contributions

Conceptualisation, J.R., C.C., and A.A.; methodology, J.R., C.C., K.B., P.v.H. and A.A.; validation, J.R.; formal analysis, J.R.; writing—original draft preparation, J.R.; writing—review and editing, J.R., C.C., A.A., K.B., and P.v.H.; supervision, C.C. and A.A.; project administration, J.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. OECD. Starting Strong 2017 Key OECD Indicators on Early Childhood Education and Care; OECD Publishing: Paris, France, 2017; pp. 18–32. [Google Scholar]
  2. Education Counts: Participation. Available online: https://www.educationcounts.govt.nz/statistics/early-childhood-education/participation (accessed on 7 May 2020).
  3. Sisson, S.B.; Krampe, M.; Anundson, K.; Castle, S. Obesity prevention and obesogenic behavior interventions in child care: A systematic review. Prev. Med. 2016, 87, 57–69. [Google Scholar] [CrossRef] [PubMed]
  4. Sisson, S.B.; Smith, C.L.; Cheney, M. Big impact on small children: Child-care providers’ perceptions of their role in early childhood healthy lifestyle behaviours. Child Care Pract. 2017, 23, 162–180. [Google Scholar] [CrossRef]
  5. Gerritsen, S.; Anderson, S.E.; Morton, S.M.; Wall, C.R. Pre-school nutrition-related behaviours at home and early childhood education services: Findings from the Growing Up in New Zealand longitudinal study. Public Health Nutr. 2018, 21, 1222–1231. [Google Scholar] [CrossRef] [Green Version]
  6. Gerritsen, S.; Dean, B.; Morton, S.M.; Wall, C.R. Do childcare menus meet nutrition guidelines? Quantity, variety and quality of food provided in New Zealand early childhood education services. Aust. N. Z. J. Public Health 2017, 41, 345–351. [Google Scholar] [CrossRef]
  7. Gerritsen, S.; Wall, C.; Morton, S. Child-care nutrition environments: Results from a survey of policy and practice in New Zealand early childhood education services. Public Health Nutr. 2016, 19, 1531–1542. [Google Scholar] [CrossRef] [Green Version]
  8. World Health Organization. Report of the Commission on Ending Childhood Obesity: Implementation Plan: Executive Summary; World Health Organization: Geneva, Switzerland, 2017; pp. 1–24. [Google Scholar]
  9. Freedman, M.R.; Alvarez, K. Early childhood feeding: Assessing knowledge, attitude, and practices of multi-ethnic child-care providers. J. Am. Diet. Assoc. 2010, 110, 447–451. [Google Scholar] [CrossRef] [Green Version]
  10. Gillis, D.E.G.; Sabry, J.H. Daycare teachers: Nutrition knowledge, opinions, and use of food. J. Nutr. Educ. Behav. 1980, 12, 200–204. [Google Scholar] [CrossRef]
  11. Soliah, L.A.; Newell, G.K.; Vaden, A.G.; Dayton, A.D. Establishing the need for nutrition education: II. Elementary teachers’ nutrition knowledge, attitudes, and practices. J. Am. Diet. Assoc. 1983, 83, 447–453. [Google Scholar]
  12. Jones, A.M.; Zidenberg-Cherr, S. Exploring nutrition education resources and barriers, and nutrition knowledge in teachers in California. J. Nutr. Educ. Behav. 2015, 47, 162–169. [Google Scholar] [CrossRef]
  13. Alkon, A.; Crowley, A.A.; Neelon, S.E.B.; Hill, S.; Pan, Y.; Nguyen, V.; Rose, R.; Savage, E.; Forestieri, N.; Shipman, L.; et al. Nutrition and physical activity randomized control trial in child care centers improves knowledge, policies, and children’s body mass index. BMC Public Health 2014, 14, 215. [Google Scholar] [CrossRef] [Green Version]
  14. Derscheid, L.E.; Umoren, J.; Kim, S.-Y.; Henry, B.W.; Zittel, L.L. Early childhood teachers’ and staff members’ perceptions of nutrition and physical activity practices for preschoolers. J. Res. Child. Educ. 2010, 24, 248–265. [Google Scholar] [CrossRef]
  15. Lanigan, J.D. The relationship between practices and child care providers’ beliefs related to child feeding and obesity prevention. J. Nutr. Educ. Behav. 2012, 44, 521–529. [Google Scholar] [CrossRef] [PubMed]
  16. Nahikian-Nelms, M. Influential factors of caregiver behavior at mealtime: A study of 24 child-care programs. J. Am. Diet. Assoc. 1997, 97, 505–509. [Google Scholar] [CrossRef]
  17. Petersen, M.E.; Kies, C. Nutrition knowledge and attitudes of early elementary teachers. J. Nutr. Educ. Behav. 1972, 4, 11–15. [Google Scholar] [CrossRef]
  18. Sharma, S.; Skala, K.; Byrd-Williams, C.E.; Truxillio, J.B.; Rahman, G.A.; Bonsu, P.; Hoelscher, D. Nutrition-related knowledge, attitudes, and dietary behaviors among head start teachers in Texas: A cross-sectional study. J. Acad. Nutr. Diet. 2013, 113, 558–562. [Google Scholar] [CrossRef] [Green Version]
  19. Rida, Z.; Burger, C.; Dev, D.A.; Smith, J.; Hasnin, S. Assessment of nutrition knowledge of childcare providers regarding the implementation of the 2017 CACFP meal pattern update. Am. J. Health Educ. 2018, 49, 384–394. [Google Scholar] [CrossRef] [Green Version]
  20. Halloran, K.M.; Gorman, K.; Fallon, M.; Tovar, A. Nutrition knowledge, attitudes, and fruit and vegetable intake as predictors of head start teachers’ classroom mealtime behaviors. J. Nutr. Educ. Behav. 2018, 50, 340–348. [Google Scholar] [CrossRef] [Green Version]
  21. O’Dea, J.A. Evaluation of nutrition and physical activity knowledge, attitudes, self efficacy and behaviors in teachers and children after implementation of the “Healthy Active Kids” online program in Australian elementary schools. Health 2016, 8, 293–303. [Google Scholar] [CrossRef] [Green Version]
  22. Al-Shookri, A.; Al-Shukaily, L.; Hassan, F.; Al-Sheraji, S.; Al-Tobi, S. Effect of mothers nutritional knowledge and attitudes on Omani children’s dietary intake. Oman Med. J. 2011, 26, 253. [Google Scholar] [CrossRef]
  23. Vereecken, C.; Maes, L. Young children’s dietary habits and associations with the mothers’ nutritional knowledge and attitudes. Appetite 2010, 54, 44–51. [Google Scholar] [CrossRef]
  24. Cotwright, C.J.; Bales, D.; Lee, J.S.; Parrott, K.; Celestin, N.; Olubajo, B. Like peas and carrots: Combining wellness policy implementation with classroom education for obesity prevention in the childcare setting. Public Health Rep. 2017, 132, 74S–80S. [Google Scholar] [CrossRef]
  25. Liu, H.; Xu, X.; Liu, D.; Rao, Y.; Reis, C.; Sharma, M.; Yuan, J.; Chen, Y.; Zhao, Y. Nutrition-related knowledge, attitudes, and practices (KAP) among kindergarten teachers in Chongqing, China: A cross-sectional survey. Int. J. Environ. Res. Public Health 2018, 15, 615. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Moore, H.; Nelson, P.; Marshall, J.; Cooper, M.; Zambas, H.; Brewster, K.; Atkin, K. Laying foundations for health: Food provision for under 5s in day care. Appetite 2005, 44, 207–213. [Google Scholar] [CrossRef] [PubMed]
  27. Rust, J.; Golombok, S. Modern Psychometrics: The Science of Psychological Assessment, 2nd ed.; Routledge: London, UK, 2014; pp. 3–216. [Google Scholar]
  28. Zinn, C.; Schofield, G.; Wall, C. Development of a psychometrically valid and reliable sports nutrition knowledge questionnaire. J. Sci. Med. Sport 2005, 8, 346–351. [Google Scholar] [CrossRef]
  29. Parmenter, K.; Wardle, J. Development of a general nutrition knowledge questionnaire for adults. Eur. J. Clin. Nutr. 1999, 53, 298–308. [Google Scholar] [CrossRef] [Green Version]
  30. Coaley, K. An Introduction to Psychological Assessment and Psychometrics, 2nd ed.; Sage: London, UK, 2014; pp. 167–176. [Google Scholar]
  31. Alagumalai, S.; Curtis, D.D.; Hungi, N. Applied Rasch Measurement: A Book of Exemplars; Springer: Dordrecht, The Netherlands, 2005; pp. 1–15. [Google Scholar]
  32. DeVellis, R.F. Classical test theory. Med. Care 2006, 44, S50–S59. [Google Scholar] [CrossRef]
  33. Ministry of Health. Food and Nutrition Guidelines for Healthy Children and Young People (Aged 2–18 Years): A Background Paper; Ministry of Health: Wellington, New Zealand, 2015; pp. 1–152.
  34. Ministry of Health. Eating for Healthy Children—From 2–12 Years; Ministry of Health: Wellington, New Zealand, 2012; pp. 1–20.
  35. Serving Size Guide. Available online: https://www.healthyfood.com/resource/serving-size-guide-1-page/ (accessed on 22 June 2020).
  36. Gerritsen, S.; Morton, S.; Wall, C.R. Physical activity and screen use policy and practices in childcare: Results from a survey of early childhood education services in New Zealand. Aust. N. Z. J. Public Health 2016, 40, 319–325. [Google Scholar] [CrossRef]
  37. Campos, S.; Doxey, J.; Hammond, D. Nutrition labels on pre-packaged foods: A systematic review. Public Health Nutr. 2011, 14, 1496–1506. [Google Scholar] [CrossRef] [Green Version]
  38. Choose My Plate. Available online: https://www.choosemyplate.gov/MyPlate (accessed on 8 May 2020).
  39. Guidance: The Eatwell Guide. Available online: https://www.gov.uk/government/publications/the-eatwell-guide (accessed on 8 May 2020).
  40. Ng, W. New Digital Technology in Education: Conceptualizing Professional Learning for Educators; Springer International Publishing: Cham, Switzerland, 2015; pp. 3–21. [Google Scholar]
  41. More, J.A.; Emmett, P.M. Evidenced-based, practical food portion sizes for preschool children and how they fit into a well balanced, nutritionally adequate diet. J. Hum. Nutr. Diet. 2015, 28, 135–154. [Google Scholar] [CrossRef]
  42. O’Cathain, A.; Thomas, K.J. “Any other comments?” Open questions on questionnaires—A bane or a bonus to research? BMC Med. Res. Methodol. 2004, 4, 25. [Google Scholar] [CrossRef] [Green Version]
  43. Rosenthal, R. Meta-Analytic Procedures for Social Research; Sage Publications: Newbury Park, CA, USA, 1991; pp. 1–168. [Google Scholar]
  44. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Academic Press: New York, NY, USA, 1988; pp. 8–14. [Google Scholar]
  45. Cicchetti, D. Choice of Agreement Statistics: A Discussion of the Underlying Biostatistics, with Heuristic Examples from the Vineland-3; NCS Pearson, Inc.: New Haven, CT, USA, 2017; pp. 1–9. [Google Scholar]
  46. Dias, K.; White, J.; Metcalfe, C.; Kipping, R.; Papadaki, A.; Jago, R. Acceptability, internal consistency and test-retest reliability of scales to assess parental and nursery staff’s self-efficacy, motivation and knowledge in relation to pre-school children’s nutrition, oral health and physical activity. Public Health Nutr. 2019, 22, 967–975. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Ministry of Education, TeachNZ. Early Childood Education: Teacher Education Qualifications 2017; Ministry of Education, TeachNZ: Wellington, New Zealand, 2016; pp. 1–42.
  48. Trakman, G.L.; Forsyth, A.; Hoye, R.; Belski, R. Development and validation of a brief general and sports nutrition knowledge questionnaire and assessment of athletes’ nutrition knowledge. J. Int. Soc. Sports Nutr. 2018, 15, 17. [Google Scholar] [CrossRef] [Green Version]
  49. Trakman, G.L.; Forsyth, A.; Hoye, R.; Belski, R. The nutrition for sport knowledge questionnaire (NSKQ): Development and validation using classical test theory and Rasch analysis. J. Int. Soc. Sports Nutr. 2017, 14, 26. [Google Scholar] [CrossRef]
  50. Pallant, J.F.; Tennant, A. An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). Br. J. Clin. Psychol. 2007, 46, 1–18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Mötteli, S.; Barbey, J.; Keller, C.; Bucher, T.; Siegrist, M. Development and validation of a brief instrument to measure knowledge about the energy content of meals. J. Nutr. Educ. Behav. 2017, 49, 257–263. [Google Scholar] [CrossRef] [Green Version]
  52. Toussaint, N.; Streppel, M.T.; Mul, S.; Schreurs, A.; Balledux, M.; Van Drongelen, K.; Janssen, M.; Fukkink, R.G.; Weijs, P.J. A preschool-based intervention for Early Childhood Education and Care (ECEC) teachers in promoting healthy eating and physical activity in toddlers: Study protocol of the cluster randomized controlled trial PreSchool@HealthyWeight. BMC Public Health 2019, 19, 278. [Google Scholar] [CrossRef] [PubMed]
  53. Rapson, J.; Conlon, C.; Ali, A. Nutrition knowledge and perspectives of physical activity for pre-schoolers amongst early childhood education teachers. Nutrients 2020, 12, 1984. [Google Scholar] [CrossRef]
Nutrients 12 01964 g001 550
Figure 1. Example question using a mobile phone view.
Figure 1. Example question using a mobile phone view.
Nutrients 12 01964 g001
Table
Table 1. Mann-Whitney-U test comparing nutrition knowledge scores between nutrition and non-nutrition students.
Table 1. Mann-Whitney-U test comparing nutrition knowledge scores between nutrition and non-nutrition students.
Nutrition Students (n = 40) 1Non-nutrition Students (n = 51) 1Uzp-ValueEffect Size
(r) 2
Total (37 maximum score)26.0
[24.0, 28.0]		17.0
[15.0, 20.0]		105.5−7.3<0.00010.77
Servings3.0
[2.0, 4.0]		2.0
[1.0, 3.0]		602.0−3.50.0010.36
Food choices18.0
[16.3, 19.0]		13.0
[11.0, 15.0]		163.0−6.9<0.00010.72
Portions3.4
[3.0, 4.0]		2.0
[1.00, 3.00]		643.0−5.3<0.00010.56
Resources1.0
[1.0, 2.0]		0.0
[0.0, 1.0]		301.5−6.2<0.00010.65
1 Data given as median (25th, 75th percentile). 2 Calculated using Rosenthal’s [43] formula; Cohen’s [44] effect sizes for r were small (0.1), medium (0.3), large (0.5). Note. Scoring: correct response: +1; incorrect response: 0; unsure response or “choose not to answer”: 0. Maximum possible scores: total = 37; servings = 6; food choices = 25; portions = 5; resource = 1.
Table
Table 2. Median-split table for nutrition and non-nutrition students’ total nutrition knowledge scores (n = 91).
Table 2. Median-split table for nutrition and non-nutrition students’ total nutrition knowledge scores (n = 91).
Median or Above (n)Below Median (n)
Nutrition students (n = 40)400
Non-nutrition students (n = 51)9
[2.0, 4.0]		42
[1.0, 3.0]
Table
Table 3. Test-retest reliability using Pearson’s product-moment correlation (n = 35; nutrition students only).
Table 3. Test-retest reliability using Pearson’s product-moment correlation (n = 35; nutrition students only).
Knowledge Section 1Pearson’s Product-Moment Correlation (r) 2p-Value
Total0.500.002
Servings0.78<0.001
Food choices0.430.001
Portions0.540.001
1 Only results for medium to large correlations shown. 2 Cohen’s 31 small (0.1), medium (0.3) and large (0.5) correlations (r) were used.

Share and Cite

MDPI and ACS Style

Rapson, J.; Conlon, C.; Beck, K.; von Hurst, P.; Ali, A. The Development of a Psychometrically Valid and Reliable Questionnaire to Assess Nutrition Knowledge Related to Pre-Schoolers. Nutrients 2020, 12, 1964. https://doi.org/10.3390/nu12071964

AMA Style

Rapson J, Conlon C, Beck K, von Hurst P, Ali A. The Development of a Psychometrically Valid and Reliable Questionnaire to Assess Nutrition Knowledge Related to Pre-Schoolers. Nutrients. 2020; 12(7):1964. https://doi.org/10.3390/nu12071964

Chicago/Turabian Style

Rapson, Jeanette, Cathryn Conlon, Kathryn Beck, Pamela von Hurst, and Ajmol Ali. 2020. "The Development of a Psychometrically Valid and Reliable Questionnaire to Assess Nutrition Knowledge Related to Pre-Schoolers" Nutrients 12, no. 7: 1964. https://doi.org/10.3390/nu12071964

APA Style

Rapson, J., Conlon, C., Beck, K., von Hurst, P., & Ali, A. (2020). The Development of a Psychometrically Valid and Reliable Questionnaire to Assess Nutrition Knowledge Related to Pre-Schoolers. Nutrients, 12(7), 1964. https://doi.org/10.3390/nu12071964

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop