This study examines the reproducibility and relative validity of a 26-item Vietnamese Children’s Short Dietary Questionnaire (VCSDQ), which was developed to rapidly evaluate the frequency intakes of five core and five non-core food groups and five dietary practices among children 9–11 years in urban Vietnam over a one-week period.
4.1. Reproducibility
Overall, the VCSDQ showed moderate to good agreement for repeated measurement at a group level (ICC > 0.5) for most of the items (except for grains, processed meat and eating outside of the home) and fair to good agreement for repeated measurement at the individual level (weighted kappa > 0.2). These findings are comparable with another short dietary questionnaire in children and adolescents [
9]. The low reproducibility of VCSDQ for processed meat (ICC = 0.43) was similar to the results reported in a questionnaire developed for children 9–10 years old in New Zealand (NZ) (ICC = 0.38 [
26]. For the intake of grains, there were no other published studies that we could compare our results with. The most similar study was conducted in NZ children showed that the reproducibility of intake estimates for rice and rice-based dishes was high (ICC = 0.73), whereas in our study, the reproducibility for intakes of grains including rice, rice-based dishes, bread, starchy foods was low (ICC = 0.33). This difference in observations between those two countries may be due to the differences in children’s diets between NZ and Vietnam. In NZ rice and rice-based dishes are potentially requested dishes eaten in response to children’s preferences so they may to more likely to be remembered [
41]. Conversely in Vietnam, rice and rice-based dishes are staple foods and consumed regularly in the diet. Using the weighted kappa, the reproducibility of cereal/grain intakes (k = 0.2) in our study was lower than that observed in older children (11–12 year old and 13–14 year old) in Belgium (k = 0.55 and 0.58) [
42] and (12–17 year old) in China (ICC = 0.48) [
43]. This higher reproducibility with older age groups could imply that the cognitive capacity of children aged 9–10 may not be fully adequate to quantify the frequency of grain/cereal intake. In addition, the fact that grains (rice, rice noodles, rice paper rolls, etc.) are usually include a range of food items (which may be difficult for young children to discern), are often eaten in different eating contexts and in mixed dishes [
9]. This makes the quantification of this food group more difficult, particularly for children. Low reproducibility of estimating cereal intake was also reported in pregnant women (ICC = 0.25) and lactating women in China (ICC = 0.48) [
44,
45]. Thus, it is possible that estimating the intake of grains and cereals has low reproducibility in Asian countries.
For the reproducibility of dietary practices, four of five items had good reproducibility except for eating outside of the home (ICC = 0.47, k = 0.3). Presently there are no other studies to compare these results with directly. For a similar concept of eating “take away foods”, the reproducibility was low in Australian Aboriginal children (k = 0.39) but higher in non-Aboriginal children (k = 0.59) [
40]. In China, eating outside of the home was positively associated with overweight and obesity in children (6–17 years old) [
40], and with dietary energy from fat and high sugar intake in Vietnamese adolescents (15–17 years old) [
46]. However, the questions for eating outside of the home had not been validated or had been drawn from 24 h recalls [
46,
47]. Thus, apart from examining food intake, questionnaires to examine dietary practices potentially highly relevant to children’s nutritional status and health should be validated to enable high-quality dietary data collection in the context of the nutrition transition in low- and middle-income countries.
4.2. Relative Validity
Overall, the relative validity of this first version of the VCSDQ was generally low, with eight out 15 items having a poor agreement, five having a fair agreement, and two having a moderate to good agreement at the individual level. Three out of 15 items had a good agreement at the group level. Similarly, low validity of short dietary questionnaire items was found in other studies [
9,
26].
For the agreement at the individual level, two core food groups (frequency intakes of vegetables, dairy) and three non-core food groups (sweetened beverages, snacks, processed meat) had a fair agreement (k = 0.21–0.4), one non-core food group (instant noodles) had a moderate agreement (k = 0.43), and one dietary practice (watching screens while eating) had a good agreement (k = 0.69). Although frequency intakes of four non-core food groups and frequency of watching screens while eating were lower than frequency intakes of core-food groups, more items in non-core food groups have a higher validity than core-food groups. This comparison could indicate that these items are children’s food preferences, so they are more likely to report them accurately than core-food groups [
48]. In the context of high prevalence of overweight and obesity in children, the potential preference for non-core foods as well as the inaccuracy in estimating core-food groups are both issues of concern impacting on reporting. Although children’s nutritional status can influence children’s reporting of dietary intake [
41], this analysis has not yet been completed for this study. Further analysis needs to be conducted to examine factors associated with the accuracy of child report of core and non-core foods groups in the context of high prevalence of overweight and obesity.
Eight out of ten food groups (vegetables, fruits, meat and alternatives, dairy, sweetened beverages, fast-foods, instant noodles, processed meat) and one out of five dietary practices (watching screens while eating) had gross misclassification of less than 10%. All items were able to allocate more than 50% of individuals in the same or adjacent group, which indicated acceptable agreement between the two methods at the individual level. So, although having a fair agreement (weighted kappa = 0.21–0.4), above nine items with misclassification less than 10% or exact/adjacent agreement more than 50% could be fairly used to classify children’s intakes from the VCSDQ in a similar group (exact or one quartile difference) from the 24 h recalls. Compared with other studies, our study had a lower gross misclassification than two studies from New Zealand and Belgium [
26] and had similar results to a study in China [
43]. Although the Spearman correlation coefficient is not a standard statistic for evaluating the agreement between two methods, we used this to compare with other similar studies. Our study had comparable results for most food groups, including fruits, vegetables, meats and alternatives, sweetened beverages, snacks, and adding sauces but lower values for processed meat, rice and rice-based dishes, dairy, and higher values for instant noodles compared to a study in New Zealand [
26].
For agreement at the group level, three items (frequency of intake of fruits, instant noodles, and eating outside of home) had good agreement, whereas the median intake of most food groups and dietary practices from the VCSDQ were significantly lower than from the 24 h recalls. The Bland–Altman plots also indicated that the VCSDQ underreported the frequency of food group intakes and dietary practices compared to 24 h recalls.
The explanation for the good agreement of these items could again be due to children’s food preferences and the regular consumption of fruits and instant noodles [
41,
48]. Although the frequency of fruits and vegetables intakes was not high, these food items may be eaten on a regular basis at similar times, for example fruits were often eaten after meals as desert and instant noodles were often eaten in the break time at school or at breakfast/supper. In addition, if children have a specific preference for fruits and instant noodles (either liking or disliking), it is potentially easier to recall the frequency intakes of these food items [
41]. Reporting fruit intake is also more accurate among children who are overweight or obese [
49], so this could be one of explanation in our study sample given that about 60% of participants were either overweight or obesity. In Ho Chi Minh City eating outside of the home is common dietary practice, which is associated with special events in the family or associated with children’s requests restaurants/shops due to the foods or location or environments of eating [
50]. So, this dietary practice is potentially more likely to be accurately reported by children.
For the underestimation of frequency intakes from the VCSDQ, one of potential explanation is the retention interval [
41]. Children may be more accurately remember what they ate during 24 h recall than over one-week recall from the VCSDQ. In addition, the 24 h recall was administrated by interviewer with the prompt and aids to recall, whereas the VCSDQ was self-administered by children. As a result, most of food items or dietary practices would be omitted in the VCSDQ. In addition, children also had a lower capacity to remember food items when eating out of the home [
51], so the food items associated with dietary practices may be also omitted in the VCSDQ. Another possible explanation could also be due to the high prevalence of overweight and obesity as those children are likely to underreport their diet [
52].
Although the food frequency questionnaire tends to overestimate children’s intake, the under or overreporting of frequency intake of food group and dietary practices from the short dietary questions has not been fully investigated. However, one study in Australian children (4–11 years) reported by parents found that the amount of food group intakes (fruits, vegetables, bread and cereals, meat and alternatives, dairy and extra foods) and diet index score from short food questions were significantly higher than from 24 h recalls [
53]. The overreporting of daily amount of intake was similar our study where the daily intake of fruits, vegetables, and water from the VCSDQ were significantly higher than from the 24 h recalls. However, in our study, the frequency intake of food groups from VCSDQ was significantly higher than from 24 h recalls and the underreport tends to be larger in main food groups including grains, meat and alternatives. So, future analysis should examine factors associated with misreporting from short dietary questions.
The frequency of grains, meat and alternatives intakes had a low validity at both the group and individual levels. In other studies, the validity of meat and grain intakes was also low. The Pearson correlation coefficients between a short food questionnaire and three 24 h recalls in Australian children (4–11 years old) assessed as servings/day were 0.08 and 0.07, respectively [
53]. The same comparisons in Chinese children (12–17 years old) were 0.13 (cereals), 0.37 (red meat), −0.04 (poultry), 0.14 (seafoods) [
43]. A possible explanation for the varying levels of agreement for each questionnaire item is the number of items belonging to a food group and the culture of shared meals in Asian countries. Items with many sub-groups and a wider variety of foods such as grains or meats and meat alternatives seem to have lower validity, whereas items that are clearly defined such as instant noodles had a higher validity. In addition, grains (particularly rice and rice-based dishes) and meat and alternatives (main courses) were often eaten in a shared meal with other family members. So, children may find it more difficult to recall accurately which types of foods and how much of these foods they consumed.
Consequently, to improve the validity of the VCSDQ, food groups such as grains and meat and alternatives, a strategy could be to divide them into discrete sub-groups that more clearly indicate the most obvious and commonly consumed food items within that group using a standard recipe and serving. Additional cognitive interviewing is also recommended to understand children’s perceptions of the classification of foods and their portion sizes. In addition, if the data is available, a food list should ideally be developed from the actual dietary intakes of children to provide examples of common dishes and food items. Such a food list should preferably be compiled from data collected in the sub-group of the total population of interest before developing the short dietary questions for dietary assessment [
54,
55]. These questionnaire modifications could improve the validity of items currently showing low validity in the VCSDQ.
Validity of frequency estimates of dietary practices such as adding salt/sauces, eating with family members, and skipping meals is low. So far, these dietary practices have not been items of interest in other validation studies. In the New Zealand study discussed above, the questionnaire item “frequency intakes of tomato sauces, ketchup” had a low validity similar to our sauces-use question (SCC = −0.11) [
26]. In Vietnam, these sauces are often eaten with fried foods (fried meatballs, fried chicken, chips) or fast foods (pizza, burgers). Apart from tomato sauces, fish sauces or soy sauces are often presented on the table for dipping with foods (fried foods or steamed foods) or adding to a dish (pho, rice noodles) as a typical eating habit in Vietnamese meals. In the validation of dietary practices, the ‘watching screens while eating’ item had high validity, whereas other dietary practices associated with mealtimes had low validity. So, it is likely that if children are not conscious about their diet or are watching screens while eating, they may not be conscious of whether they add sauces to their food or whom they eat with, thereby influencing their answers in the VCSDQ. In addition, eating with family and skipping meals are two behaviors associated with mealtimes, so it is possible that the perception of mealtimes among children in this age group is not clearly defined. In the context of dynamic family activities and work patterns in urban areas, the structure of mealtimes may not be clear and inconsistent day-by-day, so this may also make it more difficult for children to define mealtime practices. This lack of consistency in the diet can also lead to lower accuracy in estimating food intakes and dietary practices [
48].
4.4. Strengths and Limitations
4.4.1. Strengths
To date, this is the first study in Vietnam and one of few studies in low- and middle-income countries to develop and validate short dietary questions in evaluating children’s whole diet, including food group intakes and dietary practices in school-aged children aged 9–11 years old.
This study included a sample size comparable to other validation studies (
n = 144), and this sample was representative of fifth-grade students in Ho Chi Minh City in terms of age, sex, and nutritional status [
4,
15].
Similar to other validation studies of short dietary questions, this study has used multiple analyses (ICC, SCC, weighed kappa, cross-classification, Bland–Altman plots, Wilcoxon test for trend) to examine the reproducibility and validity of the short dietary questions, thereby providing a comprehensive assessment of this tool.
4.4.2. Limitations
This study’s data collection method highly depended on children’s recall for both the reference method (24 h recall) and the test method (short dietary questionnaire). For the 24 h recall, children were interviewed by trained research assistants using a standard protocol commonly used for 24 h recall interviewing, and the record of 24 h recall was checked by health officers experienced with dietary data collection however, any recall bias due to children’s capacity to remember and retrieve their diet and dietary habits could not be eliminated.
Another limitation of this study is the cognitive capacity of children 9–11 years old to report their own diet. Although the accuracy to recall children’s diet increase by age [
41], generally, the ability to report diet among children under twelve-year-old is potentially limited, particularly in estimating portion size [
56]. In addition, although children 8–11 years old could report their own diet using food frequency questionnaire better than their parents [
16], they still have limited capacity to report their diet particularly if they ate meals outside of the home [
51].
Evidence indicates that the use of photos of foods in dietary intake tools can improve the capacity to correctly estimate food portion size when children report their usual diet [
57]. We were able to use a number of photographs of typical food and portion sizes, but due to the continuously increasing diversity of food items available, pictures of food portion sizes were not available for all foods to help students correctly estimate the amount of food typically consumed. The available Vietnamese food composition table lacked many of these newly available food items (such as breakfast cereal, hamburger, pizza, meatballs, etc.), so the classification of these food items into food groups from 24 h recall may mismatch with children’s classification of food from the VCSDQ. Such food classification errors are common in low-middle income countries where food composition databases are often insufficient [
58].
The cognitive interviewing in this study was conducted with three children who lived in urban areas which may not allow comparison to the perceptions of children living in rural districts where accessibility to fast-food chain restaurants or food items from stores is limited. Therefore, children may have overlooked and misreported their intakes and dietary practices, despite the initial training using example questions. Future development of dietary tools for use in children from low- and middle-income countries should consider cognitive interviewing in a larger sample of children to understand more fully perceptions of food group classifications and portion size estimations as a process of the validation study.
The typical Vietnamese diet includes many mixed dishes and composite foods, so children may find it challenging to classify food groups contained in these mixed dishes, which may also have led to some of the misreporting in this study. A more dish-based assessment could be considered when revising the VCSDQ items as this approach is increasingly used in Asian countries where mixed-dishes are popular [
59].
Due to the COVID-19 pandemic, data collection was constrained to a short period of time, and this may have created some level of pressure on the children for self-completion of VCSDQ. In addition, during this time, all interviewers wore masks to prevent COVID-19 transmission, so the ability to build trust and have a comprehensive conversation with children was limited compared to normal circumstances. These conditions may have influenced data collection in this study though this is estimated to be minimal.
Finally, the second VCSDQ was administrated one week after the first VCSDQ, so children may remember what they reported from the first administration. This may lead to the potential increase in the reproducibility of the VCSDQ. However, the increase in interval would reduce the feasibility of the study due to the limited time of data collection and reduce the reproducibility of the VCSDQ due to the change in children’s diet week by week.