Next Article in Journal
The Use of Thermography as an Auxiliary Method for Monitoring Convalescence after Facelift Surgery: A Case Study
Previous Article in Journal
Maternal and Fetal Outcomes among Pregnant Women with Diabetes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of a Questionnaire of Food Education Content on School Catering Websites in Spain

by
Nuria Rico-Sapena
1,
María Eugenia Galiana-Sánchez
2,* and
Joaquín Moncho
3
1
Unidad Técnica Agroalimentaria, Departamento Servicio Territorial de Agricultura de Alicante, Dirección Territorial de Alicante—Consejería de Agricultura, Desarrollo Rural, Emergencia Climática y Transición Ecológica, 03690 Alicante, Spain
2
Balmis Research Group in History of Science, Health Care and Food, NISALdes, University of Alicante, 03009 Alicante, Spain
3
Research Unit for the Analysis of Mortality and Health Statistics, Department of Community Nursing, Preventive Medicine, Public Health and History of Science, University of Alicante, 03080 Alicante, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(6), 3685; https://doi.org/10.3390/ijerph19063685
Submission received: 22 December 2021 / Revised: 4 February 2022 / Accepted: 16 March 2022 / Published: 20 March 2022
(This article belongs to the Section Global Health)

Abstract

:
The aim of this study was to design and validate a questionnaire on quality and food education on catering company websites. For the validation of the questionnaire, its reliability, feasibility and content validity characteristics were determined. For content validity, a panel of experts was used and the overall and item-wise Content Validity Index (CVI) of the experts’ responses was calculated. Reliability was determined by the inter-judge agreement method with the analysis of 30 websites using the intraclass correlation coefficient (ICC) and the Bland and Altman plot. Adequate content validity was verified by obtaining a very high CVI (above 0.80) in the analysis of the expert panel’s responses and excellent inter-observer agreement with a very high global ICC (above 0.90) value in the determination of test-retest reliability. The questionnaire is a valid instrument for the evaluation of the quality of school catering websites and their content in food education, as it has good feasibility, high content validity and excellent reliability.

1. Introduction

Children’s dietary habits during childhood are linked to risk of developing chronic conditions and food consumption patterns in adulthood [1,2,3,4,5,6]. Unhealthy food and lack of physical activity have contributed to increasing the prevalence of overweightness and obesity in children and adolescents [3,7,8,9,10,11,12,13,14,15,16]. Obesity is considered by the WHO as the disease of the 21st century due to the dimensions it acquires, and the impact on health, quality of life and health spending [10,11,17]. Therefore, obesity is a complex public health issue that requires large-scale and population-based solutions [18].
Schools are the places where children spend most of their time and have access to a significant part of the food they eat [1,18]; therefore, they are key settings for the prevention of obesity [18], health promotion [1] and the consolidation of correct eating habits [19]. School canteens, in the current social context, are essential elements in child nutrition and in the achievement of public health objectives [2,7,19,20,21,22].
The school canteen catering service plays an important food, nutritional and educational role by providing a varied and nutritionally balanced diet, and by being a powerful tool for food and nutrition education and improving healthy eating habits [6,20,22,23,24,25].
Catering companies use the Internet environment to present their services and activities. Their websites allow them to show different activities and educational content on food, nutrition and healthy eating habits. It is important that this educational contribution is adequate, both in terms of content and the quality of the website itself, so that this information translates into health education for users [26,27,28].
The increase of information on the Internet favours the development of multiple websites whose quality and content characteristics are highly variable, making it increasingly difficult to select information and ensure that the results are of high quality [28,29,30,31]. For this reason, the evaluation of websites has become essential to be able to contrast this type of information [26,29,30].
Questionnaires are the instrument that has been used in numerous previous studies [26,27,28,31,32,33,34,35,36,37,38,39,40,41] for website evaluation. However, for an instrument to be useful, it must be valid, reliable, easy to apply and usable in any environment [42,43,44]. Evaluating the psychometric properties of an instrument is an essential criterion for determining the quality of its measurement [45], being a continuous and dynamic process that becomes more consistent the more psychometric properties are measured with different populations, subjects and in different cultural contexts. It is a complex process involving the assessment of feasibility, reliability, validity and sensitivity to change [45,46,47,48,49].
Several previous studies assessed the quality of web page features but did not analyse the educational content or the quality of the content of the web pages [26,27,28,31,32,33,34,35,36,37,38,39,40,41], which would require appropriate instruments to do so. In a previous phase of the present study, a first version of the EDALCAT questionnaire was designed, and its feasibility was assessed by means of a pilot test. This pilot test was carried out in order to assess the appropriate wording of the items and to adjust the quality criteria of the website. The aspects that were evaluated were: the time required to complete it, the simplicity of the format, the interest, brevity and clarity of the questions, as well as the recording, coding and interpretation of the results. It was also useful to carry out a first approximation of the food education content on the websites analysed [45,46,50].
The aim of this study was to assess the content validity and reliability of the questionnaire and to obtain the final design of the Questionnaire on evaluation in catering education (EDALCAT).

2. Materials and Methods

The EDALCAT questionnaire is a self-made checklist questionnaire, which initially included thirty-five items, with dichotomous questions (yes or no) for evaluation on quality and food education content and quality on catering company websites [50].
EDALCAT is composed of two parts, the first a block of predictors of website quality, divided into three subsections: Reliability, Design and Navigation. The items included in these sections were obtained by consulting the literature on the subject [27,28,30,32,33,34,35,36,37,51,52,53,54], and the recommendations of codes of conduct and certifications such as the American Medical Association (AMA), the e-Health Code of Ethics of the Internet Heath Coalition, the Health Summit Working Group (Summit), the e-Europe 2002 code, Accredited Medical Web (WMA), and the Health on the Net Foundation (HON Code), among others.
The second block of the EDALCAT incorporates two subsections relating, on the one hand, to the specific content of food education, and on the other hand, to the possible educational activities that caterers develop in schools. To determine the items in this section, the literature on food and nutrition education was consulted [20,55,56,57].
For the validation of the questionnaire, its reliability and content validity characteristics were determined as the feasibility was determined in a previous experiment consisting of a pilot study with ten selected websites [50].
To determine the content validity of the questionnaire, a panel of 14 experts was set up, taking into consideration their professional and research experience, and their recognised prestige in the field of community nutrition, public health, and informatics, which allowed for a comprehensive analysis of the problem under study. The experts were formally invited to participate in the project by e-mail. A computer application was developed with a questionnaire to assess the suitability of the items of the EDALCAT questionnaire for online completion. They were asked to make an overall assessment of the questionnaire and of the suitability of each of the items. They analysed the content of the questions in terms of comprehensibility, format and applicability, and assessed whether the items were relevant and representative of the domain they were intended to measure. The items were scored on a Likert scale from 1 to 5 (1 = Strongly disagree, 2 = Disagree, 3 = Not sure, 4 = Agree and 5 = Strongly agree). They were also allowed to make any suggestions about the questionnaire.
The statistical analysis was carried out by first obtaining the means and standard deviations of the scores given by the experts, as well as the Content Validity Index (CVI). This index was calculated by taking two different cut-off points. The first cut-off point was more demanding (4 or more) and the second less restrictive (3 or more), in line with those used in other studies [58,59,60,61]. The Inter-rater Agreement Method or inter-observer reliability was used to determine test-retest reliability. Two new raters who had not been members of the expert panel and with experience in the field of food and nutrition were selected to evaluate 30 selected websites with the EDALCAT. One of these new raters also had extensive experience in website design and evaluation and was considered the gold standard [46]. The intraclass correlation coefficient (ICC) was calculated for the total score and for each of the five sections of the questionnaire. In addition, scatter plots and Bland and Altman plot were constructed for the total scores obtained from the questionnaire by both raters.
Statistical analysis was performed using the statistical package PASW IMB SPSS Statistics 28 Microsoft Co., New York, NY, USA.

3. Results

The process of creating and validating the questionnaire with its different phases is shown in the flowchart in Figure 1.
Following the feasibility assessment [50], a second version of the EDALCAT questionnaire was obtained, which included the numbering of the different items to facilitate their referencing and the modification of the wording of two of them. Specifically, items 12 and 14, which became “Is the information contained on the website in more than one language?” and “Does it have an adequate browsing speed?”, respectively.

3.1. Content Validity

The content validity results from the expert panel can be seen in Table 1. All questions scored a mean of 4 points or more, except questions 6 and 34.
The CVI(1) indicates the percentage of scores between 4 and 5 that each item received from the experts. The items with the lowest CVI(1) were 33 and 34, although it should be noted that none of the items scored less than 3.
The CVI(2) indicates the percentage of scores between 3 and 5 for each item. The CVI(2) was 100% for all items except for question number six, which scored 71.40%, due to the fact that only one assessor scored 2 points.
After analysing the experts’ responses to the questionnaire and their suggestions, various modifications were made to several of the items in the questionnaire, as well as to the definitions of the variables.
In the Reliability section, question three was modified, replacing “Is the information up to date?” with “Does the web page indicate when it is up to date?”. In addition, the definition of the variable update was changed to “Date of last modification of the website”.
In the Design section, it was not considered necessary to modify any item.
In the Navigation section, items 15 and 17 were modified to read, “Is it easy to find the contents of the website?” and “Are there any recommended links?”, respectively. The question “Does the website have access to social networks?” was added. In addition, the definitions of the variables corresponding to questions 14 (speed) and 16 (downloads) were modified to read, “Adequate browsing speed, waiting time to load the website less than 5 sec.” and “Existence of any material to download, photos, documents, etc.”, respectively.
In the Content section, questions 22 and 24 were combined, resulting in the question “Is the information contained on the site factual and nutritionally adequate?”. In question 23, the word “unambiguous” was deleted, and the wording was changed to “Is the information comprehensible?”. Finally, question 30 was split into two questions, “Do you provide nutritional information on the school menu?” and “Do you provide recommendations for supplementation of the school menu?”.

3.2. Reliability

Table 2 shows the results of the reliability analysis of the questionnaire through inter-observer agreement, where an overall ICC value of 0.996 can be observed. Furthermore, the ICC calculated in each of the dimensions of the questionnaire was higher than 0.99 except in the Design and Navigation sections, where ICC values of 0.871 and 0.972, respectively, were obtained.
Figure 2 shows the scatter diagram of the total scores of the web pages awarded by each of the evaluators. It can be seen that the points are located around the bisector.
The Bland–Altman plot in Figure 3 represents, on the ordinate axis, the difference between the scores of the two observers, and on the abscissa axis, the mean of the scores obtained for each of the web pages. It can be seen that the difference remains approximately constant and within the 95% confidence interval. A small bias is detected whereby observer one would be scoring, on average, 0.5 points lower than observer two.
With these results, the adequacy of the items of the questionnaire was checked, and it was not necessary to modify any of them; it was only considered necessary to number the educational activities.
Finally, in the definition of variables, some adjustments were made to improve the wording and to clarify them, such as the definition of “Language”, or “Food-nutrition website”. The result was the final EDALCAT questionnaire (Table 3) together with the definition of variables (Table 4).

4. Discussion

EDALCAT presented optimal psychometric properties to be used as an instrument to assess the quality of catering websites and their food education content.
The experts’ scores for the different items of the questionnaire in their content validity were very high in all cases, with average values above 4 out of 5 points in all of them, except in the case of “Search engine” and “Examples” with scores of 3.86 points. To assess the content validity of EDALCAT, the Content Validity Index (CVI) was chosen because it is easy to calculate and interpret, because it focuses attention on the experts’ agreement on the relevance of the items and because it provides information both on a global scale and for each item [58,59,60,61,62,63]. The CVI has been chosen among other indices in numerous studies in a variety of settings [58,59,60,61,62,63,64,65,66], and its benefits over other indices stand out, as described in the literature [63]. The overall score was 0.87 for the CVI with cut-off point 4 and 0.99 for cut-off point 3, indicating very high content validity, and higher than that obtained in other studies. The study on the PES-NWI questionnaire [58] in the nursing setting obtained an overall average CVI of 0.85 from the 14 versions of the instrument, ranging from 0.60 to 0.98. It should be noted that a lower cut-off point of 3 (on a Likert scale of 1 to 4), and therefore less demanding, was used. Another study [66] on the validation of an instrument for the analysis of sports training in volleyball obtained a CVI of 0.91, while in the case of the Food Safety Systems Functionality Assessment (FSIA) questionnaire to measure the functionality, compliance and operability of national food safety systems, this index was 0.78 [59]. As a general rule, a CVI above 0.80 defines the item set as adequate [58,60,61,62,64,67]. However, it should be taken into account that the degree of agreement on an item also adjusts to the number of experts participating in the assessment and may be lower with a higher number of experts in the panel [60,61,62,63,64]. Considering that our expert panel consisted of 14 members, the CVI obtained can be considered very high for the EDALCAT questionnaire.
When analysing the experts’ responses and suggestions to the questionnaire, several modifications were made to items and variable definitions in order to clarify and facilitate the understanding of the questions in the questionnaire. The items of the variables “Updating”, “Ease”, “Links”, “Speed”, “Downloads” and “Comprehensibility” were modified, and the definition of these variables, such as “Updating”, was changed to “Date of last modification of the website”, as this was considered a more objective indicator of the age of the website. The items of the variables “Objectivity” and “Accuracy” were also reformulated and merged, and the item “Nutritional information and recommendations” was separated, giving rise to two items “Nutritional information” and “Recommendations”, as these are different concepts that could be misleading. Finally, the item “Social networks” was added, as it was considered appropriate to address new technologies and their current frequent use. Although there are other items that scored less well, they were considered appropriate because they are quality standards used as indicators of website quality.
The inter-observer agreement for assessing the reliability of the EDALCAT questionnaire was determined simultaneously by the two assessors. In this way, possible updates of the web pages, whose contents may vary over time, were prevented from influencing the results. Many other studies [44,45,68,69,70,71,72,73] in different fields have also chosen this method to determine the reliability of instruments.
The intraclass correlation coefficients (ICC), to determine the inter-observer reliability of the EDALCAT questionnaire, showed very high values above 0.970 in all dimensions except for the Design dimension, where the ICC value was 0.871. This last value, however, is very acceptable (above 0.75) [74], and its lower magnitude could be explained by its greater subjectivity compared to the rest of the dimensions. The overall ICC was very high and stood at 0.996 (above 0.90) [74], so it is considered to have excellent inter-observer reliability. Several studies obtained similar results, such as the evaluation of the Spanish adaptation of the “Induction Compliance Checklist” [73], which assesses the child’s behaviour during anaesthetic induction, and showed an ICC of 0.956. For its part, the IMS-Es, which assesses the mobility of critical patients in the ICU [75], obtained concordant values between nurses (0.987 ICC) and between nurse-physiotherapists (0.963 ICC). In addition, in the case of the reliability of a questionnaire on modes, time and distance of travel in university students [76], results were obtained that confirm its high reliability, with an ICC of 0.96 for the distance to and from school and 0.95 for the distance to and from university. However, other studies obtained significantly lower values, as in the study by Llorens-Ivorra et al. 2017 [71], which evaluated a questionnaire on food balance in school menus, where a value of 0.868 was reached for the overall ICC of food groups. Similarly, in the Spanish translation and validation of the Paediatric Quality of Life Inventory scale [72] on quality of life perceived by parents of children with neuromuscular diseases, an overall ICC of 0.90 was obtained. On the other hand, in studies on the evaluation of the questionnaire to measure knowledge about medication in patients [44] and in the evaluation of websites on information in the primary care setting [45], overall ICC values of 0.75 and 0.73, respectively, were obtained, which are significantly lower than those obtained in our study.
The reliability study was completed with a scatter plot and the Bland–Altman graph constructed from the total scores of the web pages given by each of the two evaluators. This method is used in some studies [69,71,72] to provide additional and alternative information, in a very visual and simple way, about the reliability of questionnaires. Both graphs showed high inter-observer agreement. Although a bias was detected whereby one of the observers was giving lower scores than the other, its magnitude was very small in relation to the overall score, at 0.5 points. On the other hand, the 95% confidence interval for the difference between the scores contained all observations and showed an acceptably low range of no more than two points difference between its upper and lower limit, regardless of the magnitude of the mean score. The results of such high inter-rater agreement are evidence of reliability in the EDALCAT questionnaire.
When checking the adequacy of the questionnaire items, it was not necessary to modify any of them. Only some editorial adjustments were made to the definitions of the variables in the questionnaire that could have a certain degree of subjectivity in their interpretation, such as “Language” or “Food-nutrition website”.
The limitations of the present study include, firstly, the dynamic and constantly updated nature of the information on the web pages, which means that the results have a temporal validity. In our study, we tried to minimise this circumstance by carrying out the evaluation of the experts on a simultaneous basis. On the other hand, the information contained in the web pages is of great interest, but all virtual information should be contrasted with information in situ, in order to verify its veracity and the scope of the educational activities carried out. Therefore, future research could focus on analysing the educational activities carried out in school canteens by catering companies, in collaboration with schools and educators, to check their involvement in practice and their impact on children.
The items relating to educational activities in the EDALCAT questionnaire could be useful for future evaluations of the educational activities carried out in school canteens, although it would be necessary to have additional data such as those relating to objectives, resources, content, methodology, action and evaluation.
The current development of the Internet has changed the way we relate to each other and obtain information, a fact that catering companies can take advantage of in order to offer services to users according to their needs. In addition, the number of children using school canteens and parents who are more aware of the importance of a proper diet for their children’s health is increasing every day. Catering websites are a good tool to provide quality information on food education, nutrition and health, provided that the information is endorsed by professionals and of high-quality standards.
Finally, the results of our study could guide the direct educational interventions of catering companies in school canteens and give greater relevance to food and nutrition education. The EDALCAT questionnaire, in this case, could be useful for the production of higher quality websites in relation to food education content.

5. Conclusions

This study developed and validated an EDALCAT questionnaire for the evaluation of catering websites, not only to measure the quality of the websites but also to assess their content in educational activities on food in school canteens.
The EDALCAT questionnaire developed in this research is a valid instrument for the evaluation of school catering websites, as the analysis of its psychometric properties showed it to have good feasibility, high content validity and excellent reliability. It is also an instrument with a possible international application and in areas other than this study.
This questionnaire can help catering companies to give more relevance to food and nutrition education through educational interventions and improvements in the activities and services provided in school canteens.
The results of this research could be considered as an opportunity for improvement, inviting managers of catering companies to implement better practice in the development of their websites.

Author Contributions

Conceptualization, N.R.-S., M.E.G.-S. and J.M.; methodology, N.R.-S.; software, N.R.-S.; validation, M.E.G.-S. and J.M.; formal analysis, M.E.G.-S. and J.M.; investigation, N.R.-S.; resources, N.R.-S., M.E.G.-S. and J.M.; data curation, M.E.G.-S. and J.M.; writing—original draft preparation, N.R.-S.; writing—review and editing, N.R.-S., M.E.G.-S. and J.M.; visualization, N.R.-S., M.E.G.-S. and J.M.; supervision, M.E.G.-S. and J.M.; project administration, M.E.G.-S. and J.M.; funding acquisition, M.E.G.-S. and J.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Manson, A.; Johnson, B.; Zarnowiecki, D.; Sutherland, R.; Golley, R. The food and nutrient intake of 5- to 12 year-old Australian children during school hours: A secondary análisis of the 2011–2012 National Nutrition and Physical Activity Survey. Public Health Nutr. 2021, 24, 5985–5994. [Google Scholar] [CrossRef] [PubMed]
  2. Seiquer, I.; Haroa, A.; Cabrera-Vique, C.; Muñoz-Hoyos, A.; Galdóc, G. Evaluación nutricional de los menús servidos en las escuelas infantiles municipales de Granada. An. Pediatr. 2016, 85, 197–203. [Google Scholar] [CrossRef]
  3. Durá, T.; Sánchez-Valverde, F. Obesidad infantil: ¿Un problema de educación individual, familiar o social? Acta Pediatr. Esp. 2005, 63, 204–207. Available online: https://studylib.es/doc/4484868/obesidad-infantil--%C2%BFun-problema-de-educaci%C3%B3n-individual-- (accessed on 1 October 2021).
  4. Macias, M.A.I.; Gordillo, S.L.G.; Camacho, R.E.J. Hábitos alimentarios de niños en edad escolar y el papel de la educación para la salud. Rev. Chil. Nutr. 2012, 39, 40–43. [Google Scholar] [CrossRef]
  5. Pozo, S.D.; Cuadrado, C.; Rodríguez, M.; Quintanilla, L.; Ávila, J.M.; Moreiras, O. Planificación nutricional de los menús escolares para los centros públicos de la Comunidad de Madrid. Nutr. Hosp. 2006, 21, 667–672. Available online: http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S0212-16112006000900006&lng=es&tlng=es (accessed on 24 October 2021). [PubMed]
  6. Caballero-Treviño, M.C. Papel del Comedor Escolar en la Dieta de la Población Infantil de Villanueva de la Cañada. Ph.D. Thesis, Universidad Complutense de Madrid, Madrid, Spain, 2010. Available online: https://eprints.ucm.es/11968/ (accessed on 1 October 2021).
  7. Quiles-Izquierdo, J.; Zubeldia-Lauzurica, L.; Álvarez-Pitti, J.; Blesa-Baviera, L.; Codoñer-Franch, P.; Crespo-Escobar, P.; Girba-Rovira, I.; Guadalupe-Fernádez, V.; Redondo-Gallego, M.J.; Serrano-Montero, A.; et al. Guía para los Menús en Comedores Escolares 2018; Conselleria de Sanidad Universal y Salud Pública: Valencia, Spain; Generalitat Valenciana: Valencia, Spain, 2018; Available online: http://www.san.gva.es/documents/151311/7497836/Guia+Menu+Comedores+Escolares+GVA+2018.pdf (accessed on 13 October 2021).
  8. Peñalvo, J.L.; Oliva, B.; Sotos-Prieta, M.; Uzhova, I.; Moreno-Franco, B.; León-Latre, M.; Ordovás, J.M. La mayor adherencia a un patrón de dieta mediterránea se asocia a una mejora del perfil lipídico plasmático: La cohorte del Aragon Health Workers Study. Rev. Esp. Cardiol. 2015, 68, 290–297. [Google Scholar] [CrossRef] [PubMed]
  9. Sánchez Muniz, F.J. La obesidad un grave problema de Salud Pública. An. Real Acad. Nac. Farm. 2016, 82, 6–26. Available online: https://dialnet.unirioja.es/servlet/articulo?codigo=6658272 (accessed on 1 October 2021).
  10. Díaz, J. Childhood obesity: Prevention or treatment? An. Pediatr. 2017, 86, 173–175. [Google Scholar] [CrossRef]
  11. Bibiloni, M.M.; Fernández-Blanco, J.; Pujol-Plana, N.; Martín-Galindo, N.; Fernández-Vallejo, M.M.; Roca-Domingo, M.; Chamorro-Medina, J.; Tur, J.A. Mejora de la calidad de la dieta y del estado nutricional en población infantil mediante un programa innovador de educación nutricional: INFADIMED. Gac. Sanit. 2017, 31, 472–477. [Google Scholar] [CrossRef]
  12. Herrero, M.; Moráis, A.B.; Pérez, J.D. Valoración nutricional en Atención Primaria ¿es posible? Rev. Pediatr. Aten. Primaria 2011, 13, 255–269. Available online: https://pap.es/articulo/11492/valoracion-nutricional-en-atencion-primaria-es-posible (accessed on 1 October 2021).
  13. Martínez, M.I.; Hernández, M.D.; Ojeda, M.; Mena, R.; Alegre, A.; Alfonso, J.L. Desarrollo de un programa de educación nutricional y valoración del cambio de hábitos alimentarios saludables en una población de estudiantes de Enseñanza Secundaria Obligatoria. Nutr. Hosp. 2009, 24, 504–510. Available online: http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S0212-16112009000400017&lng=es&nrm=iso (accessed on 17 October 2021). [PubMed]
  14. Gascón, L. Educación nutricional en la escuela como prevención de la obesidad infantil y de los TCA. In Libro de Ponencias “I Jornada Aragonesa de Nutrición y Dietética. Comer en la Escuela: Educación y Salud”: 15 de Febrero de 2008; SEDCA: Zaragoza, Spain, 2008; pp. 11–16. Available online: https://docplayer.es/74850940-Libro-de-ponencias-i-jornada-aragonesa-de-nutricion-y-dietetica.html (accessed on 13 October 2021).
  15. Romeo, J.; Wärnberg, J.; Marcos, A. Valoración del estado nutricional en niños y adolescentes. Pediatr. Integral. 2007, XI, 297–304. Available online: https://skat.ihmc.us/rid=1K4L4B2BZ-1PRDPXD-1JX/NUTRICI%C3%93N%25%2020-%20PEDIATR%C3%8DA.pdf (accessed on 12 November 2021).
  16. Durá, T. Influencia de la educación nutricional en el tratamiento de la obesidad infanto-juvenil. Nutr. Hosp. 2006, 21, 307–321. Available online: http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S0212-16112006000300004&lng=es&nrm=iso (accessed on 2 November 2021).
  17. Alba-Martín, R. Prevalencia de obesidad infantil y hábitos alimentarios en educación primaria. Enferm. Glob. 2016, 15, 40–51. Available online: http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S1695-61412016000200003&lng=es&nrm=iso (accessed on 2 November 2021).
  18. Pineda, E.; Bascunan, J.; Sassi, F. Improving the school food environment for the prevention of childhood obesity: What works and what doesn’t. Obes. Rev. 2021, 22, 13176. [Google Scholar] [CrossRef] [PubMed]
  19. Gurpinder-Singh, L. A review of the English school meal: ‘progress or a recipe for disaster’? Camb. J. Educ. 2021, 51, 627–639. [Google Scholar] [CrossRef]
  20. Aranceta, J.; Pérez-Rodrigo, C.; Dalmau, J.; Gil, A.; Lama, R.; Martin, M.A.; Suárez, V.M.; Belinchón, P.P.; Cortina, L.S. El comedor escolar: Situación actual y guía de recomendaciones. An. Pediatr. 2008, 69, 72–88. [Google Scholar] [CrossRef] [PubMed]
  21. Pozo, S. Programa de Comedores Escolares para la Comunidad de Madrid: Repercusión en la Calidad de los Menús y en el Estado Nutricional. Ph.D. Thesis, Universidad Complutense de Madrid, Madrid, Spain, 2007. Available online: https://eprints.ucm.es/7883/ (accessed on 15 October 2021).
  22. Aranceta, J.; Pérez, C. Guía para la restauración colectiva. Jano Med. Humanid. 2004, 67, 49–54. Available online: https://dialnet.unirioja.es/servlet/articulo?codigo=1056975 (accessed on 26 November 2021).
  23. Soler, C. Soberanía alimentaria en las mesas del colegio. Rev. Soberanía Aliment. Biodivers. Cult. 2011, 10, 1–82. Available online: https://da1.soberaniaalimentaria.info/images/estudios/sob_al_mesas_colegio.pdf (accessed on 13 October 2021).
  24. Llorens-Ivorra, C.; Soler-Rebollo, C. Aceptación de un menú escolar según la valoración de residuos del método de estimación visual Comstock. Rev. Esp. Nutr. Hum. Diet 2017, 21, 148–154. [Google Scholar] [CrossRef] [Green Version]
  25. Berradre-Sáenz, B.; Royo-Bordonada, M.A.; Bosqueda, M.J.; Moya, M.A.; López, L. Menú escolar de los centros de enseñanza secundaria de Madrid: Conocimiento y cumplimiento de las recomendaciones del Sistema Nacional de Salud. Gac. Sanit. 2015, 29, 341–346. [Google Scholar] [CrossRef] [Green Version]
  26. Díaz, A.M. Análisis de la calidad de las páginas web en los hospitales españoles. Enferm. Glob. 2007, 10, 1–13. Available online: https://revistas.um.es/eglobal/article/view/224 (accessed on 13 October 2021).
  27. Guardiola, R.; Gil, J.D.; Sanz, J.; Wanden-Berghe, C. Evaluating the quality of websites relating to diet and eating disorders. Health Info. Libr. J. 2011, 28, 294–310. [Google Scholar] [CrossRef]
  28. Conesa-Fuentes, M.C.; Aguinaga-Ontoso, E. Evaluación de la calidad de las páginas web con información sanitaria: Una revisión bibliográfica. Bid Textos Univ. Bibl. Doc. 2009, 23, 15. [Google Scholar] [CrossRef]
  29. Salvador-Oliván, J.A.; Angós-Ullate, J.M.; Fernández-Ruiz, M.J. Criterios para evaluar la calidad de las fuentes de información en Internet. Scire 1999, 5, 99–113. Available online: https://ibersid.eu/ojs/index.php/scire/article/view/1119 (accessed on 27 October 2021). [CrossRef]
  30. Ramos-Sánchez, E. Criterios más utilizados para la evaluación de la calidad de los recursos de información en salud disponibles en Internet. ACIMED 2004, 12, 1. Available online: http://scielo.sld.cu/scielo.php?script=sci_arttext&pid=S1024-94352004000200004&lng=es (accessed on 13 October 2021).
  31. Calvo-Calvo, M.A. Calidad y características de los sitios web de los hospitales españoles de gran tamaño. Rev. Esp. Doc. Cient. 2014, 37, e032. [Google Scholar] [CrossRef] [Green Version]
  32. Jiménez-Pernett, J.; García-Gutiérrez, J.F.; Bermúdez-Tamayo, C.; Silva-Castro, M.M.; Tuneu, L. Evaluación de sitios web con información sobre medicamentos. Aten. Primaria 2009, 41, 360–366. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Bermúdez, C.; Jiménez, J.; García, J.F.; Azpilicueta, I.; Silva, M.M.; Babio, G.; Castaño, J.P. Cuestionario para evaluar sitios web sanitarios según criterios europeos. Aten. Primaria 2006, 38, 268–274. [Google Scholar] [CrossRef] [Green Version]
  34. Domínguez, A.; Iñesta, A. Evaluación de la calidad de las webs de centros de farmacoeconomía y economía de la salud en Internet mediante un cuestionario validado. Gac. Sanit. 2004, 18, 295–304. [Google Scholar] [CrossRef] [Green Version]
  35. Rancaño, I.; Rodrigo, J.A.; Villa, R.; Abdelsater, M.; Díaz, R.; Álvarez, D. Evaluación de las páginas web en lengua española útiles para el médico de atención primaria. Aten. Primaria 2003, 31, 575–584. [Google Scholar] [CrossRef]
  36. Conesa, M.C.; Aguinaga, E.; Hernández, J.J. Evaluación de la calidad de las páginas web sanitarias mediante un cuestionario validado. Aten. Primaria 2011, 43, 33–40. [Google Scholar] [CrossRef] [Green Version]
  37. Olea, C. Calidad de las páginas web de asociaciones de diabetes en España. Rev. Esp. Común. Salud 2012, 3, 16–27. Available online: https://e-revistas.uc3m.es/index.php/RECS/article/view/3385 (accessed on 28 October 2021).
  38. Peña-Palenzuela, N. Calidad de las páginas web con información sobre el cáncer de mama: Una revisión bibliográfica. Rev. Esp. Comun. Salud 2016, 7, 104–112. [Google Scholar] [CrossRef]
  39. Sanz-Lorente, M.; Guardiola-Wanden-Berghe, R. Evaluación de la calidad de las páginas Web sobre el Hospital a Domicilio: El Indicador de Credibilidad como factor pronóstico. Hosp. Domic. 2017, 1, 73–82. [Google Scholar] [CrossRef] [Green Version]
  40. Gil-Pérez, J.D. Internet como Generador de Opinión en la Juventud Española: Valoración de la Calidad y Credibilidad de las Páginas Web Más Consultadas por los Jóvenes Españoles. Ph.D. Thesis, Universidad de Alicante, Alicante, Spain, 2011. Available online: https://rua.ua.es/dspace/bitstream/10045/24407/1/Tesis_Josefa_Gil_Perez.pdf (accessed on 28 November 2021).
  41. Alvarado-Zeballos, S.; Nazario, M.A.; Taype-Rondan, A. Características de las páginas web en español que brindan información sobre aborto. Rev. Fac. Med. 2017, 65, 621–626. [Google Scholar] [CrossRef]
  42. Ortega, E.; Calderón, A.; Palao, J.M.; Puigcerver, M.C. Diseño y validación de un cuestionario para evaluar la actitud percibida del profesor en clase y de un cuestionario para evaluar los contenidos actitudinales de los alumnos durante las clases de educación física en secundaria. Retos. Nuevas Tend. Educ. Fis. Deporte Recreación 2008, 14, 22–29. [Google Scholar] [CrossRef]
  43. Andrés-Iglesias, J.C.; Andrés-Rodríguez, N.F.; Fornos-Pérez, J.A. Validación de un cuestionario de conocimientos sobre hipercolesterolemia en la farmacia comunitaria. Seguim. Farmacoter. 2005, 3, 189–196. Available online: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.956.4268&rep=rep1&type=pdf (accessed on 13 October 2021).
  44. García-Delgado, P.; Gastelurrutia-Garralda, M.A.; Baena-Parejo, M.I.; Fisac-Lozano, F.; Martínez-Martínez, F. Validación de un cuestionario para medir el conocimiento de los pacientes sobre sus medicamentos. Aten. Primaria 2009, 41, 661–668. [Google Scholar] [CrossRef] [Green Version]
  45. Carvajal, A.; Centeno, C.; Watson, R.; Martínez, M.; Sanz-Rubiales, Á. ¿Cómo validar un instrumento de medida de la salud? An. Sist. Sanit. Navar. 2011, 34, 63–72. [Google Scholar] [CrossRef] [Green Version]
  46. García De Yébenes-Prous, M.J.; Rodríguez-Salvanés, F.; Carmona-Ortells, L. Validación de cuestionarios. Reumatol. Clin. 2009, 5, 171–177. [Google Scholar] [CrossRef]
  47. Trinidad-Rodriguez, I.; Fernández-Ballart, J.; Cucó-Pastor, G.; Biarnés-Jordá, E.; Arija-Val, V. Validación de un cuestionario de frecuencia de consumo alimentario corto: Reproducibilidad y validez. Nutr. Hosp. 2008, 23, 242–252. Available online: http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S0212-16112008000300011&lng=es (accessed on 2 October 2021).
  48. Nova, J.A.; Hernández-Mosqueda, J.S.; Tobón–Tobón, S. Juicio de expertos para la validación de un instrumento de medición del síndrome de burnout en la docencia. Ra Ximhai 2016, 12, 327–346. [Google Scholar] [CrossRef]
  49. Martín-Alfonso, L.; Bayarre-Vea, H.D.; Grau-Ábalo, J.A. Validación del cuestionario MBG (Martín-Bayarre-Grau) para evaluar la adherencia terapéutica en hipertensión arterial. Rev. Cuba. Salud Pública 2008, 34, 2–10. [Google Scholar] [CrossRef]
  50. Rico-Sapena, N.; Galiana-Sánchez, M.E.; Bernabéu-Mestre, J. Evaluación del contenido sobre educación alimentaria en páginas web de servicios de catering: Estudio piloto en el ámbito escolar. Rev. Esp. Nutr. Hum. Diet 2014, 18, 58–67. [Google Scholar] [CrossRef]
  51. Azpipilicueta, I.; Bermúdez, C.; Silva, M.M.; Valverde, I.; Martiarena, A.; García, J.F.; Jiménez-Pernett, J.; Valls, L.T.; Dáder, M.J.F. Adecuación a los códigos de conducta para información biomédica en internet de sitios web útiles para el seguimiento farmacoterapéutico. Gac. Sanit. 2007, 21, 204–209. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Cumbreras, C.; Conesa, M.C. Usabilidad en las páginas web: Distintas metodologías, creación de una guía de evaluación heurística para analizar un sitio web, aplicación en enfermería. Enferm. Global. 2006, 9, 1. [Google Scholar] [CrossRef]
  53. Valeiras, N.; Meneses, J.A. Criterios y procedimientos de análisis en el estudio del discurso en páginas web: El caso de los residuos sólidos urbanos. Enseñ. Cienc. 2006, 24, 71–84. Available online: https://raco.cat/index.php/Ensenanza/article/view/73533 (accessed on 28 November 2021). [CrossRef]
  54. Llinás, G.; Mira, J.J.; Pérez-Jover, V.; Tomás, O. En qué se fijan los internautas para seleccionar páginas web sanitarias. Rev. Calid. Asist. 2005, 20, 385–390. [Google Scholar] [CrossRef]
  55. Bolaños, P. La educación nutricional como factor de protección en los trastornos de la conducta alimentaria. Trastor. Conducta Aliment. 2009, 10, 1069–1086. Available online: https://dialnet.unirioja.es/servlet/articulo?codigo=3214016 (accessed on 3 October 2021).
  56. Téllez, M.; Orzáez, M.T. Una experiencia de educación nutricional en la escuela. OFFARM 2003, 22, 70–76. Available online: https://www.elsevier.es/es-revista-offarm-4-articulo-una-experiencia-educacion-nutricional-escuela-13049108 (accessed on 25 October 2021).
  57. Serrano, J.; Sáez, S. Recursos didácticos en educación para la salud. In Promoción y Educación para la Salud. Conceptos, Metodología, Programas; Sáez, S., Font, P., Pérez, R., Márquez, F., Eds.; Editorial Milenio: Lleida, Spain, 2001; pp. 269–284. [Google Scholar]
  58. Orts-Cortes, M.I. Validez de Contenido del Practice Environment Scale of the Nursing Work Index (PES-NWI) en el Ámbito Europeo. Ph.D. Thesis, Universidad de Alicante, Alicante, Spain, 2011. Available online: https://rua.ua.es/dspace/bitstream/10045/21852/1/tesis_orts.pdf (accessed on 30 October 2021).
  59. Cartín-Rojas, A.; Pascual-Barrera, A. Análisis de validez y reproducibilidad de un instrumento para sistemas nacionales de inocuidad de alimentos. Rev. Cient. Ecocienc. 2019, 6, 1–20. [Google Scholar] [CrossRef]
  60. Polit, D.F.; Beck, C.T. The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Polit, D.F.; Beck, C.T.; Owen, S.V. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res. Nurs. Health 2007, 30, 459–467. [Google Scholar] [CrossRef] [PubMed]
  62. Pedrosa, I.; Suárez-Álvarez, J.; García-Cueto, E. Evidencias sobre la validez de contenido: Avances teóricos y métodos para su estimación. Acción Psicol. 2014, 10, 3–20. [Google Scholar] [CrossRef]
  63. Lynn, M.R. Determination and Quantification of Content Validity. Nurs. Res. 1986, 35, 382–386. Available online: https://pubmed.ncbi.nlm.nih.gov/3640358/ (accessed on 26 November 2021). [CrossRef] [PubMed]
  64. Urrutia-Egaña, M.J.; Barrios-Araya, S.C.; Gutiérrez-Núñez, M.L.; Mayorga-Camus, M.P. Métodos óptimos para determinar validez de contenido. Educ. Méd. Super. 2014, 28, 547–558. Available online: http://www.ems.sld.cu/index.php/ems/article/view/301 (accessed on 30 October 2021).
  65. Sarabia-Cobo, C.M.; Alconero-Camarero, A.R. Claves para el diseño y validación de cuestionarios en Ciencias de la Salud. Enferm. Cardiol. 2019, 26, 69–73. Available online: https://dialnet.unirioja.es/servlet/articulo?codigo=7142007 (accessed on 30 October 2021).
  66. Collet, C.; Nascimento, J.V.; Folle, A.; Ibáñez, S.J. Construcción y validación de un instrumento para el análisis de la formación deportiva en voleibol. Cuad. Psicol. Deporte 2018, 19, 178–191. [Google Scholar] [CrossRef] [Green Version]
  67. Gilbert, G.; Prion, S. Making Sense of Methods and Measurement: Lawshe’s Content Validity Index. Clin. Simul. Nurs. 2016, 12, 530–531. [Google Scholar] [CrossRef]
  68. Ruiz-Moral, R.; Pérula de Torres, L.A. Validez y fiabilidad de un instrumento para evaluar la comunicación clínica en las consultas: El cuestionario CICAA. Aten. Primaria 2006, 37, 320–324. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  69. Pedraza, L.O.; Sierra, F.; Salazar, A.M.; Hernández, A.M.; Ariza, M.J.; Montalvo, M.C.; Plata, J.; Muñoz, Y.; Díaz, J.M.; Piñeros, C. Acuerdo intra-interobservador en las pruebas Minimental State Examination (MMSE) y Montreal Cognitive Assessment (MoCA test) aplicados por personal en entrenamiento. Acta Neurol. Colomb. 2015, 32, 35–40. [Google Scholar] [CrossRef]
  70. Infante-Ruiz, S.L.; Rodríguez-García, J.; Ríos-García, J.J.; Fernández-Torrico, J.M.; Cano-Plasencia, G.; Echevarría-Ruiz de Vargas, C. Variabilidad intra- e interobservador en la medición digital del ángulo de Cobb en la escoliosis idiopática. Rehabilitación 2016, 50, 75–80. [Google Scholar] [CrossRef]
  71. Llorens-Ivorra, C.; Arroyo-Bañuls, I.; Quiles-Izquierdo, J.; Richart-Martínez, M. Fiabilidad de un cuestionario para evaluar el equilibrio alimentario de menús escolares. Arch. Latinoam. Nutr. Órgano Of. Soc. Latinoam. Nutr. 2017, 67, 251–259. Available online: http://www.alanrevista.org/ediciones/2017/4/art-2 (accessed on 3 October 2021).
  72. Girabent-Farrés, M.; Monné-Guasch, L.; Bagur-Calafat, C.; Fagoaga, J. Traducción y validación al español del módulo neuromuscular de la escala Pediatric Quality of Life Inventory (PedsQL): Evaluación de la calidad de vida percibida por padres de niños de 2-4 años con enfermedades neuromusculares. Rev. Neurol. 2018, 66, 81–88. [Google Scholar] [CrossRef]
  73. Jerez-Molina, C.; Lázaro-Alcay, J.J.; Ullán-de la Fuente, A.M. Adaptación transcultural de la escala Induction Compliance Checklist para la evaluación del comportamiento del niño durante la inducción de la anestesia. Enferm. Clín. 2018, 28, 260–265. [Google Scholar] [CrossRef] [PubMed]
  74. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  75. Arias-Rivera, S.; Raurell-Torreda, M.; Thuissard-Vasallo, I.J.; Andreu-Vázquez, C.; Hodgson, C.L. Adaptación y validación de la ICU Mobility Scale en España. Enferm. Intensiva 2020, 31, 131–146. [Google Scholar] [CrossRef] [PubMed]
  76. Palma-Leal, X.; Escobar-Gómez, D.; Chillón, P.; Rodríguez-Rodríguez, F. Fiabilidad de un cuestionario de modos, tiempo y distancia de desplazamiento en estudiantes universitarios. Retos 2019, 37, 210–214. [Google Scholar] [CrossRef]
Figure 1. Design and validation phases of the EDALCAT questionnaire.
Figure 1. Design and validation phases of the EDALCAT questionnaire.
Ijerph 19 03685 g001
Figure 2. Inter-observer agreement scatterplot.
Figure 2. Inter-observer agreement scatterplot.
Ijerph 19 03685 g002
Figure 3. Bland-Altman Graph.
Figure 3. Bland-Altman Graph.
Ijerph 19 03685 g003
Table 1. Average of experts’ scores.
Table 1. Average of experts’ scores.
Items of the Version 2 Questionnaire by Sections
Reliability
MeanStdevCVI (1)CVI (2)
1. Is the author(s) identified on the website?4.710.49100.00100.00
2. Is a contact address for the catering company provided?4.860.38100.00100.00
3. Is the information up to date?4.290.9571.40100.00
4. Is the protection of personal data and privacy specified?4.290.7685.70100.00
5. Does the website indicate the quality certificates of the catering company?4.140.9071.40100.00
6. Does it contain an internal search engine for the information contained on the website?3.861.3571.4071.40
Design
7. Does the website have an attractive and original graphic and multimedia design?4.290.7685.70100.00
8. Is the website properly structured and organised?4.860.38100.00100.00
9. Does it include a site map?4.430.7985.70100.00
10. Does it have a clear and appropriate language for the user?4.710.49100.00100.00
11. Is the font size and colour contrast appropriate?4.140.6985.70100.00
12. Is the information contained on the website in more than one language?4.000.8271.40100.00
Navigation
13. Is the website accessible and easy to navigate?4.860.38100.00100.00
14. Does it have an adequate browsing speed?4.140.9071.40100.00
15. Is it easy to find content and search the website?4.710.76100.00100.00
16. Does it have downloadable material?4.290.9571.40100.00
17. Are there recommended links and are they up to date?4.290.7685.70100.00
18. Does it have online help?4.290.9571.40100.00
19. Is the site free of advertising?4.860.38100.00100.00
Content
20. Is the objectives or mission of the caterer reflected on the website?4.290.9571.40100.00
21. Does it have a section on food, nutrition or dietetics?4.430.7985.70100.00
22. Is the information on the website objective?4.860.38100.00100.00
23. Is the information comprehensible and unambiguous?4.860.38100.00100.00
24. Is the information nutritionally correct and adequate?4.570.7985.70100.00
25. Is the content endorsed by competent professionals?4.570.53100.00100.00
26. Does it relate nutrition to health?4.570.53100.00100.00
27. Is the importance of physical exercise indicated?4.290.7685.70100.00
28. Does the caterer participate in food and nutrition education programmes?4.430.7985.70100.00
29. Are special menus provided for students with specific therapeutic or cultural needs?4.570.53100.00100.00
30. Do you provide nutritional information and recommendations for supplementation of the school menu?4.570.53100.00100.00
31. Do you have private access to school menus for parents?4.710.49100.00100.00
32. Is the role of educators and their training indicated?4.290.7685.70100.00
33. Does the school have a separate website specifically for food and nutrition?4.001.0057.10100.00
34. Does the website cite examples or show real cases?3.860.9057.10100.00
Educational Activities
35. Are there any activities?4.570.7985.70100.00
36. Informative talks4.430.7985.70100.00
37. Gastronomic days4.570.7985.70100.00
38. Cooking workshops4.570.7985.70100.00
39. Healthy cooking recipes4.710.49100.00100.00
40. Other4.430.7985.70100.00
Global4.440.7187.0099.00
(1) Content Validity Index based on % of scores 4 or higher. (2) Content Validity Index based on % of scores 3 or higher.
Table 2. Average observer scores and intraclass correlation coefficient.
Table 2. Average observer scores and intraclass correlation coefficient.
OBSERVER 1OBSERVER 2ICC
MeanStdevMeanStdev
Reliability4.571.0734.600.9680.992
Design4.731.0484.501.1060.871
Navigation6.531.2796.271.4370.972
Content10.203.70810.233.6260.999
Educational Activities3.872.0303.802.0410.996
Total29.906.88029.406.8060.996
Table 3. Validated EDALCAT questionnaire, for the evaluation of catering websites.
Table 3. Validated EDALCAT questionnaire, for the evaluation of catering websites.
Catering Website
Predictors of quality
ReliabilityYESNO
1. Is the author(s) identified on the website?
2. Is a contact address of the catering company provided?
3. Does the website indicate when it was updated?
4. Is the protection of personal data and privacy specified?
5. Does the website indicate the quality certificates of the catering company?
6. Does it contain an internal search engine for the information contained on the website?
DesignYESNO
7. Does the website have an attractive and original graphic and multimedia design?
8. Is the website properly structured and organised?
9. Does it include a site map?
10. Does it have a clear and appropriate language for the user?
11. Is the font size and contrasting colour appropriate?
12. Is the information contained on the website in more than one language?
NavigationYESNO
13. Is the website accessible and easy to navigate?
14. Does it have an adequate browsing speed?
15. Is it easy to find content on the website?
16. Does it have downloadable material?
17. Are there any recommended links?
18. Does the website have access to social networking sites?
19. Does it have online help?
20. Is the website free of advertising?
Specific food education content
ContentsYESNO
21. Does the website reflect the objectives or mission of the caterer?
22. Does it have a section on food, nutrition or dietetics?
23. Is the information contained on the website objective and nutritionally adequate?
24. Is the information comprehensible?
25. Is the content endorsed by competent professionals?
26. Is food related to health?
27. Is the importance of physical exercise indicated?
28. Does the caterer participate in educational programmes on food and nutrition?
29. Are special menus provided for pupils with specific dietary or cultural needs?
30. Do you provide nutritional information on the school menu?
31. Do you provide recommendations for supplementation of the school menu?
32. Do you have private access for parents to the school menu?
33. Is the role of educators and their training indicated?
34. Does the school have a separate website specifically for food and nutrition?
35. Does the website cite examples or show real cases?
Educational activitiesYESNO
36. Do activities take place?
What kind of activities does the caterer carry out?37. Informative talks
38. Gastronomic days
39. Cooking workshops
40. Healthy cooking recipes
41. Other
Table 4. Definition of final variables of the validated EDALCAT questionnaire.
Table 4. Definition of final variables of the validated EDALCAT questionnaire.
VariablesDefinition
Predictors of quality
Reliability
AuthorshipPerson/people or company responsible for the content of the website.
Contact addressAddress, e-mail address, telephone number, etc.
UpdatingDate of last modification of the website.
PrivacyData protection and user privacy policy.
CertificationCatering quality, food safety, environmental, etc., certifications.
SearchMechanism for searching, consulting and locating the contents of the website.
Design
Graphic designGraphic and multimedia design of the website.
StructureStructure and organisation of the website.
Site mapSite map to facilitate the search of contents.
LegibilityLanguage and expression of the contents of the website.
Form and colourFont size and contrasting colour on the website.
LanguagePossibility of reading the website in more than one language.
Navigation
AccessibilityEasy access to the information contained in the pages without limitation.
SpeedAdequate browsing speed, web page loading time of less than 5 s. Adequate speed is considered adequate if it has a waiting time of less than 5 s.
EaseEase or not of finding content on the website.
DownloadsExistence of any kind of downloadable material, photos, documents, etc.
LinksExistence of links on the website that work correctly.
Social NetworkingExistence of hyperlinks to access social networks, Facebook, Twitter, …
HelpOnline help for queries from the website, with chat, telephone, …
AdvertisingNo advertising or promotion of brands or collaborating companies.
Specific Contents
Content
PurposeObjective or mission of the services provided by the catering service.
Food and nutrition sectionExistence of a specific section on food, nutrition or dietetics on the website.
ObjectivityInformation expressed in an objective and nutritionally adequate manner.
UnderstandableInformation expressed in an understandable and unambiguous way.
EndorsedInformation endorsed by professional and academic persons or institutions.
HealthContent relates nutrition to health effects.
Physical exerciseThe content expresses the importance of physical exercise as part of healthy habits.
CollaborationThe catering service collaborates with an established educational programme or has one of its own.
Special menusThe catering service provides special menus for pupils with diabetes, food allergies, coeliac disease, religious or cultural beliefs.
Nutritional informationNutritional information of the school menu indicating calorie, protein, fat and carbohydrate intake.
RecommendationsRecommendations for supplementing the school menu on the most appropriate food intake for the rest of the day.
Private accessPrivate access to the school’s monthly menus from the website.
MonitorsIndication of the roles of educators or monitors and their training.
Food-nutrition websiteSeparate food and nutrition specific webpage separate from the catering website.
ExamplesCitation of examples or sample real cases of catering services.
Educational Activities
ActivitiesActivities aimed at educating about food, nutrition, etc., are carried out.
TalksInformative talks on food, nutrition and dietetics.
ConferencesGastronomic days on regions or countries, themes, festivities, etc.
WorkshopsCooking workshops, where children can learn about cooking, food, etc.
ReceptionHealthy cooking recipes.
OtherCarrying out activities other than those mentioned above.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rico-Sapena, N.; Galiana-Sánchez, M.E.; Moncho, J. Validation of a Questionnaire of Food Education Content on School Catering Websites in Spain. Int. J. Environ. Res. Public Health 2022, 19, 3685. https://doi.org/10.3390/ijerph19063685

AMA Style

Rico-Sapena N, Galiana-Sánchez ME, Moncho J. Validation of a Questionnaire of Food Education Content on School Catering Websites in Spain. International Journal of Environmental Research and Public Health. 2022; 19(6):3685. https://doi.org/10.3390/ijerph19063685

Chicago/Turabian Style

Rico-Sapena, Nuria, María Eugenia Galiana-Sánchez, and Joaquín Moncho. 2022. "Validation of a Questionnaire of Food Education Content on School Catering Websites in Spain" International Journal of Environmental Research and Public Health 19, no. 6: 3685. https://doi.org/10.3390/ijerph19063685

APA Style

Rico-Sapena, N., Galiana-Sánchez, M. E., & Moncho, J. (2022). Validation of a Questionnaire of Food Education Content on School Catering Websites in Spain. International Journal of Environmental Research and Public Health, 19(6), 3685. https://doi.org/10.3390/ijerph19063685

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop