Next Article in Journal
Type 2 Diabetes Mellitus and Liver Disease: Across the Gut–Liver Axis from Fibrosis to Cancer
Next Article in Special Issue
Associations of Maternal Serum Iodine Concentration with Obstetric Complications and Birth Outcomes—Longitudinal Analysis Based on the Huizhou Mother–Infant Cohort, South China
Previous Article in Journal
Nutrients and Cardiometabolic Health in Type 2 Diabetes
Previous Article in Special Issue
Omega-3 Fatty Acids during Pregnancy in Indigenous Australian Women of the Gomeroi Gaaynggal Cohort
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development and Relative Validation of a Food Frequency Questionnaire to Assess Non-Nutritive Sweeteners Intake among Pregnant Women in Santiago, Chile: A Pilot Study

1
Department of Nutrition, Faculty of Medicine, University of Chile, Av. Independencia 1027, Independencia, Santiago 8380453, Chile
2
Institute of Nutrition and Food Technology (INTA), University of Chile, Av. El Líbano 5524, Macúl, Santiago 7830490, Chile
3
Department of Women and Newborn’s Health Promotion, Faculty of Medicine, University of Chile, Av. Independencia 1027, Independencia, Santiago 8380453, Chile
*
Authors to whom correspondence should be addressed.
Nutrients 2023, 15(11), 2518; https://doi.org/10.3390/nu15112518
Submission received: 20 April 2023 / Revised: 24 May 2023 / Accepted: 25 May 2023 / Published: 29 May 2023
(This article belongs to the Special Issue Nutrition in Pregnancy and Child)

Abstract

:
Studies on the effects of non-nutritive sweeteners (NNSs) among pregnant women are scarce and have produced mixed results. One of the major challenges is to accurately assess NNS intake, especially in countries that have implemented policies to prevent obesity and where many foods and beverages have been progressively reformulated to partially or totally replace sugar with NNSs. This study aimed to develop and assess the relative validity of a food frequency questionnaire (FFQ) for use in pregnant women. We developed an FFQ to examine the intake of seven NNSs (acesulfame-k, aspartame, cyclamate, saccharin, sucralose, steviol glycosides, and D-tagatose). This questionnaire was piloted in 29 pregnant women (median age = 31.2 y; 25th–75th percentile: 26.9–34.7) to assess NNS intake over the previous month, compared to 3-day dietary records (3-DR). The validity of this dietary method was assessed using Spearman’s correlation coefficient, Lin´s concordance correlation coefficient (CCC), and Bland–Altman plots. Spearman’s correlations between the FFQ on NNSs and 3-DR ranged from 0.50 for acesulfame K to 0.83 for saccharin. CCC ranged between 0.22 and 0.66. The Bland–Altman plots showed an overestimation of saccharin, sucralose, and steviol glycosides intake by the FFQ on NNSs compared with 3-DR, and an underestimation of acesulfame K and aspartame. Overall, the NNSs most frequently consumed were sucralose, and none of the participants exceeded the acceptable daily intake for any of the NNSs evaluated. The FFQ on NNSs seems to be reasonably valid in the assessment of NNSs among pregnant women.

1. Introduction

Non-nutritive sweeteners (NNSs) are additives used in various foods and beverages to reduce energy density and sugar content, or as tabletop sweeteners [1,2]. They are widely employed to prevent weight gain or facilitate weight loss, or to regulate glucose metabolism in diabetic patients. Due to the growing incidence of obesity and type 2 diabetes, the global consumption of NNSs over the last decade has increased dramatically in adults and children [3,4,5]. In Chile, the law 20.606 on Food Labeling and Advertising sets limits for the sugar, sodium, saturated fat, and total energy content in processed foods [6]. Foods that exceed the limits for one or more critical nutrient must carry a front-of-package warning label stating: “High in …,” with the identity of the corresponding critical nutrient [7]. Since the law came into force, many foods and beverages have been progressively reformulated to replace sugar with NNSs [8,9] and, in consequence, the proportion of processed foods containing NNSs has increased considerably in recent years. We recently showed, for example, that 55.5% of foods available in Chilean supermarkets contained NSSs, which is much higher than in other countries [9].
Alongside the increase in NNS consumption, conflicting results have associated their use with a wide range of adverse health effects related to cancer risk [10], alterations in food intake, mood, blood pressure, body weight, abdominal obesity, and the development of diabetes and neurodegenerative diseases [11,12,13,14]. Accordingly, the benefits of NNS use on human health is the subject of intense debate. In this context, the World Health Organization (WHO) has published a guideline on the use of non-sugar sweeteners which suggests “that non-sugar sweeteners not be used as a means of achieving weight control or reducing the risk of non-communicable diseases (conditional recommendation)” [15].
Of particular interest for the consumption of NNSs is their possible effect on fetal development in utero and their use during pivotal periods such as pregnancy and lactation, due to the possibility of metabolic alterations or other consequences in the mother and offspring [2,3,16,17]. Unfortunately, few studies have been conducted in this area to date. A recent meta-analysis, based on three studies, reported that NNS intake by pregnant women increased the risk of preterm delivery [18]. Another study showed that infants whose mothers consumed NNS during pregnancy and lactation have higher weight gain at one year of age [19]. More studies are therefore necessary to assess the impact of maternal NNS intake on child health.
Finally, the conflicting results reported above regarding the effect of NNS consumption may be partly due to the different approaches used to measure NNS intake. Though the consumption of artificially sweetened beverages is generally used as a proxy for NNS intake [20], the validity of this approach decreases when the variety in foods containing NSSs increases, as in Chile. There is, therefore, an urgent need to develop valid, efficient, and cost-effective instruments to accurately assess NNS consumption. Traditionally, Food Frequency Questionnaires (FFQs) have been the preferred method used in epidemiological studies to assess usual dietary intakes over long periods of time and in large samples, as they are less burdensome, less time consuming, and less intrusive for participants [21,22,23]. It is important to evaluate FFQs in the target population before implementation, and to assess their validity by comparing them to an appropriate dietary reference method [24]. FFQs are usually validated by 24 h recalls or dietary records [25]. To our knowledge, no study has accurately assessed NNS intake in pregnant women, given the variation in NNS content with portion size, brands, and flavors, especially in countries where the number of foods and beverages containing NNSs has dramatically increased [26].
Therefore, the aim of this pilot study was to develop and assess the relative validity of an FFQ to evaluate the intake of NNSs in pregnant women in Santiago, Chile. The NNSs studied were those most commonly found in food and beverages in the Chilean market at the time of data collection [9].

2. Material and Methods

2.1. Study Design

This work was undertaken as part of the study “Determination of fetal and infant exposure to non-caloric sweeteners study”, whose aim is to determine NNS concentrations (sucralose, saccharin, acesulfame-k, cyclamate, and steviol) in amniotic liquid and breastmilk and correlate them with maternal NNS intake in order to evaluate fetal/infant exposure to these compounds. In addition, it aims to determine whether a higher intake and concentration of NNSs influence sweet taste threshold and preference as well as weight gain during the first year in their offspring (https://clinicaltrials.gov/ct2/show/NCT03972176; accessed on 24 May 2023). The current FFQ on NNSs validation study was conducted as an initial step prior to subject recruitment and data collection for this study. Accordingly, subjects included in the validation step were not participants of the main study.
A convenience sample of pregnant women was recruited from the Santiago Metropolitan Area from May 2019 to September 2019 using flyers, advertisements, social media posts, and word of mouth. These mothers were attended to in Primary Health Care Centers from the surrounding neighborhood area and the Faculty of Medicine at University of Chile. Initially, 75 pregnant women were contacted, and the following eligibility criteria were applied: singleton pregnancy, being in the last trimester of pregnancy, ≥18 years of age, fluent in Spanish, without diagnosis of diabetes prior to pregnancy, and more than two years of residence in Chile. Forty-five women met these criteria and were invited to participate a face-to-face interview. These who agreed to participate signed an informed consent form, completed a short sociodemographic questionnaire, answered some questions regarding their previous pregnancies and current pregnancy, and self-reported their current weight. Trained nutritionists applied the FFQ on NNSs, and upon completion of the face-to-face interview, the women were provided with a three-day dietary record to be returned, once completed, to the nutritionist within the following seven days. The final sample with comprehensive information on the FFQ on NNSS and 3-day dietary records included 29 pregnant women. The Ethics Committee of the Faculty of Medicine at the University of Chile approved the study.

2.2. Food Frequency Questionnaire

The development of the FFQ on NNSs was divided into two phases: design (phase 1) and piloted validation (phase 2). In phase 1, a food and beverage list was created specifically to capture NNS intake over the previous month. The NNS content was obtained after trained personnel carried out a comprehensive search visiting nineteen supermarkets and gathering information from thirteen web pages from food, beverage, and tabletop NNSs. The information included ingredients, concentrations per serving size, concentrations per 100 g, brands, and flavors of all foods and beverages available in the Chilean market at the time of data collection [9]. Overall, a total of 815 food and beverage items were found that contained at least one of these NNSs: acesulfame-k, aspartame, cyclamate, saccharin, sucralose, steviol glycosides, and D-tagatose, and they were organized into six food groups: (i) dairy products; (ii) cereal products; (iii) processed fruits; (iv) non-alcoholic beverages; (v) sweets and other desserts; and (vi) tabletop NNSs. All the information was entered in an Excel spreadsheet to assign the values for NNS content in milligrams (mg) to all NNS products found per serving size and per 100 g. Furthermore, to stimulate participants´ memory, a photographic atlas of all the products with NNSs (including specific brands and flavors) ordered by food groups was developed, which also contained images of dishes, glasses, and tablespoons to estimate the size of the ingested portion. The food database and atlas were regularly updated in the course of the study in order to integrate the new NNS-containing products launched on the market and, eventually, to eliminate those that were withdrawn. A semi-quantitative questionnaire with open-ended options was used to prevent the loss of information and misclassification [27] (see Figure 1). Serving sizes were estimated based on amounts commonly purchased or eaten according to the National Chilean Dietary Survey (Encuesta Nacional de Consumo Alimentario, ENCA) [28]. A team of nutritionists reviewed and confirmed the content validity of the questionnaire.
In phase 2, the FFQ information was compiled by a trained nutritionist during the face-to-face interview with the participants. The photographic atlas of all products containing NNS, classified by food groups, was shown to the mothers, who were asked to indicate their usual frequency of consumption of each of them. Next, the serving size was specified in terms of household units of measurement. For each NNS, the amount of daily intake was calculated as follows: Daily NNS intake (mg/day) = [Number of daily serving sizes X Frequency intake monthly X Serving size amount (g or mL) X Concentration of each NNS in the food matrix (mg/100 g)]/30. Afterwards, we determined the daily intake per kilogram of body weight of each NNS by dividing the daily intake previously calculated by the self-reported body weight (mg/kg bw). Finally, such values were summed up to obtain the total daily NNS intake.

2.3. Three-Day Dietary Records

A three-day dietary record (3-DR) was used to assess the NNS consumption of all participants over a week. After the face-to-face interview, participants were instructed to provide, as accurately as possible, all foods consumed and highlight those containing NNSs on two weekdays and one weekend day. Records requested information on food and beverage items (with brand names and flavor, where possible), portion sizes in household measures, and time and location of meals. Food records were reviewed, and participants were contacted by the nutritionist to clarify missing or incomplete information. The results were entered into an Excel file to convert all the food/beverage items into a daily NNS intake and the daily intake per kg of body weight record. Intakes from three-day dietary records were averaged across the three days. The Food Processor software 10.9 COPYRIGHT © ESHA RESEARCH, INC., 2011, and the Composition Table of the Chilean Foods, as well as information provided by the food manufacturers, were used to estimate calorie and macronutrient intake.

2.4. Statistical Analyses

Statistical analyses were performed with Stata SE version 14 (StataCorp LLC, College Station, TX, USA). Data were checked for normality using the Shapiro–Wilk test and histograms. This analysis determined that continuous variables were not normally distributed; therefore, we report continuous variables as medians and 25th–75th percentile, while or the categorical variables are presented as frequencies and percentages. We described the daily intake of NNSs (mg/day) and the daily NNS intake per kg of body weight per consumer and we compared them with the Acceptable Daily Intake of NNSs (ADI) defined by the European Food Safety Authority (EFSA) [12]. The validity of the FFQ on NNSs was assessed by comparing individual and total NNS intake measured by the FFQ on NNSs against those measured with the average of the 3-DR. Spearman’s correlation was used to identify the relationship between NNS intake obtained from the FFQ on NNSs and the 3-DR. We also analyzed the data using the concordance correlation coefficient by Lin (CCC). It is the correlation between the two measurements that fall on the 45° line through the origin. The CCC ranges from 0, indicating no substantial agreement, up to 1, representing perfect concordance [29]. We preferred CCC over the Intraclass Correlation Coefficient (ICC) or paired t-test because there are some drawbacks to all these methods [29,30,31]. In addition, a sample size calculation was performed for Bland–Altman analysis of agreement [32]. Based on the mean difference between FFQ and Dietary Records as well as standard deviation of the differences from Myers at al. [20], a maximum allowed difference of 80 mg among total NNSs, an α level of 0.05, and a power of 0.8, a sample size of 25 was required. The Bland–Altman plot [33] was used to graphically assess the agreement between both instruments using mean difference and 95% limits of agreement (LoA). The analyses of the CCC and the Bland–Altman plots were conducted using the Stata “concord” command. The results were considered statistically significant at a 0.05 level (two-tailed).

3. Results

3.1. Descriptive Statistics

A total of 45 women were recruited, but only 29 completed the study. The mean of the participants was 31.2 years (25th–75th percentile: 26.9–34.7), and 69% were primiparous and with a median of 30 gestational weeks. More than two thirds of the sample were Chilean, with the remainder being of other nationalities, mainly Venezuelan, Peruvian, Colombian, and Ecuadorian. Their average daily energy intake was 1873 ± 416 kcal. More than half (52.7%) of the total calorie intake came from carbohydrates, while total fats and proteins contributed 32.3% and 15%, respectively. More than 65% of the participants had a high level of education and 80% were in the labor force (Table 1).
Of the 29 participants, 93.1% (n = 27) consumed NNSs daily in the FFQ, while 82.8% (n = 24) consumed NNSs in the 3-DR. The three NNSs most frequently consumed were sucralose, followed by steviol glycosides and acesulfame K. Overall, the median daily NNS intakes of sucralose, steviol glycosides, and D-tagatose according to the FFQ were higher than the intakes reported through the 3-DR. The median daily NNS intake from the FFQ on NNSs was 1.49 mg/kg bw (25th–75th percentile: 0.73–3.37) vs. 1.28 mg/kg bw (25th–75th percentile: 0.62–2.48) daily NNS intake reported from the 3-DR. When compared with ADI, none of the participants exceeded the acceptable daily intake for any of the NNSs evaluated (Table 2).

3.2. Correlations

Table 3 shows the correlations of the estimates of NNSs and total NNS intake between both methods. Correlations for each of the seven NNSs and total NNS intake were statistically significant (p < 0.05). Spearman’s correlation coefficients were moderate to strong and ranged from 0.50 for acesulfame K to 0.83 for saccharin. In the case of cyclamate and D-tagatose, the correlations were not applied due to the very small sample that consumed those NNSs. The Lin´s CCC was used to assess the reliability between FFQ on NNSs and the 3-DR. Within the seven NNSs and total NNSs assessed, we found a moderate level of agreement for saccharin (CCC = 0.66; 95% CI: 0.58 to 0.74), while for aspartame, there was not agreement (p > 0.05). This suggests that although the values of both methods are associated, the level of agreement was much poorer.

3.3. Agreement between Methods

The Bland–Altman plots (Figure 2) measure the agreement of mg intake of total and each type of NNS between the FFQ and 3-DR. Acesulfame K and aspartame were underestimated in the FFQ compared to the 3-DR, while other NNSs and total NNSs were overestimated. The mean differences in daily NNS intake were: −3.8 mg/day for acesulfame K, −14.2 mg/day for aspartame, 1.2 mg/day for saccharin, 19.9 mg/day for sucralose, 17.4 mg/day for steviol glycosides, and 54.8 mg/day for total NNSs.

4. Discussion

In this pilot study, we developed and assessed the validity of an FFQ to evaluate the intake of seven NNSs in pregnant women living in Santiago, Chile. To our knowledge, this is the first study to demonstrate the validity of an FFQ using a list of most food products containing NNSs available in the local market after the Chilean law on food labeling and advertising came into force, and the subsequent reformulation of food and beverage products. Our results indicate that the FFQ on NNSs had fair-to-moderate validity. The Spearman’s correlation between the FFQ on NNSs and 3-DR was >0.50 for most NNSs; three of them were above 0.60. For cyclamate and D-tagatose, we preferred to exclude the correlations to avoid a false sense of relationship as a large number of participants did not consume these NNSs [34]. This is because only 1.3% of foods containing NSSs in the Chilean market contain cyclamate [9]. In the case of D-tagatose, Article 146 of the Chilean food sanitary regulations states that the use of D-tagatose as an NNS is not allowed in foods intended for weight control diets, nor in foods that are sugar-free, or low or reduced in sugar or sugars (mono- and disaccharides), calories, and fat [35]. While tagatose was originally evaluated as a food additive, it is now considered a novel food in some places such as the United States, Australia, New Zealand, and the European Union [36].
A similar correlation was observed by Myers et al. [20], who measured five types of NNSs (saccharin, aspartame, acesulfame K, sucralose, and erythritol) in adults residing in southwest Virginia. The Spearman’s correlation between the FFQ and three 24 h dietary records ranged from 0.51 to 0.59 [20]. Although a direct comparison is not possible, due to differences in food classification and methods of assessing NNS consumption, similar correlations were observed for acesulfame K and aspartame. In addition, we observed higher correlations for saccharine and sucralose in our study. Overall, these values are similar to those reported in FFQ validation studies, which generally consider correlations between 0.4 and 0.7 to be valid [24,37].
Historically, the most common method for testing the validity of FFQs is the ICC. However, the ICC is very sensitive to sample heterogeneity [38]. We incorporated Lin’s concordance coefficients to overcome these criticisms for assessing agreement for both methods and capitalizing that the “concord” command in Stata also provides Bland and Altman’s limits of agreement graphics [39]. Our results indicate a fair to moderate agreement, but with a proportional bias, i.e., where the differences between the methods tend to first reduce and then increase when measuring larger NNS intakes. The overall mean differences in total NNSs indicate that the FFQ on NNSs tends to overestimate the total intake by 55 mg, which would be equivalent to 138 mL of diet soda. In the Chilean market, 100 mL of diet soda contains 24 mg of aspartame and 16 mg of acesulfame K. Moreover, we found an overestimation of saccharin, sucralose, and steviol glycosides intake by the FFQ on NNSs compared with the 3-DR, and an underestimation of acesulfame K and aspartame. These mean differences were larger than those reported by Myers et al., especially for sucralose and aspartame [20].
Previous studies that assessed NNS consumption in Chile mainly focused on children [40,41,42,43] and adults [44,45] generally, and only one study has addressed pregnant women [46]. To evaluate NNS intake, different dietary instruments have been used such as the 24 hours’ recall [43] or the FFQ [40,42,44,46]. The studies that used FFQ have some shortcomings. Durán et al. designed an FFQ based on a list of 122 food products available in supermarkets. Nonetheless, it was not clear what type of validation was performed [40]. Similarly, Fuentealba et al. pointed out that their FFQ was validated by experts, but without further details [46]. On the other hand, Martínez et al. assessed NNS intake among 250 Chilean children aged 6–12 years using an FFQ originally designed for the US population [42]. Because of differences in dietary habits, the use of dietary instruments in other populations may not be an appropriate alternative and caution should be taken when interpreting the results [24,37]. In addition, the use of methods with limited validity may produce a regression dilution bias [47] that will lead to a serious underestimation of the associations between intake and disease in epidemiological studies [48].
Our results show that, with both dietary instruments, more than three quarters of pregnant women consumed NNSs daily, mainly sucralose, and none of them exceeded the acceptable daily intake for any of the NNSs assessed. This high prevalence of pregnant women reporting their intentional intake of NNSs may be of concern. There is increasing evidence to suggest that pregnant women consume as much or even more NNS as the general population [3]. This steady increase in consumption is probably due to increased awareness of the harmful effects of excessive sugar consumption [16], but also to the massive presence of NNSs in different food products. Indeed, we recently found that out of 1489 products available on the Chilean market, more than fifty percent contained at least one NNS, which is a particularly high proportion when compared to other countries [9]. However, few studies have been conducted on humans to elucidate the effects of NNS consumption during pregnancy and the postnatal period, as well as the long-term consequences on the offspring.
The strengths of this study are that the FFQ on NNSs is a dietary instrument that allows for the quick and easy measurement of NNS consumption. In addition, it can differentiate between sources of NNSs, it is brand specific, and it captures both beverage and food sources of NNSs, since the FFQ on NNSs was developed considering all possible sources of NNSs in the Chilean market. Nevertheless, our study has several limitations. Although more than one third of the Chilean population lives in Santiago, according to the National Statistics Institute (INE), this study was a convenience sample. Therefore, the participants’ backgrounds do not necessarily reflect the pregnant women living in the country. Secondly, the education level of the participants in this study was higher than that of the general population [49]. Nevertheless, a higher level of education was associated with a higher accuracy of responses to the FFQ and 3-DR [50]. As Chile is increasingly receiving immigrants, especially from Latin America and Caribbean countries, with the estimated number of foreign residents reaching 1,492,522 (approximately 10% of the population) [51], we included pregnant women from other nationalities such as Venezuela, Peru, Colombia and Ecuador. However, regional food and beverage items were not taken into account, so the FFQ likely underestimates NNS intake. In addition, our sample size was insufficient to conduct a sub-group analysis.

5. Conclusions

In conclusion, this pilot study demonstrated that, at least for the assessment of the consumption of some NNSs, the FFQ can be used for pregnant women living in Santiago, Chile. The FFQ on NNSs may be a useful method for future epidemiological studies on the nutritional status of pregnant women. However, it would be advisable to also consider biological markers as a reference method for future validation studies and to assess the validity of this FFQ in multiethnic populations.

Author Contributions

The study was designed by S.L.-A., V.S., P.C., B.C. and M.G., R.P., K.A. and G.P. were responsible for collecting the data. S.L.-A., V.S. and M.G. analyzed the data. S.L.-A., V.S. and M.G. wrote the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the National Research and Development Agency ANID-FONDEF’s National Fund for Research and Development in Health (Fondo Nacional de Investigación y Desarrollo en Salud, FONIS), 2018 (project grant SA18I0062). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Universidad de Chile–Facultad de Medicina (Project 021-2018; Acta N° 106, 11/11/2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The atlas and the corresponding Excel data sheet are available on request.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflict of interest.

References

  1. Serra-Majem, L.; Raposo, A.; Aranceta-Bartrina, J.; Varela-Moreiras, G.; Logue, C.; Laviada, H.; Socolovsky, S.; Pérez-Rodrigo, C.; Aldrete-Velasco, J.A.; Meneses Sierra, E.; et al. Ibero–American consensus on low-and no-calorie sweeteners: Safety, nutritional aspects and benefits in food and beverages. Nutrients 2018, 10, 818. [Google Scholar] [CrossRef] [PubMed]
  2. Bailón Uriza, R.; Ayala Méndez, J.A.; Cavagnari, B.M.; Celis González, C.; Chapa Tellez, R.; Chávez Brambila, J.; Espinosa-Marrón, A.; Plascencia, J.L.; Alarcón, M.G.L.; García, R.L.; et al. Edulcorantes no calóricos en la mujer en edad reproductiva: Documento de consenso. Nutr. Hosp. 2020, 37, 211–222. [Google Scholar] [PubMed]
  3. Ayoob, K.T. Consumption of non-nutritive sweeteners during pregnancy. Am. J. Obstet. Gynecol. 2020, 223, 952–953. [Google Scholar] [CrossRef]
  4. Sylvetsky, A.; Rother, K.I.; Brown, R. Artificial sweetener use among children: Epidemiology, recommendations, metabolic outcomes, and future directions. Pediatr. Clin. N. Am. 2011, 58, 1467. [Google Scholar] [CrossRef] [PubMed]
  5. Sylvetsky, A.C.; Blau, J.E.; Rother, K.I. Understanding the metabolic and health effects of low-calorie sweeteners: Methodological considerations and implications for future research. Rev. Endocr. Metab. Disord. 2016, 17, 187–194. [Google Scholar] [CrossRef]
  6. Corvalán, C.; Reyes, M.; Garmendia, M.L.; Uauy, R. Structural responses to the obesity and non-communicable diseases epidemic: Update on the Chilean law of food labelling and advertising. Obes. Rev. 2019, 20, 367–374. [Google Scholar]
  7. Kanter, R.; Reyes, M.; Vandevijvere, S.; Swinburn, B.; Corvalán, C. Anticipatory effects of the implementation of the Chilean Law of Food Labeling and Advertising on food and beverage product reformulation. Obes. Rev. 2019, 20, 129–140. [Google Scholar] [PubMed]
  8. Quitral, V.; Arteaga, J.; Rivera, M.; Galleguillos, J.; Valdés, I. Comparación del contenido de azúcares y edulcorantes no calóricos en néctares y bebidas antes y después de implementar la ley chilena 20.606. Rev. Chil. Nutr. 2019, 46, 245–253. [Google Scholar]
  9. Sambra, V.; López-Arana, S.; Cáceres, P.; Abrigo, K.; Collinao, J.; Espinoza, A.; Gotteland, M. Overuse of non-caloric sweeteners in foods and beverages in Chile: A threat to consumers’ free choice? Front. Nutr. 2020, 7, 68. [Google Scholar] [CrossRef]
  10. Gallus, S.; Scotti, L.; Negri, E.; Talamini, R.; Franceschi, S.; Montella, M.; Giacosa, A.; Maso, L.D.; La Vecchia, C. Artificial sweeteners and cancer risk in a network of case–control studies. Ann. Oncol. 2007, 18, 40–44. [Google Scholar] [CrossRef]
  11. Lohner, S.; Toews, I.; Meerpohl, J.J. Health outcomes of non-nutritive sweeteners: Analysis of the research landscape. Nutr. J. 2017, 16, 55. [Google Scholar] [CrossRef] [PubMed]
  12. Lohner, S.; de Gaudry, D.K.; Toews, I.; Ferenci, T.; Meerpohl, J.J. Non-nutritive sweeteners for diabetes mellitus. Cochrane Database Syst. Rev. 2020, 5, CD012885. [Google Scholar] [CrossRef]
  13. Liauchonak, I.; Qorri, B.; Dawoud, F.; Riat, Y.; Szewczuk, M.R. Non-Nutritive sweeteners and their implications on the development of metabolic syndrome. Nutrients 2019, 11, 644. [Google Scholar] [CrossRef] [PubMed]
  14. Pase, M.P.; Seshadri, S.; Jacques, P.F.; Klein, R.B.; Fenton, T.; Bellman, J.; Wersching, H.; Gardener, H.; Sacco, R.L.; Himali, J.J.; et al. Sugar- and artificially sweetened beverages and the risks of incident stroke and dementia: A prospective cohort study. Stroke 2017, 48, 1139–1146. [Google Scholar] [CrossRef] [PubMed]
  15. Use of Non-Sugar Sweeteners: WHO Guideline; World Health Organization: Geneva, Switzerland, 2023.
  16. Plows, J.F.; Morton-Jones, J.; Bridge-Comer, P.E.; Ponnampalam, A.; Stanley, J.L.; Vickers, M.H.; Reynolds, C.M. Consumption of the Artificial Sweetener Acesulfame Potassium throughout Pregnancy Induces Glucose Intolerance and Adipose Tissue Dysfunction in Mice. J. Nutr. 2020, 150, 1773–1781. [Google Scholar] [CrossRef] [PubMed]
  17. Maslova, E.; Strøm, M.; Olsen, S.F.; Halldórsson, T.I. Consumption of artificially-sweetened soft drinks in pregnancy and risk of child asthma and allergic rhinitis. PLoS ONE 2013, 8, e57261. [Google Scholar] [CrossRef]
  18. Cai, C.; Sivak, A. Davenport MH. Effects of prenatal artificial sweeteners consumption on birth outcomes: A systematic review and meta-analysis. Public Health Nutr. 2021, 24, 5024–5033. [Google Scholar] [CrossRef]
  19. Azad, M.B.; Sharma, A.K.; de Souza, R.J.; Dolinsky, V.W.; Becker, A.B.; Mandhane, P.J.; Turvey, S.E.; Subbarao, P.; Lefebvre, D.L.; Sears, M.R.; et al. Canadian Healthy Infant Longitudinal Development Study Investigators. Association between artificially sweetened beverage consumption during pregnancy and infant body mass index. JAMA Pediatr. 2016, 170, 662–670. [Google Scholar] [CrossRef]
  20. Myers, E.A.; Passaro, E.M.; Hedrick, V.E. The reproducibility and comparative validity of a non-nutritive sweetener food frequency questionnaire. Nutrients 2018, 10, 334. [Google Scholar] [CrossRef]
  21. Willett, W. Nutritional Epidemiology; Oxford University Press: Oxford, UK, 2012. [Google Scholar]
  22. Gibson, R.S. Principles of Nutritional Assessment; Oxford University Press: New York, NY, USA, 2005. [Google Scholar]
  23. Rodrigo, C.P.; Aranceta, J.; Salvador, G.; Varela-Moreiras, G. Food frequency questionnaires. Nutr. Hosp. 2015, 31, 49–56. [Google Scholar]
  24. Cade, J.; Thompson, R.; Burley, V.; Warm, D. Development, validation and utilisation of food-frequency questionnaires–A review. Public Health Nutr. 2002, 5, 567–587. [Google Scholar] [CrossRef] [PubMed]
  25. Mertens, E.; Kuijsten, A.; Geleijnse, J.M.; Boshuizen, H.C.; Feskens, E.J.; van’t Veer, P. FFQ versus repeated 24-h recalls for estimating diet-related environmental impact. Nutr. J. 2019, 18, 2. [Google Scholar] [CrossRef] [PubMed]
  26. Kanter, R.; Vanderlee, L.; Vandevijvere, S. Front-of-package nutrition labelling policy: Global progress and future directions. Public Health Nutr. 2018, 21, 1399–1408. [Google Scholar] [CrossRef]
  27. Tylavsky, F.A.; Sharp, G.B. Misclassification of nutrient and energy intake from use of closed-ended questions in epidemiologic research. Am. J. Epidemiol. 1995, 142, 342–352. [Google Scholar] [CrossRef] [PubMed]
  28. Cerda, R.; Barrera, C.; Arena, M.; Bascuñán, K.A.; Jimenez, G. Photographic Atlas of Chilean Food and Typical Preparations. Natl. Surv. Food Consum. 2010. Available online: http://www.repositoriodigital.minsal.cl/handle/2015/902?show=full (accessed on 24 May 2023).
  29. Lawrence, I.; Lin, K. A concordance correlation coefficient to evaluate reproducibility. Biometrics 1989, 45, 255–268. [Google Scholar]
  30. Chen, C.-C.; Barnhart, H.X. Assessing agreement with intraclass correlation coefficient and concordance correlation coefficient for data with repeated measures. Comput. Stat. Data Anal. 2013, 60, 132–145. [Google Scholar] [CrossRef]
  31. Hernaez, R. Reliability and agreement studies: A guide for clinical investigators. Gut 2015, 64, 1018–1027. [Google Scholar] [CrossRef]
  32. Lu, M.-J.; Zhong, W.-H.; Liu, Y.-X.; Miao, H.-Z.; Li, Y.-C.; Ji, M.-H. Sample size for assessing agreement between two methods of measurement by Bland−Altman method. Int. J. Biostat. 2016, 12. [Google Scholar] [CrossRef]
  33. Bland, J.M.; Altman, D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 327, 307–310. [Google Scholar] [CrossRef]
  34. Aggarwal, R.; Ranganathan, P. Common pitfalls in statistical analysis: The use of correlation techniques. Perspect. Clin. Res. 2016, 7, 187. [Google Scholar]
  35. Ministerio de Salud. Reglamento Sanitario de Los Alimentos. Articulo 146. 2020. Available online: https://www.minsal.cl/sites/default/files/files/DECRETO_977_96%20actualizado%20a%20Enero%202015(1).pdf (accessed on 24 May 2023).
  36. Vera, C.; Illanes, A. Lactose-derived nondigestible oligosaccharides and other high added-value products. In Lact. Prebiotics—A Process Prospect, 1st ed.; Illanes, A., Guerr, C., Vera, C., Wilson, L., Conejeros, R., Scott, F., Eds.; 2016; pp. 87–110. ISBN 9780128027455. [Google Scholar] [CrossRef]
  37. FAO Dietary Assessment. A Resource Guide to Method Selection and Application in Low Resource Settings; FAO: Rome, Italy, 2018. [Google Scholar]
  38. Koo, T.K.; Li, M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed]
  39. Steichen, T.J.; Cox, N.J. A note on the concordance correlation coefficient. Stata J. 2002, 2, 183–189. [Google Scholar] [CrossRef]
  40. Durán, S.; Quijada, M.; Silva, L.; Almonacid, N.; Berlanga, M.; Rodríguez, M. Niveles de ingesta diaria de edulcorantes no nutritivos en escolares de la región de Valparaíso. Rev. Chil. Nutr. 2011, 38, 444–449. [Google Scholar] [CrossRef]
  41. Hamilton, V.; Guzmán, E.; Golusda, C.; Lera, L.; Cornejo, V. Edulcorantes no nutritivos e ingesta diaria admisible en adultos y niños de peso normal y obesos de tres niveles socioeconómicos, y un grupo de diabéticos de la Región Metropolitana. Rev. Chil. Nutr. 2013, 40, 123–128. [Google Scholar] [CrossRef]
  42. Martínez, X.; Zapata, Y.; Pinto, V.; Cornejo, C.; Elbers, M.; van der Graaf, M.; Villarroel, L.; Hodgson, M.I.; Rigotti, A.; Echeverría, G. Intake of Non-Nutritive Sweeteners in Chilean Children after Enforcement of a New Food Labeling Law that Regulates Added Sugar Content in Processed Foods. Nutrients 2020, 12, 1594. [Google Scholar] [CrossRef]
  43. Venturi, G.; Di Luca, M.; Fortuna, C.; Remoli, M.E.; Riccardo, F.; Severini, F.; Toma, L.; Del Manso, M.; Benedetti, E.; Caporali, M.G.; et al. Consumption of non-nutritive sweeteners by pre-schoolers of the food and environment Chilean cohort (FECHIC) before the implementation of the Chilean food labelling and advertising law. Nutr. J. 2020, 19, 69. [Google Scholar]
  44. Durán Agüero, S.; Vásquez Leiva, A.; Morales Illanes, G.; Schifferli Castro, I.; Sanhueza Espinoza, C.; Encina Vega, C.; Cuevas, K.V.; Mena Bolvaran, F. Consumo de stevia en estudiantes universitarios chilenos y su asociación con el estado nutricional. Nutr. Hosp. 2015, 32, 362–366. [Google Scholar]
  45. Durán Agüero, S.; Record Cornwall, J.; Encina Vega, C.; Salazar de Ariza, J.; Cordón Arrivillaga, K.; Cereceda Bujaico, M.D.P.; Alzamora, S.A.; Espinoza Bernardo, S. Consumo de edulcorantes no nutritivos en bebidas carbonatadas en estudiantes universitarios de algunos países de Latinoamérica. Nutr. Hosp. 2015, 31, 959–965. [Google Scholar]
  46. Fuentealba Arevalo, F.; Espinoza Espinoza, J.; Salazar Ibacache, C.; Duran Aguero, S. Consumption of non-caloric sweeteners among pregnant Chileans: A cross-sectional study. Nutr. Hosp. 2019, 36, 890–897. [Google Scholar]
  47. Berglund, L. Regression dilution bias: Tools for correction methods and sample size calculation. Ups. J. Med. Sci. 2012, 117, 279–283. [Google Scholar] [CrossRef]
  48. Bautista, L.E.; Herran, O.F.; Pryer, J.A. Development and simulated validation of a food-frequency questionnaire for the Colombian population. Public Health Nutr. 2005, 8, 181–188. [Google Scholar] [CrossRef] [PubMed]
  49. Aldunate, R.; Contreras, G.; De la Huerta, C.; Tapia, M. Characterization of the Recent Immigration to Chile; Central Bank of Chile: Santiago, Chile, 2019. [Google Scholar]
  50. Ogawa, K.; Jwa, S.C.; Kobayashi, M.; Morisaki, N.; Sago, H.; Fujiwara, T. Validation of a food frequency questionnaire for Japanese pregnant women with and without nausea and vomiting in early pregnancy. J. Epidemiol. 2017, 27, 201–208. [Google Scholar] [CrossRef] [PubMed]
  51. Departamento de Extranjería y Migración. Estadísticas Migratorias. 2019. Available online: https://www.migracionenchile.cl/wp-content/uploads/2020/06/MIGRACION-EN-CHILE-V7.pdf (accessed on 24 May 2023).
Figure 1. Example of the semiquantitative food frequency questionnaire with open-ended options used in this pilot study.
Figure 1. Example of the semiquantitative food frequency questionnaire with open-ended options used in this pilot study.
Nutrients 15 02518 g001
Figure 2. Bland–Altman plots assessing the agreement of daily NNS intake (mg/day) from the FFQ on NNSs and the average of the 3-DR. The center line represents the mean difference between the two methods and the upper and lower lines represent the 95% LoA for (a) acesulfame K; (b) aspartame; (c) saccharin; (d) sucralose; (e) steviol glycosides; and (f) total NNS intake. Bland–Altman plots (…/…).
Figure 2. Bland–Altman plots assessing the agreement of daily NNS intake (mg/day) from the FFQ on NNSs and the average of the 3-DR. The center line represents the mean difference between the two methods and the upper and lower lines represent the 95% LoA for (a) acesulfame K; (b) aspartame; (c) saccharin; (d) sucralose; (e) steviol glycosides; and (f) total NNS intake. Bland–Altman plots (…/…).
Nutrients 15 02518 g002aNutrients 15 02518 g002bNutrients 15 02518 g002c
Table 1. Characteristics of participants in the pilot study n = 29.
Table 1. Characteristics of participants in the pilot study n = 29.
Characteristics25th–75th
Percentile
or %
Age (years), median (IQR) 131.2 (26.9–34.7)
Gestational weeks, median (IQR) 130.0 (28.0–32.0)
Parity n (%)
       020 (69.0)
       ≥19 (31.0)
Pre-gestational weight, median (IQR) 160.0 (55.0–66.0)
Current weight, median (IQR) 168.0 (63.0–73.0)
Medical history n (%)
       Gestational diabetes3 (10.3)
       Hypothyroidism3 (10.3)
       High blood pressure1 (3.4)
Nationality n (%)
       Chilean20 (69.0)
       Other9 (31.0)
Education n (%)
       High school7 (24.1)
       Vocational training3 (10.4)
       College or more19 (65.5)
Employment n (%)
       Yes23 (79.3)
       No6 (20.7)
Diet
       Total energy intake (kcal/d). Mean ± SD 21873 ± 416
       Protein intake (g/d). Mean ± SD 275.5 ± 26.3
       Carbohydrate intake (g/d). Mean ± SD 2245.3 ± 64.0
       Fat intake (g/d). Mean ± SD 270.0 ± 7.5
1 IQR: Interquartile range. 2 SD: Standard deviation.
Table 2. Daily NNS intake (mg/day) and daily NNS intake per kilogram of body weight (mg/kg bw) from the FFQ on NNSs and the average of the 3-DR, and comparison with the Acceptable Daily Intake (ADI) by EFSA among pregnant women reporting any consumption of NNSs.
Table 2. Daily NNS intake (mg/day) and daily NNS intake per kilogram of body weight (mg/kg bw) from the FFQ on NNSs and the average of the 3-DR, and comparison with the Acceptable Daily Intake (ADI) by EFSA among pregnant women reporting any consumption of NNSs.
NNS Typen aFFQ on Daily NNS Intake
(mg/day)
FFQ on Daily NNS Intake
(mg/kg bw)
n a3-DR of Daily NNS Intake (mg/day)3-DR of Daily NNS Intake
(mg/kg bw)
ADI Defined by EFSA
(mg/kg bw)
Median (25th–75th Percentile)Median (25th–75th Percentile)Median (25th–75th Percentile)Median (25th–75th Percentile)
Acesulfame K2320.9 (7.0–69.7)0.38 (0.11–1.00)1540.5 (32.0–71.6)0.65 (0.45–1.16)9
Aspartame1959.1 (24.0–84.6)0.38 (0.02–0.86)1484.0 (58.5–120.0)0.40 (0.01–0.93)40
Cyclamate13.1 b0.06 b138.5 b0.71 b7
Saccharin31.1 (0.01–79.2)0.02 (0.00–1.28)222.3 (13.0–31.5)0.37 (0.24–0.51)5
Sucralose2724.8 (14.6–60.6)0.38 (0.20–0.94)2322.4 (9.4–46.5)0.33 (0.17–0.75)15
Steviol glycosides2522.0 (4.2–31.2)0.31 (0.06–0.49)1821.6 (7.8–41.3)0.31 (0.12–0.62)4
D-Tagatose13.5 b0.05 b12.70.04 bnot specified
Total NNS intake2793.0 (47.6–242.7)1.49 (0.73–3.37)2468.0 (36.7–104.8)1.28 (0.62–2.48)not specified
a n is the number of participants that consumed any NNSs. b The 25th and 75th percentile could not be calculated because many participants did not consume these NNSs.
Table 3. Spearman’s correlation coefficient (rho) and Lin´s concordance correlation coefficient (CCC) between daily NNS intake per kilogram of body weight and the average of the 3-DR among pregnant women.
Table 3. Spearman’s correlation coefficient (rho) and Lin´s concordance correlation coefficient (CCC) between daily NNS intake per kilogram of body weight and the average of the 3-DR among pregnant women.
NNS TypeRho Coefficients between FFQ and 3-DRCCC between FFQ and 3-DR (95% CI)
Acesulfame K0.50 *0.37 (0.07–0.61) *
Aspartame0.51 *0.28 (−0.01–0.52)
Cyclamaten/a ***n/a ***
Saccharin0.83 **0.66 (0.58–0.74) **
Sucralose0.67 **0.35 (0.09–0.56) **
Steviol glycosides0.79 *0.22 (0.04–0.38)
D-Tagatosen/a ***n/a ***
Total NNS intake0.66 **0.39 (0.02–0.66) *
* p ≤ 0.05. ** p ≤ 0.01. *** n/a = not applied.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

López-Arana, S.; Peralta, R.; Sambra, V.; Abrigo, K.; Prado, G.; Cáceres, P.; Carvajal, B.; Gotteland, M. Development and Relative Validation of a Food Frequency Questionnaire to Assess Non-Nutritive Sweeteners Intake among Pregnant Women in Santiago, Chile: A Pilot Study. Nutrients 2023, 15, 2518. https://doi.org/10.3390/nu15112518

AMA Style

López-Arana S, Peralta R, Sambra V, Abrigo K, Prado G, Cáceres P, Carvajal B, Gotteland M. Development and Relative Validation of a Food Frequency Questionnaire to Assess Non-Nutritive Sweeteners Intake among Pregnant Women in Santiago, Chile: A Pilot Study. Nutrients. 2023; 15(11):2518. https://doi.org/10.3390/nu15112518

Chicago/Turabian Style

López-Arana, Sandra, Rebeca Peralta, Verónica Sambra, Karen Abrigo, Gabriel Prado, Paola Cáceres, Bielka Carvajal, and Martin Gotteland. 2023. "Development and Relative Validation of a Food Frequency Questionnaire to Assess Non-Nutritive Sweeteners Intake among Pregnant Women in Santiago, Chile: A Pilot Study" Nutrients 15, no. 11: 2518. https://doi.org/10.3390/nu15112518

APA Style

López-Arana, S., Peralta, R., Sambra, V., Abrigo, K., Prado, G., Cáceres, P., Carvajal, B., & Gotteland, M. (2023). Development and Relative Validation of a Food Frequency Questionnaire to Assess Non-Nutritive Sweeteners Intake among Pregnant Women in Santiago, Chile: A Pilot Study. Nutrients, 15(11), 2518. https://doi.org/10.3390/nu15112518

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop