Next Article in Journal
Sarcopenia and Appendicular Muscle Mass as Predictors of Impaired Fasting Glucose/Type 2 Diabetes in Elderly Women
Previous Article in Journal
Energy Metabolism and Diet
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Efficacy of a Multi-Strain Probiotic Formulation in Pediatric Populations: A Comprehensive Review of Clinical Studies

1
Rosell Institute for Microbiome and Probiotics, Lallemand Health Solutions Inc., 6100 Royalmount Avenue, Montreal, QC H4P2R2, Canada
2
IFAS Statistical Consulting Unit, University of Florida, P.O. Box 110500, Gainesville, FL 32611-0500, USA
*
Author to whom correspondence should be addressed.
Nutrients 2021, 13(6), 1908; https://doi.org/10.3390/nu13061908
Submission received: 7 May 2021 / Revised: 26 May 2021 / Accepted: 27 May 2021 / Published: 1 June 2021
(This article belongs to the Section Prebiotics and Probiotics)

Abstract

:
A probiotic formulation combining Lactobacillus helveticus Rosell®-52, Bifidobacterium infantis Rosell®-33, and Bifidobacterium bifidum Rosell®-71 with fructooligosaccharides, first commercialized in China, has been sold in over 28 countries since 2002. Clinical studies with this blend of strains were conducted mainly in pediatric populations, and most were published in non-English journals. This comprehensive review summarizes the clinical studies in infants and children to evaluate the efficacy of this probiotic for pediatric indications. Literature searches for pediatric studies on Biostime® or Probiokid® (non-commercial name) in 6 international and Chinese databases identified 28 studies, which were classified by indications. Twelve studies show that the probiotic significantly increases the efficacy of standard diarrhea treatment regardless of etiology, reducing the risk of unresolved diarrhea (RR 0.31 [0.23; 0.42]; p < 0.0001) by 69%. In eight studies, the probiotic enhanced immune defenses, assessed by levels of various immune competence and mucosal immunity markers (six studies), and reduced the incidence of common infections (two studies). The probiotic improved iron deficiency anemia treatment efficacy (three studies), reducing the risk of unresolved anemia by 49% (RR 0.51 [0.28; 0.92]; p = 0.0263) and significantly reducing treatment side effects by 47% (RR 0.53 [0.37; 0.77]; p = 0.0009). Other studies support further investigation into this probiotic for oral candidiasis, eczema, feeding intolerance in premature babies, or hyperbilirubinemia in newborns.

1. Introduction

Lactobacilli and Bifidobacteria are commensal bacteria of the human and animal gastrointestinal (GI) tract, and several strains of these genera are widely used as probiotics and in food supplements, or as starter or adjunct cultures in the production of dairy products or other fermented foods. Although Lactobacilli have been shown to represent a small proportion of the fully developed and highly diverse adult microbiota, their importance is demonstrated by the association between their modulation and various diseases [1]. Bifidobacteria were shown to be among the first colonizers of the healthy infant’s GI tract, and to predominate in the intestinal tract until the transition to a solid food diet, at which point microbiota diversity begins to increase towards the varied composition typically seen in adults [2]. With the increasing awareness of the role of the microbiota and dysbiosis in pediatric health and diseases [3], the use of probiotics is considered among the potential interventions available to target the microbiota in pediatric populations. However, assessing the overall safety and efficacy of probiotics in general for a given indication increases heterogeneity when the analyses combine studies having assessed a variety of probiotic strains or formulations, dosing regimen, and outcome assessment measures [4].
The probiotic formulation reviewed herein is composed of Lactobacillus (L.) helveticus Rosell®-52, Bifidobacterium (B.) longum subsp. infantis (B. infantis) Rosell®-33 and B. bifidum Rosell®-71, with fructooligosaccharides. All three strains were deposited at the Pasteur Institute in the “Collection Nationale de Cultures de Microorganismes” (CNCM), under the numbers CNCM I-1722, CNCM I-3424 and CNCM I-3426, respectively [5,6]. The whole-genome sequences are deposited in the PATRIC database (https://www.patricbrc.org/ (accessed on 31 May 2021)) under the genome identification numbers (Genome ID): 880633.7, 1678.111, and 1678.107, respectively. First marketed in China in 2002, this formulation has since been commercially available in over 28 countries. The innocuity of the included strains is recognized by several authoritative bodies worldwide, where they are included in lists of safe strains for consumption in foods. Probiokid® and the individual strains have been recognized for their safety by the US FDA in the form of a no question letter for notified GRAS status for use in non-exempt infant formula, in Canada by the NNHPD for use in Natural Health Products in infants 3 months old and over, and in China for safe use in food for infants and young children. In addition, the safety of this product is also monitored through a pharmacovigilance program covering both foreign and domestic adverse event cases [7].
The clinical studies conducted with this probiotic formulation have demonstrated its beneficial effects on GI and immune functions in children. With many of the studies published in non-English journals, there is a barrier for results dissemination to the global scientific community. Hence, we undertook this comprehensive literature review summarizing the clinical studies on this probiotic formulation published in North America, Europe, and Asia to provide an overview of the global evidence base available on this probiotic in pediatric populations. In addition, when possible, outcome-specific meta-analyses were conducted on studies harboring similar design and outcome assessment methods, which strengthens the conclusions obtained from individual trials while providing more specificity than the meta-analyses including different probiotic strains or formulations.

2. Materials and Methods

The results of this comprehensive review are reported according to the PRISMA guidelines. The protocol of this review was not prospectively registered. Articles of interest were identified by searching for the trade names, Probiokid® (non-commercial name) or Biostime® (合生元®), and for the individual strain names and numbers (Supplemental Table S1) using search engines for scientific or medical journal databases up to May 2021. Two independent assessors conducted the searches, screening against inclusion/exclusion criteria, and data extraction (A.T., X.X.). Discrepancies were solved via discussion between the two authors, and a third assessor was consulted as needed for resolution (T.A.T.). Articles in Chinese, although most had an abstract in English, were translated using Google translate and a native speaker (X.X.) performed inclusion/exclusion criteria assessment and data extraction using the original language articles. For the selection process, retrieved articles were screened by title and abstract to identify the clinical trials in pediatric populations and then examined for study design, regardless of the indication. Only studies where controls allowed for a direct assessment of the effect of the probiotic were included. These encompassed studies where the probiotic formulation was used as adjuvant with the active comparator alone used as control, studies comparing with a placebo, another probiotic (e.g., GoldenBifido, Lacidophilin), or a standard of care (e.g., Smecta®, iron dextran, phototherapy) as control, or case–control-type studies allowing for a comparison of the effect before and after the probiotic intervention. Study authors were not contacted to provide additional data.
A total of 28 studies in pediatric populations were included and are detailed in this comprehensive review (Figure 1).
The characteristics of the 28 studies were extracted using a tabular format including study dates, population, study design, arms and n, treatment regimen, results, and adverse events (including serious adverse events). All studies were conducted with the same formulation which contains the strains L. helveticus Rosell®-52, B. infantis Rosell®-33 and B. bifidum Rosell®-71, with 750 mg of fructooligosaccharrides per sachet. This formulation is manufactured to ensure a minimal active dose of 3 billion colony-forming units (CFU) per sachet at the end of shelf-life. Considering that reporting standards for the dosage vary between countries, the Chinese or some European studies tend to report the dose at manufacturing, which is higher to maintain the guaranteed minimal active dose per sachet until the end of shelf-life. Therefore, for comparability, dosage information is provided herein based on the number of sachets administered.
After examination of the study characteristics tables, a meta-analysis was conducted if 3 studies or more allowed to calculate the relative risk for a given outcome when similar design, assessment method and data reporting format were used. Meta-analyses were conducted in R version 4.0.2, using the meta package [8,9]. Weighing was calculated using the inverse variance method, the DerSimonian–Laird estimator was used for τ2, and the Jackson method was used for confidence interval of τ2 and τ. Studies included in meta-analyses were assessed by 2 authors (A.T., X.X.) for the risk of bias (low, unclear, high) [10], and the overall level of bias was assigned for the treatment efficacy outcome used in the meta-analysis. Discrepancies were resolved through discussion, and a third assessor (T.T.) was consulted as needed. For the studies included in the diarrhea outcome meta-analysis, publication bias was estimated using a funnel plot and asymmetry quantification using the Egger’s regression test. The Trim and Fill method by Duval and Tweedie was used to estimate the number of missing studies and these estimated negative studies were added to the meta-analysis as a sensitivity assessment [11,12].

3. Results

3.1. Classification of Identified Clinical Studies

The reviewed trials were categorized by indication, delineating three broad categories (Table 1). Overall, the identified trials investigated the safety and efficacy of the probiotic at restoring normal GI function in cases of diarrhea of various etiologies (12 studies; summarized in Table 2) and at supporting immune system function and natural defenses (8 studies; summarized in Table 3), mainly by enhancing immune competence (6 studies) and reducing the occurrence or recurrence of common infections (2 studies). In addition, other studies (summarized in Table 4) investigated the role of this probiotic combination in infant eczema (one study), oral candidiasis (one study), nutritional iron deficiency anemia (three studies), necrotizing enterocolitis (one study) and hyperbilirubinemia (jaundice; two studies).

3.2. Studies on Diarrhea of Various Etiologies

Twelve studies of similar design were conducted in China on children with diarrhea of various etiologies. A total of 1356 infants were enrolled, of whom 714 received a similar probiotic regimen, provided as an adjuvant to a standard of care. These 12 randomized trials (Table 2) assessed efficacy using the same categorical scale, in accordance with the Chinese national standards for the diagnosis and treatment of diarrhea [40], as follows: a “markedly effective” result is characterized by the frequency and characteristics of the stool returning to normal (<3 bowel movements/day) and symptoms disappearing within 72 h of intervention; an “Effective” result is characterized by a significant improvement in the frequency (<4 bowel movements/day) and characteristics of stool and symptoms within 72 h of intervention; and an “ineffective” result is characterized by the frequency, characteristics of stools and overall symptoms failing to improve within 72 h of intervention.
Considering the high level of similarity between the 12 diarrhea studies, we conducted a meta-analysis of the diarrhea treatment outcome (Figure 2a). Overall, probiotic supplementation significantly improved the efficacy of standard diarrhea treatment; pooled results from the 12 studies show a 69% reduction in the RR of unresolved diarrhea (RR 0.31 [0.23; 0.42]; p < 0.0001), regardless of etiology. Heterogeneity among studies was assessed using I2 and τ2 and found absent, which was in accordance with the overall RR and 95% CI values being the same using either the fixed- or random-effects models.
For the risk of bias analysis (Figure 2b), most studies included in the meta-analysis were categorized as low or unclear risk [15,16,17,18,20,22,23,24,26], with three studies classified as high risk of bias due to potential randomization or selective reporting issues [19,21,25]. All studies were classified as unclear risk for the allocation concealment and blinding-related domains; a similar trend was observed in a previous systematic review, which could reflect regional publication practices [41]. Publication bias was assessed using the funnel plot method (Figure 3) and asymmetry was found significant (Egger’s regression test; t = −2.84, df = 10, p = 0.0176), suggesting the potential occurrence of publication bias. The number of missing studies to correct the asymmetry was estimated to five using the Trim and Fill method by Duval and Tweedie [11,12]. Upon inclusion of 5 negative studies in the meta-analysis (empty circles; total studies = 17), the result remained significant with the reduction in the risk of unresolved diarrhea changing from 69% to 62.5% (RR 0.3753 [0.2867; 0.4913]; p < 0.0001).

3.3. Studies on Immune Competence and Inflammatory Markers

All studies classified in the immunity and natural defenses indications are detailed in Table 3. At the mucosal interface, secretory immunoglobulin A (sIgA) mediate humoral immunity by regulating the balance between immune exclusion of pathogenic microorganisms and tolerance to commensal bacteria, thereby favoring the establishment of a symbiotic relationship between the gut microbiota and the host [42,43]. At birth, immunoglobulins (Ig), and mainly secretory IgA (sIgA), are provided by the mother’s breast milk while the infant’s own production of intestinal sIgA by the gut-associated lymphoid tissue (GALT) develops [44,45]. In formula-fed infants, the immune protection provided by the mother is absent and the development of infant formula able to promote microbial colonization by Bifidobacteria and stimulate the development of immune competence is required. Three studies [14,18,27] assessed the effect of the probiotic on the development of mucosal immune competence using sIgA levels in the saliva or feces as a surrogate endpoint (Table 3). Among these studies, two were conducted in healthy infants (0–48 months old) [27] or healthy formula-fed babies (3–6 months old) [14], and one in children with non-infectious diarrhea (3–38 months old) [18].
Overall, supplementation with the probiotic increased or maintained higher sIgA levels, suggesting an enhanced mucosal immunity. Chen et al. (2007), in a pilot-like study, reported a significant increase in salivary sIgA levels in children of all age groups compared to randomly selected age-matched controls [27]. The study conducted by Xiao et al. (2019) enrolling 132 formula-fed infants showed that formula-fed infants receiving the probiotic maintained significantly higher fecal sIgA levels at the end of the 4-week supplementation period compared to those receiving placebo, suggesting a positive effect of probiotics on intestinal sIgA production [14]. Similarly, Liu et al. (2015) reported a significant increase in salivary sIgA after 3 days of supplementation in children with non-infectious diarrhea [18]. They also assessed the levels of inflammatory markers; the pro-inflammatory cytokines IL-6 and IL-17 were significantly reduced in the probiotic group at the end of treatment compared to controls [18].
The modulation of inflammatory marker was also assessed in a post hoc analysis of a placebo-controlled safety study cohort of healthy 3–12-month-old children receiving the individual strains for 8 weeks [13,28]. De Andres et al. (2018) reported that the IL10/IL-12 anti-inflammatory ratio increased significantly with B. infantis Rosell®-33 but decreased with placebo [28]. Interestingly, the authors also reported that the microbiota composition in children receiving the probiotic strains was similar to the microbiota profile typical of a 4-month-old, un-weaned infant, while the profile in the placebo group corresponded to that seen during the weaning process with a decrease in different Bifidobacterium species, such as B. bifidum and B. breve, and an increase in genera seen in the more diversified microbiota of adults (Bacteroides, Blautia, Clostridium, Coprococcus and Faecalibacterium) [28].
Regulation of immune function was also assessed using circulating levels of IgA in the serum. Although less is known about the role of serum IgA in regulating the systemic inflammatory response, low levels of serum IgA compared to other serum immunoglobulins have been observed in children with selective IgA deficiency, who are known to be more susceptible to sinopulmonary infections, GI illnesses, and allergic diseases [46,47]. Two studies conducted in Serbia [29,32] assessed the effect of this formulation on serum immunoglobulin levels in infection-prone children with low serum IgA levels. In both studies, most of the enrolled children were classified as atopic based on a positive sensitization response to 25–30 allergens in a skin prick test and/or elevated IgE levels. Pantovic et al. (2013) reported a normalization of serum IgA levels in 35% of the children after 3 months and 81% after 6 months [29]. Stoijkovic et al. (2016) reported a statistically significant decrease in IgE after 9 months of supplementation, and a rise in serum IgA, IgG, and IgM levels after 3 months of supplementation, which was maintained over the following 6 months [32]. While Pantovic et al. (2013) did not correlate the effects of the probiotic on serum IgA levels with the incidence of infections, two studies, including Stojkovic et al. (2016), have shown the efficacy of this probiotic against respiratory infections in frequently sick children.

3.4. Studies on the Prevention of Common Infections

Cazzola et al. 2010 [31] and Stojkovic et al. 2016 [32] investigated the efficacy of the probiotic (administered from 3 to 9 months) at preventing common respiratory infections or complications in children, such as upper respiratory tract infections (URTI), ear/nose/throat infections (ENTI), and GI illnesses. In France, Cazzola et al. (2010) enrolled 135 children diagnosed with >3 infections in the past winter to receive either probiotic (n = 62) or placebo (n = 73) for 3 months. There was a significant reduction of 24.7% (p ≤ 0.045) in the relative risk (RR) of occurrence of common infectious diseases in the probiotic group, with 51.6% (32/62) of children reporting at least one infection versus 68.5% (50/73) in the placebo group. Furthermore, 25.8% in the probiotic group (p ≤ 0.043) reported missing at least one school day for sickness versus 42.5% in placebo, representing a 40% decrease in school absenteeism [31]. Stojkovic et al. (2016) supplemented probiotics for 9 months in 78 hospitalized children aged 1.5 months to 5 years. All children were categorized into three groups according to the predominance of symptoms over the past year; Group I—predominance of respiratory infection and wheezing; Group II—predominance of respiratory infection without wheezing; Group III—predominance of wheezing without accompanying respiratory infection. The elevation in serum IgA levels in children from Groups I and II described above was correlated with a decline of clinical symptoms’ occurrence. In children from Group III a significant rise in serum IgA levels was observed only within 6–9 months and was correlated with a statistically significant decrease in the frequency of wheezing episodes at the end of the study [32]. This open-label before–after study shows that supplementation for 3–9 months results in a positive impact on the inflammatory status in children that is consistent with the improvement in clinical symptoms.

3.5. Studies in Other Indications

The studies classified in the category “other indications” are described below and summarized in Table 4.

3.5.1. Oral Candidiasis (Thrush)

A Chinese study tested the probiotic for oral candidiasis infections (oral thrush) in 70 children (1–26 months old) [33]. The children were randomized into two groups of 35 receiving 2% sodium bicarbonate with nystatin (standard of care) with or without probiotic. Both the effective rate (94.3% vs. 77.1%, p < 0.05) and the recurrence rate (2.9% vs. 17.1%, p < 0.05) significantly favored the probiotic arm. The authors concluded that the probiotic was effective as adjuvant to nystatin and sodium bicarbonate in the treatment and prevention of oral thrush in children.

3.5.2. Eczema

Li (2017) conducted a randomized controlled study to assess the effect of the probiotic (2 weeks) as an adjuvant to a standard topical treatment in 76 children with eczema (38/group) [34]. Baseline characteristics were similar between groups (p > 0.05). The Eczema Area and Severity Index (EASI) scores were significantly improved in the probiotic group compared to controls at 1 and 2 weeks after treatment (p < 0.05). The total effective rate in the intervention group was 92.1% (35/38) compared to 65.7% (25/38) in controls (p < 0.01).

3.5.3. Iron Deficiency Anemia

Three studies of similar design investigated the effect of the probiotic as adjuvant to iron dextran supplementation for 8 weeks in a total of 182 children (6–60 months old) hospitalized for nutritional iron deficiency anemia (IDA) [35,36,37]. In parallel, children randomized to the control arms (n = 182) received iron dextran supplementation (standard of care) without probiotic. In all studies, the average age of enrolled children was approximately 3 years old, and the baseline characteristics were found similar between study arms in terms of age, gender distribution and severity of anemia (p > 0.05). Similar parameters to determine the efficacy of supplementation (i.e., blood anemia parameters) were used, including blood hemoglobin levels, mean corpuscular volume, mean corpuscular hemoglobin concentrations, reticulocyte counts, and serum iron levels. Treatment efficacy was measured as rates using a categorical scale, with a “markedly effective” result characterized by all symptoms and blood indicators returning to normal levels, an “effective” result characterized by an improvement in symptoms accompanied by a rise in hemoglobin levels by more than 20 g/L above baseline levels, and an “ineffective” result, by the absence of improvement in symptoms or by hemoglobin levels not increasing by more than 20 g/L above baseline levels [35,36,37].
To compare these studies, ineffective cases were used to calculate the RR of treatment failure in the absence of probiotic (Figure 4a). When combining all three studies to increase the number of participants, the probiotic significantly reduced the risk of unresolved anemia by 49% (RR 0.51 [0.28–0.92]; p = 0.0263). Considering the high efficiency of iron dextran supplementation on its own, improvement of treatment efficacy with the probiotic (i.e., promoting iron absorption) is considered clinically meaningful. Furthermore, the common adverse effects of iron dextran supplementation, namely GI symptoms (diarrhea or constipation), nausea, and metal taste, were monitored in all 3 studies and found consistently reduced with the probiotic (Figure 4b), with a 47% reduction in the risk of side effects (RR 0.53 [0.37–0.77]; p = 0.0009) [35,36,37]. All three studies were found at low risk of bias (Figure 4c), except for the domains related to blinding which are typically not reported possibly due to regional reporting practices, as observed previously [41].

3.5.4. GI Function and Necrotizing Enterocolitis in Newborns

In a randomized placebo-controlled trial, Huang et al. (2015) evaluated the safety and efficacy of the probiotic during 2 weeks on the GI function of 60 very low birth weight (VLBW) newborns (n = 30/arm; 1000–1500 g; average 34 weeks gestational age) [38]. All participants received intravenous nutrition starting on the second day after birth. Although not found statistically different, the incidence of necrotizing enterocolitis (NEC) was lower in the probiotic versus controls (6.7% vs. 16.7%; p > 0.05) with a relatively shorter hospital stay duration compared to controls (40.1 ± 15.6 vs. 47.3 ± 16.7 days; p > 0.05). Adverse events were similar between groups, with one death (3.3%) in the probiotic group and two (6.7%) in the controls. There was a slightly lower incidence of parenteral nutrition-associated cholestasis (PNAC) in the probiotic group with only 1 case (3.3%) vs. 3 cases (10%) in controls (p > 0.05). Feeding intolerance, which was assessed by the occurrence of GI symptoms (i.e., vomiting, diarrhea, or constipation), was significantly lower in the probiotic vs. controls (36.7% vs. 70%; p = 0.0104). Results suggest a positive effect of this formulation on the GI function in VLBW infants, which supports the conduct of further clinical trials assessing the effect of this probiotic formulation on the incidence and severity of NEC and PNAC in larger cohorts [38].

3.5.5. Jaundice in Newborns

In a double-blind, placebo-controlled trial, Gao et al. (2015) assessed the safety and efficacy of a 7 day prophylaxis with the probiotic for the prevention of jaundice in a population of 1000 healthy full-term neonates (n = 500/group; 2500–4000 g; 37–42 weeks gestational age) [39]. The time of onset of jaundice was similar between groups (p > 0.05), but incidence was significantly lower (p < 0.001) in probiotics (9%) versus controls (17%). The average levels of daily percutaneous bilirubin from the second to fifth postnatal day were similar in both groups (p > 0. 05) but the average levels of daily percutaneous bilirubin on the sixth and seventh day after birth were significantly lower in probiotics versus controls (p < 0.05). Adverse events were similar between groups (p > 0.05). This probiotic formulation was well tolerated, clinically safe, and reduced the daily percutaneous bilirubin levels and incidence of hyperbilirubinemia in newborns [39].
Qiu et al. (2020) conducted a study on the efficacy of the probiotic as an adjuvant to blue light phototherapy (450–475 nm; light intensity 10–12 µW/cm2/nm) in 64 full-term otherwise healthy newborns (gestational age 37–41 weeks) diagnosed with jaundice (n = 32/arm) [30,48]. Briefly, only children younger than 3 days old, in whom appearance of jaundice occurred within 24 h from birth, with a total bilirubin level above 102 µmol/L, a daily rise in bilirubin above 85 µmol/L, and conjugated bilirubin levels above 25 µmol/L were included. Exclusion criteria were congenital biliary malformations, acute bilirubin encephalopathy with central nervous system (CNS) manifestations, a score lower than 7 on the Agpar test (one minute), cytomegalovirus infections, or severe infections (e.g., septic shock, CNS infections). Although jaundice improved in both groups, there was a significantly higher reduction in the total and conjugated bilirubin levels at 3 and 5 days of treatment in the probiotic group (p < 0.05). There was also a significant reduction in IL-6 levels in the probiotic group compared to controls (p < 0.05) and a significant reduction in IL-6 and IL-8 levels at day 3 and 5, and a significant increase in IL-10 at day 5 vs. baseline in the probiotic group (all p < 0.05), but not in the controls. Oxidative stress markers were unchanged in both groups, except for serum catalase levels at day 5, which were significantly higher in the probiotic group compared to baseline (p < 0.05) [30]. Overall, the probiotic formulation was found safe and effective as an adjunct to blue light phototherapy for jaundice in otherwise healthy full-term newborns, possibly by improving the inflammatory status or, more speculatively, oxidative stress levels.

4. Discussion and Concluding Remarks

The clinical studies reviewed herein demonstrate the efficacy of this formulation as an adjuvant to standard treatment for diarrhea of various etiologies [15,16,17,18,19,20,21,22,23,24,25,26] and support its role at sustaining natural defenses against infections and boosting immunity [13,14,15,17,18,19,21,22,23,24,25,26,28,29,30,31,32]. Promising results support additional studies on this probiotic formulation in children with oral candidiasis [33], iron deficiency anemia [35,36,37], eczema [34], as well as for preventing jaundice or improving GI function in newborns [30,38,39].
The safety of this formulation has been confirmed in several studies and through the pharmacovigilance program in place [7]. While adverse events monitoring is expected to have been conducted in all trials, some studies have not adequately reported on this aspect. However, in the 13 studies where adverse events monitoring was reported [13,14,15,20,31,32,33,34,35,36,37,38,39] few adverse events were observed, and none could be attributed to the intervention over placebo. While the systematic reporting of adverse events in clinical trials generally needs to be improved, there is no evidence of increased risk resulting from probiotic use in otherwise healthy children [49]. However, caution is generally recommended for all probiotics in individuals more susceptible to bacterial infections, such as children younger than 3 years old with short bowel syndrome or in severely immunocompromised individuals and immunosuppressed patients [50,51]. The innocuity of the strains in this formulation is recognized by several authoritative bodies worldwide, where the strains are included in lists of safe strains for consumption in foods. Probiokid® and the individual strains have been recognized for their safety by the US FDA in the form of a no question letter for notified GRAS status for use in non-exempt infant formula, and in Canada from the NNHPD for use in Natural Health Products in infants 3 months old and over.
This review has strengths and limitations. A strength of this review is the cohesion between studies allowing to conduct outcome-specific meta-analyses without heterogeneity. Indeed, several meta-analyses attempt to compare studies using several different probiotics and measuring clinical outcomes with a variety of methods. Here, the studies are homogeneous in terms of probiotic intervention, study designs and outcome assessment methods, which strengthens the conclusions reached by individual studies, most notably with regard to the benefits on diarrhea treatment. Except for 2 studies that did not provide details on the diagnosis criteria used to define acute diarrhea, the 10 remaining studies used local guidelines in place for the diagnosis of diarrheal diseases. Another limitation of this review is the fact that many studies were assigned an unclear of high risk of bias. In many studies, while randomization was used, reporting was deficient in terms of the description of the randomization method, allocation concealment or blinding procedures implemented. This could potentially be explained by the existence of country-specific reporting guidelines. Nevertheless, the flow of participants throughout the studies and clinical outcomes were well described, which suggests a generally low risk of attrition and reporting biases in outcomes.
For the meta-analysis of IDA studies, the risk of bias was found low in all domains, heterogeneity was absent, and the results were identical when fixed- or random-effects models were applied. However, it is known that standard random-effects meta-analyses with few studies (n = 2 or 3) are less accurate, especially in the presence of heterogeneity or when studies are highly variable in size [52]. Hence, while the current positive effects in children with IDA receiving iron supplementation are promising, the conclusion about the efficacy of the formulation in this specific indication could change with an increased number of studies.
This probiotic formulation was mostly studied in children. However, a similar effect of the strain B. bifidum Rosell®-71 was shown in healthy young adults undergoing university exams; this strain significantly increased the proportion of healthy days (i.e., without cold and flu symptoms) and reduced diarrhea symptoms associated with stress [53,54]. Mechanistic insights on the modes of action of this probiotic formulation were obtained from in vitro and in vivo studies. Briefly, the formulation and individual strains were shown to preserve the integrity of the intestinal barrier, and to exert immunomodulatory functions in vitro and in vivo, which may also contribute to the beneficial effects observed on diarrhea symptoms and overall GI and immune health. In vitro, this probiotic was shown to counteract Toll-like receptor 3 (TLR3)-induced inflammation triggered by the double-stranded RNA ligand Poly(I:C), which mimics a Th1 and antiviral innate immune response in human intestinal epithelial cells [55,56]. In vivo, the formulation induced mucin and tight junction protein expression, and suppressed the inflammation and apoptosis induced by the carcinogenic compound dimethylhydrazine dihydrochloride [57]. Furthermore, this probiotic increased anti-inflammatory cytokines (i.e., IL-4) and reduced pro-inflammatory cytokines (e.g., IL-1a, IL-1b, IL-6, IFN-γ and TNF-α) in rats infected with enterotoxic E. coli (model of a Th1 immune response), and reduces pro-inflammatory cytokines (e.g., IL-1a) in rats infected with the pathogen N. brasiliensis (model of a Th2 immune response) [58].
In addition to regulating host defenses, probiotics’ effects on the immune systems also influence the host in a systemic manner. Recently, an in vivo study on this probiotic formulation revealed that the immunomodulatory effects of this formulation could also underly a potential role in indications related to the microbiota–gut–brain axis (MGBA). Indeed, this probiotic formulation prevented the increase in pro-inflammatory cytokines in the dam’s serum and fetal brain in the maternal immune activation (MIA) mouse model of autism [59]. In addition, it prevented the neuronal loss and the reduction in GABA levels seen in the MIA adult offspring’s prefrontal cortex. These changes were correlated with behavioral improvements compatible with an amelioration in autism-like symptoms in these mice (social deficits and stereotypical behavior), but also reduced anxiety- and depression-related behaviors in the adult MIA offspring. This study, by linking the immunomodulatory and behavioral effects of Probiokid® with the microbiota–gut–brain axis in a pre-clinical setting, provides a rationale to explore the potential role of this formulation in other MGBA models. Of note, the limited number of clinical trials conducted so far in children with ASD have resulted in conflicting results about the potential of probiotics to improve GI or behavioral symptoms in this population [60]. In addition, the beneficial effects on GI function with a trend towards a reduction in NEC incidence in a small cohort of premature infants [38], along with the reduction in the severity of intestinal tissue damage in a rodent model of NEC [61] warrant further studies on this probiotic in premature infants at risk of NEC.
Overall, the current knowledge base available on this probiotic indicates its efficacy to produce clinical benefits in various indications frequently seen in children, including diarrhea of various etiology and respiratory or other infections. The promising positive effects seen in a variety of conditions commonly affecting newborns and children warrants more studies on this probiotic to better understand its mechanisms of action in immune modulation and gastrointestinal protection, but also at the systemic level based on pre-clinical data. However, there is currently a gap in knowledge about how microbiota-derived molecules may systemically affect the host, especially considering the complexity of these interactions and variable translatability of mechanisms from animal models to humans. The recent advents in “meta-omics” technologies and use of various experimental models [62,63,64,65] could help bridge this gap.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/nu13061908/s1, Table S1: PubMed search strategy.

Author Contributions

Conceptualization, A.T. and T.A.T.; methodology/literature searches, A.T. and X.X.; data curation, A.T. and X.X.; data analysis, A.T., X.X. and J.C.; writing—original draft preparation, A.T.; writing—review and editing, A.T., X.X., J.C. and T.A.T.; supervision, T.A.T. All authors have read and agreed to the published version of the manuscript.

Funding

This review received no external funding.

Conflicts of Interest

A.T., X.X., and T.A.T. are employed by Lallemand Health Solutions Inc., a company that researches, develops, manufactures, markets, and sells probiotics (including Probiokid® and its individual strains) to business clients but not directly to consumers. J.C. is an independent statistical consultant.

References

  1. Heeney, D.D.; Gareau, M.G.; Marco, M.L. Intestinal Lactobacillus in health and disease, a driver or just along for the ride? Curr. Opin. Biotechnol. 2018, 49, 140–147. [Google Scholar] [CrossRef] [Green Version]
  2. Arboleya, S.; Watkins, C.; Stanton, C.; Ross, R.P. Gut Bifidobacteria Populations in Human Health and Aging. Front. Microbiol. 2016, 7, 1204. [Google Scholar] [CrossRef] [Green Version]
  3. Gaufin, T.; Tobin, N.H.; Aldrovandi, G.M. The importance of the microbiome in pediatrics and pediatric infectious diseases. Curr. Opin. Pediatr. 2018, 30, 117–124. [Google Scholar] [CrossRef]
  4. McFarland, L.V.; Evans, C.T.; Goldstein, E.J.C. Strain-Specificity and Disease-Specificity of Probiotic Efficacy: A Systematic Review and Meta-Analysis. Front. Med. 2018, 5, 124. [Google Scholar] [CrossRef]
  5. Naser, S.M.; Hagen, K.E.; Vancanneyt, M.; Cleenwerck, I.; Swings, J.; Tompkins, T.A. Lactobacillus suntoryeus Cachat and Priest 2005 is a later synonym of Lactobacillus helveticus (Orla-Jensen 1919) Bergey et al. 1925 (Approved Lists 1980). Int. J. Syst. Evol. Microbiol. 2006, 56, 355–360. [Google Scholar] [CrossRef] [PubMed]
  6. Zheng, J.; Wittouck, S.; Salvetti, E.; Franz, C.; Harris, H.M.B.; Mattarelli, P.; O’Toole, P.W.; Pot, B.; Vandamme, P.; Walter, J.; et al. A taxonomic note on the genus Lactobacillus: Description of 23 novel genera, emended description of the genus Lactobacillus Beijerinck 1901, and union of Lactobacillaceae and Leuconostocaceae. Int. J. Syst. Evol. Microbiol. 2020, 70, 2782–2858. [Google Scholar] [CrossRef] [PubMed]
  7. Canada Vigilance Adverse Reaction Online Database. Government of Canada. Available online: https://www.canada.ca/en/health-canada/services/drugs-health-products/medeffect-canada/adverse-reaction-database.html (accessed on 21 May 2021).
  8. Balduzzi, S.; Rücker, G.; Schwarzer, G. How to perform a meta-analysis with R: A practical tutorial. Evid. Based Ment. Health 2019, 22, 153–160. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Schwarzer, G. Meta: An R Package for Meta-Analysis. R News 2007, 7, 40–45. Available online: http://cran.r-project.org/doc/Rnews/Rnews_2007-3.pdf (accessed on 31 May 2021).
  10. Higgins, J.P.; Altman, D.G.; Gøtzsche, P.C.; Jüni, P.; Moher, D.; Oxman, A.D.; Savovic, J.; Schulz, K.F.; Weeks, L.; Sterne, J.A. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011, 343, d5928. [Google Scholar] [CrossRef] [Green Version]
  11. Duval, S.; Tweedie, R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000, 56, 455–463. [Google Scholar] [CrossRef]
  12. Duval, S.; Tweedie, R. A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis. J. Am. Stat. Assoc. 2000, 95, 89–98. [Google Scholar] [CrossRef]
  13. Manzano, S.; De Andres, J.; Castro, I.; Rodriguez, J.M.; Jimenez, E.; Espinosa-Martos, I. Safety and tolerance of three probiotic strains in healthy infants: A multi-centre randomized, double-blind, placebo-controlled trial. Benef. Microbes 2017, 8, 569–578. [Google Scholar] [CrossRef] [PubMed]
  14. Xiao, L.; Gong, C.; Ding, Y.; Ding, G.; Xu, X.; Deng, C.; Ze, X.; Malard, P.; Ben, X. Probiotics maintain intestinal secretory immunoglobulin A levels in healthy formula-fed infants: A randomised, double-blind, placebo-controlled study. Benef. Microbes 2019, 2019, 1–12. [Google Scholar] [CrossRef] [PubMed]
  15. Gao, M. The Efficacy Analysis of the Combination of Smecta and BIOSTIME Probiotics in the Treatment of Non-Infectious Diarrhea in Children. Med. Front. 2013, 164. Available online: https://irp-cdn.multiscreensite.com/a17cd43e/files/uploaded/Gao-2013-The%20efficacy%20analysis%20of%20the%20combinat.pdf (accessed on 31 May 2021).
  16. Li, S. Efficacy analysis of Montmorillonite combined with Biostime probiotics in children with non-infectious diarrhea. Spec. Health Issue 2020, 10, 92. [Google Scholar]
  17. Liang, Y.; Wang, X.; Zhao, B. Efficacy analysis of Montmorillonite combined with Biostime probiotics in children with non-infectious diarrhea. Women Health Res. 2018, 121–123. [Google Scholar] [CrossRef]
  18. Liu, P.; Liang, Y.; Zhu, M. Observation on the efficacy of Montmorillonite Powder and Biostime Probiotics in Children with non-infectious diarrhea. Hebei Med. J. 2015, 37, 1846–1847. [Google Scholar]
  19. Luo, G. Smecta Combined with Biostime Probiotics in the Treatment of Non-Infectious Diarrhea in Children. China Rural Health 2013, 311–312. Available online: https://xueshu.baidu.com/usercenter/paper/show?paperid=1d1d04y0fm4r0ja0bd4h0c90vh477682&site=xueshu_se (accessed on 31 May 2021).
  20. Wang, F. The effectiveness analysis of combination of Smecta and Biostime probiotics in the treatment of infantile non-infectious diarrhea. Mod. Prev. Med. 2012, 39, 2726–2727. [Google Scholar]
  21. Wu, X. The efficacy analysis of the combination of Smecta and Biostime probiotics in the treatment of non-infectious diarrhea in children. Road Health 2013, 12, 180–181. [Google Scholar]
  22. Cui, X.; Wure, G. The Treatment of 62 Cases of Rotavirus Gastroenteritis by Biostime Probiotics. Chin. J. Synth. Med. 2003, 5, 53–54. [Google Scholar]
  23. Jin, Y. Clinical Efficacy Observation of Biostime Probiotics in the Treatment of Autumn Diarrhea. Chin. J Clin. Ration. Drug Use 2014, 7, 44–45. [Google Scholar]
  24. Li, X.; Chen, Z. Evaluation of the efficacy of Biostime on rotaviral infection in children. Med. Inf. 2008, 21, 893–895. [Google Scholar]
  25. Yang, J.; Tian, X.; Chen, Y.; Li, P.; Lin, Y.; Wang, Y.; Xu, Z.; Zhao, W. Clinical Observation of Different Feeding Methods in Adjuvant Treatment of Infantile Diarrhea. Occup. Health 2010, 26, 2807–2808. [Google Scholar]
  26. Jiang, X. Clinical Evaluation of Biostime in the Treatment of Children with Persistent Diarrhea. In Proceedings of the 6th Chinese National Conference Pediatric Microecology, Shenzhen, China, 6 November 2016; Available online: https://xueshu.baidu.com/usercenter/paper/show?paperid=de84a9406f735672673620e40b7869eb&site=xueshu_se&hitarticle=1 (accessed on 31 May 2021).
  27. Chen, L.; Ouyang, L.; Liao, W.; Zhang, W. Mucous membrane immunity enhanced by taking Biostime probiotics. Chin. J. Ecol. 2007, 19, 137–141. [Google Scholar]
  28. De Andres, J.; Manzano, S.; Garcia, C.; Rodriguez, J.M.; Espinosa-Martos, I.; Jimenez, E. Modulatory effect of three probiotic strains on infants’ gut microbial composition and immunological parameters on a placebo-controlled, double-blind, randomised study. Benef. Microbes 2018, 9, 573–584. [Google Scholar] [CrossRef] [PubMed]
  29. Pantović, F. Serum immunoglobulin levels in children with respiratory infections who used a synbiotic dietary supplement. PONS Med. J. 2013, 10, 7–11. [Google Scholar] [CrossRef] [Green Version]
  30. Qiu, W.; Zhang, F.; Sun, L.; Yu, J.; Wang, S.; Li, G.; Tong, X. The effect of blue light phototherapy combined with synbiotics on neonatal hyperbilirubinemia. Chin. J. Med. 2020, 55, 1014–1016. [Google Scholar]
  31. Cazzola, M.; Pham-Thi, N.; Kerihuel, J.C.; Durand, H.; Bohbot, S. Efficacy of a synbiotic supplementation in the prevention of common winter diseases in children: A randomized, double-blind, placebo-controlled pilot study. Ther. Adv. Respir. Dis. 2010, 4, 271–278. [Google Scholar] [CrossRef]
  32. Stojković, A.; Simović, A.; Bogdanović, Z.; Banković, D.; Poskurica, M. Optimal time period to achieve the effects on synbiotic-controlled wheezing and respiratory infections in young children. Srp. Arh. Celok. Lek. 2016, 144, 38–45. [Google Scholar] [CrossRef] [PubMed]
  33. Xi, Y.; Ding, S.; Guo, J.; Ma, S.; Kong, X.; Pan, L. Observation of Clinical effects of Biostime probiotics on thrush. Chin. J. Microecol. 2013, 25, 830–831. [Google Scholar]
  34. Li, F. Biostime probiotics combined with compound Huangbai solution in treatment of children eczema: An observation on the efficacy. China Pediatrics Integr. Tradit. West. Med. 2017, 9, 121–123. [Google Scholar]
  35. Wei, J. Evaluation of Synbiotics Probiotics Granules and Iron Dextran Oral Liquid in the Treatment of Pediatric IDA. J. Med. Theory Pract. 2018, 31, 566–567. [Google Scholar]
  36. Wu, W. Prospective study of iron dextran combined with synbiotic probiotics in the treatment of nutritional iron deficiency anemia in children. Matern. Child Health Care China 2014, 29, 3284–3286. [Google Scholar]
  37. Yang, Y. Efficacy analysis of the combined treatment of iron dextran oral liquid and Biostime probiotics in children with nutritional iron deficiency. Matern. Child Health Care China 2015, 30, 6390–6392. [Google Scholar]
  38. Huang, T.; Ouyang, F. Clinical Study on the Effect of Biostime Probiotics Granules on Gastrointestinal Function in Very Low Birth Weight Infants. Med. Inf. 2015, 28, 317–318. [Google Scholar]
  39. Gao, Y.; Peng, F.; Wang, J.; Zhu, W.; Wang, S.; Xu, J.; Liu, P.; Sun, Z. Study on the preventive effect of probiotics on neonatal jaundice and neonatal tolerance of probiotics. Matern. Child Health Care China 2015, 30, 6229–6231. [Google Scholar]
  40. Fang, H.; Duan, S.; Dong, Z.; Yu, A.; Liu, X.; Zhang, J.; Peng, W.; Xiao, D.; Zheng, Q.; Xie, L.; et al. The diagnosis and treatment strategy of diarrhea in China. Chin. J. Pract. Pediatr. 1998, 13, 381–384. [Google Scholar]
  41. Sohail, G.; Xu, X.; Christman, M.C.; Tompkins, T.A. Probiotic Medilac-S® for the induction of clinical remission in a Chinese population with ulcerative colitis: A systematic review and meta-analysis. World J. Clin. Cases 2018, 6, 961–984. [Google Scholar] [CrossRef] [PubMed]
  42. Corthesy, B. Multi-faceted functions of secretory IgA at mucosal surfaces. Front. Immunol. 2013, 4, 185. [Google Scholar] [CrossRef] [Green Version]
  43. Mantis, N.J.; Rol, N.; Corthesy, B. Secretory IgA’s complex roles in immunity and mucosal homeostasis in the gut. Mucosal. Immunol. 2011, 4, 603–611. [Google Scholar] [CrossRef]
  44. Cacho, N.T.; Lawrence, R.M. Innate Immunity and Breast Milk. Front. Immunol. 2017, 8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Lewis, D.B.; Wilson, C.B. CHAPTER 4—Developmental Immunology and Role of Host Defenses in Fetal and Neonatal Susceptibility to Infection. In Infectious Diseases of the Fetus and Newborn, 7th ed.; Remington, J.S., Klein, J.O., Wilson, C.B., Nizet, V., Maldonado, Y.A., Eds.; W.B. Saunders: Philadelphia, PA, USA, 2011; pp. 80–191. [Google Scholar] [CrossRef]
  46. Leong, K.W.; Ding, J.L. The unexplored roles of human serum IgA. DNA Cell Biol. 2014, 33, 823–829. [Google Scholar] [CrossRef] [PubMed]
  47. Yel, L. Selective IgA deficiency. J. Clin. Immunol. 2010, 30, 10–16. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Neonatology Group of Pediatrics Branch of Chinese Medical Association, Editorial Board of Chinese Journal of Pediatrics. Expert consensus on diagnosis and treatment of neonatal hyperbilirubinemia. Chin. Pediatrics J. 2014, 52, 745–748. [Google Scholar]
  49. Van den Nieuwboer, M.; Brummer, R.J.; Guarner, F.; Morelli, L.; Cabana, M.; Claassen, E. Safety of probiotics and synbiotics in children under 18 years of age. Benef. Microbes 2015, 6, 615–630. [Google Scholar] [CrossRef] [Green Version]
  50. Land, M.H.; Rouster-Stevens, K.; Woods, C.R.; Cannon, M.L.; Cnota, J.; Shetty, A.K. Lactobacillus sepsis associated with probiotic therapy. Pediatrics 2005, 115, 178–181. [Google Scholar] [CrossRef]
  51. Salminen, M.K.; Rautelin, H.; Tynkkynen, S.; Poussa, T.; Saxelin, M.; Valtonen, V.; Järvinen, A. Lactobacillus bacteremia, clinical significance, and patient outcome, with special focus on probiotic L. rhamnosus GG. Clin. Infect. Dis. 2004, 38, 62–69. [Google Scholar] [CrossRef] [Green Version]
  52. Higgins, J.P.; Thompson, S.G.; Spiegelhalter, D.J. A re-evaluation of random-effects meta-analysis. J. R. Stat. Soc. Ser. A Stat. Soc. 2009, 172, 137–159. [Google Scholar] [CrossRef] [Green Version]
  53. Culpepper, T.; Christman, M.C.; Nieves, C., Jr.; Specht, G.J.; Rowe, C.C.; Spaiser, S.J.; Ford, A.L.; Dahl, W.J.; Girard, S.A.; Langkamp-Henken, B. Bifidobacterium bifidum R0071 decreases stress-associated diarrhoea-related symptoms and self-reported stress: A secondary analysis of a randomised trial. Benef. Microbes 2016, 7, 327–336. [Google Scholar] [CrossRef]
  54. Langkamp-Henken, B.; Rowe, C.C.; Ford, A.L.; Christman, M.C.; Nieves, C., Jr.; Khouri, L.; Specht, G.J.; Girard, S.A.; Spaiser, S.J.; Dahl, W.J. Bifidobacterium bifidum R0071 results in a greater proportion of healthy days and a lower percentage of academically stressed students reporting a day of cold/flu: A randomised, double-blind, placebo-controlled study. Br. J. Nutr. 2015, 113, 426–434. [Google Scholar] [CrossRef] [Green Version]
  55. Macpherson, C.; Audy, J.; Mathieu, O.; Tompkins, T.A. Multistrain probiotic modulation of intestinal epithelial cells’ immune response to a double-stranded RNA ligand, poly(i·c). Appl. Environ. Microbiol. 2014, 80, 1692–1700. [Google Scholar] [CrossRef] [Green Version]
  56. MacPherson, C.W.; Shastri, P.; Mathieu, O.; Tompkins, T.A.; Burguière, P. Genome-Wide Immune Modulation of TLR3-Mediated Inflammation in Intestinal Epithelial Cells Differs between Single and Multi-Strain Probiotic Combination. PLoS ONE 2017, 12, e0169847. [Google Scholar] [CrossRef] [PubMed]
  57. Kuugbee, E.D.; Shang, X.; Gamallat, Y.; Bamba, D.; Awadasseid, A.; Suliman, M.A.; Zang, S.; Ma, Y.; Chiwala, G.; Xin, Y.; et al. Structural Change in Microbiota by a Probiotic Cocktail Enhances the Gut Barrier and Reduces Cancer via TLR2 Signaling in a Rat Model of Colon Cancer. Dig. Dis. Sci. 2016, 61, 2908–2920. [Google Scholar] [CrossRef]
  58. Cazzola, M.; Tompkins, T.A.; Matera, M.G. Immunomodulatory impact of a synbiotic in Th1 and Th2 models of infection. Ther. Adv. Respir. Dis. 2010, 4, 259–270. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Wang, X.; Yang, J.; Zhang, H.; Yu, J.; Yao, Z. Oral probiotic administration during pregnancy prevents autism-related behaviors in offspring induced by maternal immune activation via anti-inflammation in mice. Autism. Res. 2019, 12, 576–588. [Google Scholar] [CrossRef]
  60. Ng, Q.X.; Loke, W.; Venkatanarayanan, N.; Lim, D.Y.; Soh, A.Y.S.; Yeo, W.S. A Systematic Review of the Role of Prebiotics and Probiotics in Autism Spectrum Disorders. Medicina 2019, 55, 129. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Robinson, S.; Zhu, H.; Zhang, Z.; Li, B.; Pierro, A.; Sherman, P.M. A103 Probiotic Formulations Differentially Affect Disease Outcome in a Mouse Model of Necrotizing Enterocolitis. J. Can. Assoc. Gastroenterol. 2020, 3, 119–120. [Google Scholar] [CrossRef]
  62. Zhang, X.; Li, L.; Butcher, J.; Stintzi, A.; Figeys, D. Advancing functional and translational microbiome research using meta-omics approaches. Microbiome 2019, 7, 154. [Google Scholar] [CrossRef] [PubMed]
  63. Yan, F.; Polk, D.B. Probiotics and Probiotic-Derived Functional Factors—Mechanistic Insights Into Applications for Intestinal Homeostasis. Front. Immunol. 2020, 11. [Google Scholar] [CrossRef] [PubMed]
  64. Paul, W.; Marta, C.; Tom, V.W. Resolving host-microbe interactions in the gut: The promise of in vitro models to complement in vivo research. Curr. Opin. Microbiol. 2018, 44, 28–33. [Google Scholar] [CrossRef] [PubMed]
  65. Cassotta, M.; Forbes-Hernández, T.Y.; Calderón Iglesias, R.; Ruiz, R.; Elexpuru Zabaleta, M.; Giampieri, F.; Battino, M. Links between Nutrition, Infectious Diseases, and Microbiota: Emerging Technologies and Opportunities for Human-Focused Research. Nutrients 2020, 12, 1827. [Google Scholar] [CrossRef] [PubMed]
Figure 1. PRISMA flow diagram.
Figure 1. PRISMA flow diagram.
Nutrients 13 01908 g001
Figure 2. The probiotic formulation used as adjuvant reduced the relative risk of unresolved diarrhea. (a) Forest plot of studies with an efficacy outcome (effective rate) for diarrhea of various etiologies. Events refers to the number of cases categorized as inefficient (unresolved diarrhea); Total refers to the number of participants in the Experimental (Probiotic) and Control groups. The 12 studies included in the meta-analysis are detailed in Table 2. (References: Cui, 2003 [22], Li, 2008 [24], Jiang, 2008 [26], Yang, 2010 [25], Wang, 2012 [20], Luo, 2013 [19], Gao, 2013 [15], Wu, 2013 [21], Jin, 2014 [23], Liu, 2015 [18], Liang, 2018 [17], Li, 2020 [16]). (b) Mosaic plot showing the risk of bias summary of the studies included in the meta-analysis.
Figure 2. The probiotic formulation used as adjuvant reduced the relative risk of unresolved diarrhea. (a) Forest plot of studies with an efficacy outcome (effective rate) for diarrhea of various etiologies. Events refers to the number of cases categorized as inefficient (unresolved diarrhea); Total refers to the number of participants in the Experimental (Probiotic) and Control groups. The 12 studies included in the meta-analysis are detailed in Table 2. (References: Cui, 2003 [22], Li, 2008 [24], Jiang, 2008 [26], Yang, 2010 [25], Wang, 2012 [20], Luo, 2013 [19], Gao, 2013 [15], Wu, 2013 [21], Jin, 2014 [23], Liu, 2015 [18], Liang, 2018 [17], Li, 2020 [16]). (b) Mosaic plot showing the risk of bias summary of the studies included in the meta-analysis.
Nutrients 13 01908 g002
Figure 3. Funnel plot showing the relationship between the relative risk and its standard error for the 12 studies included (filled circles) and the potential 5 negative studies added to correct asymmetry using the Trim and Fill method (empty circles).
Figure 3. Funnel plot showing the relationship between the relative risk and its standard error for the 12 studies included (filled circles) and the potential 5 negative studies added to correct asymmetry using the Trim and Fill method (empty circles).
Nutrients 13 01908 g003
Figure 4. The probiotic reduced the relative risk of unresolved anemia and side effects in children with nutritional iron deficiency anemia receiving iron supplementation. Forest plot of studies on IDA treatment efficacy and occurrence of side effects. The 3 studies included in these meta-analyses are detailed in Table 4. (References: Wei, 2018 [35], Yang, 2015 [37], Wu, 2014 [36]). (a) Events refers to the number of cases categorized as inefficient (negative outcome of treatment); Total refers to the number of participants in the Experimental (Probiotic) and Control groups. (b) Events refers to the number of cases experiencing iron supplementation-related side effects; Total refers to the number of participants in the Experimental (Probiotic) and Control groups. (c) Mosaic plot showing the summary of the risk of bias analysis of studies included in the meta-analysis.
Figure 4. The probiotic reduced the relative risk of unresolved anemia and side effects in children with nutritional iron deficiency anemia receiving iron supplementation. Forest plot of studies on IDA treatment efficacy and occurrence of side effects. The 3 studies included in these meta-analyses are detailed in Table 4. (References: Wei, 2018 [35], Yang, 2015 [37], Wu, 2014 [36]). (a) Events refers to the number of cases categorized as inefficient (negative outcome of treatment); Total refers to the number of participants in the Experimental (Probiotic) and Control groups. (b) Events refers to the number of cases experiencing iron supplementation-related side effects; Total refers to the number of participants in the Experimental (Probiotic) and Control groups. (c) Mosaic plot showing the summary of the risk of bias analysis of studies included in the meta-analysis.
Nutrients 13 01908 g004
Table 1. Overview of the clinical studies in pediatric populations.
Table 1. Overview of the clinical studies in pediatric populations.
IndicationNumber of StudiesN (Total)N (Probiotic Arm)Main Outcome MeasuresReferences
Safety
Healthy children/newborns2340≈50/strain [13] 1
66 [14]
Growth parameters, adverse events and serious adverse events, sleep and crying patterns, D-lactic acid[13,14]
Gastrointestinal function
Non-infectious diarrhea71001521Time to symptom relief, effective rate[15,16,17,18,19,20,21]
Rotavirus (RV)-induced diarrhea4394207Time to symptom relief, effective rate[22,23,24,25]
Persistent diarrhea,
undefined etiology
15232Time to symptom relief, effective rate[26]
Immune system function and natural defenses
Secretory IgA, cytokines, chemokines6405 2224 2Salivary, fecal or serum levels of secretory IgA, fecal or serum levels of cytokines/chemokines[14,18,27,28,29,30]
Common infections 32213140Incidence of infections and related symptoms,
adverse events
[31,32]
Other indications
Oral candidiasis (thrush)17035Effective rate, recurrence[33]
Eczema17638Eczema Area and Severity Index (EASI) score,
effective rate
[34]
Iron deficiency anemia3364182Anemia blood markers, effective rate, side effects [35,36,37]
Necrotizing enterocolitis16030Incidence, severity, mortality, food tolerance[38]
Jaundice21064532Incidence, severity (bilirubin levels)[30,39]
1 Study assessing individual strains. 2 Not including children from De Andres et al. (2018) [28], a post hoc analysis of Manzano et al. (2007) [13] assessing single strains vs. placebo (≈50/strain). 3 Including upper respiratory tract infections, ear-nose-throat infections, and gastrointestinal symptoms.
Table 2. Details of studies on diarrhea of various etiologies.
Table 2. Details of studies on diarrhea of various etiologies.
Reference
[Language]
Study DatesPopulationStudy Design
Arms, n
Probiotic RegimenResults (vs. Control)Adverse Events
Cui, 2003 [22]
[Chinese]
September 2002–November 2002Children
6–24 months old
RV-ag+
diarrhea
Onset < 72 h
Randomized,
controlled
Ribavirin + Pro, n = 62
Ribavirin +
Lacidophilin,
n = 60
<12 months: 1 sachet QD
12–24 months: 1 sachet BID
Orally in warm water or milk
Until resolution or up to 72 h
Shorter duration of diarrhea (39.3 ± 17.1 vs. 63.8 ± 22.9 h)
Higher total effective rate (93.5% vs. 61.7%; p < 0.01)
n.r.
Li, 2008 [24]
[Chinese]
June 2005–December 2007Children
0–60 months old
RV-ag+
diarrhea
Randomized,
controlled
Ribavirin + Pro,
n = 39
Ribavirin alone,
n = 39
1 sachet BID
Orally. 7 days
Higher total effective rate (94.9% vs. 74.3%; p < 0.05)n.r.
Jiang, 2008 [26]
[Chinese]
December 2006–June 2008Children
3–24 months old
Persistent
diarrhea
Randomized,
active control
Pro, n = 32
GoldenBifido, n = 20
<6 months: 0.5 sachet BID
6–12 months: 1 sachet BID
12–24 months: 1–2 sachet BID
Until resolution
Shorter duration of diarrhea (7.14 ± 0.78 vs. 12.6 ± 1.75 d; p < 0.001)
Higher total effective rate (91% vs. 65%; p < 0.01)
n.r.
Yang, 2010 [25]
[Chinese]
January 2008–October 2009Children
6–30 months old
RV-ag+
diarrhea
Randomized,
controlled
CST + Pro (in formula), n = 58
CST (breastfed or formula), n = 40
1 sachet QD
Orally
In lactose-free formula
Duration not stated
Shorter duration of diarrhea (2.8 ± 1.1 vs. 4.9 ± 2.6 d; p< 0.01)
Shorter hospital stay (5.5 ± 1.7 vs. 8.5 ± 2.3 d; p < 0.01).
Higher total effective rate (94.8% vs. 77.5%; p ≤ 0.05)
n.r.
Wang, 2012 [20]
[Chinese]
May 2010–December 2010Children
3–36 months old
Non-infectious diarrhea
Onset < 72 h
Randomized,
controlled
Smecta® + Pro, n = 104
Smecta®, n = 90
<12 months: 0.33 sachet TID
12–24 months: 0.5 sachet BID
24–36 months: 1 sachet BID
Orally. 3 days
Higher markedly effective rate in three age groups (p > 0.05):
< 12 months: 78.8% vs. 74.2%
12–24 months: 79.1% vs. 74/3%
24–36 months: 82.1% vs. 75%
None
observed
Luo, 2013 [19]
[Chinese]
April 2010–February 2011Children
4–36 months old Non-infectious diarrhea
Onset < 72 h
Randomized,
controlled
Smecta® + Pro, n = 75
Smecta®, n = 68
<12 months: 0.33 sachet TID
12–24 months: 0.5 sachet BID
24–36 months: 1 sachet BID
Orally. 3 days
Higher effective rate
(94.8% vs. 73%; p < 0.05)
n.r.
Gao, 2013 [15]
[Chinese]
January 2011–January 2012Children
0–36 months old
Non-infectious diarrhea
Randomized,
controlled
Smecta® + Pro, n = 43
Smecta®, n = 43
<12 months: 0.33 sachet TID
12–36 months: 0.5 sachet TID
Orally. 3 days
Higher total effective rate (90.7% vs. 62.8%; p < 0.05)None
observed
Wu, 2013 [21]
[Chinese]
April 2011–December 2011Children
2–36 months old
Non-infectious diarrhea
Onset < 72 h
Randomized,
controlled
Smecta® + Pro, n = 84
Smecta®, n = 64
<12 months: 0.33 sachet TID
12–24 months: 0.5 sachet BID
24–36 months: 1 sachet BID
Orally. 3 days
Higher total effective rate (90.5% vs. 75%; p < 0.05)n.r.
Jin, 2014 [23]
[Chinese]
October 2011–June 2013Children
5–52 months old
(mean 17.3 mo)
RV-ag+
diarrhea.
Onset < 72 h
Randomized, active control
Smecta® + Ribavirin + Pro, n = 48
Smecta® + Ribavirin, n = 48
0.5–1 sachet BID
Orally. In warm water.
Duration not stated. Fluids provided as needed
Shorter time to symptom relief (diarrhea, 31.6 ± 5.2 h vs. 34.6 ± 4.1 h; p< 0.05)
Higher total effective rate (91.7% vs. 75.0%; p < 0.05)
n.r.
Liu, 2015 [18]
[Chinese]
May 2011–May 2014Children
3–38 months old
Non-infectious diarrhea
Randomized,
controlled
Smecta® + Pro, n = 75
Smecta®, n = 75
<12 months: 0.33 sachet TID
12–24 months: 0.5 sachet BID
24–36 months: 1 sachet BID
Orally. 3 days
Higher markedly effective rate (72% vs. 45.33%; p < 0.05)
Higher total effective rate (96% vs. 84%; p < 0.05)
Reduced diarrhea frequency (p < 0.05), time to diarrhea relief (p < 0.05) and symptom disappearance (p < 0.05) in the probiotic group
n.r.
Liang, 2018 [17]
[Chinese]
February 2015–May 2017Children
3–39 months old
Non-infectious
diarrhea
Randomized, active control
Smecta® + Probiotic, n = 43
Smecta® alone, n = 43
<12 months: 0.33 sachet TID
12–24 months: 0.5 sachet BID
24–36 months: 1 sachet BID
Orally. 3 days
Higher total effective rate (95.35% vs. 79.07%; p < 0.05)n.r.
Li, 2020 [16]
[Chinese]
January 2019–February 2020Children
6–37 months old
Non-infectious diarrhea
Randomized,
controlled
Smecta® + Pro, n = 49
Smecta®, n = 49
<12 months: 0.33 sachet TID
12–24 months:
0.33 or 0.66 sachet TID
24–36 months: 1 sachet TID
Orally. 3 days
Higher total effective rate (95.91% vs. 83.67%; p < 0.05)n.r.
BID, twice a day; CST, comprehensive standard therapy (as needed; Smecta®, fluids, antibiotics, etc.); n.r., not reported; Pro, Probiotic (Biostime®); RV-ag+, positive for fecal rotavirus antigen; TID, three times per day; QD, once daily.
Table 3. Details of studies on immunity and natural defenses.
Table 3. Details of studies on immunity and natural defenses.
Reference
[Language]
Study DatesPopulationStudy Design
Arms, n
Probiotic RegimenResults (vs. Control)Adverse Events
Chen, 2007 [27]
[Chinese]
Not statedChildren
0–48 months old
Healthy with low salivary sIgA
Randomized,
controlled
Probiotic, n = 20
No Intervention, n = 8
1 sachet BID
Orally. For 14 days
Increase in salivary sIgA compared to baseline in probiotic but not in controls.
No statistical analyses reported.
n.r.
Cazzola, 2010 [31] [English]December 2006–March 2007Children
3–7 years old
≥ 3 infections (ENTI, URTI, GI illness) in past winter.
Randomized, double-blind, placebo-controlled
Probiotic, n = 62
Placebo, n = 73
1 sachet QD
Orally. For 3 months
Lower incidence of ENTI, URTI, or GI health events (51.6% vs. 68.5%; p = 0.044), representing a 25% reduction in RR.
Less participants experienced school day losses for sickness (25.8% vs. 42.5%; p = 0.0443).
2 SAEs; 1 abdominal pain in placebo and 1 otitis media in Probiotic.
24 AEs in 20 children (9 in placebo, 11 in Probiotic), most were expected respiratory or GI events.
Pantovic, 2013 [29] [English]Not statedChildren
6–42 months old
low IgA levels
hospitalized for URTI or ENTI
Open-label, uncontrolled before–after study
Probiotic, n = 31
1 sachet QD
Orally. For 6 months
Increase in serum IgA levels in 35% of the children after 3 months and 81% after 6 months (p < 0.05), normalized to normal range.
Clinical improvement in URTI after 3 months, and no infections diagnosed between 3 and 6 months.
n.r.
Liu, 2015 [18]
[Chinese]
May 2011–May 2014Children
3–38 months old
Non-infectious
diarrhea
Randomized,
controlled
Smecta® + Probiotic, n = 75
Smecta®, n = 75
<12 months: 0.33 sachet TID
13–24 months: 0.5 sachet BID
24–36 months: 1 sachet BID
Orally. For 3 days
Lower serum levels of pro-inflammatory cytokines IL-6 and IL-17
(p < 0.05).
Higher levels of salivary sIgA (p < 0.05).
n.r.
Stojkovic, 2016 [32] [English]Not stated.Children
<5 years
Hospitalized during the past year for respiratory diseases
Open label,
before–after
Probiotic, n = 78
Divided into 3 groups based on medical history:
G1: URTI + wheezing, n = 50
G2: URTI w/o wheezing, n = 17
G3: Wheezing w/o URTI, n = 11
1 sachet QD
Orally. For 9 months
Decrease in URTI and wheezing after 3 months (p < 0.01), reaching 0% after 6 months.
No recurrence of URTI or wheezing (0%) in all groups) at 9 months.
Increase in serum IgA from 3 months onwards (p < 0.01).
Increase in serum IgG from 3 months onwards (p < 0.01).
Decrease in serum IgE at 9 months (p < 0.01).
None observed.
Manzano, 2017 [13];
De Andres, 2018 [28]
[English]
August 2014–December 2016Children
3–12 months old
Healthy
Randomized, double-blind, placebo-controlled
L. helveticus Rosell®-52, n = 52
B. infantis Rosell®-33, n = 53
B. bifidum Rosell®-71, n = 51
Placebo, n = 52
3 × 109 CFU of each single strain QD
Orally. For 8 weeks
Increased IL10/IL12 ratio (anti-inflammatory) in B. infantis (p < 0.01).
Increased TNFα/IL10 ratio (pro-inflammatory) in L. helveticus and placebo (p < 0.01).
Placebo group showed a microbiota composition related to the weaning process, while the probiotics groups were similar to 4-month-old un-weaned infants.
No difference between groups for the number and severity of adverse events (mild) nor in behavioral and anthropometric parameters. No SAEs observed.
Xiao, 2019 [14]
[English]
December 2014–November 2015Children 3.5–6 months old
Healthy
Randomized, placebo-controlled
Probiotic, n = 66
Placebo, n = 66
1 sachet QD
Orally, in formula.
For 4 weeks
Maintained higher fecal sIgA levels at the end of the four-week treatment period (p < 0.05).All AEs reported were minor and more frequent in the placebo group.
Probiotic: 37 AEs; 21 respiratory, 12 GI, 4 dermatological.
Placebo: 69 AEs; 38 respiratory, 15 GI, 16 dermatological.
No effect on growth rate.
Qiu, 2020 [30]
[Chinese]
September 2017–May 2018Full-term neonates with hyperbilirubinemiaRandomized,
controlled
Blue light photo-
therapy + Probiotic, n = 32
Blue light photo-
therapy, n = 32
1 sachet BID,
for 5 days
Reduction in IL-6 vs. controls (p < 0.05).
Reduction in IL-6 and IL-8 at day 3 and 5 vs. baseline (p < 0.05).
Increase in IL-10 at day 5 vs. baseline (p < 0.05).
Increase in serum catalase levels at day 5 vs. baseline (p < 0.05).
n.r.
BID, twice a day; CFU, colony-forming unit; ENTI, ear-nose-throat infection; GI, gastrointestinal; n.r., not reported; QD, once daily; sIgA, secretory immunoglobulin A; TID, three times per day; URTI, upper respiratory tract infection.
Table 4. Details of studies in other indications.
Table 4. Details of studies in other indications.
Reference
[Language]
Study DatesPopulationStudy Design
Arms, n
Probiotic RegimenResults (vs. Control)Adverse Events
Xi, 2013 [33]
[Chinese]
(Thrush)
January 2011–December 2012Children
1–26 months old
oral candidiasis infection
Randomized,
controlled
2% NaHCO₃ + nystatin + Pro, n = 35
2% NaHCO₃ +
nystatin, n = 35
1 sachet BID
Orally. For 14 days
Higher total effective rate (94.3% vs. 77.1%, p ≤ 0.05).
Lower recurrence rate (2.9% vs. 17.1%, p ≤ 0.05).
None observed.
Li, 2017 [34]
[Chinese]
(Eczema)
August 2014–January 2016 Children
1–24 months old
infantile eczema
Randomized,
controlled
Topical treatment + Probiotic, n = 38
Topical treatment, n = 38
1 sachet BID,
for 2 weeks
Lower EASI scores at 2 weeks after treatment
(p < 0.05).
Higher total effective rate (92.1% vs. 65.7%, p < 0.01).
None observed.
Wu, 2014 [36]
[Chinese]
(IDA)
June 2010–April 2013 Children
6–60 months old
Nutritional iron deficiency anemia
Randomized,
controlled
Iron dextran, n = 71
Iron dextran + Probiotic, n = 76
1 sachet QD,
for 8 weeks
Higher total effective rate (76.3% vs. 60.6 %; χ2 = 4.236, p = 0.040).Decreased cases of side effects of Iron dextran (13.2% vs. 25.4%; p = 0.06).
Yang, 2015 [37]
[Chinese]
(IDA)
February 2011–December 2013Children
6–60 months old
Nutritional iron deficiency anemia
Randomized,
controlled
Iron dextran, n = 76
Iron dextran + Probiotic, n = 76
1 sachet BID,
for 8 weeks
Higher markedly effective rate (75% vs. 55.3%; χ2 = 6.453, p = 0.011). Decreased cases of side effects of iron dextran
(17.1% vs. 30.3%; p = 0.06).
Wei, 2018 [35]
[Chinese]
(IDA)
January 2015–December 2016Children
7–72 months old
Nutritional iron deficiency anemia
Randomized,
Controlled
Iron dextran, n = 30
Iron dextran + Probiotic, n = 30
1 sachet BID,
for 8 weeks
All received also Smecta® and antibiotics
Total effective rate 10% higher in probiotic vs. control (96.7% vs. 86.7%; p > 0.1).Decreased cases of side effects of iron dextran
(20% vs. 40%; p = 0.09).
Huang and Ouyang, 2015 [38]
[Chinese]
(GI function; NEC)
August 2011–August 2013Premature newborns (1000–1500 g; mean 34 weeks gestational age)Randomized,
placebo-controlled
Placebo, n = 30
Probiotic, n = 30
0.5 sachet BID,
for 2 weeks
Reduced feeding intolerance vs. control (36.7% vs. 70%; p = 0.0104).
Nonsignificant reduction in NEC incidence in probiotic (2/30; 6.7%) vs. control (5/30; 16.7%).
Nonsignificant reduction in duration of hospital stay in probiotic (40.1 ± 15.6 d) vs. control (47.3 ± 16.7 d).
One death (3.3%) in the probiotic group, 2 deaths in the control group (6.7%).
Parenteral nutrition-associated cholestasis: 1 case (3.3%) in probiotic vs. 3 cases (10%) in control (p = 0.2755).
Gao, 2015 [39]
[Chinese]
(Jaundice)
December 2013–December 2013Healthy full-term neonates
gestational age 37–42 weeks (mean 40 weeks), birth weight 2500–4000 g
Randomized, placebo-controlled
Placebo, n = 500
Probiotic, n = 500
1 sachet BID,
for 7 days after birth
Similar time of onset of jaundice between groups (p > 0.05), with significantly lower incidence in probiotic (9%) vs. placebo (17%); p < 0.001.
Similar daily percutaneous bilirubin levels until day 5 (p > 0.05), with a significant reduction in bilirubin levels in probiotic on treatment days 6 and 7 vs. placebo (p < 0.05).
Similar between groups (erythema, vomiting, diarrhea; all p > 0.05).
Qiu, 2020 [30]
[Chinese]
(Jaundice)
September 2017–May 2018 Healthy full-term neonates
gestational age 37–41 weeks, aged ≤3 days,
with neonatal hyperbilirubinemia developing within 24 h of birth
Randomized, controlled
Blue light phototherapy, n = 32
Blue light phototherapy + Probiotic, n = 32
1 sachet BID,
for 5 days
Significant decrease in total and unconjugated bilirubin levels in probiotic vs. controls at day 3 and day 5 (p < 0.05).
Significant increase in catalase levels vs. baseline at day 5 (p < 0.05) in the probiotic group, but no change in controls.
n.r.
BID, twice a day; IDA, iron deficiency anemia; NEC, necrotizing enterocolitis, n.r., not reported; QD, once daily; TID, three times per day.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Tremblay, A.; Xu, X.; Colee, J.; Tompkins, T.A. Efficacy of a Multi-Strain Probiotic Formulation in Pediatric Populations: A Comprehensive Review of Clinical Studies. Nutrients 2021, 13, 1908. https://doi.org/10.3390/nu13061908

AMA Style

Tremblay A, Xu X, Colee J, Tompkins TA. Efficacy of a Multi-Strain Probiotic Formulation in Pediatric Populations: A Comprehensive Review of Clinical Studies. Nutrients. 2021; 13(6):1908. https://doi.org/10.3390/nu13061908

Chicago/Turabian Style

Tremblay, Annie, Xiaoyu Xu, James Colee, and Thomas A. Tompkins. 2021. "Efficacy of a Multi-Strain Probiotic Formulation in Pediatric Populations: A Comprehensive Review of Clinical Studies" Nutrients 13, no. 6: 1908. https://doi.org/10.3390/nu13061908

APA Style

Tremblay, A., Xu, X., Colee, J., & Tompkins, T. A. (2021). Efficacy of a Multi-Strain Probiotic Formulation in Pediatric Populations: A Comprehensive Review of Clinical Studies. Nutrients, 13(6), 1908. https://doi.org/10.3390/nu13061908

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop