Next Article in Journal
Chronic Active Epstein–Barr Virus Infection: The Elucidation of the Pathophysiology and the Development of Therapeutic Methods
Next Article in Special Issue
Impacts of Low Temperature and Ensiling Period on the Bacterial Community of Oat Silage by SMRT
Previous Article in Journal
Performance of a Four-Antigen Staphylococcus aureus Vaccine in Preclinical Models of Invasive S. aureus Disease
Previous Article in Special Issue
Animal Fat as a Substrate for Production of n-6 Fatty Acids by Fungal Solid-State Fermentation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Adjunct Culture of Non-Starter Lactic Acid Bacteria for the Production of Provola Dei Nebrodi PDO Cheese: In Vitro Screening and Pilot-Scale Cheese-Making

1
Department of Agricultural, Food and Environment, University of Catania, 95123 Catania, Italy
2
Department of Veterinary Sciences, University of Messina, 98168 Messina, Italy
3
Department of Soil, Plant and Food Science, University of Bari Aldo Moro, 70121 Bari, Italy
4
Department of Foodborne Pathogens, Sciensano, 1050 Brussels, Belgium
5
Department of Chemical, Biological, Pharmaceutical and Environmental Sciences, University of Messina, 98168 Messina, Italy
*
Author to whom correspondence should be addressed.
Microorganisms 2021, 9(1), 179; https://doi.org/10.3390/microorganisms9010179
Submission received: 22 December 2020 / Revised: 12 January 2021 / Accepted: 13 January 2021 / Published: 15 January 2021
(This article belongs to the Special Issue Microbial Populations of Fermented Foods)

Abstract

:
The present study aimed at selecting non-starter lactic acid bacteria strains, with desirable technological and enzymatic activities, suitable as adjunct culture for the Provola dei Nebrodi cheese production. One hundred and twenty-one lactic acid bacteria, isolated from traditional Provola dei Nebrodi cheese samples, were genetically identified by Rep-PCR genomic fingerprinting, using the (GTG)5-primer, and by matrix-assisted laser desorption/ionisation time-of-flight mass spectrometry (MALDI-TOF MS). Twenty-seven strains, included in the qualified presumption of safety (QPS) list, were tested for technological and proteinase/peptidase activities. Results showed that technological features and flavour formation abilities were strain-dependent. Among the selected strains, Lacticaseibacillus paracasei PN 76 and Limosilactobacillus fermentum PN 101 were used as adjunct culture in pilot-scale cheese-making trials. Data revealed that adjunct cultures positively affected the flavour development of cheese, starting from 30 days of ripening, contributing to the formation of key flavour compounds. The volatile organic compound profiles of experimental cheeses was significantly different from those generated in the controls, suggesting that the selected adjunct strains were able to accelerate the flavour development, contributing to a unique profile of Provola dei Nebrodi cheese.

1. Introduction

The Provola dei Nebrodi (PN) cheese is a historical Sicilian cheese, which has been recognized as a Protected Designation of Origin (PDO) cheese (GUUE L 309—23 September 2020). It is a full-fat raw milk semi-hard pasta filata cheese, produced in the Nebrodi Mountains area under traditional practices, using cow milk or a mix of cow, ewe and goat milk. Lamb or kid rennet paste is used for coagulation, and any starter culture is added during the cheese-making. The PN cheese is generally consumed as a fresh (less than 30 days old), semi-hard (30–120 days old), or hard (more than 120 days old) cheese-type and has a typical pear-like shape with a smooth, shiny, thin, yellow-gold surface and compact straw-coloured core. It is widely recognized that artisanal cheeses, produced under traditional practices using raw milk and without starter additions, boast unique and more intense sensorial characteristics than pasteurized milk cheeses. Their distinctive taste and flavour, greatly appreciated by consumers around the world, is mainly due, along with the environmental conditions and the cheese-making technology applied, to the lactic acid bacteria population (LAB) involved during the cheese production and ripening [1,2,3]. In particular, starter LAB (SLAB) are implicated in the lactose fermentation, producing high concentrations of lactic acid and enhancing the curd acidification, whereas non-starter LAB (NSLAB) are present during the cheese ripening, influencing the biochemistry of curd maturation and contributing to the development of the sensorial characteristics of the final product [4,5]. The NSLAB population plays a key role in cheese flavour compound development through three metabolic pathways: the metabolism of lactate and citrate, the release of free fatty acids and their subsequent metabolism, and the protein breakdown and amino acids catabolism [6,7,8]. It is well known that several NSLAB strains possess a comprehensive proteinase/peptidase system which include, besides the cell envelope-associated proteinase PrtP, several intracellular oligoendopeptidases (PepO, PapF, PepP), general aminopeptidases (PepN, PepC, PepG), glutamylaminopeptidase PepA, leucyl-aminopeptidase PepL, prolyl-dipeptidyl aminopeptidase PepX, tripeptidase (PepT), dipeptidase (PepQ, PepV) and several further proteinases/peptidases [9,10]. These proteinase/peptidase systems strongly influence the sensorial characteristics of both semi-hard and hard cheeses [11]. In particular, during cheese ripening, PepN positively influences both the saltiness and maturity indexes, and it is generally responsible for a reduction in sweetness and bitterness aromatic compounds. In addition, PepL is responsible for cheesy, chocolate, sweaty and malt aromas, whereas proline-aminopeptidase (PepI) is considered a good indicator of pronounced sourness [11]. In addition, NSLAB harbour a complex system of amino acid catabolizing enzymes [12]. Therefore, to ensure the enhancement of sensory properties of cheese, NSLAB strains, which can be used as adjunct cultures, should be carefully selected based on both technological parameters and enzymatic activities.
The present study aimed to select NSLAB strains to be used as adjunct cultures during the PN cheese production. To this end, NSLAB strains were isolated, genotypically characterized, and studied for their technological properties. Subsequently, selected strains were used in the PN cheese-making in order to validate, at pilot scale, their efficacy in the proteolytic metabolism during ripening.

2. Materials and Methods

2.1. Cheese Samples and NSLAB Isolation

The artisanal Provola dei Nebrodi PDO cheese (PN) samples, analysed in the present study, were produced under traditional practices in three different farms (I, II, and III) located in the surrounding area of the Nebrodi Mountains (Sicily, Italy). For each farm, semi-hard cheese samples (60 days old), obtained from three independent batches, were collected and transferred to the Laboratory of Microbiology (Department of Agricultural, Food, and Environment, University of Catania, Italy), under refrigerated conditions (4 ± 2 °C). Overall, 9 PN cheese samples (both core and surface sections) were subjected to NSLAB isolation according to Pino et al. [13], using de Man Rogosa and Sharpe (MRS) (Oxoid, Milan, Italy) agar medium, adjusted to pH 5.4, incubated at 32 °C for 72 h (5 days) under microaerophilic conditions. Cycloheximide 100 mg/mL (Sigma, Milan, Italy), was added to inhibit yeast growth. From each MRS agar plate, about 20% of the colonies were randomly selected, checked for morphology, catalase activity, and Gram reaction, then purified, by streaking three times on MRS agar plates. Pure cultures were stored in liquid culture using 20% glycerol at −80 °C.

2.2. NSLAB Identification

Total genomic DNA was extracted from NSLAB isolates by mechanical cell lysis following the protocol previously described [14]. DNA concentration was evaluated by measuring optical density using a Fluorometer Qubit (Invitrogen, Carlsbad, CA, USA). NSLAB identification was performed by Rep-PCR genomic fingerprinting, using a (GTG)5-primer, and matrix-assisted laser desorption/ionisation time-of-flight mass spectrometry (MALDI-TOF MS) (Bruker Daltonics, Germany) according to Nguyen et al., and Pino et al. [15,16].

2.3. Safety Assessment

2.3.1. DNAse, Gelatinase, Haemolytic Activities and Mucin Degradation Ability

NSLAB strains were evaluated for DNAse and gelatinase activities according to Lavilla-Lerma et al. [16]. Mucin degradation ability was tested following the method reported by Muñoz-Atienza et al. [17]. Haemolytic activity was evaluated on blood agar plates containing sheep blood (Biolife, Milan, Italy) according to Pino et al. [18]. The haemolytic positive strains Streptococcus pyogenes ATCC 19,615 and Streptococcus pneumoniae ATCC 6303, cultured on Brain-Heart Infusion (BHI, Merck, Italy) at 37 °C under 5% of CO2, were used as positive controls.

2.3.2. Biogenic Amine Production

The ability of the strains to produce biogenic amines by amino acid decarboxylation was tested according to Bover-Cid and Holzapfel [19] using tyrosine (freebase), histidine monohydrochloride, ornithine monohydrochloride or lysine monohydrochloride as precursor amino acids. Plates without amino acids were used as controls. All amino acids were purchased from Sigma.

2.3.3. Antibiotic Susceptibility and Minimum Inhibitory Concentration Determination

NSLAB isolates were evaluated for antibiotic susceptibility according to breakpoints proposed by the European Food Safety Authority (EFSA) [20]. The minimum inhibitory concentration (MIC) was determined by micro-dilution method according to Russo et al. [21]. Strains showing MICs lower or higher than the EFSA’s breakpoints were considered as sensitive or resistant, respectively [20].

2.3.4. Genes for Virulence, Biogenic Amines, and Antibiotic Resistance

A PCR-based approach was applied to investigate the presence of gene encoding virulence factors, biogenic amines production, and antibiotic resistance as reported by Pino et al. [16]. The amplicons were separated by electrophoresis on 0.8 to 2.0% (w/v) agarose gels in 0.5× TAE buffer, and gels were stained in 0.5× TAE buffer using the GelRed® Nucleic Acid Gel Stain (Biotium, Fremont, CA, USA).

2.4. Technological Features

2.4.1. Salt Tolerance

The lactobacilli strains, fulfilling the aforementioned safety properties, were tested for the ability to grow in saline solutions containing 2, 6, and 10% (w/v) of NaCl as reported by Ferrari et al. [22].

2.4.2. Proteolytic and Lipolytic Activities, Exopolysaccharides and Diacetyl Production

Proteolytic and lipolytic activities were evaluated according to Meng et al. [1] using Plate Count Agar supplemented with 1% (w/v) skim milk powder (Oxoid, Milan, Italy) and Tributyrin Agar (Merck, France) media, respectively. Exopolysaccharides (EPS) production was tested on both MRS and mMRS, in which glucose was replaced by 10% of sucrose, following the method described by Meng and co-workers [1]. The NSLAB strains’ ability to produce diacetyl was evaluated according to Ribeiro et al. [23]. Diacetyl production was indicated by the formation of a red ring at the top of the tubes. Based on the presence and intensity of the red colour, the strains were scored as no (−), moderate (+), high (++), or strong (+++) diacetyl producers.

2.4.3. Acidifying Activity

To test acidifying activity, overnight cell cultures were grown in MRS broth at 37 °C, standardized to 9 log cfu/mL, and inoculated (2% v/v) into skim milk (Oxoid, Milan, Italy). The pH changes (ΔpH) were determined after 6–8 h of incubation at 37 °C using a pH meter (H19017, Microprocessor, Hanna Instruments, Ronchi di Villafranca Padovana, Italy).

2.4.4. Peptidase Activities

Aminopeptidase activities were evaluated on cell free extract (CFE) obtained from stationary phase cell cultures by lysozyme cell-lysis [24]. The p-nitroanilide (pNA) substrates Ala-pNA, Leu-pNA, Lys-pNA, Glu-pNA, and Pro-pNA were used according to González et al. [24]. One unit of aminopeptidase activity was considered as the enzyme amount able to determine an increase in absorbance of 0.001 units. Aminopeptidase activity was expressed as the number of activity units per milligram of protein per minute. The analyses were performed in triplicate and results are reported as mean and standard deviation.

2.5. Experimental Pilot Scale Cheese-Making

Two pilot-scale cheese-making trials, experimental (ECh) and control (CCh), were carried out in triplicate (three repetitions of each trial were conducted at different days) in a local dairy factory following the traditional cheese-making procedure and using 150 L of cow’s milk. The experimental Provola dei Nebrodi cheeses (ECh) were obtained by adding the Lacticaseibacillus paracasei PN 76 and the Limosilactobacillus fermentum PN 101 strains, which were selected based on safety and technological properties as previously described. The aforementioned stains, used as an adjunct culture at a cell density of 108 cfu/mL, were inoculated in a 1:1 ratio before milk coagulation. The control Provola dei Nebrodi cheeses (CCh) were obtained without any adjunct culture. Both experimental (ECh) and control (CCh) cheeses were collected at 0, 30 and 60 days of ripening and were subjected to microbiological and physico-chemical analyses. For each trial, samples were collected and analysed in triplicate.

2.6. Microbiological Analysis

A mixture of both core and surface sections (25 g) of the ECh or CCh samples at 0, 30, and 60 days of ripening were subjected to total mesophilic bacteria, lactic acid bacteria, Enterobacteria, lactococci, yeasts, Listeria spp., Escherichia coli, faecal coliforms and staphylococci counts following the method and using the culture media reported by Pino et al. [14]. In addition, Kanamycin Aesculin Azide agar (KAA), incubated under anaerobic conditions at 37 °C for 24–48 h, was used for enterococci count. All media were purchased from Oxoid (Basingstoke, UK).

2.7. Physico-Chemical Analysis

A mix of both core and surface cheese sections (100 g) of CCh or ECh samples at 0, 30 and 60 days of ripening were analysed for moisture, protein, fat, and salt content, using near-infrared spectroscopy in transmittance (FoodScanTM Dairy Analyser; FOSS, Hilleroed, Denmark). The ash content was determined following the Association of Official Analytical Chemists (AOAC) method (942.05 1942) [25]. In addition, the pH value of each sample was determined by pHmeter (H19017, Microprocessor, Hanna Instruments). Each analysis was conducted in triplicate and results are expressed in g/100 g of edible part. The analyses were performed at the Laboratory of the Animal Production Unit, Department of Veterinary Sciences, University of Messina, Italy.

2.8. Analysis of Volatile Organic Compounds (VOCs)

Four grams of grated cheese, supplemented with 10 µL of internal standard solution 4-methyl-2-pentanol (33 ppm) were placed into 20 mL glass vials and sealed with polytetrafluoroethylene (PTFE)-coated silicone rubber septa (20 mm diameter) (Supelco, Bellefonte, PA, USA). In order to obtain the best extraction efficiency, the micro-extraction procedure was performed as described by Delgado et al. [26], with slight modifications. At the end of sample equilibration (10 min at 50 °C), a conditioned 50/30 μm DVB/CAR/PDMS fibre (Supelco, Bellefonte, PA, USA) was exposed to headspace at the same temperature for 60 min to obtain VOC adsorption. To keep the temperature constant during analysis, the vials were maintained on a heater plate (CTC Analytics, Zwingen, Switzerland) and the extraction was carried out by a CombiPAL system injector autosampler (CTC Analytics). The extracted compounds were desorbed in splitless mode for 3 min at 220 °C and analysed by Clarus 680 (Perkien Elmer) gas-chromatography equipped with a capillary column Rtx-WAX column (30 m × 0.25 mm i.d., 0.25 μm film thickness) (Restek, Bellfonte, PA, USA). The column temperature was set initially at 35 °C for 8 min, then increased to 60 °C at 4 °C min−1, to 160 °C at 6 °C min−1 and finally to 200 °C at 20 °C min−1 and held for 15 min [27]. Helium was used as the carrier gas at a flow rate of 1 mL min−1. The analyses lasted for 50 min. The single quadrupole mass spectrometer Clarus SQ 8C (Perkien Elmer) was coupled to the gas chromatography system. The source and transfer line temperatures were kept at 250 and 230 °C, respectively. Electron ionisation masses were recorded at 70 eV, and the mass-to-charge ratio interval was 34 to 350 m/z. The GC-MS generated a chromatogram with peaks representing individual compounds. Each chromatogram was analysed for peak identification using the National Institute of Standard and Technology 2008 (NIST) library. A peak area threshold >1,000,000 and 85% or greater probability of match was used for VOC identification followed by manual visual inspection of the fragment patterns when required. The concentrations of VOCs, expressed as mg/kg, were calculated by using the internal standard.

2.9. Statistical Analysis

Acidifying activity, microbiological data, and VOC concentrations were subjected to ANOVA (one-way analysis of variance) followed by Tukey’s post-hoc test. Statistical analysis was performed using XLSTAT PRO 5.7 (Addinsoft, New York, NY, USA) setting the reference level of significance to 0.05 in all assays. In addition, VOC data were subjected to permutation analysis using PermutMatrixEN software (Montpellier, France).

3. Results

3.1. NSLAB Identification

Overall, 160 isolates were obtained and 121 of them were found to be Gram-positive, catalase-negative, rod or coccal in shape, non-motile, and unable to form spores. As reported in Figure 1, REP-PCR analysis coupled to MALDI-TOF MS allowed the classification of them into six species. Overall, the isolates were ascribed to Limosilactobacillus fermentum (55%), Enterococcus faecium (17%), Pediococcus pentosaceus (16%), Lacticaseibacillus paracasei (5%), Enterococcus faecalis (5%), and Lacticaseibacillus rhamnosus (2%) species.

3.2. Safety Properties

Ninety-five (95) isolates, with the exception of those belonging to E. faecium and E. faecalis species, not included in the qualified presumption of safety (QPS) list, were screened for safety requirements. None of the tested strains showed the ability to produce DNAse and gelatinase, to degrade the mucin, and to exert haemolytic activity. Three strains (PN 6, PN 51, and PN 18), ascribed to P. pentosaceus were able to produce biogenic amines (BA) by the decarboxylation of tyrosine. NSLABs were susceptible to tested antibiotics with the exception of P. pentosaceus PN 21, PN 29, PN 73, PN 96, PN 118, and PN 126 strains which exhibited, for both gentamicin and erythromycin, MIC values higher than the EFSA breakpoints (Table 1). The PCR-based approach revealed the presence of genetic determinants conferring resistance to gentamicin and erythromycin only for the isolates exhibiting MIC values higher than the EFSA breakpoints. In addition, none of the tested isolates carried genes encoding for virulence factors and amino acid decarboxylation.

3.3. Technological Features

3.3.1. Salt Tolerance

Sodium chloride tolerance exhibited by the tested NSLAB isolates is reported in Table 2. Overall, all stains were able to tolerate 2% of NaCl. The ability to grow in the presence of 6% of NaCl was exhibited by 70 strains (56 L. fermentum, 5 P. pentosaceus, 6 L. paracasei, and 3 L. rhamnosus), whereas 27 strains (20 L. fermentum, 5 L. paracasei, and 2 L. rhamnosus) tolerated a NaCl concentration of 10%.

3.3.2. Proteolytic and Lipolytic Activities, Exopolysaccharides and Diacetyl Production Abilities

Table 2 shows the extracellular proteolytic and lipolytic activities, exopolysaccharides (EPS) and diacetyl production abilities exhibited by the 86 tested NSLABs. Regarding proteolytic activity, 36 isolates (42%) showed transparent halo-forming colonies when grown on Plate Count Agar supplemented with 1% (w/v) skim milk powder. In particular, all the isolates ascribed to L. paracasei and L. rhamnosus species exhibited proteolytic activity, as well as 22 L. fermentum and 5 P. pentosaceus strains (Table 2). Lipolytic activity, assayed on tributyrin agar (TBA), was shown by 14 strains (16%). Among these, nine belonged to L. fermentum, three were ascribed to P. pentosaceus, and two were attributed to L. rhamnosus species. None of the L. paracasei isolates showed positive lipolytic capacity on the TBA medium. As reported in Table 2, 26 L. fermentum, 5 L. paracasei and 3 L. rhamnosus isolates were positive for EPS phenotypes, whereas none of the isolates ascribed to P. pentosaceus showed colonies with a slimy appearance. The ability to produce diacetyl from citrate was exhibited by 29 strains (34%) (Table 2). Among these, 22 L. fermentum, 5 L. paracasei and 2 L. rhamnosus isolates exhibited high or strong diacetyl-producing capabilities.

3.3.3. Acidifying Activity

The acidification activity of the isolates, selected based on the aforementioned technological properties, is reported in Figure 2. Overall, all the isolates showed slow acidification activity determining, after 6–8 h of incubation, a drop in pH values ranging from 0.24 to 0.75.

3.3.4. Peptidase Activities

Based on the aforementioned technological properties, 27 strains were tested for aminopeptidase activities, and results are reported in Table 3. Overall, the highest degree of aminopeptidase activity was recorded against the Lys-pNA substrate (range 120–0.42 activity units per milligram of protein per minute), whereas the lowest values were observed using the Ala-pNA substrate (range 2.29–0.16 activity units per milligram of protein per minute). All strains showed aminopeptidase activity towards the tested substrates with the exception of L. fermentum PN 135 and L. paracasei PN 105, which exhibited undetectable aminopeptidase activity towards both the Lys-pNA and the Glu-pNA substrates. L. fermentum PN 101 exhibited the highest aminopeptidase activity towards both Lys-pNA and Ala-pNA substrates, whereas the L. paracasei PN 76 stain appeared promising, showing the highest aminopeptidase activity toward both Leu-pNA and Pro-pNA substrates.

3.4. Microbiological Analysis of Control and Experimental Cheeses

Microbiological data of ECh and CCh cheese samples at 0, 30 and 60 days of ripening, expressed as average values and standard deviations, are reported in Table 4. Regarding ECh samples, mesophilic aerobic bacteria, lactic acid bacteria, and lactococci showed a decreasing trend throughout the ripening time with a reduction of about 1 log unit at 60 days of ripening. Enterobacteria, staphilococci, yeasts and enterococci exhibited a quite constant value up to 60 days of ripening. With regards to CCh samples, mesophilic aerobic bacteria, enterobacteria, and staphilococci showed a significant reduction at 60 days of ripening, whereas the number of lactobacilli, lactococci, yeasts, and enterococci revealed constant cell densities throughout the whole ripening time. Evaluating differences between ECh and CCh samples, statistical data revealed that the addition of adjunct cultures significantly influenced the level of lactobacilli and lactococci count, which showed, from the beginning of the ripening, higher values on ECh samples (Table 4). Moreover, the level of enterobacteria was significantly reduced by the addition of the adjunct cultures at both 0 and 30 days of ripening. Listeria spp., Escherichia coli and faecal coliforms were never detected in the analysed samples (Table 4).

3.5. Physico-Chemical Analysis

The physico-chemical composition of experimental (ECh) and control (CCh) cheese samples at 0, 30 and 60 days of ripening are reported in Table 5. Overall, at the same time of ripening, no significant differences were recorded among the analysed samples.

3.6. Volatile Organic Compounds (VOCs) Detection

The VOCs detected in ECh and CCh cheese samples at 0, 30, and 60 days of ripening are reported in Table 6. In addition, similarities in the observed metabolomics profiles between ECh and CCh samples, estimated using the PermutMatrixEN software, are displayed in Figure 3. Overall, the analysis allowed the identification of 51 compounds as alcohols, aldehydes, esters, ketones, organic acids, and terpenes. Organic acids represented the main VOCs detected, whereas aldehydes were the less abundant. Total VOCs exhibited a growing trend during the ripening time in all the analysed samples, reaching the highest value in ECh samples at 60 days of ripening (219.34 mg/kg). Focusing on each chemical class, statistically significant differences were recorded among samples. In particular, among organic acids, hexanoic acid, butanoic acid, acetic acid, propanoic acid, and pentanoic acid were detected at higher concentrations in ECh samples at 60 days of ripening. Similarly, among alcohols, phenylethyl alcohol, benzyl alcohol, and 2,3-butanediol were mainly detected in ECh samples at 60 days of ripening, whereas 3-methyl-1-butanol, 2-butanol, and 1-butanol reached the highest concentration in ECh samples, at both 30 and 60 days of ripening. Ethyl hexanoate, ethyl octanoate, ethyl butanoate, ethyl decanoate, and ethyl acetate were significantly different among ECh and CCh samples at both 30 and 60 days of ripening, whereas ethyl propanoate, 2-butanol acetate, phenylethyl acetate, and 3-methylbutyl butanoate were detected only in ECh samples at 30 and 60 days of ripening. Among ketones, 2-butanone, diacetyl, acetoin, and 2-undecanone were significantly different among ECh and CCh samples at 30 days of ripening. In addition, the aforementioned ketones were not detected in ECh samples at 60 days of ripening. Among terpenes, beta-pinene was revealed only in CCh samples at 0 and 30 days of ripening.

4. Discussion

It is already well established that selected NSLAB are mainly used as adjunct culture in cheese production for their ability to contribute to flavour development, affecting the sensorial characteristics of the final product [8,28,29,30]. The main metabolic activities, which contribute to cheese flavour development, are glycolysis, lipolysis, and proteolysis. In particular, catabolic products of proteolytic reactions represent the major metabolic pathway, which contribute to flavour development [29,30,31]. According to that, peptidase activity of lactobacilli has been widely investigated [29,30,32].
In the present study, 121 strains were considered LAB and only those with safety properties (86) were tested for technological features, showing a strain-dependent profile in accordance to previously reported data [33,34,35,36]. In addition, 27 selected strains were subjected to aminopeptidase tests such as the Pro-p-NA, which is related to the ability to release high quantities of proline from caseins during cheese ripening [37,38]; Pep L, Pep N, and Pep M, which, thanks to the release of amino acids in the cheese environment, serve as precursors of several flavour compounds [38,39]. The screening of the isolates allowed us to select the Lacticaseibacillus paracasei PN 76 and the Limosilactobacillus fermentum PN 101 strains as promising adjunct cultures in a pilot-scale cheese manufacture. In fact, as well as satisfying the safety requirements, both strains showed interesting technological properties (proteolytic activity, abilities to produce both exopolysaccharides and diacetyl). In addition, based on the peptidase activity, the L. fermentum PN 101 exhibited the highest aminopeptidase activity towards both Lys-pNA and Ala-pNA substrates, whereas the L. paracasei PN 76 strain showed the highest aminopeptidase activity toward both Leu-pNA and Pro-pNA substrates. As expected, physico-chemical compositions of both experimental and control cheeses were quite similar through ripening, while significant differences were revealed comparing the GC–MS profile. In fact, the experimental cheeses at 30 and 60 days of ripening revealed key flavour compounds which were not detected in the controls. Lipolysis of the triglycerides by indigenous milk lipase, microbial esterase, and enzymes from rennet mainly resulted in the production of medium-chain (hexanoic and octanoic acid) and long-chain free fatty acids (FFAs) [40]. In particular, the experimental cheeses exhibited high concentrations of hexanoic, butanoic, and acetic acids. Although lipoprotein lipase activity is of the utmost importance in cheese varieties made from raw milk, the presence of NSLAB enzymes over an extended period can lead to the liberation of significant FFA levels in cheese [40,41,42]. According to Stefanovic et al. [43], L. paracasei strains could contribute to the development and diversification of metabolites of lipid origin, such as long chain aldehydes, acids, ketones, and lactones. Among the aforementioned compounds, hexanoic acid, which generates popcorn, sharp, goaty, burnt, and waxy aromas [44,45], has previously been revealed in Pecorino Siciliano PDO cheese, Pecorino Crotonese, Grana Padano, Roncal, Caciocavallo Palermitano and Gouda-type cheeses [11,33,34,46,47,48,49,50] older than 60 ripening days. Similarly to other cheese types, such as Cheddar, Gruyère, Roncal, and Emmental [6,11,46,47,48,49,50], organic acids, important aromatic compounds, as well as precursors of methyl ketones, alcohols, lactones and esters, were the main detected VOCs. In addition, propanoic acid, with a typical vinegary odour, and pentanoic acid, responsible for rain, wood, vegetable, spicy, nutty, and grain aromas, were mainly identified in 60-day ripened experimental cheeses. Some differentiation in volatile profiles occurred based on differences in VOCs arising from FAA metabolism. It is interesting to note that the 3-methylbutanoic acid, a carboxylic acid characteristic of goat and sheep cheeses, appeared only in experimental cheeses. Notably, this organic acid, related to an extensive breakdown of proteins and probably derived from leucine catabolism, confers cheesy, sweaty, and very-ripened cheese aromas [6,11]. Similarly to other cheese-types, such as Parmigiano [50], Canestrato Pugliese cheese [51,52], Grana-type cheeses [50], Gouda-type cheese varieties [48], and other cheese varieties [53], esters were the second major class of detected VOCs. Esters confer sweet, fruity, and floral notes, and contribute to the aroma of cheese by reducing the sharpness and the bitterness perceptions provided by fatty acids and amines, respectively [11,54]. Regarding to the alcohol profile of experimental cheeses, both primary and secondary alcohols were detected similarly to other cheese types, such as Canestrato Pugliese [51,52], Cheddar [45], Manchego [55] and Roncal [56]. Particularly high level of 3-methyl 1-butanol, phenylethyl alcohol, and benzyl alcohol were detected in experimental cheese at 60 days of ripening. The 3-methyl 1-butanol, which confers an appreciated aroma of fresh cheese, often associated to a fruity perception [33,34], is considered an important contributor to overall flavour. This secondary alcohol is related to the degradation of branched-chain amino acids during cheese ripening, and its presence indicates the reduction of the aldehyde produced from leucine [11]. Regarding the ketones, it is interesting to note that this class of VOCs was revealed only in experimental cheeses. The FFAs’ contribution to cheese flavour is not only direct but also indirect, because they are precursors of methyl ketones and secondary alcohols [57]. Ketones derive from the β-oxidation of fatty acids and are normally present in dairy products. Among these, 2-butanone, responsible for butterscotch aromas and diacetyl were detected in experimental cheeses at high levels.

5. Conclusions

In conclusion, the screening of the autochthonous NSLABs, isolated from the Provola dei Nebrodi PDO cheese, based on technological and aminopeptidase properties, allowed the selection of the Lacticaseibacillus paracasei PN 76 and the Limosilactobacillus fermentum PN 101 strains as promising adjunct cultures. Their use in pilot-scale cheese-making trials highlighted a consistent influence on flavour development, starting from 30 days of ripening, contributing to the formation of key flavour compounds.

Author Contributions

Conceptualization, C.L.R., C.C. and A.P.; methodology, C.L.R., M.D.A., G.C., L.L. and K.V.H.; formal analysis, G.C., N.R., A.P., L.L. and K.V.H.; data curation, C.L.R., M.D.A., A.P. and L.L.; writing—original draft preparation, A.P., K.V.H. and L.L.; writing—review and editing, C.L.R., C.C., M.D.A. and V.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was partially supported by funding from the Ministero dell’Istruzione, dell’Università e della Ricerca, University of Catania (Italy), under the Piano della Ricerca PIA.CE.RI. 2020-2022 Linea 2—Progetto intradipartimentale RiDARE—Riduzione dell’Antibiotico-Resistenza e della Contaminazione Chimica degli Alimenti (RiDARE). Grant number: UPB 5A722192158.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors thank the Marlat s.r.l. dairy company (Messina, Italy) for guesting the pilot-scale cheese-making trials.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

CChcontrol cheese
CFEcell free extract
EChexperimental cheese
EPSexopolysaccharides
FFAsfree fatty acids
LABlactic acid bacteria
MALDI-TOF MSmatrix-assisted laser desorption/ionisation time-of-flight mass spectrometry
MICminimum inhibitory concentration
NSLABnon-starter LAB
PDOProtected Designation of Origin
PNProvola dei Nebrodi
pNAp-nitroanilide
QPSqualified presumption of safety
SLABstarter LAB
VOCsvolatile organic compounds

References

  1. Meng, Z.; Zhang, L.; Xin, L.; Lin, K.; Yi, H.; Han, X. Technological characterization of Lactobacillus in semihard artisanal goat cheeses from different Mediterranean areas for potential use as nonstarter lactic acid bacteria. J. Dairy Sci. 2018, 101, 2887–2896. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Carafa, I.; Nardin, T.; Larcher, R.; Viola, R.; Tuohy, K.; Franciosi, E. Identification and characterization of wild lactobacilli and pediococci from spontaneously fermented mountain cheese. Food Microbiol. 2015, 48, 123–132. [Google Scholar] [CrossRef] [PubMed]
  3. Di Grigoli, A.; Francesca, N.; Gaglio, R.; Guarrasi, V.; Moschetti, M.; Scatassa, M.L.; Settanni, L.; Bonanno, A. The influence of the wooden equipment employed for cheese manufacture on the characteristics of a traditional stretched cheese during ripening. Food Microbiol. 2015, 46, 81–91. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Khattab, A.R.; Guirguis, H.A.; Tawfik, S.M.; Farag, M.A. Cheese ripening: A review on modern technologies towards flavor enhancement, process acceleration and improved quality assessment. Trends Food Sci. Technol. 2019, 88, 343–360. [Google Scholar] [CrossRef]
  5. Beresford, T.P.; Fitzsimons, N.A.; Brennan, N.L.; Cogan, T.M. Recent advances in cheese microbiology. Int. Dairy J. 2001, 11, 259–274. [Google Scholar] [CrossRef]
  6. Yvon, M.; Rejien, L. Cheese flavour formation by amino acid catabolism. Int. Dairy J. 2001, 11, 185–201. [Google Scholar] [CrossRef]
  7. McSweeney, P.L.H.; Sousa, M.J. Biochemical pathways for the production of flavour compounds in cheeses during ripening. A review. Le Lait 2000, 80, 293–324. [Google Scholar] [CrossRef]
  8. Settanni, L.; Moschetti, G. Non-starter lactic acid bacteria used to improve cheese quality and provide health benefits. Food Microbiol. 2010, 27, 691–697. [Google Scholar] [CrossRef]
  9. Savijoki, K.; Ingmer, H.; Varmanen, P. Proteolytic systems of lactic acid bacteria. Appl. Microbiol. Biotechnol. 2006, 71, 394–406. [Google Scholar] [CrossRef]
  10. Čaplová, Z.; Pangallo, D.; Kraková, L.; Puškárová, A.; Drahovská, H.; Bučková, M.; Koreňová, J.; Kuchta, T. Detection of genes prtP, pepN, pepX and bcaT involved in formation of aroma-active compounds in lactic acid bacteria from ewes’ cheese. J. Food Nutr. Res. 2018, 57, 195–200. [Google Scholar]
  11. Curioni, P.M.G.; Bosset, J.O. Key odorants in various cheese types as determined by gas chromatography-olfactometry. Int. Dairy J. 2002, 12, 959–984. [Google Scholar] [CrossRef]
  12. Gobbetti, M.; De Angelis, M.; Di Cagno, R.; Mancini, L.; Fox, P.F. Pros and cons for using non-starter lactic acid bacteria (NSLAB) as secondary/adjunct starters for cheese ripening. Trends Food. Sci. Technol. 2015, 45, 167–178. [Google Scholar] [CrossRef]
  13. Pino, A.; Van Hoorde, K.; Pitino, I.; Russo, N.; Carpino, S.; Caggia, C.; Randazzo, C.L. Survival of potential probiotic lactobacilli used as adjunct cultures on Pecorino Siciliano cheese ripening and passage through the gastrointestinal tract of healthy volunteers. Int. J. Food Microbiol. 2017, 252, 42–52. [Google Scholar] [CrossRef] [PubMed]
  14. Pino, A.; Liotta, L.; Randazzo, C.L.; Todaro, A.; Mazzaglia, A.; De Nardo, F.; Chiofalo, V.; Caggia, C. Polyphasic approach to study physico-chemical, microbiological and sensorial characteristics of artisanal Nicastrese goat’s cheese. Food Microbiol. 2018, 70, 143–154. [Google Scholar] [CrossRef]
  15. Nguyen, T.L.D.; Van Hoorde, K.; Cnockaert, M.; De Brandt, E.; Aerts, M.; Le, B.T.; Vandamme, P. A description of the lactic acid bacteria microbiota associated with the production of traditional fermented vegetables in Vietnam. Int. J. Food Microbiol. 2013, 163, 19–27. [Google Scholar] [CrossRef] [PubMed]
  16. Pino, A.; Russo, N.; Van Hoorde, K.; De Angelis, M.; Sferrazzo, G.; Randazzo, C.L.; Caggia, C. Piacentinu Ennese PDO Cheese as Reservoir of Promising Probiotic Bacteria. Microorganisms 2019, 7, 254. [Google Scholar] [CrossRef] [Green Version]
  17. Muñoz-Atienza, E.; Gómez-Sala, B.; Araújo, C.; Campanero, C.; del Campo, R.; Hernández, P.E. Antimicrobial activity, antibiotic susceptibility and virulence factors of lactic acid bacteria of aquatic origin intended for use as probiotics in aquaculture. BMC Microbiol. 2013, 13, 15. [Google Scholar] [CrossRef] [Green Version]
  18. Pino, A.; Bartolo, E.; Caggia, C.; Cianci, A.; Randazzo, C.L. Detection of vaginal lactobacilli as probiotic candidates. Sci. Rep. 2019, 9, 3355. [Google Scholar] [CrossRef]
  19. Bover-Cid, S.; Holzapfel, W.H. Improved screening procedure for biogenic amine production by lactic acid bacteria. Int. J. Food Microbiol. 1999, 53, 33–41. [Google Scholar] [CrossRef]
  20. EFSA Panel on Additives and Products or Substances used in Animal Feed (FEEDAP). Guidance on the assessment of bacterial susceptibility to antimicrobials of human and veterinary importance. EFSA J. 2012, 10, 2740. [Google Scholar]
  21. Russo, N.; Caggia, C.; Pino, A.; Coque, T.M.; Arioli, S.; Randazzo, C.L. Enterococcus spp. in Ragusano PDO and Pecorino Siciliano cheese types: A snapshot of their antibiotic resistance distribution. Food Chem. Toxicol. 2018, 120, 277–286. [Google Scholar] [CrossRef] [PubMed]
  22. Ferrari, I.S.; de Souza, J.V.; Ramos, C.L.; da Costa, M.M.; Schwan, R.F.; Dias, F.S. Selection of autochthonous lactic acid bacteria from goat dairies and their addition to evaluate the inhibition of Salmonella typhi in artisanal cheese. Food Microbiol. 2016, 60, 29–38. [Google Scholar] [CrossRef] [PubMed]
  23. Ribeiro, S.C.; Coelho, M.C.; Todorov, S.D.; Franco, B.D.; Dapkevicius, M.L.; Silva, C.C. Technological properties of bacteriocin-producing lactic acid bacteria isolated from Pico cheese an artisanal cow’s milk cheese. J. Appl. Microbiol. 2014, 116, 573–585. [Google Scholar] [CrossRef] [PubMed]
  24. González, L.; Sacristán, N.; Arenas, R.; Fresno, J.M.; Tornadijo, E.M. Enzymatic activity of lactic acid bacteria (with antimicrobial properties) isolated from a traditional Spanish cheese. Food Microbiol. 2010, 27, 592–597. [Google Scholar] [CrossRef]
  25. Association of Official Analytical Chemists (AOAC). Official Methods of Analysis, 21st ed.; AOAC International: Gaithersburg, MD, USA, 2019. [Google Scholar]
  26. Delgado, F.J.; González-Crespo, J.; Cava, R.; Ramírez, R. Formation of the aroma of a raw goat milk cheese during maturation analysed by SPME–GC–MS. Food Chem. 2011, 129, 1156–1163. [Google Scholar] [CrossRef]
  27. Montemurro, M.; Celano, G.; De Angelis, M.; Gobbetti, M.; Rizzello, C.G.; Pontonio, E. Selection of non-Lactobacillus strains to be used as starters for sourdough fermentation. Food Microbiol. 2020, 90, 103491. [Google Scholar] [CrossRef]
  28. Sgarbi, E.; Lazzi, C.; Tabanelli, G.; Gatti, M.; Neviani, E.; Gardini, F. Nonstarter lactic acid bacteria volatilomes produced using cheese components. J. Dairy Sci. 2013, 96, 4223–4234. [Google Scholar] [CrossRef] [Green Version]
  29. Peralta, G.H.; Bergamini, C.V.; Wolf, I.V.; Perotti, M.C.; Hynes, E.R. Adjunct cultures from non-starter lactic acid bacteria. In Cheese Production, Consumption and Health Benefits; Henriques, M.H.F., Pereira, C.J.D., Eds.; Nova Science Publishers, Inc.: Hauppauge, NY, USA, 2017; Volume 1, pp. 39–96. [Google Scholar]
  30. Pintado, M.; Da Cruz, A.G.; De Sá, P.B.Z.R. Cheese microbiology. In Dairy Microbiology and Biochemistry: Recent Developments; Özer, B.H., Akdemir-Evrendilek, G., Eds.; CRC Press/Taylor & Francis: Boca Raton, FL, USA, 2014; Volume 1, pp. 113–133. [Google Scholar]
  31. Smit, G.; Smit, B.A.; Engels, W.J.M. Flavour formation by lactic acid bacteria and biochemical flavour profiling of cheese products. FEMS Microbiol. Rev. 2005, 29, 591–610. [Google Scholar] [CrossRef]
  32. Van Hoorde, K.; Van Landschoot, A. Application of adjunct-cultures and their influence on the sensory properties of hard and semi-hard cheese varieties. In Book on Beneficial Microbes in Fermented and Functional Foods; Rai, V.R., Bai, J.A., Eds.; CRC Press/Taylor & Francis Group: Boca Raton, FL, USA, 2014; pp. 531–550. [Google Scholar]
  33. Randazzo, C.L.; De Luca, S.; Todaro, A.; Restuccia, C.; Lanza, C.M.; Spagna, G.; Caggia, C. Preliminary characterization of wild lactic acid bacteria and their abilities to produce flflflavour compounds in ripened model cheese system. J. Appl. Microbiol. 2007, 103, 427–443. [Google Scholar] [CrossRef]
  34. Randazzo, C.L.; Pitino, I.; Ribbera, A.; Caggia, C. Pecorino Crotonese cheese: Study of bacterial population and flavour compounds. Food Microbiol. 2010, 27, 363–374. [Google Scholar] [CrossRef]
  35. Guarcello, R.; Carpino, S.; Gaglio, R.; Pino, A.; Rapisarda, T.; Caggia, C.; Marino, G.; Randazzo, C.L.; Settanni, L.; Todaro, M. A large factory-scale application of selected autochthonous lactic acid bacteria for PDO Pecorino Siciliano cheese production. Food Microbiol. 2016, 59, 66–75. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Carpino, S.; Randazzo, C.L.; Pino, A.; Russo, N.; Rapisarda, T.; Belvedere, G.; Caggia, C. Influence of PDO Ragusano cheese biofilm microbiota on flavour compounds formation. Food Microbiol. 2017, 61, 126–135. [Google Scholar] [CrossRef] [PubMed]
  37. Aquilanti, L.; Silvestri, G.; Zannini, E.; Osimani, A.; Santarelli, S.; Clementi, F. Phenotypic, genotypic and technological characterization of predominant lactic acid bacteria in Pecorino cheese from central Italy. J. Appl. Microbiol. 2007, 103, 948–960. [Google Scholar] [CrossRef] [PubMed]
  38. Nandan, A.; Nampoothiri, K.M. Therapeutic and biotechnological applications of substrate specific microbial aminopeptidases. Appl. Microbiol. Biotechnol. 2020, 28, 1–15. [Google Scholar] [CrossRef]
  39. Piraino, P.; Zotta, T.; Ricciardi, A.; McSweeney, P.L.H.; Parente, E. Acid production, proteolysis, autolytic and inhibitory properties of lactic acid bacteria isolated from pasta filata cheeses: A multivariate screening study. Int. Dairy J. 2008, 18, 81–92. [Google Scholar] [CrossRef]
  40. Collins, Y.F.; McSweeney, P.L.H.; Wilkinson, M.G. Lipolysis and free fatty acid catabolism in cheese: A review of current knowledge. Int. Dairy J. 2003, 13, 841–866. [Google Scholar] [CrossRef]
  41. Deeth, H.C. Lipoprotein lipase and lipolysis in milk. Int. Dairy J. 2006, 16, 555–562. [Google Scholar] [CrossRef]
  42. Thierry, A.; Collins, Y.F.; Abeijón Mukdsi, M.C.; McSweeney, P.L.H.; Wilkinson, M.G.; Spinnler, H.E. Lipolysis and Metabolism of Fatty Acids in Cheese. Cheese 2017, 423–444. [Google Scholar]
  43. Stefanovic, E.; Kilcawley, K.N.; Roces, C.; Rea, M.C.; O’sullivan, M.; Sheehan, J.J.; McAuliffe, O. Evaluation of the potential of Lactobacillus paracasei adjuncts for flavor compounds development and diversification in short-aged cheddar cheese. Front. Microbiol. 2018, 9, 1506. [Google Scholar] [CrossRef]
  44. Frank, D.C.; Owen, C.M.; Patterson, J. Solid phase microextraction (SPME) combined with gas chromatography and olfactometry—Mass spectrometry for characterization of cheese aroma compounds. LWT-Food Sci. Technol. 2004, 37, 139–154. [Google Scholar] [CrossRef]
  45. Drake, M.A.; Miracle, R.E.; McMahon, D.J. Impact of fat reduction on flavour and flavour chemistry of Cheddar cheeses. J. Dairy Sci. 2010, 93, 81. [Google Scholar] [CrossRef] [PubMed]
  46. Gaglio, R.; Franciosi, E.; Todaro, A.; Guarcello, R.; Alfeo, V.; Randazzo, C.L.; Settanni, L.; Todaro, M. Addition of selected starter/non-starter lactic acid bacterial inoculums to stabilise PDO Pecorino Siciliano cheese production. Food Res. Int. 2020, 136, 109335. [Google Scholar] [CrossRef] [PubMed]
  47. Guarrasi, V.; Sannino, C.; Moschetti, M.; Bonanno, A.; Di Grigoli, A.; Settanni, L. The individual contribution of starter and non-starter lactic acid bacteria to the volatile organic compound composition of Caciocavallo Palermitano cheese. Int. J. Food Microbiol. 2017, 259, 35–42. [Google Scholar] [CrossRef] [PubMed]
  48. Shiota, M.; Iwasawa, A.; Suzuki-Iwashima, A.; Iida, F. Effects of Flavor and Texture on the Sensory Perception of Gouda—Type Cheese Varieties during Ripening Using Multivariate Analysis. J. Food Sci. 2015, 80, 2740–2750. [Google Scholar] [CrossRef] [PubMed]
  49. Ercolini, D.; Frisso, G.; Mauriello, G.; Salvatore, F.; Coppola, S. Microbial diversity in natural whey cultures used for the production of Caciocavallo Silano PDO cheese. Int. J. Food Microbiol. 2008, 124, 164–170. [Google Scholar] [CrossRef]
  50. Bellesia, F.; Pinetti, A.; Pagnoni, U.G.; Rinaldi, R.; Zucchi, C.; Caglioti, L.; Palyi, G. Volatile components of Grana Parmigiano-Reggiano type hard cheese. Food Chem. 2003, 83, 55–61. [Google Scholar] [CrossRef]
  51. Di Cagno, R.; Banks, J.; Sheehan, L.; Fox, P.F.; Brechany, E.Y.; Corsetti, A.; Gobbetti, M. Comparison of the microbiological, compositional, biochemical, volatile profile and sensory characteristics of three Italian PDO ewes’ milk cheeses. Int. Dairy J. 2003, 13, 961–972. [Google Scholar] [CrossRef]
  52. Di Cagno, R.; Upadhyay, V.K.; McSweeney, P.L.H.; Corbo, M.R.; Faccia, M.; Gobbetti, M. Microbiological, compositional and biochemical characterisation of PDO Canestrato Pugliese cheese. Ital. J. Food Sci. 2004, 16, 45–58. [Google Scholar]
  53. Liu, S.Q.; Holland, R.; Crow, V.L. Esters and their biosynthesis in fermented dairy products: A review. Int. Dairy J. 2004, 14, 923–945. [Google Scholar] [CrossRef]
  54. Pinho, O.; Mendes, E.; Alves, M.M.; Ferreira, I.M.P.L.V.O. Chemical, Physical, and Sensorial Characteristics of “Terrincho” Ewe Cheese: Changes During Ripening and Intravarietal Comparison. J. Dairy Sci. 2004, 87, 249–257. [Google Scholar] [CrossRef] [Green Version]
  55. Fernández-García, E.; Serrano, C.; Nuñez, M. Volatile fraction and sensory characteristics of Manchego cheese. 2. Seasonal variation. J. Dairy Res. 2002, 69, 595–604. [Google Scholar] [CrossRef] [PubMed]
  56. Izco, J.M.; Torre, P. Characterisation of volatile flavour compounds in Roncal cheese extracted by the ‘purge and trap’ method and analysed by GC–MS. Food Chem. 2000, 70, 409–417. [Google Scholar] [CrossRef]
  57. Bertuzzi, A.S.; McSweeney, P.L.H.; Rea, M.C.; Kilcawley, K.N. Detection of Volatile Compounds of Cheese and Their Contribution to the Flavor Profile of Surface-Ripened Cheese. Compr. Rev. Food Sci. Food 2018, 17, 371–390. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. UPGMA dendrogram of the Rep-PCR and matrix-assisted laser desorption/ionisation time-of-flight mass spectrometry (MALDI-TOF MS) analyses of presumptive non-starter lactic acid bacteria (NSLAB) isolated from semi-hard Provola dei Nebrodi PDO (PN) cheese samples. Node values indicate the average percentage of similarity based on (GTG)5-PCR and MALDI-TOF MS profiles. The tree was made with BioNumerics version 5.1.
Figure 1. UPGMA dendrogram of the Rep-PCR and matrix-assisted laser desorption/ionisation time-of-flight mass spectrometry (MALDI-TOF MS) analyses of presumptive non-starter lactic acid bacteria (NSLAB) isolated from semi-hard Provola dei Nebrodi PDO (PN) cheese samples. Node values indicate the average percentage of similarity based on (GTG)5-PCR and MALDI-TOF MS profiles. The tree was made with BioNumerics version 5.1.
Microorganisms 09 00179 g001
Figure 2. Acidification activity of the selected NSLAB strains isolated from artisanal semi-hard Provola dei Nebrodi PDO cheese samples. Results are reported as mean and standard deviation of three replicates. For each species, bars with different lowercase letters (ae) are significantly different at p < 0.05.
Figure 2. Acidification activity of the selected NSLAB strains isolated from artisanal semi-hard Provola dei Nebrodi PDO cheese samples. Results are reported as mean and standard deviation of three replicates. For each species, bars with different lowercase letters (ae) are significantly different at p < 0.05.
Microorganisms 09 00179 g002
Figure 3. Grouping of samples based on the volatile organic compounds (VOCs) identified in experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening. The different batch of cheeses are indicated as I, II and III.
Figure 3. Grouping of samples based on the volatile organic compounds (VOCs) identified in experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening. The different batch of cheeses are indicated as I, II and III.
Microorganisms 09 00179 g003
Table 1. Minimum inhibitory concentration (MIC) values showed by NSLAB strains obtained from 60-day ripened Provola dei Nebrodi PDO cheese samples.
Table 1. Minimum inhibitory concentration (MIC) values showed by NSLAB strains obtained from 60-day ripened Provola dei Nebrodi PDO cheese samples.
AntimicrobialsSpecies
(No. of Tested Isolates)
Number of Strains which Showed the Indicated MIC Value (mg/L) aBreakpoints
(mg/L) b
0.060.120.250.512481632641282565121024
AmpicillinL. fermentum (67) 7132324 2
P. pentosaceus (16) 133 4
L. paracasei (6) 15 4
L. rhamnosus (3) 3 4
GentamicinL. fermentum (67) 151141 16
P. pentosaceus (16) 235 6 16
L. paracasei (6) 24 32
L. rhamnosus (3) 3 16
KanamycinL. fermentum (67) 321 43 32
P. pentosaceus (16) 610 64
L. paracasei (6) 6 64
L. rhamnosus (3) 3 64
StreptomycinL. fermentum (67) 13211815 64
P. pentosaceus (16) 16 64
L. paracasei (6) 15 64
L. rhamnosus (3) 12 32
ErythromycinL. fermentum (67)152128 1
P. pentosaceus (16) 46 2 4 1
L. paracasei (6) 42 1
L. rhamnosus (3) 21 1
ClindamycinL. fermentum (67) 1453 1
P. pentosaceus (16) 12 4 1
L. paracasei (6) 4 1
L. rhamnosus (3) 3 1
TetracyclineL. fermentum (67) 5116 8
P. pentosaceus (16) 16 8
L. paracasei (6) 6 4
L. rhamnosus (3) 3 8
ChloramphenicolL. fermentum (67) 5116 4
P. pentosaceus (16) 115 4
L. paracasei (6) 6 4
L. rhamnosus (3) 21 4
a MICs determined by micro-dilution method. b Breakpoints proposed by the European Food Safety Authority (EFSA). The following antibiotic dilution ranges were tested: 0.12–64 mg/L for ampicillin; 1–512 mg/L for gentamicin; 2–1024 for both kanamycin and streptomycin; 0.06–1 mg/L for erythromycin and clindamycin; 0.25–128 mg/L for tetracycline; 0.25–64 mg/L for chloramphenicol. Isolates with MICs higher than the EFSA breakpoints, indicated in bold, were considered as resistant.
Table 2. Salt tolerance, proteolytic and lipolytic activities, exopolysaccharides (EPS) and diacetyl production exhibited by the NSLAB strains isolated from artisanal semi-hard Provola dei Nebrodi PDO (PN) cheese samples.
Table 2. Salt tolerance, proteolytic and lipolytic activities, exopolysaccharides (EPS) and diacetyl production exhibited by the NSLAB strains isolated from artisanal semi-hard Provola dei Nebrodi PDO (PN) cheese samples.
SpeciesStrainsSalt Tolerance *Proteolytic Activity *Lipolytic Activity *EPS Production *Diacetyl Production **
2%6%10%
Limosilactobacillus fermentum (n = 67)PN 1; PN 3; PN 22; PN 26; PN 30; PN 31; PN 33; PN 34; PN 36; PN 44; PN 45; PN 56; PN 58; PN 61; PN 66; PN 70; PN 72; PN 75; PN 77; PN 85; PN 86; PN 87; PN 92; PN 97; PN 98; PN 103; PN 134; PN 137; PN 139; PN 150.++
PN 9; PN 23; PN 25; PN 35; PN 57; PN 62; PN 63; PN 78; PN 79; PN 80; PN 93: PN 100; PN 101; PN 113; PN 115; PN 135; PN 141; PN 151; PN 152; PN 157.+++++++
PN 15; PN 20; PN 27; PN 32; PN 67; PN 94; PN 117; PN 132; PN 133.++
PN 19; PN 38; PN 60; PN 74; PN 110; PN 114.+++
PN 81; PN 158.+++
Pediococcus penstosaceus (n = 10)PN 5; PN 53; PN 146.+++
PN 12; PN 109.++
PN 16; PN 106; PN 144; PN 148; PN 156.++
Lacticaseibacillus paracasei (n = 6)PN 7; PN 59; PN 76; PN 105; PN 145.++++++++
PN 49.+++
Lacticaseibacillus rhamnosus (n = 3)PN 14; PN 108.++++++++
PN 153.++++
* (+) positive reaction; (−) negative reaction. ** The strains were scored as no (−), moderate (+), high (++), or strong (+++) diacetyl producer.
Table 3. Peptidase activities of the NSLAB strains.
Table 3. Peptidase activities of the NSLAB strains.
SpeciesStrainPep NPep APep LPep MPep I
L. fermentumPN 976.77 c ± 0.540.16 hm ± 0.047.73 n ± 0.1419.23 j ± 0.1735.63 d ± 0.36
PN 2342.08 d ± 0.170.89 efg ± 0.070.25 q ± 0.0524.21 fg ± 0.1322.40 i ± 0.20
PN 250.5 l ± 0.122.29 a ± 0.0926.44 d ± 0.3327.74 d ± 0.2224.77 g ± 0.18
PN 350.50 l ± 0.060.70 eghim ± 0.0643.02 a ± 0.1423.57 fg ± 0.3220.18 k ± 0.13
PN 5710.63 j ± 0.480.75 eghm ± 0.0825.69 d ± 0.3126.37 e ± 0.2622.54 i ± 0.16
PN 6217.41 i ± 0.471.85 b ± 0.0914.11 j ± 0.1318.93 j ± 0.167.60 q ± 0.21
PN 6319.45 h ± 0.461.1 cf ± 0.1019.27 f ± 0.365.58 pq ± 0.1513.28 n ± 0.14
PN 780.4 7 l ± 0.121.28 c ± 0.1417.57 h ± 0.3518.37 j ± 0.1528.23 f ± 0.09
PN 7918.54 hi ± 0.380.70 eghim ± 0.0720.55 eg ± 0.377.71 n ± 0.1632.83 e ± 0.13
PN 806.52 k ± 0.291.85 b ± 0.105.95 a ± 0.0730.63 c ± 0.4416.87 m ± 0.26
PN 9330.67 e ± 0.451.43 cd ± 0.1010.68 lm ± 0.134.57 p ± 0.3618.25 l ± 0.22
PN 1000.49 l ± 0.070.79 eghm ± 0.1217.37 h ± 0.3521.42 h ± 0.2710.29 a ± 0.14
PN 101120.75 a ± 0.320.37 im ± 0.0530.64 b ± 0.3741.83 a ± 0.1739.63 b ± 0.23
PN 1130.48 l ± 0.070.71 eglm ± 0.1029.26 c ± 0.057.12 nq ± 0.1223.74 h ± 0.18
PN 1150.45 l ± 0.060.38 hm ± 0.0621.27 e ± 0.1616.72 k ± 0.1624.67 gh ± 0.27
PN 135NDND10.16 m ± 0.1124.51 f ± 0.238.97 p ± 0.18
PN 1410.46 l ± 0.070.67 eghm ± 0.0913.07 k ± 0.165.29 pq ± 0.2337.63 c ± 0.34
PN 1510.44 l ± 0.060.66 ghm ± 0.1013.22 j ± 0.1616.65 k ± 0.1420.37 jk ± 0.27
PN 1520.46 l ± 0.160.64 ghm ± 0.0619.57 fg ± 0.1315.07 l ± 0.169.21 p ± 0.16
PN 1570.42 l ± 0.041.68 bd ± 0.100.85 pq ± 0.0914.74 l ± 0.1719.69 k ± 0.26
L. paracaseiPN 70.45 l ± 0.061.19 ce ± 0.067.58 n ± 0.346.14 oq ± 0.1421.30 j ± 0.25
PN 5926.54 g ± 0.450.88 efg ± 0.0811.57 l ± 0.289.42 m ± 0.2019.51 k ± 0.20
PN 7696.65 b ± 0.340.48 hilnop ± 0.0743.37 a ± 0.2133.54 b ± 0.3347.61 a ± 0.22
PN 105NDND0.25 q ± 0.0819.63 j ± 0.3117.69 lm ± 0.17
PN 14529.32 f ± 0.230.44 mn ± 0.0530.90 b ± 0.156.61 no ± 0.3613.66 n ±0.18
L. rhamnosusPN 140.44 l ± 0.070.83 efo ± 0.097.75 n ± 0.1723.20 g ± 0.1817.78 lm ± 0.19
PN 1080.76 l ± 0.070.39 mp ± 0.071.50 p ± 0.306.58 noq ± 0.216.48 r ± 0.22
ND: not detected. Results are reported as mean and standard deviation of three replicates. Aminopeptidase activity was expressed as the number of activity units per milligram of protein per minute. One unit of aminopeptidase activity was considered as the enzyme amount able to determine an increase in absorbance of 0.001 units. Different letters (a–p) in the same column indicate significant differences by one-way ANOVA test, followed by Tukey’s post-hoc test (p < 0.05).
Table 4. Microbial counts expressed as log10 cfu/mL and standard deviation (SD) of the main microbial groups detected in experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening.
Table 4. Microbial counts expressed as log10 cfu/mL and standard deviation (SD) of the main microbial groups detected in experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening.
MediaEChCCh
0306003060
PCA9.50 d ± 0.148.93 c ± 0.078.63 bc ± 0.088.34 b ± 0.058.84 c ± 0.077.96 a ± 0.10
MRS9.29 c ± 0.078.77 b ± 0.148.74 b ± 0.067.80 a ± 0.057.88 a ± 0.107.63 a ± 0.09
VRBA *1.19 ab ± 0.111.36 b ± 0.091.04 a ± 0.071.73 c ± 0.071.85 c ± 0.091.09 ab ± 0.08
M179.23 d ± 0.068.87 c ± 0.098.13 b ± 0.067.72 a ± 0.077.84 a ± 0.077.60 a ± 0.10
SDA2.86 b ± 0.072.30 a ± 0.132.27 a ± 0.072.32 a ± 0.082.26 a ± 0.072.18 a ± 0.07
MSA1.64 b ± 0.101.13 a ± 0.091.04 a ± 0.072.29 c ± 0.121.24 a ± 0.061.03 a ± 0.09
KAA5.23 a ± 0.095.38 a ± 0.115.31 a ± 0.065.26 a ± 0.105.34 a ± 0.095.28 a ± 0.06
* incubated at 37 °C. Plate Count Agar (PCA), de Man Rogosa and Sharpe (MRS), Violet Red Bile Agar (VRBA), M17 Agar (M17), Sabouraud dextrose agar (SDA), Mannitol salt agar (MSA), Kanamycin Aesculin Azide agar (KAA). Different lowercase letters (a–d) in the same row, indicate a significant difference among experimental (ECh) or control (CCh) cheese samples at p < 0.05 (ANOVA with Tukey’s post-hoc test).
Table 5. Physico-chemical characteristics of experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening.
Table 5. Physico-chemical characteristics of experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening.
ParametersEChCCh
0306003060
pH5.65 b ± 0.025.52 b ± 0.015.43 a ± 0.085.81 b ± 0.035.66 a ± 0.015.48 a ± 0.10
Moisture44.81 c ± 0.1540.76 b ± 0.0334.58 a ± 0.0544.25 c ± 0.1240.88 b ± 1.0934.86 a ± 1.29
Protein26.98 a ± 0.2228.66 a ± 0.0830.08 b ± 0.0627.25 a ± 0.1428.34 a ± 0.4429.80 a ± 0.59
Fat23.56 a ± 0.1125.78 a ± 0.0330.03 b ± 0.0423.62 a ± 0.1925.90 a ± 0.3429.90 b ± 0.70
Salt1.54 a ± 0.202.01 b ± 0.021.83 b ± 0.011.40 a ± 0.042.04 b ± 0.031.91 b ± 0.02
Ash2.89 a ± 0.282.88 a ± 0.033.33 b ± 0.012.78 a ± 0.032.70 a ± 0.073.47 b ± 0.08
Different lowercase letters (a–c) in the same row, indicate a significant difference among experimental (ECh) or control (CCh) cheese samples at p < 0.05 (ANOVA with Tukey’s post-hoc test).
Table 6. Volatile organic compounds (VOCs) (mg/kg) identified in experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening. Data are the means and standard deviations of three independent experiments analysed in duplicate.
Table 6. Volatile organic compounds (VOCs) (mg/kg) identified in experimental (ECh) and control (CCh) cheeses at 0, 30 and 60 days of ripening. Data are the means and standard deviations of three independent experiments analysed in duplicate.
Cheese Samples
VOCsEChCCh
0306003060
Organic acids
Hexanoic acid5.67 d ± 0.00717.23 c ± 2.61649.67 a ± 3.7149.61 d ± 0.66215.37 c ± 0.55636.65 b ± 1.647
Butanoic acid2.14 d ± 0.00711.70 c ± 1.68038.21 a ± 2.4544.53 d ± 0.3639.07 c ± 0.59720.17 b ± 0.950
Octanoic acid2.04 c ± 0.1446.02 b ± 0.96018.62 a ± 3.1023.68 bc ± 0.2715.44 bc ± 0.13520.62 a ± 0.596
Acetic acid0.59 d ± 0.0955.00 bc ± 0.90418.49 a ± 2.2211.59 d ± 0.1652.75 cd ± 0.1177.27 b ± 0.800
n-Decanoic acid0.89 b ± 0.0632.57 b ± 0.4218.10 a ± 1.8091.21 b ± 0.0751.91 b ± 0.1697.63 a ± 0.341
Propanoic acidND0.74 b ± 0.3871.91 a ± 0.868ND0.03 b ± 0.0050.39 b ± 0.010
Nonanoic acid0.10 c ± 0.0520.38 bc ± 0.1330.79 a ± 0.0080.25 c ± 0.0150.71 ab ± 0.2870.83 a ± 0.032
Heptanoic acid0.07 c ± 0.0020.23 b ± 0.0430.72 a ± 0.1090.16 c ± 0.02 b0.24 b ± 0.0060.81 a ± 0.053
3-Methylbutanoic acid0.01 a ± 0.0070.57 a ± 0.5161.44 a ± 1.342ND0.04 a ± 0.006ND
Pentanoic acid0.06 d ± 0.0020.26 c ± 0.0410.76 a ± 0.0490.09 d ± 0.0030.21 c ± 0.0200.47 b ± 0.016
Dodecanoic acid0.07 b ± 0.0070.19 b ± 0.0270.65 a ± 0.1620.10 b ± 0.0060.12 b ± 0.0040.69 a ± 0.058
9-Decenoic acid0.07 b ± 0.0110.21 b ± 0.0350.69 a ± 0.1790.09 b ± 0.0120.13 b ± 0.0090.62 a ± 0.012
Alcohols
Ethanol0.30 b ± 0.0681.30 b ± 0.1304.58 a ± 0.8120.71 b ± 0.0540.37 b ± 0.0167.80 a ± 0.970
3-Methyl-1-butanol0.15 d ± 0.0261.12 b ± 0.3152.76 a ± 0.8000.24 cd ± 0.0040.23 cd ± 0.0260.15 d ± 0.046
Phenylethyl alcohol0.20 b ± 0.0181.21 ab ± 0.9472.36 a ± 1.4700.19 b ± 0.0060.24 b ± 0.0010.35 b ± 0.007
Benzyl alcohol0.12 b ± 0.0180.32 b ± 0.0441.14 a ± 0.4230.17 b ± 0.0480.37 b ± 0.1110.44 b ± 0.090
2-ButanolND0.07 c ± 0.0030.15 b ± 0.009ND0.18 a ± 0.0130.06 c ± 0.002
1-ButanolND0.07 c ± 0.0060.17 a ± 0.010ND0.02 d ± 0.0020.11 b ± 0.007
2,3-ButanediolND0.04 c ± 0.0080.19 a ± 0.030NDND0.07 b ± 0.007
1-Hexanol0.01 e ± 0.0060.03 c ± 0.0000.08 b ± 0.0090.02 de ± 0.0010.02 cd ± 0.0020.12 a ± 0.002
Phenol0.01 a ± 0.0070.01 a ± 0.013ND0.01 a ± 0.0060.01 a ± 0.010ND
Esters
Ethyl hexanoate0.11 d ± 0.01210.12 c ± 1.03334.23 a ± 4.7900.47 d ± 0.0391.47 d ± 0.13919.8 b ± 0.682
Ethyl octanoate0.08 d ± 0.0023.98 c ± 0.02314.14 a ± 0.5230.14 d ± 0.0140.52 d ± 0.0029.31 b ± 0.808
Ethyl butanoate0.03 d ± 0.0020.65 c ± 0.0495.16 a ± 0.0440.06 d ± 0.0020.14 d ± 0.0182.12 b ± 0.286
Ethyl decanoate0.04 d ± 0.0030.57 c ± 0.0302.74 a ± 0.0810.04 d ± 0.0010.07 d ± 0.0031.65 b ± 0.171
Propyl hexanoateND0.68 b ± 0.0062.08 a ± 0.180ND0.02 c ± 0.0050.69 b ± 0.042
Ethyl acetate0.07 c ± 0.0210.50 b ± 0.0081.14 a ± 0.1970.05 c ± 0.0050.05 c ± 0.0070.16 c ± 0.010
Ethyl n-dodecanoateND0.26 c ± 0.0150.90 a ± 0.100NDND0.57 b ± 0.044
Ethyl propanoateND0.33 b ± 0.0161.06 a ± 0.135NDNDND
3-Methylbutyl acetateND0.40 b ± 0.1770.76 a ± 0.131NDND0.22 b ± 0.038
Ethyl hexanoateND0.15 c ± 0.0030.58 a ± 0.023NDND0.39 b ± 0.045
2-Butanol acetateND0.26 b ± 0.0260.56 a ± 0.010NDNDND
Propyl octanoateND0.12 c ± 0.0060.46 a ± 0.011NDND0.21 b ± 0.004
Methyl isobutyrateND0.03 c ± 0.0000.37 a ± 0.029NDND0.23 b ± 0.022
Ethyl 9-decenoateND0.07 c ± 0.0080.34 a ± 0.016NDND0.18 b ± 0.018
Phenylethyl acetate0.01 a ± 0.0070.15 a ± 0.1020.14 a ± 0.105NDNDND
Ethyl nonanoateND0.0 c ± 0.0050.14 a ± 0.001NDND0.07 b ± 0.011
Ethyl pentanoateND0.01 b ± 0.0120.10 a ± 0.007NDND0.08 c ± 0.007
Propyl decanoateND0.02 c ± 0.0010.08 a ± 0.013NDND0.05 b ± 0.000
3-Methylbutyl butanoateND0.02 a ± 0.0150.07 a ± 0.072NDNDND
Ketones
2-ButanoneND0.10 b ± 0.0160.30 a ± 0.059ND0.21 c ± 0.039ND
DiacetylND0.59 b ± 0.031.42 a ± 0.280ND0.16 c ± 0.160ND
Acetoin0.10 c ± 0.0180.24 b ± 0.0480.59 a ± 0.0640.04 c ± 0.0080.48 a ± 0.073ND
2-Nonanone0.04 b ± 0.0020.07 b ± 0.0180.41 a ± 0.2910.11 ab ± 0.0280.41 a ± 0.0010.03 b ± 0.030
2-Heptanone0.04 b ± 0.0090.04 b ± 0.0020.39 a ± 0.194NDNDND
2-UndecanoneND0.01 c ± 0.0090.04 a ± 0.0030.01 c ± 0.0050.03 b ± 0.002ND
Aldehydes
Hexanal0.05 a ± 0.012NDND0.03 b ± 0.001NDND
BenzaldehydeND0.03 b ± 0.0140.07 a ± 0.001NDNDND
Terpenes
beta-PineneNDNDND0.11 a ± 0.0080.05 b ± 0.004ND
d-Limonene0.23 cd ± 0.0920.27 c ± 0.1090.16 cd ± 0.0051.53 a ± 0.0341.15 b ± 0.1280.04 d ± 0.039
Others
6-Pentyl-2H-pyran-2-one0.03 cd ± 0.0030.05 c ± 0.0120.15 a ± 0.020.04 d ± 0.0010.05 c ± 0.0070.10 b ± 0.001
a–e: values in the same line with different superscript letters differ significantly (p < 0.05) based on one-way ANOVA followed by Tukey’s post-hoc tests. ND not detected.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Randazzo, C.L.; Liotta, L.; Angelis, M.D.; Celano, G.; Russo, N.; Hoorde, K.V.; Chiofalo, V.; Pino, A.; Caggia, C. Adjunct Culture of Non-Starter Lactic Acid Bacteria for the Production of Provola Dei Nebrodi PDO Cheese: In Vitro Screening and Pilot-Scale Cheese-Making. Microorganisms 2021, 9, 179. https://doi.org/10.3390/microorganisms9010179

AMA Style

Randazzo CL, Liotta L, Angelis MD, Celano G, Russo N, Hoorde KV, Chiofalo V, Pino A, Caggia C. Adjunct Culture of Non-Starter Lactic Acid Bacteria for the Production of Provola Dei Nebrodi PDO Cheese: In Vitro Screening and Pilot-Scale Cheese-Making. Microorganisms. 2021; 9(1):179. https://doi.org/10.3390/microorganisms9010179

Chicago/Turabian Style

Randazzo, Cinzia Lucia, Luigi Liotta, Maria De Angelis, Giuseppe Celano, Nunziatina Russo, Koenraad Van Hoorde, Vincenzo Chiofalo, Alessandra Pino, and Cinzia Caggia. 2021. "Adjunct Culture of Non-Starter Lactic Acid Bacteria for the Production of Provola Dei Nebrodi PDO Cheese: In Vitro Screening and Pilot-Scale Cheese-Making" Microorganisms 9, no. 1: 179. https://doi.org/10.3390/microorganisms9010179

APA Style

Randazzo, C. L., Liotta, L., Angelis, M. D., Celano, G., Russo, N., Hoorde, K. V., Chiofalo, V., Pino, A., & Caggia, C. (2021). Adjunct Culture of Non-Starter Lactic Acid Bacteria for the Production of Provola Dei Nebrodi PDO Cheese: In Vitro Screening and Pilot-Scale Cheese-Making. Microorganisms, 9(1), 179. https://doi.org/10.3390/microorganisms9010179

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop