Next Article in Journal
Real Time Multipurpose Smart Waste Classification Model for Efficient Recycling in Smart Cities Using Multilayer Convolutional Neural Network and Perceptron
Previous Article in Journal
Arc-Induced Long-Period Fiber Gratings at INESC TEC. Part I: Fabrication, Characterization and Mechanisms of Formation
Previous Article in Special Issue
AI-Driven Framework for Recognition of Guava Plant Diseases through Machine Learning from DSLR Camera Sensor Based High Resolution Imagery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Recording the Presence of Peanibacillus larvae larvae Colonies on MYPGP Substrates Using a Multi-Sensor Array Based on Solid-State Gas Sensors

1
Department of Poultry Science and Apiculture, Faculty of Animal Bioengineering, University of Warmia and Mazury in Olsztyn, Sloneczna 48, 10-957 Olsztyn, Poland
2
Faculty of Mathematics and Computer Science, University of Warmia and Mazury in Olsztyn, 10-719 Olsztyn, Poland
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(14), 4917; https://doi.org/10.3390/s21144917
Submission received: 26 May 2021 / Revised: 9 July 2021 / Accepted: 11 July 2021 / Published: 19 July 2021

Abstract

:
American foulbrood is a dangerous disease of bee broods found worldwide, caused by the Paenibacillus larvae larvae L. bacterium. In an experiment, the possibility of detecting colonies of this bacterium on MYPGP substrates (which contains yeast extract, Mueller-Hinton broth, glucose, K2HPO4, sodium pyruvate, and agar) was tested using a prototype of a multi-sensor recorder of the MCA-8 sensor signal with a matrix of six semiconductors: TGS 823, TGS 826, TGS 832, TGS 2600, TGS 2602, and TGS 2603 from Figaro. Two twin prototypes of the MCA-8 measurement device, M1 and M2, were used in the study. Each prototype was attached to two laboratory test chambers: a wooden one and a polystyrene one. For the experiment, the strain used was P. l. larvae ATCC 9545, ERIC I. On MYPGP medium, often used for laboratory diagnosis of American foulbrood, this bacterium produces small, transparent, smooth, and shiny colonies. Gas samples from over culture media of one- and two-day-old foulbrood P. l. larvae (with no colonies visible to the naked eye) and from over culture media older than 2 days (with visible bacterial colonies) were examined. In addition, the air from empty chambers was tested. The measurement time was 20 min, including a 10-min testing exposure phase and a 10-min sensor regeneration phase. The results were analyzed in two variants: without baseline correction and with baseline correction. We tested 14 classifiers and found that a prototype of a multi-sensor recorder of the MCA-8 sensor signal was capable of detecting colonies of P. l. larvae on MYPGP substrate with a 97% efficiency and could distinguish between MYPGP substrates with 1–2 days of culture, and substrates with older cultures. The efficacy of copies of the prototypes M1 and M2 was shown to differ slightly. The weighted method with Canberra metrics (Canberra.811) and kNN with Canberra and Manhattan metrics (Canberra. 1nn and manhattan.1nn) proved to be the most effective classifiers.

1. Introduction

Semiconductor gas sensors (MOS) allow for the qualitative and quantitative identification of a gas or gas mixture due to the formation of a non-specific oxidation reaction of reducing gases adsorbed on the sensory layer. Then, on this layer, resistance changes occur, which can be converted into digital information expressed in volts [1,2].The MOS are low-cost and readily available, work in real-time, and provide an immediate score. Additionally, they show high sensitivity at the parts per million level. A set of semiconductor sensors was successfully applied as an electronic nose matrix that can recognize simple and complex odors [3,4].
The effectiveness of disease detection using an electronic nose has been scientifically proven many times. These devices are used in the diagnosis of plant [5], animal [6], and human [7] diseases. The most dangerous disease that plagues the honey bee is varroosis. It was shown that a matrix of six semiconductor gas sensors can distinguish bee colonies heavily infected with Varroa destructor from healthy ones [8], and this allows for the diagnosis of varroosis based on the examination of brood samples infected with this mite [9]. Another dangerous disease of bees is American foulbrood (AFB), caused by the Paenibacillus larvae larvae L. bacterium. This bacterium is a Gram-positive rod with dimensions of 0.5 and 1.5–6.0 m.
This bacterium produces endospores that are resistant to external environmental factors; therefore, its ability to infect may remain for over 30 years [10]. American foulbrood manifests in the dying out and rotting of bee larvae and pre-pupa in comb cells under the sealings. Consequently, this disease leads to the weakening of the colony and its death [11,12]. American foulbrood is recorded worldwide [13], and since it is considered very contagious, it is combated ex officio in most countries [14]. The symptoms of the disease are visible to the naked eye. Unfortunately, they are rarely noticed by the beekeeper in the early stages, and they are similar to the symptoms of other diseases affecting bee broods.
Therefore, laboratory diagnostics are essential. P. l. larvae in culturing on various media are colorless, transparent, and gray-white colonies; on agar with the addition of blood, they become mucoid non-hemolytic [15]. The appearance of bacterial colonies is not sufficient to identify the species of the pathogen that created them. Identification with labor-intensive chemical methods is necessary [15]. The primary structure of DNA allows for the distinction of five ERIC I–V genotypes, of which ERIC I and ERICII are most often found in infectious material [16].
In a rotting brood, a mixture of valeric, isocaproic, and caproic acids forms [17]. This results in a specific odor emitted by a bee colony with American foulbrood, which is perceptible even with a human nose [18]. Therefore, it seems reasonable to use an electronic nose for American foulbrood detection. We conducted field tests and analyzed the results. The high efficiency of a multi-sensor device in the detection of this disease in bee colonies was reported by a team of scientists from Australia [19].
The question we addressed in this study was whether an electronic nose can detect the presence of AFB-causing bacteria. The purpose of the experiment was, therefore, to determine to what extent and at what stage of multiplication of P. l. larvae on MYPGP agar (which contains yeast extract, Mueller-Hinton broth, glucose, K2HPO4, sodium pyruvate, and agar) the semiconductor sensors of volatile organic compounds can detect colonies of this bacterium.

2. Materials and Methods

The experiment was conducted at the Bee Products Quality Monitoring and Safety Laboratory of the Apiculture Division of the University of Warmia and Mazury in Olsztyn (Poland). A prototype of a multi-sensor recorder of the MCA-8 sensor signal with a matrix of six semiconductor gas sensors, created in the Laboratory of Sensor Technique and Indoor Air Quality Studies, Wroclaw University of Science and Technology, Poland, was tested. This device was created as part of the research project entitled “Development of innovative, intelligent tools monitoring the presence of American foulbrood and an increased level of Varroa destructor infestation in honeybee colonies”. Thus, by default, the task of this electronic nose is to monitor the most dangerous diseases affecting bees.

2.1. Construction and Mechanism of the MCA-8 Device’s Operation

The device uses semiconductor sensors from Figaro: TGS823, TGS826, TGS832, TGS2600, TGS2602, and TGS2603 (Table 1).
MCA-8 has eight inlets and one outlet channel. The gas flow is forced by a software-controlled diaphragm pump. Each sensor is placed in its aluminum chamber so that the sample of the gas taken flows through all of them in sequence. This causes a voltage change on the surface of each sensor. In effect, measurement data arise that reflect a medium voltage registered on the sensor within 1 s before saving and sending the measurement result. The MCA-8 device can save data on the SD card and upload it to an external server (Figure 1).

2.2. Construction of the Measuring Stand

Two twin copies of the prototype of the MCA-8 measuring device were used in the study. The first device was named M1, and the second was named M2. Each prototype was attached with polyethylene (PE) tubes into the two test chambers with dimensions of 32 × 22 × 32 cm 3 . These tubes served as pre-sampling probes and provided a gas sample from the chamber to the MCA-8 prototype device through a specific channel number. Every two days, the channel number controlled by the software was changed, and then a tube was reattached to the next selected device channel.
A filter composed of a mixture of cellulose ester (MCE 13 mm, 0.45 microns) was always located in the gas flow from the chamber to the device prototype. The chambers were composed of plexiglass. One chamber was lined with a wooden insert and the second with a polystyrene inserts. The inserts were used to reflect the conditions of the wooden and polystyrene hive because such materials are most often used in hives in beekeeping (Figure 2).

2.3. Preparation of Material for Research

The P.l. larvae ATCC 9545, ERIC I strain was used for the experiment. To identify the microbiological material obtained on the MYPGP media after culturing, MALDI-TOF-MS [20] testing was performed. The obtained spectrum confirmed that the examined bacterial colonies were the cultured strain of P. l. larvae ATCC 9545, ERIC I (Figure 3).
The bacteria culture was performed twice. In total, 64 Petri dishes with MYPGP media (which contains yeast extract, Mueller-Hinton broth, glucose, K2HPO4, sodium pyruvate, and agar) were used, with 32 plates used at once. After culturing, the plates were incubated in an incubator at 37 C. Placing the cultured plates in the incubator was considered day 0. Beginning the next day, on the first day of the experiment, three or four plates were selected daily from the incubator for the next ten days and they were examined with the MCA-8 device on the described laboratory stand.
No bacterial colonies were observed on plates with for the first 2 days of culture. Colonies visible to the naked eye already developed on the plates with the 3 day culture. The colonies were 1–3 mm in diameter; with a smooth, shiny, and slimy consistency; and regular shape. Due to their colorlessness, they appeared transparent P.l. larvae (Figure 4).

2.4. Decision Classes

We tested gas samples from above the media with the culture of one- and two-day-old P. l. larvae (class 23) and with visible bacterial colonies (cultures older than 2 days (class 24)). High-class numbers indicate laboratory research covering many different objects concerning living in a hive environment. The lower-class numbers were reserved for other objects. Air from an empty test chamber (class 1) was used as a control. Table 2 shows how many objects were located in a specific attribute and variant.

2.5. Measurement Process

For classes 23 and 24, the examination of the sample consisted of placing a Petri dish with the contents in a wooden or polystyrene chamber under the outlets of two pipes sucking in gas to both MCA-8 devices (Figure 5).
Both devices were set simultaneously for 10 min. This time was called the exposure phase. Then, the device entered a regeneration phase for 10 min. This phase consisted of suction of clean air through channel 8 from outside the chamber through a carbon filter. In the case of class 1, the procedure was the same, only the chambers were empty. A single measurement resulted in 1200 sensor readings registered every second, of which the first 600 readings corresponded to the exposure phase and the other 600 to the regeneration phase. As shown in the example in Figure 6, the sensor readings stabilized after the first minute of device operation. The tests were carried out at 21 C.

2.6. The Analyzed Variable

The analyzed variable was the response of the sensor at the selected time point of sample exposure to differential baseline corrections. Therefore, the following were selected for analysis: the value from 270 s of sensor readings from the measurement of a sample with baseline correction by subtracting these reading values from the last 600 s of the surrounding air measurement.

2.7. Visualization of the Tested Classes

First, the obtained mean sensor readings were visualized using radial charts. As such, images of the sensor matrix were obtained for individual devices and classes regarding both variants. To achieve our goal, we normalized the values of the TGS attributes to a range of [0, 1] using Equation (1). Normalization of T G S i ( o b j ) (the ith descriptor of the jth object into the [ a , b ] interval) consisted of the following step:
T G S i ( o b j ) = ( T G S i ( o b j ) m i n T G S i ) ( b a ) m a x T G S i m i n T G S i + a .
Then, we calculated the average values in the classes for the individual TGS attributes—see Equation (2)—and squared the obtained values using Equation (3), which means that a step was being taken.
a v e r a g e ( T G S i c l a s s j ) = k = 0 | c l a s s j | T G S j ( o b l ) , w h e r e o b l c l a s s j
a v e r a g e ( T G S i c l a s s j ) = a v e r a g e ( T G S i c l a s s j ) 2 .

2.7.1. Image of the Sensors Matrix of the M1 Device

Through visualization of the average reading intensity of the TGS sensors, an image of the sensors matrix was obtained. With the M1 device, the lowest readings were obtained by the sensors when measuring the empty chamber. All TGSs obtained average values did not exceed 0.1 V. Higher average sensor readings were observed for class 23 than for class 24. The highest values, both for the wooden chamber and the polystyrene chamber, were obtained from sensors TGS2602 and TGS2603, which were close to 0.45 V (Figure 7).

2.7.2. Image of the Sensor Matrix of the M2 Device

The M2 device in a wooden chamber produced average readings in four cases of sensors for class 23 that were lower than for class 24. TGS2603 in class 23 was more sensitive (above 0.45 V) than in class 24 (below 0.4 V) (Figure 8).
The low sensitivity showed by the device was due to the M2 sensor TGS826, which, in both types, produced class 23 readings similar to those for class 1 (0.05 V). In class 24 for all cases, this sensor produced a higher average reading because it fit between 0.1 and 0.15 V (Figure 8); however, it was much less than those produced by the M1 device on M1, where for both chambers, the readings fit between 0.25 and 0.3 V (Figure 7). The average readings of other sensors for M2 device were higher and more similar to the readings obtained by the M1 device.

2.8. Brief Approach to the Methods

The aim of this work was to construct a simple and effective classification technique to address the problem under investigation. To achieve this goal, we needed to design a classifier for a numeric decision system with small unbalanced decision classes that characterized the data being studied. We decided to choose the most natural problem-solving techniques, including the k nearest neighbour method (see [21]), the naïve Bayes method (see [21]), and our own weighted voting technique Algorithm 811 (see [21]).
The research was conducted using the cross-industry standard process for data mining (CRISP-DM) methodology. We used a range of metrics in these methods. Studies with dedicated methods were conducted according to the Monte Carlo cross-validation (MCCV) model, using the same subsets of data for all techniques studied. To correctly estimate the effectiveness of unbalanced data, we used balanced accuracy (the equivalent of the recall parameter) and the true positive rate (the equivalent of the precision parameter). Where more than two classes were classified, each of these parameters was calculated separately for each class.
Balanced accuracy is the average accuracy of the classification from all decision classes, whereas the accuracy of classification of a given test class is understood as the percentage of correctly classified objects in that class. The true positive rate is the percentage of objects of a given class positively classified in relation to all objects classified in that class. The coverage parameter is the percentage of classified objects. In our case, it was always equal to one; in other words, each test object was classified.
Next, we provide a more detailed discussion of the methodology used.

Summary of the Classifiers

The options we tested were canberra.1nn, canberra.2nn, canberra.3nn, canberra.811, eps = 0.01.nb, euclidean.1nn, euclidean.2nn, euclidean.3nn, euclidean.811, manhattan.1nn, manhattan.2nn, manhattan.3nn, manhattan.811, and nb.num. In this subsection, we discuss the general outline of each of these options. We provide a detailed description of our kNN classifier variant (canberra.1nn, canberra.2nn, canberra.3nn, euclidean.1nn, euclidean.2nn, euclidean.3nn, manhattan.1nn, manhattan.2nn, and manhattan.3nn).
Classification involves voting for the k nearest objects from each decision class. Consider the training decision system ( U t r n , T G S , c l a s s ) and the test decision system ( U t s t , T G S , c l a s s ) as inputs, where T G S is a set of conditional attributes and c l a s s is the decision attribute. The classification of test objects using the training objects was performed as follows: For all conditional attributes t g s T G S , training objects v U t r n , and test objects u U t s t , we computed weights w ( u , v ) based on the selected metric. The metrics used in the kNN method are shown in Table 3.
Classification was based on the summed weight of the k nearest objects of each decision class.
For a general perspective of the Bayes classifier, please see cf., Mitchell [22], Devroye et al. [23], and Duda et al. [24]. The naïve Bayes classifier owes its naivety epithet to one assuming the independence of attributes; in reality, this condition is not often met. Its working in the realm of decision systems can be described concisely as follows: For a given training decision system ( U t r n , T G S , c l a s s ) and a test system ( U t s t , T G S , c l a s s ) , where U = U t r n U t s t is the set of objects, T G S = { t g s 1 , t g s 2 , , t g s n } is the conditional attribute set, and c l a s s C L A S S = { c l a s s 1 , c l a s s 2 , , c l a s s k } is the decision attribute. The classification of a test object v U t s t , described using its information set ( t g s 1 ( v ) , t g s 2 ( v ) , , t g s n ( v ) ) , consists of computing, for all decision classes, the value of the parameter
P ( c l a s s = c l a s s i | b 1 = t g s 1 ( v ) , b 2 = t g s 2 ( v ) , , b n = t g s n ( v ) ) ,
and the decision on v is the decision value with the maximal value of the parameter. In practice, we can use partial estimation
P ( b m = t g s m ( v ) | c l a s s = c l a s s i ) =
number of test instances b m = t g s m ( v ) in training class c l a s s i cardinality of class c l a s s i .
Each decision class is voted by submitting the value of the parameter
P a r a m c l a s s = c l a s s i = P ( c l a s s = c l a s s i ) m = 1 n P ( b m = t g s m ( v ) | c l a s s = c l a s s i ) .
This classifier was fit for symbolic attributes. The method was used on numerical data in variant (eps = 0.01.nb) by applying the descriptors’ indiscernibility degree (eps parameter).
The last algorithm 811 is based on the weighted voting idea. In variants canberra.811, euclidean.811, and manhattan.811, we used the appropriate metrics (Table 3) Considering the distance between objects as
w ( u , v ) = i = 1 6 ] | T G S i ( u ) T G S i ( v ) | m a x t r a i n i n g s e t T G S i m i n t r a i n i n g s e t T G S i .
m a x t r a i n i n g s e t T G S i and m i n t r a i n i n g s e t T G S i are the largest and smallest values, respectively, of the given conditional attribute. Classification by this method consists of calculating the following parameter for each decision class of the training system:
P a r a m c l a s s j = w ( u , v ) , v c l a s s j | c l a s s j | .

3. A Few General Statements about the Experiments

In the following sections, we present the results of our research into the classification of classes 1, 23, and 24 in the context of a multi-class problem, and the binary classification using the one vs. one (one class vs. another class) and one vs. other (one class vs. other classes) strategy. We considered the test options mentioned above:
  • M1 device in a wooden chamber, and
  • M1 device in a polystyrene chamber,
as well as similar options for the M2 device.

4. Results for the Configuration One vs. Other

4.1. Analysis of the Results of the 5 × MCCV-5 Validation Tests in the Comparison: Specific one vs. Other (Class vs. other Classes): Choosing the Most Effective Classification Method

The highest values for accclass, tprclass, and accbalanced obtained in tests in the comparison class vs. other classes as well the classifiers that enabled obtaining these values are presented in Table 4, Table 5 and Table 6.
The canberra.811 test was the most effective classifier, providing the highest results in terms of accclass, tprclass, and accbalanced parameters in 11 cases out of 41. The following tests also performed well: canberra.1nn and euclidean.811 (seven cases with the highest parameters each). However, the nb.num test never provided the highest value (Table 7).

4.2. Results for the Configuration One vs. Other, canberra.811

With the canberra.811 method, class 1, i.e., empty chamber, was well-recognized by both devices, where most parameter values for the canberra.811 test were above 0.7. In both cases, tpr1 was lower: for M1, it was 0.661 for the wooden chamber; and for M2, it was 0.590 for the polystyrene chamber (Table 8).
For class 23 (MYPGP media with cultured bacteria but with no visible colonies), the results of canberra.811 were not satisfactory. For the two devices, a very low tpr23 was obtained: 0.2 and lower (Table 8).
For class 24, high acc24, tpr24, and accbalanced values of 0.7 or higher were obtained by both M1 and M2 devices. Only accbalanced for M2 polystyrene chamber was lower at 0.681 (Table 8), but this value is satisfactory.

5. Results of One vs. One

5.1. Results for the Configuration 23 vs. 24, manhattan.1nn

In classification with model 5 × MCCV-5 for classes 23 and 24, the tpr24 was the most satisfactory with the manhattan.1nn method (Table 9). Observing the results of the manhattan.1nn method in configuration 23 vs. 24, we found that the M1 device in a polystyrene chamber produced satisfactory separability of both classes. In the wooden chamber, a very low tpr23 was obtained, accompanied by an accbalanced below 0.6. In the case of the M2 device, we concluded that both classes were perfectly separable, and the M2 device achieved an excellent distinction between the MYPGP media with the culture of P. l. larvae without colonies and the MYPGP media with colonies of this bacteria (Table 9).

5.2. Results for the Configuration 1 vs. 23, canberra.811

The results of the analyses in configuration 1 vs. 23 were not indicative of the best classifier, as many methods obtained excellent separability parameters for both classes. The effectiveness of the canberra.811 method is demonstrated in Table 10. The separability of both classes was at a high level and ranged from 85% for device M1 in a wooden chamber to 100% for device M2 in a polystyrene chamber (Table 10).

5.3. Results for the Configuration 1 vs. 24, canberra.1nn

The comparison of class 1 data vs. class 24 data in the 5 × MCCV-5 validation tests provided satisfactory separability results for both classes. Most of the classifiers worked perfectly with all variants. Table 11 shows the results of tprclass and accbalanced for the canberra.1nn method. From the results, the tprclass in all variants was very high, always over 0.9 (Table 11).

5.4. Discussion

Prompt classification of pathogenic microorganisms is essential for effective disease treatment. To date, numerous complicated and time-consuming methods have been used in microbiological diagnostics [25,26]. Due to the complexity of metabolic processes, bacteria produce a series of volatile compounds (VCs) [27,28,29,30,31]. Therefore, the use of an e-nose based on gas sensors appears to be a potential method that overcomes these drawbacks [32,33].
The amount and composition of volatile compounds depend on both the medium on which the bacteria develop [34] and the species of the microorganism [35,36]. The detection of pathogenic bacteria and their identification with an e-nose can be successfully achieved in both the infected in organisms (in vivo) [33] and in laboratories (in vitro) [32].
Different types of sensors may be applied here. The performance of coated porphyrin and quartz sensors with a gas microbalance was analyzed by [37], who found that these sensors can distinguish the VCs produced by 12 microorganisms in vitro, as well as being able to classify the bacteria as Gram-positive or negative. An electronic nose, Cyranose 320, based on thirty-two polymer carbon black composite sensors can detect six species of bacteria causing eye infections with 98% efficiency [38].
Semiconductor gas sensors (MOS) have also been used in the detection and identification of bacteria [33]; by examining the bacterial biofilm on dental plaque with a matrix of six sensors of the TGS series, these sensors were able to recognize teeth and mouth diseases [32]. An e-nose based on a matrix of 28 semiconductor sensors was able to recognize pneumonia in people infected with Pseudomonas aeruginosa with 92% efficiency. Listeria monocytogenes and Bacillus cereus bacteria incubated in Tryptic soy broth (TSB) were identified by a set of metal oxide sensors with 98% efficiency [35].
Staphylococcus carnosus, Staphylococcus xylosus, Staphylococcus saprophyticus, Staphylococcus warneri, Staphylococcus epidermidis, Staphylococcus aureus, and Micrococcus varians were classified by an e-nose with a six-sensor TGSXXX matrix with 90.5% efficiency. The satisfactory results in identifying microbes that were obtained by other researchers indicate the research direction related to MCA-8 device testing. As this e-nose is intended to be used for the diagnosis of bee diseases in the future, it should also be proven in the detection of P. l. larvae bacteria that are more dangerous to bee brood. The most frequently isolated infected larvae ERIC I strain was selected for this research [39].
Many researchers, when verifying the effectiveness of e-noses in detecting bacteria, relied on one device only. In our experiment, gas from above the tested object was directed into two twin MCA-8 devices specified as M1 and M2 simultaneously. This enabled the comparison of their sensor matrix images as well as their effectiveness. Even though each MCA-8 device had a set of the same sensors, we could immediately observe that the images from each matrix appeared different. Visual comparison of mean readings for individual TGS sensors in individual classes using radial graphs showed that classes are distinguishable within the M1 and M2 devices, but they do not indicate a general rule applicable to both devices.
Thus, M1 produces a different image of the sensor matrix than M2 on the tested gas. These results of our experiment confirm there are no identical sensors with repeatable readings. This problem is called sensor drift [40] and each device requires an individual approach to calibration, for example, by using an appropriate algorithm [41].
The images of the matrix of the sensor readings obtained for the wooden and polystyrene chambers were visually similar. The raw data used for the analyses were subjected to differential baseline correction. Baseline correction has been recommended by many researchers [42,43,44,45]. Improvement in classification efficiency is the aim of such a correction. It is especially justified under changing environmental conditions. In our case, the experiment was conducted under stable laboratory conditions. However, in the final analyses, applying a baseline correction improved the results.
The variant of the multi-class classification in the MCCV-5 model does not provide a clear answer as to which method can guarantee the most accurate classification of the tested objects. However, class 23 was the hardest to separate; in most cases, it was not possible at all. Classes 1 and 24 were easier to separate.
In the next step, the results of the 5 × MCCV-5 validation classification in the one vs. other (specific class vs. other classes) configuration were validated. The summary of the highest parameter values of class separability obtained by specific classifiers allowed us to select the canberra.811method as the best. However, it did not always produce satisfying results in our experiements. A very low tpr23, below 0.3 for the M1 device was observed.
In connection with the unfavorable separability of class 23, the results of 5 × MCCV-5 validation in the one vs. one configuration (class vs. other class) were also examined. First, the data of class 23 vs. class 24 were checked. We used 15 classifiers, and the manhattan.1nn classifier was found to be the most accurate. With this classifier, the M1 device in the wooden chamber could not detect the MYPGP media with culture but with no colonies (accuracy level 14%), and in the polystyrene chamber, the detection level was very low (42%) (Table 9). In contrast, the M1 device was excellent at detecting P. l. larvae colonies on the MYPGP media. In the wooden chamber, the effectiveness was 0.81%, and in the polystyrene chamber, 0.85%.
The M2 device in the configuration of classes (23 vs. 24) was more accurate because it was effective in detecting both the first and the second class. The detection over MYPGP media with no bacteria colonies in the wooden chamber was 66% effective, and in the polystyrene, it was 70% effective. The P. l. larvae bacteria colonies in the both chambers were recognized by the M2 device with an efficiency of 88% (Table 9).
Therefore, we identified the problem of the lack of class 23 separability in the polystyrene chamber with the M1 device; we then decided to compare data of this class vs. class 1 data. The 5 × MCCV-5 validation results in this class configuration resulted in perfect class 23 separability. Such effects were obtained by most of the classifiers. Based on the canberra.811 method, we found that the M1 device detected class-assigned objects with over 85% efficiency, and the M2 device, with an accuracy of 100% in almost every case (Table 10).
To complete the analyses, a study was performed in the configuration of class 1 vs. class 24. With the use of superior classifiers, the 5 × MCCV-5 validation results were favorable. Using the example of the canberra.1nn method, we observed that the M1 device could recognize an empty wooden chamber with an accuracy of 81%, and a polystyrene one with an accuracy of 100%. The recognition of the P. l. larvae bacterial colony through this device remained at the level of 91% in the wooden chamber and 100% in the polystyrene chamber (Table 11).
The M2 device was even more effective in detecting an empty chamber. The result for the wooden chamber was 97% and 100% for polystyrene. Colonies of P. l. larvae bacteria were recognized by the M2 device in the wooden chamber with 99% efficiency, and in a polystyrene chamber with 96% efficiency (Table 11).
The experiment, therefore, showed that P. l. larvae colonies on the MYPGP medium in laboratory conditions can be easily detected by our MCA-8 prototype of a multi-sensor recorder of sensor signals. We can expect average effectiveness of more than 97%. Comparing the results obtained in the in vitro detection of bacteria by other researchers [35,36], who tested e-noses based on the same sensors as MCA-8, the results of the experiment can be considered excellent. It is clear, that the laboratory results presented here are for a highly simplified laboratory model. Therefore, our team also tested three specimens of the MCA-8 device under live bee colony conditions. The results and conclusions from these tests will be presented in the next publication. The multi-sensor recorder used in our experiment in earlier studies perfectly detected bee broods strongly infected with the dangerous parasitic mite Varroa destructor. This indicates that our e-nose has considerable potential to be applied in the detection of bacteria that are dangerous to bees and, therefore, the diseases caused by them.

6. Conclusions

(1)
The P.l. larvae colonies on MYPGP media were detected by the MCA-8 prototype of a multi-sensor recorder of the sensor with 97% efficiency.
(2)
Objects, such as an empty wooden chamber, an empty polystyrene chamber, MYPGP media with 1–2 days’ bacteria culture (no visible colonies), and MYPGP media with visible P.l. larvae colonies were distinguished by the MCA-8 device.
(3)
The M1 unit of the MCA-8 device was slightly less effective in object detection than the M2 unit.
(4)
A different average image obtained by the matrices of the sensors used was generated by each unit of a prototype of a multi-sensor recorder of the MCA-8 sensor signal.
(5)
The environment of the tested object did not significantly influence the effectiveness of the MCA-8 device. The results of the recognizability of the examined objects were satisfactory and comparable for both the wooden and polystyrene chambers.
(6)
The most effective classifiers proved to be: weighted method with Canberra metric (canberra.811) and kNN with the Canberra and Manhattan metric (canberra. 1nn and manhattan.1nn).
(7)
When applying the 5 × MCCV-5 quality classification model, the best results were obtained in the one vs. one binary classification variant.

Author Contributions

Conceptualization, B.B. and J.W. (Jakub Wilk); methodology, B.B., J.W. (Jakub Wilk) and P.A.; software, B.B., J.W. (Jakub Wilk) and P.A.; validation, B.B., J.W. (Jerzy Wilde), J.W. (Jakub Wilk) and P.A.; formal analysis, B.B., J.W. (Jakub Wilk) and P.A.; investigation, B.B. and J.W. (Jakub Wilk); resources, B.B., J.W. (Jakub Wilk) and J.W. (Jerzy Wilde); data curation, B.B. and J.W. (Jakub Wilk); writing—original draft preparation, B.B. and P.A.; writing—review and editing, J.W. (Jakub Wilk) and J.W. (Jerzy Wilde); visualization, B.B.; supervision, J.W. (Jerzy Wilde) and B.B.; project administration, J.W. (Jerzy Wilde) and B.B.; funding acquisition, J.W. (Jerzy Wilde) and B.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Centre for Research and Development under grant N BIOSTRATEG3/343779/10/NCBR/2017.

Acknowledgments

We thank Andrzej Oponowicz for helping to prepare the data.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Francioso, L. 5—Chemiresistor gas sensors using semiconductor metal oxides. In Nanosensors for Chemical and Biological Applications; Honeychurch, K.C., Ed.; Woodhead Publishing: Sawston, UK, 2014; pp. 101–124. [Google Scholar] [CrossRef]
  2. Zhang, J.; Qin, Z.; Zeng, D.; Xie, C. Metal-oxide-semiconductor based gas sensors: Screening, preparation, and integration. Phys. Chem. Chem. Phys. 2017, 19, 6313–6329. [Google Scholar] [CrossRef]
  3. Dey, A. Semiconductor metal oxide gas sensors: A review. Mater. Sci. Eng. B 2018, 229, 206–217. [Google Scholar] [CrossRef]
  4. Gardner, J.W.; Bartlett, P.N. A brief history of electronic noses. Sensors Actuators B Chem. 1994, 18, 210–211. [Google Scholar] [CrossRef]
  5. Ghaffari, R.; Zhang, F.; Iliescu, D.; Hines, E.; Leeson, M.; Napier, R.; Clarkson, J. Early detection of diseases in tomato crops: An electronic nose and intelligent systems approach. In Proceedings of the 2010 International Joint Conference on Neural Networks (IJCNN), Barcelona, Spain, 18–23 July 2010. [Google Scholar] [CrossRef]
  6. Wilson, A.D. Applications of Electronic-Nose Technologies for Noninvasive Early Detection of Plant, Animal and Human Diseases. Chemosensors 2018, 6, 45. [Google Scholar] [CrossRef] [Green Version]
  7. Ryabtsev, S.; Shaposhnick, A.; Lukin, A.; Domashevskaya, E. Application of semiconductor gas sensors for medical diagnostics. Sens. Actuators B Chem. 1999, 59, 26–29. [Google Scholar] [CrossRef]
  8. Szczurek, A.; Maciejewska, M.; Bak, B.; Wilk, J.; Wilde, J.; Siuda, M. Gas Sensor Array and Classifiers as a Means of Varroosis Detection. Sensors 2019, 20, 117. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Ba̧k, B.; Wilk, J.; Artiemjew, P.; Wilde, J.; Siuda, M. Diagnosis of Varroosis Based on Bee Brood Samples Testing with Use of Semiconductor Gas Sensors. Sensors 2020, 20, 4014. [Google Scholar] [CrossRef]
  10. Ebeling, J.; Knispel, H.; Hertlein, G.; Fünfhaus, A.; Genersch, E. Biology of Paenibacillus larvae, a deadly pathogen of honey bee larvae. Appl. Microbiol. Biotechnol. 2016, 100, 7387–7395. [Google Scholar] [CrossRef] [PubMed]
  11. Ellis, J.D.; Munn, P.A. The worldwide health status of honey bees. Bee World 2005, 86, 88–101. [Google Scholar] [CrossRef]
  12. Lindström, A. Distribution of Paenibacillus larvae spores among adult honey bees (Apis mellifera) and the relationship with clinical symptoms of American foulbrood. Microb. Ecol. 2008, 56, 253–259. [Google Scholar] [CrossRef]
  13. Genersch, E. American Foulbrood in honeybees and its causative agent, Paenibacillus larvae. J. Invertebr. Pathol. 2010, 103, S10–S19. [Google Scholar] [CrossRef]
  14. Djukic, M.; Brzuszkiewicz, E.; Fünfhaus, A.; Voss, J.; Gollnow, K.; Poppinga, L.; Liesegang, H.; Garcia-Gonzalez, E.; Genersch, E.; Daniel, R. How to Kill the Honey Bee Larva: Genomic Potential and Virulence Mechanisms of Paenibacillus larvae. PLoS ONE 2014, 9, e90914. [Google Scholar] [CrossRef]
  15. De Graaf, D.C.; Alippi, A.M.; Antúnez, K.; Aronstein, K.A.; Budge, G.; De Koker, D.; De Smet, L.; Dingman, D.W.; Evans, J.D.; Foster, L.J.; et al. Standard methods for American foulbrood research. J. Apic. Res. 2013, 52, 1–23. [Google Scholar] [CrossRef] [Green Version]
  16. Beims, H.; Bunk, B.; Erler, S.; Mohr, K.I.; Spröer, C.; Pradella, S.; Günther, G.; Rohde, M.; von der Ohe, W.; Steinert, M. Discovery of Paenibacillus larvae ERIC V: Phenotypic and genomic comparison to genotypes ERIC I-IV reveal different inventories of virulence factors which correlate with epidemiological prevalences of American Foulbrood. Int. J. Med. Microbiol. 2020, 310, 151394. [Google Scholar] [CrossRef] [PubMed]
  17. Gochnauer, T.A.; Shearer, D. Volatile Acids from Honeybee Larvae Infected with Bacillus Larvae and from a Culture of the Organism. J. Apic. Res. 1981, 20, 104–109. [Google Scholar] [CrossRef]
  18. Lee, S.; Lim, S.; Choi, Y.S.; lyeol Lee, M.; Kwon, H.W. Volatile disease markers of American foulbrood-infected larvae in Apis mellifera. J. Insect Physiol. 2020, 122, 104040. [Google Scholar] [CrossRef]
  19. Moran, J.; Melonek, J.; Purino, G.; Leyland, D.; Small, D.I.; Grassl, J. Towards an Electronic Nose for American Foulbrood. 2019. Available online: https://www.researchgate.net/publication/330410354_Towards_an_Electronic_Nose_for_American_Foulbrood (accessed on 15 July 2021).
  20. Schäfer, M.O.; Genersch, E.; Fünfhaus, A.; Poppinga, L.; Formella, N.; Bettin, B.; Karger, A. Rapid identification of differentially virulent genotypes of Paenibacillus larvae, the causative organism of American foulbrood of honey bees, by whole cell MALDI-TOF mass spectrometry. Vet. Microbiol. 2014, 170, 291–297. [Google Scholar] [CrossRef] [PubMed]
  21. Polkowski, L.; Artiemjew, P. Granular Computing in Decision Approximation; Springer International Publishing: New York, NY, USA, 2015. [Google Scholar] [CrossRef]
  22. Mitchell, T.M. Machine Learning; McGraw-Hill: New York, NY, USA, 1997. [Google Scholar]
  23. Devroye, L.; Györfi, L.; Lugosi, G. A Probabilistic Theory of Pattern Recognition; Springer: New York, NY, USA, 1996. [Google Scholar]
  24. Duda, R.O.; Hart, P.E. Pattern Classification and Scene Analysis; John Willey & Sons: New York, NY, USA, 1973. [Google Scholar]
  25. Busse, H.J.; Denner, E.B.; Lubitz, W. Classification and identification of bacteria: Current approaches to an old problem. Overview of methods used in bacterial systematics. J. Biotechnol. 1996, 47, 3–38. [Google Scholar] [CrossRef]
  26. Bullock, N.O.; Aslanzadeh, J. Biochemical profile-based microbial identification systems. In Advanced Techniques in Diagnostic Microbiology; Springer US: New York, NY, USA, 2013; Volume 9781461439707, pp. 87–121._6. [Google Scholar] [CrossRef]
  27. Citron, C.A.; Rabe, P.; Dickschat, J.S. The scent of bacteria: Headspace analysis for the discovery of natural products. J. Nat. Prod. 2012, 75, 1765–1776. [Google Scholar] [CrossRef]
  28. Nalik, H.P.; Muller, K.D.; Ansorg, R. Rapid identification of Legionella species from a single colony by gas-liquid chromatography with trimethylsulphonium hydroxide for transesterification. J. Med. Microbiol. 1992, 36, 371–376. [Google Scholar] [CrossRef]
  29. Kai, M.; Haustein, M.; Molina, F.; Petri, A.; Scholz, B.; Piechulla, B. MINI-REVIEW Bacterial volatiles and their action potential. Appl. Microbiol. Biotechnol. 2009, 81, 1001–1012. [Google Scholar] [CrossRef]
  30. Elgaali, H.; Hamilton-Kemp, T.R.; Newman, M.C.; Collins, R.W.; Yu, K.; Archbold, D.D. Comparison of long-chain alcohols and other volatile compounds emitted from food-borne and related Gram positive and Gram negative bacteria. J. Basic Microbiol. 2002, 42, 373–380. [Google Scholar] [CrossRef]
  31. Carrol, W.; Lenney, W.; Wang, T.; Španěl, P.; Alcock, A.; Smith, D. Detection of volatile compounds emitted by Pseudomonas aeruginosa using selected ion flow tube mass spectrometry. Pediatr. Pulmonol. 2005, 39, 452–456. [Google Scholar] [CrossRef]
  32. Liao, Y.H.; Shih, C.H.; Abbod, M.F.; Shieh, J.S.; Hsiao, Y.J. Development of an E-nose system using machine learning methods to predict ventilator-associated pneumonia. Microsyst. Technol. 2020. [Google Scholar] [CrossRef]
  33. Astuti, S.D.; Mukhammad, Y.; Duli, S.A.J.; Putra, A.P.; Setiawatie, E.M.; Triyana, K. Gas sensor array system properties for detecting bacterial biofilms. J. Med. Signals Sens. 2019, 9, 158–164._60_18. [Google Scholar] [CrossRef] [PubMed]
  34. Robacker, D.C.; Lauzon, C.R.; Patt, J.; Margara, F.; Sacchetti, P. Attraction of Mexican fruit flies (Diptera: Tephritidae) to bacteria: Effects of culturing medium on odour volatiles. J. Appl. Entomol. 2009, 133, 155–163. [Google Scholar] [CrossRef]
  35. Astantri, P.F.; Prakoso, W.S.A.; Triyana, K.; Untari, T.; Airin, C.M.; Astuti, P. Lab-Made Electronic Nose for Fast Detection of Listeria monocytogenes and Bacillus cereus. Vet. Sci. 2020, 7, 20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Rossi, V.; Talon, R.; Berdagué, J.L. Rapid discrimination of Micrococcaceae species using semiconductor gas sensors. J. Microbiol. Methods 1995, 24, 183–190. [Google Scholar] [CrossRef]
  37. Zetola, N.; Modongo, C.; Matlhagela, K.; Sepako, E.; Matsiri, O.; Tamuhla, T.; Mbongwe, B.; Martinelli, E.; Sirugo, G.; Paolesse, R.; et al. Identification of a Large Pool of Microorganisms with an Array of Porphyrin Based Gas Sensors. Sensors 2016, 16, 466. [Google Scholar] [CrossRef] [Green Version]
  38. Dutta, R.; Hines, E.L.; Gardner, J.W.; Boilot, P. Bacteria classification using Cyranose 320 elcetronic nose. Biomed. Eng. Online 2002, 1, 4. [Google Scholar] [CrossRef] [Green Version]
  39. Genersch, E.; Forsgren, E.; Pentikä inen, J.; Ashiralieva, A.; Rauch, S.; Kilwinski, J.; Fries, I. Reclassification of Paenibacillus larvae subsp. pulvifaciens and Paenibacillus larvae subsp. larvae as Paenibacillus larvae without subspecies differentiation. Int. J. Syst. Evol. Microbiol. 2006, 56, 501–511. [Google Scholar] [CrossRef] [Green Version]
  40. Göpel, J.W.; Hesse, N.Z. Sensors: A Comprehensive Survey; VCH Verlag: Darmstadt, Germany, 1991; pp. 341–428. [Google Scholar]
  41. Haugen, J.E.; Tomic, O.; Kvaal, K. A calibration method for handling the temporal drift of solid state gas-sensors. Anal. Chim. Acta 2000, 407, 23–39. [Google Scholar] [CrossRef]
  42. Arshak, K.; Moore, E.; Lyons, G.; Harris, J.; Clifford, S. A review of gas sensors employed in electronic nose applications. Sens. Rev. 2004, 24, 181–198. [Google Scholar] [CrossRef] [Green Version]
  43. Pearce, T.C.; Schiffman, S.S.; Nagle, H.T.; Gardner, J.W. Handbook of Machine Olfaction: Electronic Nose Technology; Wiley-VCH Verlag GmbH & Co. KGaA: New York, NY, USA, 2003. [Google Scholar] [CrossRef]
  44. Laref, R.; Ahmadou, D.; Losson, E.; Siadat, M. Orthogonal Signal Correction to Improve Stability Regression Model in Gas Sensor Systems. J. Sens. 2017, 2017, 9851406. [Google Scholar] [CrossRef] [Green Version]
  45. Ahmadou, D.; Laref, R.; Losson, E.; Siadat, M. Reduction of drift impact in gas sensor response to improve quantitative odor analysis. In Proceedings of the 2017 IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada, 22–25 March 2017; pp. 928–933. [Google Scholar] [CrossRef]
Figure 1. MCA-8 measurement device: (a) general view: A, multi-sensor recorder (MCA-8); B, power supply control panel; C, control panel for data transfer to the server; D, power cord; E, card reader; F, housing; and G, inlet channels; and (b) block diagram with marked construction elements and directional gas 80 flow.
Figure 1. MCA-8 measurement device: (a) general view: A, multi-sensor recorder (MCA-8); B, power supply control panel; C, control panel for data transfer to the server; D, power cord; E, card reader; F, housing; and G, inlet channels; and (b) block diagram with marked construction elements and directional gas 80 flow.
Sensors 21 04917 g001
Figure 2. The measurement stand.
Figure 2. The measurement stand.
Sensors 21 04917 g002
Figure 3. P. l. larvae (strain ATCC 9545, ERIC I): a spectrum of this bacterium obtained with a MALDI-TOF MS test.
Figure 3. P. l. larvae (strain ATCC 9545, ERIC I): a spectrum of this bacterium obtained with a MALDI-TOF MS test.
Sensors 21 04917 g003
Figure 4. The Petri dish with MYPGP media (which contains yeast extract, Mueller-Hinton broth, glucose, K2HPO4, sodium pyruvate, and agar) with visible fine, transparent, and slimy colonies of the P.l.larvae; 6-day culture.
Figure 4. The Petri dish with MYPGP media (which contains yeast extract, Mueller-Hinton broth, glucose, K2HPO4, sodium pyruvate, and agar) with visible fine, transparent, and slimy colonies of the P.l.larvae; 6-day culture.
Sensors 21 04917 g004
Figure 5. Measurement of a Petri dish with MYPGP media without visible colonies (class 23) in a wooden chamber.
Figure 5. Measurement of a Petri dish with MYPGP media without visible colonies (class 23) in a wooden chamber.
Sensors 21 04917 g005
Figure 6. A sample graph illustrating the process of measurement. In this case, the measurement concerned a colony of P. l. larvae 6 days after culture in a wooden chamber.
Figure 6. A sample graph illustrating the process of measurement. In this case, the measurement concerned a colony of P. l. larvae 6 days after culture in a wooden chamber.
Sensors 21 04917 g006
Figure 7. The visualization of the average reading intensity of TGS sensors for decision classes 1, 23, and 24 using M1; wooden chamber on the left and polystyrene chamber on the right.
Figure 7. The visualization of the average reading intensity of TGS sensors for decision classes 1, 23, and 24 using M1; wooden chamber on the left and polystyrene chamber on the right.
Sensors 21 04917 g007
Figure 8. The visualization of the average reading intensity of TGS sensors for decision classes 1, 23, and 24 using M2; wooden chamber on the left and polystyrene chamber on the right.
Figure 8. The visualization of the average reading intensity of TGS sensors for decision classes 1, 23, and 24 using M2; wooden chamber on the left and polystyrene chamber on the right.
Sensors 21 04917 g008
Table 1. The characteristics of semiconductor gas sensors, which were used in the multi-sensor array ([9], https://www.figaro.co.jp/en (accessed on 17 July 2021)).
Table 1. The characteristics of semiconductor gas sensors, which were used in the multi-sensor array ([9], https://www.figaro.co.jp/en (accessed on 17 July 2021)).
Sensor Substances Detected Detection Range
T G S 823 O r g a n i c s o l v e n t v a p o r s 50∼5000 ppm, ethanol, n-hexane, benzene, acetone
T G S 826 A m m o n i a 30∼300 ppm, ethanol, ammonia, i s o b u t a n e
T G S 832 C h l o r o f l u o r o c a r b o n s 100∼3000 ppm, R-407c, R-134a, R-410a, R-404a, R-22
T G S 2600 G a s e o u s a i r c o n t a m i n a n t s 1∼100 ppm
T G S 2602 V O C s a n d o d o r o u s g a s e s 1∼30 ppm, ethanol, ammonia, t o l u e n e
T G S 2603 A m i n e - s e r i e s a n d s u l f u r o u s o d o r g a s e s 1–30 ppm, ethanol, 0.1–3 ppm trimethylamine, 0.3–2 ppm methyl mercaptan
Table 2. Size of decision classes in the tested variants.
Table 2. Size of decision classes in the tested variants.
Variant / Class Name 12324
M 1 w o o d e n c h a m b e r 141249
M 1 p o l y s t y r e n e c h a m b e r 141149
M 2 w o o d e n c h a m b e r 91150
M 2 p o l y s t y r e n e c h a m b e r 91149
Table 3. Metrics used in the kNN method.
Table 3. Metrics used in the kNN method.
Canberra metric w ( u , v ) = i = 1 6 | T G S i ( u ) T G S i ( v ) | | T G S i ( u ) | + | T G S i ( v ) |
Euclidean metric w ( u , v ) = ( i = 1 6 ( | T G S i ( u ) T G S i ( v ) ) 2 )
Manhattan metric w ( u , v ) = i = 1 6 | T G S i ( u ) T G S i ( v ) |
Table 4. Summary of the highest accclass values obtained in the 5 × MCCV-5 validation tests: specific class vs. other classes including the classifiers that enabled obtaining them: devices M1 and M2.
Table 4. Summary of the highest accclass values obtained in the 5 × MCCV-5 validation tests: specific class vs. other classes including the classifiers that enabled obtaining them: devices M1 and M2.
Parameteraccclass
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
Configuration1 vs. other classes
Max0.8451.0001.0001.000
The best method c a n b e r r a . 811 e u c l i d e a n . 811 e u c l i d e a n . 811 e u c l i d e a n . 811
m a n h a t t a n . 811 m a n h a t t a n . 811 m a n h a t t a n . 811
Configuration23 vs. other classes
Max0.6970.8870.9700.983
The best method c a n b e r r a . 811 c a n b e r r a . 811 e u c l i d e a n . 811 m a n h a t t a n . 811
Configuration24 vs. other classes
Max0.9330.9940.8470.864
The best method e u c l i d e a n . 3 n n c a n b e r r a . 811 c a n b e r r a . 811 c a n b e r r a . 1 n n
Table 5. Summary of the highest values of tprclass obtained in the 5 × MCCV-5 validation tests: specific class vs. other classes including classifiers that enabled obtaining the result (the best method) for devices M1 and M2.
Table 5. Summary of the highest values of tprclass obtained in the 5 × MCCV-5 validation tests: specific class vs. other classes including classifiers that enabled obtaining the result (the best method) for devices M1 and M2.
Parametertprclass
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
configuration1 vs. other classes
max0.8000.9370.9930.977
the best method e u c l i d e a n . 1 n n c a n b e r r a . 2 n n c a n b e r r a . 1 n n c a n b e r r a . 1 n n
c a n b e r r a . 2 n n
configuration23 vs. other classes
max0.2330.4850.7350.608
the best method e u c l i d e a n . 2 n n e u c l i d e a n . 2 n n c a n b e r r a . 1 n n e u c l i d e a n . 1 n n
configuration24 vs. other classes
max0.7860.8510.8690.848
the best method c a n b e r r a . 811 c a n b e r r a . 1 n n e u c l i d e a n . 811 e u c l i d e a n . 1 n n
Table 6. Summary of the highest accbalanced values obtained in the 5 × MCCV-5 validation tests: specific class vs. other classes including classifiers that enabled obtaining these values (the best method) for devices M1 and M2.
Table 6. Summary of the highest accbalanced values obtained in the 5 × MCCV-5 validation tests: specific class vs. other classes including classifiers that enabled obtaining these values (the best method) for devices M1 and M2.
Parameteraccbalanced
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
configuration1 vs. all
max0.8650.7920.9720.983
the best method c a n b e r r a . 811 c a n b e r r a . 3 n n c a n b e r r a . 1 n n e u c l i d e a n . 1 n n
e u c l i d e a n . 811
configuration23 vs. all
max0.5190.6510.6450.648
the best method m a n h a t t a n . 2 n n e u c l i d e a n . 811 c a n b e r r a . 811 e u c l i d e a n . 1 n n
configuration24 vs. all
max0.7170.8010.7000.681
the best method c a n b e r r a . 811 c a n b e r r a . 1 n n c a n b e r r a . 811 c a n b e r r a . 811
Table 7. The effectiveness of individual classifiers expressed as a number indicating how many times a specific test produced the highest value of accklass, tprclass, or accbalanced in all comparisons of class vs. other.
Table 7. The effectiveness of individual classifiers expressed as a number indicating how many times a specific test produced the highest value of accklass, tprclass, or accbalanced in all comparisons of class vs. other.
Method acc class tpr class acc balanced Total
M1M2M1M2M1M2
c a n b e r r a . 1 n n 0113117
c a n b e r r a . 2 n n 0011002
c a n b e r r a . 3 n n 0000101
c a n b e r r a . 811 41102311
e p s = 0.01 . n b 0000000
e u c l i d e a n . 1 n n 0012025
e u c l i d e a n . 2 n n 0020002
e u c l i d e a n . 3 n n 1000001
e u c l i d e a n . 811 1301207
m a n h a t t a n . 1 n n 0000000
m a n h a t t a n . 2 n n 0000101
m a n h a t t a n . 3 n n 0000000
m a n h a t t a n . 811 1300004
n b . n u m 0000000
sum78677641
Table 8. The obtained accclass values in the 5 × MCCV-5 validation tests in the comparison of specified class vs. other classes for the test c a n b e r r a . 811 for devices M1 and M2.
Table 8. The obtained accclass values in the 5 × MCCV-5 validation tests in the comparison of specified class vs. other classes for the test c a n b e r r a . 811 for devices M1 and M2.
Method c a n b e r r a . 811
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
configuration1 vs. all
acc10.8450.9880.9780.971
tpr10.6610.8280.7010.590
accbalanced0.8640.9680.9470.936
configuration23 vs. all
acc230.6970.8760.9700.992
tpr230.1520.1670.2250.202
accbalanced0.5190.6160.6450.604
configuration24 vs. all
acc240.9020.9940.8470.864
tpr240.7860.8150.8310.789
accbalanced0.7170.7840.7010.681
Table 9. The obtained tpr values for class 23 and 24, and accbalanced in validation tests of 5 × MCCV-5 in comparison of 23 vs.24 for m a n h a t t a n . 1 n n test, devices M1 and M2.
Table 9. The obtained tpr values for class 23 and 24, and accbalanced in validation tests of 5 × MCCV-5 in comparison of 23 vs.24 for m a n h a t t a n . 1 n n test, devices M1 and M2.
Configuration23 vs. 24
Method manhattan . 1 nn
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
t p r 23 0.1380.4230.6570.702
t p r 24 0.8060.8490.8770.880
a c c b a l a n c e d 0.4500.5960.6760.695
Table 10. The obtained tpr values for class 1 and 23, and accbalanced in validation tests of 5 × MCCV-5 in the comparison of 1 vs.23 for the c a n b e r r a . 811 test, device M1 and M2.
Table 10. The obtained tpr values for class 1 and 23, and accbalanced in validation tests of 5 × MCCV-5 in the comparison of 1 vs.23 for the c a n b e r r a . 811 test, device M1 and M2.
Configuration1 vs. 23
Method manhattan . 1 nn
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
t p r 23 0.8530.9101.0001.000
t p r 24 0.8701.0000.9811.000
a c c b a l a n c e d 0.8510.9870.9871.000
Table 11. The obtained tpr values for classes 1 and 24, and accbalanced in the validation tests of 5 × MCCV-5 in the comparison of 1 vs. 24 for the c a n b e r r a . 1 n n test, devices M1 and M2.
Table 11. The obtained tpr values for classes 1 and 24, and accbalanced in the validation tests of 5 × MCCV-5 in the comparison of 1 vs. 24 for the c a n b e r r a . 1 n n test, devices M1 and M2.
Configuration1 vs. 24
Method canberra . 1 nn
DeviceM1M2
ChamberWoodenPolystyreneWoodenPolystyrene
t p r 1 0.9131.0000.9731.00
t p r 24 0.9140.9970.9920.958
a c c b a l a n c e d 0.8260.9960.9770.894
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bąk, B.; Wilk, J.; Artiemjew, P.; Wilde, J. Recording the Presence of Peanibacillus larvae larvae Colonies on MYPGP Substrates Using a Multi-Sensor Array Based on Solid-State Gas Sensors. Sensors 2021, 21, 4917. https://doi.org/10.3390/s21144917

AMA Style

Bąk B, Wilk J, Artiemjew P, Wilde J. Recording the Presence of Peanibacillus larvae larvae Colonies on MYPGP Substrates Using a Multi-Sensor Array Based on Solid-State Gas Sensors. Sensors. 2021; 21(14):4917. https://doi.org/10.3390/s21144917

Chicago/Turabian Style

Bąk, Beata, Jakub Wilk, Piotr Artiemjew, and Jerzy Wilde. 2021. "Recording the Presence of Peanibacillus larvae larvae Colonies on MYPGP Substrates Using a Multi-Sensor Array Based on Solid-State Gas Sensors" Sensors 21, no. 14: 4917. https://doi.org/10.3390/s21144917

APA Style

Bąk, B., Wilk, J., Artiemjew, P., & Wilde, J. (2021). Recording the Presence of Peanibacillus larvae larvae Colonies on MYPGP Substrates Using a Multi-Sensor Array Based on Solid-State Gas Sensors. Sensors, 21(14), 4917. https://doi.org/10.3390/s21144917

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop