Next Article in Journal
Multiple Damaged Cables Identification in Cable-Stayed Bridges Using Basis Vector Matrix Method
Next Article in Special Issue
Stress Detection Using Frequency Spectrum Analysis of Wrist-Measured Electrodermal Activity
Previous Article in Journal
Accurate Crack Detection Based on Distributed Deep Learning for IoT Environment
Previous Article in Special Issue
Improved Individualized Patient-Oriented Depth-of-Hypnosis Measurement Based on Bispectral Index
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Hybrid Feature Fusion-Based High-Sensitivity Fire Detection and Early Warning for Intelligent Building Systems

1
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
2
School of Chemistry and Chemical Engineering, Southwest Petroleum University, Chengdu 610500, China
3
School of Mechanical and Electronic Engineering, Southwest Petroleum University, Chengdu 610500, China
4
School of Materials Science and Engineering, Chongqing University, Chongqing 400044, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(2), 859; https://doi.org/10.3390/s23020859
Submission received: 17 November 2022 / Revised: 9 January 2023 / Accepted: 9 January 2023 / Published: 11 January 2023
(This article belongs to the Special Issue Intelligent Soft Sensors)

Abstract

:
High-sensitivity early fire detection is an essential prerequisite to intelligent building safety. However, due to the small changes and erratic fluctuations in environmental parameters in the initial combustion phase, it is always a challenging task. To address this challenge, this paper proposes a hybrid feature fusion-based high-sensitivity early fire detection and warning method for in-building environments. More specifically, the temperature, smoke concentration, and carbon monoxide concentration were first selected as the main distinguishing attributes to indicate an in-building fire. Secondly, the propagation neural network (BPNN) and the least squares support vector machine (LSSVM) were employed to achieve the hybrid feature fusion. In addition, the genetic algorithm (GA) and particle swarm optimization (PSO) were also introduced to optimize the BPNN and the LSSVM, respectively. After that, the outputs of the GA-BPNN and the PSO-LSSVM were fused to make a final decision by means of the D-S evidence theory, achieving a highly sensitive and reliable early fire detection and warning system. Finally, an early fire warning system was developed, and the experimental results show that the proposed method can effectively detect an early fire with an accuracy of more than 96% for different types and regions of fire, including polyurethane foam fire, alcohol fire, beech wood smolder, and cotton woven fabric smolder.

1. Introduction

Over the past few years, building fires have been one of the most common and frequent types of fire, causing severe property losses and fatalities [1,2,3]. Thus, it has become extremely important and imperative to effectively decrease and control the risk of fire in buildings. One of the most critical technologies is early fire warning, and both academia and industry are exploring approaches that enable the prompt detection and accurate determination of scene conditions in the early stages of building fires [4]. Furthermore, with the development of intelligent buildings, an effective early fire detection and warning system is also an essential prerequisite to provide safe, healthy, and comfortable residential or working conditions.
For achieving early fire detection and warning inside building environments, many algorithms have been presented, which can be mainly divided into three categories, namely optical, smoke, and carbon-monoxide sensors. Li et al. [5,6] conducted a fire detection algorithm performance evaluation based on image complexity, which could accurately determine the detection level of the detection algorithm under different image complexity conditions. Li et al. [7] proposed a new hybrid model for fire prediction based on the visual information of RGB images. The model achieves promising performance, which also shows the potential to monitor the constant changes in a building fire through the continuous processing of images of flames. Xie et al. [8] employed an early fire detection method for shielded indoor environments based on fire light reflection characteristics and established a multi-expert system by extracting the change characteristics of the fire area with light reflection. They then verified the method based on a large data evaluation system. However, in the above methods, they ignored the early stages of the fire that may not involve the open flame but cannot determine the correct scene conditions in time. The temperature, another major feature of fire, has also attracted significant attention. Ji et al. [9] proposed a machine-learning-based real-time prediction method for monitoring physical parameters for early fire warnings based on temperatures. The results show that the trained intelligences improve the accuracy and reliability of building fire warnings. Sun et al. [10] verified a bio-inspired artificial intelligence algorithm driven by temperature data to detect fire in 3D spaces. Yusuf et al. [3] presented a linearly regressive artificial-neural-network-based technique to predict temperature increases caused by building fire environments. This method predicts temperature ranges in a burning compartment based on the historic fire behavior data modelled via a neural network algorithm. Garrity et al. [11] exploited a compact embedded artificial neural network (ANN) with a second-stage classifier, reading temperature data from the in-built thermocouple, to produce the output of predicted temperatures. However, this technical approach, namely its ability to judge temperature fluctuations in special environments, still requires further improvement. To compensate for the deficiencies of the feature parameter, Zhang et al. [12] proposed DBN-R-LSTM-NN to classify and predict fire smoke and other features based on data collected from IoT sensors. Pincoot et al. [13] designed a vision-based indoor fire and smoke detection system with small training and test datasets, whereby different pixel density images, high-density smoke environments, and flame density scenes were recognized. Qiu et al. [14] developed a distributed feedback carbon monoxide (CO) sensor based on lasers used for the early warning detection of fire and verified the reliability of this sensor via different experiments. Li et al. [15] studied and proposed an early fire detection method based on a gas turbulent diffusion (GTD) model and particle swarm optimization (PSO). The experimental results verify that the sensor system has good fire detection and location performance. Chen et al. [16] proposed a fast and cost-effective indoor fire alarm system, which is used to find the fire, carbon monoxide, smoke, temperature, and humidity data in real time and conduct effective data analysis and classification. For smoke detection, the influence of smoke and dust in the environment represents a challenge.
Although vision-based sensing systems have shown good performance, massive and complex datasets often delay the time in the decision-making process [17]. Thus, visual-based sensing systems are not appropriate for early fire detection where decision making needs to be conducted in limited time. Additionally, vision-based sensing systems are inappropriate inside buildings because of the size and cost of devices, as well as privacy concerns that make them unsuitable for installation in multiple rooms and private homes. Meanwhile, single chemical sensor fire detectors are susceptible to interference from environmental conditions such as electromagnetic waves, water vapor, dust, cigarette smoke, and cooking smoke [18], which means that most smoke detectors will have false alarms when they detect these interfering conditions. Similarly, single temperature sensor devices still suffer from the misjudgment of environmental temperature fluctuations. They cannot effectively distinguish between early fire signals and environmental interference signals and cannot properly send early fire warning signals.
Due to the rapid development of machine learning, many intelligent algorithms have been presented to fuse several fire feature parameters [19,20,21,22]. This method overcomes the singularity and instability of the traditional threshold judgment method, which can significantly improve the accuracy of fire detection. Therefore, this paper proposes a hybrid feature fusion-based early fire detection method. First, by means of the distributed wireless sensing network, a hybrid feature collection system is developed to collect the smoke concentration, temperature, and CO concentration. On this account, a hybrid feature fusion algorithm, combining an error back propagation (BP) neural network with a least square support vector machine (LSSVM), is proposed. Then, the genetic algorithm (GA) and particle swarm optimization (PSO) are applied to obtain the optimal parameters in the data fusion process of the two algorithms, in order to achieve the optimized feature-level fusion results. Furthermore, the two algorithms are treated as subevidence bodies and the output results are adopted as the basic probability assignment of the D-S evidence theory for decision-level fusion to realize highly sensitive and reliable early fire warnings.

2. Suggestions and Methodology

The process of the hybrid feature data fusion algorithm is shown in Figure 1. The smoke concentration, temperature, and carbon monoxide concentration are obtained after collecting nodes and they are then transmitted to the data processing center via LoRa as inputs of the genetic algorithm–back propagation neural network (GA-BPNN) and the particle swarm optimization–least squares support vector machine (PSO-LSSVM). The two models both obtain three outputs: fire, smolder, and no fire. Then, the results of the feature layer fusion are integrated by the D-S evidence theory to output the final decision.

2.1. Genetic Algorithm–Back Propagation Neural Network Fire Warning Model

The BPNN algorithm optimized by GA is a continuous and iterative process used for searching the best weight and threshold [19]. The process of the BPNN algorithm optimized by GA is shown in Figure 2.
The BPNN is a multi-layer forward feedback network for error correction, which includes the forward propagation of the signal and backward propagation of the error. The error excitation function is a sigmoid function, as shown in Equation (1).
Y i = 1 1 + exp i = 1 n w i j x i + w j 0 Y k = k = 1 N w k j Y j + w k 0
where Yk is the kth variable of the output layer, Yj is the jth variable of the hidden layer, xi is the ith input variable, N is the number of output neurons, n is the number of hidden neurons, wkj is the weight between the output layer and the hidden layer, and wji is the weight between the input layer and the hidden layer.
The gradient descent method is often used to optimize the parameters of neural networks. However, BPNN is difficult to converge and may fall into local extremes. Since the GA [23] can reduce the solution space of the neural network, the global optimal solution can be obtained more quickly and stably by the GA-BPNN [24]. The GA uses selection, crossover, and mutation to generate several initial populations of defined encoding lengths in a random number [25].
In the GA optimization strategy, the best realized individuals of the new generation will be considered as a result of the execution and GA setups shown in Table 1. The optimal parameters obtained by GA are then brought into the BPNN for training.

2.2. Particle Swarm Optimization–Least Squares Support Vector Machine Fire Warning Model

The inputs to the LSSVM are the smoke concentration, temperature, and carbon monoxide concentration. The penalty factor C and the kernel parameter σ of the LSSVM are optimized by PSO. The simulation outputs are compared with the expected outputs to verify the feasibility of the algorithm, and the design is shown in Figure 3.
In support vector machines (SVMs), the dot product algorithm in the high-level feature is replaced by the kernel function [26].
SuykensJ and Vandewalle [27] further proposed the least squares support vector machine (LSSVM) for solving pattern classification and regression prediction problems [28]. A nonlinear function φ(xi) is used to map the input to the feature space, and the nonlinear function estimation modeling is shown in Equation (2).
f x = b + x , w
where w is the weight vector and b is the bias term.
The evaluation problem is described as the optimization problem based on the principle of structured risk minimization and the Lagrange function is constructed, as shown in Equation (3), to solve the optimization problem.
L L S S V M = 1 2 w 2 + 1 2 γ i = 1 N e i 2 i = 1 N α i w , x i + b + e i y i
where ai is the Lagrange multiplier.
The linear problems can be simplified by eliminating w and ei, as described in Equation (4).
0 E T E Ώ + 1 γ E b a = 0 y
where y = [y1, …, yN]T, a = [a1, …, aN]T, E = [1, …, 1]T, and Ώ is a symmetric matrix equation for the N × N as shown in Equation (5).
Ω i j = K ( x i , x j ) = ( x i ) T ( x j ) i , j = 1 , 2 , , N
where K(xi, yj) is the kernel function that satisfies the Meser condition [29].
Finally, the LSSVM can be described, as shown in Equation (6).
y x = w , x + b = i = 1 n α i x i x + b = i = 1 n α i K x i , x + b
The four main forms of the LSSVM kernel function are shown in Table 2.
The PSO algorithm simulates a bird in a flock by designing a massless particle with position and velocity attributes [30]. The individual extremes are matched with the current global optimal solution shared by other particles in the global to adjust the speed and position [31].
The PSO will initialize to a group of random particles and find the optimal solution by iteration [21]. The particle update is tracked (pbest, gbest) in iteration by Equations (7) and (8).
v i = v i + c 1 × r a n d ( ) × p b e s t i x i + c 2 × r a n d ( ) × g b e s t i x i
x i = x i + v i
where i = 1, 2, …, N, and N is the total number of particles. Vi is the speed of the particle. Rand ( ) is a random number between 0 and 1. Xi is the current position of the particle. C1 and c2 are the learning factors of c1 = c2 = 2. The maximum value of vi is Vmax (>0); if vi > Vmax, then vi = Vmax.
According to the update of the velocity v, c1 is aimed towards the local optimal solution and c2 is aimed towards the global optimal solution. The representation is shown in Figure 4.
The design steps of the PSO are shown in Figure 5.
The initialization of the PSO algorithm is shown in Table 3. The fire detection uses the smoke concentration, temperature, and carbon monoxide concentration as inputs for training and testing samples. Then, the samples are trained by the LSSVM. The optimal penalty factor c and the optimal kernel function width factor σ of the LSSVM are obtained by the PSO optimization search. The partial fusion results of another group of samples can be obtained as the original fusion results for adjustment.
To assess the performance of the BPNN, the GA-BPNN, and the PSO-LSVM model, three evaluation indicators, i.e., the mean square error (MSE), the root mean square error (RMSE), and the mean absolute error (MAE), are adopted [20]. The MSE, RMSE, and MAE are calculated, as shown in Equations (9)–(11). The smaller the MSE, RMSE, and MAE, the smaller the error.
R S E = 1 N m = 1 N d ( y ^ m y m ) 2
R M S E = 1 N d m = 1 N d ( y ^ m y m ) 2
M A E = 1 N d m = 1 N d ( y ^ m y m )
where Nd is the amount of data, y m is the actual value of data, and y ^ m is the simulation output of the model.

2.3. Decision-Level Feature Data Fusion

The D-S evidence theory [32,33] is specialized in solving uncertainty problems [34,35]. It fuses confidence functions obtained by different algorithms to make decisions using the combination rules of the evidence theory. The system will make a final decision based on new evidence according to the decision rules.
Suppose U is an identification frame, the function m: 2Θ → [0, 1] satisfies Equation (12).
m ( ϕ ) = 0 , A Θ m ( A ) = 1
m is the basic probability assignment function based on 2Θ and m(A) is the basic probability assignment of proposition A, indicating the degree of confidence in the probability assignment.
The confidence function indicates the total degree to which the obtained evidence supports the information grading. The function Bal is defined by ∀A ⊆ Θ and B a l A = B A m B . 2Θ → [0, 1] is the reliability function on Θ. For ∀A ⊆ Θ if m(A) > 0, A is the focal element of the reliability function Bel and the union of all the focal elements in the frame Θ is the kernel.
The likelihood function describes the degree to which the obtained evidence cannot reject the score. A pl: 2Θ → [0, 1] is defined in Equation (13):
p l ( A ) = 1 B e l ( A ) = B A ϕ M ( B )
The confidence functions of Bel1 and Bel2 are demonstrated. M1 and m2 are the corresponding basic probability assignment functions. The focal elements are A1, A2, …, An and B1, B2, …, Bn. The new probability M can be obtained according to the D-S evidence theory shown in Equation (14):
M = 0 , C = ϕ 1 1 K A i B j = C m 1 ( A i ) m 2 ( B j ) , C Φ
The calculation of K is shown in Equation (15).
K = A B = ϕ m 1 ( A ) m 2 ( B )
On the one hand, if K ≠ 1, the two are compatible, and basic probability assignment can be conducted. On the other hand, if K = 1, then m1 and m2 are contradictory or cannot combine.
The decision of the D-S evidence theory followed the rules shown below, assuming that A1 ⊂ Θ, A2 ⊂ Θ satisfies Equations (16) and (17).
m ( A 1 ) = max m A i , A Θ
m ( A 2 ) = max m A i , A i Θ , A i A 1
If Equations (18) and (20) are satisfied as below:
m ( A 1 ) m ( A 2 ) > ε 1
m ( Θ ) < ε 2
m ( A 1 ) > m ( Θ )
where ε1 and ε2 are the preset thresholds, then A1 is the determined result by the D-S evidence theory.
The training error e of the GA-BPNN and the PSO-LSSVM is calculated as part of the basic probability assignment shown in Equation (21).
e = 1 2 ( t i y i ) 2
where ti and yi are the expected and simulated outputs in the GA-BP and the PSO-LSSVM.
The identification framework of the evidence theory Θ = {A1, A2, A3}, A1, A2, A3 represents the fire, smolder, and no fire. In the portfolio of evidence E = {E1, E2}, E1 and E2 denote the outputs of the GA-BP and the PSO-LSSVM, respectively. m1(A1), m1(A2), and m1(A3) represent the basic probability assignments of the GA-BP for the three outputs of fire, smolder, and no fire, respectively. m2(A1), m2(A2), and m2(A3) represent the basic probability assignments of the PSO-LSSVM for the three outputs of fire, smolder, and no fire, respectively.
The final basic probability assignment of each element obtained from Equation (21) is shown in Equation (22) below:
m j ( A i ) = y ( A i ) i = 1 3 y ( A i ) + e ( j = 1 , 2 )
Then, the D-S evidence theory fusion rule is described in Equation (23).
m ( A z ) = m 1 ( A i ) m 2 ( A j ) = 1 1 K A i A j = A z m 1 ( A i ) m 2 ( A j ) , A Z Θ , A z ϕ 0 , A Z = ϕ
Equation (24) is then used to calculate K:
K = A i A j = ϕ m 1 ( A i ) m 2 ( A j )

3. Results and Discussions

3.1. Experimental Setup

Firstly, the fire dynamics simulator (FDS) [36,37] was employed to simulate in-building fires, as shown in Figure 6a. The large eddy simulation (LES) in the FDS was used by the Smagorinsky subgrid model to solve the Navier–Stokes equations for the turbulence with a low Mach number caused by the fire phenomenon. The simulated setting was a no-wind scenario. In this figure, the burning duration was set to 40 s, and the combustion products in the space are presented in Figure 6b–d. We can see that the temperature, smoke concentration, and CO concentration changed slowly in the first five seconds, and then they began to rise significantly. At the end of the 40 s burn time, the temperature achieved the maximum, while the smoke variation stabilized, and the CO concentration continued to increase. Therefore, according to the results of the building fire simulation, these three feature parameters were selected as the monitoring parameters of the fire warning system.
Three key parameters, i.e., temperature, smoke concentration, and carbon monoxide concentration, were extracted from the experimental data to form the basic datasets. Then, we divided the outputs of the hybrid feature fusion model into three classes (open fire, smolder, and no fire). On this basis, (1,0,0), (0,1,0), and (0,0,1) were modeled as the ideal representations of open fire, smolder, and no fire, respectively. Subsequently, we developed a combustion product collection system, including the combustion product collection node and gateway node, as shown in Figure 7, to obtain the real experimental data generated by small simulated in-building fires, where 800 sets of data were collected. The feature data in the datasets were derived from combustion products of different materials, while each dataset included the temperature (Temp), smoke concentration (Smoke), and carbon monoxide concentration (CO). After that, these data were further divided into 600 sets of training data and 200 groups of test data. The training data were utilized to train the model and the optimal network training model could be obtained after consecutive iterations with learning rates of 0.001. The test data were employed to demonstrate the effectiveness.

3.2. Results of Open Fire

The fire test data were substituted into the already trained BPNN, and the results are shown in Figure 8a. The comparison reveals that the simulation output of the BPNN differed significantly from the expected output of fire. However, the network model optimized by the GA could obtain the optimal weights and thresholds, which we inputted into the BPNN for training. The outputs are shown in Figure 8b. It can be seen that the difference between the simulated and expected outputs was reduced.
The PSO-LSSVM fire warning model adopted four kernel functions: (1) the radial basis kernel function; (2) the sigmoid kernel function; (3) the polypolynomial kernel function; (4) and the linear kernel function. The simulation results of fire based on the four types of kernel functions were compared and analyzed with the expected outputs, as shown in Figure 9a–d. It is clear that the radial basis kernel function could perform better than the other three kernel functions. Thereby, it delivered the best data fusion effects.

3.3. Results of the Smolder

Figure 10 shows that the simulation results of the BPNN optimized by GA had better stability. Compared with the original model, the difference between the simulation results and the expected results was significantly reduced.
Figure 11 illustrates the different output results of smolder with the LSSVM. It can be seen that the radial basis kernel function also obtained the most stable output results, representing the highest reliability and the best data fusion effects.

3.4. Model Performance Analysis

Table 4 shows the error MSE, RMSE, and MAE of the BPNN and the GA-BPNN to quantify the model performance. Table 4 also shows that the GA-BPNN had the smallest MSE, RMSE, and MAE, which indicates that the simulation output of the GA-BPNN was more suited to the expected output. The GA-BPNN also performed better than the original BPNN. Therefore, the GA-BPNN could also fuse the fire feature data in the feature layer.
Table 5 illustrates the calculation analysis of the MSE, RMSE, and MAE for different kernel functions. As shown in Table 4 and Table 5, the algorithm based on the RBF had the smallest MSE, RMSE, and MAE, indicating that the simulation output was closer to the expected output and the model performance was better than the others. Therefore, the PSO-LSSVM model based on the RBF was selected to fuse the feature layer data for the fire feature.

3.5. Results of the Proposed Method

According to the empirical definition ε1 = 0.5, the simulation outputs of five groups of test sample data were selected for comparison and analysis with the expected outputs using Equation (24). Table 6 shows three uncertainty data outputs from the GA-BPNN and one uncertainty output from the PSO-LSSVM. These results are ambiguous. So, these five groups of results were then assigned and calculated by the probability of the D-S evidence theory, and the results are shown in Table 7. The evidence indicates that the results of the fusion based on the D-S evidence theory were consistent with the expected outputs. Thus, the results of the D-S evidence theory fusing the two model treatments effectively addressed the ambiguity of the evidence and improved the reliability of the fused data.
A comparison of the simulated and expected outputs of the D-S evidence theory incorporating the GA-BP fire warning algorithm and the PSO-LSSVM fire warning algorithm is shown in Figure 12. The expected output and the fused output were basically the same. Additionally, the inferred results of the D-S evidence theory enabled the accurate determination of fire hazards. The combined prediction method, used to fuse the information from the above two networks after identification, provided results with higher accuracy than each single model.

4. Early Fire Warning Experiments

To verify the real-time performance of the presented early fire detection and warning system, we conducted four early fire warning experiments with different fire classes, i.e., polyurethane foam fire, alcohol fire, beech wood smolder, and cotton woven fabric smolder. A combustion experiment box was then placed inside the building and the fire detector was installed at 2.0 m above the combustion box.

4.1. Results of the Warning Time

Figure 13a shows the combustion process of polyurethane foam, and Figure 13b shows the fire scene. The polyurethane burned slowly at the beginning. However, a period later, the flame became larger, with a gradually increasing temperature and producing much smoke. The PC alarmed after 16 s.
Figure 14a shows the process of alcohol burns, and Figure 14b shows the scene of alcohol fire. The alcohol immediately burned when ignited. The flame became large and released a lot of heat, resulting in the temperature rising rapidly. However, there was no visible smoke. The PC alarmed after 18 s.
Figure 15a shows the burn process of beech wood and Figure 15b shows the beech wood experiment with smolder. The smolder had no obvious fire but produced smoke particles with a slow rise in temperature. The PC alarmed after 22 s.
Figure 16a shows the process when the cotton rope is ignited and smoldered, and Figure 16b shows the overall state of the cotton rope smolder. The smolder process produced a large amount of smoke, but the temperature did not rise significantly with a few sparks. The PC alarmed after 20 s.

4.2. Accuracy Verification of Alarm System

Fifty experiments were conducted on the above scenarios to verify the accuracy of the fire warning system. The data were collected using a single acquisition node for the features information generated from each burn experiment to verify whether the results in the PC match the real situation. A comparison between the realistic case and the fire warning system is shown in Table 8. The alarm accuracy of each type of experiment was shown to exceed 96%. The results show that the early fire warning model can ensure the detection and warning of different types of fire hazards.

4.3. Distributed Network Fire Response

The main purpose of the distributed network fire warning experiment is to verify whether the early fire warning system consisting of three data collection nodes can achieve the simultaneous detection of fires in multiple regions. Three fire feature data collection nodes were used to detect fires in three different regions (see Figure 17). Each collection node was connected to a gateway node via LoRa wireless spread spectrum technology, and the gateway node collected the environmental feature data acquired by each collection node. The fusion results of the GA-BP algorithm are shown in Table 9, the fusion results of the PSO-LSSVM algorithm are shown in Table 10, and the fusion results of the D-S evidence theory are shown in Table 11.
It is evident that the data obtained from different sensor nodes collected by the GA-BP and PSO-LSSVM algorithms were also ambiguous after calculation. However, the fusion of different results using the D-S evidence theory was shown to improve the reliability of the evidence.

5. Conclusions

This paper proposes a data fusion method with multiple features to achieve an in-building fire detection and early warning system. Firstly, the GA-BPNN and the PSO-LSSVM were employed to translate the smoke concentration, temperature, and CO concentration into probabilities of fire, smolder, and no fire. Subsequently, the feature data of the GA-BPNN and the PSO-LSSVM were fused by the D-S evidence theory to further improve the accuracy and the reliability of the fire warning algorithm. Finally, an early fire detection and warning system was developed. Small-scale in-building fire experiments have confirmed the effectiveness of the method, and the combined algorithm of the D-S evidence theory could significantly improve early fire detection. Additionally, the early fire warning system could accurately identify the fire signals from different types and regions. The early fire detection accuracy also exceeded 96%. However, the proposed method can only achieve fire recognition. It cannot be utilized to indicate the severity of fire. In addition, in this paper, limited kinds of experimental materials were employed for fire combustion. As a result, in future work, we plan to develop an end-to-end approach that can not only achieve fire detection but also predict the fire levels based on the featured data, and more kinds of experimental materials will be presented to demonstrate the effectiveness. Moreover, another valuable research interest is to identify the smoking behavior for avoiding false fire alarm by utilizing the hybrid feature fusion-based method.

Author Contributions

Conceptualization, S.X. and Z.P.; data curation, S.W.; formal analysis, S.W.; funding acquisition, L.G., X.F. and Z.P.; investigation, S.X.; methodology, S.X. and H.W.; project administration, L.G.; resources, L.G.; software, S.X.; supervision, L.G., Z.P. and W.Z.; validation, S.X., L.G. and H.W.; visualization, S.X. and S.W.; writing—original draft, S.X.; writing—review and editing, S.X., X.F. and W.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded part by the National Natural Science Foundation of China, grant number 52174209 and the Scientific Research Starting Project of SWPU under Grant 2021QHZ022.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Zheng, X.; Chen, F.; Lou, L.; Cheng, P.; Huang, Y. Real-Time Detection of Full-Scale Forest Fire Smoke Based on Deep Convolution Neural Network. Remote Sens. 2022, 14, 536. [Google Scholar] [CrossRef]
  2. Abdusalomov, A.; Baratov, N.; Kutlimuratov, A.; Whangbo, T.K. An improvement of the fire detection and classification method using YOLOv3 for surveillance systems. Sensors 2021, 21, 6519. [Google Scholar] [CrossRef]
  3. Yusuf, S.A.; Alshdadi, A.A.; Alghamdi, R.; Alassafi, M.O.; Garrity, D.J. An autoregressive exogenous neural network to model fire behavior via a naïve bayes filter. IEEE Access 2020, 8, 98281–98294. [Google Scholar] [CrossRef]
  4. Lou, L.; Chen, F.; Cheng, P.; Huang, Y. Smoke root detection from video sequences based on multi-feature fusion. J. For. Res. 2022, 33, 1841–1856. [Google Scholar] [CrossRef]
  5. Li, P.; Yang, Y.; Zhao, W.; Zhang, M. Evaluation of image fire detection algorithms based on image complexity. Fire Saf. J. 2021, 121, 103306. [Google Scholar] [CrossRef]
  6. Li, P.; Zhao, W. Image fire detection algorithms based on convolutional neural networks. Case Stud. Therm. Eng. 2020, 19, 100625. [Google Scholar] [CrossRef]
  7. Li, Y.; Ko, Y.; Lee, W. RGB image-based hybrid model for automatic prediction of flashover in compartment fires. Fire Saf. J. 2022, 132, 103629. [Google Scholar] [CrossRef]
  8. Xie, Y.; Zhu, J.; Guo, Y.; You, J.; Feng, D.; Cao, Y. Early indoor occluded fire detection based on firelight reflection characteristics. Fire Saf. J. 2022, 128, 103542. [Google Scholar] [CrossRef]
  9. Ji, W.; Li, G.Q.; Zhu, S. Real-time prediction of key monitoring physical parameters for early warning of fire-induced building collapse. Comput. Struct. 2022, 272, 106875. [Google Scholar] [CrossRef]
  10. Sun, B.; Liu, X.; Xu, Z.-D.; Xu, D. Temperature data-driven fire source estimation algorithm of the underground pipe gallery. Int. J. Therm. Sci. 2022, 171, 107247. [Google Scholar] [CrossRef]
  11. Garrity, D.J.; Yusuf, S.A. A predictive decision-aid device to warn firefighters of catastrophic temperature increases using an AI-based time-series algorithm. Saf. Sci. 2021, 138, 105237. [Google Scholar] [CrossRef]
  12. Zhang, Y.; Geng, P.; Sivaparthipan, C.B.; Muthu, B.A. Big data and artificial intelligence based early risk warning system of fire hazard for smart cities. Sustain. Energy Technol. Assess. 2021, 45, 100986. [Google Scholar] [CrossRef]
  13. Pincott, J.; Tien, P.W.; Wei, S.; Calautit, J.K. Indoor fire detection utilizing computer vision-based strategies. J. Build. Eng. 2022, 61, 105154. [Google Scholar] [CrossRef]
  14. Qiu, X.; Wei, Y.; Li, N.; Guo, A.; Zhang, E.; Li, C.; Peng, Y.; Wei, J.; Zang, Z. Development of an early warning fire detection system based on a laser spectroscopic carbon monoxide sensor using a 32-bit system-on-chip. Infrared Phys. Technol. 2019, 96, 44–51. [Google Scholar] [CrossRef]
  15. Li, Y.; Yu, L.; Zheng, C.; Ma, Z.; Yang, S.; Song, F.; Zheng, K.; Ye, W.; Zhang, Y.; Wang, Y.; et al. Development and field deployment of a mid-infrared CO and CO2 dual-gas sensor system for early fire detection and location. Spectrochim. Acta Part A Mol. Biomol. Spectrosc. 2022, 270, 120834. [Google Scholar] [CrossRef] [PubMed]
  16. Chen, S.; Ren, J.; Yan, Y.; Sun, M.; Hu, F.; Zhao, H. Multi-sourced sensing and support vector machine classification for effective detection of fire hazard in early stage. Comput. Electr. Eng. 2022, 101, 108046. [Google Scholar] [CrossRef]
  17. Hsu, T.W.; Pare, S.; Meena, M.S.; Jain, D.K.; Li, D.L.; Saxena, A.; Prasad, M.; Lin, C.T. An Early Flame Detection System Based on Image Block Threshold Selection Using Knowledge of Local and Global Feature Analysis. Sustainability 2020, 12, 8899. [Google Scholar] [CrossRef]
  18. Cao, C.-F.; Yu, B.; Guo, B.-F.; Hu, W.-J.; Sun, F.-N.; Zhang, Z.-H.; Li, S.-N.; Wu, W.; Tang, L.-C.; Song, P.; et al. Bio-inspired, sustainable and mechanically robust graphene oxide-based hybrid networks for efficient fire protection and warning. Chem. Eng. J. 2022, 439, 134516. [Google Scholar] [CrossRef]
  19. Tian, Z.; Gan, W.; Zou, X.; Zhang, Y.; Gao, W. Performance prediction of a cryogenic organic Rankine cycle based on back propagation neural network optimized by genetic algorithm. Energy 2022, 254, 124027. [Google Scholar] [CrossRef]
  20. Al-Jarrah, R.; AL-Oqla, F.M. A novel integrated BPNN/SNN artificial neural network for predicting the mechanical performance of green fibers for better composite manufacturing. Compos. Struct. 2022, 289, 115475. [Google Scholar] [CrossRef]
  21. Álvarez Antón, J.C.; García Nieto, P.J.; García Gonzalo, E.; Viera Pérez, J.C.; González Vega, M.; Blanco Viejo, C. A New Predictive Model for the State-of-Charge of a High-Power Lithium-Ion Cell Based on a PSO-Optimized Multivariate Adaptive Regression Spline Approach. IEEE Trans. Veh. Technol. 2016, 65, 4197–4208. [Google Scholar] [CrossRef]
  22. Wu, L.; Chen, L.; Hao, X. Multi-Sensor Data Fusion Algorithm for Indoor Fire Early Warning Based on BP Neural Network. Information 2021, 12, 59. [Google Scholar] [CrossRef]
  23. Zhu, J.; Wang, G.; Li, Y.; Duo, Z.; Sun, C. Optimization of hydrogen liquefaction process based on parallel genetic algorithm. Int. J. Hydrog. Energy 2022, 47, 27038–27048. [Google Scholar] [CrossRef]
  24. Cao, H.; Liu, L.; Wu, B.; Gao, Y.; Qu, D. Process optimization of high-speed dry milling UD-CF/PEEK laminates using GA-BP neural network. Compos. Part B Eng. 2021, 221, 109034. [Google Scholar] [CrossRef]
  25. Mota, B.; Faria, P.; Vale, Z. Residential load shifting in demand response events for bill reduction using a genetic algorithm. Energy 2022, 260, 124978. [Google Scholar] [CrossRef]
  26. Jain, P.; Coogan, S.C.P.; Subramanian, S.G.; Crowley, M.; Taylor, S.; Flannigan, M.D. A review of machine learning applications in wildfire science and management. Environ. Rev. 2020, 28, 478–505. [Google Scholar] [CrossRef]
  27. Suykens, J.A.K.; Vandewalle, J. Least squares support vector machine classifiers. Neural Process. Lett. 1999, 9, 293–300. [Google Scholar] [CrossRef]
  28. Chamkalani, A.; Zendehboudi, S.; Bahadori, A.; Kharrat, R.; Chamkalani, R.; James, L.; Chatzis, I. Integration of LSSVM technique with PSO to determine asphaltene deposition. J. Pet. Sci. Eng. 2014, 124, 243–253. [Google Scholar] [CrossRef]
  29. Song, Y.; Niu, W.; Wang, Y.; Xie, X.; Yang, S. A Novel Method for Energy Consumption Prediction of Underwater Gliders Using Optimal LSSVM with PSO Algorithm. In Proceedings of the Global Oceans 2020: Singapore–U.S. Gulf Coast, Biloxi, MS, USA, 5–30 October 2020; pp. 1–5. [Google Scholar] [CrossRef]
  30. Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the ICNN’95—International Conference on Neural Networks, Perth, WA, Australia, 27 November–1 December 1995; Volume 4, pp. 1942–1948. [Google Scholar] [CrossRef]
  31. Amirteimoori, A.; Mahdavi, I.; Solimanpur, M.; Ali, S.S.; Tirkolaee, E.B. A parallel hybrid PSO-GA algorithm for the flexible flow-shop scheduling with transportation. Comput. Ind. Eng. 2022, 173, 108672. [Google Scholar] [CrossRef]
  32. Dempster, A.P. Upper and Lower Probabilities Induced by a Multivalued Mapping. Ann. Math. Stat. 1967, 38, 325–339. [Google Scholar] [CrossRef]
  33. Shafer, G. A Mathematical Theory of Evidence; Princeton University Press: Princeton, NJ, USA, 1976. [Google Scholar] [CrossRef]
  34. Sung, W.T.; Chang, K.Y. Evidence-based multi-sensor information fusion for remote health care systems. Sens. Actuators A Phys. 2013, 204, 1–19. [Google Scholar] [CrossRef]
  35. Feng, R.; Che, S.; Wang, X.; Yu, N. Trust Management Scheme Based on D-S Evidence Theory for Wireless Sensor Networks. Int. J. Distrib. Sens. Netw. 2013, 9, 948641. [Google Scholar] [CrossRef]
  36. Wang, W.; He, T.; Huang, W.; Shen, R.; Wang, Q. Optimization of switch modes of fully enclosed platform screen doors during emergency platform fires in underground metro station. Tunn. Undergr. Sp. Technol. 2018, 81, 277–288. [Google Scholar] [CrossRef]
  37. Mi, H.; Liu, Y.; Jiao, Z.; Wang, W.; Wang, Q. A numerical study on the optimization of ventilation mode during emergency of cable fire in utility tunnel. Tunn. Undergr. Sp. Technol. 2020, 100, 103403. [Google Scholar] [CrossRef]
Figure 1. Overall design of the early fire detection and warning system.
Figure 1. Overall design of the early fire detection and warning system.
Sensors 23 00859 g001
Figure 2. The BPNN process with GA optimization.
Figure 2. The BPNN process with GA optimization.
Sensors 23 00859 g002
Figure 3. The PSO-LSSVM fire warning algorithm model.
Figure 3. The PSO-LSSVM fire warning algorithm model.
Sensors 23 00859 g003
Figure 4. Schematic diagram of particle search for optimization.
Figure 4. Schematic diagram of particle search for optimization.
Sensors 23 00859 g004
Figure 5. Particle swarm optimization process.
Figure 5. Particle swarm optimization process.
Sensors 23 00859 g005
Figure 6. The simulation analysis of in-building fire features: (a) fire model; (b) temperature change; (c) smoke concentration change; and (d) carbon monoxide concentration.
Figure 6. The simulation analysis of in-building fire features: (a) fire model; (b) temperature change; (c) smoke concentration change; and (d) carbon monoxide concentration.
Sensors 23 00859 g006aSensors 23 00859 g006b
Figure 7. The fire detection and warning system: (a) collection node design; (b) gateway node design; (c) hardware.
Figure 7. The fire detection and warning system: (a) collection node design; (b) gateway node design; (c) hardware.
Sensors 23 00859 g007
Figure 8. The output results of fire with (a) the BPNN and (b) the GA-BPNN.
Figure 8. The output results of fire with (a) the BPNN and (b) the GA-BPNN.
Sensors 23 00859 g008
Figure 9. The output results of fire with the LSSVM for different kernel functions: (a) the radial basis kernel function; (b) the sigmoid kernel function; (c) the polypolynomial kernel function; (d) the linear kernel function.
Figure 9. The output results of fire with the LSSVM for different kernel functions: (a) the radial basis kernel function; (b) the sigmoid kernel function; (c) the polypolynomial kernel function; (d) the linear kernel function.
Sensors 23 00859 g009
Figure 10. The output results of smolder with (a) the BPNN and (b) the GA-BPNN.
Figure 10. The output results of smolder with (a) the BPNN and (b) the GA-BPNN.
Sensors 23 00859 g010
Figure 11. The output results of smolder with the LSSVM for different kernel functions: (a) radial basis kernel function; (b) sigmoid kernel function; (c) polypolynomial kernel function; (d) linear kernel function.
Figure 11. The output results of smolder with the LSSVM for different kernel functions: (a) radial basis kernel function; (b) sigmoid kernel function; (c) polypolynomial kernel function; (d) linear kernel function.
Sensors 23 00859 g011
Figure 12. Comparative results of the D-S evidence theory fusion approach: (a) expected fire output and simulation outputs; (b) desired smolder output and simulation outputs.
Figure 12. Comparative results of the D-S evidence theory fusion approach: (a) expected fire output and simulation outputs; (b) desired smolder output and simulation outputs.
Sensors 23 00859 g012
Figure 13. The polyurethane fire test: (a) the process of polyurethane combustion; (b) the fire scene.
Figure 13. The polyurethane fire test: (a) the process of polyurethane combustion; (b) the fire scene.
Sensors 23 00859 g013
Figure 14. The alcohol fire test: (a) the process of alcohol combustion; (b) the fire scene.
Figure 14. The alcohol fire test: (a) the process of alcohol combustion; (b) the fire scene.
Sensors 23 00859 g014
Figure 15. The beech wood smolder test: (a) the process of beech wood combustion; (b) the smolder scene.
Figure 15. The beech wood smolder test: (a) the process of beech wood combustion; (b) the smolder scene.
Sensors 23 00859 g015
Figure 16. The cotton rope smolder test: (a) the process of cotton rope combustion; (b) the smolder scene.
Figure 16. The cotton rope smolder test: (a) the process of cotton rope combustion; (b) the smolder scene.
Sensors 23 00859 g016
Figure 17. Distributed networking experiments: (a) Node 1; (b) Node 2; (c) Node 3.
Figure 17. Distributed networking experiments: (a) Node 1; (b) Node 2; (c) Node 3.
Sensors 23 00859 g017
Table 1. The GA setups.
Table 1. The GA setups.
TypesSymbolsInterval
The coding lengthN20~200
The crossover probabilityPc0.4~0.99
The mutation probability\0.005~0.1
The number of terminated evolutionary generations\100~1000
Table 2. The forms of the kernel function.
Table 2. The forms of the kernel function.
Kernel FunctionForms
The polynomial kernel function K x , x i = x · x i + c N
The radial basis kernel function K x , x i = exp x x i 2 2 σ 2
The sigmoid kernel function K x , x i = tanh τ · x , x i + t , ( τ > 0 , t > 0 )
The linear kernel function k x , x i = x x i
Table 3. The PSO algorithm initialization parameters.
Table 3. The PSO algorithm initialization parameters.
TypesSymbolsInterval
The acceleration factorc11.5
c21.7
The maximum number of population evolution\300
The population size\30
The penalty factor range\0.1~1000
The kernel function width factor rangeσ0.01~1000
Table 4. The output error analysis.
Table 4. The output error analysis.
Algorithm ModelFireSmolder
MSERMSEMAEMSERMSEMAE
BP0.01850.13610.04120.00830.09100.0362
GA-BP0.00370.06120.01640.00250.04980.0140
Table 5. The output error analysis.
Table 5. The output error analysis.
Kernel FunctionFireSmolder
MSERMSEMAEMSERMSEMAE
RBF0.00280.05290.02930.0009840.03140.0152
Sigmoid0.01880.13700.06390.01550.12470.0603
Poly0.01720.13100.06400.01460.12090.0619
Linear0.01920.13860.06940.01690.13000.0681
Table 6. Neural network simulation output results and expected output results.
Table 6. Neural network simulation output results and expected output results.
Algorithm ModelSimulation OutputExpected OutputResults
The GA-BP neural network0.627450.001380.37117100Uncertainty
0.682780.014710.30251100Uncertainty
0.99690.00250.0006100Fire
0.59860.39270.0087100Uncertainty
0.997920.0020.00008100Fire
The PSO-LSSVM network0.863540.076890.07941100Fire
0.870260.045970.0794100Fire
0.641140.299530.05933100Uncertainty
0.874510.110740.07941100Fire
0.971660.001140.02283100Fire
Table 7. The results of the D-S evidence theory fusion approach.
Table 7. The results of the D-S evidence theory fusion approach.
Samplem(A1)m(A2)m(A3)Results
10.99970.00010.0002Fire
20.99830.00110.0006Fire
3100Fire
4100Fire
5100Fire
Table 8. A comparison of the real situation and system recognition.
Table 8. A comparison of the real situation and system recognition.
Fire TypesExperiments/nAlarms/nMissed Alarms/nAccuracy/%
Polyurethane fire5049198%
Alcohol fire5048296%
Beech wood smolder5048296%
Cotton rope smolder5049198%
Table 9. The GA-BP algorithm fusion results.
Table 9. The GA-BP algorithm fusion results.
Temperature/°CSmoke/103 ppmCO/ppmFire OutputSmolder OutputNo Fire Output
Node 125.62.3660.69490.05320.2519
31.63.68260.72470.05130.2239
35.92.56170.92960.00110.0692
Node 226.31.8420.67620.15220.1716
33.72.28140.81240.05240.1350
36.92.4470.94560.03250.0219
Node 325.32.660.70250.23050.0670
32.41.95230.79520.12480.0800
371.690.90330.03620.0605
Table 10. The PSO-LSSVM algorithm fusion results.
Table 10. The PSO-LSSVM algorithm fusion results.
Temperature/°CSmoke/103 ppmCO/ppmFire OutputSmolder OutputNo Fire Output
Node 125.62.3660.63140.12500.2436
31.63.68260.76150.02150.2171
35.92.56170.87030.04600.0838
Node 226.31.8420.70430.14530.1504
33.72.28140.80210.13200.0659
36.92.4470.93820.00440.0573
Node 325.32.660.61250.23100.1566
32.41.95230.74930.08160.1691
371.690.88530.03330.0814
Table 11. The D-S evidence theory fusion results.
Table 11. The D-S evidence theory fusion results.
Temperature/°CSmoke/103 ppmCO/ppmFire OutputSmolder OutputNo Fire Output
Node 125.62.3660.86580.01310.1211
31.63.68260.91740.00180.0808
35.92.56170.99280.00010.0071
Node 226.31.8420.90860.04220.0492
33.72.28140.97630.01040.0133
36.92.4470.99840.00020.0014
Node 325.32.660.87100.10780.0212
32.41.95230.96170.01640.0218
371.690.99240.00150.0061
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xiao, S.; Wang, S.; Ge, L.; Weng, H.; Fang, X.; Peng, Z.; Zeng, W. Hybrid Feature Fusion-Based High-Sensitivity Fire Detection and Early Warning for Intelligent Building Systems. Sensors 2023, 23, 859. https://doi.org/10.3390/s23020859

AMA Style

Xiao S, Wang S, Ge L, Weng H, Fang X, Peng Z, Zeng W. Hybrid Feature Fusion-Based High-Sensitivity Fire Detection and Early Warning for Intelligent Building Systems. Sensors. 2023; 23(2):859. https://doi.org/10.3390/s23020859

Chicago/Turabian Style

Xiao, Shengyuan, Shuo Wang, Liang Ge, Hengxiang Weng, Xin Fang, Zhenming Peng, and Wen Zeng. 2023. "Hybrid Feature Fusion-Based High-Sensitivity Fire Detection and Early Warning for Intelligent Building Systems" Sensors 23, no. 2: 859. https://doi.org/10.3390/s23020859

APA Style

Xiao, S., Wang, S., Ge, L., Weng, H., Fang, X., Peng, Z., & Zeng, W. (2023). Hybrid Feature Fusion-Based High-Sensitivity Fire Detection and Early Warning for Intelligent Building Systems. Sensors, 23(2), 859. https://doi.org/10.3390/s23020859

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop