Next Article in Journal
Data-Driven Futuristic Scenarios: Smart Home Service Experience Foresight Based on Social Media Data
Next Article in Special Issue
Credit Card Fraud Detection Based on Unsupervised Attentional Anomaly Detection Network
Previous Article in Journal
Forecasting per Capita Energy Consumption in China Using a Spatial Discrete Grey Prediction Model
Previous Article in Special Issue
Renewable Energy-Based DC Microgrid with Hybrid Energy Management System Supporting Electric Vehicle Charging System
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Spatiotemporal Hybrid Air Pollution Early Warning System of Urban Agglomeration Based on Adaptive Feature Extraction and Hesitant Fuzzy Cognitive Maps

College of Economics and Management, Northeast Forestry University, Harbin 150040, China
*
Author to whom correspondence should be addressed.
Systems 2023, 11(6), 286; https://doi.org/10.3390/systems11060286
Submission received: 13 May 2023 / Revised: 30 May 2023 / Accepted: 31 May 2023 / Published: 2 June 2023

Abstract

:
Long-term exposure to air pollution will pose a serious threat to human health. Accurate prediction can help people reduce exposure risks and promote environmental pollution control. However, most previous studies have ignored the spatial spillover of air pollution, i.e., that the current region’s air quality is also correlated with that of geographically adjacent areas. Therefore, this paper proposes an innovative spatiotemporal hybrid early warning system based on adaptive feature extraction and improved fuzzy cognition maps. Firstly, a spatial spillover analysis model based on the Moran index and local gravitational clustering was proposed to capture the diffusion and concentration characteristics of air pollution between regions. Then, an adaptive feature extraction model based on an optimized Hampel filter was put forward to process and correct the outliers in the original series. Finally, a hesitant fuzzy information optimized fuzzy cognitive maps model was proposed to forecast the air quality of urban agglomeration. The experimental results show that the air quality forecasting accuracy of urban agglomerations can be significantly improved when the geographical conditions and other interactions among cities are comprehensively considered, and the proposed model outperformed other benchmarks and can be used as a powerful analytical tool during urban agglomeration air quality management.

1. Introduction

With the advancement of science and technology, the continuous improvement of urban spatial structure has promoted the rapid growth of the economy. But at the same time, rapid urbanization has also caused serious air quality problems [1,2]. In addition, studies have also shown that people’s long-term exposure to particulate pollutants and other air pollutants mainly includes SO2, NO2, O3, and CO [3], which will cause harm to the human respiratory system, nervous system, cardiovascular system, and reproductive system [4,5,6,7]. Therefore, it is necessary to establish an air quality forecasting system to grasp the development trend of air quality and air pollution, provide technical support for regional air pollution prevention and control, and provide early warning information for daily travel or production activities.
The individual methods commonly used to forecast air quality are summarized into three types: data simulation method, mathematical statistics method, and machine learning method. The data simulation method uses professional knowledge such as atmospheric physical diffusion formulas and chemical reaction equations to simulate and forecast the formation and diffusion of pollutants [8]. This method is simple to calculate, but it needs to follow strict theoretical assumptions. Because the complexity that occurs in the atmosphere cannot be considered, forecasting accuracy is low [9]. Compared with simulation-based methods, statistical methods based on probability theory show better forecasting results. The most common are classical time series models, such as the auto-regressive (AR) models, moving average (MA) models, and auto-regressive moving average (ARMA) models [10]. However, statistical methods cannot perform nonlinear fitting during the formation and diffusion of pollutants, which leads to deviations. To address the nonlinear relationship between input and output outcomes, scholars were beginning to leverage machine learning. Support vector machine (SVM) [11,12], random foresting (RF) [13,14], and artificial neural network (ANN) [15] are widely applied in air quality forecasting. Saeid et al. used artificial neural networks to forecast PM10 concentration and applied it to health risk assessment, and the correlation coefficient reached 0.87 [16]. In addition, as the historical data collected by monitoring sites increases, deep learning methods for big data show superior predictive performance. Given that the recurrent neural network (RNN) can take into account the time-dependent effects of air quality [17], it can be applied to forecast air quality by processing series well. However, in highly complex and large-scale monitoring site networks, it is difficult to capture spatiotemporal correlations between sites.
Fuzzy cognitive maps (FCM) were developed in combination with the above advantages. FCM not only has the ability to handle fuzzy logic uncertainty problems but also has the machine learning algorithms used by neural networks. The model has a good predictive effect while explaining causality [18]. For example, Liu et al. established an EMD-HFCM model combining recurrent neural networks and fuzzy logic, which greatly improved the performance of processing large-scale and non-stationary time series [19]. Yang et al. established the Wavelet-FCM model, which decomposed the original nonstationary time series into multiple time series through the wavelet transform, which improved the forecasting performance and could be applied to a variety of forecasting tasks [20]. Therefore, an in-depth study of FCM can effectively improve the performance of the model, which has the potential and advantages for dealing with dynamic, noisy air quality [21].
However, the forecasting effect of individual models is limited. So, people started building hybrid models. The multi-scale decomposition step is introduced in the forecasting system to decompose the complex system into multiple subsystems that are easy to analyze, such as decomposition and recombination methods [22], data reconstruction [23], feature extraction [24], optimization algorithms [25], etc. For example, Wang et al. applied data preprocessing based on different strategies to improve the performance of wind speed prediction systems [26]. Yang et al. added the variational mode decomposition technique based on adaptive parameters to the machine learning model, and the average absolute error of the last four data sets reached 0.5121 [27]. Hybrid models can reduce the difficulty of modeling complex systems and improve the forecasting performance of the model. Therefore, it makes sense to construct a hybrid model based on FCM.
Based on the combing and summarizing of the literature, the research motivation of this paper can be summarized as follows:
(1)
Although the hybrid model can serve the purpose of the problem well by combining specific methods, there are still some disadvantages. Most of the current hybrid models only focus on extracting data features through the decomposition of time series, which greatly improves the fitting effect of data but ignores the potential risk of information leakage in the decomposition process [28]. Therefore, the data preprocessing method needs to be further improved.
(2)
In the past, the study of air pollution was based on the division of administrative regions, and the effects of meteorology and time were analyzed separately. However, air pollution is a cross-regional environmental pollution problem, and the spatial spillover effect between urban agglomerations cannot be ignored [29].
(3)
Traditional single models cannot achieve high accuracy requirements, while hybrid models can improve forecasting accuracy.
(4)
The study of time series data only focuses on the order of time and ignores the particularities of the air quality data itself, such as the ambiguity and uncertainty of the data.
In order to solve the above problems, an innovative spatiotemporal hybrid forecasting model based on adaptive feature extraction and improved fuzzy cognitive maps is proposed. It consists of three modules: a spatial correlation analysis module, data preprocessing module, and fuzzy information forecasting module. For the spatial correlation analysis module, a spatial feature extraction model based on the Moran index and local gravitational clustering (LGC) is designed that can combine spatiotemporal features and extract key influencers from complex data to represent a variety of complex issues in a visual way. For the data preprocessing module, a novel adaptive feature extraction model optimized by the squirrel search algorithm (SSA) is proposed to process and correct the outliers of the original series. Finally, novel hesitant fuzzy cognitive maps (HFCM) are proposed for the fuzzy information forecasting module. The fuzzy logic in the original model is optimized by hesitate fuzzy information, and the forecasting at the numerical level is transformed into the forecasting of probability at the interval level.
In summary, the main contributions of this paper are:
  • Spatial spillover effects are considered the main factors affecting the air quality index (AQI) of different cities. It verifies that the spatiotemporal correlation of the extracted data is necessary to improve the accuracy of air pollution forecasting.
  • The Hampel filter algorithm optimized by the squirrel search algorithm is innovatively introduced into the air quality forecasting model to process and correct the data outliers to improve the forecasting accuracy of the hybrid model.
  • Hesitant fuzzy cognitive maps are first proposed to forecast air pollution. It can effectively solve the gray information of air quality or fuzzy relationships and uncertainties, thus further improving the accuracy of forecasting.
  • The proposed model was comprehensively evaluated with the actual AQI dataset, five model evaluation criteria, and thirteen comparative models collected from the Beijing-Tianjin-Hebei region. The empirical results show that the proposed hybrid method has superior forecasting performance compared with the comparison models and can provide a theoretical basis for air pollution forecasting and early warning.

2. Design of Spatiotemporal Hybrid Air Pollution Early Warning System

Air pollution not only has a temporal complexity but also has a spatial spillover effect. Therefore, in order to forecast air pollution scientifically and rationally, this paper proposes a spatiotemporal hybrid air pollution early warning system of urban agglomeration. Figure 1 depicts the framework of the system.

2.1. Spatial Correlation Analysis Module

In this section, the Moran I-Local gravitational clustering (ILGC) model is proposed to verify the spatial correlation and capture the diffusion and concentration characteristics of air pollution between regions.

2.1.1. Moran Index

The Moran index is applied to analyze the spatial correlation between different cities. The Moran index is divided into the global Moran index and the local Moran index [30,31]. The global Moran index is used to determine whether there is aggregation or anomaly in space, and if it is judged to be global autocorrelation, the local Moran index is further used to explore the specific manifestations of aggregation or outliers.
Global Moran index
I c = i = 1 ψ j = 1 ψ w i j ( X i c i = 1 ψ X i c / ψ ) ( X j c j = 1 ψ X j c / ψ ) i = 1 ψ j = 1 ψ w i j i = 1 ψ ( X i c i = 1 ψ X i c / ψ ) 2 / ψ
Local Moran index
I i c = X i c i = 1 ψ X i c / ψ ( X i c i = 1 ψ X i c / ψ ) 2 / ψ j i ψ w i j ( X i c i = 1 ψ X i c / ψ )
where X i c is each region i = 1 , 2 , 3 , ψ , c represents a different group of cities. The spatial weights between features i and j are denoted as w i j and the total number of features is ψ , so that the aggregation of all spatial weights can be found.
Most of Moran’s I belong to (−1, 1), but there are also extreme cases, that is, Moran’s value appears outside this range [32]. When Moran’s I is closer to 1, the more pronounced the positive spatial correlation and the closer the relationship between cities. When Moran’s I is closer to −1, the more pronounced the negative spatial correlation and the greater the spatial difference between cities. When Moran’s I is 0, the space is random, indicating that cities are not correlated.

2.1.2. Local Gravitational Clustering

The data are grouped using LGC based on a spatial neighborhood matrix. LGC is a clustering algorithm based on local center metrics. It describes the connectivity of the adjacent regions of each sample point through local gravitational resultant force and centrality. By comparing clustering algorithms such as k-means clustering [33] and fuzzy c-means clustering [34], LGC has the advantage of being able to train singular values to obtain possible impact information [35].
Step 1: The local resultant force is calculated for each sample point.
The local resultant force (LRF) is the sum of the forces acting at point X i with mass m i , denoted as F X i .
F ( X i ) = 1 m i j = 1 k D ^ i j
where the reciprocal of all distance points acting on the k nearest neighbors of the data point X i is obtained by summing up m i .
m i = 1 j = 1 k D i j
D i j is a unit vector connecting two mass directions and k is the number of nearest neighbors around X i . The closer to the center, the greater the mass of the sample points and the less susceptible they are to other forces.
Step 2: Calculate the centrality (CE) and coordination (CO) values.
The relationship between LRF is measured by two metrics: centrality and coordination. Where the centrality of data point X i is calculated as follows:
C E i = j = 1 m cos ( F j , D i j ) m
where D i j is the displacement vector from X i ’s neighbor to X i , cos ( θ ) belongs to (−1, 1), and when C E i is greater than zero, it is pointed out that most of the neighbors point to it, indicating that it has better centrality.
The CO of data point X i is calculated as follows:
C O i = j = 1 m ( F i F j )
Among them, F i and F j are the local resultant forces of points X i and X j , and their neighbors, and a smaller local gravitational resultant force and a larger CE value are selected as local proxy points in their own domain, and the local proxy point should preferably appear above the direction pointed by the local gravitational resultant force of the sample point.
Step 3: Clustering is performed for each sample point  X i .
The current local proxy point selected in the previous step connects to communicate with other local proxy points. The current local proxy point looks for the target local proxy point in the neighborhood for connection communication, and if it cannot be found, the best sample is found in the neighborhood sample, and the intermediate communication point continues to complete the work. The intermediate communication point must have a C E value greater than 0 and be closer to the target proxy point than the origin. The local proxy point itself forms a small cluster, which forms a large cluster by communicating with the target proxy point.

2.2. Data Preprocessing Module

This stage introduces a new type of feature extraction model based on an improved Hampel filtering method called SHP. Since the default parameters of the adaptive Hampel filter cannot adapt to the characteristics of all data, we use the squirrel algorithm to optimize the DX (the scalar of the half-width of the filter window), T (the threshold used in the equation), and Threshold (adaptive threshold. The final minimum MAPE value is the optimization goal, and the data preprocessing algorithm for different urban agglomerations finds the best parameters and then obtains the optimal forecasting effect. The basic theoretical composition of the model is as follows.

2.2.1. Squirrel Search Algorithm

The SSA is a naturally inspired optimization paradigm that simulates the dynamic process of finding pinecones in southern flying squirrel gliding. Compared with other optimizations, SSA considers the seasonal factors of the data to be random factors, which disrupts the search space and improves the randomness of the optimization algorithm.
First, the position of the squirrel in the dimensional search space is represented using the following matrix:
F S = F S 11 F S 12 F S 1 d F S 21 F S 22 F S 2 d F S n 1 F S n 2 F S n d
where F S n d is the initial position. Next, random initialization is performed using the fol-lowing formula:
F S i = F S L + U ( 0 , 1 ) × ( F S U F S L )
where F S i is the updated position. U ( 0 , 1 ) denotes the randomness of the flying squirrel population contained in the range 0 to 1. F S U and F S L are the upper and lower limits, respectively.
Eventually, the squirrel colony locations are updated to the following matrix:
f = f 1 F S 11 F S 12 F S 1 d f 1 F S 21 F S 22 F S 2 d f 1 F S n 1 F S n 2 F S n d
The difference between the advantages and disadvantages of searching for food sources will depend on the different fitness levels of each flying squirrel’s location. Therefore, based on the initial position of the squirrel, the position fitness is calculated by determining the variables, namely the best food source (hickory tree F S h t ), normal food source (acorn tree F S a t ), and no food source (flying squirrel on normal tree F S n t ). Its position updating for three different foraging scenarios is mathematically modeled as follows.
Case 1: Best food source (hickory tree)
F S a t t + 1 = F S a t t + d g G c ( F S h t t F S a t t ) P d p R 1 R a n d o m   location otherwise
Case 2: Normal food source (acorn tree)
F S n t t + 1 = F S n t t + d g G c ( F S a t t F S n t t ) P d p R 2 R a n d o m   location otherwise
Case 3: No food source (flying squirrel on normal tree)
F S n t t + 1 = F S n t t + d g G c ( F S n t t F S n t t ) P d p R 3 R a n d o m   location otherwise
where d g is the random glide distance, R 1 , R 2 , R 3 is a random number in the range of [0, 1], F S n t t + 1 is the position of the squirrel reaching the hickory tree, and t is the current iteration. The sliding constant G c is used in the mathematical model to seek a balance between exploration and development. Its value has a non-negligible role in the performance of the proposed algorithm. In the current work, the value of G c is 1.9, which is derived from rigorous analysis. The predator presence probability P d p is 0.1 in all cases.
At the same time, in winter, due to low-temperature environmental conditions, squirrels tend to exercise on a small scale compared to other seasons and are mostly used to store pecans to maintain energy for the winter, so the influence of seasonal factors is considered. It can effectively solve the problem that the algorithm is trapped in the local optimal solution. Seasonal variables are expressed as:
S c t = k = 1 d ( F S a t , k t F S h t , k t ) 2
S m i n = 10 H 6 365 T ( T m / 2.5 ) 1
where k is the current iteration value and S m i n is a direct influence on the algorithm’s search and development capability. The larger the S m i n , the stronger the exploration capability, and the smaller the S m i n , the stronger the development capability.
After winter, flying squirrel foraging will be active again, considering that those squirrels that have not been able to find the best food source in winter but still survive will be able to forage again, and there is randomness, which will move in different directions.
The repositioning of the flying squirrel can be expressed by the equation as:
F S n t n e w = F S L + L é v y ( n ) ( F S U F S L )
where F S U and F S L are the upper and lower bounds of variables, L é v y is used to generate random solutions.
L é v y ( x = 0.01 × r a σ r b 1 / β )
where r a and r b are random number matrices belonging to (0, 1), β = 1.5. And σ is defined as follows:
σ = Γ ( 1 + β ) sin ( β π 2 ) Γ ( 1 + β 2 ) β 2 ( β 1 2 ) 1 / β
where Γ x = x 1 ! .

2.2.2. Hampel Filter

The Hampel filter is a decision filter used to detect and remove outliers [36]. Like the 3 σ rule, which distinguishes between the mean and standard deviation, it determines whether the data in the data set are a singular value by the median and the median that deviates from the absolute value of the median, and then replaces the outlier with the median of the short series in the filter movement window.
x i x > t S j = 1 , 2 , , N
S = 1.4286 m e d i a n x i x
where t is a predefined threshold for determining the absolute difference from the median, and x denotes the median of the data sequence of length N, and S is the median absolute difference (MAD) scale estimator. The constant 1.4286 guarantees that the expected value of S is equal to the standard deviation of the normal distribution data [37].

2.3. Fuzzy Information Forecasting Module

In this section, the basic theory of hesitant fuzzy time series is first described, followed by the details of the innovative hesitant fuzzy cognitive maps. This paper innovatively proposes hesitant fuzzy cognitive maps (HFCM) and introduces the hesitant fuzzy logic relationship to modify the output results of the fuzzy cognitive maps.

2.3.1. The Basic Definition of Hesitant Fuzzy Theory

Before constructing hesitant fuzzy cognitive maps for forecasting, let us review the definitions of fuzzy set, hesitant fuzzy set, and fuzzy time series (FTS). The basic theory is as follows [38].
Definition 1.
Define  U = u 1 , u 2 , , u n  the universe of discourse. A fuzzy set  A i j  in U can be defined by its membership function.
A i j = i = 1 n j = 1 m μ A i j ( x i j ) x i j = μ A 11 ( x 11 ) x 11 + μ A 12 ( x 12 ) x 12 + + μ A n m ( x n m ) x n m
where  A i j : U [ 0 , 1 ]  represents the membership function of the fuzzy set  A i j  and  μ A i j  represents the member degree of µ to  A i j .
Definition 2.
H , A i j , X  over the reference set  U = u 1 , u 2 , , u n  is represented by a mathematical expression as follows:
H = x i j , h H ( x i j ) x i j U
where  h H x i j  is the set of possible subsets in [0, 1] by membership function that computes the possible membership degrees of the elements in U to the set H.  P [ 0 , 1 ]  is the set of multiple subsets of [0, 1]. For the element  u U ,  h H u i  is called the hesitant fuzzy element (HFE).
Definition 3.
Let  Y ξ   ξ = 0 , 1 , 2 ,  , R (a subset of real number) be a universe of discourse. Different fuzzy sets  f i ξ   ξ = 0 , 1 , 2 ,  are defined on  Y ξ . If  F ξ  is a collection of  f i ξ   ξ = 0 , 1 , 2 , , then it is known that  F ξ  is called an FTS on  Y ξ   ξ = 0 , 1 , 2 , .
Definition 4.
Let  F ξ  be the FTS and  R ξ , ξ 1  be a first order model of  F ξ . If  R ξ , ξ 1 = R ξ 1 , ξ 2  for any time  ξ , then  F ξ  is designated as time-invariant FTS, otherwise  F ξ  is named as time-variant FTS.
Definition 5.
The fuzzy logic relation (FLR) can be expressed as  F ( ξ q ) F ( ξ ) , Their relationship can be expressed by the formula:
F ( ξ ) = F ( ξ q ) ο R ( ξ q , ξ )
where “ ο ” is a max-min composition operator, R ( ξ q , ξ ) is fuzzy relationship.
Definition 6.
The relationship between  F ( ξ )  and  F ( ξ q )  can be denoted as  A w A v  , where  A w  and  A v  are called the left-hand side and the right-hand side of the FLR, respectively. FLRs with the same left-hand side can be categorized into an ordered fuzzy logic group (FLG).

2.3.2. The FCM Framework

FCM consists of a set of nodes and weighted edges, which can be regarded as a weighted directed graph. The nodes represent the variables in the AQI time series, that is, each city in the urban agglomeration, and the edges represent the causal relationship between these nodes. The set of these concept nodes is represented as vector C, that is, the set of urban agglomerations. Each FCM containing N concepts can be defined by four elements, C , W , A , F , where C = C 1 , C 2 , , C N is the collection of concepts that represent all detected air quality indices. These concepts define the state value of t at any moment as a vector A i , that is, the AQI time series data of each city:
A i = A 1 , A 2 , , A N
where W c : C × C [ 1 , 1 ] is an N × N connection matrix representing the relationship from C i to C j .
The circular relationship between A ξ 1 and A ξ on ξ 0 is expressed as follows:
A i c k + 1 = f A i c k + j = 1 , j i m A i c k W i j
A i c ξ denotes the state value of node A i c at time ξ , A i c ξ + 1 denotes the value of node A i c at time ξ + 1 . The state value of the node at the (t + 1)-th iteration is determined by the weight matrix and state value of all connected nodes at the t-th iteration.
The f is the transfer function which simulates the forecasting process of the conceptual state of the c-th FCM model. It is the activation function that updates the activation state of the node at each iteration to perform a simulation of conceptual state forecasting.
f ( x ) = 1 1 + e λ x
where λ λ 0 acts as a regulator that determines the appropriate shape of the function and the speed at which the curve converges to the boundary. λ = 1 is commonly chosen.

2.3.3. Hesitant Fuzzy Processing Time Series

  • Step 1: Define the universe of discourse and divide the interval.
The universe of discourse is defined as U = [ D a min σ 1 , D a max + σ 2 ] . Among them, D a max and D a min are the maximum and minimum values of AQI data, respectively, σ 1 and σ 2 are the standard deviation of the training sample.
Then, the cumulative distribution function (CDF) is used to divide the equal frequency interval.
F ( x i c ) = Pr ( X x i c ) f o r < x i c <
To determine the optimal number of intervals, adaptive interval division is performed based on fuzzy c-means clustering. The cluster generated by clustering is regarded as a fuzzy set; the cluster center is the midpoint of the interval, and the size of the clustered category is the interval size.
u i j c = 1 c e n t e r = 1 k ( d i j c d i k c ) 2 f z 1
where u i j c is the membership degree between the sample point x i c and the cluster enter v j c , i is the sample, c is the city category, f z is the fuzzy index ( f z > 1 ), d i j c is the distance between the sample point x i c and cluster center v j c . The most common method for calculating the distance is Euclidean distance.
v j c = i = 1 n ( u i j c ) f z x i i = 1 n ( u i j c ) f z
  • Step 2: Calculate membership degree.
For the calculation of the weights w e h , w u h , this article uses the trigonometric membership function with the following formula:
w e h = d e d e + d u
w u h = d u d e + d u
where d e and d u are the equal and unequal spacing lengths calculated above, respectively.
The triangle membership function is used to calculate the membership degree on the interval divided by different methods, and the m b g e i , m b g u i is obtained. The triangle membership function formula is as follows:
t r i a n g l e ( x i c ; a , b , c ) = 0 x i c a x i c a b a a x i c b c x i c c b b x i c c 0 c x i c
The formula for aggregating hesitant fuzzy elements and constructing fuzzy sets, where the aggregation operator is used to calculate the member rank of the elements, is defined as follows:
O x 1 , x 2 , , x n = 1 i = 1 n 1 x i w i h
Based on Definition 3, the fuzzy set is determined according to the maximum membership principle. Because the air quality index lags one-stage correlation, the first-order fuzzy logic relationship is determined according to Definition 5. After that, the fuzzy relationship group is established based on Definition 6 by counting the frequency of fuzzy relationships in the training set.
  • Step 3: Build fuzzy relationship matrix.
The weight matrix is established by the elements in the fuzzy relationship matrix with the frequency of “ A w A v ” in the training set.
w 11 w 12 w 1 m w 21 w 22 w 2 m w m 1 w m 2 w m m = W 1 c , W 2 c , , W m c
where w i j [ 0 , 1 ] , i , j = 1 , 2 , , m . It is the result of weighting the frequency of each fuzzy relationship.
  • Step 4: Defuzzify
Fuzzy output is obtained on the basis of hesitant fuzzy relations. Before that, the combined midpoints of the equal and unequally spaced trigonometric membership functions are calculated as follows:
C M = M e w e h + M u w u h e e h + e u h
where M e ; w e h and M u ; w u h are the midpoints and weights of the membership functions in the interval of equality and inequality, respectively. Use the following formula to defuzzify them for numerical forecasting.
N F = f i C M i f i
where f i is the fuzzified output obtained by applying the max–min combination operation on fuzzy logic relationships (FLR).
The pseudo-code of the data hesitant fuzzification process of Algorithm 1 is as follows:
Algorithm 1: HFCM
Objective function: min (MAPE) = 1 n i = 1 n y ^ i ( x ) y i ( x ) y i ( x ) × 100 %
Input:  x 1 c , x 2 c , x 3 c , , x n c —a sequence of sample data.
    h 1 c , h 2 c , h 3 c   h n c —a sequence of FCM output
Output:  M A P E ( r , : ) = 1 n i = 1 n y ^ i ( x ) y i ( x ) y i ( x ) × 100 % R M S E ( r , : ) = 1 n i = 1 n y i ( x ) y i ( x ) 2 M A E ( r , : ) = 1 n i = 1 n y ^ i ( x ) y i ( x )
Parameters:
ip: number of the intervals
i: i-th sample
j: 0 a d a p t i v e   d i v i s i o n   i n t e r v a l 1 e q u a l   f r e q u e n c y   d i v i s i o n   i n t e r v a l
L o ( N ) : the left endpoint of the adaptive division interval
U p N : the right endpoint of the adaptive division interval
P L B N : the left endpoint of the equal frequency division interval
P U B N : the right endpoint of the equal frequency division interval
m b g e i : the membership degree of the adaptive division interval
m b g u i : the membership degree of the equal frequency division interval
nn: min number of the intervals
mm: max number of the intervals
1:/* Initialize the data and convert it into growth rate */
2:/* Define the universe of discourse */
3:FOR ip = nn: mm (number of the intervals); N = ip;
4:  /* Calculate L o ( N ) ; U p ( N ) by cumulative distribution function. (Equation (26)) */
5:  /* Calculate   P L B N ; P U B ( N )  by fuzzy c-means clustering (Equation (27)) */
6:  /* Calculate the weights of different intervals */
7:       d e = P U B ( N ) P L B ( N ) ,   d u = U p N L o N ;
8:       w e = d e / d e + d u ,   w u = d u / d e + d u
9:  /* Calculate   m b g e i ;   m b g u ( i ) */
10:  Calculate: Membership grades u ( i ) = 1 ( ( 1 m b g e ( i ) ) w e ) × ( ( 1 m b g u ( i ) ) w u ) ;
11:  /* Judgment fuzzy sets */   u k i = m a x   ( u 1 i , u 2 i , u 3 i . , u j i ) , 1 < k < n
12:    IF H A k  is fuzzy set corresponding to   u k i
13:      Assign fuzzy set   H A k to x i c
14:    END
15:     IF   H A i is fuzzy production of day n, and   H A K is fuzzy production of day n + 1
16:       F u z z y   l o g i c   r e l a t i o n s h i p = H A 1 H A 2 ,   ,   H A i H A j
17:    END
18:  /* Determine the fuzzy logic relation group */
19:  /* Count the frequency of each logical relationship */
20:  /* Calculate the percentage rate of each occurrence logic */
21:  /* Calculate the weight matrix and normalize the weight. */
22:  Calculate:  g r a d e i , j = t r i m f   h 1 c , h 2 c , h 3 c   h n c ,   L o w e r j   ,   m i d _ p o i n t j ,   U p p e r ( j ) ;
23:  /* The maximum membership principle determines the fuzzy set to which it belongs. */
24:  Calculate:  c o m b i n e d   m i d = w e .   * m i d _ p o i n t j + w u .   * m i d _ p o i n t j .   / w e + w u ;
25:  /* Defuzzification to obtain the predicted value */
26:  /* Turning growth rates into data y ^ i ( x ) */
27:END
28: r , c = f i n d M A P E = = m i n M A P E
29:Returned: r (The location of the optimal concept)

2.4. Error Evaluation Module

To evaluate the superiority of the proposed system, the error evaluation module was constructed, which contained three statistical indicators and two test models.

2.4.1. Error Test

The following three statistical indicators were employed to evaluate the effectiveness of the predictive model: mean absolute percentage error (MAPE), root mean square error (RMSE), and mean absolute error (MAE). They are defined as:
M A P E = 1 n i = 1 n y ^ i ( x ) y i ( x ) y i ( x ) × 100 %
R M S E = 1 n i = 1 n y i ( x ) y i ( x ) 2
M A E = 1 n i = 1 n y ^ i ( x ) y i ( x )
where y ^ i ( x ) is the forecasting data, y i ( x ) is the original data, and i is the number of samples.

2.4.2. Hypothesis Testing

This section uses the Diebold–Mariano (DM) test [39] and the modified Diebold–Mariano (MDM) test [40] to evaluate hypothesis testing methods for the predictive performance of different models. Its theory is described below.
The raw data is u t n , and for the two forecasting sequences ε j t and ε k t , their error can be calculated by the following formula:
e r j t n = ε j t u t n
e r k t n = ε k t u t n
ψ e r j t n = e r j t n 2
ψ e r k t n = e r k t n 2
At this point, the difference between the two error sequences d i f f t can be defined as follow:
d i f f t = ψ e j t n ψ e r k t n
The null and alternative hypotheses are set as follows:
H 0 : E d i f f t = z e r o ; H 1 : E d i f f t z e r o ;
The DM statistic follows a standard normal distribution and can be calculated as:
D M = d i f f ¯ / S 2 / T 1
Specifically, T is the number of advance multi-step forecasting. Where d i f f ¯ , S 2 can be defined as:
d i f f ¯ = T 1 t = 1 T d i f f t
S 2 = T 1 1 t = 1 T d i f f t d i f f ¯ 2
However, efficient T-period forecasting has forecasting errors after the M A T 1 process, so MDM is proposed to solve this problem with the assumption that “no observed” lag has zero covariance. The DM statistic is compared with the cut-off value Z α / 2 . If Z α / 2 D M Z α / 2 , accept the null hypothesis, indicating that there is no difference in the forecasting effect of the two models; If D M > Z α / 2 or D M < Z α / 2 , the null hypothesis was rejected, indicating that the difference in forecasting performance between the two models was not caused by accidental factors.

3. Results

This section includes three parts: data description, spatial feature capture, and model comparison experiments. What is more, three sets of comparison experiments are established to verify the validity of the forecasting of the proposed spatiotemporal mixture model.

3.1. Study Area and Data Description

To verify the accuracy and effectiveness of the proposed model, the Beijing-Tianjin-Hebei region was selected as the research object. The site of the study is shown in Figure 2.
China’s major urban agglomerations with high levels of economic development are Beijing-Tianjin-Hebei, Yangtze River Delta, and Pearl River Delta. Among them, the Beijing-Tianjin-Hebei region is not only a representative area of China’s economic development but also a typical area with serious air pollution [41]. Due to the high population density in the region, the proportion of heavy industry [42], industrial transfer [43], and other factors, the air environment problem has become increasingly prominent. While the Beijing-Tianjin-Hebei region has coordinated economic development [44], air quality between different cities also has a certain mutual influence [45]. The air pollution problem of the Beijing-Tianjin-Hebei urban agglomeration has become a topic of general concern for the Chinese government, the media, and the public. So, it is typical to select the Beijing-Tianjin-Hebei region as the research object.
This study uses daily AQI data from 1 January 2017 to 31 August 2022, for 13 cities with a total of 2069 observations. Daily AQI data were collected from http://www.tianqihoubao.com (accessed on 10 September 2022). AQI is a comprehensive indicator of air quality [46], and the higher the value, the more serious the pollution. It was calculated according to the National Ambient Air Quality Standard of China (GB3095-2012) [47], including sulfur dioxide (SO2), nitrogen dioxide (NO2), PM2.5, PM10 (particulate matter with particle size less than or equal to 10 μm), ozone (O3), carbon monoxide (CO), and other six pollutants [18] to comprehensively reflect the regional air quality and pollution degree. Comprehensive AQI can emphasize the possible chronic health effects of air pollution and long-term damage to the environment. Compared with the air pollution index (API) [48], the detection of pollutants is more comprehensive, the grading restriction standards are stricter, and the evaluation results are more objective. Specifically, the air pollution level is divided into seven attribute categories according to the air quality index (AQI), as shown in Table 1.
When the air pollution index is less than 100, people can engage in normal activities. When the air quality index reaches mild pollution (100~200), patients with heart disease and respiratory diseases should reduce physical consumption and outdoor activities; when the air quality index reaches 200~300, healthy people ought to reduce outdoor ac-tivities. Additionally, the elderly and patients with heart disease and lung disease should stay indoors and reduce physical activity; when heavy pollution (air quality index above 300) is reached, healthy people should also avoid outdoor activities.
Statistical analysis of daily data is shown in Table 2.
From Table 2, in the Beijing-Tianjin-Hebei region, Shijiazhuang and Chengde have the best air quality situation, with mean values of 59.69 and 59.34, respectively, and less fluctuation, with variances of 31.2 and 36.17. In comparison, Handan has the worst air quality and a larger variation, indicating that the air pollution level fluctuates more seri-ously in the process of economic and social development.

3.2. Spatial Feature Extraction Results

For each city, the annual average of daily AQI data is taken as the data for Moran’s index, and the geographical distance matrix is used to describe the static spatial correlation between cities, so as to further use the model to summarize the neighborhood characteristics of the target city for spatiotemporal forecasting.

3.2.1. Spatial Autocorrelation

Table 3 shows the calculation results of the global Moran index to verify whether it is spatially correlated. The average daily data for one year was taken as the calculation data for Moran’s index. Figure 3 is the Moran scatter plot, which visually shows the distribu-tion of AQI clusters in various cities and further explores the degree of spatial correlation in a specific area. Table 4 shows the distribution trend of the Moran index, from which there is a temporal and spatial transfer process for the AQI.
Table 3 shows the AQI of thirteen cities in the Beijing-Tianjin-Hebei region from 2017 to 2022. It can be seen from the table that the Moran index has passed the 5% confidence test and is positive. The results showed that there was a positive spatial correlation, the AQI tended to be agglomerated in space, and the distribution of the air quality index was concentrated and encircled.
As shown in Figure 3, the Moran scatter plot set for each city’s AQI is distributed in the first and third quadrants, indicating a significant positive contribution of each city’s air quality in the local space. The total number of cities located in the 1,3-quadrant re-mained unchanged at 0.77 in the total sample. Most cities maintain similar cluster charac-teristics to their neighbors.
In addition, only three cities have experienced location migration of the Moran scat-tering point, namely, Chengde, Langfang, and Hengshui. Among them, Hengshui and Langfang return to their original spatial states after being influenced by the surrounding environment, while Cangzhou, which was at low air pollution, completely changes its original state and enters the HL region under the influence of high surrounding air pollu-tion. This indicates that the air quality of Chinese urban agglomerations is highly spatially correlated, that air pollution between urban agglomerations is interacting, and that the magnitude of the effect is not the same.

3.2.2. Local Gravitational Clustering

As described in Section 3.2.1, the AQI is spatially dependent. Non-independent air quality may affect clustered data with interdependent observations. Because the AQI is a comprehensive index, it can reflect the air quality of the city. Therefore, the daily AQI data of different cities are used as clustering variables to cluster cities.
It can be seen from Figure 4 that the cities are divided into three different classes of air quality categories, showing good zonal differences and regional similarities.
Category I includes five cities: Shijiazhuang, Hengshui, Baoding, Xingtai, and Han-dan. This type of urban agglomeration is in the plains and has poor air pollution dispel-sion conditions. It is a heavy industrial city close to the inland, with many polluting industries superimposed on the transmission of air pollution from western Lu and north-ern Yu, where air pollution is most serious.
Category II includes five cities: Beijing, Cangzhou, Langfang, Tianjin, and Tangshan. Due to the large population and rapid economic development, in which the steel industry in Tangshan, coal in Cangzhou, and cement in Langfang were coupled, pollution is serious and air quality is deteriorating.
Category III includes three cities: Chengde, Qinhuangdao, and Zhangjiakou. Tour-ism-driven economic development, a few polluting industries, and mountainous terrain limit the flow and interaction of the atmosphere between the three cities and other cities, thus keeping air quality low.
Therefore, in order to continuously improve the environmental benefits and air qual-ity of the Beijing-Tianjin-Hebei region, the interaction between its cities cannot be ignored, and it is necessary to establish an improvement mechanism according to its geographical location, industrial structure, and economic development level to achieve the coordinated development of the Beijing-Tianjin-Hebei region.

3.3. Model Comparison Results

Based on the above experimental purposes, this section establishes three comparative experiments and uses the same evaluation index system to verify the forecasting performance.

3.3.1. Feature Extraction Strategy

Due to the variability and nonlinearity of AQI in time series changes, it is difficult to accurately predict. In addition, there are many factors affecting air quality, including pol-icy factors, natural factors, etc., which are prone to fluctuations and singular values. Out-liers are data with significant deviations from most observations, which interfere with the training efficiency of the model. Removing outliers can improve forecasting accuracy. Therefore, before the experimental forecasting, it is necessary to test and correct the outli-ers of the data.
To illustrate the excellence of the optimized Hempel filtering in detecting and cor-recting outliers, comparative models based on different optimization algorithms were de-veloped, including the dragonfly algorithm (DA), SSA, and the honey badger algorithm (HBA). The comparison experiments were FCM and DHP-FCM, FCM and SHP-FCM, and FCM and HHP-FCM. The specific results are shown in Table 5 and Figure 5.
From Table 5, it can be seen that the SHP-FCM model has the best performance on MAPE, RMSE, and MAE compared to other optimization models for Category I, Category II, and Category III. In addition, the SSA algorithm has an outstanding advantage in find-ing the best model parameters to build a better hybrid model. In the three urban clusters, the MAPE metrics were reduced by 1.6%, 10.5%, and 5.8% compared to those optimized using the SSA algorithm. This finding has been confirmed in several application scenarios.
Remark 1.
SHP not only removes significantly deviated data and reduces interference with the model training rate, but also reduces data variability and preserves original features. Furthermore, from the residual sequence of the right diagram, it can be seen that the processed data and the original data only change slightly, and only the median substitution in the data pane is performed on the extreme data. Therefore, the data preprocessing in this paper will not cause information loss to the data.

3.3.2. Probabilistic Hesitation Fuzzy Set Strategy

In the previous section, it was known that SHP is superior to DHP and HHP through comparative experiments. In the setting of SHP to extract data features, in order to verify the effectiveness of the HFCM prediction system constructed by combining the hesitant fuzzy information set strategy, FCM and Gaussian smooth fuzzy cognitive maps (GFCM) are also constructed for comparative experiments. The experimental results are shown in Table 6, Figure 6 and Figure 7.
The results in Table 6 showed that adaptive feature extraction using the Hampel fil-tering algorithm on the original data significantly improved forecasting accuracy com-pared to the direct use of fuzzy cognitive maps. In the comparison of the first type of model to improve the forecasting effect of the original single model, in the case of MAPE, the proposed model decreased by 94.1083% compared with FCM. And GFCM decreased by 17.7548% compared with FCM. In addition, MAE and RMSE also showed different degrees of improvement in each type of urban cluster. Taking Beijing as an example, SHP-FCM and SHP-GFCM are 24.95 and 17.06 higher than the RMSE of SHP-HFCM, respect-tively. The proposed model SHP-HFCM in Shijiazhuang has MAPE, RMSE, and MAE of 1.12%, 4.33, and 0.69, respectively, which are significantly less than the other two compar-ison models.
In particular, the third type of urban agglomeration has the best forecasting accuracy. In all evaluation indicators, the feature extraction strategy based on SHP is significantly better than the hybrid forecasting system based on ordinary fuzziness and Gaussian smoothing.
Remark 2.
HFCM has non-negligible advantages over FCM and GFCM in data forecasting. The proposed novel hesitant fuzzy cognitive maps can not only effectively eliminate uncertain infor-mation and unstable elements in time series but also be a promising method for processing the characteristics of time series forecast data itself.

3.3.3. Comparison of Mixed Models in Different Data Preprocessing Environments

In addition, to show the scalability of hesitant, ambiguous information, the third comparison model is established. The FCM, HFCM, and GFCM data processing methods in the SHP, DHP, and HHP cases were compared. The results are shown in Table 7 and Figure 8.
Table 7 shows the performance indicator values for all submodules launched for the three considered environments. Especially taking the third type of urban agglomeration as an example, S H P H F C M C h e n g d e M A P E = 0.49 , S H P H F C M C h e n g d e R M S E = 0.62 , S H P H F C M C h e n g d e M A E = 0.23 , so for the same data preprocessing environment, the model using the HFCM method is better than the model using the FCM and the GFCM. In addition, the MAPE values for various hybrid forecasting systems are S H P H F C M B e i j i n g M A P E = 1.48 , S H P H F C M S h i j i a z h u a n g M A P E = 1.12 , S H P H F C M C h e n g d e M A P E = 0.62 , thus it is concluded that SSA plays an important role in HFCM forecasting. After comprehensive comparison, the proposed model has a good effect in the forecasting of pollutant concentration series.
Remark 3.
In different data preprocessing scenarios, the submodule with the best predictive per-formance is uniquely identified. The hybrid forecasting system based on HFCM constructed in this paper achieves the best results of all evaluation indicators under different data processing environ-ments. This property has been demonstrated in three different scenarios.

4. Discussion

4.1. Robustness of the Proposed Model

The purpose of the robustness test is to investigate whether the daily data are non-stationary when the air quality receives the impact of high pollution. At this time, whether the model can still work normally and whether the forecasting accuracy fluctuates greatly are evaluated in this test. In this experiment, the data of the training set increases the ran-dom number in the range of (−2, 2), which is considered to be from random interference; then, observe the changes of each performance index; the comparison results are shown in Table 8.
Before and after adding random disturbance, the MAPE values of Beijing were 1.39% and 1.48%, respectively; only 0.09% changed, and the same was true for other cities. After adding random disturbances, the forecasting accuracy of the proposed model changed slightly: Shijiazhuang changed by 0.29%, and Chengde changed by 0.18%. It can also be seen from Table 7 that the average RMSE of the three observation cities of the original data model is 17.63, 21.03, and 13.50, respectively. Compared with the model with increased disturbance, the values of MAPE change by 2.49, 0.82, and 0.3, respectively, which clarifies that the random disturbance will not affect the forecasting performance. In addition, for the original data model, taking the predicted value of Beijing as an example, the average MAE is 12.45, and the standard deviation is 9.22. From the model, after increasing the disturbance, the average MAE increases slightly, the standard deviation increases to 13.97, the change range is 1.52, and the standard deviation change range is 1.36, which indicates that the random disturbance is not significant.
In summary, by observing the fluctuation of the forecasting results of each city, the forecasting performance of the model proposed in this paper has not changed significantly and still maintains an outstanding forecasting effect. Therefore, there is enough evidence to prove that although the air quality will be affected by other factors, such as high pollu-tion or other abnormal conditions, the proposed model can still have stability.

4.2. Differences of the Proposed Model

The discrepancy test of the forecasting system proposed in this paper will be further discussed in this section. To test whether the forecasting performance of the proposed hybrid forecasting model is significantly different from other forecasting models, the DM test and the MDM test are used to perform statistical tests.
From the experimental results in Table 9, the loss series of the proposed hybrid fore-casting system passed the significance test at the 5% confidence level. It denotes that the proposed hybrid forecasting system has higher forecasting efficiency than other hybrid strategies, and it is not a coincidence that the forecasting is significantly different.
Compared with other models, the model proposed in this paper has the best results in any possible data environment. On the one hand, it performs spatial effect analysis and data feature extraction before data forecasting, which can better utilize the spatial and data features of the data for subsequent forecasting, and this is the excellence of the model. On the other hand, the system continuously updates the output conceptual values after k iterations by combining the geographic location of each data and does not directly output the forecasting results, but it eliminates the uniqueness of the data itself through fuzzy time series, and the forecasting results are more superior.

4.3. Application of the Proposed Model

The proposed model not only has outstanding forecasting performance but also has potential functions in practical applications. The early warning system consists of three modules: spatial feature analysis module, data preprocessing module, and fuzzy infor-mation prediction module. The following analyzes its practical significance from these three modules.
  • Air pollution has spatial spillover effects, so the spatial feature analysis module can comprehensively consider the interaction of urban agglomerations. In addition, it also provides theoretical support for the formulation of pollution control policies among urban agglomerations and facilitates coordinated governance among urban agglomerations.
  • In fact, air quality is affected by many factors, including information ambiguity and uncertainty. Through the data preprocessing module, it can remove the outliers and noise from the data, making the data features more obvious and achieving better forecasting performance.
  • Accurate AQI forecasting results can provide early warning information for actual life and production activities. From the perspective of the public, the forecasting of air quality can let the public understand the air quality, the scope of air quality dete-rioration, the degree of deterioration, and the development trend; secondly, it guides the daily activities and behaviors of residents, protects the physical and mental health of the people, and reduces the incidence of diseases. From the perspective of social economy, it can not only provide the theoretical basis for pollution control measures, such as strict control of motor vehicle pollution, reduction of coal consumption, shut-down of polluting enterprises, control of construction sites and road dust, and super-vision of factories with large pollutant emissions.

5. Conclusions

In terms of application, it is profoundly important to make accurate forecasts of air quality. The air environment is an important guarantee for people’s health and production safety, and understanding real-time AQI can provide a theoretical basis for establishing an early warning system on the one hand, and a tool for implementing pollution control policies on the other. However, because AQI has the complexity and nonlinearity of time series changes, and has spatial correlation among urban clusters, it is difficult to make accurate forecasting. Coupled with the fact that it is influenced by many factors and prone to fluctuations and singular values, it is even more challenging for the forecasting effect of the model. Therefore, this paper proposes a novel spatiotemporal hybrid forecasting system to realize the time series forecasting of AQI. Three comparative experiments were established using the air quality indices of thirteen cities in the Beijing-Tianjin-Hebei re-gion of China to analyze and demonstrate, and the results are as follows:
  • First, the spatial feature extraction module is built. The module successfully extracted the spatial overflow features, captured the dynamic transition of air quality, and per-formed cluster analysis with different sizes and weights for irregular data.
  • The adaptive Hampel filtering model improved by SSA is the best data processing sub-module for comparison with FCM, DHP-FCM, and HHP-FCM.
  • The first proposed HFCM forecasting model plays an irreplaceable role in time series forecasting in the same data preprocessing environment. The model reduced MAPE by 94.1083%, 96.9120%, and 98.2361% for three different urban clusters.
  • In the environment of different data preprocessing methods, the model proposed in this paper can still make accurate forecasts for data with large fluctuations and mu-tations. MAPE, RMSE, and MAE reach the minimum values in the three urban ag-glomerations.
In summary, the proposed air quality forecasting system has outstanding forecasting performance in handling low-quality and large-noise data. Although the model makes an accurate prediction by analyzing the spatial correlation between the target city and the adjacent city and excavating its internal relationship, this study also has shortcomings, and the stability needs to be improved when optimizing the Hampel parameter values for single objectives. In future research, we can consider a multi-objective optimization algorithm and select other urban agglomerations for research to further verify the superiority of the forecasting model proposed in this paper for air quality index forecasting.

Author Contributions

X.G. conceptualization, methodology, software, writing—original draft preparation; H.L. validation, formal analysis, writing—review and editing, supervision; H.F. methodology, resources, data curation, investigation. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Youth Program of National Natural Science Foundation of China (Grant No. 72201054), Excellent Youth Program of Natural Science Foundation of Heilongjiang Province of China (Grant No. YQ2022G001), Youth Program of Philosophy and Social Science planning project (Grant No. 22GLC278) and Central Universities Basic Research Business Special Funds project (Grant No. 2572021BM01).

Data Availability Statement

No additional data are available.

Conflicts of Interest

The authors declare no conflict of interest.

Nomenclature

The abbreviations for each name are as follows:
ARAuto-regressive model
ANNArtificial neural network
APIAir pollution index
AQIAir quality index
ARMAAuto-regressive moving average model
CDFCumulative distribution function
CECentrality
COCoordination
DADragonfly algorithm
DMDiebold–Mariano
FCMFuzzy cognitive maps
FLGFuzzy logic group
FLRFuzzy logic relation
FTSFuzzy time series
HBAHoney badger algorithm
HFCMHesitant fuzzy cognitive maps
LGCLocal gravitational clustering
LRFLocal resultant force
MAMoving average model
MADMedian absolute difference
MAEMean absolute error
MAPEMean absolute percentage error
MDMModified Diebold–Mariano
RFRandom foresting
RMSERoot mean square error
RNNRecurrent neural network
SSASquirrel search algorithm
SVMSupport vector machine

References

  1. Wang, Y.; Yao, L.; Xu, Y.; Sun, S.; Li, T. Potential Heterogeneity in the Relationship between Urbanization and Air Pollution, from the Perspective of Urban Agglomeration. J. Clean. Prod. 2021, 298, 126822. [Google Scholar] [CrossRef]
  2. Ulpiani, G. On the Linkage between Urban Heat Island and Urban Pollution Island: Three-Decade Literature Review towards a Conceptual Framework. Sci. Total Environ. 2021, 751, 141727. [Google Scholar] [CrossRef] [PubMed]
  3. Wei, J.; Guo, X.; Marinova, D.; Fan, J. Industrial SO2 Pollution and Agricultural Losses in China: Evidence from Heavy Air Polluters. J. Clean. Prod. 2014, 64, 404–413. [Google Scholar] [CrossRef] [Green Version]
  4. de Groot, P.; Munden, R.F. Lung Cancer Epidemiology, Risk Factors, and Prevention. Radiol. Clin. N. Am. 2012, 50, 863–876. [Google Scholar] [CrossRef] [PubMed]
  5. Poursafa, P.; Mansourian, M.; Motlagh, M.-E.; Ardalan, G.; Kelishadi, R. Is Air Quality Index Associated with Cardiometabolic Risk Factors in Adolescents? The CASPIAN-III Study. Environ. Res. 2014, 134, 105–109. [Google Scholar] [CrossRef]
  6. Rajagopalan, S.; Brook, R.D. Air Pollution and Type 2 Diabetes: Mechanistic Insights. Diabetes 2012, 61, 3037–3045. [Google Scholar] [CrossRef] [Green Version]
  7. Chen, P.; Yuan, Z.; Miao, L.; Yang, L.; Wang, H.; Xu, D.; Lin, Z. Acute Cardiorespiratory Response to Air Quality Index in Healthy Young Adults. Environ. Res. 2022, 214, 113983. [Google Scholar] [CrossRef]
  8. Soman, S.S.; Zareipour, H.; Malik, O.; Mandal, P. A Review of Wind Power and Wind Speed Forecasting Methods with Different Time Horizons. In Proceedings of the North American Power Symposium 2010, Online, 26–28 September 2010; pp. 1–8. [Google Scholar]
  9. Li, Y.; He, Y.; Su, Y.; Shu, L. Forecasting the Daily Power Output of a Grid-Connected Photovoltaic System Based on Multivariate Adaptive Regression Splines. Appl. Energy 2016, 180, 392–401. [Google Scholar] [CrossRef]
  10. You, J.; Yu, C.; Sun, J.; Chen, J. Generalized Maximum Entropy Based Identification of Graphical ARMA Models. Automatica 2022, 141, 110319. [Google Scholar] [CrossRef]
  11. Liu, C.-C.; Lin, T.-C.; Yuan, K.-Y.; Chiueh, P.-T. Spatio-Temporal Prediction and Factor Identification of Urban Air Quality Using Support Vector Machine. Urban Clim. 2022, 41, 101055. [Google Scholar] [CrossRef]
  12. Murillo-Escobar, J.; Sepulveda-Suescun, J.P.; Correa, M.A.; Orrego-Metaute, D. Forecasting Concentrations of Air Pollutants Using Support Vector Regression Improved with Particle Swarm Optimization: Case Study in Aburrá Valley, Colombia. Urban Clim. 2019, 29, 100473. [Google Scholar] [CrossRef]
  13. Yoo, B.H.; Kim, K.S.; Park, J.Y.; Moon, K.H.; Ahn, J.J.; Fleisher, D.H. Spatial Portability of Random Forest Models to Estimate Site-Specific Air Temperature for Prediction of Emergence Dates of the Asian Corn Borer in North Korea. Comput. Electron. Agric. 2022, 199, 107113. [Google Scholar] [CrossRef]
  14. Noi, P.T.; Degener, J.; Kappas, M. Comparison of Multiple Linear Regression, Cubist Regression, and Random Forest Algorithms to Estimate Daily Air Surface Temperature from Dynamic Combinations of MODIS LST Data. Remote Sens. 2017, 9, 398. [Google Scholar] [CrossRef] [Green Version]
  15. Goudarzi, G.; Hopke, P.K.; Yazdani, M. Forecasting PM2.5 Concentration Using Artificial Neural Network and Its Health Effects in Ahvaz, Iran. Chemosphere 2021, 283, 131285. [Google Scholar] [CrossRef] [PubMed]
  16. Fallahizadeh, S.; Kermani, M.; Esrafili, A.; Asadgol, Z.; Gholami, M. The Effects of Meteorological Parameters on PM10: Health Impacts Assessment Using AirQ+ Model and Prediction by an Artificial Neural Network (ANN). Urban Clim. 2021, 38, 100905. [Google Scholar] [CrossRef]
  17. Zhang, J.; Li, S. Air Quality Index Forecast in Beijing Based on CNN-LSTM Multi-Model. Chemosphere 2022, 308, 136180. [Google Scholar] [CrossRef]
  18. Zhu, S.; Lian, X.; Liu, H.; Hu, J.; Wang, Y.; Che, J. Daily Air Quality Index Forecasting with Hybrid Models: A Case in China. Environ. Pollut. 2017, 231, 1232–1244. [Google Scholar] [CrossRef]
  19. Liu, Z.; Liu, J. A Robust Time Series Prediction Method Based on Empirical Mode Decomposition and High-Order Fuzzy Cognitive Maps. Knowl.-Based Syst. 2020, 203, 106105. [Google Scholar] [CrossRef]
  20. Yang, S.; Liu, J. Time-Series Forecasting Based on High-Order Fuzzy Cognitive Maps and Wavelet Transform. IEEE Trans. Fuzzy Syst. 2018, 26, 3391–3402. [Google Scholar] [CrossRef]
  21. Liang, W.; Zhang, Y.; Liu, X.; Yin, H.; Wang, J.; Yang, Y. Towards Improved Multifactorial Particle Swarm Optimization Learning of Fuzzy Cognitive Maps: A Case Study on Air Quality Prediction. Appl. Soft Comput. 2022, 130, 109708. [Google Scholar] [CrossRef]
  22. Korkmaz, D. SolarNet: A Hybrid Reliable Model Based on Convolutional Neural Network and Variational Mode Decomposition for Hourly Photovoltaic Power Forecasting. Appl. Energy 2021, 300, 117410. [Google Scholar] [CrossRef]
  23. Wu, Q.; Lin, H. Daily Urban Air Quality Index Forecasting Based on Variational Mode Decomposition, Sample Entropy and LSTM Neural Network. Sustain. Cities Soc. 2019, 50, 101657. [Google Scholar] [CrossRef]
  24. Zhu, S.; Lian, X.; Wei, L.; Che, J.; Shen, X.; Yang, L.; Qiu, X.; Liu, X.; Gao, W.; Ren, X.; et al. PM2.5 Forecasting Using SVR with PSOGSA Algorithm Based on CEEMD, GRNN and GCA Considering Meteorological Factors. Atmos. Environ. 2018, 183, 20–32. [Google Scholar] [CrossRef]
  25. Li, H.; Wang, J.; Lu, H.; Guo, Z. Research and Application of a Combined Model Based on Variable Weight for Short Term Wind Speed Forecasting. Renew. Energy 2018, 116, 669–684. [Google Scholar] [CrossRef]
  26. Yang, W.; Hao, M.; Hao, Y. Innovative ensemble system based on mixed frequency modeling for wind speed point and interval forecasting. Inf. Sci. 2023, 622, 560–586. [Google Scholar] [CrossRef]
  27. Yang, W.; Sun, S.; Hao, Y.; Wang, S. A novel machine learning-based electricity price forecasting model based on optimal model selection strategy. Energy 2022, 238, 121989. [Google Scholar] [CrossRef]
  28. Lv, Y.-W.; Yang, G.-H. Centralized and Distributed Adaptive Cubature Information Filters for Multi-Sensor Systems with Unknown Probability of Measurement Loss. Inf. Sci. 2023, 630, 173–189. [Google Scholar] [CrossRef]
  29. Liu, X.; Zhong, S.; Li, S.; Yang, M. Evaluating the Impact of Central Environmental Protection Inspection on Air Pollution: An Empirical Research in China. Process Saf. Environ. Prot. 2022, 160, 563–572. [Google Scholar] [CrossRef]
  30. Moran, P.A.P. The Interpretation of Statistical Maps. J. R. Stat. Soc. Ser. B 1948, 10, 243–251. [Google Scholar] [CrossRef]
  31. Zhang, C.; Luo, L.; Xu, W.; Ledwith, V. Use of Local Moran’s I and GIS to Identify Pollution Hotspots of Pb in Urban Soils of Galway, Ireland. Sci. Total Environ. 2008, 398, 212–221. [Google Scholar] [CrossRef]
  32. On Extreme Values of Moran’s I and Geary’s c—Jong—1984—Geographical Analysis—Wiley Online Library. Available online: https://onlinelibrary.wiley.com/doi/10.1111/j.1538-4632.1984.tb00797.x (accessed on 8 May 2023).
  33. Sadeghi, M.; Naghedi, R.; Behzadian, K.; Shamshirgaran, A.; Tabrizi, M.R.; Maknoon, R. Customisation of Green Buildings Assessment Tools Based on Climatic Zoning and Experts Judgement Using K-Means Clustering and Fuzzy AHP. Build. Environ. 2022, 223, 109473. [Google Scholar] [CrossRef]
  34. Setiawan, K.E.; Kurniawan, A.; Chowanda, A.; Suhartono, D. Clustering Models for Hospitals in Jakarta Using Fuzzy C-Means and k-Means. Procedia Comput. Sci. 2023, 216, 356–363. [Google Scholar] [CrossRef] [PubMed]
  35. Kaloni, S.; Singh, G.; Tiwari, P. Nonparametric Damage Detection and Localization Model of Framed Civil Structure Based on Local Gravitation Clustering Analysis. J. Build. Eng. 2021, 44, 103339. [Google Scholar] [CrossRef]
  36. Liu, H.; Shah, S.; Jiang, W. On-Line Outlier Detection and Data Cleaning. Comput. Chem. Eng. 2004, 28, 1635–1647. [Google Scholar] [CrossRef]
  37. Allen, D.P. A Frequency Domain Hampel Filter for Blind Rejection of Sinusoidal Interference from Electromyograms. J. Neurosci. Methods 2009, 177, 303–310. [Google Scholar] [CrossRef]
  38. Song, Q.; Chissom, B.S. Forecasting Enrollments with Fuzzy Time Series—Part II. Fuzzy Sets Syst. 1994, 62, 1–8. [Google Scholar] [CrossRef]
  39. Diebold, F.X.; Mariano, R.S. Comparing Predictive Accuracy. J. Bus. Econ. Stat. 2002, 20, 134–144. [Google Scholar] [CrossRef]
  40. Harvey, D.; Leybourne, S.; Newbold, P. Testing the Equality of Prediction Mean Squared Errors. Int. J. Forecast. 1997, 13, 281–291. [Google Scholar] [CrossRef]
  41. Zheng, D.; Shi, M.; Pang, R. Agglomeration Economies and Environmental Regulatory Competition: Evidence from China. J. Clean. Prod. 2021, 280, 124506. [Google Scholar] [CrossRef]
  42. Hao, Y.; Guo, Y.; Li, S.; Luo, S.; Jiang, X.; Shen, Z.; Wu, H. Towards Achieving the Sustainable Development Goal of Industry: How Does Industrial Agglomeration Affect Air Pollution? Innov. Green Dev. 2022, 1, 100003. [Google Scholar] [CrossRef]
  43. Tan, G.; Cao, Y.; Xie, R.; Fang, J. Intergovernmental Competition, Industrial Spatial Distribution, and Air Quality in China. J. Environ. Manag. 2022, 310, 114721. [Google Scholar] [CrossRef]
  44. Cheng, Y.; Loo, B.P.Y.; Vickerman, R. High-Speed Rail Networks, Economic Integration and Regional Specialisation in China and Europe. Travel Behav. Soc. 2015, 2, 1–14. [Google Scholar] [CrossRef] [Green Version]
  45. Zhao, C.; Wang, B. How Does New-Type Urbanization Affect Air Pollution? Empirical Evidence Based on Spatial Spillover Effect and Spatial Durbin Model. Environ. Int. 2022, 165, 107304. [Google Scholar] [CrossRef] [PubMed]
  46. Ruggieri, M.; Plaia, A. An Aggregate AQI: Comparing Different Standardizations and Introducing a Variability Index. Sci. Total Environ. 2012, 420, 263–272. [Google Scholar] [CrossRef]
  47. GB3095-2012; National Ambient Air Quality Standard of China. Ministry of Ecology and Environment of the People’s Republic of China: Beijing, China, 2012.
  48. Chen, W.; Tang, H.; Zhao, H. Urban Air Quality Evaluations under Two Versions of the National Ambient Air Quality Standards of China. Atmos. Pollut. Res. 2016, 7, 49–57. [Google Scholar] [CrossRef]
Figure 1. Framework for the proposed spatiotemporal hybrid air pollution early warning system for urban agglomeration.
Figure 1. Framework for the proposed spatiotemporal hybrid air pollution early warning system for urban agglomeration.
Systems 11 00286 g001
Figure 2. Location of the study area.
Figure 2. Location of the study area.
Systems 11 00286 g002
Figure 3. Local Moran maps of AQI in 2017 and 2022.
Figure 3. Local Moran maps of AQI in 2017 and 2022.
Systems 11 00286 g003
Figure 4. Irregular cluster results.
Figure 4. Irregular cluster results.
Systems 11 00286 g004
Figure 5. The result of feature extraction from raw data.
Figure 5. The result of feature extraction from raw data.
Systems 11 00286 g005
Figure 6. Comparison of performance indicators of hybrid systems based on SHP.
Figure 6. Comparison of performance indicators of hybrid systems based on SHP.
Systems 11 00286 g006
Figure 7. The result of a hybrid model built from raw data.
Figure 7. The result of a hybrid model built from raw data.
Systems 11 00286 g007
Figure 8. Comparison of performance indicators of hybrid models based on different feature extraction strategies.
Figure 8. Comparison of performance indicators of hybrid models based on different feature extraction strategies.
Systems 11 00286 g008
Table 1. Air quality index scale.
Table 1. Air quality index scale.
AQILevelIDescriptionsColor
0–50I0.155GoodGreen
51–100II0.207ModerateYellow
101–150III0.176Lightly pollutedOrange
151–200IV0.095Moderately pollutedRed
201–300V0.066Heavily pollutedPurple
>300VI0.195Severely pollutedMaroon
Table 2. Statistical analysis of raw data.
Table 2. Statistical analysis of raw data.
No.City NameLongitudeLatitudeTraining TestingMaxMinMeanStd
1Shijiazhuang114.50246138.04547416564134421997.85 57.78
2Hengshui115.66599337.73509716564133771689.68 50.88
3Baoding115.48233138.86765716564134761792.46 56.39
4Xingtai114.50885137.06825616564134631797.28 56.61
5Handan114.49068636.61227316564133891699.81 56.43
6Beijing116.40528539.90498916564134541172.05 47.77
7Cangzhou116.85746138.31058216564133461681.99 45.15
8Langfang116.71387339.52924416564134131378.05 46.25
9Tianjin117.19018239.12559616564133651478.29 42.51
10Tangshan118.17539339.63511316564133991684.83 45.85
11Chengde117.93915240.97620416564134091759.69 31.20
12Qinhuangdao119.58657939.94253116564133641666.22 35.44
13Zhangjiakou114.88409140.81190116564134881959.3436.17
Table 3. Moran index of the AQI for 2017 and 2022.
Table 3. Moran index of the AQI for 2017 and 2022.
YearIE(I)Sd(I)zp-Value *
20170.155−0.0830.0922.5990.005
20180.207−0.0830.0923.1640.001
20190.176−0.0830.092.8730.002
20200.095−0.0830.091.9830.024
20210.066−0.0830.091.6610.048
20220.195−0.0830.0913.0640.001
Note: I is Moran’s index, reflecting the spatial correlation. E(I) is the mean of I, Var(I) is the standard deviation of I; Z is the standard score, reflecting the degree of dispersion of a data set; p-value rep-resents the probability. When the probability value is small, the null hypothesis will be rejected. * represents 10 % confidence.
Table 4. Spatial transition of Moran scatter of urban AQI (2017~2022).
Table 4. Spatial transition of Moran scatter of urban AQI (2017~2022).
Cities201720182019202020212022
1LLLLLLLLLLLL
2LLLLLLHLLLLL
3HHHHHHHHHHHH
4HLHLHLHLHLHL
5LLLLLLLLLLLL
6HHHHHHHHHHHH
7HHHHHHHHHHHH
8HHHHHHHHHLHH
9LHLHLHLHLHLH
10LLLLLLLLLLLL
11HHHLHHHLLLHL
12LLLLLLLLLLLL
13HHHHHHHHHHHH
Note: HH: in the first quadrant, areas with high AQI are surrounded by other cities that also have high AQI; LH: in the second quadrant, areas with a low AQI are surrounded by other cities with a high AQI; LL: in the third quadrant, areas with a low AQI are surrounded by other cities with the same low AQI; HL: in the fourth quadrant, areas with a high AQI are surrounded by other cities with a low AQI.
Table 5. Comparison of feature extraction strategies based on different optimization algorithms.
Table 5. Comparison of feature extraction strategies based on different optimization algorithms.
CitiesMethodMAPERMSEMAE
Category I
Beijing
FCM25.5425.1517.76
DHP-FCM39.4737.5224.25
SHP-FCM25.1226.3417.79
HHP-FCM25.4021.9415.91
Category II
Shijiazhuang
FCM40.5137.7321.18
DHP-FCM31.9624.3815.43
SHP-FCM36.2721.0215.36
HHP-FCM36.2521.0815.40
Category III
Chengde
FCM29.5020.6614.25
DHP-FCM28.85 20.3113.93
SHP-FCM27.7819.2213.29
HHP-FCM29.5619.6213.87
Note: HP: Hampel filtering; DHP: Hampel filtering optimized by dragonfly algorithm (DA); SHP: Hampel filtering optimized squirrel search algorithm (SSA); HHP: Hampel filtering optimized honey badger algorithm (HBA).
Table 6. Comparison of forecasting effects based on different submodules of SHP.
Table 6. Comparison of forecasting effects based on different submodules of SHP.
CitiesMethodMAPE (%)RMSEMAE
Category I
Beijing
SHP-FCM25.1226.3417.79
SHP-GFCM20.6618.4512.85
SHP-HFCM1.481.391.81
Category II
Shijiazhuang
SHP-FCM36.2721.0215.36
SHP-GFCM28.7621.3013.78
SHP-HFCM1.124.330.69
Category III
Chengde
SHP-FCM27.7819.2213.29
SHP-GFCM24.141.119.75
SHP-HFCM0.490.620.23
Note: FCM: fuzzy cognitive maps; HFCM: hesitant fuzzy cognitive maps. GFCM: Gaussian smoothed fuzzy cognitive maps.
Table 7. Comparison of hybrid models based on various feature extraction strategies.
Table 7. Comparison of hybrid models based on various feature extraction strategies.
CitiesMethodMAPE (%)RMSEMAE
Category I
Beijing
DHP-FCM39.4737.5224.25
DHP-GFCM30.2126.1918.98
DHP-HFCM21.4521.7413.48
HHP-FCM25.4021.9415.91
HHP-GFCM27.2423.2416.89
HHP-HFCM25.0021.4815.58
SHP-FCM25.1226.3417.79
SHP-GFCM20.6618.4512.85
SHP-HFCM1.481.391.81
Category II
Shijiazhuang
DHP-FCM31.9624.3815.43
DHP-GFCM32.6419.4013.66
DHP-HFCM14.6616.727.01
HHP-FCM36.2521.0815.40
HHP-GFCM38.9722.1816.30
HHP-HFCM34.2420.6414.83
SHP-FCM36.2721.0215.36
SHP-GFCM28.7621.3013.78
SHP-HFCM1.124.330.69
Category III
Chengde
DHP-FCM28.8520.3113.93
DHP-GFCM18.6711.878.38
DHP-HFCM0.530.470.25
HHP-FCM29.5619.6213.87
HHP-GFCM29.2719.6113.82
HHP-HFCM29.4619.6313.87
SHP-FCM27.7819.2213.29
SHP-GFCM24.141.119.75
SHP-HFCM0.490.620.23
Table 8. The results of robustness test.
Table 8. The results of robustness test.
MAPE (%) RMSE MAE
RandomProposedChangeRandomProposedChangeRandomProposedChange
Beijing
FCM32.1525.546.6130.1525.155.0020.2617.762.5
SHP-FCM30.7225.125.628.6126.342.2719.8917.792.1
SHP-HFCM1.391.480.091.581.390.191.761.810.05
Mean21.42 17.38 4.0420.11 17.63 2.4913.97 12.45 1.52
Std17.36 13.77 3.5916.07 14.07 1.9910.58 9.22 1.36
Shijiazhuang
FCM45.4940.514.9828.2837.739.4519.6321.181.55
SHP-FCM45.7136.279.4428.1621.027.1419.5715.364.21
SHP-HFCM0.831.120.294.174.330.160.520.690.17
Mean30.68 25.97 4.71 20.20 21.03 0.82 13.24 12.41 0.83
Std25.85 21.62 4.23 13.89 16.70 2.81 11.02 10.56 0.46
Chengde
FCM32.2629.502.7620.3420.660.3213.8114.250.44
SHP-FCM32.0427.784.2620.5519.221.3313.9813.290.69
SHP-HFCM0.670.490.180.500.620.120.310.230.08
Mean21.66 19.26 2.40 13.80 13.50 0.30 9.37 9.26 0.11
Std18.18 16.28 1.90 11.52 11.18 0.34 7.84 7.83 0.01
Note: Random represents adding random disturbance to simulate air situation. Proposed represents the original data. Change is the absolute value of the difference between the data after adding the disturbance and the accuracy data model, that is, the magnitude of the change.
Table 9. The results of testing model differences.
Table 9. The results of testing model differences.
CategoryMethodDMPMDMP
Category I
Beijing
DHP-FCM15.2192 8.39 × 10−4215.2007 1.01 × 10−41
DHP-GFCM9.7186 3.11 × 10−209.7068 3.42 × 10−20
DHP-HFCM8.05313.88 × 10−258.04232.63 × 10−25
HHP-FCM13.6566 2.83 × 10−3513.6401 3.31 × 10−35
HHP-GFCM5.8835 8.34 × 10−95.8764 8.67 × 10−9
HHP-HFCM5.15443.26 × 10−75.14783.19 × 10−7
SHP-FCM5.7104 2.16 × 10−85.7034 2.25 × 10−8
SHP-GFCM6.4946 2.41 × 10−106.4867 2.52 × 10−10
Category II
Shijiazhuang
DHP-FCM16.4863 3.10 × 10−4716.4663 3.78 × 10−47
DHP-GFCM10.0901 1.55 × 10−2110.0778 1.71 × 10−21
DHP-HFCM5.92168.34 × 10−115.91488.34 × 10−11
HHP-FCM15.9536 6.12 × 10−4515.9342 7.42 × 10−45
HHP-GFCM9.5553 1.14 × 10−199.5437 1.25 × 10−19
HHP-HFCM9.13321.25 × 10−139.12771.36 × 10−13
SHP-FCM10.5755 2.79 × 10−2310.5626 3.11 × 10−23
SHP-GFCM11.6521 2.63 × 10−2711.6380 2.98 × 10−27
Category III
Chengde
DHP-FCM13.0401 4.63 × 10−4113.0242 5.54 × 10−41
DHP-GFCM12.9219 8.93 × 10−3412.9062 1.04 × 10−33
DHP-HFCM1.4234 3.74 × 10−511.4217 4.62 × 10−51
HHP-FCM10.3126 4.40 × 10−4310.3001 5.30 × 10−43
HHP-GFCM10.2920 1.39 × 10−3910.2795 1.65 × 10−39
HHP-HFCM10.3339 2.25 × 10−3610.3214 2.64 × 10−36
SHP-FCM13.4234 9.09 × 10−3313.4071 1.05 × 10−32
SHP-GFCM13.2622 2.72 × 10−3213.2461 3.14 × 10−32
Note: The model SHP-HFCM proposed in this study is used for comparison with the above combinatorial strategy, where the statistic p-value represents the probability.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gu, X.; Li, H.; Fan, H. Spatiotemporal Hybrid Air Pollution Early Warning System of Urban Agglomeration Based on Adaptive Feature Extraction and Hesitant Fuzzy Cognitive Maps. Systems 2023, 11, 286. https://doi.org/10.3390/systems11060286

AMA Style

Gu X, Li H, Fan H. Spatiotemporal Hybrid Air Pollution Early Warning System of Urban Agglomeration Based on Adaptive Feature Extraction and Hesitant Fuzzy Cognitive Maps. Systems. 2023; 11(6):286. https://doi.org/10.3390/systems11060286

Chicago/Turabian Style

Gu, Xiaoyang, Hongmin Li, and Henghao Fan. 2023. "Spatiotemporal Hybrid Air Pollution Early Warning System of Urban Agglomeration Based on Adaptive Feature Extraction and Hesitant Fuzzy Cognitive Maps" Systems 11, no. 6: 286. https://doi.org/10.3390/systems11060286

APA Style

Gu, X., Li, H., & Fan, H. (2023). Spatiotemporal Hybrid Air Pollution Early Warning System of Urban Agglomeration Based on Adaptive Feature Extraction and Hesitant Fuzzy Cognitive Maps. Systems, 11(6), 286. https://doi.org/10.3390/systems11060286

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop