Next Article in Journal / Special Issue
Image Encryption Based on Pixel-Level Diffusion with Dynamic Filtering and DNA-Level Permutation with 3D Latin Cubes
Previous Article in Journal
Intra- and Inter-Modular Connectivity Alterations in the Brain Structural Network of Spinocerebellar Ataxia Type 3
Previous Article in Special Issue
Primality, Fractality, and Image Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Kapur’s Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm

College of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin 150040, China
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(3), 318; https://doi.org/10.3390/e21030318
Submission received: 14 March 2019 / Accepted: 21 March 2019 / Published: 23 March 2019
(This article belongs to the Special Issue Entropy in Image Analysis)

Abstract

:
In this paper, a new hybrid whale optimization algorithm (WOA) called WOA-DE is proposed to better balance the exploitation and exploration phases of optimization. Differential evolution (DE) is adopted as a local search strategy with the purpose of enhancing exploitation capability. The WOA-DE algorithm is then utilized to solve the problem of multilevel color image segmentation that can be considered as a challenging optimization task. Kapur’s entropy is used to obtain an efficient image segmentation method. In order to evaluate the performance of proposed algorithm, different images are selected for experiments, including natural images, satellite images and magnetic resonance (MR) images. The experimental results are compared with state-of-the-art meta-heuristic algorithms as well as conventional approaches. Several performance measures have been used such as average fitness values, standard deviation (STD), peak signal to noise ratio (PSNR), structural similarity index (SSIM), feature similarity index (FSIM), Wilcoxon’s rank sum test, and Friedman test. The experimental results indicate that the WOA-DE algorithm is superior to the other meta-heuristic algorithms. In addition, to show the effectiveness of the proposed technique, the Otsu method is used for comparison.

1. Introduction

Image segmentation is a fundamental and key technique in image processing, computer vision, and pattern recognition, the purpose of which is to partition a given image into specific regions with unique characteristics and then extract the objects of interest [1,2,3,4]. Hence, the segmentation technique to be adopted determines the performance of higher level systems that introduced above [5]. At present, the main techniques of image segmentation include edge-based technique, region-based technique, neural network-based technique, wavelet transform-based technique, and threshold-based technique [6,7,8,9,10]. Among the available techniques, threshold-based technique (thresholding) is the most popular one that many scholars have done much work in this domain.
More specifically, the thresholding technique determines the segmentation thresholds by optimizing some criteria, such as maximum between-class variance and various entropy criteria [11]. In 1985, Kapur et al. maximized the histogram entropy of segmented classes to obtain the optimal threshold values, which is known as Kapur’s entropy technique [12]. This thresholding technique is adopted extensively and show remarkable performance in many image segmentation problems. However, when dealing with complex image segmentation problem, the high threshold operation will increase the computational complexity of the algorithm significantly. Thus, scholars introduce various meta-heuristic algorithms into this domain with the view of reducing computational complexity and improving segmentation accuracy. Shen et al. [13] proposed a modified flower pollination algorithm (MFPA)-based technique for segmenting both real-life images and remote sensing images. The experimental results show that the MFPA algorithm gives higher values in terms of PSNR and SSIM, which is suitable for high dimensional complex image segmentation. In 2016, Kapur’s entropy thresholding technique was adopted by Sambandam and Jayaraman [14] for multilevel medical image thresholding. The proposed technique was then optimized by dragonfly optimization (DFO) with the purpose of reducing computational complexity. It can be seen from the results that the proposed algorithm can efficiently explore the search space and obtain the optimal thresholds. In 2017, Khairuzzaman and Chaudhury [5] proposed a grey wolf optimizer (GWO)-based technique for multilevel image thresholding. Kapur’s entropy and Otsu methods are used to determine the segmentation thresholds. Experimental results show that the GWO-based technique using both Kapur’s entropy and Otsu thresholding techniques performs better than particle swarm optimization (PSO) and bacterial foraging optimization (BFO)-based methods. Besides, there are still many other meta-heuristic algorithms have been successfully applied to multilevel image thresholding, such as artificial bee colony (ABC) [15], firefly algorithm (FA) [16], cuckoo search (CS) [17], wind driven optimization (WDO) [18], krill herd optimization (KHO) [19], moth-flame optimization (MFO) [20], etc. It is well known that the overwhelming majority of images in practical engineering problems are color images, which are often complex and contain a lot of information, whereas, most of the techniques above are used to segment the grayscale images rather than color images. This phenomenon motivated us to introduce an efficient technique to satisfy the practical requirements.
The whale optimization algorithm (WOA) is a novel meta-heuristic algorithm that simulates the behavior of humpback whales in nature [21]. There are mainly three foraging behaviors, namely encircling prey, bubble-net attacking, and search for prey. WOA is a simple and powerful algorithm that has attracted wide attention from scholars recently [22]. In 2018, Xiong et al. [23] used a WOA algorithm to extract the parameters of solar photovoltaic (PV) models. Compared to the conventional as well as recently-developed methods, the proposed algorithm can determine the parameters more accurately. Sun et al. [24] proposed a modified whale optimization algorithm (MWOA) for solving large-scale global optimization (LSGO) problems. Twenty-five benchmark test functions with various dimensions were utilized to verify the performance. The experimental results indicated that the proposed algorithm is superior to other state-of-the-art optimization algorithms in terms of accuracy and stability. In 2017, Mafarja and Mirjalili [25] introduced two hybridization models of WOA and simulated annealing (SA) and then applied the proposed methods to feature selection domain. The SA was adopted to enhance the exploitation capability. It can be observed that the proposed hybrid algorithm outperformed other wrapper-based algorithms in classification accuracy, which is suitable for the current optimization task [25]. To sum up, these promising results motivate us to introduce the WOA algorithm into color image segmentation domain.
It is worth mentioning that color image multilevel thresholding operations need to determine the thresholds of every color component (red, green, and blue), while a meta-heuristic algorithm with strong optimizing capacity can improve the accuracy of image segmentation, as it can obtain appropriate thresholds [26]. Therefore, an improved whale optimization algorithm is proposed which is known as WOA-DE. In the proposed algorithm, differential evolution (DE) is served as local search technique to enhance the exploitation ability. What’s more, introducing DE operator improves the situation that the traditional WOA is easy to fall into local optimum in the later iteration. In order to obtain an efficient and universal segmentation method, the performance of WOA-DE using Kapur’s entropy is investigated. A series of experiments are conducted on both natural images and satellite images. All experimental results are compared with state-of-the-art algorithms as well as conventional methods. It can be observed from the results that the WOA-DE based methods outperform other meta-heuristic based methods in terms of average fitness values, standard deviation (STD), peak signal to noise ratio (PSNR), structural similarity index (SSIM), feature similarity index (FSIM), and the Wilcoxon’s rank sum test as well as the Friedman test. The goal of this paper is as follows:
  • Obtain an efficient segmentation technique for multilevel color image thresholding task.
  • Improve the optimizing capability of WOA to determine the optimal thresholds.
  • Investigate the adaptability of WOA-DE based techniques in the field of natural, satellite, and MR image segmentation.
  • Evaluate the performance of proposed technique from various aspects.
The structure of this paper is presented as follows: Section 2 gives the definition of Kapur’s entropy thresholding technique. Section 3 introduces a brief review of the WOA algorithm. The description of the DE algorithm is presented in Section 4. In Section 5, the proposed WOA-DE-based multilevel color image thresholding technique is described in details. Experiments and discussion can be found in Section 6. Finally, Section 7 presents the conclusions and future work directions.

2. Multilevel Thresholding

The image threshold methods can be summarized into two categories: bi-level thresholding methods and multilevel thresholding methods. Bi-level thresholding methods involve one threshold value which partitions the image into two classes: foreground and background, however if the image is quite complex and contains various objects, the bi-level thresholding method is not very effective [27,28,29,30]. Therefore, multilevel thresholding methods are used extensively for image segmentation [31,32,33]. In this paper, a famous multilevel thresholding technique is used to determine the threshold values, namely, Kapur’s entropy. A brief formulation of this technique is given in the following subsections. In addition, the RGB image has three basic color components of red, green, and blue, so these thresholding techniques are executed three times to determine the optimal threshold values of each color component [16].

Kapur’s Entropy

Kapur’s method is also an unsupervised automatic thresholding technique, which selects the optimum thresholds based on the entropy of segmented classes [12]. Assuming that [ t h 1 , t h 2 , , t h n ] represents the thresholds combination which divided the image into various classes. Then the object function of Kapur’s method can be defined as:
H ( t h 1 , t h 2 , , t h n ) = H 0 + H 1 + + H n
where:
H 0 = j = 0 t h 1 1 p j ω 0 ln p j ω 0 ,   ω 0 = j = 0 t h 1 1 p j
H 1 = j = t h 1 t h 2 1 p j ω 1 ln p j ω 1 ,   ω 1 = j = t h 1 t h 2 1 p j
H n = j = t h n L 1 p j ω n ln p j ω n ,   ω n = j = t h n L 1 p j
H 0 , H 1 ,…, H n denote the entropies of distinct classes, ω 0 , ω 1 ,…, ω n are the probability of each class.
In order to obtain the optimal threshold values, the fitness function in Equation (5) is maximized:
f K a p u r ( t h 1 , t h 2 , , t h n ) = arg max { H ( t h 1 , t h 2 , , t h n ) }
It is worth noting that the computational complexity of the thresholding technique above will result in exponential growth as the number of thresholds increase. Under such circumstances, Kapur’s entropy method is not very effective for multilevel thresholding. Therefore, the WOA-DE-based method using Kapur’s entropy is proposed to improve the accuracy and computation speed of thresholding techniques. The ultimate goal of proposed method is to determine the optimal threshold values by maximizing the objective function given in Equation (1).

3. Whale Optimization Algorithm

The whale optimization algorithm, which was proposed by Mirjalili and Lewis in 2016, is inspired by the foraging behavior of humpback whales in nature [21]. Humpback whales tend to create spiral bubbles, and then swim to the prey along the trajectory of bubbles (see Figure 1) [25]. The encircling prey and bubble-net attacking behaviors represent the exploitation phase of optimization. The other phase of optimization namely exploration is represented by the search for prey behavior. It is worth noting that the position vector of search agent is defined in a d-dimensional space, where d denotes the number of decision variables of an optimization problem. Thus, the population X of n search agents can be represented by a (n × d)-dimensional matrix, which is shown in Equation (6):
X = [ x 1 , 1 x 1 , 2 x 1 , d x 2 , 1 x 2 , 2 x 2 , d x n , 1 x n , 2 x n , d ]

3.1. Exploitation Phase (Encircling Prey and Bubble-Net Attacking Method)

In the process of hunting, the humpback whales first encircle the prey, which can be represented as follows:
D = | C X * ( t ) X ( t ) |
X ( t + 1 ) = X * ( t ) A D
where X * represents the best solution obtained so far, X denotes the position vector, t is the current iteration, || is the absolute value, · is an element-by-element multiplication, A and C are two essential parameters that can be evaluated by:
A = 2 a r a
C = 2 r
where r is a random number in the range of [0,1] and a is a constant that will decrease linearly from 2 to 0 within the whole iterative process (both exploration and exploitation). It can be observed from Equation (8) that search agents can update their position X(t) according the best solution X * . The parameters A and C determine the distance between the updated position X ( t + 1 ) and the optimal position X * .
The bubble-net attacking behavior can be mathematically represented by the following equation:
D = | X * ( t ) X ( t ) |
X ( t + 1 ) = D e b r cos ( 2 π r ) + X * ( t )
where D shows the distance between the current search agent position and the optimal position, b is a constant that determine the shape of a logarithmic spiral, and r is a random number in the range of [−1,1]. In order to transform these two mechanisms (encircling prey and bubble-net attacking method) of exploitation phase, assume that each mechanism will be executed with 50% probability. Thus, the mathematical model of the entire exploitation phase can be expressed as:
X ( t + 1 ) = { X * ( t ) A D i f   p < 0.5 D e b r cos ( 2 π r ) + X * ( t ) i f   p 0.5
where p is a random number in the range of [0,1].

3.2. Exploration Phase (Search for Prey)

In order to enhance the exploration capability of algorithm, a global search strategy is utilized. The search agents update their position according to a random agent in the population rather than the best solution obtained so far. It is worth mentioning that the absolute value of A determines the phase of optimization to be selected, namely the exploration and exploitation phases. Thus, the search for prey behavior can be mathematically represented as follows:
D = | C X r a n d ( t ) X ( t ) |
X ( t + 1 ) = X r a n d ( t ) A D
where Xrand denotes a random individual in the current population.
Pseudo code of traditional whale optimization algorithm based multilevel thresholding has been given in Algorithm 1.
Algorithm 1 Pseudo code of whale optimization algorithm based multilevel thresholding
Initialize the position of whales Xi.
Initialize the best search agent X * .
 WHILE t < Maximum number of iterations
  FOR i = 1:n
   Calculate the objective value of each search agent by using the Equation (1) for Kapur’s entropy.
   Update the best search agent X * .
   Update a, A, C, r, and p
   IF1 p < 0.5
    IF2 |A| < 1
     Update the position of search agent using Equations (7) and (8).
    ELSE
     Update the position of search agent using Equations (14) and (15).
    END IF2
   ELSE
    Update the position of search agent using Equations (11) and (12).
   END IF1
   Correct the position of the current search agent if it is beyond the border.
  END FOR
 END WHILE
Return X * , which represents the optimal threshold values of segmentation.

4. Differential Evolution

Differential evolution (DE) algorithm is a simple and powerful algorithm for solving optimization problems [34,35,36]. Basically, the DE algorithm contains two significant parameters, namely mutation scaling factor denoted by SF and crossover probability denoted by CR [37]. For the standard DE algorithm, the mutation, crossover, and selection operators can be summarized as follows [38]:

4.1. Mutation Operation

The mutation operation of DE algorithm is defined as follows:
m i g + 1 = x r 1 g + S F × ( x r 2 g x r 3 g )
where m i g + 1 represents the mutant individual in the (g + 1)-th generation. x r 1 g , x r 2 g , and x r 3 g are different individuals from the population. In other words, r 1 , r 2 , and r 3 cannot be equal. SF is a constant that indicates the mutation scaling factor.

4.2. Crossover Operation

In the process of crossover, the trial individual c i g + 1 is selected from the current individual x i g or the mutant individual m i g + 1 on account of enhancing the diversity of population. The crossover operation of DE algorithm is described as:
c i g + 1 = { m i g + 1 i f   r a n d C R x i g i f   r a n d > C R
where rand represents a random value which is in the range [0,1]. CR is a constant that shows the crossover probability.

4.3. Selection Operation

After the process of selection, the individual of next generation x i g + 1 is selected according to the comparison of fitness value between the trail individual c i g + 1 and the target individual x i g . For a problem to be minimized, the selection operation of DE algorithm can be summarized as follows:
x i g + 1 = { c i g + 1 i f   f ( c i g + 1 ) < f ( x i g ) x i g o t h e r w i s e
where f denotes the fitness function value of a given problem.

5. The Proposed Method

In this section, a detailed introduction of the WOA-DE-based method is given, and the algorithm will be used to obtain the optimal threshold values for image segmentation. A hybrid of the WOA and DE algorithms is introduced to balance the two essential phases of optimization, namely exploration and exploitation. The flowchart of WOA-DE for finding the optimal threshold values is shown in Figure 2.
It is worth mentioning that a better balance between exploration and exploitation plays an important role in improving the optimization ability of algorithm. Therefore, an efficient hybrid strategy is introduced to balance and improve these two phases. On the one hand, the WOA algorithm has strong ability to explore the solution space and is used as global search technique. On the other hand, the DE algorithm is adopted as local search technique, which can increase the precision of solutions.
In addition, the purpose of introducing DE operator is not only to enhance the local search ability of the algorithm, but also to overcome the drawback that WOA algorithms easily fall into local optima in the late iterations. As described above, the random variable A will change in the range [−2,2] as a decreases progressively. If the value larger than 1 or less than −1, Equation (15) will be adopted to enhance the exploration capability of the algorithm. On the contrary, Equation (8) will be adopted as local search strategy when the value in the range [−1,1]. In order to more intuitively reflect the change of random variable A during the whole iterative process, a relevant schematic diagram is presented in Figure 3. It can be observed from the figure that the value of random variable A is fixed in the interval of [−1,1] after 250 iterations. This means that the global search strategy has no chance to be adopted after half of the iterative process, even if the current best solution may not the global optimum. Therefore, the traditional WOA algorithm will fall into the local optimum, resulting in an unsatisfactory solution accuracy. Especially for complex multi-dimensional optimization problems, such as multilevel color image segmentation, traditional WOA algorithms cannot handle them. On the contrary, DE operators can scale the difference between any two search agents in the population, which makes the particles jump out of the current search area. In Equation (16), ( x r 2 g x r 3 g ) can be considered as the difference between two individuals, and S F is the scaling factor. The latter term in Equation (16) “ S F × ( x r 2 g x r 3 g ) ” is crucial to the mutation operator. For the exploration stage, particles tend to be very far apart, and there is a big difference between the individuals. Scaling this big difference can enhance the diversity of population. For the exploitation stage, particles tend to be close together, scaling a small difference makes the algorithm effectively optimize in a small range, improving the accuracy of the solution and avoiding local optimum.
In this paper, the average fitness value of the population is computed in the iterative process to evaluate the quality of each particle. The proposed hybrid model enables particles with better quality to exploit the current promising area to ensure the convergence speed, while the particles with poor quality can explore the unknown area to prevent local optimization. Although the global search strategy of traditional WOA algorithm will not be adopted in the later iteration, the introduced DE operator can effectively overcome this shortcoming, as discussed above. Exactly speaking, if f i > f ¯ , the DE algorithm will be used to update the solution x i g using Equations (16)–(18). However, if f i f ¯ , then the current solution will be updated using Equations (8), (12), or (15). In addition, a series of experiments are conducted in the following section to verify the advantages of WOA-DE algorithm from various aspects.

6. Experiments and Results

6.1. Experimental Setup

In this paper, Kapur’s entropy thresholding technique is utilized to determine the optimal threshold values for image segmentation. The performance of our WOA-DE-based method is evaluated on fourteen images. Among them, five images are natural images from the Berkeley segmentation database [39], five images are satellite images from [40], and four images are brain magnetic resonance images (MRI) from [41]. Besides, all the images and their corresponding histogram images are shown in Figure 4. Both state-of-the-art and conventional methods, such as the traditional WOA [21], salp swarm algorithm (SSA) [42], sine cosine algorithm (SCA) [43], ant lion optimizer (ALO) [44], harmony search optimization (HSO) [45], bat algorithm (BA) [46], particle swarm optimization (PSO) [47,48], betaDE (BDE) [49], and improved differential search algorithm (IDSA) [50] are used to validate the superiority of proposed algorithm, whose parametric settings are presented in Table 1, except for the population size N set to 30 and the number of iterations t max set to 500 for fair comparison. The experiments are carried out through the simulation in “Matlab2017” (The MathWorks Inc., Natick, MA, USA) and implemented on a computer equipped with the Microsoft Windows 10 operating system and 8 GB memory space.

6.2. Objective Function Measure

As discussed above, Kapur’s entropy is used to determine the segmentation thresholds. The segmented images of “Image2” and “Image10” obtained by WOA-DE using Kapur’s entropy method with different threshold levels are given in Figure 5 and Figure 6, respectively. Due to the stochastic nature of meta-heuristic algorithms, the experiments are conducted over 30 runs. Then the average objective values of “Image1” and “Image6” are presented in Table 2. It can be seen from the table that the WOA-DE based method gives the best values in general.
The entropy of an image reflects its average information content [51]. Therefore, higher value of Kapur’s entropy indicates more information in the image. It can be observed from Table 2 that the objective function value of each algorithm increases with the number of threshold values. This promising result shows that high-quality image with more information is obtained when the threshold level is high (such as K = 10 and 12).

6.3. Stability Analysis

Standard deviation (STD): a value indicates the dispersion of sample data and it is mathematically represented as:
S T D = 1 n 1 i = 1 n ( f i f ¯ ) 2
where n is the sample size, fi is the fitness value of the i-th individual, and f ¯ indicates the average value of the sample.
In order to verify the stability of proposed algorithm, the STD indicator is also used. A lower value of STD indicates better stability. The STD values of “Image1” and “Image6” obtained by all algorithms are presented in Table 2. From the table it is found that WOA-DE based method gives lower values as compared to other algorithms, which shows the better consistency and stability of proposed algorithm.

6.4. Peak Signal to Noise Ratio (PSNR)

Peak signal to noise ratio (PSNR): an index which is used to evaluate the similarity of the processed image against the original image [13]:
P S N R = 10 log 10 ( 255 2 M S E )
M S E represents the mean squared error and is calculated as:
M S E = 1 M N i = 1 M j = 1 N [ I ( i , j ) K ( i , j ) ] 2
where I(i, j) and K(i, j) denote the gray level of the original image and the segmented image in the i-th row and j-th column, respectively. M and N denote the number of rows and columns in the image matrix, respectively. A higher value of PSNR indicates a better quality segmented image.
Table 3 shows the PSNR values of “Image2” and “Image7” obtained by all algorithms and Kapur’s entropy method. According to the table, the WOA-DE-based method gives the highest values in 9 out of 10 cases using Kapur’s entropy. When the threshold level is small, all algorithms give similar result, while the obtained values become different as the number of thresholds increases, and the proposed method can present the best result in most cases. This phenomenon indicates that WOA-DE-based method can determine the appropriate thresholds and then present high-quality segmented image that are more similar to the original image. Figure 7 shows the visual comparison of all available methods at different threshold levels. The results of proposed method are represented as “black” lines and “square” data points.

6.5. Structural Similarity Index (SSIM)

Structural similarity index (SSIM) [52,53]: a measure of the similarity between the original image and the segmented image, which takes various factors such as brightness, contrast, and structural similarity into account:
S S I M ( x , y ) = ( 2 μ x μ y + c 1 ) ( 2 σ x y + c 2 ) ( μ x 2 + μ y 2 + c 1 ) ( σ x 2 + σ y 2 + c 2 )
where μ x and μ y denote the mean intensities of the original image and the segmented image respectively. σ x 2 and σ y 2 are the standard deviation of the original image and the segmented image respectively. σ x y denotes the covariance between the original image and the segmented image. c 1 and c 2 are constants. The value of SSIM is in the range [0,1], and a higher value shows better performance.
The SSIM values obtained by all algorithms are given in Table 3 and Figure 8, respectively. It can be seen from the table that the WOA-DE-based method gives competitive results again compared with other methods in terms of SSIM indicator. The values obtained by all algorithms increase with the number of thresholds, which indicates that the segmented image is more similar to the original image in terms of brightness, contrast, and structural similarity. The experimental results in this section verify the remarkable performance of the proposed algorithm from another perspective.

6.6. Feature Similarity Index (FSIM)

Feature similarity index (FSIM) [54,55]: another measure of the image quality through evaluating the feature similarity between the original image and the segmented image:
F S I M = x Ω S L ( x ) × P C m ( x ) x Ω P C m ( x )
where Ω represents the whole image pixel domain. S L ( x ) is a similarity score. P C m ( x ) denotes the phase consistency measure, which is defined as:
P C m ( x ) = max ( P C 1 ( x ) , P C 2 ( x ) )
where P C 1 ( x ) and P C 2 ( x ) represent the phase consistency of two blocks, respectively:
S L ( x ) = [ S P C ( x ) ] α [ S G ( x ) ] β
S P C ( x ) = 2 P C 1 ( x ) × P C 2 ( x ) + T 1 P C 1 2 ( x ) × P C 2 2 ( x ) + T 1
S G ( x ) = 2 G 1 ( x ) × G 2 ( x ) + T 2 G 1 2 ( x ) × G 2 2 ( x ) + T 2
S P C ( x ) denotes the similarity measure of phase consistency. S G ( x ) denotes the gradient magnitude of two regions G 1 ( x ) and G 2 ( x ) . α , β , T 1 , and T 2 are all constants. The value of FSIM is also in the range [0,1], and a higher value shows better segmented image quality.
On comparing the FSIM values, which are given in Table 3 and Figure 9, it can be observed that WOA-DE-based method again outperforms the other methods. The feature similarity between the original image and the segmented image is considered in this experiment to verify the quality of segmented image comprehensively. The relevant results indicate that the proposed method has a strong feature preserving ability as compared to other methods.

6.7. Convergence Performance

In this section, the convergence performance of all algorithms is evaluated and discussed in details. In order to reflect the performance of WOA-DE more intuitively, the convergence curves of Kapur’s entropy function (for K = 12) are shown in Figure 10. Four different images are selected for testing, namely “Image1”, “Image4”, “Image7”, and “Image10”. It can be found that the proposed algorithm outperforms other algorithms in general. In other words, the WOA-DE-based method gives higher position curves using Kapur’s entropy technique.
As discussed above, the main drawbacks of the standard WOA are premature convergence and unbalanced exploration-exploitation, which are clearly reflected in the curves. For example, under the circumstance of “Image1” segmentation, the objective function value of WOA is almost never updated after 100 iterations, while the optimal value obtained is not the best. This phenomenon illustrates the premature convergence shortcoming of WOA. However, the proposed WOA-DE algorithm gives the highest objective function value under the premise of ensuring the convergence speed. In fact, the remarkable performance of the proposed algorithm is not only reflected in the segmentation task of “Image1”, but also in other images. The experimental results in this section indicate that WOA-DE algorithm can better balance the exploration and exploitation, and the complex image segmentation tasks are also competent.

6.8. Computation Time

The average CPU time of different algorithms considering all cases is given in Table 4. It can be found from the table that HSO is the fastest among available methods, but the segmentation accuracy discussed above is not ideal. The standard WOA algorithm gives competitive results in some cases, and the proposed algorithm namely WOA-DE is slightly slower than the standard WOA. The reason for this phenomenon is the premature convergence of HSO algorithm, which cannot well balance exploration and exploitation. On the contrary, the WOA-DE algorithm combines the advantages of both WOA and DE, which determine the most appropriate threshold value, despite not being the fastest. To sum up, WOA-DE is a high-performance hybrid algorithm that improves segmentation precision while maintaining runtime.

6.9. Statistical Analysis

In this section, a non-parametric statistical test known as “Wilcoxon’s rank sum test” is used to evaluate the significant difference between algorithms [56]. The experiments are conducted 30 runs at significance level 5%. All experimental data obtained based on Kapur’s entropy are used for testing. The alternative hypothesis ( H 1 ) assumes that there is a significant difference between the two algorithms being compared. The null hypothesis H 0 considers that there is no significant difference between the algorithms. The results of the statistical experiments are given in Table 5.
It can be observed from the table that the p-values acquired are far less than 0.05. This promising result indicates that H 0 can be rejected in all cases and there is a significant difference between the proposed algorithm and other methods.

6.10. Comparison of Otsu and Kapur’s Entropy Methods

In order to obtain a simple and powerful technique for color image segmentation, an experiment of comparison between Otsu and Kapur’s entropy thresholding techniques based on WOA-DE is conducted in this section. More details of Otsu thresholding technique can be found in [11].
The PSNR, SSIM, and FSIM values obtained by WOA-DE-based method are given in Table 6. It can be seen that WOA-DE-based method using Kapur’s entropy gives higher values than using Otsu technique in general for PSNR values. However, the Otsu-based technique performs better when comparing SSIM values. Considering the FSIM indicator, these two thresholding techniques are equal. Precisely speaking, on comparing the PSNR values, the Otsu technique presents better results in 11 out of 50 cases (10 images and five thresholds), whereas, Kapur’s entropy technique gives better results in 39 out of 50 cases. Considering other two indicators, the Kapur’s entropy technique outperforms in 21 cases for SSIM and 25 cases for FSIM, while the Otsu technique outperforms in 29 cases for SSIM and 25 cases for FSIM. To sum up, the WOA-DE-based method through Otsu gives better results in 65 out of 150 cases (10 images, five thresholds, and three performance measures) and the WOA-DE-based method through Kapur’s entropy gives satisfactory results in 85 cases. To some extent, these satisfactory results prove that WOA-DE-based method using Kapur’s entropy is superior to the method using Otsu. However, as the no free lunch (NFL) theorem goes, there is no technique that can handle all image segmentation tasks [57]. Thus, the WOA-DE algorithm based on different thresholding techniques has potential in the field of color image segmentation, which may exhibit superior performance in some engineering problems that have not been solved so far.

6.11. Robustness Testing on Noisy Images

In order to further investigate the performance of proposed algorithm, an experiment is conducted on two famous benchmark test images with various noise levels. “Lena” and “Peppers” images are used in this section (see Figure 11), which can be obtained from [58]. The mean value is fixed in this experiment, and the level of Gaussian noise is adjusted by setting the variance as 0.00625, 0.0125, 0.025, 0.05, and 0.1, respectively. The experiment is carried out at 12 threshold level, in which case the difference between algorithms is the most obvious. The relevant results are presented in Figure 12, Figure 13, Figure 14 and Figure 15. It can be observed from the results that the value of performance measures and quality of segmented image decrease with the increase of noise level, and the WOA-DE-Kapur outperforms other methods using Kapur entropy. The promising results indicate that the proposed technique has strong robustness, which can be competent for complex image segmentation tasks with noise.

6.12. Application in MR Image

In this section, the WOA-DE-Kapur-based multilevel thresholding technique is applied to the field of MR image segmentation. The purpose of this experiment is to investigate whether the proposed algorithm is capable of producing high quality segmented MR images. Two other threshold-based MR image segmentation techniques are used for comparison, namely the crow search algorithm-based method using minimum cross entropy thresholding (CSA-MCET) [59] and adaptive bacterial foraging algorithm-based method using Otsu (ABF-Otsu) [60]. The combination of thresholds (K = 2, 3, 4, and 5) selected is the same as that used by above two algorithms in their corresponding articles. Besides, the parameter values are set according to the original literature, except for the population size N set to 30 and the number of iterations t max set to 500 for fair comparison. All experiments are performed 30 times to eliminate errors.
The experimental results are shown in three tables. Table 7 presents the optimal thresholds and PSNR values, Table 8 gives the SSIM and FSIM values, and Table 9 indicates the segmented images obtained by all methods. It can be found from these results that WOA-DE-Kapur method can determine more accurate thresholds compared to other methods. For quantitative analysis, the values of performance measures obtained by proposed method is higher, which indicate the better quality of segmented image. For visual analysis, WOA-DE-Kapur method gives more informative segmented MR images, and the details of image become more prominent as the number of thresholds increases.
Since the experiments of three methods are the same, it is necessary to carry out relevant statistical tests. In this section, Friedman test [61] and Wilcoxon’s rank sum test [56] are used as non-parametric statistical test to evaluate the performance of these methods considering 5% as significant level. Null hypothesis ( H 0 ) in Friedman test states equality of medians between the algorithms, and the alternative hypothesis ( H 1 ) indicates the difference. A more detailed description of Friedman test can be found in literature [62]. The results of the relevant statistical tests can be observed in Table 10 and Table 11. Table 10 presents the average rank and p-value of all algorithms at different threshold levels. As can be found, ABF-Otsu obtains the first rank for K = 3, and WOA-DE-Kapur provides the first rank in other cases. In other words, the proposed technique gives the best result in general. The p-value for all threshold levels is very small indicating the significant difference among available methods. Table 11 gives the result of Wilcoxon’s rank sum test. It can be observed that the p-value is less than 0.05 in most cases, which verifies the remarkable performance of WOA-DE-Kapur technique in a statistical and meaningful way.

7. Conclusions

In order to obtain an efficient technique for color image segmentation, an improved WOA-based method is introduced in this paper, which is known as WOA-DE. In the proposed algorithm, DE is adopted as a local search strategy with the purpose of enhancing exploitation capability. Compared to the traditional WOA, the WOA-DE algorithm can effectively avoid falling into a local optimum and prevent the loss of population diversity in the later iterations. A series of experiments have been conducted on various color images including natural images and satellite images. Seven meta-heuristic algorithms are utilized for comparison. The experimental results indicate that the proposed techniques outperform other methods in terms of average fitness values, standard deviation (STD), peak signal to noise ratio (PSNR), structural similarity index (SSIM), and feature similarity index (FSIM) as well as the Wilcoxon’s rank sum test. In addition, to give more convincing and reliable results, another thresholding technique namely Otsu is adopted for testing. The experimental results indicate that WOA-DE-based technique through Kapur’s entropy gives better results than using the Otsu technique in most cases. However, there is no technique that can handle all image segmentation tasks. Thus, it is necessary to introduce more and better techniques to meet the requirements of different image segmentation problems and this is also the motivation for our future research. The performance of some novel meta-heuristic algorithms will be evaluated in this domain, such as salp swarm algorithm, spotted hyena optimizer, emperor penguin optimizer, etc.

Author Contributions

C.L. and H.J. contributed to the idea of this paper; C.L. performed the experiments; C.L. wrote the paper; C.L. and H.J. contributed to the revision of this paper.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank the anonymous reviewers for their constructive comments and suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Qian, P.; Zhao, K.; Jiang, Y.; Su, K.; Deng, Z.; Wang, S.; Muzic, R.F. Knowledge-leveraged transfer fuzzy C-Means for texture image segmentation with self-adaptive cluster prototype matching. Knowl.-Based Syst. 2017, 130, 33–50. [Google Scholar] [CrossRef] [PubMed]
  2. Robert, M.; Carsten, M.; Olivier, E.; Jochen, P.; Noordhoek, N.J.; Aravinda, T.; Reddy, V.Y.; Chan, R.C.; Jürgen, W. Automatic Segmentation of Rotational X-Ray Images for Anatomic Intra-Procedural Surface Generation in Atrial Fibrillation Ablation Procedures. IEEE Trans. Med. Imaging 2010, 29, 260–272. [Google Scholar]
  3. Lee, S.H.; Koo, H.I.; Cho, N.I. Image segmentation algorithms based on the machine learning of features. Pattern Recognit. Lett. 2010, 31, 2325–2336. [Google Scholar]
  4. Ye, J.; Fu, G.; Poudel, U.P. High-accuracy edge detection with Blurred Edge Model. Image Vis. Comput. 2005, 23, 453–467. [Google Scholar]
  5. Khairuzzaman, A.K.M.; Chaudhury, S. Multilevel thresholding using grey wolf optimizer for image segmentation. Expert Syst. Appl. 2017, 86, 64–76. [Google Scholar] [CrossRef]
  6. Chen, W.; Yue, H.; Wang, J.; Wu, X. An improved edge detection algorithm for depth map inpainting. Opt. Lasers Eng. 2014, 55, 69–77. [Google Scholar] [CrossRef]
  7. Liu, K.; Guo, L.; Li, H.; Chen, J. Fusion of Infrared and Visible Light Images Based on Region Segmentation. Chin. J. Aeronaut. 2009, 22, 75–80. [Google Scholar] [Green Version]
  8. Fu, X.; Liu, T.; Xiong, Z.; Smaill, B.H.; Stiles, M.K.; Zhao, J. Segmentation of histological images and fibrosis identification with a convolutional neural network. Comput. Biol. Med. 2018, 98, 147–158. [Google Scholar] [CrossRef] [PubMed]
  9. Demirhan, A.; Törü, M.; Güler, İ. Segmentation of Tumor and Edema Along With Healthy Tissues of Brain Using Wavelets and Neural Networks. IEEE J. Biomed. Health Inf. 2015, 19, 1451–1458. [Google Scholar] [CrossRef] [PubMed]
  10. Ouadfel, S.; Taleb-Ahmed, A. Social spiders optimization and flower pollination algorithm for multilevel image thresholding: A performance study. Expert Syst. Appl. 2016, 55, 566–584. [Google Scholar] [CrossRef]
  11. Otsu, N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef]
  12. Kapura, J.N.; Sahoob, P.K.; Wongc, A.K.C. A new method for gray-level picture thresholding using the entropy of the histogram. Comput. Vis. Graph. Image Proc. 1985, 29, 273–285. [Google Scholar] [CrossRef]
  13. Shen, L.; Fan, C.; Huang, X. Multi-Level Image Thresholding Using Modified Flower Pollination Algorithm. IEEE Access 2018, 6, 30508–30519. [Google Scholar] [CrossRef]
  14. Sambandam, R.K.; Jayaraman, S. Self-adaptive dragonfly based optimal thresholding for multilevel segmentation of digital images. J. King Saud Univ. Comput. Inf. Sci. 2018, 30, 449–461. [Google Scholar] [CrossRef] [Green Version]
  15. Gao, H.; Fu, Z.; Pun, C.; Hu, H.; Lan, R. A multi-level thresholding image segmentation based on an improved artificial bee colony algorithm. Comput. Electr. Eng. 2018, 70, 931–938. [Google Scholar] [CrossRef]
  16. He, L.; Huang, S. Modified firefly algorithm based multilevel thresholding for color image segmentation. Neurocomputing 2017, 240, 152–174. [Google Scholar] [CrossRef]
  17. Pare, S.; Kumar, A.; Bajaj, V.; Singh, G.K. An efficient method for multilevel color image thresholding using cuckoo search algorithm based on minimum cross entropy. Appl. Soft Comput. 2017, 61, 570–592. [Google Scholar] [CrossRef]
  18. Kotte, S.; Pullakura, R.K.; Injeti, S.K. Optimal multilevel thresholding selection for brain MRI image segmentation based on adaptive wind driven optimization. Measurement 2018, 130, 340–361. [Google Scholar] [CrossRef]
  19. Beevi, S.; Nair, M.S.; Bindu, G.R. Automatic segmentation of cell nuclei using Krill Herd optimization based multi-thresholding and Localized Active Contour Model. Biocybern. Biomed. Eng. 2016, 36, 584–596. [Google Scholar] [CrossRef]
  20. Aziz, M.A.E.; Ewees, A.A.; Hassanien, A.E. Whale Optimization Algorithm and Moth-Flame Optimization for multilevel thresholding image segmentation. Expert Syst. Appl. 2017, 83, 242–256. [Google Scholar] [CrossRef]
  21. Mirjalili, S.; Lewis, A. The Whale Optimization Algorithm. Adv. Eng. Softw. 2016, 95, 51–67. [Google Scholar] [CrossRef]
  22. Oliva, D.; Aziz, M.A.E.; Hassanien, A.E. Parameter estimation of photovoltaic cells using an improved chaotic whale optimization algorithm. Appl. Energy 2017, 200, 141–154. [Google Scholar] [CrossRef]
  23. Xiong, G.; Zhang, J.; Shi, D.; He, Y. Parameter extraction of solar photovoltaic models using an improved whale optimization algorithm. Energy Convers. Manag. 2018, 174, 388–405. [Google Scholar] [CrossRef]
  24. Sun, Y.; Wang, X.; Chen, Y.; Liu, Z. A modified whale optimization algorithm for large-scale global optimization problems. Expert Syst. Appl. 2018, 114, 563–577. [Google Scholar] [CrossRef]
  25. Mafarja, M.M.; Mirjalili, S. Hybrid Whale Optimization Algorithm with simulated annealing for feature selection. Neurocomputing 2017, 260, 302–312. [Google Scholar] [CrossRef]
  26. Pare, S.; Kumar, A.; Bajaj, V.; Singh, G.K. A multilevel color image segmentation technique based on cuckoo search algorithm and energy curve. Appl. Soft Comput. 2016, 47, 76–102. [Google Scholar] [CrossRef]
  27. Díaz-Cortés, M.; Ortega-Sánchez, N.; Hinojosa, S.; Oliva, D.; Cuevas, E.; Rojas, R.; Demin, A. A multi-level thresholding method for breast thermograms analysis using Dragonfly algorithm. Infrared Phys. Technol. 2018, 93, 346–361. [Google Scholar] [CrossRef]
  28. Ewees, A.A.; Elaziz, M.A.; Oliva, D. Image segmentation via multilevel thresholding using hybrid optimization algorithms. J. Electron. Imaging 2018, 27, 1. [Google Scholar] [CrossRef]
  29. Bhandari, A.K.; Kumar, A.; Singh, G.K. Tsallis entropy based multilevel thresholding for colored satellite image segmentation using evolutionary algorithms. Expert Syst. Appl. 2015, 42, 8707–8730. [Google Scholar] [CrossRef]
  30. Sathya, P.D.; Kayalvizhi, R. Modified bacterial foraging algorithm based multilevel thresholding for image segmentation. Eng. Appl. Artif. Intell. 2011, 42, 595–615. [Google Scholar] [CrossRef]
  31. Manikandan, S.; Ramar, K.; Iruthayarajan, M.W.; Srinivasagan, K.G. Multilevel thresholding for segmentation of medical brain images using real coded genetic algorithm. Measurement 2014, 47, 558–568. [Google Scholar] [CrossRef]
  32. Bhandari, A.K.; Singh, V.K.; Kumar, A.; Singh, G.K. Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur’s entropy. Expert Syst. Appl. 2014, 41, 3538–3560. [Google Scholar] [CrossRef]
  33. Pare, S.; Bhandari, A.K.; Kumar, A.; Singh, G.K. A new technique for multilevel color image thresholding based on modified fuzzy entropy and Lévy flight firefly algorithm. Comput. Electr. Eng. 2018, 70, 476–495. [Google Scholar] [CrossRef]
  34. Ibrahim, R.A.; Elaziz, M.A.; Lu, S. Chaotic opposition-based grey-wolf optimization algorithm based on differential evolution and disruption operator for global optimization. Expert Syst. Appl. 2018, 108, 1–27. [Google Scholar] [CrossRef]
  35. Zorlu, H. Optimization of weighted myriad filters with differential evolution algorithm. AEU Int. J. Electron. Commun. 2017, 77, 1–9. [Google Scholar] [CrossRef]
  36. Lin, Q.; Zhu, Q.; Huang, P.; Chen, J.; Ming, Z.; Yu, J. A novel hybrid multi-objective immune algorithm with adaptive differential evolution. Comput. Oper. Res. 2015, 62, 95–111. [Google Scholar] [CrossRef]
  37. Jadon, S.S.; Tiwari, R.; Sharma, H.; Bansal, J.C. Hybrid Artificial Bee Colony algorithm with Differential Evolution. Appl. Soft Comput. 2017, 58, 11–24. [Google Scholar] [CrossRef]
  38. Yüzgeç, U.; Eser, M. Chaotic based differential evolution algorithm for optimization of baker’s yeast drying process. Egypt. Inf. J. 2018, 19, 151–163. [Google Scholar] [CrossRef]
  39. The Berkeley Segmentation Dataset and Benchmark. Available online: https://www2.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/segbench/ (accessed on 15 June 2018).
  40. Landsat Imagery Courtesy of NASA Goddard Space Flight Center and U.S. Geological Survey. Available online: https://landsat.visibleearth.nasa.gov/index.php?&p=1 (accessed on 17 October 2018).
  41. Harvard Medical School. Available online: http://www.med.harvard.edu/AANLIB/ (accessed on 22 December 2018).
  42. Mirjalili, S.; Gandomi, A.H.; Mirjalili, S.Z.; Saremi, S.; Faris, H.; Mirjalili, S.M. Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems. Adv. Eng. Softw. 2017, 114, 163–191. [Google Scholar] [CrossRef]
  43. Mirjalili, S. SCA: A Sine Cosine Algorithm for solving optimization problems. Knowl.-Based Syst. 2016, 96, 120–133. [Google Scholar] [CrossRef]
  44. Mirjalili, S. The Ant Lion Optimizer. Adv. Eng. Softw. 2015, 83, 80–98. [Google Scholar] [CrossRef]
  45. Geem, Z.W.; Kim, J.H.; Loganathan, G.V. A new heuristic optimization algorithm: Harmony search. Simulation 2001, 76, 60–68. [Google Scholar] [CrossRef]
  46. Ye, Z.; Wang, M.; Liu, W.; Chen, S. Fuzzy entropy based optimal thresholding using bat algorithm. Appl. Soft Comput. 2015, 31, 381–395. [Google Scholar] [CrossRef]
  47. Kennedy, J.; Eberhart, R.C. Particle swarm optimization. In Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; Volume 4, pp. 1942–1948. [Google Scholar]
  48. Li, Y.; Bai, X.; Jiao, L.; Xue, Y. Partitioned-cooperative quantum-behaved particle swarm optimization based on multilevel thresholding applied to medical image segmentation. Appl. Soft Comput. 2017, 56, 345–356. [Google Scholar] [CrossRef]
  49. Bhandari, A.K. A novel beta differential evolution algorithm-based fast multilevel thresholding for color image segmentation. Neural Comput. Appl. 2018, 1–31. [Google Scholar] [CrossRef]
  50. Kotte, S.; Kumar, P.R.; Injeti, S.K. An efficient approach for optimal multilevel thresholding selection for gray scale images based on improved differential search algorithm. Ain Shams Eng. J. 2018, 9, 1043–1067. [Google Scholar] [CrossRef] [Green Version]
  51. de Albuquerque, M.P.; Esquef, I.A.; Mello, A.R.G.; de Albuquerque, M.P. Image thresholding using Tsallis entropy. Pattern Recognit. Lett. 2004, 25, 1059–1065. [Google Scholar]
  52. John, J.; Nair, M.S.; Kumar, P.R.A.; Wilscy, M. A novel approach for detection and delineation of cell nuclei using feature similarity index measure. Biocybern. Biomed. Eng. 2016, 36, 76–88. [Google Scholar] [CrossRef]
  53. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [PubMed]
  54. Pare, S.; Bhandari, A.K.; Kumar, A.; Singh, G.K. An optimal color image multilevel thresholding technique using grey-level co-occurrence matrix. Expert Syst. Appl. 2017, 87, 335–362. [Google Scholar] [CrossRef]
  55. Zhang, L.; Zhang, L.; Mou, X.; Zhang, D. FSIM: A Feature Similarity Index for Image Quality Assessment. IEEE Trans. Image Process. 2011, 20, 2378–2386. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Frank, W. Individual Comparisons of Grouped Data by Ranking Methods. J. Econ. Entomol. 1946, 39, 269–270. [Google Scholar]
  57. Wolpert, D.H.; Macready, W.G. No free lunch theorems for optimization. Evolut. Comput. IEEE Trans. 1997, 1, 67–82. [Google Scholar] [Green Version]
  58. The USC-SIPI Image Database. Available online: http://sipi.usc.edu/database/ (accessed on 7 December 2018).
  59. Oliva, D.; Hinojosa, S.; Cuevas, E.; Pajares, G.; Avalos, O.; Gálvez, J. Cross entropy based thresholding for magnetic resonance brain images using Crow Search Algorithm. Expert Syst. Appl. 2017, 79, 164–180. [Google Scholar] [CrossRef]
  60. Sathya, P.D.; Kayalvizhi, R. Optimal segmentation of brain MRI based on adaptive bacterial foraging algorithm. Neurocomputing 2011, 74, 2299–2313. [Google Scholar] [CrossRef]
  61. Friedman, M. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J. Am. Stat. Assoc. 1937, 32, 676–701. [Google Scholar] [CrossRef]
  62. Derrac, J.; García, S.; Molina, D.; Herrera, F. A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 2011, 1, 3–18. [Google Scholar] [CrossRef]
Figure 1. Bubble-net feeding behavior of humpback whale (a) and the position update model (b).
Figure 1. Bubble-net feeding behavior of humpback whale (a) and the position update model (b).
Entropy 21 00318 g001
Figure 2. Framework of the WOA-DE based method.
Figure 2. Framework of the WOA-DE based method.
Entropy 21 00318 g002
Figure 3. Schematic diagram of the change in random variable A.
Figure 3. Schematic diagram of the change in random variable A.
Entropy 21 00318 g003
Figure 4. Original test images and the corresponding histograms.
Figure 4. Original test images and the corresponding histograms.
Entropy 21 00318 g004aEntropy 21 00318 g004bEntropy 21 00318 g004c
Figure 5. The segmented results of “Image2” at different threshold levels obtained by WOA-DE-Kapur.
Figure 5. The segmented results of “Image2” at different threshold levels obtained by WOA-DE-Kapur.
Entropy 21 00318 g005
Figure 6. The segmented results of “Image10” at different threshold levels obtained by WOA-DE-Kapur.
Figure 6. The segmented results of “Image10” at different threshold levels obtained by WOA-DE-Kapur.
Entropy 21 00318 g006
Figure 7. Comparison of PSNR values for different algorithms using Kapur’s entropy at 4, 6, 8, 10, and 12 levels.
Figure 7. Comparison of PSNR values for different algorithms using Kapur’s entropy at 4, 6, 8, 10, and 12 levels.
Entropy 21 00318 g007
Figure 8. Comparison of SSIM values for different algorithms using Kapur’s entropy at 4, 6, 8, 10, and 12 levels.
Figure 8. Comparison of SSIM values for different algorithms using Kapur’s entropy at 4, 6, 8, 10, and 12 levels.
Entropy 21 00318 g008
Figure 9. Comparison of FSIM values for different algorithms using Kapur’s entropy at 4, 6, 8, 10, and 12 levels.
Figure 9. Comparison of FSIM values for different algorithms using Kapur’s entropy at 4, 6, 8, 10, and 12 levels.
Entropy 21 00318 g009
Figure 10. The convergence curves for fitness function using Kapur’s entropy method at 12 levels thresholding.
Figure 10. The convergence curves for fitness function using Kapur’s entropy method at 12 levels thresholding.
Entropy 21 00318 g010
Figure 11. Original “Lena” and “Peppers” images from Berkeley Segmentation Dataset.
Figure 11. Original “Lena” and “Peppers” images from Berkeley Segmentation Dataset.
Entropy 21 00318 g011
Figure 12. The original “Lena” image and the corresponding segmented results under various noise levels.
Figure 12. The original “Lena” image and the corresponding segmented results under various noise levels.
Entropy 21 00318 g012
Figure 13. The original “Peppers” image and the corresponding segmented results under various noise levels.
Figure 13. The original “Peppers” image and the corresponding segmented results under various noise levels.
Entropy 21 00318 g013
Figure 14. The value of various performance measures over “Lena” image with different levels of noise.
Figure 14. The value of various performance measures over “Lena” image with different levels of noise.
Entropy 21 00318 g014
Figure 15. The value of various performance measures over “Peppers” image with different levels of noise.
Figure 15. The value of various performance measures over “Peppers” image with different levels of noise.
Entropy 21 00318 g015
Table 1. Parameters of the algorithms.
Table 1. Parameters of the algorithms.
No.AlgorithmParameter SettingYearReference
1WOA-DE C R = 0.9 ( crossover   rate ) , S F = 0.5 ( scaling   factor )
2WOA
OA
a [ 0 , 2 ] 2016[21]
3SSA c 1 [ 0 , 2 ] 2017[42]
4SCA r 1 [ 0 , 2 ] 2016[43]
5ALO ω [ 2 , 6 ] ( constant ) 2015[44]
6HSO H M C R = 0.9 , P A R = 0.3 ( pitch   adjusting   rate ) 2001[45]
7BA r i [ 0 , 1 ] ( rate   of   pluse   emission ) , A i [ 1 , 2 ] ( loudness   value ) 2015[46]
8PSO c 1 = c 2 = 2 , w [ 0.4 , 0.9 ] , v m a x = 25.5 1995[47]
9BDE a [ 0 , 1 ] ( beta   distribution   parameter ) 2018[49]
10IDSA2018[50]
Table 2. The average fitness values and STD values obtained by all algorithms.
Table 2. The average fitness values and STD values obtained by all algorithms.
MeasuresImageKWOA-DEWOASSASCAALOHSOBAPSOBDEIDSA
MeanImage1418.584318.584318.584318.563218.584318.576118.581818.584218.584318.5843
623.841823.7323.840823.47923.841723.75523.808523.841223.811523.8383
828.509428.460528.505127.822528.462728.38527.763128.499128.511828.5139
1032.846232.843232.832531.368532.844332.668232.085832.751932.845532.7269
1236.853436.716436.726934.588136.731336.622134.764136.69636.764236.7764
Image6418.483918.478418.481718.443418.483618.477818.474518.483918.481618.4836
624.005923.998823.999423.76524.00523.968723.922524.001524.005124.0059
828.93728.874328.883627.997328.927228.850828.269628.929328.934228.9196
1033.348333.300933.185131.876833.274333.086731.632133.319733.307933.2562
1237.367437.27137.104635.887637.324636.864435.106837.181337.355337.2569
STDImage1402.66 × 10−52.66 × 10−54.39 × 10−35.83 × 10−53.19 × 10−32.17 × 10−32.68 × 10−52.471.58 × 10−1
63.25 × 10−51.61 × 10−49.58 × 10−47.45 × 10−22.95 × 10−41.97 × 10−25.39 × 10−24.33 × 10−48.41 × 10−11.59
84.32 × 10−42.74 × 10−28.89 × 10−31.33 × 10−13.24 × 10−23.38 × 10−21.82 × 10−17.30 × 10−31.39.98 × 10−1
103.38 × 10−35.36 × 10−33.90 × 10−22.67 × 10−14.91 × 10−23.24 × 10−21.51 × 10−13.34 × 10−27.76 × 10−17.27 × 10−1
121.83 × 10−23.25 × 10−27.48 × 10−22.30 × 10−16.12 × 10−25.02 × 10−26.41 × 10−17.35 × 10−26.66 × 10−16.65 × 10−1
Image643.91 × 10−37.91 × 10−34.81 × 10−31.24 × 10−28.29 × 10−15.49 × 10−34.60 × 10−33.93 × 10−36.96 × 10−32.92 × 10−1
61.68 × 10−23.81 × 10−31.94 × 10−26.82 × 10−24.20 × 10−33.58 × 10−22.96 × 10−25.03 × 10−34.661.75
81.57 × 10−22.64 × 10−21.64 × 10−21.60 × 10−12.48 × 10−24.37 × 10−23.94 × 10−16.14 × 10−23.889.82 × 10−1
102.15 × 10−24.26 × 10−23.64 × 10−21.40 × 10−15.49 × 10−22.50 × 10−24.03 × 10−13.55 × 10−22.288.98 × 10−1
121.53 × 10−23.02 × 10−29.90 × 10−22.85 × 10−12.52 × 10−26.41 × 10−23.37 × 10−13.43 × 10−21.671.25
Table 3. The PSNR, SSIM, and FSIM values obtained by all algorithms under different threshold levels.
Table 3. The PSNR, SSIM, and FSIM values obtained by all algorithms under different threshold levels.
MeasuresImageKWOA-DEWOASSASCAALOHSOBAPSOBDEIDSA
PSNRImage2418.655818.655818.655818.653318.655818.572218.435218.655818.645218.6558
622.248120.858821.340221.579921.314820.86120.259621.713620.858820.9995
824.882123.174423.637323.487724.162424.572423.115823.37223.586323.5837
1027.911625.395625.950227.044627.705125.321125.128925.393825.8725.9861
1229.880529.839529.671928.676729.430926.302329.221829.3429.066329.2001
Image7423.236722.94722.928622.930523.044222.976522.92322.98222.98222.9122
626.648126.555326.520526.595326.65626.468526.596326.615626.52726.5732
829.188629.100428.940527.860629.13229.06327.937829.008829.115129.0763
1031.215430.943331.118629.666530.957930.6428.399730.919931.037431.169
1232.720332.653831.702230.10132.656631.629528.98832.703532.677432.6603
SSIMImage240.52660.52660.52660.52530.51860.52120.52120.52660.52420.5266
60.6520.61030.6170.61050.61920.63790.58640.63320.61030.6197
80.73610.69440.70520.69760.72810.72240.70940.69780.70040.6963
100.80640.75510.76080.77010.79960.75340.72470.75940.77050.7733
120.85050.84840.84320.78590.84110.84630.81820.83670.84830.8269
Image740.84940.84140.84070.84190.84560.84050.83820.84160.84160.8399
60.91360.90970.9070.90860.91150.90910.90980.90870.90910.9079
80.94220.94090.93920.92540.94150.94120.92410.94040.94160.9418
100.96480.96080.96030.9460.95870.95520.92550.96240.96330.9637
120.97260.97150.96240.95430.97240.9630.93380.97180.97240.9725
FSIMImage240.71510.71510.71510.71490.71510.71170.71150.71510.71420.7151
60.79210.77070.77230.77080.77110.78760.75770.77990.77070.7866
80.84350.82570.82890.82460.84260.83130.80930.8240.82560.8198
100.87450.86170.85820.84230.87380.86160.81530.8640.86860.8682
120.90410.90360.90050.89870.90070.89780.85310.88060.90220.8915
Image740.90120.89640.89590.89650.89910.89680.89530.89720.89720.8956
60.94690.94450.9460.94580.94670.94490.94680.94650.94530.9464
80.96710.96660.96580.95910.96650.96590.95590.96580.96660.966
100.97730.97580.97520.9710.97590.97540.95740.97650.97610.9763
120.98340.98240.97990.97290.98290.98020.96640.98280.98250.9826
Table 4. The average computation time (s) considering all images under different threshold levels.
Table 4. The average computation time (s) considering all images under different threshold levels.
KWOA-DEWOASSASCAALOHSOBAPSOBDEIDSA
41.400871.0471.490621.494387.80461.037391.971221.708872.213351.41216
61.552591.145271.639021.621719.667731.103382.084521.884912.403891.5397
81.670411.184491.728571.676412.090741.184782.318041.991032.482571.56885
101.742871.244461.792941.8684915.318651.239332.368362.135322.585951.67435
121.881041.393351.954421.9836917.196511.303392.5132.234872.747911.70745
Table 5. Wilcoxon’s rank sum test results.
Table 5. Wilcoxon’s rank sum test results.
Comparisonp-Value
WOA-DE versus WOA2.3197 × 10−4
WOA-DE versus SSA9.0193 × 10−8
WOA-DE versus SCA6.8546 × 10−7
WOA-DE versus ALO4.2264 × 10−10
WOA-DE versus HSO7.6791 × 10−7
WOA-DE versus BA3.2115 × 10−9
WOA-DE versus PSO7.6473 × 10−8
WOA-DE versus BDE4.5474 × 10−5
WOA-DE versus IDSA7.0546 × 10−4
Table 6. Comparison of Kapur’s entropy and Otsu methods based on WOA-DE algorithm.
Table 6. Comparison of Kapur’s entropy and Otsu methods based on WOA-DE algorithm.
ImagesKPSNRSSIMFSIM
OtsuKapurOtsuKapurOtsuKapur
Image1420.342817.77810.57980.46810.77710.734
622.670224.9770.68150.65590.84580.8197
824.051628.60920.74460.80330.91220.8798
1025.216430.66870.78980.8330.92250.9039
1226.189732.20540.80590.86720.9260.9271
Image2418.45918.65580.6080.52660.75820.7151
620.918222.24810.70950.6520.82450.7921
824.562224.88210.81640.73610.86840.8435
1025.758527.91160.84210.80640.88780.8745
1228.414429.88050.89640.85050.9170.9041
Image3417.577620.82470.69710.71090.69720.7182
622.755523.60590.74310.75920.74690.7619
827.896726.01320.79480.80360.7950.8017
1029.540529.01840.83410.84330.83220.8329
1231.689132.68860.86330.87290.86190.8646
Image4419.001523.0130.61510.6120.70120.6484
624.429626.98720.76310.71880.81290.7665
827.978129.76820.84340.79530.87930.8415
1032.071331.76030.88880.84560.91930.8907
1233.922733.0960.91940.87670.94310.9203
Image5423.450923.44950.80820.72310.84690.7925
627.239627.24170.89480.82860.91420.8716
829.607329.58520.9260.89030.94150.9229
1031.502431.47040.93450.9190.95850.9452
1232.910532.7820.94570.94290.96720.9614
Image6419.219220.5970.66260.59950.77120.7443
623.493425.48830.80610.75870.86730.8562
827.646728.68980.87320.84270.91920.9136
1029.728931.2920.91040.90020.94160.9489
1232.040632.70580.93840.92270.95990.9615
Image7418.947423.23670.78980.84940.8480.9012
623.674226.64810.89380.91360.91980.9469
826.829429.18860.93830.94220.95130.9671
1030.55931.21540.96260.96480.97280.9773
1232.902132.72030.97810.97260.98280.9834
Image8420.369519.48010.53720.48810.7860.7807
623.498225.57170.63650.70430.86430.8705
825.539927.81730.73260.78230.90070.9102
1027.232630.67270.81740.84790.92280.9361
1230.494532.04420.84830.88490.9430.9514
Image9420.585822.16960.67590.65810.84980.8671
625.140326.34490.74650.74920.91740.9197
828.67229.29540.79380.80820.94760.9524
1030.902631.1260.87110.87160.96640.9661
1232.585532.98780.90120.87570.97610.9764
Image10420.212122.61280.73990.75510.83120.8499
624.916827.03970.81280.83550.90750.9179
829.125429.54410.88650.86490.95030.947
1030.953231.4470.91960.87740.96410.9645
1232.512932.83510.92840.89230.97290.9734
Rank2(11)1(39)2(29)1(21)1(25)1(25)
Table 7. Comparison of Optimal threshold and PSNR value obtained by WOA-DE-Kapur, ABF-Otsu, and CSA-MCET.
Table 7. Comparison of Optimal threshold and PSNR value obtained by WOA-DE-Kapur, ABF-Otsu, and CSA-MCET.
ImagesKOptimal Threshold ValuePSNR
WOA-DE-KapurABF-OtsuCSA-MCETWOA-DE-KapurABF-OtsuCSA-MCET
Slice20294 16728 9713 8416.858616.52415.9746
39 118 21929 87 15118 64 13423.900823.106122.4605
48 29 129 2107 53 100 15316 64 98 14724.622825.497224.3967
516 36 94 171 21121 54 98 156 1903 40 61 113 15030.491227.341128.5034
Slice242111 18248 14519 11819.734521.083920.8004
334 117 18240 108 1727 56 13623.442822.991323.5030
417 73 129 19323 70 118 1826 50 101 16126.784826.206124.7095
514 70 115 165 21020 63 102 143 1964 27 66 111 17028.920428.331825.3871
Slice282114 17952 15120 12119.699118.688419.1865
320 81 15646 110 1757 56 13924.898324.361623.7032
422 78 137 19227 76 126 1876 48 103 16126.945527.041925.8075
513 72 117 157 20323 68 109 149 2036 36 74 115 17429.682229.188428.1382
Slice322115 17553 15920 13723.349622.88822.6576
316 76 14350 120 1898 54 14824.71123.273525.9537
416 74 131 18621 70 122 1917 52 107 17227.585227.95827.947
518 71 118 162 20519 63 105 147 2063 28 67 116 18029.791428.618329.598
Rank1(10)2(4)3(2)
Table 8. Comparison of SSIM and FSIM value obtained by WOA-DE-Kapur, ABF-Otsu, and CSA-MCET.
Table 8. Comparison of SSIM and FSIM value obtained by WOA-DE-Kapur, ABF-Otsu, and CSA-MCET.
ImagesKSSIMFSIM
WOA-DE-KapurABF-OtsuCSA-MCETWOA-DE-KapurABF-OtsuCSA-MCET
Slice2020.79230.77260.78820.87430.85650.8421
30.87840.80610.88110.94110.93050.9594
40.92250.84080.92080.96080.96140.9599
50.94350.88620.92490.98820.96740.9723
Slice2420.68090.78860.78650.77720.81780.8117
30.83910.83180.83430.86860.86600.8394
40.87910.87700.87420.90810.90260.8944
50.90150.89590.89970.92770.92530.9099
Slice2820.78320.76780.77920.8130.83940.8274
30.83650.82380.82750.88490.88460.8585
40.86720.86870.86910.90840.91360.9156
50.89930.89370.90100.93710.93550.9366
Slice3220.81230.79730.78620.86170.83880.8589
30.84650.8320.85130.88640.89430.9009
40.87940.88240.87840.91990.92710.9275
50.90230.87050.89910.94770.92370.9347
Rank1(10)3(2)2(4)1(9)3(3)2(4)
Table 9. The segmented MRI for different algorithms at 2, 3, 4, and 5 levels.
Table 9. The segmented MRI for different algorithms at 2, 3, 4, and 5 levels.
KWOA-DE-KapurABF-OtsuCSA-MCETWOA-DE-KapurABF-OtsuCSA-MCET
Slice20Slice24
2 Entropy 21 00318 i001 Entropy 21 00318 i002 Entropy 21 00318 i003 Entropy 21 00318 i004 Entropy 21 00318 i005 Entropy 21 00318 i006
3 Entropy 21 00318 i007 Entropy 21 00318 i008 Entropy 21 00318 i009 Entropy 21 00318 i010 Entropy 21 00318 i011 Entropy 21 00318 i012
4 Entropy 21 00318 i013 Entropy 21 00318 i014 Entropy 21 00318 i015 Entropy 21 00318 i016 Entropy 21 00318 i017 Entropy 21 00318 i018
5 Entropy 21 00318 i019 Entropy 21 00318 i020 Entropy 21 00318 i021 Entropy 21 00318 i022 Entropy 21 00318 i023 Entropy 21 00318 i024
KSlice28Slice32
2 Entropy 21 00318 i025 Entropy 21 00318 i026 Entropy 21 00318 i027 Entropy 21 00318 i028 Entropy 21 00318 i029 Entropy 21 00318 i030
3 Entropy 21 00318 i031 Entropy 21 00318 i032 Entropy 21 00318 i033 Entropy 21 00318 i034 Entropy 21 00318 i035 Entropy 21 00318 i036
4 Entropy 21 00318 i037 Entropy 21 00318 i038 Entropy 21 00318 i039 Entropy 21 00318 i040 Entropy 21 00318 i041 Entropy 21 00318 i042
5 Entropy 21 00318 i043 Entropy 21 00318 i044 Entropy 21 00318 i045 Entropy 21 00318 i046 Entropy 21 00318 i047 Entropy 21 00318 i048
Table 10. Friedman test for WOA-DE-Kapur, ABF-Otsu, and CSA-MCET on MR images.
Table 10. Friedman test for WOA-DE-Kapur, ABF-Otsu, and CSA-MCET on MR images.
KAverage Rankp-Value
WOA-DE-KapurABF-OtsuCSA-MCET
21.66672.00002.33332.2619 × 10−7
31.58332.58331.83331.1603 × 10−8
42.00001.66672.33337.2217 × 10−9
51.08332.75002.16675.3467 × 10−9
Table 11. Wilcoxon’s rank sum test for WOA-DE-Kapur, ABF-Otsu, and CSA-MCET on MR images.
Table 11. Wilcoxon’s rank sum test for WOA-DE-Kapur, ABF-Otsu, and CSA-MCET on MR images.
KWOA-DE-Kapur vs. ABF-OtsuWOA-DE-Kapur vs. CSA-MCET
p-Valuehp-Valueh
2< 0.051< 0.051
3< 0.0510.09260
4< 0.051< 0.051
5< 0.051< 0.051

Share and Cite

MDPI and ACS Style

Lang, C.; Jia, H. Kapur’s Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm. Entropy 2019, 21, 318. https://doi.org/10.3390/e21030318

AMA Style

Lang C, Jia H. Kapur’s Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm. Entropy. 2019; 21(3):318. https://doi.org/10.3390/e21030318

Chicago/Turabian Style

Lang, Chunbo, and Heming Jia. 2019. "Kapur’s Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm" Entropy 21, no. 3: 318. https://doi.org/10.3390/e21030318

APA Style

Lang, C., & Jia, H. (2019). Kapur’s Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm. Entropy, 21(3), 318. https://doi.org/10.3390/e21030318

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop