Next Article in Journal
Land-Cover Changes to Surface-Water Buffers in the Midwestern USA: 25 Years of Landsat Data Analyses (1993–2017)
Previous Article in Journal
Landslides Information Extraction Using Object-Oriented Image Analysis Paradigm Based on Deep Learning and Transfer Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Irregular Tessellation and Statistical Modeling Based Regionalized Segmentation for SAR Intensity Image

1
The Institute for Remote Sensing, School of Geomatics, Liaoning Technical University, Fuxin 123000, China
2
Satellite Surveying and Mapping Application Center, NASG, Beijing 100081, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2020, 12(5), 753; https://doi.org/10.3390/rs12050753
Submission received: 13 December 2019 / Revised: 6 February 2020 / Accepted: 21 February 2020 / Published: 25 February 2020
(This article belongs to the Section Remote Sensing Image Processing)

Abstract

:
This paper presents a regionalized segmentation method for synthetic aperture radar (SAR) intensity images based on tessellation with irregular polygons. In the proposed method, the image domain is partitioned into a collection of irregular polygons, which are constructed using sets of nodes and are used to fit homogeneous regions with arbitrary shapes. Each partitioned polygon is taken as the basic processing unit. Assuming the intensities of the pixels in the polygon follow an independent and identical gamma distribution, the likelihood of the image intensities is modeled. After defining the prior distributions of the tessellation and the parameters for the likelihood model, a posterior probability model can be built based on the Bayes theorem as a segmentation model. To obtain optimal segmentation, a reversible-jump Markov chain Monte Carlo (RJMCMC) algorithm is designed to simulate from the segmentation model, where the move operations include updating the gamma distribution parameter, updating labels, moving nodes, merging polygons, splitting polygons, adding nodes, and deleting nodes. Experiments were carried out on synthetic and real SAR intensity images using the proposed method while the regular and Voronoi tessellation-based methods were also preformed for comparison. Our results show the proposed method overcomes some intrinsic limitations of current segmentation methods and is able to generate good results for homogeneous regions with different shapes.

Graphical Abstract

1. Introduction

The synthetic aperture radar (SAR) system has been applied to numerous fields, providing high-resolution imagery, having a strong penetration capability, and acquiring images both day and night and in all weather conditions [1,2]. In SAR image processing, segmentation is the most important task, because its result is critical for subsequent high-level image processing tasks, such as feature extraction, object recognition, and classification [3,4]. Currently, many SAR image segmentation methods have been proposed, including ones based on region [5,6], edge [7,8], clustering [9,10], and statistical models [11,12]. However, the unique imaging mechanism of the SAR system produces images that contain substantial inherent speckle noise. The results of SAR image segmentation are highly susceptible to the noise. Many studies have shown that the speckle noise inherent in SAR imagery can be characterized as a statistical distribution; thus, the statistical model-based segmentation methods are considered to be more efficient [13,14]. Traditionally, statistical segmentation methods always take the pixel as the primary processing unit, resulting in heavy missegmentation [15,16]. In order to solve this issue, region-based statistical segmentation methods have been proposed [17,18]. Their basic principle is that the image domain is first partitioned into a group of sub-regions, and the partitioned sub-regions are viewed as basic processing units to model image segmentation. Wang et al. [19] utilized regular tessellation to partition the image domain into rectangles or squares. Then, several sub-regions were used to fit a homogeneous region. The segmentation method is straightforward and tackles the issue of error segmentation in homogeneous regions to a certain extent; however, the effect of boundary fitting can be vague and irregular. In order to improve boundary fitting, Zhao et al. [20] proposed using Voronoi tessellation instead of regular tessellation. Although the effect of boundary fitting is slightly improved, there are still difficulties in fitting specific shapes due to the convex characteristics of Voronoi polygons. The proposed method is based on an iterative elaboration of the selected polygons, in order to best fit the shapes in the geometry of the intensity image.

2. Description of the Proposed Algorithm

2.1. Irregular Tessellation

Given a SAR image, irregular tessellation is used to partition its domain, D, a collection of irregular polygons constructed with a set of nodes, that is, D = {Dj; j = 1, …, m}, where m is the number of polygons, j is the index of the partitioned polygons, and Dj denotes the region occupied by the polygon j. Let Pj = {(sjg, tjg) ∈ D; g = 1, …, nj} be the set of nodes, where nj is the number of nodes, g is the node index, and (sjg, tjg) is the coordinate of the node g. Furthermore, let P = P1P2∪...∪Pm be the set of all nodes formed by the tessellation. All nodes are categorized into one of two types: mobile and immobile nodes, which are denoted as Pmm and Pim, respectively. Accordingly, P can be expressed as P = {Pim, Pmm}. The vertices of the image domain are viewed as immobile nodes, while the others as mobile. The mobile nodes are further categorized into two sub-types: (1) nodes on image boundaries and (2) nodes inside the image domain. The latter can freely move within the domain, while the former can only move on the image they locate at.
Figure 1 shows a partition of an image domain, D, by the proposed irregular tessellation, where D is partitioned into four polygons, such that D = {D1, D2, D3, D4}, and its node set is {P1, P2, P3, P4}, where P1 = {(s11, t11), (s12, t12), (s13, t13), (s14, t14)}, P2 = {(s21, t21), (s22, t22), (s23, t23), (s24, t24), (s25, t25)}, P3 = {(s31, t31), (s32, t32), (s33, t33), (s34, t34)}, and P4 = {(s41, t41), (s42, t42), (s43, t43)}. Thus, P = {(s11, t11), (s12, t12)/(s121, t21), (s22, t22), (s14, t14)/(s41, t41), (s13, t13)/(s25, t25)/(s31, t31)/(s42, t42), (s24, t24)/(s32, t32), (s23, t23)/(s33, t33), (s35, t35)/(s43, t43), (s34, t34)}. The symbol “/” indicates that both the nodes constructing different polygons are the same. Pim = {(s11, t11), (s22, t22), (s35, t35)/(s43, t43), (s34, t34)}. Pmm = P \ Pim. It is worth noting that, as the nodes on the image boundaries, (s12, t12)/(s21, t21), (s14, t14)/(s41, t41), (s23, t23)/(s33, t33) can only move along the boundary they are on.

2.2. Segmentation Model

Assume that a SAR image contains a known number, k, of homogeneous regions, and its domain is partitioned into an unknown number, m, of polygons by irregular tessellation, where m can be considered as a random variable and follows a prior distribution. Each polygon assigns a random variable, Lj, to indicate its membership to a homogeneous region. The label variables for all polygons form a label field, L = {Lj; j = 1, ..., m}. Let l = {lj ∈{1, ..., k}; j = 1, ...., m} denote a realization of L, which corresponds to a segmentation result of the image.
According to the Bayesian theorem [21], a posterior probability as the segmentation model can be written as
p ( m , L , P , β | Z ) p ( Ζ | m , L , P , β ) p ( L | m ) p ( P | m ) p ( β ) p ( m )
where p(Z | m, L, P, β) is the likelihood model for the SAR image, characterized by gamma distribution [22],
p ( Z | m , L , P , β ) = l = 1 k ( x i , y i ) Δ l Z i α 1 Γ ( α ) β l α exp ( Z i β l )
where α and β = {βl; l = 1, ..., k} are the shape and scale parameters of the gamma distribution, and Δl = {Dj: lj = l, j = 1, ..., m} is the collection of polygons with the same label l. p(L| m) is the statistic model of the label field L, which can be defined based on the Markov random field (MRF) [23,24]
p ( L | m ) = j = 1 m p ( L j | L j , j N j ) = j = 1 m exp ( c j N j δ ( L j , L j ) ) l = 1 k exp ( c j N j δ ( l , L j ) )
where c > 0 is a constant that controls the neighborhood dependence between pairs of neighboring polygons [25] and δ is an indicator function,
δ ( L j , L j ) = { 1 ,   if   L j = L j   0 ,   otherwise
p(P) is the joint prior distribution of the nodes in P, which is characterized by uniform distribution in the image domain D,
p ( P | m ) = ( 1 D ) n p = ( D ) n p
where np indicates the total number of images.
For a multi-look SAR intensity image, the shape parameters α of its gamma distribution can be viewed as the number of its looks [26]. p(β) is the joint distribution of {βl; l = 1, ..., k}. Under the assumption that βl, l = 1, ..., k, follow identical independent Gaussian distributions with the same distribution parameter μβ and σβ , p(β) can be expressed as
p ( β ) = l = 1 k 1 2 π σ β exp [ ( β l μ β ) 2 2 σ β 2 ]
p(m) is the prior distribution for the number of polygons, m, which is assumed to satisfy the Poisson distribution with mean λ [27],
p ( m ) = λ m m ! exp ( λ )
Using Equations (2)–(7), the segmentation model of Z defined in Equation (1) can be rewritten as
p ( m , L , P , β | Z ) p ( Ζ | m , L , P , β ) p ( L | m ) p ( P | m ) p ( β ) p ( m ) = l = 1 k ( x i , y i ) Δ l Z i α 1 Γ ( α ) β l α exp ( Z i β l ) × j = 1 m exp ( c j N j δ ( L j , L j ) ) l = 1 k exp ( c j N j δ ( l , L j ) ) × l = 1 k 1 2 π σ β exp [ ( β l μ β ) 2 2 σ β 2 ] × λ m m ! exp ( λ ) × ( D ) n p

2.3. Simulation

In order to obtain the optimal segmentation from Equation (8), a reversible-jump Markov chain Monte Carlo (RJMCMC) [28] algorithm was designed to simulate from the posterior probability and the maximum a posterior (MAP) [29] scheme was adopted. Using MAP, the optimal segmentation result could be expressed as
( m ^ , L ^ , P ^ , β ^ ) = arg max { p ( m , L , P , β | Z ) }
To obtain the optimal segmentation result, seven move operations were designed.
Move 1: Updating the gamma distribution parameter. Randomly select a scale parameter from β = {βl; l = 1, ..., k}, for example βl. The proposed βl* is drawn from a Gaussian distribution with the mean βl and standard deviation εβ (i.e., βl*~ N(βl, εβ)). The acceptance probability of changing β to β* = {β1, ..., βl-1, βl*, βl+1, ..., βk} can be calculated as,
α β = min { 1 , p ( Z | m , L , P , β * ) p ( β * | L ) p ( Z | m , L , P , β ) p ( β | L ) }
Move 2: Updating the label. A polygon Dj with the label lj is uniformly drawn with the probability 1/m from {Dj; j = 1, …, m}. To update its label, a proposed label lj* is uniformly drawn from {1, ..., k} and restricted to lj*lj. The realization l = {l1, ..., lj, ..., lm} of L after updating lj to lj* becomes l * = {l1, ..., lj-1, lj*, lj+1, ..., lm}. The acceptance probability of changing l to l* can be written as
α L = min { 1 , p ( Z | m , l * , P , β ) p ( l * | m ) p ( Z | m , l , P , β ) p ( l | m ) }
Move 3: Moving the node. A node is uniformly selected from mobile nodes Pmm (e.g., (sjg, tjg)) to move to a new proposed candidate point (sjg*, tjg*). If the node is located inside the image domain, the candidate point is selected randomly within a circle with the center at (sjg, tjg) and the radius r. If the node is on the boundary of the image, it can only move along the side of the boundary that it is on. If the node moves from (sjg, tjg) to (sjg*, tjg*), the polygon Dj is changed into Dj*. Consequently, the set of the nodes for the polygon j, Pj = {(sj1, tj1), …, (sjg, tjg), …, (sjnj, tjnj)}, become Pj*= {(sj1, tj1), …, (sjg*, tjg*), …, (sjnj, tjnj)}. The node sets for all polygons become P* = P1∪...∪Pj-1Pj*Pj+1∪...∪Pm. Figure 2 shows two examples of the moving node operation, where Figure 2a,b shows the example of moving a node inside the image domain and Figure 2d the example of moving a node on the image boundary. After the moving node operation, the shapes of all the polygons related to the mobile node are changed.
The acceptance probability for the moving node can be written as
α P = min { 1 , p ( Z | m , L , P * , β ) p ( P * | m ) p ( Z | m , L , P , β ) p ( P | m ) }
Move 4: Merging polygons. A pair of neighbor polygons is selected, for example (Dj, Dj’) and j < j’. The two polygons Dj and Dj are merged into a candidate polygon Dj*, and then the set of partitioned polygons {D1, ..., Dj, ..., Dj’, ..., Dm} is changed into {D1, ..., Dj*, ..., Dm-1*}. Accordingly, its node set Pj* can be obtained as Pj* = PjPj (specifically, delete the node located on the line). Then, the proposed lj* for the Dj* is uniformly drawn from {1, ..., k} with the probability (1/k). The number of polygons after the merging polygons operation becomes m−1. The label field L = {L1, ..., Lj, ..., Lj’, ..., Lm} becomes L* = {L1, ..., Lj*, ..., Lm-1*}. Figure 3 shows an example of merging polygons, where polygons D1 and D4 are selected to be merged as polygon D1*. The set of polygons D = {D1, D2, D3, D4} becomes D* = {D1*, D2*, D3*}, where D1* = D1D4.
The acceptance probability of merging polygons can be written as,
α M P = min { 1 , p ( Z | m 1 , L * , P * , β * ) p ( L * | m 1 ) p ( P * | m 1 ) p ( m 1 ) p ( Z | m , L , P , β ) p ( L | m ) p ( P | m ) p ( m ) }
Move 5: Splitting polygons. A polygon with more than three nodes is selected randomly, for example Dj. A node (sjg, tjg) is selected from the node set Pj, randomly. Then another node is selected, for example (sjg, tjg), which is not adjacent to (sjg, tjg) from the node set Pj. The two selected nodes, (sjg, tjg) and (sjg, tjg), are then connected. As a result, Dj is split into two polygons, denoted as Dj* and Dm+1*. Correspondingly, Pj is divided into Pj*Pj and Pm+1*Pj. The P = {P1, ..., Pj, ..., Pm} is changed to P* = {P1, ... ,Pj*, ...,Pm*, Pm+1}. Figure 4 shows an example of splitting a polygon, where the polygon D2 is selected to be split into polygons D2* and D3*. The set of polygons D = {D1, D2, D3, D4} become D* = {D1, D2*, D3, D4, D5*}, where D2 = D2*D5*.
The acceptance probability of splitting polygons can be written as
α S P = min { 1 , p ( Z | m + 1 , L * , P * , β * ) p ( L * | m + 1 ) p ( P * | m + 1 ) p ( m + 1 ) p ( Z | m , L , P , β ) p ( L | m ) p ( P | m ) p ( m ) }
Move 6: Adding a node. For a randomly selected polygon, for example Dj, with one of its edges inside the image domain with the end points (sjg, tjg) and (sjg+1, tjg+1), a candidate node, denoted as (sjnj+1, tjnj+1), is uniformly drawn from the area from the intersection of the image domain and the circle with the center at the edge and the diameter equal to the length of the edge. Consequently, the set of nodes Pj = {(sjg, tjg) ∈ D; g = 1, …, nj} is changed to Pj*= {(sjg, tjg) ∈ D; g = 1, …, nj+1}, and Pj = {(sjg, tjg) ∈ D; g = 1, …, nj} is changed to Pj*= {(sjg, tjg) ∈ D; g = 1, …, nj+1}. Additionally, the polygon Dj and its neighbor Dj, which share the edge with Dj, are changed to Dj* and Dj*, respectively. Figure 5 shows an example of adding a node, where the edge selected is made up of points (s25, t25) and (s24, t24) from D2, and its neighbor polygon sharing the edge is D3. After the operation, the number of nodes in polygon D2 is transformed from five to six, while the number of nodes in polygon D3 is also changed from five to six. Polygons D2 and D3 are changed into D2* and D3*, respectively.
The acceptance probability of adding a node can be written as
α A N = min { 1 , p ( Z | m , L , P * , β ) p ( P * | m + 1 ) p ( Z | m , L , P , β ) p ( P | m ) }
Move 7: Deleting a node. A concave polygon Dj is selected randomly from the current m polygons. Two adjacent edges are selected from Dj. The common node of the two edges is deleted. After deleting, the new edge can be generated by connecting the remaining nodes of the edges. Consequently, the set of nodes Pj = {(sjg, tjg) ∈ D; g = 1, …, nj} is changed to Pj*= {(sjg, tjg) ∈ D; g = 1, …, nj-1}, and Pj = {(sjg, tjg) ∈ D; g = 1, …, nj} is changed to Pj*= {(sjg, tjg) ∈ D; g = 1, …, nj-1}. The polygons Dj and Dj are changed to Dj* and Dj*, respectively. Figure 6 shows an example of deleting a node. The concave polygon is D2, and its neighbor polygon is D3. Two adjacent edges are selected from D2, and then delete the common node, (s24, t24)/(s32, t32), of the edges. Thus, the remaining nodes, (s13, t13)/(s25, t25)/(s31, t31)/(s42, t42) and (s23, t23)/(s33, t33), are connected to generate a new edge. After the operation, the number of nodes of polygon D2 is converted from five to four, and the number of nodes of polygon D3 is also changed from five to four. Polygons D2 and D3 are changed into D2* and D3*, respectively.
The acceptance probability of deleting a node can be written as
α D N = min { 1 , p ( Z | m , L , P * , β ) p ( P * | m + 1 ) p ( Z | m , L , P , β ) p ( P | m ) }

3. Experimental Results and Discussion

To verify the feasibility and effectiveness of the proposed algorithm, experiments were performed on both the simulated and intensity SAR images.

3.1. Experiment Setups

The proposed method was implemented by MATLAB programming and run on an Intel(R) Core (TM) i7-4790 CPU@ 3.6GHz 4G computer. The running time was about 30 min. Table 1 lists the constants used in the proposed algorithm for the experiment. As the number of polygons changed by splitting and merging polygon operations, the value of the initial m had no significant impact on the results. In order to facilitate the following move operation, the initial tessellation partitioned the image domain D into 16 squares, such that the initial m = 16. The constant c was the coefficient used for characterizing the dependence of the neighboring polygons in the improved Potts model as defined in Equation (3), such that the conditional probability of the label for a polygon was a monotonic function. Based on a series of experiments, c ∈ [0.5, 1.5] was recommended [30]. In the experiment, the constant c was set to one. For multi-look SAR images, the shape parameter α of the gamma distribution was equal to the number of its looks. In the experiment, four-look SAR images were used for testing the proposed algorithm, such that α = 4. The initial scale parameters of gamma distribution were also drawn from their distributions, i.e., βl ~ N(μβ, σβ), l = 1, ..., k. The values of the mean μβ and standard deviation σβ were set as 32 and 8, respectively. The constant εβ was the proposed variance for β, which affects the convergence rate of the algorithm under the RJMCMC scheme. When εβ is set to be too large, the parameter estimation is inaccurate, but if εβ is set to be too small, the algorithm converges slowly. According to [31], the proper parameters can be obtained when εβ is set to one. In the experiment, the number of iterations was set to 10,000. Generally, 10,000 iterations are sufficient to ensure convergence of the algorithm.

3.2. Simulated SAR Image Segmentation

To create a simulated image, a template of size 128 × 128 was constructed, as shown in Figure 7a. The number of homogeneous regions was three. For the simulated SAR image, each homogeneous region followed a gamma distribution, where the shape parameter was equal to four, and the scale parameter is listed in Table 2. The simulated image is shown in Figure 7b. In order to verify the capability of fitting homogeneous regions with sharp angles in the proposed method, the simulated image was designed to have a sharp angle, as shown in Figure 7b highlighted by a blue rectangle. Figure 7c shows the zoomed image of the sharp angle area.
Figure 8 displays the segmentation results of the simulated image. Figure 8a shows the partition result from the irregular tessellation, and Figure 8b provides the optimal segmentation result. As shown in Figure 8a, each homogeneous region was fitted by one irregular polygon. To evaluate the proposed segmentation method qualitatively, the outlines of the segmented homogeneous regions (marked in red) were overlaid on the original image, as shown in Figure 8c. Figure 8d–f shows the zoomed-in images of the highlighted regions (in blue squares) from Figure 8a–c. As shown in Figure 8, the segmented regions from the proposed segmentation method perfectly fitted the homogeneous regions in the simulated image.
In order to verify the effectiveness of the proposed irregular partition method, the regular partition method [19] and Voronoi partition method [31] were used as comparison method. The results from the regular tessellation-based and Voronoi tessellation-based segmentation methods are illustrated in Figure 9 and Figure 10. The partition results of the regular and Voronoi tessellations are presented in Figure 9a and Figure 10a, the optimal segmentation results are provided in Figure 9b and Figure 10b, and the visual evaluation results are presented in Figure 9c and Figure 10c. Figure 9d–f and Figure 10d–f show the zoomed in images (in blue squares) from Figure 9a–c and Figure 10a–c, respectively. As shown in Figure 9, regular tessellation solved the problem of error segmentation caused by speckle noise in homogeneous regions to a certain extent, but boundary fitting results were coarse and uneven. From Figure 10, although the Voronoi polygons fitted most of the segments along the boundaries well, the results show that the method had difficulty matching the region with sharp angles (see Figure 10f).
In order to verify the effectiveness of the proposed method for SAR image segmentation, the most classic multi-threshold method [32] was used as the contrast method to carry out experiments on the simulated SAR image, and the experimental results are shown in Figure 11. Figure 11a is the segmentation result. It can be seen that this method segmented region I better, but there were still many noises in regions II and III. In order to evaluate the experimental results qualitatively from the visual vision, the contour lines of the segmentation results were overlapped with the experimental image, as shown in the Figure 11b. It can be clearly seen that there was a lot of noise in regions II and III.
To evaluate quantitatively the effectiveness of all the segmentation methods, the confusion matrixes for their segmentation results (Figure 8b, Figure 9b, Figure 10b and Figure 11a) were calculated, taking the image from Figure 7a as a reference. Based on the matrixes, the producer’s accuracy, user’s accuracy, the overall accuracy, and the Kappa coefficient were calculated and listed in Table 3 [33]. From Table 3, the overall precision of the proposed segmentation method was 98.57%, which demonstrates that the proposed method achieved excellent segmentation and was comparatively better than the regular, Voronoi tessellation-based segmentation methods and the multi-threshold segmentation method.
Figure 12 shows the changes of scale parameters throughout the 10,000 iterations for the different segmentation methods. Figure 12a–c shows the parameter variations of the proposed, the regular, and the Voronoi tessellation-based segmentation methods, respectively. From Figure 12a,c, the parameter for each homogeneous region converged to some steady value quickly (after about 1000 iterations). Figure 12b shows that the parameters were convergent but were not steady.
Table 4 provides the estimation values of the scale parameters and their percentage errors. It can be seen from Table 4 that the estimated parameters of the proposed and the Voronoi tessellation-based segmentation methods were more accurate than that of the regular tessellation-based segmentation method, particularly for region I. Figure 13 illustrates the histograms of the different homogeneous regions in the simulated image and the gamma distributions with real parameters. The histograms and the distribution function curves for the various homogeneous regions all matched accordingly.

3.3. Real SAR Intensity Images

Figure 14 presents four multi-look SAR intensity images with a size of 128 × 128 pixels, a spatial resolution of 30 m, and the number of looks equal to four. Figure 14a is a RADARSAT-1 image with HH polarization of a coastal scene, where the darker region indicates water (C1), and the brighter region represents the coast (C2). Figure 14b is a RADARSAT-II estuary image with HV polarization, where the darker regions indicate riverbanks (C1), and the middle portion marks ice (C2). Figure 14c is a RADARSAT-I image of sea ice with HH polarization. It contains three sea-ice structures, which from light to dark represent sea ice (C2), partially melted ice (C1), and water (C3), respectively. Figure 14d shows a RADARSAT-I standard-mode image with HH polarization, which shows four types of sea-ice structures, representative of different degrees of ice (light) and water (dark).
The proposed segmentation method was applied to the four SAR intensity images shown in Figure 14 using the same constants listed in Table 1. The segmentation results are shown in Figure 15. Figure 15a shows the result of dividing into irregular polygons. Figure 15b shows the segmentation results of the test images with varying numbers of homogeneous regions. In general, the number of irregular polygons should be the same as the number of homogeneous regions of the image. However, for non-adjacent homogeneous regions, the number of polygons was different from the number of homogeneous regions. As shown in the results of Figure 14b, the number of irregular polygons was three, while the number of homogeneous regions was two. This means that there were two polygons with the same label. In Figure 15c, the outlines of the segmented homogeneous regions were extracted and overlaid over the real images. From a visual examination, the proposed segmentation method was able to attain the optimal segmentation results.
Figure 16 shows the variations of the scale parameters throughout the iteration process. The abscissa and ordinate represent the number of iterations and the scale parameter value, respectively. It can be seen from Figure 14 that the proposed segmentation method made the parameter value converge quickly and get stable parameter values.
To compare the results of the proposed segmentation method, the real images shown in Figure 14 were tested using the regular and Voronoi tessellation-based segmentation methods; their segmentation results are shown in Figure 17 and Figure 18. There were some noises in the segmentation results of the regular tessellation method, as shown in Figure 17b. In Figure 18, the Voronoi tessellation-based segmentation method did not produce misclassified noise, but the boundary fitting was still not sufficiently accurate. Because the Voronoi polygons were convex, there were some constraints when using them to fit homogeneous regions.
Figure 19 shows the experimental results of the multi-threshold segmentation method, where Figure 19a is the segmentation result and Figure 19b is the result of the overlap of the contour of the segmentation result and experimental image. It can be seen from the experimental results that this method had a good segmentation effect on the small difference in the pixel gray value (as shown in Figure 14b), but it was difficult to achieve a better segmentation result on the large difference in the pixel gray value.

4. Conclusions

This paper presents a new regional-based segmentation method for SAR intensity images. In this method, the image domain is partitioned into a collection of irregular polygons, which are constructed with a set of nodes and are used to fit homogeneous regions with arbitrary shapes. The commonly used regional-based segmentation method is based on either regular or Voronoi tessellations. The regular and Voronoi polygons can only fit in convex homogeneous regions but correspond poorly in areas with sharp corners. Compared with widely used segmentation methods, the proposed segmentation method provides greater flexibility, which can be used in both convex and concave homogeneous sections. As the nodes are used in segmenting sections, fewer polygons are needed to fit the homogeneous regions, resulting in more well-defined segments compared with other tessellation-based segmentation methods. Combining irregular tessellation and Bayesian inference to segment SAR images, the experiment results show that the proposed segmentation method can provide better segmentation results and, at the same time, the model parameters can be estimated more accurately. The proposed irregular tessellation method provides a new idea for region-based image segmentation and a better solution for region segmentation with different geometric shapes. However, it has no effect on the image category (sea ice, city, and forest). This paper only takes low-resolution SAR sea-ice images as examples for simple verification. In future work, high-resolution urban and forest images can be considered for segmentation experiments to verify the universality of the proposed method.

Author Contributions

Q.Z., Y.L. and G.W. designed the research. H.Z. performed the research and wrote the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China (No. 2016YFB0501403), the Young Scientists Fund of National Natural Science Foundation of China (No. 41301479), the University Innovation Talent Support Program of Liaoning Province (No. LR2016061), and the General Project of Science and Technology Research of Education Department of Liaoning Province (No. LJCL009).

Acknowledgments

Special thanks to the professional English editing service from EditX.

Conflicts of Interest

No conflict of interest is declared by the authors.

References

  1. Oliver, C.; Quegan, S. Understanding Synthetic Aperture Radar Images; Artech House: Boston, UK, 1998; pp. 277–296. [Google Scholar]
  2. Dong, G.G.; Kuang, G.Y.; Wang, N.; Zhao, L.J. SAR target recognition via joint sparse representation of monogenic signal. IEEE J.-STARS 2017, 8, 3316–3328. [Google Scholar] [CrossRef]
  3. Zhang, S.; He, F.; Zhang, Y.; Wang, J.M.; Mei, X.; Feng, T.T. Geometric active contour based approach for segmentation of high-resolution spaceborne SAR images. J. Syst. Eng. Election. 2015, 26, 69–76. [Google Scholar] [CrossRef]
  4. Li, M.X.; Cheng, J.L. SAR image segmentation based on watershed and spectral clustering. J. Infrared Millim. W 2008, 27, 452–456. [Google Scholar]
  5. Li, W.; Benie, G.B.; He, D.C.; Wang, S.R.; Ziou, D.; Hugh, Q.; Gwyn, J. Watershed-based hierarchical SAR image segmentation. Int. J. Remote Sens. 1999, 20, 3377–3390. [Google Scholar] [CrossRef]
  6. Ayed, I.B.; Mitiche, A.; Belhadj, Z. Multiregion level-set partitioning of synthetic aperture radar images. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27, 793–800. [Google Scholar] [CrossRef]
  7. Roger, F.; Armand, L.; Philippe, M.; Eliane, C.C. An optimal multiedge detector for SAR image segmentation. IEEE Trans. Geosci. Remote Sens. 1998, 36, 793–802. [Google Scholar]
  8. Germain, O.; Refregier, P. Edge location in SAR images: Performance of the likelihood ratio filter and accuracy improvement with an active contour approach. IEEE Trans. Image Process. 2001, 10, 72–78. [Google Scholar] [CrossRef]
  9. Smith, D.M. Speckle reduction and segmentation of Synthetic Aperture Radar images. Int. J. Remote Sens. 1996, 17, 2043–2057. [Google Scholar] [CrossRef]
  10. Quan, J.J.; Wen, X.B.; Xu, X.Q. Multiscale probabilistic neural network method for SAR image segmentation. Appl. Math. Comput. 2008, 205, 578–583. [Google Scholar] [CrossRef]
  11. Galland, F.; Bertaux, N.; Refregier, P. Minimum description length synthetic aperture radar image segmentation. IEEE Trans. Image Process 2003, 12, 995–1006. [Google Scholar] [CrossRef] [Green Version]
  12. Cremers, D.; Rousson, M.; Deriche, R. A review of statistical approaches to level set segmentation: Integrating color, texture, motion and shape. Int. J. Comput. Vis. 2007, 72, 195–215. [Google Scholar] [CrossRef] [Green Version]
  13. Lei, X.; Li, Y.; Zhao, N. Fast segmentation approach for SAR image based on simple Markov random field. J. Syst. Eng. Election. 2010, 21, 31–36. [Google Scholar] [CrossRef]
  14. Zhao, Q.H.; Li, Y.; He, X.J.; Song, W.D. Multi-look SAR image segmentation based on voronoi tessellation technique and EM/MPM algorithm. J. Remote Sens. 2013, 17, 841–854. [Google Scholar]
  15. Comer, M.L.; Delp, E.J. The EM/MPM algorithm for segmentation of textured images: Analysis and further experimental results. IEEE Trans. Image Process. 2000, 9, 1731–1744. [Google Scholar] [CrossRef]
  16. Hou, Y.M. A novel SAR image segmentation method based on markov random field. J. Electron. Inf. Technol. 2007, 29, 1069–1072. [Google Scholar]
  17. Yang, Y.; Sun, H.; He, C. Supervised SAR image MPM segmentation based on region-based hierarchical model. IEEE Geosci. Remote Sens. 2006, 3, 517–521. [Google Scholar] [CrossRef]
  18. Dryden, I.L.; Farnoosh, R.; Taylor, C.C. Image segmentation using Voronoi polygons and MCMC, with application to muscle fibre images. J. Appl. Stat. 2006, 33, 609–622. [Google Scholar] [CrossRef]
  19. Wang, Y.; Li, Y.; Zhao, Q.H. Segmentation of high-resolution SAR image with unknown number of classes based on regular tessellation and RJMCMC algorithm. Int. J. Remote Sens. 2015, 36, 1290–1306. [Google Scholar] [CrossRef]
  20. Zhao, Q.H.; Li, Y.; Wang, Y. SAR image segmentation with unknown number of classes combined Voronoi tessellation and RJMCMC algorithm. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2016, 3, 119–124. [Google Scholar] [CrossRef]
  21. Julian, B. Towards Bayesian image analysis. J. Appl. Stat. 1989, 16, 395–406. [Google Scholar]
  22. Dong, Y.; Forster, B.C.; Milne, A.K. Comparison of radar image segmentation by Gaussian and Gamma-Markov random field models. Int. J. Remote Sens. 2003, 24, 711–722. [Google Scholar] [CrossRef]
  23. Besag, J. On the statistical analysis of dirty picture (with discussion). J. R. Stat. Soc. B 1986, 48, 259–302. [Google Scholar]
  24. Strauss, D.J. Clustering on coloured lattices. J. Appl. Prob. 1977, 14, 135–143. [Google Scholar] [CrossRef]
  25. Dryden, I.; Scarr, M.R.; Taylor, C.C. Bayesian texture segmentation of weed and crop image using reversible jump Markov chain Monte Carlo methods. J. R. Stat. Soc. Ser. C Appl. Stat. 2003, 52, 31–50. [Google Scholar] [CrossRef]
  26. Richards, J.A. Remote Sensing with Imaging Radar; Springer: Berlin/Heidelberg, Germany, 2009; pp. 1–373. [Google Scholar]
  27. Zhao, Q.H.; Zhang, H.Y.; Li, Y. Detecting dark spots from SAR intensity images by a point process with irregular geometry marks. Int. J. Remote Sens. 2018. [Google Scholar] [CrossRef]
  28. Green, J. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 1995, 82, 711–732. [Google Scholar] [CrossRef]
  29. Bernardo, J.M.; Smith, A.F.M. Bayesian Theory; Wiley: New York, NY, USA, 1994; pp. 1–606. [Google Scholar]
  30. Li, Y.; Li, J. Segmentation of SAR intensity imagery with a Voronoi tessellation, bayesian inference, and reversible jump MCMC algorithm. IEEE Trans. Geosci. Remote Sens. 2010, 48, 1872–1881. [Google Scholar] [CrossRef]
  31. Zhao, Q.H.; Li, Y.; Liu, Z.G. SAR image segmentation using Voronoi tessellation and Bayesian inference applied to dark spot feature extraction. Sensors 2013, 13, 14484–14499. [Google Scholar] [CrossRef] [Green Version]
  32. Otsu, N. A Threshold Selection Method from Gray-Level Histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef] [Green Version]
  33. Congaltonr, G.; Green, K. Assessing the Accuracy of Remotely Sensed Data: Principles and Practices, 2nd ed.; CRC Press: Boca, Ration, FL, USA, 2008; pp. 169–190. [Google Scholar]
Figure 1. Irregular tessellation with four polygons, where the symbol • indicates node.
Figure 1. Irregular tessellation with four polygons, where the symbol • indicates node.
Remotesensing 12 00753 g001
Figure 2. Example of moving one mobile node. (a) initial division; (b) relocated node within the image; (c) initial division; (d) relocated node along the boundary.
Figure 2. Example of moving one mobile node. (a) initial division; (b) relocated node within the image; (c) initial division; (d) relocated node along the boundary.
Remotesensing 12 00753 g002
Figure 3. Example of merging polygons. (a) initial division; (b) merged polygon.
Figure 3. Example of merging polygons. (a) initial division; (b) merged polygon.
Remotesensing 12 00753 g003
Figure 4. Example of splitting a polygon. (a) initial division; (b) split polygon.
Figure 4. Example of splitting a polygon. (a) initial division; (b) split polygon.
Remotesensing 12 00753 g004
Figure 5. Example of adding a node. (a) initial division; (b) after one node is added.
Figure 5. Example of adding a node. (a) initial division; (b) after one node is added.
Remotesensing 12 00753 g005
Figure 6. Example of deleting a node. (a) Initial division; (b) One node deleted.
Figure 6. Example of deleting a node. (a) Initial division; (b) One node deleted.
Remotesensing 12 00753 g006
Figure 7. Irregular tessellation with four polygons. (a) template image; (b) simulated image; (c) Enlarge image.
Figure 7. Irregular tessellation with four polygons. (a) template image; (b) simulated image; (c) Enlarge image.
Remotesensing 12 00753 g007
Figure 8. Experimental result of proposed method. (a) irregular tessellation result; (b) segmentation result; (c) visual evaluation; (d) magnified irregular tessellation result; (e) magnified segmentation result; (f) magnified visual evaluation image.
Figure 8. Experimental result of proposed method. (a) irregular tessellation result; (b) segmentation result; (c) visual evaluation; (d) magnified irregular tessellation result; (e) magnified segmentation result; (f) magnified visual evaluation image.
Remotesensing 12 00753 g008
Figure 9. Experimental results of the regular tessellation-based method. (a) regular tessellation result; (b) segmentation result; (c) visual evaluation; (d) magnified regular tessellation result; (e) magnified segmentation result; (f) magnified visual evaluation image.
Figure 9. Experimental results of the regular tessellation-based method. (a) regular tessellation result; (b) segmentation result; (c) visual evaluation; (d) magnified regular tessellation result; (e) magnified segmentation result; (f) magnified visual evaluation image.
Remotesensing 12 00753 g009
Figure 10. Experimental results of the Voronoi-tessellation-based method. (a)Voronoi tessellation result; (b) segmentation result; (c) visual evaluation; (d) magnified Voronoi tessellation result; (e) magnified segmentation result; (f) magnified visual evaluation.
Figure 10. Experimental results of the Voronoi-tessellation-based method. (a)Voronoi tessellation result; (b) segmentation result; (c) visual evaluation; (d) magnified Voronoi tessellation result; (e) magnified segmentation result; (f) magnified visual evaluation.
Remotesensing 12 00753 g010
Figure 11. Experimental results of multi-threshold segmentation. (a) segmentation result; (b) visual evaluation.
Figure 11. Experimental results of multi-threshold segmentation. (a) segmentation result; (b) visual evaluation.
Remotesensing 12 00753 g011
Figure 12. Changes in scale parameters through iteration. (a) parameter variations of the proposed method; (b) parameter variations of regular tessellation; (c) parameter variations of Voronoi tessellation.
Figure 12. Changes in scale parameters through iteration. (a) parameter variations of the proposed method; (b) parameter variations of regular tessellation; (c) parameter variations of Voronoi tessellation.
Remotesensing 12 00753 g012
Figure 13. Histograms and curves of gamma distributions with real and estimated model parameters. (a) Region I; (b) Region II; (c) Region III.
Figure 13. Histograms and curves of gamma distributions with real and estimated model parameters. (a) Region I; (b) Region II; (c) Region III.
Remotesensing 12 00753 g013
Figure 14. Real SAR intensity images.
Figure 14. Real SAR intensity images.
Remotesensing 12 00753 g014
Figure 15. Segmentation results and visual evaluation. (a) irregular tessellation results; (b) segmentation results; (c) visual evaluation.
Figure 15. Segmentation results and visual evaluation. (a) irregular tessellation results; (b) segmentation results; (c) visual evaluation.
Remotesensing 12 00753 g015
Figure 16. Curves of parameter variations with number of iterations. (ad) represent the scale parameter changes of each homogeneous region in the four remote sensing images in Figure 14.
Figure 16. Curves of parameter variations with number of iterations. (ad) represent the scale parameter changes of each homogeneous region in the four remote sensing images in Figure 14.
Remotesensing 12 00753 g016
Figure 17. Segmentation results and visual evaluations of the regular tessellation method. (a) regular tessellation results; (b) segmentation results; (c) visual evaluation.
Figure 17. Segmentation results and visual evaluations of the regular tessellation method. (a) regular tessellation results; (b) segmentation results; (c) visual evaluation.
Remotesensing 12 00753 g017
Figure 18. Segmentation results and visual evaluations of the Voronoi tessellation method. (a) Voronoi tessellation results; (b) segmentation results; (c) visual evaluation.
Figure 18. Segmentation results and visual evaluations of the Voronoi tessellation method. (a) Voronoi tessellation results; (b) segmentation results; (c) visual evaluation.
Remotesensing 12 00753 g018
Figure 19. Segmentation results and visual evaluations of the multi-threshold segmentation. (a) segmentation results; (b) visual evaluation.
Figure 19. Segmentation results and visual evaluations of the multi-threshold segmentation. (a) segmentation results; (b) visual evaluation.
Remotesensing 12 00753 g019
Table 1. Initial constant parameters.
Table 1. Initial constant parameters.
ConstantsmcμβσβεβIteration
Value161328110,000
Table 2. Parameter values of the gamma distributions for the simulated image.
Table 2. Parameter values of the gamma distributions for the simulated image.
Region.IIIIII
Scale parameter (β)52545
Table 3. Quantitative evaluation of accuracy for the proposed method, the regular tessellation-based method, the Voronoi tessellation-based method, and the multi-threshold segmentation method.
Table 3. Quantitative evaluation of accuracy for the proposed method, the regular tessellation-based method, the Voronoi tessellation-based method, and the multi-threshold segmentation method.
Region
MethodIIIIII
User’s accuracy (%)Proposed method98.3598.7698.39
Regular tessellation83.3397.4599.58
Voronoi tessellation97.0497.1998.69
Multi threshold45.6251.8792.13
Producer’s accuracy (%)Proposed method94.9198.3699.85
Regular tessellation97.2397.2094.18
Voronoi tessellation90.8198.6599.71
Multi threshold10050.4357.12
Total accuracy (%)Proposed method98.57
Regular tessellation95.76
Voronoi tessellation97.89
Multi threshold61.59
Kappa Proposed method0.976
Regular tessellation0.932
Voronoi tessellation0.966
Multi threshold0.431
Table 4. Parameters obtained by the proposed method, regular tessellation, and Voronoi tessellation.
Table 4. Parameters obtained by the proposed method, regular tessellation, and Voronoi tessellation.
Region
MethodIIIIII
βProposed method5.3625.0646.56
Regular tessellation25.7729.6646.25
Voronoi tessellation5.0424.7846.99
eβ (%)Proposed method7.200.243.47
Regular tessellation415.4018.642.77
Voronoi tessellation0.800.884.42

Share and Cite

MDPI and ACS Style

Zhao, Q.; Zhang, H.; Wang, G.; Li, Y. Irregular Tessellation and Statistical Modeling Based Regionalized Segmentation for SAR Intensity Image. Remote Sens. 2020, 12, 753. https://doi.org/10.3390/rs12050753

AMA Style

Zhao Q, Zhang H, Wang G, Li Y. Irregular Tessellation and Statistical Modeling Based Regionalized Segmentation for SAR Intensity Image. Remote Sensing. 2020; 12(5):753. https://doi.org/10.3390/rs12050753

Chicago/Turabian Style

Zhao, Quanhua, Hongyun Zhang, Guanghui Wang, and Yu Li. 2020. "Irregular Tessellation and Statistical Modeling Based Regionalized Segmentation for SAR Intensity Image" Remote Sensing 12, no. 5: 753. https://doi.org/10.3390/rs12050753

APA Style

Zhao, Q., Zhang, H., Wang, G., & Li, Y. (2020). Irregular Tessellation and Statistical Modeling Based Regionalized Segmentation for SAR Intensity Image. Remote Sensing, 12(5), 753. https://doi.org/10.3390/rs12050753

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop