Next Article in Journal
A Transformer-Based Model for Super-Resolution of Anime Image
Next Article in Special Issue
Multi-Target Tracking AA Fusion Method for Asynchronous Multi-Sensor Networks
Previous Article in Journal
Deep Learning-Based Synthesized View Quality Enhancement with DIBR Distortion Mask Prediction Using Synthetic Images
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Defogging Algorithm Based on Polarization Characteristics and Atmospheric Transmission Model

National Key Laboratory of Science and Technology on Automatic Target Recognition, College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(21), 8132; https://doi.org/10.3390/s22218132
Submission received: 1 August 2022 / Revised: 4 October 2022 / Accepted: 19 October 2022 / Published: 24 October 2022
(This article belongs to the Special Issue Multi-Sensor Fusion for Target Detection and Tracking)

Abstract

:
We propose a polarized image defogging algorithm according to the sky segmentation results and transmission map optimization. Firstly, we propose a joint sky segmentation method based on scene polarization information, gradient information and light intensity information. This method can effectively segment the sky region and accurately estimate the global parameters such as atmospheric polarization degree and atmospheric light intensity at infinite distance. Then, the Gaussian filter is used to solve the light intensity map of the target, and the information of the polarization degree of the target is solved. Finally, based on the segmented sky region, a three-step transmission optimization method is proposed, which can effectively suppress the halo effect in the reconstructed image of large area sky region. Experimental results shows that defogging has a big improvement in the average gradient of the image and the grayscale standard deviation. Therefore, the proposed algorithm provides strong defogging and can improve the optical imaging quality in foggy scenes by restoring fog-free images.

1. Introduction

The imaging quality of natural scenes depends on weather conditions, such as haze and fog. In a foggy scene, water vapor in the atmosphere is stable owing to suspended water droplets. Owing to the strong scattering properties of the suspended particles, air light is scattered and absorbed during propagation, reducing visibility [1,2]. Consequently, optical imaging of foggy scenes presents low visibility, low contrast, blurry details, and even color distortion [3], compromising the image quality for tasks like target detection and recognition. To improve the accuracy and reliability of such tasks, image defogging and clear imaging under foggy conditions are extremely valuable in practice.
Research on image defogging has been actively conducted in recent years. Most defogging algorithms are based on direct image processing or considering the foundation of atmospheric transmission models. Defogging based on image processing such as Retinex [4,5], wavelet transform [6,7,8,9] and homomorphic filtering [10,11]. These methods aim to improve the image quality through the global or local image enhancement, and do not take the physical causes of image degradation on foggy days into account. Defogging algorithms based on atmospheric transmission models determine image contrast degradation caused by the underlying physical mechanisms. By applying the physical model to a foggy image, the fog-free image can be restored. This type of algorithm focuses on image degradation owing to fog, in which light is scattered and absorbed during propagation by suspended water particles in the atmosphere. A representative algorithm is a dark channel prior proposed by He et al. [12]. They analyzed massive experimental data captured over several years in fog-free weather, finding that at least one of the three image channels in the non-sky region shows an extremely low pixel value level that is assumed to be infinitely close to zero. According to this prior knowledge and an atmospheric transmission model, they estimate the transmission map and reconstruct fog-free images. Other image dehazing algorithms based on atmospheric transmission model, such as color attenuation prior algorithm and optimized contrast enhancement algorithm, both have a good performance in the field of single image dehazing.
In recent years, with the rapid progress of convolutional neural network (CNN), image dehazing algorithms based on neural networks have been developed successively. CAI first proposed the DehazeNet for image dehazing [13], and due to the emergence of GAN, CHEN proposed an end-to-end image dehazing algorithm [14], which called GCANet. This method uses smooth extended convolution instead of extended convolution, which solves the problem of grid artifacts, and improves the image defogging effect.
Polarimetric dehazing method was first proposed by Schechner in 2001 [15,16]. They acquired the polarimetric information by obtaining two orthogonal polarimetric images, and the model parameters are estimated to remove haze. Zhang proposed an image fusion method based on the correlation and information complementarity of different polarimetric images, which has a good effect on image restoration under mist weather conditions [17]. Zhou proposed an image fusion dehazing algorithm based on multi-scale singular value decomposition to overcome the lack of robustness of traditional polarimetric dehazing algorithms [18]. Huo proposed a method which introduces polarimetric information into the traditional dark channel prior to enhance the identification degree between different objects [19]. The above study shows that the polarimetric dehazing method is effective in many different hazy environments. However, when processing some images with high scene light intensity and large area of sky, the traditional image dehazing algorithm based on polarimetric information is easy to appear halo effect in the restoration image, which has a serious impact on the quality of the reconstructed fog-free image.
To address the shortcomings of existing methods, we propose a defogging algorithm according to the sky segmentation results and transmission map optimization. First, the polarimetric characteristics are extracted from polarimetric images and the angle of polarization (AOP). Then, the sky region is jointly segmented using the AOP and image of scene intensity (IOI) to obtain the polarization degree of air light ( P a ) and air-light intensity at infinite distance ( A inf ) relative to the sky region. In addition, Gaussian blur filtering is used to estimate the air-light intensity image. Then, the object light intensity image and object polarization degree ( P d ) are obtained to construct an initial transmission map. The map is refined with the sky region and guided image filtering, finally providing a fog-free image. We use different methods to deal the hazy images under different scenarios, in order to test their dehazing ability compared to the proposed methods. Furthermore, the average gradient, gray variance and no reference image quality evaluation are used here to assess the quality belongs to different method’s result. The precision of the experimental analysis shows that the proposed method can effectively solve the halo phenomenon caused by the light intensity in the hazy images, and effectively improve the quality of the reconstructed images. Furthermore, the proposed algorithm also has good experimental results in low light intensity scenes.

2. Atmospheric Transmission Model

The two primary causes of image degradation in foggy scenes are air-light scattering into stray light during propagation, which results in image blur, and absorption and scattering of the reflected light by water particles suspended in air, which reduce image brightness and contrast [20,21,22,23].
In polarized imaging, when light scatters during propagation, its polarization changes accordingly, and the air light changes from non-polarized to partially polarized. The polarization of an object depends on both the scattering effect caused by water particles suspended in air and the material and surface roughness of objects. Therefore, polarization information of the scene acquired through optical imaging includes the polarization information of both air light and objects [24]. The atmospheric transmission model used in this study is illustrated in Figure 1.
Through the atmospheric transmission model, the light reaching the optical imaging system can be expressed as:
I = L t + A inf ( 1 t )
where I represents the intensity of the scene, L represents the fog-free image, A inf represents air-light intensity at infinite distance, and t represents the transmission map. By including the polarization degree, we obtain:
I d = I P = D P d + A P a
where P , P d , and P a are the polarization degrees of the scene, object, and atmosphere, respectively, D and A are the light intensities of the objects and air light, respectively, and I d is the polarization-difference image.
By letting:
I = D + A
A and D can be expressed using polarization parameters as follows:
D = I ( P P a ) P d P a A = I ( P P d ) P a P d
Based on the atmospheric transmission model and (2)–(4), transmission map t can be expressed in terms of P d as:
t inital = 1 P d I I d ( P d P a ) A inf
which is a function of I d , P d , the light intensity of images I , A inf , and P a . Therefore, the transmission map t can be obtained by calculating the above-mentioned parameters.

3. Stokes Vector and Polarized Images

3.1. Extraction of Scene Polarization Characteristics

Polarized light can have trigonometric, Jones vector, Stokes vector, or graphic representation. The Stokes vector representation is widely used given its detection convenience and intuitive expression [25]. Thus, we use this representation to describe polarization characteristics.
The Stokes vector representation is a matrix representation of polarization with four rows and one column, where the four parameters describe the intensity of different characteristics:
S = [ S 0 , S 1 , S 2 , S 3 ] T
where S 0 is the total light intensity of the scene, S 1 is the difference in intensity between the linear polarized horizontal and vertical components, S 2 is the difference in intensity between the linear polarized components captured at 45° and 135°, and S 3 is the difference in intensity between the left- and right-handed polarized light components. In general, circularly polarized light is negligible in polarized optical imaging. The images captured by a four-angle polarization detector are denoted as I 0 , I 45 , I 90 , and I 135 . Each parameter in the Stokes vector can be expressed as:
S 0 = I 0 + I 90 S 1 = I 0 I 90 S 2 = I 45 I 135
For the Stokes vector, the degree of linear polarization (DOP) and AOP can be expressed as follows:
D o p = S 1 2 + S 2 2 S 0 θ = 1 2 tan 1 ( S 1 S 2 )

3.2. Joint Segmentation of Sky Region

He et al. considered that the intensity at one of the RGB (red–green–blue) image channels is always close to 0 in their dark channel prior algorithm. According to this assumption, the dark channel image was obtained and A inf was estimated. The dark channel prior algorithm avoids errors related to the heuristic selection of A inf . However, the sky region does not follow the dark channel prior assumption. When a large sky region is acquired in an image, the corresponding A inf is inaccurate, producing texture and blocking effect in the restored fog-free image, which reduces the image quality. In the literature [15,16], a small region far enough from the target was selected as the sky region, and the pixel in this region was calculated and solved to obtain the A inf . However, this method has certain subjectivity and cannot ensure that the selected sky region is globally representative.
To prevent this problem, we perform automatic sky region segmentation based on AOP and IOI to accurately estimate P a and A inf from a correctly segmented sky region.
In a foggy environment, the polarization angles of the scattered light and the reflected light are generally different, and the polarization angles of the reflected light of different materials are different. Owing to the uniform atmospheric distribution in the sky region, the change in polarization angle in the sky region is relatively gentle, while the angle of polarization transforms at the junction of the sky and the target region will jump. According to the atmospheric transmission model, with an increase in the transmission distance, the light intensity of the atmospheric scattered light increases while the light intensity of the target reflected light decreases. Since the transmitted light in the sky region is approximately infinity, the light intensity in the sky region must be higher than that in the target region. Therefore, an automatic sky region segmentation algorithm combining polarization angle image and scene light intensity image is proposed in this paper. The segmented sky region is used to accurately estimate the atmospheric polarization degree and the atmospheric light intensity at infinity.
Sobel operator is a common edge detection operator [26,27,28]. Sobel operator calculates the gradient of the corresponding region of the image. Since the gradient information of the region reflects the degree of change of the image in the region, the gray value at the junction of the target and the sky will change obviously, and its gradient value will also change accordingly. In the sky region and the target region, the gray value changes relatively smoothly, and the corresponding gradient changes are small; hence, the sky region can be segmented theoretically.
Starting from the pixels in the second row and second column of the upper left corner of the polarization angle image and scene light intensity image, the image gradient of polarization angle and the scene light intensity image were successively calculated to obtain the image gradient map of the polarization angle and scene light intensity image. Because the atmosphere in the sky region has the characteristics of uniform distribution, and the intensity value of the target changes relatively gently, if the gradient jump at a point in the scene light intensity image is less than the preset threshold, we think it is not at the edge of the target and the sky. In order to ensure the authenticity, the gradient jump of the same pixel position in the gradient map of the polarization Angle image is judged again whether it is greater than the preset gradient value. If the gradient jump of this point is greater than the preset threshold, it is considered that this point may be noise or edge point in the scene light intensity image, and the value of this point is taken as 0. Otherwise, if the gradient jump of this point is smaller than the preset threshold at the same time, this point is considered a non-edge point. In the sky area and the target area, the gradient will not be greater than the preset threshold because the pixel value changes smoothly. In this case, the target light intensity is introduced to judge the area where the pixel belongs, if the pixel is judged as a non-edge point. If the pixel value of the corresponding pixel in the scene light intensity image is greater than the preset threshold, the point is considered as the sky area, and the value is taken as 1; otherwise, it is 0. Finally, the maximum area connectivity is used to connect the target area and remove the noise points in the sky area.
By comparing the coincidence degree between the real scene of the image and the extracted sky area, the extraction effect is judged. When the polarization angle gradient threshold is 60, the scene light intensity gradient threshold is 60, and the scene light intensity threshold is 180. The extraction results for the sky region are shown in Figure 2a. Gradually increase the value of the three thresholds, get b–g. When the polarization angle gradient threshold is 70, the scene light intensity gradient threshold is 95, and the scene light intensity threshold is 205, the sky region can be extracted. However, because the spectral intensity in the middle of the target is close to the light intensity in the sky region, this part is wrongly extracted as the sky region. By further increasing the threshold of scene light intensity, the sky region and the target can be completely segmented. However, some sky region at the target is not infinite, and the intensity characteristics of this region are closer to those of the targets on both sides of it, so this part is segmented into the target region. If the threshold of scene light intensity continues to increase, the image of the miss-elected area will increase rapidly, which will cause interference to the subsequent transmission optimization and restoration of the fog-free image.
P a and A inf are important parameters for defogging because they describe air light. They are generally considered global parameters owing to the smooth color distribution of the air in images. We estimate P a and A inf using the sky binary template, DOP, and IOI as follows.
The image of scene polarization degree in the sky region is obtained by multiplying the sky binary template and DOP. Then, according to the statistics of the polarization degree corresponding to each pixel in the sky region, the most frequent value is taken as P a . To estimate A inf , the sky binary template is multiplied by the scene-light intensity image to obtain an image that preserves only the sky region. The average of the 100 largest pixel values is taken as A inf . The estimation error of Pa and Ainf caused by interferences in the sky region is prevented using statistics.

3.3. Calculation of Polarized-Difference Image

Two perpendicularly polarized images are used to measure the polarization degree. Their difference is denoted as I d , which is important for restoring a fog-free image.
To obtain polarized-difference images, the artificial rotating polarizer or fixed-angle shooting method is used to obtain dual-angle images [29] and estimate the differential images. However, as objects in a scene show diverse polarization characteristics, these methods cannot provide the best Id image by only relying on orthogonal imaging. Hence, we propose a method to directly obtain I d by combining the Stokes vector and polarization degree of the scene.
The polarization degree and light intensity of the scene can be expressed by dual-angle images as follows:
P = I w o r s t I b e s t I w o r s t + I b e s t = I d S 0
As P is estimated by the Stokes vector during polarization characteristic extraction (Section 3.1), I d can be expressed as:
I d = S 0 P
Thus, image I d can be obtained directly from P and S 0 , avoiding calculations of dual-angle images and reducing the algorithm complexity and running time.

4. Calculation of Air-Light Intensity Image Based on Gaussian Blur Filtering

Calculation of Light Intensities A and D

The most common methods to estimate the image of intensity A are the dark channel prior and median filtering [30]. As mentioned above, the dark channel prior is not suitable for scenes with large sky regions because color can be easily distorted, and the block effect may appear in restored images. On the other hand, median filtering fails to preserve image edges, likely leading to the loss of details after the restoration of fog-free images. Instead, we use the Gaussian blur algorithm to estimate the air-light intensity image and ensure smooth filtering while maintaining the image edges.
Gaussian blur performs filtering by assigning weights according to a normal distribution. Owing to the continuity of image pixels, nearer pixels have higher correlation, rendering normal distribution weighting suitable for filtering. The position of the center of a filtering window is set as the primary pixel, and the weights of other pixels in the window are allocated according to the position in the normal distribution. Thus, the weighted average can be obtained as a filtered value of the center. A two-dimensional Gaussian function can be expressed as:
G ( x , y ) = 1 2 π δ 2 e ( x 2 + y 2 ) / 2 δ 2
The filtered image I is thus given by
I = x , y Ω G ( x , y ) A ( x , y )
where σ is the size of the weight matrix, A represents the image to be filtered, and Ω is the window area.
We adopt the method in the reference [30] for differential filtering. The estimated polarized air-light images are obtained from the original polarized images: I 0 , I 45 , I 90 , and I 135 , according to the Formula (13):
B = G a u s s ( I ) G a u s s ( I G u a s s ( I ) ) A = max ( min ( a B , I ) , 0 )
The object light intensity at each angle is calculated according to Formula (3), and the polarization degree of the target can be solved by Stokes vector. Examples of polarized air-light images, polarized object images at different angles, the light intensity of the air-light, the light intensity of the object and polarization degree of the target are shown in Figure 3 below:

5. Estimation of Transmission Map t and Restoration of a Fog-Free Image

Through the parameters above all to estimate the transmittance map t .
Due to the use of filter method are applied to solve the target light intensity images, the result is just an approximation of the target light intensity map, so we use the above parameters for the estimation of the transmittance map t is usually associated with errors, so we need to optimize the transmission rate, ensure that the quality of the fog-free scene finally restored.
Here, we propose a three steps method for transmission map optimization in this study:
Step 1: Use statistics to calculate the pixel value of the sky area. If the pixel value of the sky area is greater than 50%, the scene is considered a large-area sky scene, and the sky needs to be optimized to avoid the halo effect caused by the large-area sky area. The sky region was used to optimize the initial transmittance of the solution, and the pixel value of the sky region in the transmittance map was randomly assigned between 0.01 and 0.1 to ensure that the transmittance of the sky region was close to 0, so that there was no large area halo interference in the recovered fog-free scene image.
Step 2: Use guided filtering [31] to optimize the results of Step 1 to ensure the texture and details of the transmittance in the target area.
Step 3: If the image does not belong to a large sky area, direct guided filtering is used to optimize the initial transmittance results.
The transmittance map is obtained as below Figure 4:
t ( x , y ) m i d = min ( t ( x , y ) i n i t a l , R ( 0.01 , 0.1 ) ) ( x , y ) Ω s t ( x , y ) ( x , y ) Ω o t ( x , y ) f i n a l = G ( ( t ( x , y ) m i d ) )
In the above formula, R stands for the random assignment. Ω s represents the sky region, Ω o represents the object region, and G represents the guided filtering.
Using (1), the fog-free restored image L can be obtained as:
L = D t f i n a l
Examples of the hazy image I and restored fog-free image L are shown in Figure 5.
In order to better show the process of the algorithm in this paper, the flowchart is shown in the following Figure 6:

6. Experimental Analysis

To verify the defogging effect of the proposed method, we compared it with the dark channel prior and the single image dehazing using a multilayer perceptron (SIDMP) [32], which was proposed by Colores in recent years, in foggy scenario, obtaining the results shown in Figure 7.
Figure 7 scenario1–scenario3 shows different outdoor experimental scenes. In Figure 7a is the original fog-containing scene, Figure 7b is the dark channel processing result, Figure 7c is the processing result of the SIDMP, and Figure 7d is the defogging result of the proposed method. It can be seen that all the three dehazing algorithms have obvious dehazing effect. However, when dealing with high light intensity and large area sky image, large area halo effect will appear in the non-hazing image reconstructed by dark channel dehazing algorithm, which reduces the image quality and affects the observation of image details. The SIDMP reduces the brightness of the halo, but cannot effectively suppress the area of the halo, and the target is still in a large area of the halo background. When the fog-free image is reconstructed using the method proposed in this paper, the area of halo is effectively reduced, and the visual quality of the image is improved by optimizing the sky area.
Figure 8 is the local enlarged image corresponding to Figure 7. Based on the analysis of Figure 7, it can be seen that the proposed algorithm can better recover the target information and realize the reconstruction of foggy scenes. At the same time, compared with the dark channel algorithm, the proposed algorithm can effectively improve the detail contrast of the reconstructed image and realize the restoration of the target detail texture.
The gray histogram statistics of the enlarged details in scene 2 are performed, and the results are as follows Figure 9:
Through the gray histogram distribution, we can find that the gray value of the original fog image is mainly distributed in the range of 60–200, and there are a lot of gray value distribution in the high brightness area, which is close to 200. Dark channel method and SIDMP do not effectively realize the extension of image gray distribution. The method proposed in this paper extends the gray distribution to the interval of 10–180, and effectively reduces the gray value distribution in the highlighted area, which means, it effectively reduces the influence of atmospheric light on the image.
To quantitatively evaluate the effectiveness of the proposed algorithm, we obtained the average gradient and grayscale variance of the original foggy images and fog-free images obtained by different algorithms in the scenarios shown in Figure 7.
The average gradient of an image represents the change rate of its grayscale level, which can be used to indicate the sharpness of an image. A larger average gradient indicates higher sharpness, being an important indicator of the expression ability of image details.
G ¯ = 1 ( m 1 ) ( n 1 ) i = 1 m 1 j = 1 n 1 ( F ( i , j ) F ( i + 1 , j ) ) 2 + ( F ( i , j ) F ( i , j + 1 ) ) 2 2
where F ( i , j ) represents the gray value of the pixel at position ( i , j ) in the image and G is the average gradient of the image. in the image.
The grayscale variance indicates the dispersion of the distribution of grayscale values. A larger grayscale variance indicates a more scattered distribution of grayscale values:
s t d = 1 m n i = 1 m j = 1 n ( F ( i , j ) u ) 2
where m n is the total number of pixels in the image, F ( i , j ) gray value of the pixel at position ( i , j ) in the image, and μ is the value of the gray mean.
By analyzing the data quantification results in the Table 1, it can be seen that the statistical characteristics of the data of the defogging and restoring images by the method proposed in this paper are greatly improved compared with the processing results of the original fog-containing scene. Compared with the dark channel de-hazing algorithm, when processing the data of scenario1–scenario3, the average gradient of the result come from the proposed method is better because the halo phenomenon in the restored image is effectively suppressed. That is, the clarity and detail expression ability of the restored image is stronger than that of the dark channel algorithm. In terms of gray standard deviation, since there are halos in scenario1–scenario3, the gray variance value of the dark channel processing result is larger than that of the proposed algorithm, which also proves that the proposed method can effectively suppress the halo effect. The quantitative analysis results obtained by SIDMP are similar to those obtained by the dark channel method.
To test the ability of proposed method in the low light intensity scenarios, here we give another tow experimental results, and another dehazing method [33] proposed in the past two years, which is called Dual Transmission Maps Strategy (DTMS), to compare the results Figure 10:
Through the visualization results, we can find that the algorithm in this paper can also achieve a better dehazing effect when dealing with such low light intensity scenarios.
The gray histogram statistics of the scenario4 are performed, and the results are as follows Figure 11:
Through the gray histogram visualization of scenario4, it can be seen that the method proposed in this paper can effectively improve the gray histogram distribution of images, enhance the images contrast and improve quality of reconstructed fog-free images.
In order to effectively evaluate the quality of reconstructed fog-free image and fog-containing image, the non-reference quality evaluation index, which is called Natural Image Quality Evaluator (NIQE) [34], is adopted to evaluate the image data of scenario4 and scenario5. NIQE is an objective evaluation index that extracts features from natural landscapes to test images, a lower NIQE value corresponds to a higher overall naturalness, representing a higher image quality. The results are shown in Table 2.
According to various evaluation results without reference, in scenario4 and scenario5, the dehazing effect of the proposed method is improved compared with the DTMS.

7. Conclusions

In order to solve the halo phenomenon in the dehazing process of high light intensity image with a large region of sky, a joint sky region segmentation method and a transmission map optimization method based on polarimetric information are proposed in this paper. The idea of the proposed method in this paper is that the air light and object light can be separated by Gaussian blur, based on the different frequency characteristic. Then, the image dehazing reconstruction is completed by calculating the parameters in the dehazing model.
The accurate segmentation of sky region plays an important role in the process of image dehazing. The estimation of important parameters such as P a and A inf can be realized by accurate sky segmentation results. Compared with the traditional method of manually selecting sky area and estimating parameters, the method of parameter estimation combined with sky region is more accurate and reliable. At the same time, the sky region in the transmission map is optimized by using the sky segmentation results. By adjusting the atmospheric transmittance in the sky region, the halo phenomenon in the reconstructed image can be effectively reduced, the visual observation effect and image quality can be better improved. The experimental results show that the proposed method can effectively dehaze and reconstruct the high light intensity images with a large region of sky, greatly reduce the halo effect in the reconstructed images. Combined with the experimental results of scenario4 and scenario5, it is proved that the proposed method also has a good defogging effect when processing low light intensity image. It is proved that the proposed method can achieve good defogging effect under various scenarios.
However, through the experimental results, it can be found that the proposed algorithm is easy to cause a certain degree of color distortion in the process of dehazing reconstruction, especially when there are trees and other objects in the scene. Through the analysis of the experiment, the reason for this phenomenon may be that only approximate results can be obtained when Gaussian blur is used to separate air light from the scene, but the complete and accurate separation cannot be achieved. The next work will focus on optimizing the separation method in order to get better results.

Author Contributions

Conceptualization, F.L.; Data curation, J.Z. and Y.Z. (Yu Zhang); Methodology, F.L.; Software, F.L. and Y.Z. (Yi Zhang); Supervision, Y.Z. (Yan Zhang) and Z.S.; Writing—original draft, F.L.; Writing—review and editing, Y.Z. (Yan Zhang) and Z.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by The National Natural Science Foundation of China, grant number 62075239.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhou, J.; Yang, T.; Chu, W.; Zhang, W. Underwater image restoration via backscatter pixel prior and color compensation. Eng. Appl. Artif. Intell. 2022, 11, 104785. [Google Scholar] [CrossRef]
  2. Zhou, J.; Zhang, D.; Zhang, W. Underwater image enhancement method via multi-feature prior fusion. Appl. Intell. 2022, 111, 1–23. [Google Scholar] [CrossRef]
  3. Gao, J.; Bi, R.; Zhao, J.; Fan, Z. Global optimal reconstruction of foggy images using polarization information. Opt. Precis. Eng. 2017, 25, 2212–2220. [Google Scholar]
  4. Hu, X.; Gao, X.; Wang, H. A Novel Retinex Algorithm and Its Application to Fog-degraded Image Enhancement. Sens. Transducers 2014, 175, 138–143. [Google Scholar]
  5. Yang, W.; Wang, R.; Fang, S.; Zhang, X. Variable Filter Retinex Algorithm for Foggy Image Enhancement. J. Comput.-Aided Des. Comput. Graph. 2010, 22, 965–971. [Google Scholar] [CrossRef]
  6. Khan, H.; Sharif, M.; Bibi, N.; Usman, M.; Haider, S.A.; Zainab, S.; Shah, J.H.; Bashir, Y.; Muhammad, N. Localization of radiance transformation for image dehazing in wavelet domain. Neurocomputing 2020, 381, 141–151. [Google Scholar] [CrossRef]
  7. Khmag, A.; Al-Haddad, S.A.R.; Ramli, A.R.; Kalantar, B. Single Image Dehazing Using Second-generation Wavelet Transforms and The Mean Vector L2-norm. Vis. Comput. 2018, 34, 675–688. [Google Scholar] [CrossRef]
  8. Dharejo, F.A.; Zhou, Y.; Deeba, F.; Jatoi, M.A.; Khan, M.A.; Mallah, G.A.; Ghaffar, A.; Chhattal, M.; Du, Y.; Wang, X. A deep hybrid neural network for single image dehazing via wavelet transform. Opt. Int. J. Light Electron Opt. 2021, 231, 166462. [Google Scholar] [CrossRef]
  9. Kaur, H.; Majumdar, S. Image Dehazing Using Dark Chammel Prior and Fast Guided Filter in Daubechies Lifting Wavelet Transform Domain. Int. J. Comput. Inf. Eng. 2018, 12, 219–225. [Google Scholar]
  10. Joy, N.; Johnson, J. Fast Image Dehazing Method Based on Homomorphism Filtering and Contrast Enhancement. Int. J. Sci. Res. Eng. Trends 2019, 5, 305–309. [Google Scholar]
  11. Wu, H.; Tan, Z. An Image Dehazing Algorithm Based on Single-Scale Retinex and Homomorphic Filtering. Commun. Signal Process. Syst. 2020, 571, 1482–1493. [Google Scholar]
  12. He, K.; Sun, J.; Tang, X. Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33, 2341–2353. [Google Scholar]
  13. Cai, B.; Xu, X.; Jia, K.; Qing, C.; Dao, T. Dehazenet: An end-to-end system for single image haze removal. IEEE Trans. Image Process. 2016, 25, 5187–5198. [Google Scholar] [CrossRef] [Green Version]
  14. Chen, D.; He, M.; Fan, Q.; Liao, J.; Zhang, L.; Hou, D.; Yuan, L.; Hua, G. Gated context aggregation network for image dehazing and deraining. In Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA, 7–11 January 2019; IEEE Press: Piscataway, NJ, USA, 2019; pp. 1375–1383. [Google Scholar]
  15. Schechner, Y.Y.; Narasimhan, S.G.; Nayar, S.K. Instant Dehazing of Images Using Polarization. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA, 8–14 May 2001; pp. 325–332. [Google Scholar]
  16. Schechner, Y.Y.; Narasimhan, S.G.; Nayar, S.K. Polarization-based Vision Through Haze. Appl. Opt. 2003, 42, 511–525. [Google Scholar] [CrossRef]
  17. Zhang, X.-L.; Xu, Y.; Wang, X.-Z.; Xu, L. Image fusion method based on polarization characteristics of mist. J. Xiamen Univ. Nat. Sci. Ed. 2011, 3, 520–524. [Google Scholar]
  18. Zhou, W.-Z.; Fan, C.; Hu, X.-P.; He, X.-F.; Zhang, L.-l. Polarization image fusion dehazing algorithm and experiment based on multi-scale singular value Decomposition. Chin. Opt. 2021, 14, 298–306. [Google Scholar] [CrossRef]
  19. Huo, Y.S. Dark Channel Prior dehazing based on Polarization. Acta Phys. Sin. 2022, 71, 275–283. [Google Scholar] [CrossRef]
  20. Lakshmi, T.R.V.; Reddy, C.V.K.; Padmavathi, K.; Swaraja, K.; Meenakshi, K. Entropy based single image dehazing with refined transmission using holistic edges. Multimed. Tools Appl. 2022, 81, 20229–20253. [Google Scholar] [CrossRef]
  21. Zhou, J.; Yang, T.; Zhang, W. Underwater vision enhancement technologies: A comprehensive review, challenges, and recent trends. Appl. Intell. 2022, 1–28. [Google Scholar] [CrossRef]
  22. Zhou, J.; Zhang, D.; Ren, W.; Weishi, Z. Auto Color Correction of Underwater Images Utilizing Depth Information. IEEE Geosci. Remote Sens. Lett. 2022, 19, 1–5. [Google Scholar] [CrossRef]
  23. Zhou, J.; Zhang, D.; Zhang, W. Classical and state-of-the-art approaches for underwater image defogging: A comprehensive survey. Front. Inf. Technol. Electron. Eng. 2020, 21, 1745–1770. [Google Scholar] [CrossRef]
  24. Fang, S.; Xia, X.S.; Xing, H.; Chen, C.W. Image dehazing using polarization effects of objects and airlight. Opt. Express 2014, 22, 19523–19537. [Google Scholar] [CrossRef]
  25. Zhang, J.H. Technology of Sea Clutter Suppression and Ship Target Recognition Based on Infrared Polarization Information. Master’s Thesis, National University of Defense Technology, Changsha, China, 2018. [Google Scholar]
  26. Jing, M.; Du, Y. Flank angle measurement based on improved Sobel operator. Manuf. Lett. 2020, 25, 44–49. [Google Scholar] [CrossRef]
  27. Zhou, Y.; Fu, X. Research on the combination of improved Sobel operator and ant colony algorithm for defect detection. MATEC Web Conf. 2021, 336, 01009. [Google Scholar] [CrossRef]
  28. Han, L.; Tian, Y.; Qi, Q. Research on edge detection algorithm based on improved sobel operator. MATEC Web Conf. 2020, 309, 03031. [Google Scholar] [CrossRef] [Green Version]
  29. Zhang, Y.M. Research on All Stokes Polarization Imaging Technology. Ph.D. Thesis, Nanjing University of Science and Technology, Nanjing, China, 2015. [Google Scholar]
  30. Tarel, J.P.; Hautière, N. Fast visibility restoration from a single color or gray level image. In Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan, 29 September–2 October 2009. [Google Scholar]
  31. Zhang, X.; Zhao, W.; Zhang, W.; Peng, J.; Fan, J. Guided Filter Network for Semantic Image Segmentation. IEEE Trans. Image Process. 2022, 31, 2695–2709. [Google Scholar] [CrossRef]
  32. Salazar-Colores, S.; Cruz-Aceves, I.; Ramos-Arreguin, J.-M. Single image dehazing using a multilayer perceptron. J. Electron. Imaging 2018, 27, 043022. [Google Scholar] [CrossRef]
  33. Ehsan, S.M.; Imran, M.; Ullah, A.; Elbasi, E. Single Image Dehazing Technique Using the Dual Transmission Maps Strategy and Gradient-Domain Guided Image Filtering. IEEE Access 2021, 9, 89055–89063. [Google Scholar] [CrossRef]
  34. Wu, L.; Zhang, X.; Chen, H.; Wang, D.; Deng, J. VP-NIQE: An Opinion-Unaware Visual Perception Natural Image Quality Evaluator. Neurocomputing 2021, 463, 17–28. [Google Scholar] [CrossRef]
Figure 1. Atmospheric transmission model.
Figure 1. Atmospheric transmission model.
Sensors 22 08132 g001
Figure 2. Segmentation example of sky region, (ah) show the different results of the sky segmentation under different parameters, (a) th1 = 60, th2 = 60, th3 = 180, (b) th1 = 70, th2 = 70, th3 = 190, (c) th1 = 70, th2 = 80, th3 = 190, (d) th1 = 70, th2 = 80, th3 = 200, (e) th1 = 70, th2 = 90, th3 = 200, (f) th1 = 70, th2 = 95, th3 = 200, (g) th1 = 70, th2 = 95, th3 = 205, (h) th1 = 70, th2 = 95, th3 = 215.
Figure 2. Segmentation example of sky region, (ah) show the different results of the sky segmentation under different parameters, (a) th1 = 60, th2 = 60, th3 = 180, (b) th1 = 70, th2 = 70, th3 = 190, (c) th1 = 70, th2 = 80, th3 = 190, (d) th1 = 70, th2 = 80, th3 = 200, (e) th1 = 70, th2 = 90, th3 = 200, (f) th1 = 70, th2 = 95, th3 = 200, (g) th1 = 70, th2 = 95, th3 = 205, (h) th1 = 70, th2 = 95, th3 = 215.
Sensors 22 08132 g002
Figure 3. Result of the Gaussian blur filtering, (ad) the polarized air-light images at fours angle, (eh) the polarized object images at fours angles, (i) the light intensity of the air-light, (j) the light intensity of the object, (k) DOP of the object.
Figure 3. Result of the Gaussian blur filtering, (ad) the polarized air-light images at fours angle, (eh) the polarized object images at fours angles, (i) the light intensity of the air-light, (j) the light intensity of the object, (k) DOP of the object.
Sensors 22 08132 g003
Figure 4. The optimization process of the transmittance map.
Figure 4. The optimization process of the transmittance map.
Sensors 22 08132 g004
Figure 5. The comparison between original hazy image and dehazed image, (a) original hazy image, (b) dehazed image.
Figure 5. The comparison between original hazy image and dehazed image, (a) original hazy image, (b) dehazed image.
Sensors 22 08132 g005
Figure 6. Algorithm flow chart.
Figure 6. Algorithm flow chart.
Sensors 22 08132 g006
Figure 7. The comparison between different methods, (a) the original hazy image, (b) the result of dark channel, (c) the result of SIDMP, (d) the result of proposed method.
Figure 7. The comparison between different methods, (a) the original hazy image, (b) the result of dark channel, (c) the result of SIDMP, (d) the result of proposed method.
Sensors 22 08132 g007
Figure 8. The comparison of the enlarged details, (a) the original image, (b) the result of dark channel, (c) the result of SIDMP, (d) the result of proposed.
Figure 8. The comparison of the enlarged details, (a) the original image, (b) the result of dark channel, (c) the result of SIDMP, (d) the result of proposed.
Sensors 22 08132 g008
Figure 9. Histogram comparison results, (a) result of the original hazy images, (b) result of dark channel, (c) result of SIDMP, (d) result of proposed method.
Figure 9. Histogram comparison results, (a) result of the original hazy images, (b) result of dark channel, (c) result of SIDMP, (d) result of proposed method.
Sensors 22 08132 g009
Figure 10. The comparison of deferent methods, (a) the original hazy image, (b) the result of DTMS, (c) the result of proposed method.
Figure 10. The comparison of deferent methods, (a) the original hazy image, (b) the result of DTMS, (c) the result of proposed method.
Sensors 22 08132 g010
Figure 11. Histogram comparison results, (a) the result of original image, (b) the result of DTMS, (c) the result of proposed.
Figure 11. Histogram comparison results, (a) the result of original image, (b) the result of DTMS, (c) the result of proposed.
Sensors 22 08132 g011
Table 1. Quantitative evaluation of defogging algorithms in the three scenes shown in Figure 7.
Table 1. Quantitative evaluation of defogging algorithms in the three scenes shown in Figure 7.
Grayscale Standard DeviationScenario1Scenario2Scenario3
Original37.707856.991159.3694
Dark channel prior68.488286.620484.1204
SIDMP70.388183.574091.6790
Proposed64.731477.634183.3641
Average GradientScenario1Scenario2Scenario3
Original0.00360.00450.0080
Dark channel0.00500.00660.0084
SIDMP0.00580.00670.0115
Proposed0.00910.00960.0176
Table 2. Image quality evaluation without reference.
Table 2. Image quality evaluation without reference.
NIQEScenario4Scenario5
Original4.88125.3302
DTMS5.18975.6805
Proposed4.33354.2907
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ling, F.; Zhang, Y.; Shi, Z.; Zhang, J.; Zhang, Y.; Zhang, Y. Defogging Algorithm Based on Polarization Characteristics and Atmospheric Transmission Model. Sensors 2022, 22, 8132. https://doi.org/10.3390/s22218132

AMA Style

Ling F, Zhang Y, Shi Z, Zhang J, Zhang Y, Zhang Y. Defogging Algorithm Based on Polarization Characteristics and Atmospheric Transmission Model. Sensors. 2022; 22(21):8132. https://doi.org/10.3390/s22218132

Chicago/Turabian Style

Ling, Feng, Yan Zhang, Zhiguang Shi, Jinghua Zhang, Yu Zhang, and Yi Zhang. 2022. "Defogging Algorithm Based on Polarization Characteristics and Atmospheric Transmission Model" Sensors 22, no. 21: 8132. https://doi.org/10.3390/s22218132

APA Style

Ling, F., Zhang, Y., Shi, Z., Zhang, J., Zhang, Y., & Zhang, Y. (2022). Defogging Algorithm Based on Polarization Characteristics and Atmospheric Transmission Model. Sensors, 22(21), 8132. https://doi.org/10.3390/s22218132

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop