Next Article in Journal
An Improved SAR Ship Classification Method Using Text-to-Image Generation-Based Data Augmentation and Squeeze and Excitation
Next Article in Special Issue
An Advanced Quality Assessment and Monitoring of ESA Sentinel-1 SAR Products via the CyCLOPS Infrastructure in the Southeastern Mediterranean Region
Previous Article in Journal
Spatiotemporal Patterns of Air Pollutants over the Epidemic Course: A National Study in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

GPU Acceleration for SAR Satellite Image Ortho-Rectification

1
Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
2
Key Laboratory of Technology in Geo-Spatial Information Processing and Application Systems, Chinese Academy of Sciences, Beijing 100190, China
3
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2024, 16(7), 1301; https://doi.org/10.3390/rs16071301
Submission received: 17 February 2024 / Revised: 27 March 2024 / Accepted: 6 April 2024 / Published: 7 April 2024
(This article belongs to the Special Issue Calibration and Validation of SAR Data and Derived Products)

Abstract

:
Synthetic Aperture Radar (SAR) satellite image ortho-rectification requires pixel-level calculations, which are time-consuming. Moreover, for SAR images with large overlapping areas, the processing time for ortho-rectification increases linearly, significantly reducing the efficiency of SAR satellite image mosaic. This paper thoroughly analyzes two geometric positioning models for SAR images. In order to address the high computation time of pixel-by-pixel ortho-rectification in SAR satellite images, a GPU-accelerated pixel-by-pixel correction method based on a rational polynomial coefficients (RPCs) model is proposed, which improves the efficiency of SAR satellite image ortho-rectification. Furthermore, in order to solve the problem of linearly increasing processing time for the ortho-rectification of multiple SAR images in large overlapping areas, a multi-GPU collaborative acceleration strategy for the ortho-rectification of multiple SAR images in large overlapping areas is proposed, achieving efficient ortho-rectification processing of multiple SAR image data in large overlapping areas. By conducting ortho-rectification experiments on 20 high-resolution SAR images from the Gaofen-3 satellite, the feasibility and efficiency of the multi-GPU collaborative acceleration processing algorithm are verified.

1. Introduction

Synthetic Aperture Radar (SAR) is a remote sensing technology that uses high-frequency electromagnetic waves to emit and receive echoes from the earth’s surface to obtain surface information [1]. Unlike optical remote sensing, SAR sensors can collect data under any weather conditions because they acquire target information by transmitting electromagnetic waves, independent of weather conditions [2,3]. Because of various error factors such as range measurement, Doppler center frequency, satellite ephemeris, and satellite attitude measurement accuracy during SAR satellite imaging, geometric features of various land features in SAR satellite images, including size, shape, and orientation, can be distorted. SAR satellite image ortho-rectification is based on the geometric positioning model of SAR satellites. It processes the geometric errors caused by various factors such as satellite platform, SAR payload, and terrain undulation based on high-precision control point data and elevation data, resulting in SAR satellite image ortho-rectification products with geographic coding and conforming to orthographic projection.
Currently, there are two main types of positioning methods for SAR satellite images as follows: methods based on rigorous models and methods based on generic models [4,5]. For SAR images, the rigorous model is the range-Doppler (RD) model, which mainly discusses the relationship between image points and target points from the perspective of synthetic aperture radar imaging geometry. It was first proposed by Brown in 1981 [6]. Based on this model, Curlander further studied the positioning method based on the RD model and achieved the precise positioning of SAR images by solving the Doppler equation [7]. With the launch of SAR systems such as TerraSAR-X, German Aerospace developed software for SAR image geocoding, which realized fast processing of SAR images based on the RD model [8]. With the expansion of SAR image applications, extensive research has been conducted on the positioning of SAR images both domestically and internationally. Zhang et al. proposed a method to solve the RD imaging equation without ground control points. By using the slant range vector in the RD equation as a variable and expanding the error equation through Taylor series expansion, the position information of the target point was iteratively solved using the least squares adjustment principle [9]. Chen et al. proposed a method that combines analytical and numerical solution algorithms for the direct positioning of SAR images on board satellites [10]. Li et al. proposed research on the positioning method of SAR images based on satellite parameter prediction [11]. However, because of the requirement of precise orbital parameters at the moment of satellite imaging for the RD model and the different formats of SAR satellite parameters, the joint processing of multi-source SAR images is greatly limited.
Therefore, in order to adapt to the joint processing of multi-source remote sensing image data, generic positioning models emerged, among which the most widely used is the Rational Function Model (RFM) [12,13,14,15]. RFM uses a rational polynomial form to fit the rigorous model and was initially used for the geolocation of optical images [16,17,18]. With continuous research by scientists, RFM began to be gradually applied to the geolocation of SAR images [19,20,21]. Zhang et al. proposed a method to replace the rigorous model with the RFM model for SAR image geolocation and experimentally verified the effectiveness of the RFM model [22]. He et al. proposed a hybrid method that combines the L curve and IMCCV (iterative method to modify the characteristic values) to solve the unconditional equations in the rational polynomial coefficients (RPCs) model [23]. Subsequently, Zhang et al. introduced the RFM model into the InSAR processing technology and constructed SAR and InSAR data processing models based on RFM [24]. Zhao et al. proposed a method for calculating the geometric angles of SAR local imaging based on the RFM model [25]. Liu proposed a real-time geometric correction method and system for SAR images based on RD plane pixel mapping, which deduces the ground distance coordinates of each pixel of real-time SAR imaging results through imaging geometry relationships. At the same time, in the process of pixel-grid positioning, the ground distance pixel scale adjustment is realized using the ground distance coordinate [26].
During the process of the ortho-rectification of remote sensing images, whether it is a rigorous model or an RFM model, point-by-point interpolation calculations are required. At the same time, because of the large range of remote sensing images, parallel point-by-point interpolation calculations consume a lot of processing time. In order to improve computational efficiency, scholars have conducted relevant research on parallel ortho-rectification methods for remote sensing image processing. Fang et al. addressed the problem of long processing time for the ortho-rectification of high-resolution, large-swath optical satellite images and proposed a CPU-GPU collaborative processing strategy for the ortho-rectification of optical satellite remote sensing images to fully utilize the computational performance of the CPU-GPU collaborative processing architecture [27]. Based on this, Wang et al. proposed a GPU block acceleration strategy for the ortho-rectification processing of remote sensing images [28]. Xiao et al. proposed a hierarchical logical strategy for the ortho-rectification processing of high swath width GaoFen-4 remote sensing images, which is suitable for large-area remote sensing image ortho-rectification processing to improve efficiency [29]. However, because of special phenomena such as layover, shadow, and perspective shrinkage in SAR images, traditional ortho-rectification strategies for optical images cannot fully meet the requirements of SAR image ortho-rectification. Therefore, this paper proposes a multi-GPU acceleration strategy for SAR images in large areas. Based on the pixel-to-object ortho-rectification method based on SAR geometric characteristics, the block strategy for SAR image ortho-rectification is optimized according to the resource conditions of different GPU nodes, thereby optimizing the efficiency of SAR image ortho-rectification.
For the time-consuming pixel-by-pixel operation in SAR satellite image ortho-rectification, this paper proposes a GPU pixel-by-pixel rectification method for SAR images based on the RPC rational function model, which improves the processing efficiency of SAR satellite image ortho-rectification. Based on this, aiming at the problem of linearly increasing time consumption in the ortho-rectification processing of multiple SAR images in large-area mosaicking of SAR satellite images, this paper further proposes a multi-GPU collaborative acceleration strategy for the ortho-rectification of multiple SAR images in large areas. Finally, efficient ortho-rectification processing of multiple SAR image data in large areas is achieved.
This paper conducts research in the following five parts:
Section 1 briefly analyzes the problems to be solved in SAR satellite image ortho-rectification and the reasons for GPU acceleration. Section 2 introduces the two geometric positioning models for SAR satellite image ortho-rectification. Section 3 proposes a pixel-to-object ortho-rectification method based on SAR geometric characteristics and a SAR ortho-rectification model based on pixel-to-object imaging. Section 4 uses 20 scenes of Gaofen-3 SAR images to carry out ortho-rectification experiments and analyzes the experimental results. Section 5 verifies the feasibility and efficiency of the GPU-accelerated processing method for the ortho-rectification of SAR satellite images through experiments.

2. SAR Satellite Image Ortho-Rectification Model

Compared with optical imaging, SAR systems use active transmission and reception of signals for imaging, which is fundamentally different from passive optical imaging. Therefore, there are significant differences between SAR images and optical images in imaging principles, geometric structures, and radiation characteristics, making it difficult to directly apply conventional calibration methods (e.g., inverse methods) for optical images to SAR image correction. Instead, a forward method is used to correct the SAR slant range image pixel by pixel to obtain the final orthorectified image. The two main geometric positioning models for SAR imagery are based on the rigorous imaging model and the general imaging model.

2.1. Ortho-Rectification Model Based on Rigorous Imaging

The ortho-rectification model of SAR satellite images based on rigorous imaging is the range-Doppler positioning model.
Range measurement and Doppler frequency measurement are the two major measurements in SAR, which decompose the object into two-dimensional components in the range and azimuth directions through distance measurement and Doppler frequency measurement. This is achieved by measuring the time delay (range measurement) of the radar pulse propagation between the radar and the object to decompose the object in the radar line-of-sight (range direction). The azimuth position of the object is determined by measuring the Doppler frequency shift.
Based on the principles of slant range measurement and Doppler, a positioning method that conforms to the SAR imaging mechanism can be obtained. Within a range scan line, any point on the slant range image should satisfy the slant range distance condition and the Doppler condition specified in Equation (1):
r 0 + x · M x = X s X p 2 + Y s Y p 2 + Z s Z p 2                 V X ( X s X p ) + V Y ( Y s Y p ) + V z ( Z s Z p ) r 0 + x · M x = f D λ 2                                                                          
The ground point also satisfies the ellipsoid equation in Equation (2):
X P 2 + Y P 2 ( a + h ) 2 + Z P 2 ( b + h ) = 1
where x is the image coordinate (column) corresponding to the ground point coordinates X p , Y p , Z p ,   r 0 is the near-range slant range, λ is the wavelength of the radar, M x is the resolution in the slant range direction, which is generally known, f D is the Doppler center frequency value, which can be accurately calculated during image processing and is also known, X s , Y s , Z s and V x , V y , V z are the three-dimensional position and velocity of the satellite, a and b are the long and short semi-axes of the earth reference ellipsoid, and h is the height of the ground point.
The georeferencing of SAR images based on range and Doppler primarily involves the design of orbital position parameters and the establishment of range-Doppler equations. For simplicity, the satellite platform operating at high altitude can be considered to have a stable operation. Its position changes can be accurately described using acceleration, velocity, and position state variables. According to Newtonian mechanics, it is known that the satellite position and velocity at any time are given by:
X s = X 0 + V X 0 t + 1 2 a X t 2 Y s = Y 0 + V Y 0 t + 1 2 a Y t 2 Z s = Z 0 + V Z 0 t + 1 2 a Z t 2 V X = V X 0 + a X t V Y = V Y 0 + a Y t V Z = V Z 0 + a Z t
where t is closely related to the scan line and can be expressed as   t = y / P R F , where y is the row coordinate of the image and P R F is the pulse repetition frequency of the SAR, which is a known constant.

2.2. Ortho-Rectification Model Based on General Imaging

For satellite remote sensing images, because of stable satellite flight, slow attitude changes, and nearly parallel projection during imaging, there is a strong correlation between the various orientation elements of the image, making it difficult to control the numerical stability of the bundle adjustment method based on the strict imaging geometry model during the solution process, even though it is theoretically rigorous. At the same time, because of technical confidentiality and other factors, the imaging mode and orbit information of the satellite are not publicly available, making it difficult to establish a strict geometric imaging model for the sensor. Unlike the strict sensor model, the RPC model does not require knowledge of the physical properties of each type of imaging sensor, such as orbit parameters and platform orientation parameters. Therefore, for high-resolution optical satellite images, the RPC model based on single-scene image has been widely used in recent years.
Zhang et al. [16] verified the substitutability of the RPC model for the rigorous imaging model of SAR from both theoretical and experimental aspects, demonstrating the feasibility of using the RPC model to fit SAR image imaging. The experimental results showed that the RPC model can achieve high fitting accuracy for SAR systems of different resolutions and can be used for the photogrammetric processing of SAR images.
Currently, in the field of optical remote sensing, the RFM has become a standard and is supported by many commercial software programs. Research has also been carried out on methods for stereomapping based on the RFM model, and the same model can be used for georeferencing SAR images.
The RFM model represents the image coordinates ( r , c ) as a polynomial ratio with respect to the corresponding ground spatial coordinates ( X , Y , Z ) :
r n = P 1 ( X n , Y n , Z n ) P 2 ( X n , Y n , Z n ) c n = P 3 ( X n , Y n , Z n ) P 4 ( X n , Y n , Z n )
where P 1 ( X n , Y n , Z n ) , P 2 ( X n , Y n , Z n ) , P 3 ( X n , Y n , Z n ) , and P 4 ( X n , Y n , Z n ) are polynomials with respect to X , Y , Z . When the control points used to solve the RFM parameters are unevenly distributed or the model is overly parameterized, the denominators in the model can change drastically, resulting in the normal equations of the error equations being severely ill-conditioned after linearization. To reduce numerical errors in calculations, the image coordinates and geographical coordinates are normalized:
r n = r r 0 r s c n = c c 0 c s X n = X X 0 X s Y n = Y Y 0 Y s Z n = Z Z 0 Z s
where ( X 0 , Y 0 , Z 0 , c 0 , r 0 ) are the normalized translation parameters and X s , Y s , Z s , c s , r s are the normalized scaling parameters. The normalized coordinates ( r n , c n ) and ( X n , Y n , Z n ) represent the normalized image coordinates and geographical coordinates, respectively. This normalization process reduces rounding errors introduced because of the difference in data scales.
Each term in the polynomial has a maximum degree of 3 for the coordinates X ,   Y ,   Z , and the total degree of all terms in each polynomial does not exceed 3. The form of each polynomial is as follows:
P 1 X n , Y n , Z n = a 0 + a 1 X n + a 2 Y n + a 3 Z n + a 4 X n Y n + a 5 X n Z n + a 6 Y n Z n + a 7 X n 2 + a 8 Y n 2 + a 9 Z n 2 + a 10 X n Y n Z n + a 11 X n 3 + a 12 X n Y n 2 + a 13 X n Z n 2 + a 14 X n 2 Y n + a 15 Y n 3 + a 16 Y n Z n 2 + a 17 X n 2 Z n + a 18 Y n 2 Z n + a 19 Z n 3
  P 2 X n , Y n , Z n = b 0 + b 1 X n + b 2 Y n + b 3 Z n + b 4 X n Y n + b 5 X n Z n + b 6 Y n Z n + b 7 X n 2 + b 8 Y n 2 + b 9 Z n 2 + b 10 X n Y n Z n + b 11 X n 3 + b 12 X n Y n 2 + b 13 X n Z n 2 + b 14 X n 2 Y n + b 15 Y n 3 + b 16 Y n Z n 2 + b 17 X n 2 Z n + b 18 Y n 2 Z n + b 19 Z n 3
  P 3 X n , Y n , Z n = d 0 + d 1 X n + d 2 Y n + d 3 Z n + d 4 X n Y n + d 5 X n Z n + d 6 Y n Z n + d 7 X n 2 + d 8 Y n 2 + d 9 Z n 2 + d 10 X n Y n Z n + d 11 X n 3 + d 12 X n Y n 2 + d 13 X n Z n 2 + d 14 X n 2 Y n + d 15 Y n 3 + d 16 Y n Z n 2 + d 17 X n 2 Z n + d 18 Y n 2 Z n + d 19 Z n 3
P 4 X n , Y n , Z n = e 0 + e 1 X n + e 2 Y n + e 3 Z n + e 4 X n Y n + e 5 X n Z n + e 6 Y n Z n + e 7 X n 2 + e 8 Y n 2 + e 9 Z n 2 + e 10 X n Y n Z n + e 11 X n 3 + e 12 X n Y n 2 + e 13 X n Z n 2 + e 14 X n 2 Y n + e 15 Y n 3 + e 16 Y n Z n 2 + e 17 X n 2 Z n + e 18 Y n 2 Z n + e 19 Z n 3
where ( a 0 , a 1 , , a 19 , b 0 , b 1 , , b 19 , d 0 , d 1 , , d 19 , e 0 , e 1 , , e 19 ) are rational function coefficients. In most cases, b0 and e0 are both equal to 1, so the core parameters of RFM are the rational polynomial coefficients, often referred to as RPC.

3. Methods

3.1. Geometric Correction Method for SAR Images Based on the Image-to-Ground Ortho-Rectification Process

Because of the imaging characteristics of SAR, when the echoes of multiple positions reflected by the target reach the radar antenna at the same distance, they will appear at the same position on the SAR image. This phenomenon forms an area in the image called the layover region. In the layover region, traditional correction methods may cause “smearing” effects in the corrected image. These phenomena can have different degrees of impact on target structures, posing challenges to the accurate interpretation of high-resolution SAR images and limiting their use in various applications. Therefore, an image-to-ground ortho-rectification method based on the geometric characteristics of SAR can provide precise correction of SAR images by combining the elevation data provided by the digital surface model (DSM) to calculate the ground coordinates after correction for each pixel.
In the SAR image ortho-rectification model, the pixels in the non-layover region can directly calculate the accurate position coordinates in the ground space based on the single mapping relationship between the image space and the ground space. The processing flow is as follows:
(1)
According to the SAR range Doppler localization model parameters and the iteration calculation of the ground coordinates x , y , Z 0 , obtain the ground latitude and longitude coordinates X 0 , Y 0 .
(2)
Based on the latitude and longitude coordinates, compute the corresponding elevation value Z d on the DSM.
(3)
Calculate the elevation change Z = Z d Z 0 . If Z ε , exit the loop, and the corresponding latitude and longitude coordinates X 0 , Y 0 , Z d of the pixel coordinates are obtained. If the above requirement is not met, set Z 0 = Z d , and then repeat steps (1)–(3) until the condition for exiting the loop is met or the maximum number of iterations is reached and the iteration does not converge, and force an exit.
According to the above processing flow, the ground latitude and longitude coordinate information corresponding to the pixels in the non-layover region can be obtained. For the pixels in the layover region, since their pixel coordinates correspond to multiple ground space coordinates, it is necessary to solve the corresponding ground space coordinates of the target structure to resolve the mixed pixel information. Assuming that the image-to-ground coordinates of the region to be corrected are x , y , with the initial elevation of the center of the region Z 0 , the following correction model based on SAR geometric characteristics is applied:
(1)
Based on the SAR range Doppler localization model parameters and the iteration calculation of the image-to-ground coordinates x , y , Z 0 , obtain the ground latitude and longitude coordinates X , Y .
(2)
Set the elevation change range Z 0 d Z , Z 0 + d Z . For each elevation value Z i in the elevation change range, use the SAR range Doppler localization model to iteratively calculate the latitude and longitude coordinates X i , Y i corresponding to x , y , Z i , and obtain the elevation value Z i d on the DSM based on the latitude and longitude coordinates.
(3)
By traversing all the elevation values in the elevation change range, obtain the elevation linear change curve Z i Z 0 d Z , Z 0 + d Z and the DSM elevation curve Z i d . Calculate the intersection between the two elevation curves as the multiple ground space coordinates X c , Y c , Z c corresponding to the pixel coordinates.
(4)
Considering that higher targets always occlude lower targets when an image is occluded, take the ground space coordinates corresponding to the highest elevation value in the intersection as the final orthorectified coordinates.
According to the above steps, the ground coordinates corresponding to each pixel coordinate of the SAR-corrected image can be obtained. Then, based on the radiation values corresponding to the pixel coordinates, gray value interpolation can be applied to the ground coordinates to obtain the final orthorectified image.

3.2. GPU-Accelerated Processing Method Based on the Image-to-Ground SAR Ortho-Rectification Model

SAR image data needs to be orthorectified before further processing such as mosaic and radiometric normalization. For large-area SAR image data, considering the iterative processing required by the ortho-rectification model based on SAR geometric characteristics, it is necessary to design targeted acceleration algorithms to improve the efficiency of ortho-rectification processing. Currently, there are two main problems in ortho-rectification of large-area SAR images as follows:
(1)
Ortho-rectification requires pixel-by-pixel computation, which is time-consuming. Furthermore, for large-area SAR image data consisting of multiple images, the processing time for ortho-rectification increases linearly, requiring the proper allocation of multiple GPU nodes to accelerate the processing.
(2)
The efficiency of ortho-rectification for non-layover pixels and layover pixels based on SAR geometric characteristics is different. The iteration for non-layover pixels generally converges in 3–5 iterations, making the computation efficient. However, handling layover pixels requires traversing all possible cases in the elevation change range, leading to lower efficiency. Usually, non-layover pixels are located in flat areas with small variations, while layover pixels are in areas with significant terrain variations. Therefore, GPU nodes and memory need to be allocated according to different types of SAR images.
To address the above problems, this study proposes a GPU-accelerated processing strategy based on the SAR geometric ortho-rectification model. To ensure generality, the RPC model is used instead of the range-Doppler geometric localization model. The RPC rational function model relates the ground coordinates ( X , Y , Z ) and the corresponding image coordinates ( x , y ) using ratio polynomials.
  • GPU-based pixel-by-pixel ortho-rectification of SAR images using the RPC rational function model.
The steps for pixel-by-pixel ortho-rectification of SAR images using the RPC rational function model are as follows:
(1)
According to the RPC rational function model, calculate the ground latitude and longitude coordinates X , Y of the boundary pixels of the original SAR image and the average elevation x , y , Z 0 at the center of the image. Iterate to obtain the range of ground coordinates in the orthorectified image by calculating the maximum and minimum longitudes and latitudes.
(2)
Based on the set ortho-rectification resolution and ground coordinate range, calculate the pixel size of the orthorectified image and initialize the image matrix file.
(3)
Copy the RPC rational function model parameters, DEM elevation data, original SAR image data, and the initialized image matrix from memory to GPU memory. Initialize the number of parallel computing threads and blocks on the GPU.
(4)
Use each GPU thread to iterate over the pixels of the original image and calculate the ground coordinates corresponding to the pixel coordinates based on the SAR geometric ortho-rectification model.
(5)
Calculate the corresponding pixel coordinates in the orthorectified image based on the ground coordinates and perform interpolation on the radiometric values of the orthorectified image.
The overall processing flow is shown in Figure 1.
2.
SAR Geometric Ortho-Rectification and Standardization Processing Based on Multi-GPU Collaboration
Multi-GPU nodes have the capability to simultaneously perform parallel ortho-rectification on multiple SAR images. Considering that SAR images have different sizes and land cover types, and the computation time for overlay and non-overlay pixels in a single SAR image also varies, the time required for the ortho-rectification of each SAR image is also different. Therefore, designing an appropriate strategy for distributing multiple GPU nodes is needed.
First, the optimal pixel size M c × N c for processing is calculated based on the maximum memory limit of each GPU card. Then, the overlay pixel mask is calculated for the SAR images to be rectified. Based on the definition of overlay regions, the corresponding latitude and longitude coordinates in the object space are obtained. Therefore, the number of times the pixel coordinates obtained through the projection of latitude and longitude coordinates are traversed can be statistically counted. The coordinates that appear more than or equal to twice are considered overlay pixels, and a threshold segmentation based on the number of coordinates can be used to obtain the overlay pixels mask and calculate the overlay pixel ratio R l .
From the analysis of the processing models of non-overlay pixels and overlay pixels in the SAR geometric ortho-rectification model, it can be seen that the computation complexity of overlay pixels is determined by the traversal of the elevation space. Assuming the number of traversals in the elevation space is N z , the computation amount of overlay pixels is N z / 5 times that of non-overlay pixels. Based on the above analysis, the overlay pixel ratio of all SAR images to be rectified can be calculated first, and then the adjustment of the optimal size can be performed using the following formula:
M c a × N c a = M c × N c × 0.5 , 1 R l
where M c a and N c a are the adjusted optimal sizes based on the topography, M c and N c are the original processing sizes calculated based on the memory limit, and R l is the overlay pixel ratio.
For SAR images with a low overlay pixel ratio, the processing efficiency is relatively fast, so a larger processing size can be set. For SAR images with a high overlay pixel ratio, the processing efficiency is relatively slow. In order to maintain the consistency of multi-GPU collaboration, a corresponding smaller size is set to ensure consistent processing time for different areas.

4. Experiment and Analysis

4.1. Experimental Data and Platform

To verify the effectiveness of the proposed algorithm in this paper, validation experiments were conducted using domestic Gaofen-3 SAR satellite images. The Gaofen-3 SAR images used in the experiments were acquired in ultra-fine strip (UFS) mode, with a total of 20 images and a resolution of 3 m. The coverage area of the data used in the experiment is the southeastern coastal area of China, as shown in Figure 2. The terrain elevation ranges from 0 m to 1500 m. The specific experimental data information is shown in Table 1.
In the experiment, a high-performance computing server with specific hardware parameters, as shown in Table 2, was used.

4.2. Experimental Process

To verify the effectiveness of the SAR image GPU-based per-pixel correction based on the RPC rational function model, and the SAR geometric ortho-rectification standardization processing based on multi-GPU cooperation, experiments were conducted with 20 scenes of Gaofen-3 SAR images acquired in UFS mode. Four experiments were conducted as follows:
(1)
Implementation of geometric ortho-rectification algorithm on a single CPU server node
Using one CPU server node (without GPU card) consistent with the subsequent experimental server node configuration, an experiment was conducted to implement the CPU-based geometric ortho-rectification algorithm. The time for the ortho-rectification of the 20 scenes of Gaofen-3 SAR images in UFS mode was recorded as the baseline algorithm for comparison with the proposed GPU-based per-pixel correction algorithm based on the RPC rational function model and the SAR geometric ortho-rectification standardization processing strategy based on multi-GPU cooperation.
(2)
Implementation of SAR image GPU per-pixel correction algorithm based on the RPC rational function model
Using one GPU server node (with one GPU card), an experiment was conducted to implement the GPU per-pixel correction algorithm for SAR images. The time for ortho-rectification of the 20 scenes of Gaofen-3 SAR images in UFS mode was recorded to verify the accelerated efficiency of the GPU per-pixel correction algorithm based on the RPC rational function model.
(3)
Implementation of SAR geometric ortho-rectification standardization processing on four GPU server nodes
Using four server nodes (total of eight GPU cards), an experiment was conducted to implement the SAR geometric ortho-rectification standardization processing based on eight GPU cards. The time for ortho-rectification of the 20 scenes of Gaofen-3 SAR images in UFS mode was recorded to verify the effectiveness of the acceleration strategy based on the multi-GPU cooperation in Section 3.2.
(4)
Implementation of SAR geometric ortho-rectification standardization processing on eight GPU server nodes
Using eight server nodes (total of 16 GPU cards), an experiment was conducted to implement the SAR geometric ortho-rectification standardization processing based on 16 GPU cards. The time for ortho-rectification of the 20 scenes of Gaofen-3 SAR images in UFS mode was recorded to verify the effectiveness of the acceleration strategy based on multi-GPU cooperation in Section 3.2.

4.3. Experimental Results Analysis

In order to quantitatively evaluate the performance of the algorithm before and after optimization, this paper introduces two key performance evaluation indicators.
First, we define the Ratio Of Speed Up (ROSU), which is used to measure the improvement in the parallel algorithm in execution speed compared with the serial algorithm. Its calculation formula is shown in Formula (11).
R O S U = T s e r i a l T p a r a l l e l
where T s e r i a l represents the time of executing the algorithm serially on the CPU, and T p a r a l l e l represents the time of executing the algorithm in parallel on the GPU or CPU. The higher the ROSU value, the more significant the effect of the parallel algorithm in improving the execution speed.
Second, we propose the concept of the Ratio Of Performance Improvement (ROPI), which is used to evaluate the effectiveness of specific performance optimization methods in improving the efficiency of the algorithm. Its calculation formula is shown in Formula (12).
R O P I = T b e f o r e T a f t e r T b e f o r e
where T b e f o r e represents the execution time of the algorithm before performance optimization, and T a f t e r represents the execution time of the algorithm after performance optimization. The higher the ROPI value, the more significant the effect of the adopted performance optimization method in improving algorithm efficiency.
Through these two metrics, we can comprehensively and accurately evaluate the performance changes in the algorithm before and after optimization, as well as the degree of impact of different optimization methods on algorithm performance.
The experiment used experimental data from 20 high-resolution SAR images covering the southeastern coastal areas of China for orthographic correction parallelization verification. The hardware resources used in the experiment are shown in Table 2. To verify the effectiveness of the proposed parallel optimization strategy for SAR image ortho-rectification, experiments were conducted to compare the ortho-rectification time under different strategies. Some orthorectified SAR images are shown in Figure 3.
Table 3 shows the time consumption of SAR image ortho-rectification under different strategies, comparing the ortho-rectification time of a single CPU node, a single GPU node, four GPU nodes, and eight GPU nodes. The comprehensive results shown in Figure 4, Figure 5 and Figure 6 indicate the following:
(1)
When performing ortho-rectification of SAR images on a single node, after GPU processing, the ortho-rectification algorithm achieves a speed-up ratio (ROSU) of 12 and a performance improvement ratio (ROPI) of 91.9% compared with the CPU-based ortho-rectification algorithm, demonstrating the effectiveness of the optimization strategy based on GPU mapping.
(2)
After processing by multiple nodes, the performance of SAR image ortho-rectification is greatly improved. After parallelization on eight nodes, the GPU-based ortho-rectification algorithm using multiple nodes achieves a speed-up ratio (ROSU) of 73 and a performance improvement ratio (ROPI) of 98.6% compared with the traditional single CPU node, demonstrating the effectiveness of the multi-node GPU parallelization strategy for ortho-rectification.
In conclusion, by optimizing the parallelization strategy of the computational time in the SAR image ortho-rectification process, the resource utilization of the computing nodes can be effectively improved, thereby improving the efficiency of SAR image ortho-rectification.

5. Conclusions

The effectiveness of the GPU acceleration processing method based on the image object SAR orthorectified correction model proposed in this paper was verified through Gaofen-3 satellite SAR image orthorectified correction experiments. Therefore, the following conclusion can be drawn:
(1)
After single-node GPU matching, the orthorectified correction of Gaofen-3 satellite SAR images achieves a speed-up ratio (ROSU) of 12 and a performance improvement ratio (ROPI) of 91.9%, verifying the effectiveness of the optimization strategy based on GPU mapping in the orthorectified correction algorithm.
(2)
After processing with multiple GPU nodes, the orthorectified correction of Gaofen-3 satellite SAR images achieves a speed-up ratio (ROSU) of 73 and a performance improvement ratio (ROPI) of 98.6%, verifying the effectiveness of the multi-GPU node parallelization strategy.

Author Contributions

Conceptualization, L.D.; Methodology, L.D., F.L. and T.Z.; Software, L.D., T.Z. and F.L.; Validation, R.L. and H.Y.; Formal analysis, L.D. and R.L.; Resources, H.Y.; Writing—original draft preparation, L.D.; Writing—review and editing, L.D., T.Z. and F.L.; Visualization, F.L.; Supervision, H.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Chan, Y.K.; Koo, V. An introduction to synthetic aperture radar (SAR). Prog. Electromagn. Res. B 2008, 2, 27–60. [Google Scholar] [CrossRef]
  2. Moreira, A.; Prats-Iraola, P.; Younis, M.; Krieger, G.; Hajnsek, I.; Papathanassiou, K.P. A tutorial on synthetic aperture radar. IEEE Geosci. Remote Sens. Mag. 2013, 1, 6–43. [Google Scholar] [CrossRef]
  3. Xiang, Y.; Jiao, N.; Wang, F.; You, H. A Robust Two-Stage Registration Algorithm for Large Optical and SAR Images. IEEE Trans. Geosci. Remote Sens. 2022, 60, 1–15. [Google Scholar] [CrossRef]
  4. Gao, X.; Chen, X.; Guo, P. An Ortho-Rectification Method for Space-Borne SAR Image with Imaging Equation. In Universal Access in Human-Computer Interaction. Intelligent and Ubiquitous Interaction Environments. UAHCI 2009; Stephanidis, C., Ed.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2009; Volume 5615. [Google Scholar]
  5. Wang, T.; Li, X.; Zhang, G.; Lin, M.; Deng, M.; Cui, H.; Jiang, B.; Wang, Y.; Zhu, Y.; Wang, H.; et al. Large-scale orthorectification of GF-3 SAR images without ground control points for China’s land area. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5221617. [Google Scholar] [CrossRef]
  6. Brown, W.E. Applications of SEASAT SAR Digitally Corrected Imagery for Sea Ice Dynamics. In Proceedings of the American Geophysical Union Spring 1981 Meeting, Baltimore, MD, USA, 25–29 May 1981; pp. 25–29. [Google Scholar]
  7. Curlander, J.C. Location of Space-borne SAR Imagery. IEEE. Trans. Geosci. Remote Sens. 1982, 20, 359–364. [Google Scholar] [CrossRef]
  8. Kosmann, D.; Roth, A.; Bollner, M.; Benjes, A. Value-added SAR products for ENVISAT. In Proceedings of the IEEE Geoscience and Remote Sensing Symposium Proceedings, 1998. IGARSS ‘98. 1998 IEEE International, Seattle, WA, USA, 6–9 July 1998; IEEE: Piscataway, NJ, USA, 1998; pp. 259–261. [Google Scholar]
  9. Zhang, B.; Zhang, H.; Wang, C.; Wu, F. A new method for satellite borne SAR image localization. J. Radio Sci. 2006, 21, 5.1. [Google Scholar]
  10. Chen, E.; Li, Z. A Direct Localization Algorithm for Spaceborne SAR by Combining Analytical and Numerical Algorithms. Chin. J. Image Graph. 2006, 11, 5. [Google Scholar] [CrossRef]
  11. Li, L.; Wu, Y.; Liu, B.; Peng, H.; You, H.; Zhou, Q. Research on Spaceborne SAR Image Positioning Method Based on Satellite Parameter Prediction. J. Electron. Inf. Technol. 2007, 7, 1691–1694. [Google Scholar]
  12. Liu, J.; Wang, D.; Liu, J.; Li, J. Accurate localization of IKONOS images using RPC model. J. Surv. Mapp. Sci. Technol. 2006, 23, 5. [Google Scholar]
  13. Zhang, Y.; Liu, J. Algorithm and Optimization of RPC Model Localization for High Resolution Remote Sensing Satellite Stereoscopic Images. Surv. Mapp. Eng. 2004, 13, 4. [Google Scholar]
  14. Xiang, Y.; Wang, X.; Wang, F.; You, H.; Qiu, X.; Fu, K. A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration. IEEE Trans. Geosci. Remote Sens. 2023, 61, 1–20. [Google Scholar] [CrossRef]
  15. Zhang, L.; Balz, T.; Liao, M. Satellite SAR geocoding with refined RPC model. ISPRS J. Photogramm. Remote. Sens. 2012, 69, 37–49. [Google Scholar] [CrossRef]
  16. Wang, L.; Xiang, Y.; Wang, Z.; You, H.; Hu, Y. On-Board Geometric Rectification for Micro-Satellite Based on Lightweight Feature Database. Remote. Sens. 2023, 15, 5333. [Google Scholar] [CrossRef]
  17. Dial, G.; Sc, M.J.; Grodecki, P.D. Satellite image block adjustment simulations with physical and RPC camera models. In Proceedings of the ASPRS 2004 Conference, Denver, Colorado, 23–28 May 2004. [Google Scholar]
  18. Dial, G.; Grodecki, J. Block adjustment with rational polynomial camera models. In Proceeding of the ASCM-ASPRS Annual Conventions, Washington DC, USA, 19–26 April 2002. [Google Scholar]
  19. Zhang, G.; Fei, W.; Li, Z.; Zhu, X.Y.; Tang, X.M. Experiment and analysis of using RPC to replace the rigorous imaging geometric model of spaceborne SAR. J. Surv. Mapp. 2010, 39, 7. [Google Scholar]
  20. Qin, X.; Zhang, G.; Li, L. Research on Algorithm for Solving RPC Model Parameters of SAR Images. J. Chengdu Univ. Technol. Nat. Sci. Ed. 2006, 4, 349–355. [Google Scholar]
  21. Jiao, N.; Wang, F.; You, H.; Liu, J.; Qiu, X. A generic framework for improving the geopositioning accuracy of multi-source optical and SAR imagery. ISPRS J. Photogramm. Remote Sens. 2020, 169, 377–388. [Google Scholar] [CrossRef]
  22. Zhang, G.; Li, D.; Qin, X.; Zhu, X. Geometric Rectification of High Resolution Spaceborne SAR Image Based on RPC Model. J. Remote Sens. 2008, 6, 942–948. [Google Scholar]
  23. He, X.; Wei, X.; Zhang, L.; Balz, T.; Liao, M. RPC modeling for spaceborne SAR and its aplication in radargrammetry. In Proceedings of the 2010 IEEE International Geoscience and Remote Sensing Symposium, Honolulu, HI, USA, 25–30 July 2010; IEEE: Piscataway, NJ, USA, 2010. [Google Scholar]
  24. Zhang, G.; Qin, X. Spaceborne SAR and InSAR Data Processing Technology Based on RPC Model; Surveying and Mapping Press: Austin, TX, USA, 2013. [Google Scholar]
  25. Zhao, L.; Chen, E.; Li, Z. Geometric Angle Calculation Method for SAR Local Imaging Based on RPC Model. CN108594225A, 28 September 2018. [Google Scholar]
  26. Liu, N.; Dai, Z.; Zhang, S.; Duan, C.; Men, Y. Real Time Geometric Correction Method and System for SAR Images Based on RD Plane Pixel Mapping. CN111127334B, 12 December 2023. [Google Scholar]
  27. Fang, L.; Wang, M.; Li, D. A CPU-GPU Co-processing Orthographic Rectification Approach for Optical Satellite Imagery. Acta Geod. Cartogr. Sin. 2013, 42, 668–675. [Google Scholar]
  28. Wang, P.; Quan, J.; Wang, H. Blocking processing method for large image orthorectified correction based on GPU. Sci. Technol. Vis. 2016, 21, 1. [Google Scholar] [CrossRef]
  29. Xiao, L.; Li, X.; Yang, B. Quick Orthographic Rectification Based on CUDA. J. Geomat. 2019, 44, 74–78. [Google Scholar]
Figure 1. GPU-accelerated pixel-by-pixel ortho-rectification of SAR images based on the RPC rational function model.
Figure 1. GPU-accelerated pixel-by-pixel ortho-rectification of SAR images based on the RPC rational function model.
Remotesensing 16 01301 g001
Figure 2. Distribution of original experimental data.
Figure 2. Distribution of original experimental data.
Remotesensing 16 01301 g002
Figure 3. Orthorectified image results.
Figure 3. Orthorectified image results.
Remotesensing 16 01301 g003
Figure 4. Parallel speed-up ratio of SAR imagery ortho-rectification.
Figure 4. Parallel speed-up ratio of SAR imagery ortho-rectification.
Remotesensing 16 01301 g004
Figure 5. Parallel performance improvement ratio of SAR imagery ortho-rectification.
Figure 5. Parallel performance improvement ratio of SAR imagery ortho-rectification.
Remotesensing 16 01301 g005
Figure 6. Comparison of ortho-rectification time for SAR images.
Figure 6. Comparison of ortho-rectification time for SAR images.
Remotesensing 16 01301 g006
Table 1. Detailed table of experiment data from the Gaofen-3 satellite.
Table 1. Detailed table of experiment data from the Gaofen-3 satellite.
S/NImage IdentificationRange Resolution
(m)
Azimuth Resolution
(m)
Processing Level
1GF3-36409-11.531.12Level 1B
2GF3-36409-2
3GF3-36409-3
4GF3-29599-11.541.12
5GF3-29599-2
6GF3-29599-3
7GF3-29109-11.681.12
8GF3-29109-2
9GF3-29109-3
10GF3-29109-4
11GF3-27040-11.691.12
12GF3-27040-2
13GF3-27040-3
14GF3-27040-4
15GF3-29698-11.711.12
16GF3-29698-2
17GF3-29698-3
18GF3-26944-11.731.12
19GF3-26944-2
20GF3-26944-3
Table 2. Hardware parameters of the experimental platform.
Table 2. Hardware parameters of the experimental platform.
ItemTypeModel Parameter
CPU ConfigurationCPU Frequency2.6 GHz
Number of CPUChips 2
Number of CPU Cores48 cores
Memory ConfigurationMemory TypeDDR4
Total Memory Capacity384 GB
SSD Hard Disk ConfigurationNumber of SSD HardDisks 1
SSD Hard Disk Capacity512 GB
GPU Card ConfigurationNumber of GPUs2
GPU ModelNVIDIA A100 PCIE
GPU Computing Performance19.5 TFLOPS
GPU Memory Capacity40 GB
Table 3. Production time of the orthorectified image parallelization strategy.
Table 3. Production time of the orthorectified image parallelization strategy.
ResourceTime (s)ROSUROPI
Single CPU node536.77 //
Single GPU node43.49 12.34 91.90%
Four GPU nodes10.52 51.02 98.04%
Eight GPU nodes7.31 73.43 98.64%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Dong, L.; Zhang, T.; Liu, F.; Liu, R.; You, H. GPU Acceleration for SAR Satellite Image Ortho-Rectification. Remote Sens. 2024, 16, 1301. https://doi.org/10.3390/rs16071301

AMA Style

Dong L, Zhang T, Liu F, Liu R, You H. GPU Acceleration for SAR Satellite Image Ortho-Rectification. Remote Sensing. 2024; 16(7):1301. https://doi.org/10.3390/rs16071301

Chicago/Turabian Style

Dong, Lei, Tingtao Zhang, Fangjian Liu, Rui Liu, and Hongjian You. 2024. "GPU Acceleration for SAR Satellite Image Ortho-Rectification" Remote Sensing 16, no. 7: 1301. https://doi.org/10.3390/rs16071301

APA Style

Dong, L., Zhang, T., Liu, F., Liu, R., & You, H. (2024). GPU Acceleration for SAR Satellite Image Ortho-Rectification. Remote Sensing, 16(7), 1301. https://doi.org/10.3390/rs16071301

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop