2. CT Reconstruction: Problem Statement and Solutions Overview
CT reconstruction entails creating a digital representation of an object based on a collection of measured X-ray images or tomographic projections. This digital depiction represents a discrete spatial distribution of the linear attenuation coefficient of X-ray radiation.
2.1. Projection Image Model in Parallel-Beam Circular CT
The classical mathematical model for generating a CT projection image is based on the following assumptions:
- -
Monochromatic radiation is used for scanning;
- -
The imaging process is approximated with geometric optics;
- -
There are no radiation sources (primary or secondary) within the examined sample;
- -
Radiation attenuation depends on the absorptive properties of the material and follows the Bouguer–Beer–Lambert law;
- -
the detector only records the attenuated probing radiation. The detector cell has an infinitesimal size, a linear response function, and unit sensitivity.
The basic scheme for measuring projections with a parallel beam on an object is illustrated in
Figure 1.
When an object is probed with a parallel beam and the axis of rotation is perpendicular to the beam, we can analyze the CT problem on a plane without loss of generality. Consider a parallel set of planes perpendicular to the rotation axis. Measurements in each of these regions are independent. Let us take advantage of this and focus on a single plane.
The Cartesian coordinate system
in the plane aligns with the center of rotation of the source-detector system, and the spatial distribution of the linear attenuation coefficient
of the probing radiation is described by a finite function. In this coordinate system, we will use the standard parameterization of a line:
. All rays in the probing beam at one projection position share the same
coordinate. The image is captured by a planar position-sensitive detector located perpendicular to the probing direction. The
coordinate precisely locates the detector cell. For an infinitely thin X-ray beam at an angle
reaching the detector at
, the radiation attenuation law through the object is expressed as:
where
is the source’s radiant exitance, and
I is the irradiance of the detector cell. Normalizing by
and taking the logarithm yields the function
, referred to as the ray integral:
Through tomographic measurements, we acquire linear integrals of the function
along each straight line
ℓ. This process, known as the Radon transform, maps a function from Euclidean space to its set of linear integrals. Radon introduced an explicit inversion formula for an infinite set of straight lines in 1917 [
58]. Building on this, the problem of tomographic reconstruction involves recovering the function
when linear integrals are known for a finite set of straight lines. The arrangement of these lines is referred to as the measurement scheme, which is determined by the tomograph’s design, including the shape of the probing beam and the scanning scheme. Consequently, the reconstruction process must align with the chosen measurement scheme.
In practice, synchrotron radiation sources primarily employ monochromatic probing. Medical and industrial tomographs, on the other hand, utilize polychromatic radiation. Different approaches have been suggested to linearize the relationship between measurement results and the function describing attenuation. These methods vary from those needing extra calibration measurements [
59,
60] to fully automated techniques [
61,
62]. Note that using parallel beams for scanning is primarily a feature of synchrotrons. In laboratory settings, achieving a parallel scheme necessitates the incorporation of extra optical components in the tomograph setup. Conversely, when employing an X-ray tube to generate the beam without extra optical elements, a cone beam is formed. In this setup, the source is situated at the apex of the cone, while the detector rests in the plane of its base. The object being probed is located within the cone. The collection of rays composing a tomographic projection under the current angle in a cone scheme differs from that in a parallel scheme for the same angle.
Consider a circular scanning path. In tomographic research, measurements are taken along a specified finite number of directions C, which determine the set of projection angles . For each projection angle, the linearized measurements are recorded as a vector , where N represents the number of cells in the detector array (in the two-dimensional scenario). The measurements for all angles can be consolidated into a single vector . The set of rays constituting the vector for the current projection angle in a cone beam differs from the set of rays forming the vector in a parallel beam for the same angle.
To perform reconstruction, we need to produce measured data discretization first. For discretization, the reconstructed area is divided into a regular grid of square pixels. The number of pixels in the horizontal direction is the same as in the vertical direction, and it matches the number of detector cells N. This grid contains a total of elements, which can be expressed as a vector .
The vector
represents a 2D slice of the reconstructed 3D image. Ray integral values (
2) are approximated using sums. The model for generating projection data is expressed in matrix form:
where
is the projection matrix of size
. The elements
in this matrix specify each pixel’s contribution to the sum. This
matrix defines the measurement setup.
The dimensions of the projection matrix depend on the number of detector cells and the quantity of projection angles. Its configuration is influenced by factors like scanning path, probe shape, the number of projection angles, and their absolute values.
2.2. CT Reconstruction Algorithms
In the formulation (
3), the CT problem involves reconstructing a digital image of the studied object
given the known projection matrix
and the vector of linearized measured values
.
The matrix
is a sparse non-negative matrix, with elements representing weights calculated based on the chosen ray-pixel intersection model [
23]. We will treat the projection matrix
as a binary matrix for the forward projection operator in the natural basis of the introduced Cartesian coordinate system
. The value
of the projection matrix element at indices
i,
j equals 1 if and only if the X-ray beam intersects the pixel of the reconstructed object’s cross-section at coordinates
i,
j.
Various approaches have been proposed for reconstructing images from measured projections. Integral methods rely on the numerical implementation of the Radon transform inversion formulas. The most widely used method, found in most medical tomographs, is the convolution and backprojection technique.
2.3. CT Reconstruction Algorithms for Parallel Scanning Scheme
2.3.1. Convolution and Back-Projection Algorithms (Filtered BackProjection, FBP)
In tomography, a widely used family of algorithms for reconstructing images is based on the convolution and backprojection method, known as Filtered Back-Projection (FBP) [
63]. Buzug et al. [
23] demonstrated that with the matrix representation from (
3), the following relationship can be derived:
where
represents the backprojection operator matrix. The matrices
and
are filtering operators that can be applied either after or before the projection, respectively.
The convolution and backprojection method is a fast two-step approach. Initially, measured projections are convolved with a filter [
64]. Subsequently, a backprojection operation is conducted. Proposed optimizations targeted hardware solutions. Myagotin et al. presented an implementation of the method on multi-core processors [
65]. The method operates with low memory requirements due to its sequential execution. However, it requires a substantial number of projections. To ensure accurate reconstruction, projection angles should be evenly distributed within the 0 to 180-degree range, with the number of angles meeting the Nyquist criterion. Otherwise, additional data interpolation may be necessary [
66], potentially impacting reconstruction accuracy. In cases of limited projections, an algebraic reconstruction approach has demonstrated effectiveness.
2.3.2. Algebraic Reconstruction: SIRT (Simultaneous
Iterative Reconstruction Technique)
The algebraic approach to CT reconstruction, used alongside FBP [
67], treats (
3) as a system of linear algebraic equations, seeking a solution for
. Due to the system’s high dimensionality, direct methods for solving linear systems of equations are not feasible. Specialized algorithms have been proposed for this purpose [
68,
69]. In contrast to the algebraic reconstruction techniques proposed by Gordon et al. [
68], where solution vector values are updated sequentially, the SIRT method, introduced by Gilbert in 1972 [
69], updates all coordinates of the solution vector at each step. For each coordinate, the current value is calculated, taking into account all registered contributions. The solution at each iteration in matrix form is updated as follows:
where
is the relaxation parameter [
70] and
represents the matrix of the backprojection operator. The diagonal matrices
and
are of dimensions
and
, respectively. Their elements are computed using the following formulas:
and
. When the number of projection angles and/or the angle range are restricted, employing the Total Variation (TV) method [
71] for regularization yields a highly precise result. In such cases, the reconstruction is acquired by solving the convex optimization problem:
where
is the regularization parameter [
71]. The optimized expression, and thus the iteratively obtained solution, includes both forward projection and backprojection operations. While the algebraic approach to CT reconstruction demands more computational resources compared to the convolution and backprojection method, its significant advantage lies in its lack of strict limitations on the number and quality of tomographic projections, as well as its independence from uniform distribution of observed projection angles. Fast reconstruction using iterative algorithms can be achieved through two approaches. The first involves augmenting computational resources and devising methods for parallel processing [
72]. The second focuses on designing and utilizing algorithms with reduced computational complexity. While given specific measurement schemes, there are efficient algorithms for forward projection operator computation [
52], and fast computation of the backprojection operator is not guaranteed.
2.3.3. Neural Network-Based Reconstruction Techniques
The development of neural network-based approaches to tomographic reconstruction began in 1995 with the landmark work by Kerr et al. [
73]. They demonstrated that a neural network could produce tomographic images of comparable accuracy to those used in its training. This was based on the neural network’s capacity to discern and evaluate intricate functional relationships. The neural network was trained using reconstructions obtained through the FBP method. Nowadays, the integration of neural network models into reconstruction algorithms facilitates high-quality reconstructions in few-view CT [
74], especially in cases when the full range of angles is limited [
75,
76], or when the measured projections are noisy [
77]. The method’s groundbreaking applications, such as tomographic measurements with nanometer resolution, real-time CT, and studying dynamic processes, pose challenges for traditional methods. In neural network approaches, the operations of forward projection and backprojection remain the mathematical cornerstone.
2.4. Fast Approximation Schemes
Efficient CT reconstruction algorithms can be built with fast approximate computational schemes that utilize the Fast Hough Transform (FHT), also known as the Fast Discrete Radon Transform [
45,
78,
79,
80,
81]. The Brady–Yong algorithm [
45] approximates straight lines using discrete dyadic patterns. While these patterns enable optimized summation calculations, they exhibit some degree of approximation inaccuracy. For comprehensive insights into the general properties and practical applications of FHT in 2D cases, refer to [
82,
83].
In [
84], FHT was proposed for speeding up the Simultaneous Algebraic Reconstruction Technique (SART) [
85] in 2D reconstruction. The authors applied FHT for both forward projection operator calculation of residuals and for transposed operator calculation of corrections in the iterative scheme. This led to a reduction in the asymptotic complexity of a single iteration from
to
. Additionally, in [
86], a modification of the FBP algorithm, which employs FHT to speed up the most computationally intensive step (backprojection) is introduced. This modification allows for the image reconstruction with
addition operations and
multiplication operations.
In 3D CT reconstruction schemes, ref. [
35] demonstrated that summing over
patterns can be computed in
addition operations by utilizing a generalization of FHT for 3D introduced by Ershov et al. [
87]. However, ref. [
35] provides only a theoretical estimate and a general outline of the algorithm without a specific implementation, and the algorithm for the fast computation of the transposed operator was not discussed.
Thus, reducing the constant in the computation complexity of the forward projection algorithm and devising fast schemes for the transposed operator will substantially improve the efficiency of various CT reconstruction algorithms.
5. Experiments and Discussion
We tested the proposed general transposition method for summation-based algorithms by implementing efficient forward projection and backprojection operators for the two-dimensional scenario. The implementation, conducted in C++, followed the computational framework outlined in
Section 4.2: FHT computation with termination and aggregation. The optimized implementation of the algorithms prompted numerical experiments to gauge the speed and quality of their performance. The realization of the method was performed using our closed libraries for fast image processing to achieve a realistic execution time together with adequate comparison to classical methods. For this reason, unfortunately, the implementation can not be provided in open access. Although we hope that our detailed pseudo code implementations would be enough to reproduce the results.
We compared the quality of reconstruction in the case of parallel-beam circular CT. As reference methods for CT reconstruction, we employed the classical FBP method [
63] and the accelerated FBP for computed tomography image reconstruction (referred to as HFBP) from [
86]. The modified HFBP method, utilizing fast forward and backprojection operators obtained through the proposed transposition method, is denoted as HFBP-L. The reconstructions were acquired using the Smart Tomo Engine v.2.0.0 software [
90].
For our experiments, we selected the Shepp–Logan phantom model (see
Figure 7) with dimensions of
. The set of projections simulated measurements with a detector size of
N for
source rotation angles around the object’s center, with a uniform angle step from 0 to
. The projections were simulated in parallel geometry of the experiment as a simple forward projection, which can be reproduced by any open-source software for CT simulation.
The reconstruction results, obtained using the listed methods, are displayed in
Figure 7. The entire set of projection data was utilized for the reconstruction. It is important to note that in the case of the HFBP-L method, we applied optimal aggregation depth determined by corresponding formulas for
outlined in
Section 4.2.3 and
Section 4.2.5 for both forward projection and backprojection operators (with
).
To evaluate the performance of the reconstruction methods (refer to
Table 2), we employed numerical metrics including NRMSE, SSIM [
91], and STRESS [
92]. The NRMSE metric for the reconstructed image
is calculated as
, where
represents the vector of pixel values in the ideal phantom image.
The consistency in accuracy metrics between the HFBP and HFBP-L reconstruction methods is not coincidental. This confirms the validity of our algorithm implementation and the proposed aggregation approach. The algorithm’s accuracy should not be influenced by the aggregation level
, and the reconstruction outcome should be indistinguishable from the result of the same algorithm without aggregation, as evidenced by matching accuracy metrics. At the same time, according to the performance measurements, both HFBP and HFBP-L fall slightly behind the classical FBP algorithm, as they employ a less precise straight line approximation for the sake of speed. Nonetheless, the visual quality of reconstruction using HFBP and HFBP-L is quite satisfactory, with no significant distortions observed in the images (refer to
Figure 7).
Comparing algorithm speed, it is crucial to highlight that the distinction between HFBP and HFBP-L methods lies solely in the computation of the backprojection operator. HFBP employs the transposed Brady–Yong algorithm without aggregation, whereas HFBP-L utilizes the
algorithm (refer to
Section 4.2.5). When discussing execution time, the number of operations, or the algorithms’ asymptotic complexity, we specifically focus on the projection operators, excluding additional consistent costs for both methods.
Both HFBP and HFBP-L share identical asymptotic algorithmic complexities. However, HFBP-L displays superior speed, characterized by a constant factor. For instance, at
, HFBP-L requires at least
fewer addition operations than HFBP. And at
, this difference is at least
(assuming optimal aggregation depth as per formula (
55)).
Experimental measurements of algorithm execution time were conducted on a Windows 10 system with x64 architecture, driven by an AMD Ryzen 7 2700X processor clocked at 3.70 GHz, featuring a 16 MB L3 cache, and 64 GB of RAM. All measurements were executed in a single thread, and each measurement was repeated 1000 times. The recorded time values were averaged with an assessment of the standard deviation. The recorded time corresponds to the computation duration of the projection operation. Additionally, although computing the forward projection operator is not essential for HFBP and HFBP-L algorithms, corresponding values were measured for completeness and for comparison with theoretical dependencies. These values are also annotated in reference to their respective algorithm.
The computation time of both the forward projection and backprojection operators for the HFBP method is independent of and can be represented by a single value. Specifically, the computation time for the forward projection operator is ms, while for the backprojection operator, it is ms.
For the HFBP-L method, the computation time is influenced by both the number of projections, denoted by the parameter
, and the aggregation depth
. The computation time for the forward projection and backprojection operators is detailed in
Table 3 and
Table 4 respectively. Case
corresponds to computing the operator fully using the Brady–Yong method without termination.
As the number of projection directions increases, the overall computation time for the forward projection operator also rises. In the range of
, aggregation leads to time savings (refer to
Table 3). The most significant reduction in computation time for the forward projection operator, by
, is achieved at
.
In the computation of the backprojection operator within the HFBP-L method, optimizing the aggregation depth speeds up the process for
values within the range of
for the considered phantom (see
Table 4). The highest acceleration, 21.5%, is attainable at
for computing the backprojection operator.
It is worth noting that even with a zero aggregation level (), the computation time of the operators is influenced by the number of projections, despite the absence of aggregation. This arises from additional overhead costs related to the explicit formation of the straight line list.
The time values for computing the forward projection and backprojection operators, provided in
Table 3 and
Table 4, are represented as plots in
Figure 8a,b. The plot illustrates the difference in time compared to
for the corresponding
value. This facilitates comparison with the theoretical plots in
Section 4.2. The key distinction from theoretical calculations lies in the fact that the optimal aggregation depth,
, deviates from the theoretical value (refer to
Section 4.2). Moreover, for
, there is no optimal integer aggregation level that would lead to a time improvement in computing the forward projection and backprojection operators. Essentially, in these scenarios,
proves to be optimal.
In summary, the conducted experiments validate the theoretically grounded potential for accelerating reconstruction methods. This is achieved through a fast algorithm for computing the forward projection operator using FHT with termination and aggregation, and a fast algorithm for computing the backprojection operator, achieved by applying a common transposition technique for summation-based algorithms to the forward projection calculation. Time is saved by reducing the number of projection frames used in the reconstruction process. The proposed methods enable accelerations of up to for the forward projection operator and for the backprojection operator when compared to fast calculation methods based on the Brady–Yong algorithm. This acceleration is most pronounced when dealing with a small number of angles and utilizing the optimal aggregation depth . This outcome holds particular significance in the realm of few-view CT.
6. Conclusions
This work introduces a versatile method for transposing summation-based algorithms, which rely exclusively on addition operations. This method facilitates the efficient computation of the transpose of linear operators represented as Boolean matrices, assuming a known fast computation algorithm is available. Importantly, this transposition technique maintains the asymptotic complexity of the algorithms, ensuring consistent asymptotic algorithmic complexity for both the original and derived algorithms.
The summation-based transposition method holds significant promise in computer tomography, particularly in algorithms for computing forward projection and backprojection operators, where matrices are transposed in pairs. By applying this method to a known algorithm for computing the forward projection operator, we can derive an algorithm for computing the backprojection operator. The number of addition operations in the resulting algorithm align with the copy operations in the original, and vice versa.
In this study, for the first time, we present fast summation-based algorithms for computing forward projection and backprojection operators in 2D tomographic reconstruction, tailored for parallel-beam CT, especially suitable for few-view CT (FVCT). Although the asymptotic complexity remains at (where n represents the linear size of the reconstruction), consistent with the Brady–Yong algorithm, our proposed algorithms are superior in terms of constant factors.
We also extend the method to cone-beam 3D CT. Previously, a forward projection algorithm with a complexity of
was introduced for this setup [
35]. While the number and linear dimensions of the projections scale proportionally with
n, a fast algorithm for backprojection was lacking. In this study, we devised such an algorithm, also with a complexity of
.
Therefore, the summation-based transposition method serves as a versatile approach for developing fast algorithms in CT reconstruction, applicable across various measurement schemes, both in two and three-dimensional scenarios. Implementing this method with existing forward projection algorithms, such as [
35], adaptable to diverse measurement schemes, facilitates the creation of fast algorithms for computing the backprojection operator in any measurement setup.
We implemented the computation of the backprojection operator by transposing the algorithm for computing the forward projection operator based on FHT with termination and aggregation. This allowed us to assess the accuracy and speed of the new algorithm, comparing it with theoretical dependencies and experimental baselines. The results confirm the theoretically justified potential for accelerating classical reconstruction methods using this transposition method. They also suggest a minimum time depending on the chosen aggregation level. Notably, applying the transposed algorithm, which employs FHT with termination and aggregation, to a fraction of 0.01 of the considered projection directions during reconstruction led to a 15% increase in speed for computing the forward projection operator and a 21% increase for the backprojection operator, with visually insignificant degradation of the result.
Further research into the dynamics of the parameters, particularly the fraction of projections used for reconstruction, where the application of aggregation allows for time savings, is considered worthwhile. This should be explored for various linear sizes of reconstruction. Moreover, the intriguing potential of applying the proposed summation-based transposition method to algorithms computing the forward projection operator, particularly those based on cutting-edge, accurate, fast algorithms for Hough transforms, warrants attention. Employing this method in tandem with precise, fast algorithms such as those in [
55] could offer a promising avenue for achieving both speed and accuracy in reconstruction simultaneously.