1. Introduction
As a novel building element for modular construction, stainless steel core plates (SSCPs) have been successfully applied to build high-rise steel buildings [
1]. This form of structure comprises two skin panels held together with an array of thin-walled core tubes, which imitates the natural structure of honeycombs, as shown in
Figure 1. Because all the components are made of stainless steel, the floors and walls assembled by SSCPs have distinct advantages over standard concrete components, including anti-corrosion, light weight, high strength, high temperature resistance, and sound isolation. Instead of using adhesive, the skin panels and core tubes are connected by a copper-brazing technology which is processed in a dedicated hot wind (inert nitrogen) furnace [
2]. In the furnace, the hot wind blowing through the gaps of the tubes is controlled at a temperature of about 1030
. At this point, the copper foils pre-filled between the panels and tube ends are melted whereas the base materials are not, thereby eventually rendering one-time forming of all the brazing joints [
2,
3]. The quality of the brazing joint depends on several factors such as the heating temperature, heating/cooling rate, brazing time and flatness of the panel surface [
4]. It is difficult to maintain uniform and precise brazing parameters across the vast chamber of the furnace which accommodates the stacked large-size SSCPs (12 m × 2 m × 0.15 m in length, width and thickness). Brazing quality defects, such as missing solder and grain coarsening, still appear in actual production, which undoubtedly jeopardizes the mechanical properties of the brazing joint and thus the security of buildings. Therefore, it is necessary to carry out nondestructive testing (NDT) tasks to identify the defective products before they are transported to the construction site.
NDT methods, such as ultrasonic, X-ray, eddy current testing (ECT), and optical inspection, as well as AI methods (neural networks), are potential solutions to this problem [
2,
5]. In our previous studies [
2,
3], we have demonstrated that PECT has superiority over other techniques in the detection of SSCP brazing defects in aspects of detection speed, accuracy, usability for automated measurements, and cost. Analytical modelling was performed to reveal the underlying mechanism of PECT detection and predict the variation of signal with the presence of brazing defects. With the aid of an industrial robot, the probe was fast scanned on the SSCP specimen and C-scan images which visualized the brazing ring were obtained, providing a feasible solution for the quality check of SSCP products.
Compared with the time-domain, frequency-domain and impedance plane analysis, the imaging representation can provide spatial information of defects such as size, shape, location, orientation, and distribution [
6]. Meanwhile, imaging results are more intuitive and easily interpreted than those of traditional methods, especially for a beginner who grasps little about the ECT basics. In the past few decades, many researchers have proposed different eddy current imaging (ECI) methods including magneto-optical/eddy current imaging (MOI) [
7], multi-frequency eddy current imaging [
8], low-frequency eddy current imaging [
9] and pulsed eddy current imaging (PECI) [
10,
11]. Among these methods, PECI has gained much attention due to its advantages including the simplicity of the electronics and the ease of obtaining useful information from the acquired time-domain signals [
12].
A common feature for eddy current imaging is that the image is created using data extracted from the probe signals, which is apparently different from the optical or radio-graphic methods where the resulting images are directly filmed by the beam of light or rays. Therefore, the defect image is actually a convolution of the defect with the ECT probe, making defect readings strongly dependent on the quality of the probe signal. It is well documented that the measured signals are affected by many disturbing factors including the lift-off (probe-to-specimen distance) changes, probe-tilt, variations in specimen electromagnetic properties and surface condition, and the size of the probe footprint [
6,
13]. In our previous practice using PECI for SSCP defects, the probe is snake-scanned above the specimen with the aid of a robotic arm. The probe lift-off fluctuation caused by wobbling and tilting is inevitable during the experimental operation, producing artifacts that might hinder defect identifications and cause false calls. It is therefore appealing to develop a probe to eliminate or mitigate the effect of the probe lift-off changes on signal measurements. The other issue that occurred in imaging is the blurring effect, which renders the imaged brazing ring wider than its actual width. This phenomenon is due to the convolution of the point spread function of the probe with the imaging object [
2,
14]. The ECT images used in this work were formed by sampling the signal of the probe as it was scanned in a raster pattern over the SSCP specimen. The row and column spacing of the specimen is much less than the probe footprint, smoothly blurring the brazing ring and missing solder defects.
In the literature, many approaches have been proposed to address the two problems. Giguère et al. proposed a lift-off independent point in the time-domain PECT signal, called the lift-off point of intersection (LOI), to eliminate lift-off noise [
15]. Tian et al. proposed an approach using normalization and two reference signals from air measurement and defect-free sample measurement to reduce the lift-off effect with pulsed eddy current techniques [
16]. Yu et al. analyzed the lift-off effect by theoretical and experimental methods and proposed an approach to reduce lift-off noise based on the experimental phenomenon that the slope of the linear relationship is specific when the defect depth or width is constant for all lift-offs [
17]. Fan et al. proposed a phase of spectral PECT response as the feature immune to lift-off effect for thickness evaluation [
18]. Li et al. developed a two-stage differential PECT probe consisting of one excitation coil and two pairs of pickup-reference coils to suppress the lift-off effect [
19].
For the blurring of images, there have been studies focused on restoring the ECT images to match the actual defect dimensions using deconvolution, linear filtering and other image processing methods. Bahr et al. presented a model for eddy current imaging based on linear filtering and derived the point-spread functions of the probe by assuming that the quasistatic fields scattered by the flaw are proportional to immittance coefficients that are independent of the probe position [
20]. Groshong et al. presented an image restoration method by formulating image restoration as a maximum likelihood estimation problem, and then solving the problem using constrained iterative gradient descent [
21]. Balakrishnan et al. proposed a method for eddy current image fusion based on a discrete wavelet transform; the fusion results demonstrated that the selection of wavelet and fusion rule reduces the ambiguity and enhances the reliability of defect detection in both visual and qualitative evaluation [
22]. To improve defect recognition and offer accurate information about the defects, the employment of sophisticated algorithms to deblur defect images is a common means in optical imaging system. In image processing algorithms, both image segmentation [
23] and image thinning [
24] algorithms can remove image blurring. The K-means clustering algorithm is widely used for image segmentation because of its simplicity, ease of implementation, and high efficiency. This algorithm achieves deblurring by segmenting the image into foreground and background through clustering [
25]. However, the K-means algorithm alone cannot effectively remove image blur due to the similarity of pixel values in the blurred regions. Image thinning algorithms remove image blur by stripping unnecessary edges and points in the image layer-by-layer until a point can no longer be thinned. The Zhang-Suen algorithm, proposed by Zhang and Suen [
26], is an iterative parallel thinning algorithm that offers fast computation and preserves the continuity of the refined curve [
27]. However, this algorithm is only applicable to binary images, and the quality of the binary image significantly impacts the final processing results.
This study is designed as a follow-up study of ref. [
3] in order to improve the imaging results in the evaluation of partially missing solder in SSCP brazing joints. A PECT probe working in the differential mode is designed to weaken the lift-off effect, and a mask-based image segmentation and thinning method is used to remove the blur in C-scan images. The details of the probe structure, signal analysis, and image processing are elaborated in the following sections. In
Section 2, the generation of a C-scan image using PECT data is mathematically described. In
Section 3, a differential PECT probe is designed and the mechanism of reducing the lift-off effect is analyzed. Experimental work using the designed probe and the conventional probe was respectively conducted in
Section 4, which is followed by an analysis of the differential signal features for detecting missing solder in the SSCP specimen, as well as the C-scan images produced using both probes. In
Section 5, a mask-based image segmentation and thinning method is proposed to de-blur and quantitatively evaluate C-scan images of brazed joints. Finally, a brief conclusion is drawn.
2. Problem Description
As shown in
Figure 2, the C-scan is achieved by a number of superimposing parallel scans in one direction (called the testing axis; here
x) with a displacement (called the feeding axis; here
y) in the other direction. During the experiment, the PECT probe is lifted above the SSCP specimen, and the brazing joints are scanned contactlessly. For a single brazing joint, a raster step-scan with a resolution of 1 mm in both
x and
y directions is conducted. The starting point is defined as the origin and thus other points are positioned with corresponding coordinates. In this context, a matrix of PECT data generated with each element indexed to the
xoy plane coordinate is presented in the form of a C-scan image.
A C-scan PECT image formation can be written mathematically as follows [
27]:
where the terms of
g,
f and
n are two-dimensional matrices of size N × M elements. The matrix
f represents the original brazing ring,
D represents the point-spread function of the probe,
n is additive noise mainly referring to lift-off noise,
g is the observed image, and the notation
denotes the convolution operator.
The objective of designing a differential probe is to reduce lift-off noise n, while in this premise, the image processing is to produce an accurate profile of the original brazing f.
5. Image Processing
5.1. Image Processing Method
It can be observed in
Figure 13 that there is some blurring at the edges of the brazed ring in the grayscale image produced using the differential probe due to the convolution effect of the probe’s point spread function
D with the brazed ring
f. This blurring makes it challenging to quantitatively assess the width of the joints and the size of missing solder defects. To effectively address the image blurring problem and precisely evaluate the size of defects and brazed joints, we processed the C-scan grayscale images with a mask-based image segmentation and thinning method to generate restored images.
Given that for a brazed joint, the total time from raster scanning to the generation of a C-scan image is approximately 5 min, image preprocessing is essential to improve the efficiency of subsequent processing and reduce image restoration time. During image preprocessing, the region of interest (ROI) in grayscale images can be rapidly extracted using a masking technique to reduce the processing area, thereby decreasing computation load and shortening processing time [
29]. The preparation of a suitable mask image allows the extraction of the ROI without losing valuable image information. Blurring at the image edges indicates a reduction in high-frequency components within the image’s frequency domain, and a homomorphic filtering technique is applied during the mask preparation to enhance the high-frequency components, thereby achieving edge enhancement. A Canny operator is then applied for edge detection to identify the edges of the enhanced image. Morphological closure operations are performed to fill the contours from the edge detection results, producing a suitable mask image. Finally, a bitwise operation is performed between the mask image and the grayscale image to extract the ROI. The pixel values outside the ROI are set to zero, while those inside the ROI remain unchanged.
The K-means clustering algorithm, a classical unsupervised learning method, effectively classifies image pixels to reduce blur. In the initialization phase of the algorithm, K centroids are randomly selected as the initial clustering centers, where the value of K depends on the specific segmentation requirements. Subsequently, the Euclidean distance between each pixel in the image and the centroid is calculated, and pixels are assigned to the cluster of the nearest centroid based on the principle of minimum distance, where (, ) denotes the pixel point coordinates and (, ) denotes the centroid coordinates. This process is carried out through multiple iterations to ensure the gradual convergence of the centroid positions. In each iteration, the centroid is recalculated as the mean of all pixels in the cluster, and pixels are reassigned to the updated centroid. This iterative process continues until the centroids no longer change significantly. Through this clustering process, the K-means algorithm effectively segments the foreground and background, reduces image blurring, and improves overall image clarity. To remove image blurring, pixel points in the blurred region of the image should be clustered into well-brazed regions (foreground) and non-brazed regions (background). Therefore, in this paper, the number of clusters (K) is set to 2 to reflect this binary classification. This binary classification accurately differentiates the foreground from the background, ensuring that the edges of the brazed joints are clearly rendered and blurred areas are reduced, thus improving overall image clarity.
The result of the image clustering segmentation is a binary image. To remove the redundant information in the binary image caused by the blurring effect, the Zhang-Suen thinning algorithm is applied. The algorithm consists of two steps. In the first step, if the pixel point P with a pixel value of 1 meets the following conditions (a), (b), and (c), the pixel point P is labeled as a non-safe point and removed.
In the second step, the pixel point P is marked as a non-safe point for removal when it satisfies conditions (a), (b), and (d). Here,
represents the number of neighboring pixels around pixel point P with a pixel value of 1 in the eight-neighborhood, as shown in
Figure 14.
represents the number of times the pixel values P
1 to P
8 in the eight-neighborhood sequence are converted from 0 to 1. After processing all the pixel points in these two steps, the non-safe points are gradually removed, completing one iteration of the algorithm.
- (a)
;
- (b)
;
- (c)
and ;
- (d)
and
Since thinning is only necessary for removing image blur and not for forming a single-pixel skeleton, the number of iterations should be constrained. According to the literature [
23], the eddy current image blurring region exhibits uniform blurring in all directions. Therefore, the number of iterations
can be calculated using the following equation:
where
represents the radial width of the brazed joint in the image, while
represents the radial width of the brazed joint in reality, and
denotes the radial width reduction after one iteration of the thinning algorithm.
5.2. Image Processing Results
As shown in
Figure 15, with the application of masking and K-means clustering algorithms to the grayscale image, the resolution of the image is improved, the edges of the brazed joints are clearer, and the defects become easier to identify. However, the radial width
of the brazed joint in the image is about 4.64 mm, which is larger than the actual radial width
of the brazed joint, measuring 3.2 mm. Additionally, the detected size of partially missing solder defects is smaller than their actual size. This is because the K-means algorithm calculates the centers of each cluster during the clustering process and classifies pixels based on these centers. In areas where the grayscale variation in the ROI is not significant, the location of the cluster centers may result in the neighboring pixels incorrectly assigned to the brazing area, causing overestimation of the radial width of the brazed joint and underestimation of the defect size. Subsequently, the binary image is processed using the Zhang-Suen thinning algorithm. The radial width reduction
after one iteration is approximately 0.092 mm. By substituting the relevant parameters into Equation (2), the number of iterations
is calculated to be 15.
After 15 iterations of the thinning process, the radial width of the brazed joints in the binary image is about 3.2 mm, and the size of the missing solder defects matches the actual defect sizes. For well-bonded brazing and the presence of 1/24, 1/8, and 5/24 missing solder, the total image processing time required for image restoration differs, taking 4.93, 4.73, 4.59, and 4.37 s, respectively. This is because the number of pixel points with a value of 1 varies in each binary image when executing the thinning algorithm, leading to a varying number of executions of criteria (a) to (d) in each iteration, which results in different image processing times. The total time for all image processing is kept under 5 s, which can fully meet industrial requirements.